2023-12-06T14:36:38.256 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-06T14:36:38.257 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/adking-2023-12-06_14:29:19-orch:cephadm-wip-adk-testing-2023-12-05-1905-distro-default-smithi/7480270 --name adking-2023-12-06_14:29:19-orch:cephadm-wip-adk-testing-2023-12-05-1905-distro-default-smithi --description orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} --owner scheduled_adking@teuthology --verbose -- /home/teuthworker/archive/adking-2023-12-06_14:29:19-orch:cephadm-wip-adk-testing-2023-12-05-1905-distro-default-smithi/7480270/orig.config.yaml 2023-12-06T14:36:38.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-06T14:36:38.392 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/adking-2023-12-06_14:29:19-orch:cephadm-wip-adk-testing-2023-12-05-1905-distro-default-smithi/7480270 branch: wip-adk-testing-2023-12-05-1905 description: orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: adking@redhat.com first_in_suite: false job_id: '7480270' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: adking-2023-12-06_14:29:19-orch:cephadm-wip-adk-testing-2023-12-05-1905-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-adk-testing-2023-12-05-1905 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 0482646fcf78576d871bc87843257d82edb79541 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 0482646fcf78576d871bc87843257d82edb79541 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-adk-testing-2023-12-05-1905 sha1: 0482646fcf78576d871bc87843257d82edb79541 owner: scheduled_adking@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 2836 sha1: 0482646fcf78576d871bc87843257d82edb79541 sleep_before_teardown: 0 subset: 1/14 suite: orch:cephadm suite_branch: wip-adk-testing-2023-12-05-1905 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_0482646fcf78576d871bc87843257d82edb79541/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 0482646fcf78576d871bc87843257d82edb79541 targets: smithi152.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAGZVRlFHxrIzzq3xXuUbpXjLuiky7MinfUvixOnItkg9xA3I3/4H7rfA2BozkHRZUv2o66qU5nOEYSlvNWbJwQ= smithi190.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLZX2VRnca7s6Qk9yipVo+7S/Ug6IDq6WEYevg+VDOpKVyZ+f3JdIE2KyYOIfDCPLR5BdhFW8Fm65g6K+XgncHs= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /cephfs/home/adking/src/git.ceph.com_ceph-c_wip-adk-testing-2023-12-05-1905/qa/suites/orch/cephadm/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: f2de108beb0a6dde7f3e6c96039071828a1f6269 timestamp: 2023-12-06_14:29:19 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: adking verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2023-12-06T14:36:38.392 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_0482646fcf78576d871bc87843257d82edb79541/qa; will attempt to use it 2023-12-06T14:36:38.393 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_0482646fcf78576d871bc87843257d82edb79541/qa/tasks 2023-12-06T14:36:38.393 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-06T14:36:38.394 INFO:teuthology.task.internal:Checking packages... 2023-12-06T14:36:38.418 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '0482646fcf78576d871bc87843257d82edb79541' 2023-12-06T14:36:38.418 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-06T14:36:38.418 INFO:teuthology.packaging:ref: None 2023-12-06T14:36:38.418 INFO:teuthology.packaging:tag: None 2023-12-06T14:36:38.418 INFO:teuthology.packaging:branch: wip-adk-testing-2023-12-05-1905 2023-12-06T14:36:38.418 INFO:teuthology.packaging:sha1: 0482646fcf78576d871bc87843257d82edb79541 2023-12-06T14:36:38.418 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-adk-testing-2023-12-05-1905 2023-12-06T14:36:38.558 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-26.g0482646f 2023-12-06T14:36:38.559 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-06T14:36:38.566 INFO:teuthology.task.internal:no buildpackages task found 2023-12-06T14:36:38.566 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-06T14:36:38.597 INFO:teuthology.task.internal:Saving configuration 2023-12-06T14:36:38.622 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-06T14:36:38.628 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-06T14:36:38.654 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-12-06_14:29:19-orch:cephadm-wip-adk-testing-2023-12-05-1905-distro-default-smithi/7480270', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-06 14:31:12.785954', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAGZVRlFHxrIzzq3xXuUbpXjLuiky7MinfUvixOnItkg9xA3I3/4H7rfA2BozkHRZUv2o66qU5nOEYSlvNWbJwQ='} 2023-12-06T14:36:38.680 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-12-06_14:29:19-orch:cephadm-wip-adk-testing-2023-12-05-1905-distro-default-smithi/7480270', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-06 14:31:12.784641', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLZX2VRnca7s6Qk9yipVo+7S/Ug6IDq6WEYevg+VDOpKVyZ+f3JdIE2KyYOIfDCPLR5BdhFW8Fm65g6K+XgncHs='} 2023-12-06T14:36:38.680 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-06T14:36:38.689 INFO:teuthology.task.internal:roles: ubuntu@smithi152.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2023-12-06T14:36:38.689 INFO:teuthology.task.internal:roles: ubuntu@smithi190.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2023-12-06T14:36:38.689 INFO:teuthology.run_tasks:Running task console_log... 2023-12-06T14:36:38.807 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fefcaf23a60>, signals=[15]) 2023-12-06T14:36:38.808 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-06T14:36:38.814 INFO:teuthology.task.internal:Opening connections... 2023-12-06T14:36:38.814 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi152.front.sepia.ceph.com 2023-12-06T14:36:38.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T14:36:38.922 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi190.front.sepia.ceph.com 2023-12-06T14:36:38.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T14:36:38.989 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-06T14:36:38.996 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2023-12-06T14:36:39.018 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2023-12-06T14:36:39.018 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2023-12-06T14:36:39.079 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2023-12-06T14:36:39.080 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8" 2023-12-06T14:36:39.080 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2023-12-06T14:36:39.080 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2023-12-06T14:36:39.080 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8" 2023-12-06T14:36:39.080 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8" 2023-12-06T14:36:39.080 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-06T14:36:39.080 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2023-12-06T14:36:39.080 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-06T14:36:39.080 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2023-12-06T14:36:39.080 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-06T14:36:39.080 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-06T14:36:39.080 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-06T14:36:39.081 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2023-12-06T14:36:39.105 DEBUG:teuthology.orchestra.run.smithi190:> uname -m 2023-12-06T14:36:39.127 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2023-12-06T14:36:39.127 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-12-06T14:36:39.189 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="CentOS Stream" 2023-12-06T14:36:39.189 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8" 2023-12-06T14:36:39.189 INFO:teuthology.orchestra.run.smithi190.stdout:ID="centos" 2023-12-06T14:36:39.189 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="rhel fedora" 2023-12-06T14:36:39.189 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8" 2023-12-06T14:36:39.189 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2023-12-06T14:36:39.189 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-06T14:36:39.189 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2023-12-06T14:36:39.189 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-06T14:36:39.189 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://centos.org/" 2023-12-06T14:36:39.190 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-06T14:36:39.190 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-06T14:36:39.190 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-06T14:36:39.190 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-12-06T14:36:39.213 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-06T14:36:39.222 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-06T14:36:39.291 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-06T14:36:39.291 DEBUG:teuthology.orchestra.run.smithi152:> test '!' -e /home/ubuntu/cephtest 2023-12-06T14:36:39.294 DEBUG:teuthology.orchestra.run.smithi190:> test '!' -e /home/ubuntu/cephtest 2023-12-06T14:36:39.314 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-06T14:36:39.327 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-06T14:36:39.327 DEBUG:teuthology.orchestra.run.smithi152:> test -z $(ls -A /var/lib/ceph) 2023-12-06T14:36:39.354 DEBUG:teuthology.orchestra.run.smithi190:> test -z $(ls -A /var/lib/ceph) 2023-12-06T14:36:39.391 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-06T14:36:39.447 INFO:teuthology.run_tasks:Running task kernel... 2023-12-06T14:36:39.461 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-12-06T14:36:39.461 INFO:teuthology.task.kernel:config {'host.a': {'kdb': True, 'sha1': 'distro'}, 'host.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-12-06T14:36:39.461 DEBUG:teuthology.orchestra.run.smithi152:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-06T14:36:39.462 DEBUG:teuthology.orchestra.run.smithi190:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-06T14:36:39.481 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-06T14:36:39.482 DEBUG:teuthology.orchestra.run.smithi152:> uname -r 2023-12-06T14:36:39.483 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-06T14:36:39.483 DEBUG:teuthology.orchestra.run.smithi190:> uname -r 2023-12-06T14:36:39.543 INFO:teuthology.orchestra.run.smithi152.stdout:4.18.0-489.el8.x86_64 2023-12-06T14:36:39.543 INFO:teuthology.task.kernel:Running kernel on smithi152: 4.18.0-489.el8.x86_64 2023-12-06T14:36:39.544 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum install -y kernel 2023-12-06T14:36:39.545 INFO:teuthology.orchestra.run.smithi190.stdout:4.18.0-489.el8.x86_64 2023-12-06T14:36:39.545 INFO:teuthology.task.kernel:Running kernel on smithi190: 4.18.0-489.el8.x86_64 2023-12-06T14:36:39.545 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum install -y kernel 2023-12-06T14:36:44.397 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS Stream 8 - AppStream 14 MB/s | 34 MB 00:02 2023-12-06T14:36:44.673 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 8 - AppStream 13 MB/s | 34 MB 00:02 2023-12-06T14:36:52.170 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS Stream 8 - BaseOS 37 MB/s | 55 MB 00:01 2023-12-06T14:36:53.096 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 8 - BaseOS 25 MB/s | 55 MB 00:02 2023-12-06T14:37:00.553 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS Stream 8 - Extras 44 kB/s | 18 kB 00:00 2023-12-06T14:37:00.896 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS Stream 8 - Extras common packages 44 kB/s | 6.9 kB 00:00 2023-12-06T14:37:01.231 INFO:teuthology.orchestra.run.smithi190.stdout:Copr repo for python3-asyncssh owned by ceph 20 kB/s | 3.5 kB 00:00 2023-12-06T14:37:01.539 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 8 - Extras 32 kB/s | 18 kB 00:00 2023-12-06T14:37:02.048 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 8 - Extras common packages 21 kB/s | 6.9 kB 00:00 2023-12-06T14:37:02.050 INFO:teuthology.orchestra.run.smithi190.stdout:Extra Packages for Enterprise Linux 24 MB/s | 16 MB 00:00 2023-12-06T14:37:02.366 INFO:teuthology.orchestra.run.smithi152.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-12-06T14:37:04.859 INFO:teuthology.orchestra.run.smithi152.stdout:Extra Packages for Enterprise Linux 6.8 MB/s | 16 MB 00:02 2023-12-06T14:37:05.898 INFO:teuthology.orchestra.run.smithi190.stdout:lab-extras 567 kB/s | 24 kB 00:00 2023-12-06T14:37:08.717 INFO:teuthology.orchestra.run.smithi152.stdout:lab-extras 440 kB/s | 24 kB 00:00 2023-12-06T14:37:09.631 INFO:teuthology.orchestra.run.smithi190.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-12-06T14:37:09.631 INFO:teuthology.orchestra.run.smithi190.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-12-06T14:37:09.908 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2023-12-06T14:37:09.909 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:37:09.909 INFO:teuthology.orchestra.run.smithi190.stdout: Package Architecture Version Repository Size 2023-12-06T14:37:09.909 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:37:09.909 INFO:teuthology.orchestra.run.smithi190.stdout:Installing: 2023-12-06T14:37:09.910 INFO:teuthology.orchestra.run.smithi190.stdout: kernel x86_64 4.18.0-526.el8 baseos 10 M 2023-12-06T14:37:09.910 INFO:teuthology.orchestra.run.smithi190.stdout:Installing dependencies: 2023-12-06T14:37:09.910 INFO:teuthology.orchestra.run.smithi190.stdout: kernel-core x86_64 4.18.0-526.el8 baseos 43 M 2023-12-06T14:37:09.910 INFO:teuthology.orchestra.run.smithi190.stdout: kernel-modules x86_64 4.18.0-526.el8 baseos 36 M 2023-12-06T14:37:09.910 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:37:09.910 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction Summary 2023-12-06T14:37:09.910 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:37:09.910 INFO:teuthology.orchestra.run.smithi190.stdout:Install 3 Packages 2023-12-06T14:37:09.910 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:37:09.911 INFO:teuthology.orchestra.run.smithi190.stdout:Total download size: 90 M 2023-12-06T14:37:09.911 INFO:teuthology.orchestra.run.smithi190.stdout:Installed size: 96 M 2023-12-06T14:37:09.911 INFO:teuthology.orchestra.run.smithi190.stdout:Downloading Packages: 2023-12-06T14:37:12.333 INFO:teuthology.orchestra.run.smithi152.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-12-06T14:37:12.334 INFO:teuthology.orchestra.run.smithi152.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-12-06T14:37:12.623 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-06T14:37:12.624 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:37:12.624 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2023-12-06T14:37:12.624 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:37:12.624 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2023-12-06T14:37:12.624 INFO:teuthology.orchestra.run.smithi152.stdout: kernel x86_64 4.18.0-526.el8 baseos 10 M 2023-12-06T14:37:12.624 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2023-12-06T14:37:12.624 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-core x86_64 4.18.0-526.el8 baseos 43 M 2023-12-06T14:37:12.624 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules x86_64 4.18.0-526.el8 baseos 36 M 2023-12-06T14:37:12.624 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:37:12.624 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-12-06T14:37:12.624 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:37:12.624 INFO:teuthology.orchestra.run.smithi152.stdout:Install 3 Packages 2023-12-06T14:37:12.625 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:37:12.625 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 90 M 2023-12-06T14:37:12.625 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 96 M 2023-12-06T14:37:12.625 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-12-06T14:37:13.940 INFO:teuthology.orchestra.run.smithi190.stdout:(1/3): kernel-4.18.0-526.el8.x86_64.rpm 3.6 MB/s | 10 MB 00:02 2023-12-06T14:37:14.469 INFO:teuthology.orchestra.run.smithi152.stdout:(1/3): kernel-4.18.0-526.el8.x86_64.rpm 5.6 MB/s | 10 MB 00:01 2023-12-06T14:37:15.461 INFO:teuthology.orchestra.run.smithi152.stdout:(2/3): kernel-modules-4.18.0-526.el8.x86_64.rpm 13 MB/s | 36 MB 00:02 2023-12-06T14:37:16.315 INFO:teuthology.orchestra.run.smithi190.stdout:(2/3): kernel-core-4.18.0-526.el8.x86_64.rpm 8.3 MB/s | 43 MB 00:05 2023-12-06T14:37:17.011 INFO:teuthology.orchestra.run.smithi152.stdout:(3/3): kernel-core-4.18.0-526.el8.x86_64.rpm 10 MB/s | 43 MB 00:04 2023-12-06T14:37:17.011 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-12-06T14:37:17.011 INFO:teuthology.orchestra.run.smithi152.stdout:Total 20 MB/s | 90 MB 00:04 2023-12-06T14:37:17.690 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-12-06T14:37:18.100 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-12-06T14:37:18.100 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-12-06T14:37:19.328 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-12-06T14:37:19.345 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-12-06T14:37:22.121 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-12-06T14:37:22.676 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-core-4.18.0-526.el8.x86_64 1/3 2023-12-06T14:37:23.398 INFO:teuthology.orchestra.run.smithi190.stdout:(3/3): kernel-modules-4.18.0-526.el8.x86_64.rpm 2.9 MB/s | 36 MB 00:12 2023-12-06T14:37:23.398 INFO:teuthology.orchestra.run.smithi190.stdout:-------------------------------------------------------------------------------- 2023-12-06T14:37:23.399 INFO:teuthology.orchestra.run.smithi190.stdout:Total 6.6 MB/s | 90 MB 00:13 2023-12-06T14:37:24.073 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction check 2023-12-06T14:37:24.500 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction check succeeded. 2023-12-06T14:37:24.500 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction test 2023-12-06T14:37:25.757 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction test succeeded. 2023-12-06T14:37:25.783 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction 2023-12-06T14:37:26.258 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-core-4.18.0-526.el8.x86_64 1/3 2023-12-06T14:37:26.633 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-modules-4.18.0-526.el8.x86_64 2/3 2023-12-06T14:37:28.573 INFO:teuthology.orchestra.run.smithi190.stdout: Preparing : 1/1 2023-12-06T14:37:29.070 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : kernel-core-4.18.0-526.el8.x86_64 1/3 2023-12-06T14:37:30.072 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-modules-4.18.0-526.el8.x86_64 2/3 2023-12-06T14:37:30.354 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-4.18.0-526.el8.x86_64 3/3 2023-12-06T14:37:32.601 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: kernel-core-4.18.0-526.el8.x86_64 1/3 2023-12-06T14:37:32.969 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : kernel-modules-4.18.0-526.el8.x86_64 2/3 2023-12-06T14:37:36.398 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: kernel-modules-4.18.0-526.el8.x86_64 2/3 2023-12-06T14:37:36.683 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : kernel-4.18.0-526.el8.x86_64 3/3 2023-12-06T14:37:52.115 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-core-4.18.0-526.el8.x86_64 3/3 2023-12-06T14:37:52.138 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-modules-4.18.0-526.el8.x86_64 3/3 2023-12-06T14:37:52.494 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-4.18.0-526.el8.x86_64 3/3 2023-12-06T14:37:52.494 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-4.18.0-526.el8.x86_64 1/3 2023-12-06T14:37:52.495 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-core-4.18.0-526.el8.x86_64 2/3 2023-12-06T14:37:53.278 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-modules-4.18.0-526.el8.x86_64 3/3 2023-12-06T14:37:53.278 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:37:53.278 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-12-06T14:37:53.278 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-4.18.0-526.el8.x86_64 kernel-core-4.18.0-526.el8.x86_64 2023-12-06T14:37:53.278 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules-4.18.0-526.el8.x86_64 2023-12-06T14:37:53.278 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:37:53.278 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-06T14:37:53.426 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q kernel | sort -rV | head -n 1 2023-12-06T14:37:53.643 INFO:teuthology.orchestra.run.smithi152.stdout:kernel-4.18.0-526.el8.x86_64 2023-12-06T14:37:53.644 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-526.el8.x86_64 2023-12-06T14:37:53.644 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-526.el8.x86_64 2023-12-06T14:37:53.644 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-06T14:37:53.644 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-06T14:37:53.644 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2023-12-06T14:37:53.644 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi152.front.sepia.ceph.com, path=None, version=distro) 2023-12-06T14:37:53.644 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q kernel | sort -rV | head -n 1 2023-12-06T14:37:53.853 INFO:teuthology.orchestra.run.smithi152.stdout:kernel-4.18.0-526.el8.x86_64 2023-12-06T14:37:53.854 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-526.el8.x86_64 2023-12-06T14:37:53.854 DEBUG:teuthology.orchestra.run.smithi152:> sudo rpm -qi grub2-tools 2023-12-06T14:37:53.887 INFO:teuthology.orchestra.run.smithi152.stdout:Name : grub2-tools 2023-12-06T14:37:53.887 INFO:teuthology.orchestra.run.smithi152.stdout:Epoch : 1 2023-12-06T14:37:53.887 INFO:teuthology.orchestra.run.smithi152.stdout:Version : 2.02 2023-12-06T14:37:53.888 INFO:teuthology.orchestra.run.smithi152.stdout:Release : 129.el8 2023-12-06T14:37:53.888 INFO:teuthology.orchestra.run.smithi152.stdout:Architecture: x86_64 2023-12-06T14:37:53.888 INFO:teuthology.orchestra.run.smithi152.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-12-06T14:37:53.888 INFO:teuthology.orchestra.run.smithi152.stdout:Group : System Environment/Base 2023-12-06T14:37:53.888 INFO:teuthology.orchestra.run.smithi152.stdout:Size : 9265586 2023-12-06T14:37:53.888 INFO:teuthology.orchestra.run.smithi152.stdout:License : GPLv3+ 2023-12-06T14:37:53.888 INFO:teuthology.orchestra.run.smithi152.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-12-06T14:37:53.888 INFO:teuthology.orchestra.run.smithi152.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-12-06T14:37:53.888 INFO:teuthology.orchestra.run.smithi152.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-12-06T14:37:53.888 INFO:teuthology.orchestra.run.smithi152.stdout:Build Host : kbuilder.bsys.centos.org 2023-12-06T14:37:53.888 INFO:teuthology.orchestra.run.smithi152.stdout:Relocations : (not relocatable) 2023-12-06T14:37:53.888 INFO:teuthology.orchestra.run.smithi152.stdout:Packager : CentOS BuildSystem 2023-12-06T14:37:53.888 INFO:teuthology.orchestra.run.smithi152.stdout:Vendor : CentOS 2023-12-06T14:37:53.888 INFO:teuthology.orchestra.run.smithi152.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-06T14:37:53.889 INFO:teuthology.orchestra.run.smithi152.stdout:Summary : Support tools for GRUB. 2023-12-06T14:37:53.889 INFO:teuthology.orchestra.run.smithi152.stdout:Description : 2023-12-06T14:37:53.889 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:37:53.889 INFO:teuthology.orchestra.run.smithi152.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-06T14:37:53.889 INFO:teuthology.orchestra.run.smithi152.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-06T14:37:53.889 INFO:teuthology.orchestra.run.smithi152.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-06T14:37:53.889 INFO:teuthology.orchestra.run.smithi152.stdout:hardware devices. 2023-12-06T14:37:53.889 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:37:53.889 INFO:teuthology.orchestra.run.smithi152.stdout:This subpackage provides tools for support of all platforms. 2023-12-06T14:37:53.890 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-06T14:37:53.890 INFO:teuthology.task.kernel:Updating grub on smithi152 to boot 4.18.0-526.el8.x86_64 2023-12-06T14:37:53.890 DEBUG:teuthology.orchestra.run.smithi152:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-06T14:37:55.687 INFO:teuthology.orchestra.run.smithi152.stderr:Generating grub configuration file ... 2023-12-06T14:37:58.130 INFO:teuthology.orchestra.run.smithi152.stderr:done 2023-12-06T14:37:58.132 DEBUG:teuthology.orchestra.run.smithi152:> mktemp 2023-12-06T14:37:58.154 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.zEZjTw71Ig 2023-12-06T14:37:58.155 DEBUG:teuthology.orchestra.run.smithi152:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.zEZjTw71Ig 2023-12-06T14:37:58.230 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0666 /tmp/tmp.zEZjTw71Ig 2023-12-06T14:37:58.368 DEBUG:teuthology.orchestra.remote:smithi152:/tmp/tmp.zEZjTw71Ig is 6KB 2023-12-06T14:37:58.416 DEBUG:teuthology.orchestra.run.smithi152:> rm -fr /tmp/tmp.zEZjTw71Ig 2023-12-06T14:37:58.434 DEBUG:teuthology.orchestra.run.smithi152:> sudo /bin/ls /boot/loader/entries || true 2023-12-06T14:37:58.499 INFO:teuthology.orchestra.run.smithi152.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-12-06T14:37:58.499 INFO:teuthology.orchestra.run.smithi152.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-12-06T14:37:58.499 INFO:teuthology.orchestra.run.smithi152.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-12-06T14:37:58.499 INFO:teuthology.orchestra.run.smithi152.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-526.el8.x86_64.conf 2023-12-06T14:37:58.500 DEBUG:teuthology.orchestra.run.smithi152:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-526.el8.x86_64 2023-12-06T14:37:58.531 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: kernel-core-4.18.0-526.el8.x86_64 3/3 2023-12-06T14:37:58.555 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: kernel-modules-4.18.0-526.el8.x86_64 3/3 2023-12-06T14:37:58.665 DEBUG:teuthology.orchestra.run.smithi152:> sudo shutdown -r now 2023-12-06T14:37:58.899 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: kernel-4.18.0-526.el8.x86_64 3/3 2023-12-06T14:37:58.899 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : kernel-4.18.0-526.el8.x86_64 1/3 2023-12-06T14:37:58.899 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : kernel-core-4.18.0-526.el8.x86_64 2/3 2023-12-06T14:37:59.676 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : kernel-modules-4.18.0-526.el8.x86_64 3/3 2023-12-06T14:37:59.676 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:37:59.677 INFO:teuthology.orchestra.run.smithi190.stdout:Installed: 2023-12-06T14:37:59.677 INFO:teuthology.orchestra.run.smithi190.stdout: kernel-4.18.0-526.el8.x86_64 kernel-core-4.18.0-526.el8.x86_64 2023-12-06T14:37:59.677 INFO:teuthology.orchestra.run.smithi190.stdout: kernel-modules-4.18.0-526.el8.x86_64 2023-12-06T14:37:59.677 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:37:59.677 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2023-12-06T14:37:59.813 DEBUG:teuthology.orchestra.run.smithi190:> rpm -q kernel | sort -rV | head -n 1 2023-12-06T14:38:00.028 INFO:teuthology.orchestra.run.smithi190.stdout:kernel-4.18.0-526.el8.x86_64 2023-12-06T14:38:00.028 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-526.el8.x86_64 2023-12-06T14:38:00.028 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-526.el8.x86_64 2023-12-06T14:38:00.029 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-06T14:38:00.029 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-06T14:38:00.029 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2023-12-06T14:38:00.029 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi190.front.sepia.ceph.com, path=None, version=distro) 2023-12-06T14:38:00.029 DEBUG:teuthology.orchestra.run.smithi190:> rpm -q kernel | sort -rV | head -n 1 2023-12-06T14:38:00.241 INFO:teuthology.orchestra.run.smithi190.stdout:kernel-4.18.0-526.el8.x86_64 2023-12-06T14:38:00.242 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-526.el8.x86_64 2023-12-06T14:38:00.242 DEBUG:teuthology.orchestra.run.smithi190:> sudo rpm -qi grub2-tools 2023-12-06T14:38:00.276 INFO:teuthology.orchestra.run.smithi190.stdout:Name : grub2-tools 2023-12-06T14:38:00.276 INFO:teuthology.orchestra.run.smithi190.stdout:Epoch : 1 2023-12-06T14:38:00.276 INFO:teuthology.orchestra.run.smithi190.stdout:Version : 2.02 2023-12-06T14:38:00.276 INFO:teuthology.orchestra.run.smithi190.stdout:Release : 129.el8 2023-12-06T14:38:00.276 INFO:teuthology.orchestra.run.smithi190.stdout:Architecture: x86_64 2023-12-06T14:38:00.276 INFO:teuthology.orchestra.run.smithi190.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-12-06T14:38:00.276 INFO:teuthology.orchestra.run.smithi190.stdout:Group : System Environment/Base 2023-12-06T14:38:00.276 INFO:teuthology.orchestra.run.smithi190.stdout:Size : 9265586 2023-12-06T14:38:00.277 INFO:teuthology.orchestra.run.smithi190.stdout:License : GPLv3+ 2023-12-06T14:38:00.277 INFO:teuthology.orchestra.run.smithi190.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-12-06T14:38:00.277 INFO:teuthology.orchestra.run.smithi190.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-12-06T14:38:00.277 INFO:teuthology.orchestra.run.smithi190.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-12-06T14:38:00.277 INFO:teuthology.orchestra.run.smithi190.stdout:Build Host : kbuilder.bsys.centos.org 2023-12-06T14:38:00.277 INFO:teuthology.orchestra.run.smithi190.stdout:Relocations : (not relocatable) 2023-12-06T14:38:00.277 INFO:teuthology.orchestra.run.smithi190.stdout:Packager : CentOS BuildSystem 2023-12-06T14:38:00.277 INFO:teuthology.orchestra.run.smithi190.stdout:Vendor : CentOS 2023-12-06T14:38:00.277 INFO:teuthology.orchestra.run.smithi190.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-06T14:38:00.277 INFO:teuthology.orchestra.run.smithi190.stdout:Summary : Support tools for GRUB. 2023-12-06T14:38:00.277 INFO:teuthology.orchestra.run.smithi190.stdout:Description : 2023-12-06T14:38:00.277 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:38:00.277 INFO:teuthology.orchestra.run.smithi190.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-06T14:38:00.277 INFO:teuthology.orchestra.run.smithi190.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-06T14:38:00.277 INFO:teuthology.orchestra.run.smithi190.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-06T14:38:00.278 INFO:teuthology.orchestra.run.smithi190.stdout:hardware devices. 2023-12-06T14:38:00.278 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:38:00.278 INFO:teuthology.orchestra.run.smithi190.stdout:This subpackage provides tools for support of all platforms. 2023-12-06T14:38:00.278 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-06T14:38:00.279 INFO:teuthology.task.kernel:Updating grub on smithi190 to boot 4.18.0-526.el8.x86_64 2023-12-06T14:38:00.279 DEBUG:teuthology.orchestra.run.smithi190:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-06T14:38:01.900 INFO:teuthology.orchestra.run.smithi190.stderr:Generating grub configuration file ... 2023-12-06T14:38:04.304 INFO:teuthology.orchestra.run.smithi190.stderr:done 2023-12-06T14:38:04.305 DEBUG:teuthology.orchestra.run.smithi190:> mktemp 2023-12-06T14:38:04.339 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.eMmOWfW4rs 2023-12-06T14:38:04.340 DEBUG:teuthology.orchestra.run.smithi190:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.eMmOWfW4rs 2023-12-06T14:38:04.414 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.eMmOWfW4rs 2023-12-06T14:38:04.557 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.eMmOWfW4rs is 6KB 2023-12-06T14:38:04.605 DEBUG:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.eMmOWfW4rs 2023-12-06T14:38:04.623 DEBUG:teuthology.orchestra.run.smithi190:> sudo /bin/ls /boot/loader/entries || true 2023-12-06T14:38:04.707 INFO:teuthology.orchestra.run.smithi190.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-12-06T14:38:04.707 INFO:teuthology.orchestra.run.smithi190.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-12-06T14:38:04.708 INFO:teuthology.orchestra.run.smithi190.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-12-06T14:38:04.708 INFO:teuthology.orchestra.run.smithi190.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-526.el8.x86_64.conf 2023-12-06T14:38:04.709 DEBUG:teuthology.orchestra.run.smithi190:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-526.el8.x86_64 2023-12-06T14:38:04.839 DEBUG:teuthology.orchestra.run.smithi190:> sudo shutdown -r now 2023-12-06T14:38:28.692 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2023-12-06T14:38:28.692 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-12-06T14:38:28.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T14:38:34.846 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2023-12-06T14:38:34.846 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-12-06T14:38:34.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T14:38:47.139 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-12-06T14:38:53.282 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-12-06T14:38:56.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-12-06T14:38:56.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T14:38:59.202 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-12-06T14:39:02.286 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-12-06T14:39:02.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T14:39:05.346 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-12-06T14:39:11.206 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-12-06T14:39:11.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T14:39:17.350 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-12-06T14:39:17.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T14:39:35.782 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-12-06T14:39:50.798 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-12-06T14:39:50.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T14:39:52.143 DEBUG:teuthology.orchestra.run.smithi190:> true 2023-12-06T14:39:52.653 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-12-06T14:39:52.654 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "4.18.0-526.el8.x86_64"... 2023-12-06T14:39:52.654 DEBUG:teuthology.orchestra.run.smithi190:> uname -r 2023-12-06T14:39:52.715 INFO:teuthology.orchestra.run.smithi190.stdout:4.18.0-526.el8.x86_64 2023-12-06T14:39:52.715 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-526.el8.x86_64 vs 4.18.0-526.el8.x86_64 2023-12-06T14:39:52.716 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-06T14:39:52.716 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-06T14:39:53.716 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2023-12-06T14:39:53.716 DEBUG:teuthology.orchestra.run.smithi190:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-06T14:39:53.786 INFO:teuthology.orchestra.run.smithi190.stdout:ttyS1 2023-12-06T14:39:53.801 DEBUG:teuthology.parallel:result is None 2023-12-06T14:40:11.209 DEBUG:teuthology.orchestra.remote:timed out 2023-12-06T14:40:26.210 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-12-06T14:40:26.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T14:40:26.524 DEBUG:teuthology.orchestra.run.smithi152:> true 2023-12-06T14:40:26.803 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-12-06T14:40:26.803 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "4.18.0-526.el8.x86_64"... 2023-12-06T14:40:26.803 DEBUG:teuthology.orchestra.run.smithi152:> uname -r 2023-12-06T14:40:26.862 INFO:teuthology.orchestra.run.smithi152.stdout:4.18.0-526.el8.x86_64 2023-12-06T14:40:26.862 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-526.el8.x86_64 vs 4.18.0-526.el8.x86_64 2023-12-06T14:40:26.862 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-06T14:40:26.862 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-06T14:40:27.863 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2023-12-06T14:40:27.864 DEBUG:teuthology.orchestra.run.smithi152:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-06T14:40:27.947 INFO:teuthology.orchestra.run.smithi152.stdout:ttyS1 2023-12-06T14:40:27.961 DEBUG:teuthology.parallel:result is None 2023-12-06T14:40:27.962 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-06T14:40:27.969 INFO:teuthology.task.internal:Creating test directory... 2023-12-06T14:40:27.969 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-06T14:40:27.972 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-06T14:40:27.995 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-06T14:40:28.002 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-06T14:40:28.012 INFO:teuthology.task.internal:Creating archive directory... 2023-12-06T14:40:28.012 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-06T14:40:28.032 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-06T14:40:28.070 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-06T14:40:28.077 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-06T14:40:28.077 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-06T14:40:28.105 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-06T14:40:28.149 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-06T14:40:28.150 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-06T14:40:28.160 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-06T14:40:28.161 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-06T14:40:28.162 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-06T14:40:28.169 INFO:teuthology.task.internal:Configuring sudo... 2023-12-06T14:40:28.169 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-06T14:40:28.171 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-06T14:40:28.231 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-06T14:40:28.241 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-06T14:40:28.241 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-06T14:40:28.243 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-06T14:40:28.290 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-06T14:40:28.347 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-06T14:40:28.402 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-06T14:40:28.488 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-06T14:40:28.529 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-06T14:40:28.529 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-06T14:40:28.596 DEBUG:teuthology.orchestra.run.smithi190:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-06T14:40:28.644 DEBUG:teuthology.orchestra.run.smithi190:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-06T14:40:28.698 DEBUG:teuthology.orchestra.run.smithi190:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-06T14:40:28.782 DEBUG:teuthology.orchestra.run.smithi190:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-06T14:40:28.828 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-06T14:40:28.828 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-06T14:40:28.896 DEBUG:teuthology.orchestra.run.smithi152:> sudo service rsyslog restart 2023-12-06T14:40:28.898 DEBUG:teuthology.orchestra.run.smithi190:> sudo service rsyslog restart 2023-12-06T14:40:28.950 INFO:teuthology.orchestra.run.smithi152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-06T14:40:29.002 INFO:teuthology.orchestra.run.smithi190.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-06T14:40:29.390 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-06T14:40:29.398 INFO:teuthology.task.internal:Starting timer... 2023-12-06T14:40:29.399 INFO:teuthology.run_tasks:Running task pcp... 2023-12-06T14:40:29.414 INFO:teuthology.run_tasks:Running task selinux... 2023-12-06T14:40:29.427 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-12-06T14:40:29.427 DEBUG:teuthology.orchestra.run.smithi152:> sudo service auditd rotate 2023-12-06T14:40:29.554 INFO:teuthology.orchestra.run.smithi152.stdout:Rotating logs: 2023-12-06T14:40:29.555 DEBUG:teuthology.orchestra.run.smithi190:> sudo service auditd rotate 2023-12-06T14:40:29.620 INFO:teuthology.orchestra.run.smithi190.stdout:Rotating logs: 2023-12-06T14:40:29.622 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-06T14:40:29.622 DEBUG:teuthology.orchestra.run.smithi152:> /usr/sbin/getenforce 2023-12-06T14:40:29.652 INFO:teuthology.orchestra.run.smithi152.stdout:Permissive 2023-12-06T14:40:29.653 DEBUG:teuthology.orchestra.run.smithi190:> /usr/sbin/getenforce 2023-12-06T14:40:29.679 INFO:teuthology.orchestra.run.smithi190.stdout:Permissive 2023-12-06T14:40:29.679 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi152.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi190.front.sepia.ceph.com': 'permissive'} 2023-12-06T14:40:29.680 DEBUG:teuthology.orchestra.run.smithi152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-06T14:40:29.720 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-06T14:40:29.720 DEBUG:teuthology.orchestra.run.smithi190:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-06T14:40:29.750 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-06T14:40:29.750 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-06T14:40:29.751 DEBUG:teuthology.orchestra.run.smithi152:> sudo /usr/sbin/setenforce permissive 2023-12-06T14:40:29.788 DEBUG:teuthology.orchestra.run.smithi190:> sudo /usr/sbin/setenforce permissive 2023-12-06T14:40:29.822 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-06T14:40:29.832 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-06T14:40:29.832 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-06T14:40:29.850 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-06T14:40:29.852 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi152.front.sepia.ceph.com,smithi190.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-06T14:47:59.957 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi152.front.sepia.ceph.com'), Remote(name='ubuntu@smithi190.front.sepia.ceph.com')] 2023-12-06T14:47:59.958 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-12-06T14:47:59.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T14:48:00.027 DEBUG:teuthology.orchestra.run.smithi152:> true 2023-12-06T14:48:00.051 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-12-06T14:48:00.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-12-06T14:48:00.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T14:48:00.121 DEBUG:teuthology.orchestra.run.smithi190:> true 2023-12-06T14:48:00.192 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-12-06T14:48:00.192 INFO:teuthology.run_tasks:Running task clock... 2023-12-06T14:48:00.204 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-06T14:48:00.204 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-06T14:48:00.204 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-06T14:48:00.206 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-06T14:48:00.206 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-06T14:48:00.236 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-06T14:48:00.250 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-06T14:48:00.263 INFO:teuthology.orchestra.run.smithi190.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-06T14:48:00.277 INFO:teuthology.orchestra.run.smithi190.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-06T14:48:00.320 INFO:teuthology.orchestra.run.smithi152.stderr:sudo: ntpd: command not found 2023-12-06T14:48:00.331 INFO:teuthology.orchestra.run.smithi152.stdout:506 Cannot talk to daemon 2023-12-06T14:48:00.344 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-06T14:48:00.350 INFO:teuthology.orchestra.run.smithi190.stderr:sudo: ntpd: command not found 2023-12-06T14:48:00.357 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-06T14:48:00.361 INFO:teuthology.orchestra.run.smithi190.stdout:506 Cannot talk to daemon 2023-12-06T14:48:00.375 INFO:teuthology.orchestra.run.smithi190.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-06T14:48:00.389 INFO:teuthology.orchestra.run.smithi190.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-06T14:48:00.430 INFO:teuthology.orchestra.run.smithi152.stderr:bash: ntpq: command not found 2023-12-06T14:48:00.433 INFO:teuthology.orchestra.run.smithi152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-06T14:48:00.433 INFO:teuthology.orchestra.run.smithi152.stdout:=============================================================================== 2023-12-06T14:48:00.433 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-06T14:48:00.433 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-06T14:48:00.433 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-06T14:48:00.433 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-06T14:48:00.452 INFO:teuthology.orchestra.run.smithi190.stderr:bash: ntpq: command not found 2023-12-06T14:48:00.456 INFO:teuthology.orchestra.run.smithi190.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-06T14:48:00.456 INFO:teuthology.orchestra.run.smithi190.stdout:=============================================================================== 2023-12-06T14:48:00.456 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-06T14:48:00.456 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-06T14:48:00.456 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-06T14:48:00.456 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-06T14:48:00.457 INFO:teuthology.run_tasks:Running task pexec... 2023-12-06T14:48:00.466 INFO:teuthology.task.pexec:Executing custom commands... 2023-12-06T14:48:00.467 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi152.front.sepia.ceph.com 2023-12-06T14:48:00.467 DEBUG:teuthology.orchestra.run.smithi152:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-06T14:48:00.467 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi190.front.sepia.ceph.com 2023-12-06T14:48:00.467 DEBUG:teuthology.orchestra.run.smithi190:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-06T14:48:01.356 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:39 ago on Wed 06 Dec 2023 02:46:22 PM UTC. 2023-12-06T14:48:01.382 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:01:41 ago on Wed 06 Dec 2023 02:46:20 PM UTC. 2023-12-06T14:48:03.505 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-06T14:48:03.506 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:48:03.507 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2023-12-06T14:48:03.507 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:48:03.507 INFO:teuthology.orchestra.run.smithi152.stdout:Resetting modules: 2023-12-06T14:48:03.507 INFO:teuthology.orchestra.run.smithi152.stdout: container-tools 2023-12-06T14:48:03.507 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:48:03.507 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-12-06T14:48:03.507 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:48:03.507 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:48:03.521 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2023-12-06T14:48:03.522 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:48:03.523 INFO:teuthology.orchestra.run.smithi190.stdout: Package Architecture Version Repository Size 2023-12-06T14:48:03.523 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:48:03.523 INFO:teuthology.orchestra.run.smithi190.stdout:Resetting modules: 2023-12-06T14:48:03.523 INFO:teuthology.orchestra.run.smithi190.stdout: container-tools 2023-12-06T14:48:03.523 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:48:03.523 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction Summary 2023-12-06T14:48:03.523 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:48:03.523 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:48:03.774 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-06T14:48:03.783 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2023-12-06T14:48:04.712 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:42 ago on Wed 06 Dec 2023 02:46:22 PM UTC. 2023-12-06T14:48:04.713 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:01:44 ago on Wed 06 Dec 2023 02:46:20 PM UTC. 2023-12-06T14:48:06.817 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-06T14:48:06.840 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2023-12-06T14:48:07.002 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:48:07.002 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2023-12-06T14:48:07.002 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:48:07.003 INFO:teuthology.orchestra.run.smithi152.stdout:Installing group/module packages: 2023-12-06T14:48:07.003 INFO:teuthology.orchestra.run.smithi152.stdout: aardvark-dns x86_64 2:1.8.0-1.module_el8+712+4cd1bd69 appstream 1.0 M 2023-12-06T14:48:07.003 INFO:teuthology.orchestra.run.smithi152.stdout: buildah x86_64 1:1.32.0-1.module_el8+712+4cd1bd69 appstream 9.6 M 2023-12-06T14:48:07.003 INFO:teuthology.orchestra.run.smithi152.stdout: cockpit-podman noarch 78-1.module_el8+712+4cd1bd69 appstream 750 k 2023-12-06T14:48:07.003 INFO:teuthology.orchestra.run.smithi152.stdout: crun x86_64 1.9.2-1.module_el8+712+4cd1bd69 appstream 241 k 2023-12-06T14:48:07.003 INFO:teuthology.orchestra.run.smithi152.stdout: netavark x86_64 2:1.8.0-2.module_el8+712+4cd1bd69 appstream 3.9 M 2023-12-06T14:48:07.003 INFO:teuthology.orchestra.run.smithi152.stdout: python3-podman noarch 4.7.0-1.module_el8+712+4cd1bd69 appstream 178 k 2023-12-06T14:48:07.003 INFO:teuthology.orchestra.run.smithi152.stdout: skopeo x86_64 2:1.13.3-1.module_el8+712+4cd1bd69 appstream 8.1 M 2023-12-06T14:48:07.003 INFO:teuthology.orchestra.run.smithi152.stdout: toolbox x86_64 0.0.99.4-6.module_el8+712+4cd1bd69 appstream 2.5 M 2023-12-06T14:48:07.003 INFO:teuthology.orchestra.run.smithi152.stdout: udica noarch 0.2.6-20.module_el8+712+4cd1bd69 appstream 53 k 2023-12-06T14:48:07.003 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2023-12-06T14:48:07.003 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2023-12-06T14:48:07.004 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2023-12-06T14:48:07.004 INFO:teuthology.orchestra.run.smithi152.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2023-12-06T14:48:07.004 INFO:teuthology.orchestra.run.smithi152.stdout:Installing weak dependencies: 2023-12-06T14:48:07.004 INFO:teuthology.orchestra.run.smithi152.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2023-12-06T14:48:07.004 INFO:teuthology.orchestra.run.smithi152.stdout:Installing module profiles: 2023-12-06T14:48:07.004 INFO:teuthology.orchestra.run.smithi152.stdout: container-tools/common 2023-12-06T14:48:07.004 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:48:07.004 INFO:teuthology.orchestra.run.smithi152.stdout:Enabling module streams: 2023-12-06T14:48:07.004 INFO:teuthology.orchestra.run.smithi152.stdout: container-tools rhel8 2023-12-06T14:48:07.004 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:48:07.004 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-12-06T14:48:07.004 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:48:07.004 INFO:teuthology.orchestra.run.smithi152.stdout:Install 13 Packages 2023-12-06T14:48:07.004 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:48:07.005 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 27 M 2023-12-06T14:48:07.005 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 89 M 2023-12-06T14:48:07.005 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-12-06T14:48:07.023 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:48:07.024 INFO:teuthology.orchestra.run.smithi190.stdout: Package Arch Version Repository Size 2023-12-06T14:48:07.024 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:48:07.024 INFO:teuthology.orchestra.run.smithi190.stdout:Installing group/module packages: 2023-12-06T14:48:07.024 INFO:teuthology.orchestra.run.smithi190.stdout: aardvark-dns x86_64 2:1.8.0-1.module_el8+712+4cd1bd69 appstream 1.0 M 2023-12-06T14:48:07.024 INFO:teuthology.orchestra.run.smithi190.stdout: buildah x86_64 1:1.32.0-1.module_el8+712+4cd1bd69 appstream 9.6 M 2023-12-06T14:48:07.024 INFO:teuthology.orchestra.run.smithi190.stdout: cockpit-podman noarch 78-1.module_el8+712+4cd1bd69 appstream 750 k 2023-12-06T14:48:07.024 INFO:teuthology.orchestra.run.smithi190.stdout: crun x86_64 1.9.2-1.module_el8+712+4cd1bd69 appstream 241 k 2023-12-06T14:48:07.024 INFO:teuthology.orchestra.run.smithi190.stdout: netavark x86_64 2:1.8.0-2.module_el8+712+4cd1bd69 appstream 3.9 M 2023-12-06T14:48:07.024 INFO:teuthology.orchestra.run.smithi190.stdout: python3-podman noarch 4.7.0-1.module_el8+712+4cd1bd69 appstream 178 k 2023-12-06T14:48:07.024 INFO:teuthology.orchestra.run.smithi190.stdout: skopeo x86_64 2:1.13.3-1.module_el8+712+4cd1bd69 appstream 8.1 M 2023-12-06T14:48:07.024 INFO:teuthology.orchestra.run.smithi190.stdout: toolbox x86_64 0.0.99.4-6.module_el8+712+4cd1bd69 appstream 2.5 M 2023-12-06T14:48:07.024 INFO:teuthology.orchestra.run.smithi190.stdout: udica noarch 0.2.6-20.module_el8+712+4cd1bd69 appstream 53 k 2023-12-06T14:48:07.024 INFO:teuthology.orchestra.run.smithi190.stdout:Installing dependencies: 2023-12-06T14:48:07.024 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2023-12-06T14:48:07.024 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2023-12-06T14:48:07.025 INFO:teuthology.orchestra.run.smithi190.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2023-12-06T14:48:07.025 INFO:teuthology.orchestra.run.smithi190.stdout:Installing weak dependencies: 2023-12-06T14:48:07.025 INFO:teuthology.orchestra.run.smithi190.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2023-12-06T14:48:07.025 INFO:teuthology.orchestra.run.smithi190.stdout:Installing module profiles: 2023-12-06T14:48:07.025 INFO:teuthology.orchestra.run.smithi190.stdout: container-tools/common 2023-12-06T14:48:07.025 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:48:07.025 INFO:teuthology.orchestra.run.smithi190.stdout:Enabling module streams: 2023-12-06T14:48:07.025 INFO:teuthology.orchestra.run.smithi190.stdout: container-tools rhel8 2023-12-06T14:48:07.025 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:48:07.025 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction Summary 2023-12-06T14:48:07.025 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:48:07.025 INFO:teuthology.orchestra.run.smithi190.stdout:Install 13 Packages 2023-12-06T14:48:07.025 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:48:07.026 INFO:teuthology.orchestra.run.smithi190.stdout:Total download size: 27 M 2023-12-06T14:48:07.026 INFO:teuthology.orchestra.run.smithi190.stdout:Installed size: 89 M 2023-12-06T14:48:07.026 INFO:teuthology.orchestra.run.smithi190.stdout:Downloading Packages: 2023-12-06T14:48:07.347 INFO:teuthology.orchestra.run.smithi152.stdout:(1/13): cockpit-podman-78-1.module_el8+712+4cd1 2.4 MB/s | 750 kB 00:00 2023-12-06T14:48:07.365 INFO:teuthology.orchestra.run.smithi190.stdout:(1/13): cockpit-podman-78-1.module_el8+712+4cd1 2.5 MB/s | 750 kB 00:00 2023-12-06T14:48:07.390 INFO:teuthology.orchestra.run.smithi152.stdout:(2/13): aardvark-dns-1.8.0-1.module_el8+712+4cd 2.9 MB/s | 1.0 MB 00:00 2023-12-06T14:48:07.399 INFO:teuthology.orchestra.run.smithi190.stdout:(2/13): aardvark-dns-1.8.0-1.module_el8+712+4cd 3.0 MB/s | 1.0 MB 00:00 2023-12-06T14:48:07.415 INFO:teuthology.orchestra.run.smithi152.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 564 kB/s | 38 kB 00:00 2023-12-06T14:48:07.433 INFO:teuthology.orchestra.run.smithi190.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 564 kB/s | 38 kB 00:00 2023-12-06T14:48:07.457 INFO:teuthology.orchestra.run.smithi152.stdout:(4/13): crun-1.9.2-1.module_el8+712+4cd1bd69.x8 3.5 MB/s | 241 kB 00:00 2023-12-06T14:48:07.466 INFO:teuthology.orchestra.run.smithi190.stdout:(4/13): crun-1.9.2-1.module_el8+712+4cd1bd69.x8 3.5 MB/s | 241 kB 00:00 2023-12-06T14:48:07.524 INFO:teuthology.orchestra.run.smithi152.stdout:(5/13): python3-podman-4.7.0-1.module_el8+712+4 2.6 MB/s | 178 kB 00:00 2023-12-06T14:48:07.533 INFO:teuthology.orchestra.run.smithi190.stdout:(5/13): python3-podman-4.7.0-1.module_el8+712+4 2.6 MB/s | 178 kB 00:00 2023-12-06T14:48:07.591 INFO:teuthology.orchestra.run.smithi152.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 371 kB/s | 25 kB 00:00 2023-12-06T14:48:07.609 INFO:teuthology.orchestra.run.smithi190.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 331 kB/s | 25 kB 00:00 2023-12-06T14:48:07.658 INFO:teuthology.orchestra.run.smithi152.stdout:(7/13): python3-pyxdg-0.25-16.el8.noarch.rpm 1.4 MB/s | 94 kB 00:00 2023-12-06T14:48:07.667 INFO:teuthology.orchestra.run.smithi190.stdout:(7/13): python3-pyxdg-0.25-16.el8.noarch.rpm 1.6 MB/s | 94 kB 00:00 2023-12-06T14:48:07.800 INFO:teuthology.orchestra.run.smithi152.stdout:(8/13): netavark-1.8.0-2.module_el8+712+4cd1bd6 10 MB/s | 3.9 MB 00:00 2023-12-06T14:48:07.809 INFO:teuthology.orchestra.run.smithi190.stdout:(8/13): netavark-1.8.0-2.module_el8+712+4cd1bd6 10 MB/s | 3.9 MB 00:00 2023-12-06T14:48:08.017 INFO:teuthology.orchestra.run.smithi152.stdout:(9/13): buildah-1.32.0-1.module_el8+712+4cd1bd6 9.9 MB/s | 9.6 MB 00:00 2023-12-06T14:48:08.034 INFO:teuthology.orchestra.run.smithi190.stdout:(9/13): buildah-1.32.0-1.module_el8+712+4cd1bd6 9.9 MB/s | 9.6 MB 00:00 2023-12-06T14:48:08.067 INFO:teuthology.orchestra.run.smithi152.stdout:(10/13): toolbox-0.0.99.4-6.module_el8+712+4cd1 9.5 MB/s | 2.5 MB 00:00 2023-12-06T14:48:08.092 INFO:teuthology.orchestra.run.smithi152.stdout:(11/13): udica-0.2.6-20.module_el8+712+4cd1bd69 701 kB/s | 53 kB 00:00 2023-12-06T14:48:08.101 INFO:teuthology.orchestra.run.smithi190.stdout:(10/13): toolbox-0.0.99.4-6.module_el8+712+4cd1 8.7 MB/s | 2.5 MB 00:00 2023-12-06T14:48:08.126 INFO:teuthology.orchestra.run.smithi152.stdout:(12/13): yajl-2.1.0-12.el8.x86_64.rpm 698 kB/s | 41 kB 00:00 2023-12-06T14:48:08.127 INFO:teuthology.orchestra.run.smithi190.stdout:(11/13): udica-0.2.6-20.module_el8+712+4cd1bd69 572 kB/s | 53 kB 00:00 2023-12-06T14:48:08.169 INFO:teuthology.orchestra.run.smithi190.stdout:(12/13): yajl-2.1.0-12.el8.x86_64.rpm 613 kB/s | 41 kB 00:00 2023-12-06T14:48:08.419 INFO:teuthology.orchestra.run.smithi190.stdout:(13/13): skopeo-1.13.3-1.module_el8+712+4cd1bd6 11 MB/s | 8.1 MB 00:00 2023-12-06T14:48:08.420 INFO:teuthology.orchestra.run.smithi190.stdout:-------------------------------------------------------------------------------- 2023-12-06T14:48:08.420 INFO:teuthology.orchestra.run.smithi190.stdout:Total 19 MB/s | 27 MB 00:01 2023-12-06T14:48:08.451 INFO:teuthology.orchestra.run.smithi152.stdout:(13/13): skopeo-1.13.3-1.module_el8+712+4cd1bd6 10 MB/s | 8.1 MB 00:00 2023-12-06T14:48:08.452 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-12-06T14:48:08.452 INFO:teuthology.orchestra.run.smithi152.stdout:Total 18 MB/s | 27 MB 00:01 2023-12-06T14:48:08.687 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction check 2023-12-06T14:48:08.708 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction check succeeded. 2023-12-06T14:48:08.708 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction test 2023-12-06T14:48:08.718 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-12-06T14:48:08.739 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-12-06T14:48:08.740 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-12-06T14:48:08.956 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction test succeeded. 2023-12-06T14:48:08.959 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction 2023-12-06T14:48:09.000 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-12-06T14:48:09.004 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-12-06T14:48:09.650 INFO:teuthology.orchestra.run.smithi190.stdout: Preparing : 1/1 2023-12-06T14:48:09.662 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-12-06T14:48:09.857 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2023-12-06T14:48:09.923 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2023-12-06T14:48:10.002 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 2/13 2023-12-06T14:48:10.121 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 2/13 2023-12-06T14:48:10.217 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/13 2023-12-06T14:48:10.354 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/13 2023-12-06T14:48:10.429 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-06T14:48:10.571 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-06T14:48:10.986 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 5/13 2023-12-06T14:48:11.168 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 5/13 2023-12-06T14:48:11.955 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-06T14:48:12.181 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 7/13 2023-12-06T14:48:12.201 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-06T14:48:12.385 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 8/13 2023-12-06T14:48:12.472 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 7/13 2023-12-06T14:48:12.615 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 9/13 2023-12-06T14:48:12.676 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 8/13 2023-12-06T14:48:12.950 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 9/13 2023-12-06T14:48:12.999 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 10/13 2023-12-06T14:48:13.389 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 10/13 2023-12-06T14:48:13.860 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-06T14:48:14.087 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 12/13 2023-12-06T14:48:14.301 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-06T14:48:14.321 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-06T14:48:14.531 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 12/13 2023-12-06T14:48:14.723 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-06T14:48:14.724 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 1/13 2023-12-06T14:48:14.724 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2/13 2023-12-06T14:48:14.724 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 3/13 2023-12-06T14:48:14.724 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-06T14:48:14.724 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 5/13 2023-12-06T14:48:14.724 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-06T14:48:14.724 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 7/13 2023-12-06T14:48:14.724 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2023-12-06T14:48:14.724 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2023-12-06T14:48:14.724 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 10/13 2023-12-06T14:48:14.724 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-06T14:48:14.724 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 12/13 2023-12-06T14:48:14.751 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-06T14:48:15.164 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 13/13 2023-12-06T14:48:15.164 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86 1/13 2023-12-06T14:48:15.164 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2/13 2023-12-06T14:48:15.164 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 3/13 2023-12-06T14:48:15.164 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2023-12-06T14:48:15.164 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 5/13 2023-12-06T14:48:15.164 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 6/13 2023-12-06T14:48:15.165 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noa 7/13 2023-12-06T14:48:15.165 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2023-12-06T14:48:15.165 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2023-12-06T14:48:15.165 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 10/13 2023-12-06T14:48:15.165 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 11/13 2023-12-06T14:48:15.165 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 12/13 2023-12-06T14:48:15.553 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2023-12-06T14:48:15.553 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:48:15.553 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-12-06T14:48:15.553 INFO:teuthology.orchestra.run.smithi152.stdout: aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-06T14:48:15.553 INFO:teuthology.orchestra.run.smithi152.stdout: buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-06T14:48:15.553 INFO:teuthology.orchestra.run.smithi152.stdout: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 2023-12-06T14:48:15.553 INFO:teuthology.orchestra.run.smithi152.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2023-12-06T14:48:15.553 INFO:teuthology.orchestra.run.smithi152.stdout: crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 2023-12-06T14:48:15.553 INFO:teuthology.orchestra.run.smithi152.stdout: netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 2023-12-06T14:48:15.553 INFO:teuthology.orchestra.run.smithi152.stdout: python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noarch 2023-12-06T14:48:15.553 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-06T14:48:15.553 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-06T14:48:15.554 INFO:teuthology.orchestra.run.smithi152.stdout: skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 2023-12-06T14:48:15.554 INFO:teuthology.orchestra.run.smithi152.stdout: toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 2023-12-06T14:48:15.554 INFO:teuthology.orchestra.run.smithi152.stdout: udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 2023-12-06T14:48:15.554 INFO:teuthology.orchestra.run.smithi152.stdout: yajl-2.1.0-12.el8.x86_64 2023-12-06T14:48:15.554 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:48:15.554 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-06T14:48:15.788 DEBUG:teuthology.parallel:result is None 2023-12-06T14:48:15.964 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2023-12-06T14:48:15.964 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:48:15.964 INFO:teuthology.orchestra.run.smithi190.stdout:Installed: 2023-12-06T14:48:15.964 INFO:teuthology.orchestra.run.smithi190.stdout: aardvark-dns-2:1.8.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-06T14:48:15.964 INFO:teuthology.orchestra.run.smithi190.stdout: buildah-1:1.32.0-1.module_el8+712+4cd1bd69.x86_64 2023-12-06T14:48:15.965 INFO:teuthology.orchestra.run.smithi190.stdout: cockpit-podman-78-1.module_el8+712+4cd1bd69.noarch 2023-12-06T14:48:15.965 INFO:teuthology.orchestra.run.smithi190.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2023-12-06T14:48:15.965 INFO:teuthology.orchestra.run.smithi190.stdout: crun-1.9.2-1.module_el8+712+4cd1bd69.x86_64 2023-12-06T14:48:15.965 INFO:teuthology.orchestra.run.smithi190.stdout: netavark-2:1.8.0-2.module_el8+712+4cd1bd69.x86_64 2023-12-06T14:48:15.965 INFO:teuthology.orchestra.run.smithi190.stdout: python3-podman-4.7.0-1.module_el8+712+4cd1bd69.noarch 2023-12-06T14:48:15.965 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-06T14:48:15.965 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-06T14:48:15.965 INFO:teuthology.orchestra.run.smithi190.stdout: skopeo-2:1.13.3-1.module_el8+712+4cd1bd69.x86_64 2023-12-06T14:48:15.965 INFO:teuthology.orchestra.run.smithi190.stdout: toolbox-0.0.99.4-6.module_el8+712+4cd1bd69.x86_64 2023-12-06T14:48:15.965 INFO:teuthology.orchestra.run.smithi190.stdout: udica-0.2.6-20.module_el8+712+4cd1bd69.noarch 2023-12-06T14:48:15.965 INFO:teuthology.orchestra.run.smithi190.stdout: yajl-2.1.0-12.el8.x86_64 2023-12-06T14:48:15.965 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:48:15.965 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2023-12-06T14:48:16.248 DEBUG:teuthology.parallel:result is None 2023-12-06T14:48:16.248 INFO:teuthology.run_tasks:Running task install... 2023-12-06T14:48:16.258 DEBUG:teuthology.task.install:project ceph 2023-12-06T14:48:16.258 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '0482646fcf78576d871bc87843257d82edb79541'}} 2023-12-06T14:48:16.258 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '0482646fcf78576d871bc87843257d82edb79541'} 2023-12-06T14:48:16.258 INFO:teuthology.task.install:Using flavor: default 2023-12-06T14:48:16.266 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-06T14:48:16.266 INFO:teuthology.task.install:extra packages: [] 2023-12-06T14:48:16.267 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0482646fcf78576d871bc87843257d82edb79541', 'tag': None, 'wait_for_package': False} 2023-12-06T14:48:16.267 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-06T14:48:16.267 INFO:teuthology.packaging:ref: None 2023-12-06T14:48:16.267 INFO:teuthology.packaging:tag: None 2023-12-06T14:48:16.267 INFO:teuthology.packaging:branch: quincy 2023-12-06T14:48:16.267 INFO:teuthology.packaging:sha1: 0482646fcf78576d871bc87843257d82edb79541 2023-12-06T14:48:16.267 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-06T14:48:16.269 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0482646fcf78576d871bc87843257d82edb79541', 'tag': None, 'wait_for_package': False} 2023-12-06T14:48:16.270 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-06T14:48:16.270 INFO:teuthology.packaging:ref: None 2023-12-06T14:48:16.270 INFO:teuthology.packaging:tag: None 2023-12-06T14:48:16.270 INFO:teuthology.packaging:branch: quincy 2023-12-06T14:48:16.270 INFO:teuthology.packaging:sha1: 0482646fcf78576d871bc87843257d82edb79541 2023-12-06T14:48:16.270 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-06T14:48:16.488 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/quincy/ece0d60728c6966000bb839fe46b2b8e2bdb5305/centos/8/flavors/default/ 2023-12-06T14:48:16.489 INFO:teuthology.task.install.rpm:Package version is 17.2.7-113.gece0d607 2023-12-06T14:48:16.611 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/quincy/ece0d60728c6966000bb839fe46b2b8e2bdb5305/centos/8/flavors/default/ 2023-12-06T14:48:16.611 INFO:teuthology.task.install.rpm:Package version is 17.2.7-113.gece0d607 2023-12-06T14:48:16.664 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/quincy/ece0d60728c6966000bb839fe46b2b8e2bdb5305/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/ece0d60728c6966000bb839fe46b2b8e2bdb5305/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/ece0d60728c6966000bb839fe46b2b8e2bdb5305/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-06T14:48:16.664 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-06T14:48:16.664 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-06T14:48:16.698 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-06T14:48:16.698 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-06T14:48:16.698 INFO:teuthology.packaging:ref: None 2023-12-06T14:48:16.698 INFO:teuthology.packaging:tag: None 2023-12-06T14:48:16.698 INFO:teuthology.packaging:branch: quincy 2023-12-06T14:48:16.698 INFO:teuthology.packaging:sha1: 0482646fcf78576d871bc87843257d82edb79541 2023-12-06T14:48:16.699 DEBUG:teuthology.orchestra.run.smithi152:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-06T14:48:16.720 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/quincy/ece0d60728c6966000bb839fe46b2b8e2bdb5305/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/ece0d60728c6966000bb839fe46b2b8e2bdb5305/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/ece0d60728c6966000bb839fe46b2b8e2bdb5305/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-06T14:48:16.720 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-06T14:48:16.720 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-06T14:48:16.749 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-06T14:48:16.749 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-06T14:48:16.749 INFO:teuthology.packaging:ref: None 2023-12-06T14:48:16.749 INFO:teuthology.packaging:tag: None 2023-12-06T14:48:16.749 INFO:teuthology.packaging:branch: quincy 2023-12-06T14:48:16.749 INFO:teuthology.packaging:sha1: 0482646fcf78576d871bc87843257d82edb79541 2023-12-06T14:48:16.749 DEBUG:teuthology.orchestra.run.smithi190:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-06T14:48:16.773 DEBUG:teuthology.orchestra.run.smithi152:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-06T14:48:16.816 DEBUG:teuthology.orchestra.run.smithi190:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-06T14:48:16.855 DEBUG:teuthology.orchestra.run.smithi152:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-06T14:48:16.893 DEBUG:teuthology.orchestra.run.smithi190:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-06T14:48:16.925 INFO:teuthology.orchestra.run.smithi152.stdout:check_obsoletes = 1 2023-12-06T14:48:16.926 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum clean all 2023-12-06T14:48:16.960 INFO:teuthology.orchestra.run.smithi190.stdout:check_obsoletes = 1 2023-12-06T14:48:16.961 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum clean all 2023-12-06T14:48:17.197 INFO:teuthology.orchestra.run.smithi152.stdout:76 files removed 2023-12-06T14:48:17.225 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-radosgw 2023-12-06T14:48:17.226 INFO:teuthology.orchestra.run.smithi190.stdout:76 files removed 2023-12-06T14:48:17.254 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum -y install ceph-radosgw 2023-12-06T14:48:17.904 INFO:teuthology.orchestra.run.smithi190.stdout:ceph packages for x86_64 320 kB/s | 78 kB 00:00 2023-12-06T14:48:17.999 INFO:teuthology.orchestra.run.smithi152.stdout:ceph packages for x86_64 212 kB/s | 78 kB 00:00 2023-12-06T14:48:18.238 INFO:teuthology.orchestra.run.smithi190.stdout:ceph noarch packages 31 kB/s | 9.1 kB 00:00 2023-12-06T14:48:18.308 INFO:teuthology.orchestra.run.smithi152.stdout:ceph noarch packages 34 kB/s | 9.1 kB 00:00 2023-12-06T14:48:18.530 INFO:teuthology.orchestra.run.smithi190.stdout:ceph source packages 5.5 kB/s | 1.5 kB 00:00 2023-12-06T14:48:18.626 INFO:teuthology.orchestra.run.smithi152.stdout:ceph source packages 5.0 kB/s | 1.5 kB 00:00 2023-12-06T14:48:22.160 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 8 - AppStream 9.8 MB/s | 34 MB 00:03 2023-12-06T14:48:25.597 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS Stream 8 - AppStream 4.9 MB/s | 34 MB 00:07 2023-12-06T14:48:35.639 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS Stream 8 - BaseOS 15 MB/s | 55 MB 00:03 2023-12-06T14:48:37.567 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 8 - BaseOS 6.0 MB/s | 55 MB 00:09 2023-12-06T14:48:43.913 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS Stream 8 - Extras 41 kB/s | 18 kB 00:00 2023-12-06T14:48:44.738 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS Stream 8 - Extras common packages 11 kB/s | 6.9 kB 00:00 2023-12-06T14:48:46.059 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 8 - Extras 33 kB/s | 18 kB 00:00 2023-12-06T14:48:46.308 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS Stream 8 - PowerTools 4.7 MB/s | 6.6 MB 00:01 2023-12-06T14:48:46.751 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 8 - Extras common packages 13 kB/s | 6.9 kB 00:00 2023-12-06T14:48:47.784 INFO:teuthology.orchestra.run.smithi190.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-12-06T14:48:48.119 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 8 - PowerTools 5.4 MB/s | 6.6 MB 00:01 2023-12-06T14:48:49.579 INFO:teuthology.orchestra.run.smithi152.stdout:Copr repo for python3-asyncssh owned by ceph 20 kB/s | 3.5 kB 00:00 2023-12-06T14:48:51.210 INFO:teuthology.orchestra.run.smithi190.stdout:Extra Packages for Enterprise Linux 4.9 MB/s | 16 MB 00:03 2023-12-06T14:48:51.707 INFO:teuthology.orchestra.run.smithi152.stdout:Extra Packages for Enterprise Linux 8.1 MB/s | 16 MB 00:01 2023-12-06T14:48:55.102 INFO:teuthology.orchestra.run.smithi190.stdout:lab-extras 407 kB/s | 24 kB 00:00 2023-12-06T14:48:55.604 INFO:teuthology.orchestra.run.smithi152.stdout:lab-extras 437 kB/s | 24 kB 00:00 2023-12-06T14:48:59.677 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2023-12-06T14:48:59.680 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:48:59.680 INFO:teuthology.orchestra.run.smithi190.stdout: Package Arch Version Repository Size 2023-12-06T14:48:59.680 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:48:59.680 INFO:teuthology.orchestra.run.smithi190.stdout:Installing: 2023-12-06T14:48:59.680 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-radosgw x86_64 2:17.2.7-113.gece0d607.el8 ceph 17 M 2023-12-06T14:48:59.680 INFO:teuthology.orchestra.run.smithi190.stdout:Upgrading: 2023-12-06T14:48:59.680 INFO:teuthology.orchestra.run.smithi190.stdout: librados2 x86_64 2:17.2.7-113.gece0d607.el8 ceph 3.5 M 2023-12-06T14:48:59.680 INFO:teuthology.orchestra.run.smithi190.stdout: librbd1 x86_64 2:17.2.7-113.gece0d607.el8 ceph 3.6 M 2023-12-06T14:48:59.680 INFO:teuthology.orchestra.run.smithi190.stdout:Installing dependencies: 2023-12-06T14:48:59.680 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-base x86_64 2:17.2.7-113.gece0d607.el8 ceph 5.2 M 2023-12-06T14:48:59.680 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-common x86_64 2:17.2.7-113.gece0d607.el8 ceph 23 M 2023-12-06T14:48:59.681 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-selinux x86_64 2:17.2.7-113.gece0d607.el8 ceph 24 k 2023-12-06T14:48:59.681 INFO:teuthology.orchestra.run.smithi190.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-06T14:48:59.681 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs2 x86_64 2:17.2.7-113.gece0d607.el8 ceph 796 k 2023-12-06T14:48:59.681 INFO:teuthology.orchestra.run.smithi190.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-06T14:48:59.681 INFO:teuthology.orchestra.run.smithi190.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-12-06T14:48:59.681 INFO:teuthology.orchestra.run.smithi190.stdout: libradosstriper1 x86_64 2:17.2.7-113.gece0d607.el8 ceph 507 k 2023-12-06T14:48:59.681 INFO:teuthology.orchestra.run.smithi190.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-12-06T14:48:59.681 INFO:teuthology.orchestra.run.smithi190.stdout: librgw2 x86_64 2:17.2.7-113.gece0d607.el8 ceph 5.6 M 2023-12-06T14:48:59.681 INFO:teuthology.orchestra.run.smithi190.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-06T14:48:59.681 INFO:teuthology.orchestra.run.smithi190.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-12-06T14:48:59.681 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-argparse x86_64 2:17.2.7-113.gece0d607.el8 ceph 45 k 2023-12-06T14:48:59.681 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-common x86_64 2:17.2.7-113.gece0d607.el8 ceph 115 k 2023-12-06T14:48:59.681 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cephfs x86_64 2:17.2.7-113.gece0d607.el8 ceph 190 k 2023-12-06T14:48:59.681 INFO:teuthology.orchestra.run.smithi190.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-12-06T14:48:59.682 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rados x86_64 2:17.2.7-113.gece0d607.el8 ceph 371 k 2023-12-06T14:48:59.682 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rbd x86_64 2:17.2.7-113.gece0d607.el8 ceph 358 k 2023-12-06T14:48:59.682 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rgw x86_64 2:17.2.7-113.gece0d607.el8 ceph 107 k 2023-12-06T14:48:59.682 INFO:teuthology.orchestra.run.smithi190.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-06T14:48:59.682 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:48:59.682 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction Summary 2023-12-06T14:48:59.682 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:48:59.682 INFO:teuthology.orchestra.run.smithi190.stdout:Install 21 Packages 2023-12-06T14:48:59.682 INFO:teuthology.orchestra.run.smithi190.stdout:Upgrade 2 Packages 2023-12-06T14:48:59.682 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:48:59.683 INFO:teuthology.orchestra.run.smithi190.stdout:Total download size: 63 M 2023-12-06T14:48:59.683 INFO:teuthology.orchestra.run.smithi190.stdout:Downloading Packages: 2023-12-06T14:49:00.168 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-06T14:49:00.171 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:49:00.171 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2023-12-06T14:49:00.171 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:49:00.171 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2023-12-06T14:49:00.171 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw x86_64 2:17.2.7-113.gece0d607.el8 ceph 17 M 2023-12-06T14:49:00.171 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrading: 2023-12-06T14:49:00.171 INFO:teuthology.orchestra.run.smithi152.stdout: librados2 x86_64 2:17.2.7-113.gece0d607.el8 ceph 3.5 M 2023-12-06T14:49:00.171 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1 x86_64 2:17.2.7-113.gece0d607.el8 ceph 3.6 M 2023-12-06T14:49:00.172 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2023-12-06T14:49:00.172 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base x86_64 2:17.2.7-113.gece0d607.el8 ceph 5.2 M 2023-12-06T14:49:00.172 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common x86_64 2:17.2.7-113.gece0d607.el8 ceph 23 M 2023-12-06T14:49:00.172 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux x86_64 2:17.2.7-113.gece0d607.el8 ceph 24 k 2023-12-06T14:49:00.172 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-06T14:49:00.172 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2 x86_64 2:17.2.7-113.gece0d607.el8 ceph 796 k 2023-12-06T14:49:00.172 INFO:teuthology.orchestra.run.smithi152.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-06T14:49:00.172 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-12-06T14:49:00.172 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1 x86_64 2:17.2.7-113.gece0d607.el8 ceph 507 k 2023-12-06T14:49:00.172 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-12-06T14:49:00.172 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2 x86_64 2:17.2.7-113.gece0d607.el8 ceph 5.6 M 2023-12-06T14:49:00.172 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-06T14:49:00.172 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-12-06T14:49:00.173 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse x86_64 2:17.2.7-113.gece0d607.el8 ceph 45 k 2023-12-06T14:49:00.173 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common x86_64 2:17.2.7-113.gece0d607.el8 ceph 115 k 2023-12-06T14:49:00.173 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs x86_64 2:17.2.7-113.gece0d607.el8 ceph 190 k 2023-12-06T14:49:00.173 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-12-06T14:49:00.173 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados x86_64 2:17.2.7-113.gece0d607.el8 ceph 371 k 2023-12-06T14:49:00.173 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd x86_64 2:17.2.7-113.gece0d607.el8 ceph 358 k 2023-12-06T14:49:00.173 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw x86_64 2:17.2.7-113.gece0d607.el8 ceph 107 k 2023-12-06T14:49:00.173 INFO:teuthology.orchestra.run.smithi152.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-06T14:49:00.173 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:49:00.173 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-12-06T14:49:00.173 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:49:00.173 INFO:teuthology.orchestra.run.smithi152.stdout:Install 21 Packages 2023-12-06T14:49:00.173 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrade 2 Packages 2023-12-06T14:49:00.173 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:49:00.174 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 63 M 2023-12-06T14:49:00.174 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-12-06T14:49:00.678 INFO:teuthology.orchestra.run.smithi190.stdout:(1/23): ceph-base-17.2.7-113.gece0d607.el8.x86_ 11 MB/s | 5.2 MB 00:00 2023-12-06T14:49:00.745 INFO:teuthology.orchestra.run.smithi190.stdout:(2/23): ceph-selinux-17.2.7-113.gece0d607.el8.x 364 kB/s | 24 kB 00:00 2023-12-06T14:49:01.131 INFO:teuthology.orchestra.run.smithi152.stdout:(1/23): ceph-base-17.2.7-113.gece0d607.el8.x86_ 7.0 MB/s | 5.2 MB 00:00 2023-12-06T14:49:01.295 INFO:teuthology.orchestra.run.smithi190.stdout:(3/23): libcephfs2-17.2.7-113.gece0d607.el8.x86 1.4 MB/s | 796 kB 00:00 2023-12-06T14:49:01.297 INFO:teuthology.orchestra.run.smithi152.stdout:(2/23): ceph-selinux-17.2.7-113.gece0d607.el8.x 146 kB/s | 24 kB 00:00 2023-12-06T14:49:01.387 INFO:teuthology.orchestra.run.smithi190.stdout:(4/23): libradosstriper1-17.2.7-113.gece0d607.e 5.4 MB/s | 507 kB 00:00 2023-12-06T14:49:01.406 INFO:teuthology.orchestra.run.smithi152.stdout:(3/23): libcephfs2-17.2.7-113.gece0d607.el8.x86 7.2 MB/s | 796 kB 00:00 2023-12-06T14:49:01.515 INFO:teuthology.orchestra.run.smithi152.stdout:(4/23): libradosstriper1-17.2.7-113.gece0d607.e 4.6 MB/s | 507 kB 00:00 2023-12-06T14:49:02.257 INFO:teuthology.orchestra.run.smithi152.stdout:(5/23): librgw2-17.2.7-113.gece0d607.el8.x86_64 7.5 MB/s | 5.6 MB 00:00 2023-12-06T14:49:02.270 INFO:teuthology.orchestra.run.smithi190.stdout:(5/23): librgw2-17.2.7-113.gece0d607.el8.x86_64 6.3 MB/s | 5.6 MB 00:00 2023-12-06T14:49:02.323 INFO:teuthology.orchestra.run.smithi152.stdout:(6/23): python3-ceph-argparse-17.2.7-113.gece0d 672 kB/s | 45 kB 00:00 2023-12-06T14:49:02.329 INFO:teuthology.orchestra.run.smithi190.stdout:(6/23): python3-ceph-argparse-17.2.7-113.gece0d 771 kB/s | 45 kB 00:00 2023-12-06T14:49:02.382 INFO:teuthology.orchestra.run.smithi152.stdout:(7/23): python3-ceph-common-17.2.7-113.gece0d60 1.9 MB/s | 115 kB 00:00 2023-12-06T14:49:02.396 INFO:teuthology.orchestra.run.smithi190.stdout:(7/23): python3-ceph-common-17.2.7-113.gece0d60 1.7 MB/s | 115 kB 00:00 2023-12-06T14:49:02.449 INFO:teuthology.orchestra.run.smithi152.stdout:(8/23): python3-cephfs-17.2.7-113.gece0d607.el8 2.8 MB/s | 190 kB 00:00 2023-12-06T14:49:02.471 INFO:teuthology.orchestra.run.smithi190.stdout:(8/23): python3-cephfs-17.2.7-113.gece0d607.el8 2.5 MB/s | 190 kB 00:00 2023-12-06T14:49:02.549 INFO:teuthology.orchestra.run.smithi152.stdout:(9/23): python3-rados-17.2.7-113.gece0d607.el8. 3.6 MB/s | 371 kB 00:00 2023-12-06T14:49:02.564 INFO:teuthology.orchestra.run.smithi190.stdout:(9/23): python3-rados-17.2.7-113.gece0d607.el8. 4.0 MB/s | 371 kB 00:00 2023-12-06T14:49:02.642 INFO:teuthology.orchestra.run.smithi152.stdout:(10/23): python3-rbd-17.2.7-113.gece0d607.el8.x 3.8 MB/s | 358 kB 00:00 2023-12-06T14:49:02.656 INFO:teuthology.orchestra.run.smithi190.stdout:(10/23): python3-rbd-17.2.7-113.gece0d607.el8.x 3.8 MB/s | 358 kB 00:00 2023-12-06T14:49:02.733 INFO:teuthology.orchestra.run.smithi152.stdout:(11/23): python3-rgw-17.2.7-113.gece0d607.el8.x 1.1 MB/s | 107 kB 00:00 2023-12-06T14:49:02.748 INFO:teuthology.orchestra.run.smithi190.stdout:(11/23): python3-rgw-17.2.7-113.gece0d607.el8.x 1.1 MB/s | 107 kB 00:00 2023-12-06T14:49:03.017 INFO:teuthology.orchestra.run.smithi152.stdout:(12/23): librdkafka-0.11.4-3.el8.x86_64.rpm 1.2 MB/s | 354 kB 00:00 2023-12-06T14:49:03.023 INFO:teuthology.orchestra.run.smithi190.stdout:(12/23): librdkafka-0.11.4-3.el8.x86_64.rpm 1.3 MB/s | 354 kB 00:00 2023-12-06T14:49:03.150 INFO:teuthology.orchestra.run.smithi152.stdout:(13/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.9 MB/s | 259 kB 00:00 2023-12-06T14:49:03.165 INFO:teuthology.orchestra.run.smithi190.stdout:(13/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.8 MB/s | 259 kB 00:00 2023-12-06T14:49:03.218 INFO:teuthology.orchestra.run.smithi152.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 658 kB/s | 44 kB 00:00 2023-12-06T14:49:03.251 INFO:teuthology.orchestra.run.smithi190.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 507 kB/s | 44 kB 00:00 2023-12-06T14:49:03.665 INFO:teuthology.orchestra.run.smithi190.stdout:(15/23): ceph-radosgw-17.2.7-113.gece0d607.el8. 4.8 MB/s | 17 MB 00:03 2023-12-06T14:49:03.667 INFO:teuthology.orchestra.run.smithi152.stdout:(15/23): ceph-radosgw-17.2.7-113.gece0d607.el8. 5.1 MB/s | 17 MB 00:03 2023-12-06T14:49:03.691 INFO:teuthology.orchestra.run.smithi190.stdout:(16/23): librabbitmq-0.9.0-4.el8.x86_64.rpm 107 kB/s | 47 kB 00:00 2023-12-06T14:49:03.693 INFO:teuthology.orchestra.run.smithi152.stdout:(16/23): librabbitmq-0.9.0-4.el8.x86_64.rpm 99 kB/s | 47 kB 00:00 2023-12-06T14:49:03.958 INFO:teuthology.orchestra.run.smithi190.stdout:(17/23): liboath-2.6.2-3.el8.x86_64.rpm 221 kB/s | 59 kB 00:00 2023-12-06T14:49:04.010 INFO:teuthology.orchestra.run.smithi152.stdout:(17/23): ceph-common-17.2.7-113.gece0d607.el8.x 6.5 MB/s | 23 MB 00:03 2023-12-06T14:49:04.035 INFO:teuthology.orchestra.run.smithi152.stdout:(18/23): liboath-2.6.2-3.el8.x86_64.rpm 172 kB/s | 59 kB 00:00 2023-12-06T14:49:04.091 INFO:teuthology.orchestra.run.smithi190.stdout:(18/23): gperftools-libs-2.7-9.el8.x86_64.rpm 720 kB/s | 306 kB 00:00 2023-12-06T14:49:04.102 INFO:teuthology.orchestra.run.smithi152.stdout:(19/23): gperftools-libs-2.7-9.el8.x86_64.rpm 705 kB/s | 306 kB 00:00 2023-12-06T14:49:04.117 INFO:teuthology.orchestra.run.smithi190.stdout:(19/23): libunwind-1.3.1-3.el8.x86_64.rpm 473 kB/s | 75 kB 00:00 2023-12-06T14:49:04.169 INFO:teuthology.orchestra.run.smithi152.stdout:(20/23): libunwind-1.3.1-3.el8.x86_64.rpm 473 kB/s | 75 kB 00:00 2023-12-06T14:49:04.253 INFO:teuthology.orchestra.run.smithi152.stdout:(21/23): thrift-0.13.0-2.el8.x86_64.rpm 8.0 MB/s | 1.7 MB 00:00 2023-12-06T14:49:04.417 INFO:teuthology.orchestra.run.smithi190.stdout:(20/23): thrift-0.13.0-2.el8.x86_64.rpm 5.3 MB/s | 1.7 MB 00:00 2023-12-06T14:49:04.511 INFO:teuthology.orchestra.run.smithi152.stdout:(22/23): librbd1-17.2.7-113.gece0d607.el8.x86_6 10 MB/s | 3.6 MB 00:00 2023-12-06T14:49:04.611 INFO:teuthology.orchestra.run.smithi152.stdout:(23/23): librados2-17.2.7-113.gece0d607.el8.x86 6.8 MB/s | 3.5 MB 00:00 2023-12-06T14:49:04.613 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-12-06T14:49:04.614 INFO:teuthology.orchestra.run.smithi152.stdout:Total 14 MB/s | 63 MB 00:04 2023-12-06T14:49:04.651 INFO:teuthology.orchestra.run.smithi190.stdout:(21/23): librados2-17.2.7-113.gece0d607.el8.x86 6.5 MB/s | 3.5 MB 00:00 2023-12-06T14:49:04.654 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-12-06T14:49:04.701 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-12-06T14:49:04.701 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-12-06T14:49:04.926 INFO:teuthology.orchestra.run.smithi190.stdout:(22/23): librbd1-17.2.7-113.gece0d607.el8.x86_6 7.0 MB/s | 3.6 MB 00:00 2023-12-06T14:49:05.060 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-12-06T14:49:05.063 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-12-06T14:49:06.081 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-12-06T14:49:06.281 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2023-12-06T14:49:06.418 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-06T14:49:06.784 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-06T14:49:06.876 INFO:teuthology.orchestra.run.smithi190.stdout:(23/23): ceph-common-17.2.7-113.gece0d607.el8.x 3.5 MB/s | 23 MB 00:06 2023-12-06T14:49:06.878 INFO:teuthology.orchestra.run.smithi190.stdout:-------------------------------------------------------------------------------- 2023-12-06T14:49:06.879 INFO:teuthology.orchestra.run.smithi190.stdout:Total 8.8 MB/s | 63 MB 00:07 2023-12-06T14:49:06.919 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction check 2023-12-06T14:49:06.966 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction check succeeded. 2023-12-06T14:49:06.966 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction test 2023-12-06T14:49:06.976 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librados2-2:17.2.7-113.gece0d607.el8.x86_64 3/25 2023-12-06T14:49:07.068 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-2:17.2.7-113.gece0d607.el8.x86_64 3/25 2023-12-06T14:49:07.320 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rados-2:17.2.7-113.gece0d607.el8.x86_64 4/25 2023-12-06T14:49:07.331 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction test succeeded. 2023-12-06T14:49:07.334 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction 2023-12-06T14:49:07.510 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs2-2:17.2.7-113.gece0d607.el8.x86_64 5/25 2023-12-06T14:49:07.903 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephfs2-2:17.2.7-113.gece0d607.el8.x86_64 5/25 2023-12-06T14:49:08.085 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librbd1-2:17.2.7-113.gece0d607.el8.x86_64 6/25 2023-12-06T14:49:08.298 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-2:17.2.7-113.gece0d607.el8.x86_64 6/25 2023-12-06T14:49:08.350 INFO:teuthology.orchestra.run.smithi190.stdout: Preparing : 1/1 2023-12-06T14:49:08.531 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : thrift-0.13.0-2.el8.x86_64 7/25 2023-12-06T14:49:08.566 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2023-12-06T14:49:08.717 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 8/25 2023-12-06T14:49:08.768 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-06T14:49:08.860 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/25 2023-12-06T14:49:09.135 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-06T14:49:09.343 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : librados2-2:17.2.7-113.gece0d607.el8.x86_64 3/25 2023-12-06T14:49:09.433 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librados2-2:17.2.7-113.gece0d607.el8.x86_64 3/25 2023-12-06T14:49:09.434 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/25 2023-12-06T14:49:09.593 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librgw2-2:17.2.7-113.gece0d607.el8.x86_64 10/25 2023-12-06T14:49:09.646 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librgw2-2:17.2.7-113.gece0d607.el8.x86_64 10/25 2023-12-06T14:49:09.699 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rados-2:17.2.7-113.gece0d607.el8.x86_64 4/25 2023-12-06T14:49:09.795 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-argparse-2:17.2.7-113.gece0d607.el8.x 11/25 2023-12-06T14:49:09.910 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libcephfs2-2:17.2.7-113.gece0d607.el8.x86_64 5/25 2023-12-06T14:49:09.954 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cephfs-2:17.2.7-113.gece0d607.el8.x86_64 12/25 2023-12-06T14:49:10.169 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rgw-2:17.2.7-113.gece0d607.el8.x86_64 13/25 2023-12-06T14:49:10.301 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libcephfs2-2:17.2.7-113.gece0d607.el8.x86_64 5/25 2023-12-06T14:49:10.362 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rbd-2:17.2.7-113.gece0d607.el8.x86_64 14/25 2023-12-06T14:49:10.520 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : librbd1-2:17.2.7-113.gece0d607.el8.x86_64 6/25 2023-12-06T14:49:10.534 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libradosstriper1-2:17.2.7-113.gece0d607.el8.x86_64 15/25 2023-12-06T14:49:10.605 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libradosstriper1-2:17.2.7-113.gece0d607.el8.x86_64 15/25 2023-12-06T14:49:10.730 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librbd1-2:17.2.7-113.gece0d607.el8.x86_64 6/25 2023-12-06T14:49:10.843 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2023-12-06T14:49:11.025 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : thrift-0.13.0-2.el8.x86_64 7/25 2023-12-06T14:49:11.034 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2023-12-06T14:49:11.225 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-12-06T14:49:11.241 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 8/25 2023-12-06T14:49:11.393 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/25 2023-12-06T14:49:11.427 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-common-2:17.2.7-113.gece0d607.el8.x86 19/25 2023-12-06T14:49:11.962 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/25 2023-12-06T14:49:12.109 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librgw2-2:17.2.7-113.gece0d607.el8.x86_64 10/25 2023-12-06T14:49:12.170 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librgw2-2:17.2.7-113.gece0d607.el8.x86_64 10/25 2023-12-06T14:49:12.320 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-ceph-argparse-2:17.2.7-113.gece0d607.el8.x 11/25 2023-12-06T14:49:12.515 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cephfs-2:17.2.7-113.gece0d607.el8.x86_64 12/25 2023-12-06T14:49:12.702 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rgw-2:17.2.7-113.gece0d607.el8.x86_64 13/25 2023-12-06T14:49:12.904 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rbd-2:17.2.7-113.gece0d607.el8.x86_64 14/25 2023-12-06T14:49:13.087 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libradosstriper1-2:17.2.7-113.gece0d607.el8.x86_64 15/25 2023-12-06T14:49:13.143 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libradosstriper1-2:17.2.7-113.gece0d607.el8.x86_64 15/25 2023-12-06T14:49:13.354 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2023-12-06T14:49:13.561 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2023-12-06T14:49:13.744 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-12-06T14:49:13.945 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-ceph-common-2:17.2.7-113.gece0d607.el8.x86 19/25 2023-12-06T14:49:14.181 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:17.2.7-113.gece0d607.el8.x86_64 20/25 2023-12-06T14:49:14.393 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-common-2:17.2.7-113.gece0d607.el8.x86_64 20/25 2023-12-06T14:49:14.971 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:17.2.7-113.gece0d607.el8.x86_64 20/25 2023-12-06T14:49:15.225 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-base-2:17.2.7-113.gece0d607.el8.x86_64 21/25 2023-12-06T14:49:15.378 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-base-2:17.2.7-113.gece0d607.el8.x86_64 21/25 2023-12-06T14:49:15.575 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-selinux-2:17.2.7-113.gece0d607.el8.x86_64 22/25 2023-12-06T14:49:16.689 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-common-2:17.2.7-113.gece0d607.el8.x86_64 20/25 2023-12-06T14:49:16.951 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-common-2:17.2.7-113.gece0d607.el8.x86_64 20/25 2023-12-06T14:49:17.514 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-common-2:17.2.7-113.gece0d607.el8.x86_64 20/25 2023-12-06T14:49:17.776 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-base-2:17.2.7-113.gece0d607.el8.x86_64 21/25 2023-12-06T14:49:17.908 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-base-2:17.2.7-113.gece0d607.el8.x86_64 21/25 2023-12-06T14:49:18.075 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-selinux-2:17.2.7-113.gece0d607.el8.x86_64 22/25 2023-12-06T14:49:34.179 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-selinux-2:17.2.7-113.gece0d607.el8.x86_64 22/25 2023-12-06T14:49:34.180 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /sys 2023-12-06T14:49:34.180 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /proc 2023-12-06T14:49:34.180 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /dev 2023-12-06T14:49:34.180 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /run 2023-12-06T14:49:34.180 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /mnt 2023-12-06T14:49:34.180 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /var/tmp 2023-12-06T14:49:34.180 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /home 2023-12-06T14:49:34.180 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /tmp 2023-12-06T14:49:34.180 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /dev 2023-12-06T14:49:34.180 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:49:35.863 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-radosgw-2:17.2.7-113.gece0d607.el8.x86_64 23/25 2023-12-06T14:49:35.941 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-113.gece0d607.el8.x86_64 23/25 2023-12-06T14:49:35.941 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-06T14:49:36.158 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-06T14:49:36.158 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-06T14:49:36.666 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-selinux-2:17.2.7-113.gece0d607.el8.x86_64 22/25 2023-12-06T14:49:36.666 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /sys 2023-12-06T14:49:36.666 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /proc 2023-12-06T14:49:36.666 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /dev 2023-12-06T14:49:36.667 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /run 2023-12-06T14:49:36.667 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /mnt 2023-12-06T14:49:36.667 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /var/tmp 2023-12-06T14:49:36.667 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /home 2023-12-06T14:49:36.667 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /tmp 2023-12-06T14:49:36.667 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /dev 2023-12-06T14:49:36.667 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:49:36.905 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-06T14:49:36.905 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-base-2:17.2.7-113.gece0d607.el8.x86_64 1/25 2023-12-06T14:49:36.905 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-common-2:17.2.7-113.gece0d607.el8.x86_64 2/25 2023-12-06T14:49:36.905 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-radosgw-2:17.2.7-113.gece0d607.el8.x86_64 3/25 2023-12-06T14:49:36.905 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-selinux-2:17.2.7-113.gece0d607.el8.x86_64 4/25 2023-12-06T14:49:36.905 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs2-2:17.2.7-113.gece0d607.el8.x86_64 5/25 2023-12-06T14:49:36.905 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libradosstriper1-2:17.2.7-113.gece0d607.el8.x86_64 6/25 2023-12-06T14:49:36.906 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librgw2-2:17.2.7-113.gece0d607.el8.x86_64 7/25 2023-12-06T14:49:36.906 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-argparse-2:17.2.7-113.gece0d607.el8.x 8/25 2023-12-06T14:49:36.906 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-common-2:17.2.7-113.gece0d607.el8.x86 9/25 2023-12-06T14:49:36.906 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cephfs-2:17.2.7-113.gece0d607.el8.x86_64 10/25 2023-12-06T14:49:36.906 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rados-2:17.2.7-113.gece0d607.el8.x86_64 11/25 2023-12-06T14:49:36.906 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rbd-2:17.2.7-113.gece0d607.el8.x86_64 12/25 2023-12-06T14:49:36.906 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rgw-2:17.2.7-113.gece0d607.el8.x86_64 13/25 2023-12-06T14:49:36.906 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 14/25 2023-12-06T14:49:36.906 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-12-06T14:49:36.906 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-12-06T14:49:36.906 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 17/25 2023-12-06T14:49:36.906 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-12-06T14:49:36.906 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2023-12-06T14:49:36.907 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2023-12-06T14:49:36.907 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2023-12-06T14:49:36.907 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-2:17.2.7-113.gece0d607.el8.x86_64 22/25 2023-12-06T14:49:36.907 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-12-06T14:49:36.907 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-2:17.2.7-113.gece0d607.el8.x86_64 24/25 2023-12-06T14:49:38.028 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-12-06T14:49:38.028 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:49:38.028 INFO:teuthology.orchestra.run.smithi152.stdout:Upgraded: 2023-12-06T14:49:38.029 INFO:teuthology.orchestra.run.smithi152.stdout: librados2-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:49:38.029 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:49:38.029 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-12-06T14:49:38.029 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:49:38.029 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:49:38.029 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:49:38.029 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:49:38.029 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-06T14:49:38.029 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:49:38.029 INFO:teuthology.orchestra.run.smithi152.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-06T14:49:38.029 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-12-06T14:49:38.029 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:49:38.029 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-12-06T14:49:38.029 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:49:38.030 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-06T14:49:38.030 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-06T14:49:38.030 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:49:38.030 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:49:38.030 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:49:38.030 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-06T14:49:38.030 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:49:38.030 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:49:38.030 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:49:38.030 INFO:teuthology.orchestra.run.smithi152.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-06T14:49:38.030 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:49:38.030 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-06T14:49:38.278 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-test 2023-12-06T14:49:38.389 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-radosgw-2:17.2.7-113.gece0d607.el8.x86_64 23/25 2023-12-06T14:49:38.466 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-113.gece0d607.el8.x86_64 23/25 2023-12-06T14:49:38.466 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-06T14:49:38.702 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-06T14:49:38.702 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-06T14:49:39.129 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:00:44 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:49:39.367 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-06T14:49:39.367 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-base-2:17.2.7-113.gece0d607.el8.x86_64 1/25 2023-12-06T14:49:39.367 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-common-2:17.2.7-113.gece0d607.el8.x86_64 2/25 2023-12-06T14:49:39.367 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-radosgw-2:17.2.7-113.gece0d607.el8.x86_64 3/25 2023-12-06T14:49:39.367 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-selinux-2:17.2.7-113.gece0d607.el8.x86_64 4/25 2023-12-06T14:49:39.367 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libcephfs2-2:17.2.7-113.gece0d607.el8.x86_64 5/25 2023-12-06T14:49:39.367 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libradosstriper1-2:17.2.7-113.gece0d607.el8.x86_64 6/25 2023-12-06T14:49:39.368 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librgw2-2:17.2.7-113.gece0d607.el8.x86_64 7/25 2023-12-06T14:49:39.368 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-ceph-argparse-2:17.2.7-113.gece0d607.el8.x 8/25 2023-12-06T14:49:39.368 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-ceph-common-2:17.2.7-113.gece0d607.el8.x86 9/25 2023-12-06T14:49:39.368 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cephfs-2:17.2.7-113.gece0d607.el8.x86_64 10/25 2023-12-06T14:49:39.368 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rados-2:17.2.7-113.gece0d607.el8.x86_64 11/25 2023-12-06T14:49:39.368 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rbd-2:17.2.7-113.gece0d607.el8.x86_64 12/25 2023-12-06T14:49:39.368 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rgw-2:17.2.7-113.gece0d607.el8.x86_64 13/25 2023-12-06T14:49:39.368 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 14/25 2023-12-06T14:49:39.368 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-12-06T14:49:39.368 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-12-06T14:49:39.368 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 17/25 2023-12-06T14:49:39.368 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-12-06T14:49:39.368 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2023-12-06T14:49:39.368 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2023-12-06T14:49:39.368 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2023-12-06T14:49:39.368 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librados2-2:17.2.7-113.gece0d607.el8.x86_64 22/25 2023-12-06T14:49:39.368 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-12-06T14:49:39.369 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librbd1-2:17.2.7-113.gece0d607.el8.x86_64 24/25 2023-12-06T14:49:40.574 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-12-06T14:49:40.574 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:49:40.574 INFO:teuthology.orchestra.run.smithi190.stdout:Upgraded: 2023-12-06T14:49:40.574 INFO:teuthology.orchestra.run.smithi190.stdout: librados2-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:49:40.574 INFO:teuthology.orchestra.run.smithi190.stdout: librbd1-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:49:40.574 INFO:teuthology.orchestra.run.smithi190.stdout:Installed: 2023-12-06T14:49:40.574 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-base-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:49:40.575 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-common-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:49:40.575 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-radosgw-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:49:40.575 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-selinux-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:49:40.575 INFO:teuthology.orchestra.run.smithi190.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-06T14:49:40.575 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs2-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:49:40.575 INFO:teuthology.orchestra.run.smithi190.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-06T14:49:40.575 INFO:teuthology.orchestra.run.smithi190.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-12-06T14:49:40.575 INFO:teuthology.orchestra.run.smithi190.stdout: libradosstriper1-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:49:40.575 INFO:teuthology.orchestra.run.smithi190.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-12-06T14:49:40.575 INFO:teuthology.orchestra.run.smithi190.stdout: librgw2-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:49:40.575 INFO:teuthology.orchestra.run.smithi190.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-06T14:49:40.575 INFO:teuthology.orchestra.run.smithi190.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-06T14:49:40.575 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-argparse-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:49:40.575 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-common-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:49:40.576 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cephfs-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:49:40.576 INFO:teuthology.orchestra.run.smithi190.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-06T14:49:40.576 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rados-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:49:40.576 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rbd-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:49:40.576 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rgw-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:49:40.576 INFO:teuthology.orchestra.run.smithi190.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-06T14:49:40.576 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:49:40.576 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2023-12-06T14:49:40.805 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-06T14:49:40.806 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:49:40.807 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2023-12-06T14:49:40.807 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:49:40.807 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2023-12-06T14:49:40.807 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test x86_64 2:17.2.7-113.gece0d607.el8 ceph 52 M 2023-12-06T14:49:40.807 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2023-12-06T14:49:40.807 INFO:teuthology.orchestra.run.smithi152.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2023-12-06T14:49:40.807 INFO:teuthology.orchestra.run.smithi152.stdout: libcephsqlite x86_64 2:17.2.7-113.gece0d607.el8 ceph 174 k 2023-12-06T14:49:40.807 INFO:teuthology.orchestra.run.smithi152.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-12-06T14:49:40.807 INFO:teuthology.orchestra.run.smithi152.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-12-06T14:49:40.807 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-12-06T14:49:40.807 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:49:40.807 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-12-06T14:49:40.807 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:49:40.808 INFO:teuthology.orchestra.run.smithi152.stdout:Install 6 Packages 2023-12-06T14:49:40.808 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:49:40.808 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 53 M 2023-12-06T14:49:40.808 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 234 M 2023-12-06T14:49:40.808 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-12-06T14:49:40.894 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum -y install ceph-test 2023-12-06T14:49:41.206 INFO:teuthology.orchestra.run.smithi152.stdout:(1/6): libcephsqlite-17.2.7-113.gece0d607.el8.x 908 kB/s | 174 kB 00:00 2023-12-06T14:49:41.431 INFO:teuthology.orchestra.run.smithi152.stdout:(2/6): jq-1.6-8.el8.x86_64.rpm 487 kB/s | 203 kB 00:00 2023-12-06T14:49:41.631 INFO:teuthology.orchestra.run.smithi152.stdout:(3/6): oniguruma-6.8.2-2.el8.x86_64.rpm 440 kB/s | 187 kB 00:00 2023-12-06T14:49:41.742 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:00:46 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:49:41.748 INFO:teuthology.orchestra.run.smithi152.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 606 kB/s | 71 kB 00:00 2023-12-06T14:49:41.815 INFO:teuthology.orchestra.run.smithi152.stdout:(5/6): socat-1.7.4.1-1.el8.x86_64.rpm 841 kB/s | 323 kB 00:00 2023-12-06T14:49:43.403 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2023-12-06T14:49:43.404 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:49:43.404 INFO:teuthology.orchestra.run.smithi190.stdout: Package Arch Version Repository Size 2023-12-06T14:49:43.404 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:49:43.404 INFO:teuthology.orchestra.run.smithi190.stdout:Installing: 2023-12-06T14:49:43.404 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-test x86_64 2:17.2.7-113.gece0d607.el8 ceph 52 M 2023-12-06T14:49:43.404 INFO:teuthology.orchestra.run.smithi190.stdout:Installing dependencies: 2023-12-06T14:49:43.405 INFO:teuthology.orchestra.run.smithi190.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2023-12-06T14:49:43.405 INFO:teuthology.orchestra.run.smithi190.stdout: libcephsqlite x86_64 2:17.2.7-113.gece0d607.el8 ceph 174 k 2023-12-06T14:49:43.405 INFO:teuthology.orchestra.run.smithi190.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-12-06T14:49:43.405 INFO:teuthology.orchestra.run.smithi190.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-12-06T14:49:43.405 INFO:teuthology.orchestra.run.smithi190.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-12-06T14:49:43.405 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:49:43.405 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction Summary 2023-12-06T14:49:43.405 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:49:43.405 INFO:teuthology.orchestra.run.smithi190.stdout:Install 6 Packages 2023-12-06T14:49:43.405 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:49:43.406 INFO:teuthology.orchestra.run.smithi190.stdout:Total download size: 53 M 2023-12-06T14:49:43.406 INFO:teuthology.orchestra.run.smithi190.stdout:Installed size: 234 M 2023-12-06T14:49:43.406 INFO:teuthology.orchestra.run.smithi190.stdout:Downloading Packages: 2023-12-06T14:49:43.799 INFO:teuthology.orchestra.run.smithi190.stdout:(1/6): jq-1.6-8.el8.x86_64.rpm 645 kB/s | 203 kB 00:00 2023-12-06T14:49:43.882 INFO:teuthology.orchestra.run.smithi190.stdout:(2/6): oniguruma-6.8.2-2.el8.x86_64.rpm 2.2 MB/s | 187 kB 00:00 2023-12-06T14:49:43.907 INFO:teuthology.orchestra.run.smithi190.stdout:(3/6): libcephsqlite-17.2.7-113.gece0d607.el8.x 411 kB/s | 174 kB 00:00 2023-12-06T14:49:43.975 INFO:teuthology.orchestra.run.smithi190.stdout:(4/6): socat-1.7.4.1-1.el8.x86_64.rpm 3.4 MB/s | 323 kB 00:00 2023-12-06T14:49:44.158 INFO:teuthology.orchestra.run.smithi190.stdout:(5/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 282 kB/s | 71 kB 00:00 2023-12-06T14:49:49.516 INFO:teuthology.orchestra.run.smithi190.stdout:(6/6): ceph-test-17.2.7-113.gece0d607.el8.x86_6 8.6 MB/s | 52 MB 00:06 2023-12-06T14:49:49.518 INFO:teuthology.orchestra.run.smithi190.stdout:-------------------------------------------------------------------------------- 2023-12-06T14:49:49.518 INFO:teuthology.orchestra.run.smithi190.stdout:Total 8.6 MB/s | 53 MB 00:06 2023-12-06T14:49:49.559 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction check 2023-12-06T14:49:49.580 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction check succeeded. 2023-12-06T14:49:49.580 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction test 2023-12-06T14:49:49.865 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction test succeeded. 2023-12-06T14:49:49.868 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction 2023-12-06T14:49:50.332 INFO:teuthology.orchestra.run.smithi190.stdout: Preparing : 1/1 2023-12-06T14:49:50.582 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-12-06T14:49:50.756 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-12-06T14:49:50.889 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-06T14:49:50.994 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-06T14:49:51.185 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2023-12-06T14:49:51.556 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libcephsqlite-2:17.2.7-113.gece0d607.el8.x86_64 5/6 2023-12-06T14:49:55.564 INFO:teuthology.orchestra.run.smithi152.stdout:(6/6): ceph-test-17.2.7-113.gece0d607.el8.x86_6 3.6 MB/s | 52 MB 00:14 2023-12-06T14:49:55.566 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-12-06T14:49:55.566 INFO:teuthology.orchestra.run.smithi152.stdout:Total 3.6 MB/s | 53 MB 00:14 2023-12-06T14:49:55.609 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-12-06T14:49:55.630 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-12-06T14:49:55.630 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-12-06T14:49:55.914 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-12-06T14:49:55.917 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-12-06T14:49:56.388 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-12-06T14:49:56.499 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libcephsqlite-2:17.2.7-113.gece0d607.el8.x86_64 5/6 2023-12-06T14:49:56.613 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-12-06T14:49:56.762 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-test-2:17.2.7-113.gece0d607.el8.x86_64 6/6 2023-12-06T14:49:56.779 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-12-06T14:49:56.944 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-06T14:49:57.031 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-06T14:49:57.051 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-test-2:17.2.7-113.gece0d607.el8.x86_64 6/6 2023-12-06T14:49:57.051 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-test-2:17.2.7-113.gece0d607.el8.x86_64 1/6 2023-12-06T14:49:57.051 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libcephsqlite-2:17.2.7-113.gece0d607.el8.x86_64 2/6 2023-12-06T14:49:57.051 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2023-12-06T14:49:57.051 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-12-06T14:49:57.051 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-12-06T14:49:57.192 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2023-12-06T14:49:57.352 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephsqlite-2:17.2.7-113.gece0d607.el8.x86_64 5/6 2023-12-06T14:49:57.780 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-12-06T14:49:57.780 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:49:57.780 INFO:teuthology.orchestra.run.smithi190.stdout:Installed: 2023-12-06T14:49:57.780 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-test-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:49:57.780 INFO:teuthology.orchestra.run.smithi190.stdout: jq-1.6-8.el8.x86_64 2023-12-06T14:49:57.780 INFO:teuthology.orchestra.run.smithi190.stdout: libcephsqlite-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:49:57.780 INFO:teuthology.orchestra.run.smithi190.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-06T14:49:57.780 INFO:teuthology.orchestra.run.smithi190.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-06T14:49:57.780 INFO:teuthology.orchestra.run.smithi190.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-06T14:49:57.781 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:49:57.781 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2023-12-06T14:49:58.010 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum -y install ceph 2023-12-06T14:49:58.870 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:01:03 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:50:00.526 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2023-12-06T14:50:00.529 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:50:00.530 INFO:teuthology.orchestra.run.smithi190.stdout: Package Arch Version Repository Size 2023-12-06T14:50:00.530 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:50:00.530 INFO:teuthology.orchestra.run.smithi190.stdout:Installing: 2023-12-06T14:50:00.530 INFO:teuthology.orchestra.run.smithi190.stdout: ceph x86_64 2:17.2.7-113.gece0d607.el8 ceph 6.4 k 2023-12-06T14:50:00.530 INFO:teuthology.orchestra.run.smithi190.stdout:Installing dependencies: 2023-12-06T14:50:00.530 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mds x86_64 2:17.2.7-113.gece0d607.el8 ceph 2.3 M 2023-12-06T14:50:00.530 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr x86_64 2:17.2.7-113.gece0d607.el8 ceph 1.6 M 2023-12-06T14:50:00.530 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-modules-core noarch 2:17.2.7-113.gece0d607.el8 ceph-noarch 238 k 2023-12-06T14:50:00.530 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mon x86_64 2:17.2.7-113.gece0d607.el8 ceph 3.9 M 2023-12-06T14:50:00.530 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-osd x86_64 2:17.2.7-113.gece0d607.el8 ceph 17 M 2023-12-06T14:50:00.531 INFO:teuthology.orchestra.run.smithi190.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-06T14:50:00.531 INFO:teuthology.orchestra.run.smithi190.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-06T14:50:00.531 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-12-06T14:50:00.531 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-06T14:50:00.531 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-06T14:50:00.531 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-12-06T14:50:00.531 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-06T14:50:00.531 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-06T14:50:00.531 INFO:teuthology.orchestra.run.smithi190.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-06T14:50:00.531 INFO:teuthology.orchestra.run.smithi190.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-12-06T14:50:00.531 INFO:teuthology.orchestra.run.smithi190.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-12-06T14:50:00.531 INFO:teuthology.orchestra.run.smithi190.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-06T14:50:00.531 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-06T14:50:00.531 INFO:teuthology.orchestra.run.smithi190.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-06T14:50:00.532 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-12-06T14:50:00.532 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-12-06T14:50:00.532 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-12-06T14:50:00.532 INFO:teuthology.orchestra.run.smithi190.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-06T14:50:00.532 INFO:teuthology.orchestra.run.smithi190.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-06T14:50:00.532 INFO:teuthology.orchestra.run.smithi190.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-06T14:50:00.532 INFO:teuthology.orchestra.run.smithi190.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-06T14:50:00.532 INFO:teuthology.orchestra.run.smithi190.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-06T14:50:00.532 INFO:teuthology.orchestra.run.smithi190.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-06T14:50:00.532 INFO:teuthology.orchestra.run.smithi190.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-06T14:50:00.532 INFO:teuthology.orchestra.run.smithi190.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-12-06T14:50:00.532 INFO:teuthology.orchestra.run.smithi190.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-06T14:50:00.532 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:50:00.532 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction Summary 2023-12-06T14:50:00.533 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:50:00.533 INFO:teuthology.orchestra.run.smithi190.stdout:Install 32 Packages 2023-12-06T14:50:00.533 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:50:00.533 INFO:teuthology.orchestra.run.smithi190.stdout:Total download size: 28 M 2023-12-06T14:50:00.533 INFO:teuthology.orchestra.run.smithi190.stdout:Installed size: 110 M 2023-12-06T14:50:00.533 INFO:teuthology.orchestra.run.smithi190.stdout:Downloading Packages: 2023-12-06T14:50:00.876 INFO:teuthology.orchestra.run.smithi190.stdout:(1/32): ceph-17.2.7-113.gece0d607.el8.x86_64.rp 32 kB/s | 6.4 kB 00:00 2023-12-06T14:50:01.068 INFO:teuthology.orchestra.run.smithi190.stdout:(2/32): ceph-mds-17.2.7-113.gece0d607.el8.x86_6 5.9 MB/s | 2.3 MB 00:00 2023-12-06T14:50:01.377 INFO:teuthology.orchestra.run.smithi190.stdout:(3/32): ceph-mgr-17.2.7-113.gece0d607.el8.x86_6 2.2 MB/s | 1.6 MB 00:00 2023-12-06T14:50:01.485 INFO:teuthology.orchestra.run.smithi190.stdout:(4/32): ceph-mgr-modules-core-17.2.7-113.gece0d 2.2 MB/s | 238 kB 00:00 2023-12-06T14:50:01.652 INFO:teuthology.orchestra.run.smithi190.stdout:(5/32): ceph-mon-17.2.7-113.gece0d607.el8.x86_6 5.1 MB/s | 3.9 MB 00:00 2023-12-06T14:50:01.694 INFO:teuthology.orchestra.run.smithi190.stdout:(6/32): python3-mako-1.0.6-14.el8.noarch.rpm 753 kB/s | 157 kB 00:00 2023-12-06T14:50:01.745 INFO:teuthology.orchestra.run.smithi190.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 2.0 MB/s | 103 kB 00:00 2023-12-06T14:50:01.797 INFO:teuthology.orchestra.run.smithi190.stdout:(8/32): python3-markupsafe-0.23-19.el8.x86_64.r 273 kB/s | 39 kB 00:00 2023-12-06T14:50:01.820 INFO:teuthology.orchestra.run.smithi190.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm 758 kB/s | 57 kB 00:00 2023-12-06T14:50:02.005 INFO:teuthology.orchestra.run.smithi190.stdout:(10/32): ceph-osd-17.2.7-113.gece0d607.el8.x86_ 18 MB/s | 17 MB 00:00 2023-12-06T14:50:02.125 INFO:teuthology.orchestra.run.smithi190.stdout:(11/32): python3-werkzeug-0.12.2-4.el8.noarch.r 1.4 MB/s | 457 kB 00:00 2023-12-06T14:50:02.315 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephsqlite-2:17.2.7-113.gece0d607.el8.x86_64 5/6 2023-12-06T14:50:02.429 INFO:teuthology.orchestra.run.smithi190.stdout:(12/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 408 kB/s | 249 kB 00:00 2023-12-06T14:50:02.550 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-test-2:17.2.7-113.gece0d607.el8.x86_64 6/6 2023-12-06T14:50:02.571 INFO:teuthology.orchestra.run.smithi190.stdout:(13/32): python3-pycparser-2.14-14.el8.noarch.r 244 kB/s | 109 kB 00:00 2023-12-06T14:50:02.840 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-test-2:17.2.7-113.gece0d607.el8.x86_64 6/6 2023-12-06T14:50:02.840 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-test-2:17.2.7-113.gece0d607.el8.x86_64 1/6 2023-12-06T14:50:02.840 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephsqlite-2:17.2.7-113.gece0d607.el8.x86_64 2/6 2023-12-06T14:50:02.840 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2023-12-06T14:50:02.840 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-12-06T14:50:02.840 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-12-06T14:50:02.863 INFO:teuthology.orchestra.run.smithi190.stdout:(14/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 100 kB/s | 44 kB 00:00 2023-12-06T14:50:02.889 INFO:teuthology.orchestra.run.smithi190.stdout:(15/32): python3-cryptography-3.2.1-6.el8.x86_6 725 kB/s | 641 kB 00:00 2023-12-06T14:50:03.081 INFO:teuthology.orchestra.run.smithi190.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 364 kB/s | 185 kB 00:00 2023-12-06T14:50:03.208 INFO:teuthology.orchestra.run.smithi190.stdout:(17/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 502 kB/s | 173 kB 00:00 2023-12-06T14:50:03.239 INFO:teuthology.orchestra.run.smithi190.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 70 kB/s | 11 kB 00:00 2023-12-06T14:50:03.348 INFO:teuthology.orchestra.run.smithi190.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 125 kB/s | 18 kB 00:00 2023-12-06T14:50:03.382 INFO:teuthology.orchestra.run.smithi190.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 343 kB/s | 49 kB 00:00 2023-12-06T14:50:03.552 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-12-06T14:50:03.553 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:50:03.553 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-12-06T14:50:03.553 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:50:03.553 INFO:teuthology.orchestra.run.smithi152.stdout: jq-1.6-8.el8.x86_64 2023-12-06T14:50:03.553 INFO:teuthology.orchestra.run.smithi152.stdout: libcephsqlite-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:50:03.553 INFO:teuthology.orchestra.run.smithi152.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-06T14:50:03.553 INFO:teuthology.orchestra.run.smithi152.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-06T14:50:03.553 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-06T14:50:03.553 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:50:03.553 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-06T14:50:03.749 INFO:teuthology.orchestra.run.smithi190.stdout:(21/32): python3-pecan-1.3.2-9.el8.noarch.rpm 771 kB/s | 283 kB 00:00 2023-12-06T14:50:03.806 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph 2023-12-06T14:50:03.857 INFO:teuthology.orchestra.run.smithi190.stdout:(22/32): python3-portend-2.6-1.el8.noarch.rpm 144 kB/s | 16 kB 00:00 2023-12-06T14:50:03.899 INFO:teuthology.orchestra.run.smithi190.stdout:(23/32): python3-cherrypy-18.4.0-1.el8.noarch.r 381 kB/s | 384 kB 00:01 2023-12-06T14:50:03.958 INFO:teuthology.orchestra.run.smithi190.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 186 kB/s | 19 kB 00:00 2023-12-06T14:50:04.000 INFO:teuthology.orchestra.run.smithi190.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 239 kB/s | 24 kB 00:00 2023-12-06T14:50:04.083 INFO:teuthology.orchestra.run.smithi190.stdout:(26/32): python3-tempora-1.14.1-5.el8.noarch.rp 233 kB/s | 29 kB 00:00 2023-12-06T14:50:04.117 INFO:teuthology.orchestra.run.smithi190.stdout:(27/32): python3-trustme-0.6.0-4.el8.noarch.rpm 235 kB/s | 27 kB 00:00 2023-12-06T14:50:04.168 INFO:teuthology.orchestra.run.smithi190.stdout:(28/32): python3-more-itertools-7.2.0-3.el8.noa 72 kB/s | 59 kB 00:00 2023-12-06T14:50:04.330 INFO:teuthology.orchestra.run.smithi190.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 1.0 MB/s | 255 kB 00:00 2023-12-06T14:50:04.435 INFO:teuthology.orchestra.run.smithi190.stdout:(30/32): python3-zc-lockfile-2.0-2.el8.noarch.r 218 kB/s | 23 kB 00:00 2023-12-06T14:50:04.477 INFO:teuthology.orchestra.run.smithi190.stdout:(31/32): python3-webtest-2.0.33-1.el8.noarch.rp 276 kB/s | 85 kB 00:00 2023-12-06T14:50:04.552 INFO:teuthology.orchestra.run.smithi190.stdout:(32/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 579 kB/s | 251 kB 00:00 2023-12-06T14:50:04.553 INFO:teuthology.orchestra.run.smithi190.stdout:-------------------------------------------------------------------------------- 2023-12-06T14:50:04.553 INFO:teuthology.orchestra.run.smithi190.stdout:Total 7.1 MB/s | 28 MB 00:04 2023-12-06T14:50:04.639 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction check 2023-12-06T14:50:04.669 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:09 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:50:04.676 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction check succeeded. 2023-12-06T14:50:04.676 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction test 2023-12-06T14:50:04.993 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction test succeeded. 2023-12-06T14:50:04.996 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction 2023-12-06T14:50:06.134 INFO:teuthology.orchestra.run.smithi190.stdout: Preparing : 1/1 2023-12-06T14:50:06.350 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-12-06T14:50:06.351 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-06T14:50:06.355 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:50:06.355 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2023-12-06T14:50:06.355 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:50:06.355 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2023-12-06T14:50:06.355 INFO:teuthology.orchestra.run.smithi152.stdout: ceph x86_64 2:17.2.7-113.gece0d607.el8 ceph 6.4 k 2023-12-06T14:50:06.355 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2023-12-06T14:50:06.355 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds x86_64 2:17.2.7-113.gece0d607.el8 ceph 2.3 M 2023-12-06T14:50:06.355 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr x86_64 2:17.2.7-113.gece0d607.el8 ceph 1.6 M 2023-12-06T14:50:06.355 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core noarch 2:17.2.7-113.gece0d607.el8 ceph-noarch 238 k 2023-12-06T14:50:06.355 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon x86_64 2:17.2.7-113.gece0d607.el8 ceph 3.9 M 2023-12-06T14:50:06.355 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd x86_64 2:17.2.7-113.gece0d607.el8 ceph 17 M 2023-12-06T14:50:06.355 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-06T14:50:06.356 INFO:teuthology.orchestra.run.smithi152.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-06T14:50:06.356 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-12-06T14:50:06.356 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-06T14:50:06.356 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-06T14:50:06.356 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-12-06T14:50:06.356 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-06T14:50:06.356 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-06T14:50:06.356 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-06T14:50:06.356 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-12-06T14:50:06.356 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-12-06T14:50:06.356 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-06T14:50:06.356 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-06T14:50:06.356 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-06T14:50:06.356 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-12-06T14:50:06.356 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-12-06T14:50:06.357 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-12-06T14:50:06.357 INFO:teuthology.orchestra.run.smithi152.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-06T14:50:06.357 INFO:teuthology.orchestra.run.smithi152.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-06T14:50:06.357 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-06T14:50:06.357 INFO:teuthology.orchestra.run.smithi152.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-06T14:50:06.357 INFO:teuthology.orchestra.run.smithi152.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-06T14:50:06.357 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-06T14:50:06.357 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-06T14:50:06.357 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-12-06T14:50:06.357 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-06T14:50:06.357 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:50:06.357 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-12-06T14:50:06.357 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:50:06.357 INFO:teuthology.orchestra.run.smithi152.stdout:Install 32 Packages 2023-12-06T14:50:06.358 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:50:06.358 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 28 M 2023-12-06T14:50:06.358 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 110 M 2023-12-06T14:50:06.358 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-12-06T14:50:06.678 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-12-06T14:50:06.934 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-12-06T14:50:07.575 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2023-12-06T14:50:07.748 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-12-06T14:50:07.946 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-12-06T14:50:07.964 INFO:teuthology.orchestra.run.smithi152.stdout:(1/32): ceph-17.2.7-113.gece0d607.el8.x86_64.rp 29 kB/s | 6.4 kB 00:00 2023-12-06T14:50:08.148 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-12-06T14:50:08.340 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-12-06T14:50:08.398 INFO:teuthology.orchestra.run.smithi152.stdout:(2/32): ceph-mgr-17.2.7-113.gece0d607.el8.x86_6 2.4 MB/s | 1.6 MB 00:00 2023-12-06T14:50:08.566 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-12-06T14:50:08.796 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-12-06T14:50:08.815 INFO:teuthology.orchestra.run.smithi152.stdout:(3/32): ceph-mds-17.2.7-113.gece0d607.el8.x86_6 2.2 MB/s | 2.3 MB 00:01 2023-12-06T14:50:08.915 INFO:teuthology.orchestra.run.smithi152.stdout:(4/32): ceph-mon-17.2.7-113.gece0d607.el8.x86_6 4.1 MB/s | 3.9 MB 00:00 2023-12-06T14:50:09.033 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-12-06T14:50:09.035 INFO:teuthology.orchestra.run.smithi152.stdout:(5/32): ceph-mgr-modules-core-17.2.7-113.gece0d 1.1 MB/s | 238 kB 00:00 2023-12-06T14:50:09.307 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-12-06T14:50:09.449 INFO:teuthology.orchestra.run.smithi152.stdout:(6/32): python3-mako-1.0.6-14.el8.noarch.rpm 294 kB/s | 157 kB 00:00 2023-12-06T14:50:09.687 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2023-12-06T14:50:09.733 INFO:teuthology.orchestra.run.smithi152.stdout:(7/32): python3-markupsafe-0.23-19.el8.x86_64.r 56 kB/s | 39 kB 00:00 2023-12-06T14:50:09.766 INFO:teuthology.orchestra.run.smithi152.stdout:(8/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 326 kB/s | 103 kB 00:00 2023-12-06T14:50:09.950 INFO:teuthology.orchestra.run.smithi152.stdout:(9/32): ceph-osd-17.2.7-113.gece0d607.el8.x86_6 11 MB/s | 17 MB 00:01 2023-12-06T14:50:09.953 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 14/32 2023-12-06T14:50:09.975 INFO:teuthology.orchestra.run.smithi152.stdout:(10/32): python3-pytz-2017.2-11.el8.noarch.rpm 235 kB/s | 57 kB 00:00 2023-12-06T14:50:10.059 INFO:teuthology.orchestra.run.smithi152.stdout:(11/32): python3-werkzeug-0.12.2-4.el8.noarch.r 1.5 MB/s | 457 kB 00:00 2023-12-06T14:50:10.141 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-12-06T14:50:10.443 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-12-06T14:50:10.542 INFO:teuthology.orchestra.run.smithi152.stdout:(12/32): python3-pycparser-2.14-14.el8.noarch.r 226 kB/s | 109 kB 00:00 2023-12-06T14:50:10.567 INFO:teuthology.orchestra.run.smithi152.stdout:(13/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 403 kB/s | 249 kB 00:00 2023-12-06T14:50:10.651 INFO:teuthology.orchestra.run.smithi152.stdout:(14/32): python3-cryptography-3.2.1-6.el8.x86_6 949 kB/s | 641 kB 00:00 2023-12-06T14:50:10.667 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-06T14:50:10.960 INFO:teuthology.orchestra.run.smithi152.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 104 kB/s | 44 kB 00:00 2023-12-06T14:50:10.967 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-12-06T14:50:11.052 INFO:teuthology.orchestra.run.smithi152.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 383 kB/s | 185 kB 00:00 2023-12-06T14:50:11.160 INFO:teuthology.orchestra.run.smithi152.stdout:(17/32): python3-jaraco-6.2-6.el8.noarch.rpm 102 kB/s | 11 kB 00:00 2023-12-06T14:50:11.194 INFO:teuthology.orchestra.run.smithi152.stdout:(18/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 318 kB/s | 173 kB 00:00 2023-12-06T14:50:11.206 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-12-06T14:50:11.261 INFO:teuthology.orchestra.run.smithi152.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 175 kB/s | 18 kB 00:00 2023-12-06T14:50:11.303 INFO:teuthology.orchestra.run.smithi152.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 449 kB/s | 49 kB 00:00 2023-12-06T14:50:11.378 INFO:teuthology.orchestra.run.smithi152.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 502 kB/s | 59 kB 00:00 2023-12-06T14:50:11.380 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2023-12-06T14:50:11.478 INFO:teuthology.orchestra.run.smithi152.stdout:(22/32): python3-portend-2.6-1.el8.noarch.rpm 156 kB/s | 16 kB 00:00 2023-12-06T14:50:11.545 INFO:teuthology.orchestra.run.smithi152.stdout:(23/32): python3-cherrypy-18.4.0-1.el8.noarch.r 658 kB/s | 384 kB 00:00 2023-12-06T14:50:11.570 INFO:teuthology.orchestra.run.smithi152.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 204 kB/s | 19 kB 00:00 2023-12-06T14:50:11.597 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-12-06T14:50:11.646 INFO:teuthology.orchestra.run.smithi152.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 238 kB/s | 24 kB 00:00 2023-12-06T14:50:11.663 INFO:teuthology.orchestra.run.smithi152.stdout:(26/32): python3-tempora-1.14.1-5.el8.noarch.rp 318 kB/s | 29 kB 00:00 2023-12-06T14:50:11.721 INFO:teuthology.orchestra.run.smithi152.stdout:(27/32): python3-pecan-1.3.2-9.el8.noarch.rpm 676 kB/s | 283 kB 00:00 2023-12-06T14:50:11.746 INFO:teuthology.orchestra.run.smithi152.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 274 kB/s | 27 kB 00:00 2023-12-06T14:50:11.851 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-12-06T14:50:11.938 INFO:teuthology.orchestra.run.smithi152.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 927 kB/s | 255 kB 00:00 2023-12-06T14:50:11.964 INFO:teuthology.orchestra.run.smithi152.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 394 kB/s | 85 kB 00:00 2023-12-06T14:50:12.039 INFO:teuthology.orchestra.run.smithi152.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 229 kB/s | 23 kB 00:00 2023-12-06T14:50:12.064 INFO:teuthology.orchestra.run.smithi152.stdout:(32/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 734 kB/s | 251 kB 00:00 2023-12-06T14:50:12.065 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-12-06T14:50:12.065 INFO:teuthology.orchestra.run.smithi152.stdout:Total 5.0 MB/s | 28 MB 00:05 2023-12-06T14:50:12.106 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-12-06T14:50:12.151 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-12-06T14:50:12.187 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-12-06T14:50:12.188 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-12-06T14:50:12.310 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-12-06T14:50:12.490 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-12-06T14:50:12.493 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-12-06T14:50:12.626 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2023-12-06T14:50:13.125 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-12-06T14:50:13.497 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-113.gece0d607.el8.n 27/32 2023-12-06T14:50:13.588 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-12-06T14:50:13.733 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-2:17.2.7-113.gece0d607.el8.x86_64 28/32 2023-12-06T14:50:13.838 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-12-06T14:50:14.098 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-12-06T14:50:14.374 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-12-06T14:50:14.622 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2023-12-06T14:50:14.845 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-12-06T14:50:15.018 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-12-06T14:50:15.194 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-12-06T14:50:15.221 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-2:17.2.7-113.gece0d607.el8.x86_64 28/32 2023-12-06T14:50:15.405 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-12-06T14:50:15.425 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-osd-2:17.2.7-113.gece0d607.el8.x86_64 29/32 2023-12-06T14:50:15.605 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-12-06T14:50:15.802 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-12-06T14:50:15.832 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-osd-2:17.2.7-113.gece0d607.el8.x86_64 29/32 2023-12-06T14:50:16.055 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-12-06T14:50:16.058 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mon-2:17.2.7-113.gece0d607.el8.x86_64 30/32 2023-12-06T14:50:16.274 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mon-2:17.2.7-113.gece0d607.el8.x86_64 30/32 2023-12-06T14:50:16.296 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-12-06T14:50:16.485 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mds-2:17.2.7-113.gece0d607.el8.x86_64 31/32 2023-12-06T14:50:16.503 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mds-2:17.2.7-113.gece0d607.el8.x86_64 31/32 2023-12-06T14:50:16.627 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-2:17.2.7-113.gece0d607.el8.x86_64 32/32 2023-12-06T14:50:16.678 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2023-12-06T14:50:16.901 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 14/32 2023-12-06T14:50:17.019 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-2:17.2.7-113.gece0d607.el8.x86_64 32/32 2023-12-06T14:50:17.019 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-2:17.2.7-113.gece0d607.el8.x86_64 1/32 2023-12-06T14:50:17.019 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mds-2:17.2.7-113.gece0d607.el8.x86_64 2/32 2023-12-06T14:50:17.019 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-2:17.2.7-113.gece0d607.el8.x86_64 3/32 2023-12-06T14:50:17.020 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mon-2:17.2.7-113.gece0d607.el8.x86_64 4/32 2023-12-06T14:50:17.020 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-osd-2:17.2.7-113.gece0d607.el8.x86_64 5/32 2023-12-06T14:50:17.020 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-113.gece0d607.el8.n 6/32 2023-12-06T14:50:17.020 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2023-12-06T14:50:17.020 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-12-06T14:50:17.020 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-12-06T14:50:17.020 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2023-12-06T14:50:17.020 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-12-06T14:50:17.020 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2023-12-06T14:50:17.020 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 13/32 2023-12-06T14:50:17.021 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-12-06T14:50:17.021 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-12-06T14:50:17.021 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-12-06T14:50:17.021 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-06T14:50:17.021 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-12-06T14:50:17.022 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-12-06T14:50:17.022 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-12-06T14:50:17.022 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-12-06T14:50:17.022 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-12-06T14:50:17.022 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-12-06T14:50:17.022 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-12-06T14:50:17.022 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-12-06T14:50:17.022 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-12-06T14:50:17.022 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-12-06T14:50:17.022 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-12-06T14:50:17.022 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2023-12-06T14:50:17.022 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-12-06T14:50:17.023 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-12-06T14:50:17.106 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-12-06T14:50:17.348 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-12-06T14:50:17.549 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-06T14:50:17.857 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-12-06T14:50:18.062 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-12-06T14:50:18.164 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-12-06T14:50:18.164 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:50:18.164 INFO:teuthology.orchestra.run.smithi190.stdout:Installed: 2023-12-06T14:50:18.164 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:50:18.164 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mds-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:50:18.164 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:50:18.164 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-modules-core-2:17.2.7-113.gece0d607.el8.noarch 2023-12-06T14:50:18.164 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mon-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:50:18.164 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-osd-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:50:18.164 INFO:teuthology.orchestra.run.smithi190.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-06T14:50:18.164 INFO:teuthology.orchestra.run.smithi190.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-06T14:50:18.164 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-12-06T14:50:18.164 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-06T14:50:18.165 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-06T14:50:18.165 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-12-06T14:50:18.165 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-06T14:50:18.165 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-06T14:50:18.165 INFO:teuthology.orchestra.run.smithi190.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-06T14:50:18.165 INFO:teuthology.orchestra.run.smithi190.stdout: python3-mako-1.0.6-14.el8.noarch 2023-12-06T14:50:18.165 INFO:teuthology.orchestra.run.smithi190.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-06T14:50:18.165 INFO:teuthology.orchestra.run.smithi190.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-06T14:50:18.165 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-06T14:50:18.165 INFO:teuthology.orchestra.run.smithi190.stdout: python3-portend-2.6-1.el8.noarch 2023-12-06T14:50:18.165 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-06T14:50:18.165 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-06T14:50:18.165 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pytz-2017.2-11.el8.noarch 2023-12-06T14:50:18.165 INFO:teuthology.orchestra.run.smithi190.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-06T14:50:18.166 INFO:teuthology.orchestra.run.smithi190.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-06T14:50:18.166 INFO:teuthology.orchestra.run.smithi190.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-06T14:50:18.166 INFO:teuthology.orchestra.run.smithi190.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-06T14:50:18.166 INFO:teuthology.orchestra.run.smithi190.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-06T14:50:18.166 INFO:teuthology.orchestra.run.smithi190.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-06T14:50:18.166 INFO:teuthology.orchestra.run.smithi190.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-06T14:50:18.166 INFO:teuthology.orchestra.run.smithi190.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-06T14:50:18.166 INFO:teuthology.orchestra.run.smithi190.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-06T14:50:18.166 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:50:18.166 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2023-12-06T14:50:18.201 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2023-12-06T14:50:18.369 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum -y install ceph-base 2023-12-06T14:50:18.395 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-12-06T14:50:18.630 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-12-06T14:50:18.873 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-12-06T14:50:19.076 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-12-06T14:50:19.219 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:01:24 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:50:19.383 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2023-12-06T14:50:19.694 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-12-06T14:50:20.045 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-113.gece0d607.el8.n 27/32 2023-12-06T14:50:20.256 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-2:17.2.7-113.gece0d607.el8.x86_64 28/32 2023-12-06T14:50:20.678 INFO:teuthology.orchestra.run.smithi190.stdout:Package ceph-base-2:17.2.7-113.gece0d607.el8.x86_64 is already installed. 2023-12-06T14:50:20.902 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2023-12-06T14:50:20.903 INFO:teuthology.orchestra.run.smithi190.stdout:Nothing to do. 2023-12-06T14:50:20.903 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2023-12-06T14:50:21.009 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum -y install cephadm 2023-12-06T14:50:21.738 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-2:17.2.7-113.gece0d607.el8.x86_64 28/32 2023-12-06T14:50:21.852 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:01:26 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:50:21.931 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-osd-2:17.2.7-113.gece0d607.el8.x86_64 29/32 2023-12-06T14:50:22.336 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-osd-2:17.2.7-113.gece0d607.el8.x86_64 29/32 2023-12-06T14:50:22.515 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mon-2:17.2.7-113.gece0d607.el8.x86_64 30/32 2023-12-06T14:50:22.731 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mon-2:17.2.7-113.gece0d607.el8.x86_64 30/32 2023-12-06T14:50:22.940 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mds-2:17.2.7-113.gece0d607.el8.x86_64 31/32 2023-12-06T14:50:22.958 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mds-2:17.2.7-113.gece0d607.el8.x86_64 31/32 2023-12-06T14:50:23.089 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-2:17.2.7-113.gece0d607.el8.x86_64 32/32 2023-12-06T14:50:23.500 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-2:17.2.7-113.gece0d607.el8.x86_64 32/32 2023-12-06T14:50:23.501 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-2:17.2.7-113.gece0d607.el8.x86_64 1/32 2023-12-06T14:50:23.501 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mds-2:17.2.7-113.gece0d607.el8.x86_64 2/32 2023-12-06T14:50:23.501 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-2:17.2.7-113.gece0d607.el8.x86_64 3/32 2023-12-06T14:50:23.501 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mon-2:17.2.7-113.gece0d607.el8.x86_64 4/32 2023-12-06T14:50:23.501 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-osd-2:17.2.7-113.gece0d607.el8.x86_64 5/32 2023-12-06T14:50:23.501 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-113.gece0d607.el8.n 6/32 2023-12-06T14:50:23.501 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2023-12-06T14:50:23.501 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-12-06T14:50:23.501 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-12-06T14:50:23.501 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2023-12-06T14:50:23.501 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-12-06T14:50:23.501 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2023-12-06T14:50:23.501 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 13/32 2023-12-06T14:50:23.501 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-12-06T14:50:23.502 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-12-06T14:50:23.502 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-12-06T14:50:23.502 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-06T14:50:23.502 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-12-06T14:50:23.502 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-12-06T14:50:23.502 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-12-06T14:50:23.502 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-12-06T14:50:23.502 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-12-06T14:50:23.502 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-12-06T14:50:23.502 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-12-06T14:50:23.502 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-12-06T14:50:23.502 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-12-06T14:50:23.502 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-12-06T14:50:23.502 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-12-06T14:50:23.503 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2023-12-06T14:50:23.503 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-12-06T14:50:23.503 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-12-06T14:50:23.533 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2023-12-06T14:50:23.533 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:50:23.533 INFO:teuthology.orchestra.run.smithi190.stdout: Package Arch Version Repository Size 2023-12-06T14:50:23.533 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:50:23.533 INFO:teuthology.orchestra.run.smithi190.stdout:Installing: 2023-12-06T14:50:23.534 INFO:teuthology.orchestra.run.smithi190.stdout: cephadm noarch 2:17.2.7-113.gece0d607.el8 ceph-noarch 80 k 2023-12-06T14:50:23.534 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:50:23.534 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction Summary 2023-12-06T14:50:23.534 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:50:23.534 INFO:teuthology.orchestra.run.smithi190.stdout:Install 1 Package 2023-12-06T14:50:23.534 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:50:23.534 INFO:teuthology.orchestra.run.smithi190.stdout:Total download size: 80 k 2023-12-06T14:50:23.535 INFO:teuthology.orchestra.run.smithi190.stdout:Installed size: 364 k 2023-12-06T14:50:23.535 INFO:teuthology.orchestra.run.smithi190.stdout:Downloading Packages: 2023-12-06T14:50:23.919 INFO:teuthology.orchestra.run.smithi190.stdout:cephadm-17.2.7-113.gece0d607.el8.noarch.rpm 209 kB/s | 80 kB 00:00 2023-12-06T14:50:23.920 INFO:teuthology.orchestra.run.smithi190.stdout:-------------------------------------------------------------------------------- 2023-12-06T14:50:23.920 INFO:teuthology.orchestra.run.smithi190.stdout:Total 208 kB/s | 80 kB 00:00 2023-12-06T14:50:23.920 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction check 2023-12-06T14:50:23.928 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction check succeeded. 2023-12-06T14:50:23.928 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction test 2023-12-06T14:50:23.930 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction test succeeded. 2023-12-06T14:50:23.933 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction 2023-12-06T14:50:24.585 INFO:teuthology.orchestra.run.smithi190.stdout: Preparing : 1/1 2023-12-06T14:50:24.724 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-12-06T14:50:24.724 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:50:24.724 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-12-06T14:50:24.724 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:50:24.724 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:50:24.724 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:50:24.724 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core-2:17.2.7-113.gece0d607.el8.noarch 2023-12-06T14:50:24.724 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:50:24.724 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:50:24.725 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-06T14:50:24.725 INFO:teuthology.orchestra.run.smithi152.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-06T14:50:24.725 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-12-06T14:50:24.725 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-06T14:50:24.725 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-06T14:50:24.725 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-12-06T14:50:24.725 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-06T14:50:24.725 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-06T14:50:24.725 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-06T14:50:24.725 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako-1.0.6-14.el8.noarch 2023-12-06T14:50:24.725 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-06T14:50:24.725 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-06T14:50:24.725 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-06T14:50:24.725 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend-2.6-1.el8.noarch 2023-12-06T14:50:24.726 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-06T14:50:24.726 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-06T14:50:24.726 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz-2017.2-11.el8.noarch 2023-12-06T14:50:24.726 INFO:teuthology.orchestra.run.smithi152.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-06T14:50:24.726 INFO:teuthology.orchestra.run.smithi152.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-06T14:50:24.726 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-06T14:50:24.726 INFO:teuthology.orchestra.run.smithi152.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-06T14:50:24.726 INFO:teuthology.orchestra.run.smithi152.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-06T14:50:24.726 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-06T14:50:24.726 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-06T14:50:24.726 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-06T14:50:24.726 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-06T14:50:24.726 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:50:24.726 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-06T14:50:24.952 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-base 2023-12-06T14:50:25.805 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:30 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:50:26.135 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: cephadm-2:17.2.7-113.gece0d607.el8.noarch 1/1 2023-12-06T14:50:26.320 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : cephadm-2:17.2.7-113.gece0d607.el8.noarch 1/1 2023-12-06T14:50:26.553 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: cephadm-2:17.2.7-113.gece0d607.el8.noarch 1/1 2023-12-06T14:50:27.256 INFO:teuthology.orchestra.run.smithi152.stdout:Package ceph-base-2:17.2.7-113.gece0d607.el8.x86_64 is already installed. 2023-12-06T14:50:27.283 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : cephadm-2:17.2.7-113.gece0d607.el8.noarch 1/1 2023-12-06T14:50:27.283 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:50:27.283 INFO:teuthology.orchestra.run.smithi190.stdout:Installed: 2023-12-06T14:50:27.283 INFO:teuthology.orchestra.run.smithi190.stdout: cephadm-2:17.2.7-113.gece0d607.el8.noarch 2023-12-06T14:50:27.284 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:50:27.284 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2023-12-06T14:50:27.480 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-06T14:50:27.481 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2023-12-06T14:50:27.481 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-06T14:50:27.507 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum -y install ceph-immutable-object-cache 2023-12-06T14:50:27.589 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install cephadm 2023-12-06T14:50:28.361 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:01:33 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:50:28.438 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:33 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:50:30.025 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2023-12-06T14:50:30.025 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:50:30.026 INFO:teuthology.orchestra.run.smithi190.stdout: Package Arch Version Repo Size 2023-12-06T14:50:30.026 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:50:30.026 INFO:teuthology.orchestra.run.smithi190.stdout:Installing: 2023-12-06T14:50:30.026 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-113.gece0d607.el8 ceph 161 k 2023-12-06T14:50:30.026 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:50:30.026 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction Summary 2023-12-06T14:50:30.026 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:50:30.026 INFO:teuthology.orchestra.run.smithi190.stdout:Install 1 Package 2023-12-06T14:50:30.026 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:50:30.027 INFO:teuthology.orchestra.run.smithi190.stdout:Total download size: 161 k 2023-12-06T14:50:30.027 INFO:teuthology.orchestra.run.smithi190.stdout:Installed size: 490 k 2023-12-06T14:50:30.027 INFO:teuthology.orchestra.run.smithi190.stdout:Downloading Packages: 2023-12-06T14:50:30.123 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-06T14:50:30.123 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:50:30.123 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2023-12-06T14:50:30.123 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:50:30.123 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2023-12-06T14:50:30.124 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm noarch 2:17.2.7-113.gece0d607.el8 ceph-noarch 80 k 2023-12-06T14:50:30.124 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:50:30.124 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-12-06T14:50:30.124 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:50:30.124 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2023-12-06T14:50:30.124 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:50:30.124 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 80 k 2023-12-06T14:50:30.125 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 364 k 2023-12-06T14:50:30.125 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-12-06T14:50:30.466 INFO:teuthology.orchestra.run.smithi190.stdout:ceph-immutable-object-cache-17.2.7-113.gece0d60 367 kB/s | 161 kB 00:00 2023-12-06T14:50:30.467 INFO:teuthology.orchestra.run.smithi190.stdout:-------------------------------------------------------------------------------- 2023-12-06T14:50:30.467 INFO:teuthology.orchestra.run.smithi190.stdout:Total 366 kB/s | 161 kB 00:00 2023-12-06T14:50:30.467 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction check 2023-12-06T14:50:30.478 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction check succeeded. 2023-12-06T14:50:30.478 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction test 2023-12-06T14:50:30.526 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction test succeeded. 2023-12-06T14:50:30.529 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction 2023-12-06T14:50:30.667 INFO:teuthology.orchestra.run.smithi190.stdout: Preparing : 1/1 2023-12-06T14:50:30.864 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-113.gece0d607.e 1/1 2023-12-06T14:50:30.919 INFO:teuthology.orchestra.run.smithi152.stdout:cephadm-17.2.7-113.gece0d607.el8.noarch.rpm 101 kB/s | 80 kB 00:00 2023-12-06T14:50:30.920 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-12-06T14:50:30.920 INFO:teuthology.orchestra.run.smithi152.stdout:Total 101 kB/s | 80 kB 00:00 2023-12-06T14:50:30.920 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-12-06T14:50:30.929 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-12-06T14:50:30.930 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-12-06T14:50:30.932 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-12-06T14:50:30.935 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-12-06T14:50:31.277 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-113.gece0d607.e 1/1 2023-12-06T14:50:31.586 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-12-06T14:50:32.030 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-113.gece0d607.e 1/1 2023-12-06T14:50:32.030 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:50:32.030 INFO:teuthology.orchestra.run.smithi190.stdout:Installed: 2023-12-06T14:50:32.030 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-immutable-object-cache-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:50:32.030 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:50:32.030 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2023-12-06T14:50:32.229 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum -y install ceph-mgr 2023-12-06T14:50:32.876 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephadm-2:17.2.7-113.gece0d607.el8.noarch 1/1 2023-12-06T14:50:33.059 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephadm-2:17.2.7-113.gece0d607.el8.noarch 1/1 2023-12-06T14:50:33.079 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:01:38 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:50:33.291 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephadm-2:17.2.7-113.gece0d607.el8.noarch 1/1 2023-12-06T14:50:33.953 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephadm-2:17.2.7-113.gece0d607.el8.noarch 1/1 2023-12-06T14:50:33.953 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:50:33.953 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-12-06T14:50:33.953 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm-2:17.2.7-113.gece0d607.el8.noarch 2023-12-06T14:50:33.954 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:50:33.954 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-06T14:50:34.177 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-immutable-object-cache 2023-12-06T14:50:34.540 INFO:teuthology.orchestra.run.smithi190.stdout:Package ceph-mgr-2:17.2.7-113.gece0d607.el8.x86_64 is already installed. 2023-12-06T14:50:34.763 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2023-12-06T14:50:34.764 INFO:teuthology.orchestra.run.smithi190.stdout:Nothing to do. 2023-12-06T14:50:34.765 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2023-12-06T14:50:34.867 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum -y install ceph-mgr-dashboard 2023-12-06T14:50:35.039 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:40 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:50:35.724 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:01:40 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:50:36.734 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-06T14:50:36.735 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:50:36.735 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repo Size 2023-12-06T14:50:36.735 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:50:36.735 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2023-12-06T14:50:36.735 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-113.gece0d607.el8 ceph 161 k 2023-12-06T14:50:36.736 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:50:36.736 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-12-06T14:50:36.736 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:50:36.736 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2023-12-06T14:50:36.736 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:50:36.736 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 161 k 2023-12-06T14:50:36.736 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 490 k 2023-12-06T14:50:36.736 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-12-06T14:50:37.031 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-immutable-object-cache-17.2.7-113.gece0d60 549 kB/s | 161 kB 00:00 2023-12-06T14:50:37.031 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-12-06T14:50:37.032 INFO:teuthology.orchestra.run.smithi152.stdout:Total 546 kB/s | 161 kB 00:00 2023-12-06T14:50:37.032 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-12-06T14:50:37.042 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-12-06T14:50:37.042 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-12-06T14:50:37.088 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-12-06T14:50:37.091 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-12-06T14:50:37.208 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-12-06T14:50:37.411 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2023-12-06T14:50:37.413 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:50:37.413 INFO:teuthology.orchestra.run.smithi190.stdout: Package Arch Version Repository Size 2023-12-06T14:50:37.413 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:50:37.413 INFO:teuthology.orchestra.run.smithi190.stdout:Installing: 2023-12-06T14:50:37.413 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-dashboard noarch 2:17.2.7-113.gece0d607.el8 ceph-noarch 1.7 M 2023-12-06T14:50:37.413 INFO:teuthology.orchestra.run.smithi190.stdout:Installing dependencies: 2023-12-06T14:50:37.413 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-grafana-dashboards noarch 2:17.2.7-113.gece0d607.el8 ceph-noarch 23 k 2023-12-06T14:50:37.413 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-prometheus-alerts noarch 2:17.2.7-113.gece0d607.el8 ceph-noarch 14 k 2023-12-06T14:50:37.413 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-12-06T14:50:37.413 INFO:teuthology.orchestra.run.smithi190.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-06T14:50:37.414 INFO:teuthology.orchestra.run.smithi190.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-06T14:50:37.414 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:50:37.414 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction Summary 2023-12-06T14:50:37.414 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:50:37.414 INFO:teuthology.orchestra.run.smithi190.stdout:Install 6 Packages 2023-12-06T14:50:37.414 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:50:37.415 INFO:teuthology.orchestra.run.smithi190.stdout:Total download size: 2.0 M 2023-12-06T14:50:37.415 INFO:teuthology.orchestra.run.smithi190.stdout:Installed size: 8.0 M 2023-12-06T14:50:37.415 INFO:teuthology.orchestra.run.smithi190.stdout:Downloading Packages: 2023-12-06T14:50:37.421 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-113.gece0d607.e 1/1 2023-12-06T14:50:37.630 INFO:teuthology.orchestra.run.smithi190.stdout:(1/6): ceph-prometheus-alerts-17.2.7-113.gece0d 100 kB/s | 14 kB 00:00 2023-12-06T14:50:37.731 INFO:teuthology.orchestra.run.smithi190.stdout:(2/6): ceph-grafana-dashboards-17.2.7-113.gece0 94 kB/s | 23 kB 00:00 2023-12-06T14:50:37.854 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-113.gece0d607.e 1/1 2023-12-06T14:50:37.873 INFO:teuthology.orchestra.run.smithi190.stdout:(3/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 237 kB/s | 34 kB 00:00 2023-12-06T14:50:37.956 INFO:teuthology.orchestra.run.smithi190.stdout:(4/6): ceph-mgr-dashboard-17.2.7-113.gece0d607. 3.6 MB/s | 1.7 MB 00:00 2023-12-06T14:50:37.982 INFO:teuthology.orchestra.run.smithi190.stdout:(5/6): python3-jwt-1.6.1-2.el8.noarch.rpm 121 kB/s | 43 kB 00:00 2023-12-06T14:50:38.040 INFO:teuthology.orchestra.run.smithi190.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.1 MB/s | 196 kB 00:00 2023-12-06T14:50:38.041 INFO:teuthology.orchestra.run.smithi190.stdout:-------------------------------------------------------------------------------- 2023-12-06T14:50:38.042 INFO:teuthology.orchestra.run.smithi190.stdout:Total 3.2 MB/s | 2.0 MB 00:00 2023-12-06T14:50:38.051 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction check 2023-12-06T14:50:38.060 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction check succeeded. 2023-12-06T14:50:38.060 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction test 2023-12-06T14:50:38.135 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction test succeeded. 2023-12-06T14:50:38.138 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction 2023-12-06T14:50:38.387 INFO:teuthology.orchestra.run.smithi190.stdout: Preparing : 1/1 2023-12-06T14:50:38.595 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-113.gece0d607.e 1/1 2023-12-06T14:50:38.595 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:50:38.595 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-12-06T14:50:38.595 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:50:38.596 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:50:38.596 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-06T14:50:38.629 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-12-06T14:50:38.834 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-mgr 2023-12-06T14:50:38.880 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-12-06T14:50:39.082 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-12-06T14:50:39.227 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-113.gece0d607.el8.no 4/6 2023-12-06T14:50:39.573 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-113.gece0d607.el8.n 5/6 2023-12-06T14:50:39.693 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:44 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:50:39.804 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-113.gece0d607.el8.noarch 6/6 2023-12-06T14:50:40.100 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-113.gece0d607.el8.noarch 6/6 2023-12-06T14:50:40.100 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-113.gece0d607.el8.n 1/6 2023-12-06T14:50:40.100 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-113.gece0d607.el8.noarch 2/6 2023-12-06T14:50:40.101 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-113.gece0d607.el8.no 3/6 2023-12-06T14:50:40.101 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-12-06T14:50:40.101 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-12-06T14:50:40.785 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-12-06T14:50:40.785 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:50:40.785 INFO:teuthology.orchestra.run.smithi190.stdout:Installed: 2023-12-06T14:50:40.785 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-grafana-dashboards-2:17.2.7-113.gece0d607.el8.noarch 2023-12-06T14:50:40.785 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-dashboard-2:17.2.7-113.gece0d607.el8.noarch 2023-12-06T14:50:40.785 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-prometheus-alerts-2:17.2.7-113.gece0d607.el8.noarch 2023-12-06T14:50:40.785 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-06T14:50:40.785 INFO:teuthology.orchestra.run.smithi190.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-06T14:50:40.785 INFO:teuthology.orchestra.run.smithi190.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-06T14:50:40.785 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:50:40.785 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2023-12-06T14:50:40.906 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-06T14:50:41.138 INFO:teuthology.orchestra.run.smithi152.stdout:Package ceph-mgr-2:17.2.7-113.gece0d607.el8.x86_64 is already installed. 2023-12-06T14:50:41.361 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-06T14:50:41.362 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2023-12-06T14:50:41.362 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-06T14:50:41.468 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-mgr-dashboard 2023-12-06T14:50:41.764 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:01:46 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:50:42.334 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:47 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:50:43.452 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2023-12-06T14:50:43.453 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================================ 2023-12-06T14:50:43.453 INFO:teuthology.orchestra.run.smithi190.stdout: Package Arch Version Repository Size 2023-12-06T14:50:43.453 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================================ 2023-12-06T14:50:43.454 INFO:teuthology.orchestra.run.smithi190.stdout:Installing: 2023-12-06T14:50:43.454 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-113.gece0d607.el8 ceph-noarch 7.4 M 2023-12-06T14:50:43.454 INFO:teuthology.orchestra.run.smithi190.stdout:Installing dependencies: 2023-12-06T14:50:43.454 INFO:teuthology.orchestra.run.smithi190.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2023-12-06T14:50:43.454 INFO:teuthology.orchestra.run.smithi190.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2023-12-06T14:50:43.454 INFO:teuthology.orchestra.run.smithi190.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-12-06T14:50:43.454 INFO:teuthology.orchestra.run.smithi190.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-12-06T14:50:43.455 INFO:teuthology.orchestra.run.smithi190.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-12-06T14:50:43.455 INFO:teuthology.orchestra.run.smithi190.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-12-06T14:50:43.455 INFO:teuthology.orchestra.run.smithi190.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-12-06T14:50:43.455 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:50:43.455 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction Summary 2023-12-06T14:50:43.455 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================================ 2023-12-06T14:50:43.455 INFO:teuthology.orchestra.run.smithi190.stdout:Install 8 Packages 2023-12-06T14:50:43.456 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:50:43.457 INFO:teuthology.orchestra.run.smithi190.stdout:Total download size: 35 M 2023-12-06T14:50:43.457 INFO:teuthology.orchestra.run.smithi190.stdout:Installed size: 210 M 2023-12-06T14:50:43.457 INFO:teuthology.orchestra.run.smithi190.stdout:Downloading Packages: 2023-12-06T14:50:44.014 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-06T14:50:44.015 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:50:44.015 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2023-12-06T14:50:44.015 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:50:44.015 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2023-12-06T14:50:44.015 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard noarch 2:17.2.7-113.gece0d607.el8 ceph-noarch 1.7 M 2023-12-06T14:50:44.016 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2023-12-06T14:50:44.016 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards noarch 2:17.2.7-113.gece0d607.el8 ceph-noarch 23 k 2023-12-06T14:50:44.016 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts noarch 2:17.2.7-113.gece0d607.el8 ceph-noarch 14 k 2023-12-06T14:50:44.016 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-12-06T14:50:44.016 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-06T14:50:44.016 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-06T14:50:44.016 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:50:44.016 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-12-06T14:50:44.016 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:50:44.016 INFO:teuthology.orchestra.run.smithi152.stdout:Install 6 Packages 2023-12-06T14:50:44.016 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:50:44.017 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 2.0 M 2023-12-06T14:50:44.017 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 8.0 M 2023-12-06T14:50:44.017 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-12-06T14:50:44.181 INFO:teuthology.orchestra.run.smithi190.stdout:(1/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 9.9 MB/s | 4.9 MB 00:00 2023-12-06T14:50:44.240 INFO:teuthology.orchestra.run.smithi190.stdout:(2/8): openblas-0.3.15-4.el8.x86_64.rpm 8.6 MB/s | 4.7 MB 00:00 2023-12-06T14:50:44.332 INFO:teuthology.orchestra.run.smithi190.stdout:(3/8): ceph-mgr-diskprediction-local-17.2.7-113 12 MB/s | 7.4 MB 00:00 2023-12-06T14:50:44.382 INFO:teuthology.orchestra.run.smithi190.stdout:(4/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 1.5 MB/s | 225 kB 00:00 2023-12-06T14:50:44.449 INFO:teuthology.orchestra.run.smithi190.stdout:(5/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 14 MB/s | 3.7 MB 00:00 2023-12-06T14:50:44.516 INFO:teuthology.orchestra.run.smithi152.stdout:(1/6): ceph-prometheus-alerts-17.2.7-113.gece0d 101 kB/s | 14 kB 00:00 2023-12-06T14:50:44.583 INFO:teuthology.orchestra.run.smithi152.stdout:(2/6): ceph-grafana-dashboards-17.2.7-113.gece0 109 kB/s | 23 kB 00:00 2023-12-06T14:50:44.775 INFO:teuthology.orchestra.run.smithi152.stdout:(3/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 175 kB/s | 34 kB 00:00 2023-12-06T14:50:44.842 INFO:teuthology.orchestra.run.smithi152.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 131 kB/s | 43 kB 00:00 2023-12-06T14:50:44.849 INFO:teuthology.orchestra.run.smithi190.stdout:(6/8): libquadmath-8.5.0-21.el8.x86_64.rpm 431 kB/s | 172 kB 00:00 2023-12-06T14:50:44.917 INFO:teuthology.orchestra.run.smithi152.stdout:(5/6): ceph-mgr-dashboard-17.2.7-113.gece0d607. 3.1 MB/s | 1.7 MB 00:00 2023-12-06T14:50:44.942 INFO:teuthology.orchestra.run.smithi152.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.1 MB/s | 196 kB 00:00 2023-12-06T14:50:44.944 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-12-06T14:50:44.944 INFO:teuthology.orchestra.run.smithi152.stdout:Total 2.2 MB/s | 2.0 MB 00:00 2023-12-06T14:50:44.955 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-12-06T14:50:44.964 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-12-06T14:50:44.964 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-12-06T14:50:45.057 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-12-06T14:50:45.060 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-12-06T14:50:45.116 INFO:teuthology.orchestra.run.smithi190.stdout:(7/8): python3-scipy-1.0.0-21.module_el8.5.0+77 17 MB/s | 14 MB 00:00 2023-12-06T14:50:45.142 INFO:teuthology.orchestra.run.smithi190.stdout:(8/8): libgfortran-8.5.0-21.el8.x86_64.rpm 850 kB/s | 645 kB 00:00 2023-12-06T14:50:45.142 INFO:teuthology.orchestra.run.smithi190.stdout:-------------------------------------------------------------------------------- 2023-12-06T14:50:45.142 INFO:teuthology.orchestra.run.smithi190.stdout:Total 21 MB/s | 35 MB 00:01 2023-12-06T14:50:45.317 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-12-06T14:50:45.372 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction check 2023-12-06T14:50:45.390 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction check succeeded. 2023-12-06T14:50:45.391 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction test 2023-12-06T14:50:45.509 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-12-06T14:50:45.762 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-12-06T14:50:45.769 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction test succeeded. 2023-12-06T14:50:45.772 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction 2023-12-06T14:50:45.963 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-12-06T14:50:46.067 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-113.gece0d607.el8.no 4/6 2023-12-06T14:50:46.326 INFO:teuthology.orchestra.run.smithi190.stdout: Preparing : 1/1 2023-12-06T14:50:46.448 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-113.gece0d607.el8.n 5/6 2023-12-06T14:50:46.480 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-06T14:50:46.668 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-113.gece0d607.el8.noarch 6/6 2023-12-06T14:50:46.742 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-06T14:50:46.985 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-113.gece0d607.el8.noarch 6/6 2023-12-06T14:50:46.985 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-113.gece0d607.el8.n 1/6 2023-12-06T14:50:46.985 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-113.gece0d607.el8.noarch 2/6 2023-12-06T14:50:46.985 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-113.gece0d607.el8.no 3/6 2023-12-06T14:50:46.985 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-12-06T14:50:46.985 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-12-06T14:50:47.701 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-12-06T14:50:47.701 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:50:47.701 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-12-06T14:50:47.701 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards-2:17.2.7-113.gece0d607.el8.noarch 2023-12-06T14:50:47.701 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard-2:17.2.7-113.gece0d607.el8.noarch 2023-12-06T14:50:47.701 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts-2:17.2.7-113.gece0d607.el8.noarch 2023-12-06T14:50:47.701 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-06T14:50:47.701 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-06T14:50:47.701 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-06T14:50:47.701 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:50:47.702 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-06T14:50:47.770 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-06T14:50:47.822 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-06T14:50:48.378 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-06T14:50:48.555 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-12-06T14:50:48.675 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:53 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:50:49.176 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-12-06T14:50:49.353 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-06T14:50:50.034 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-06T14:50:50.362 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-06T14:50:50.364 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================================ 2023-12-06T14:50:50.364 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2023-12-06T14:50:50.364 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================================ 2023-12-06T14:50:50.364 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2023-12-06T14:50:50.364 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-113.gece0d607.el8 ceph-noarch 7.4 M 2023-12-06T14:50:50.364 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2023-12-06T14:50:50.364 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2023-12-06T14:50:50.364 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2023-12-06T14:50:50.364 INFO:teuthology.orchestra.run.smithi152.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-12-06T14:50:50.364 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-12-06T14:50:50.364 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-12-06T14:50:50.365 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-12-06T14:50:50.365 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-12-06T14:50:50.365 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:50:50.365 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-12-06T14:50:50.365 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================================ 2023-12-06T14:50:50.365 INFO:teuthology.orchestra.run.smithi152.stdout:Install 8 Packages 2023-12-06T14:50:50.365 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:50:50.365 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 35 M 2023-12-06T14:50:50.366 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 210 M 2023-12-06T14:50:50.366 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-12-06T14:50:50.371 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-12-06T14:50:50.638 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-06T14:50:50.941 INFO:teuthology.orchestra.run.smithi152.stdout:(1/8): openblas-0.3.15-4.el8.x86_64.rpm 9.7 MB/s | 4.7 MB 00:00 2023-12-06T14:50:51.025 INFO:teuthology.orchestra.run.smithi152.stdout:(2/8): ceph-mgr-diskprediction-local-17.2.7-113 13 MB/s | 7.4 MB 00:00 2023-12-06T14:50:51.100 INFO:teuthology.orchestra.run.smithi152.stdout:(3/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 7.5 MB/s | 4.9 MB 00:00 2023-12-06T14:50:51.192 INFO:teuthology.orchestra.run.smithi152.stdout:(4/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 15 MB/s | 3.7 MB 00:00 2023-12-06T14:50:51.346 INFO:teuthology.orchestra.run.smithi152.stdout:(5/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 702 kB/s | 225 kB 00:00 2023-12-06T14:50:51.743 INFO:teuthology.orchestra.run.smithi152.stdout:(6/8): python3-scipy-1.0.0-21.module_el8.5.0+77 21 MB/s | 14 MB 00:00 2023-12-06T14:50:51.776 INFO:teuthology.orchestra.run.smithi152.stdout:(7/8): libgfortran-8.5.0-21.el8.x86_64.rpm 1.1 MB/s | 645 kB 00:00 2023-12-06T14:50:51.802 INFO:teuthology.orchestra.run.smithi152.stdout:(8/8): libquadmath-8.5.0-21.el8.x86_64.rpm 379 kB/s | 172 kB 00:00 2023-12-06T14:50:51.802 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-12-06T14:50:51.802 INFO:teuthology.orchestra.run.smithi152.stdout:Total 25 MB/s | 35 MB 00:01 2023-12-06T14:50:52.035 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-12-06T14:50:52.053 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-12-06T14:50:52.053 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-12-06T14:50:52.411 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-06T14:50:52.421 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-12-06T14:50:52.424 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-12-06T14:50:53.002 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-12-06T14:50:53.243 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-06T14:50:53.671 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2023-12-06T14:50:53.902 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-06T14:50:53.910 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-113.gece0d607 8/8 2023-12-06T14:50:54.212 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-113.gece0d607 8/8 2023-12-06T14:50:54.212 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-113.gece0d607 1/8 2023-12-06T14:50:54.212 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-12-06T14:50:54.212 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-12-06T14:50:54.213 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-12-06T14:50:54.213 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-12-06T14:50:54.213 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2023-12-06T14:50:54.213 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2023-12-06T14:50:54.421 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-06T14:50:54.939 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2023-12-06T14:50:54.939 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:50:54.940 INFO:teuthology.orchestra.run.smithi190.stdout:Installed: 2023-12-06T14:50:54.940 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-diskprediction-local-2:17.2.7-113.gece0d607.el8.noarch 2023-12-06T14:50:54.940 INFO:teuthology.orchestra.run.smithi190.stdout: libgfortran-8.5.0-21.el8.x86_64 2023-12-06T14:50:54.940 INFO:teuthology.orchestra.run.smithi190.stdout: libquadmath-8.5.0-21.el8.x86_64 2023-12-06T14:50:54.940 INFO:teuthology.orchestra.run.smithi190.stdout: openblas-0.3.15-4.el8.x86_64 2023-12-06T14:50:54.940 INFO:teuthology.orchestra.run.smithi190.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-12-06T14:50:54.940 INFO:teuthology.orchestra.run.smithi190.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-06T14:50:54.940 INFO:teuthology.orchestra.run.smithi190.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-06T14:50:54.941 INFO:teuthology.orchestra.run.smithi190.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-12-06T14:50:54.941 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:50:54.941 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2023-12-06T14:50:55.004 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-06T14:50:55.075 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum -y install ceph-mgr-rook 2023-12-06T14:50:55.151 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-12-06T14:50:55.773 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-12-06T14:50:55.918 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-06T14:50:55.921 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:02:00 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:50:56.604 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-06T14:50:56.920 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-12-06T14:50:57.125 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-06T14:50:57.594 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2023-12-06T14:50:57.596 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:50:57.596 INFO:teuthology.orchestra.run.smithi190.stdout: Package Arch Version Repository Size 2023-12-06T14:50:57.596 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:50:57.596 INFO:teuthology.orchestra.run.smithi190.stdout:Installing: 2023-12-06T14:50:57.596 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-rook noarch 2:17.2.7-113.gece0d607.el8 ceph-noarch 47 k 2023-12-06T14:50:57.596 INFO:teuthology.orchestra.run.smithi190.stdout:Installing dependencies: 2023-12-06T14:50:57.596 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-06T14:50:57.596 INFO:teuthology.orchestra.run.smithi190.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-06T14:50:57.596 INFO:teuthology.orchestra.run.smithi190.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-06T14:50:57.596 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-12-06T14:50:57.596 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-12-06T14:50:57.596 INFO:teuthology.orchestra.run.smithi190.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-06T14:50:57.597 INFO:teuthology.orchestra.run.smithi190.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-12-06T14:50:57.597 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-12-06T14:50:57.597 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-12-06T14:50:57.597 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-12-06T14:50:57.597 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-06T14:50:57.597 INFO:teuthology.orchestra.run.smithi190.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-06T14:50:57.597 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:50:57.597 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction Summary 2023-12-06T14:50:57.597 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:50:57.597 INFO:teuthology.orchestra.run.smithi190.stdout:Install 13 Packages 2023-12-06T14:50:57.597 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:50:57.598 INFO:teuthology.orchestra.run.smithi190.stdout:Total download size: 1.9 M 2023-12-06T14:50:57.598 INFO:teuthology.orchestra.run.smithi190.stdout:Installed size: 25 M 2023-12-06T14:50:57.598 INFO:teuthology.orchestra.run.smithi190.stdout:Downloading Packages: 2023-12-06T14:50:58.350 INFO:teuthology.orchestra.run.smithi190.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 152 kB/s | 27 kB 00:00 2023-12-06T14:50:58.375 INFO:teuthology.orchestra.run.smithi190.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 100 kB/s | 20 kB 00:00 2023-12-06T14:50:58.425 INFO:teuthology.orchestra.run.smithi190.stdout:(3/13): ceph-mgr-rook-17.2.7-113.gece0d607.el8. 189 kB/s | 47 kB 00:00 2023-12-06T14:50:58.525 INFO:teuthology.orchestra.run.smithi190.stdout:(4/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 720 kB/s | 126 kB 00:00 2023-12-06T14:50:58.551 INFO:teuthology.orchestra.run.smithi190.stdout:(5/13): python3-pyasn1-modules-0.3.7-6.el8.noar 626 kB/s | 110 kB 00:00 2023-12-06T14:50:58.793 INFO:teuthology.orchestra.run.smithi190.stdout:(6/13): python3-cachetools-3.1.1-4.el8.noarch.r 136 kB/s | 33 kB 00:00 2023-12-06T14:50:58.851 INFO:teuthology.orchestra.run.smithi190.stdout:(7/13): python3-requests-oauthlib-1.0.0-1.el8.n 131 kB/s | 43 kB 00:00 2023-12-06T14:50:58.877 INFO:teuthology.orchestra.run.smithi190.stdout:(8/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 343 kB/s | 155 kB 00:00 2023-12-06T14:50:58.884 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-06T14:50:58.893 INFO:teuthology.orchestra.run.smithi190.stdout:(9/13): python3-certifi-2018.10.15-7.el8.noarch 162 kB/s | 16 kB 00:00 2023-12-06T14:50:59.136 INFO:teuthology.orchestra.run.smithi190.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 286 kB/s | 81 kB 00:00 2023-12-06T14:50:59.161 INFO:teuthology.orchestra.run.smithi190.stdout:(11/13): python3-rsa-4.9-2.el8.noarch.rpm 240 kB/s | 64 kB 00:00 2023-12-06T14:50:59.194 INFO:teuthology.orchestra.run.smithi190.stdout:(12/13): python3-kubernetes-11.0.0-6.el8.noarch 3.7 MB/s | 1.2 MB 00:00 2023-12-06T14:50:59.228 INFO:teuthology.orchestra.run.smithi190.stdout:(13/13): python3-websocket-client-0.56.0-5.el8. 665 kB/s | 61 kB 00:00 2023-12-06T14:50:59.231 INFO:teuthology.orchestra.run.smithi190.stdout:-------------------------------------------------------------------------------- 2023-12-06T14:50:59.231 INFO:teuthology.orchestra.run.smithi190.stdout:Total 1.2 MB/s | 1.9 MB 00:01 2023-12-06T14:50:59.291 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction check 2023-12-06T14:50:59.307 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction check succeeded. 2023-12-06T14:50:59.307 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction test 2023-12-06T14:50:59.394 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction test succeeded. 2023-12-06T14:50:59.397 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction 2023-12-06T14:50:59.963 INFO:teuthology.orchestra.run.smithi190.stdout: Preparing : 1/1 2023-12-06T14:51:00.067 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2023-12-06T14:51:00.222 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-12-06T14:51:00.283 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-113.gece0d607 8/8 2023-12-06T14:51:00.409 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-12-06T14:51:00.602 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-113.gece0d607 8/8 2023-12-06T14:51:00.602 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-113.gece0d607 1/8 2023-12-06T14:51:00.602 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-12-06T14:51:00.602 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-12-06T14:51:00.603 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-12-06T14:51:00.603 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-12-06T14:51:00.603 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2023-12-06T14:51:00.603 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2023-12-06T14:51:00.644 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2023-12-06T14:51:00.907 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-12-06T14:51:01.098 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-12-06T14:51:01.337 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2023-12-06T14:51:01.337 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:51:01.337 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-12-06T14:51:01.337 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local-2:17.2.7-113.gece0d607.el8.noarch 2023-12-06T14:51:01.337 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran-8.5.0-21.el8.x86_64 2023-12-06T14:51:01.337 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath-8.5.0-21.el8.x86_64 2023-12-06T14:51:01.338 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-0.3.15-4.el8.x86_64 2023-12-06T14:51:01.338 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-12-06T14:51:01.338 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-06T14:51:01.338 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-06T14:51:01.338 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-12-06T14:51:01.338 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:51:01.338 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-06T14:51:01.359 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-12-06T14:51:01.473 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-mgr-rook 2023-12-06T14:51:01.641 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-12-06T14:51:01.930 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-12-06T14:51:02.330 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:07 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:51:02.951 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-12-06T14:51:03.226 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-12-06T14:51:03.460 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-12-06T14:51:03.651 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-12-06T14:51:03.809 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-rook-2:17.2.7-113.gece0d607.el8.noarch 13/13 2023-12-06T14:51:04.005 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-06T14:51:04.007 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:51:04.007 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2023-12-06T14:51:04.007 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:51:04.007 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2023-12-06T14:51:04.007 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook noarch 2:17.2.7-113.gece0d607.el8 ceph-noarch 47 k 2023-12-06T14:51:04.007 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2023-12-06T14:51:04.007 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-06T14:51:04.008 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-06T14:51:04.008 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-06T14:51:04.008 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-12-06T14:51:04.008 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-12-06T14:51:04.008 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-06T14:51:04.008 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-12-06T14:51:04.008 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-12-06T14:51:04.008 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-12-06T14:51:04.008 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-12-06T14:51:04.008 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-06T14:51:04.008 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-06T14:51:04.008 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:51:04.008 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-12-06T14:51:04.008 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:51:04.009 INFO:teuthology.orchestra.run.smithi152.stdout:Install 13 Packages 2023-12-06T14:51:04.009 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:51:04.009 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 1.9 M 2023-12-06T14:51:04.009 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 25 M 2023-12-06T14:51:04.009 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-12-06T14:51:04.108 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-113.gece0d607.el8.noarch 13/13 2023-12-06T14:51:04.108 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-rook-2:17.2.7-113.gece0d607.el8.noarch 1/13 2023-12-06T14:51:04.108 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-12-06T14:51:04.108 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-12-06T14:51:04.108 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-12-06T14:51:04.108 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-12-06T14:51:04.108 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-12-06T14:51:04.108 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-12-06T14:51:04.108 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-12-06T14:51:04.108 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-12-06T14:51:04.108 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-12-06T14:51:04.108 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-12-06T14:51:04.109 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2023-12-06T14:51:04.749 INFO:teuthology.orchestra.run.smithi152.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 165 kB/s | 27 kB 00:00 2023-12-06T14:51:04.766 INFO:teuthology.orchestra.run.smithi152.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 112 kB/s | 20 kB 00:00 2023-12-06T14:51:04.791 INFO:teuthology.orchestra.run.smithi152.stdout:(3/13): ceph-mgr-rook-17.2.7-113.gece0d607.el8. 233 kB/s | 47 kB 00:00 2023-12-06T14:51:04.856 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-12-06T14:51:04.856 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:51:04.856 INFO:teuthology.orchestra.run.smithi190.stdout:Installed: 2023-12-06T14:51:04.856 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-rook-2:17.2.7-113.gece0d607.el8.noarch 2023-12-06T14:51:04.856 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-06T14:51:04.856 INFO:teuthology.orchestra.run.smithi190.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-06T14:51:04.857 INFO:teuthology.orchestra.run.smithi190.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-06T14:51:04.857 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-06T14:51:04.857 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-06T14:51:04.857 INFO:teuthology.orchestra.run.smithi190.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-06T14:51:04.857 INFO:teuthology.orchestra.run.smithi190.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-06T14:51:04.857 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-06T14:51:04.857 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-06T14:51:04.857 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-06T14:51:04.857 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-06T14:51:04.857 INFO:teuthology.orchestra.run.smithi190.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-06T14:51:04.857 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:51:04.857 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2023-12-06T14:51:04.899 INFO:teuthology.orchestra.run.smithi152.stdout:(4/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 948 kB/s | 126 kB 00:00 2023-12-06T14:51:04.925 INFO:teuthology.orchestra.run.smithi152.stdout:(5/13): python3-pyasn1-modules-0.3.7-6.el8.noar 694 kB/s | 110 kB 00:00 2023-12-06T14:51:04.978 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum -y install ceph-mgr-cephadm 2023-12-06T14:51:05.008 INFO:teuthology.orchestra.run.smithi152.stdout:(6/13): python3-cachetools-3.1.1-4.el8.noarch.r 396 kB/s | 33 kB 00:00 2023-12-06T14:51:05.058 INFO:teuthology.orchestra.run.smithi152.stdout:(7/13): python3-certifi-2018.10.15-7.el8.noarch 327 kB/s | 16 kB 00:00 2023-12-06T14:51:05.134 INFO:teuthology.orchestra.run.smithi152.stdout:(8/13): python3-google-auth-1.1.1-10.el8.noarch 1.1 MB/s | 81 kB 00:00 2023-12-06T14:51:05.184 INFO:teuthology.orchestra.run.smithi152.stdout:(9/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 394 kB/s | 155 kB 00:00 2023-12-06T14:51:05.243 INFO:teuthology.orchestra.run.smithi152.stdout:(10/13): python3-requests-oauthlib-1.0.0-1.el8. 124 kB/s | 43 kB 00:00 2023-12-06T14:51:05.310 INFO:teuthology.orchestra.run.smithi152.stdout:(11/13): python3-kubernetes-11.0.0-6.el8.noarch 6.6 MB/s | 1.2 MB 00:00 2023-12-06T14:51:05.327 INFO:teuthology.orchestra.run.smithi152.stdout:(12/13): python3-rsa-4.9-2.el8.noarch.rpm 452 kB/s | 64 kB 00:00 2023-12-06T14:51:05.354 INFO:teuthology.orchestra.run.smithi152.stdout:(13/13): python3-websocket-client-0.56.0-5.el8. 563 kB/s | 61 kB 00:00 2023-12-06T14:51:05.354 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-12-06T14:51:05.354 INFO:teuthology.orchestra.run.smithi152.stdout:Total 1.4 MB/s | 1.9 MB 00:01 2023-12-06T14:51:05.414 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-12-06T14:51:05.430 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-12-06T14:51:05.430 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-12-06T14:51:05.517 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-12-06T14:51:05.520 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-12-06T14:51:05.835 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:02:10 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:51:06.086 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-12-06T14:51:06.310 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-12-06T14:51:06.524 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-12-06T14:51:06.751 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2023-12-06T14:51:06.964 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-12-06T14:51:07.155 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-12-06T14:51:07.369 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-12-06T14:51:07.527 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2023-12-06T14:51:07.528 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:51:07.529 INFO:teuthology.orchestra.run.smithi190.stdout: Package Arch Version Repository Size 2023-12-06T14:51:07.529 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:51:07.529 INFO:teuthology.orchestra.run.smithi190.stdout:Installing: 2023-12-06T14:51:07.529 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-cephadm noarch 2:17.2.7-113.gece0d607.el8 ceph-noarch 121 k 2023-12-06T14:51:07.529 INFO:teuthology.orchestra.run.smithi190.stdout:Installing dependencies: 2023-12-06T14:51:07.529 INFO:teuthology.orchestra.run.smithi190.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-06T14:51:07.529 INFO:teuthology.orchestra.run.smithi190.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-12-06T14:51:07.529 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-12-06T14:51:07.529 INFO:teuthology.orchestra.run.smithi190.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-06T14:51:07.529 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:51:07.529 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction Summary 2023-12-06T14:51:07.530 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:51:07.530 INFO:teuthology.orchestra.run.smithi190.stdout:Install 5 Packages 2023-12-06T14:51:07.530 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:51:07.531 INFO:teuthology.orchestra.run.smithi190.stdout:Total download size: 6.0 M 2023-12-06T14:51:07.531 INFO:teuthology.orchestra.run.smithi190.stdout:Installed size: 26 M 2023-12-06T14:51:07.531 INFO:teuthology.orchestra.run.smithi190.stdout:Downloading Packages: 2023-12-06T14:51:07.669 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-12-06T14:51:07.911 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-12-06T14:51:07.986 INFO:teuthology.orchestra.run.smithi190.stdout:(1/5): ceph-mgr-cephadm-17.2.7-113.gece0d607.el 630 kB/s | 121 kB 00:00 2023-12-06T14:51:08.095 INFO:teuthology.orchestra.run.smithi190.stdout:(2/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 1.7 MB/s | 538 kB 00:00 2023-12-06T14:51:08.412 INFO:teuthology.orchestra.run.smithi190.stdout:(3/5): python3-babel-2.5.1-7.el8.noarch.rpm 7.7 MB/s | 4.8 MB 00:00 2023-12-06T14:51:08.679 INFO:teuthology.orchestra.run.smithi190.stdout:(4/5): python3-natsort-7.1.1-2.el8.noarch.rpm 103 kB/s | 60 kB 00:00 2023-12-06T14:51:08.762 INFO:teuthology.orchestra.run.smithi190.stdout:(5/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 613 kB/s | 476 kB 00:00 2023-12-06T14:51:08.765 INFO:teuthology.orchestra.run.smithi190.stdout:-------------------------------------------------------------------------------- 2023-12-06T14:51:08.766 INFO:teuthology.orchestra.run.smithi190.stdout:Total 4.8 MB/s | 6.0 MB 00:01 2023-12-06T14:51:08.820 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction check 2023-12-06T14:51:08.832 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction check succeeded. 2023-12-06T14:51:08.832 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction test 2023-12-06T14:51:08.935 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction test succeeded. 2023-12-06T14:51:08.938 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction 2023-12-06T14:51:08.981 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-12-06T14:51:09.190 INFO:teuthology.orchestra.run.smithi190.stdout: Preparing : 1/1 2023-12-06T14:51:09.239 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-12-06T14:51:09.465 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-12-06T14:51:09.529 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2023-12-06T14:51:09.675 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-12-06T14:51:09.874 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-rook-2:17.2.7-113.gece0d607.el8.noarch 13/13 2023-12-06T14:51:10.177 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-113.gece0d607.el8.noarch 13/13 2023-12-06T14:51:10.177 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-rook-2:17.2.7-113.gece0d607.el8.noarch 1/13 2023-12-06T14:51:10.177 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-12-06T14:51:10.178 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-12-06T14:51:10.178 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-12-06T14:51:10.178 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-12-06T14:51:10.178 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-12-06T14:51:10.178 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-12-06T14:51:10.178 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-12-06T14:51:10.178 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-12-06T14:51:10.178 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-12-06T14:51:10.178 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-12-06T14:51:10.178 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2023-12-06T14:51:10.497 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-12-06T14:51:10.900 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2023-12-06T14:51:10.913 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-12-06T14:51:10.913 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:51:10.913 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-12-06T14:51:10.913 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook-2:17.2.7-113.gece0d607.el8.noarch 2023-12-06T14:51:10.913 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-06T14:51:10.913 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-06T14:51:10.913 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-06T14:51:10.913 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-06T14:51:10.913 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-06T14:51:10.914 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-06T14:51:10.914 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-06T14:51:10.914 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-06T14:51:10.914 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-06T14:51:10.914 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-06T14:51:10.914 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-06T14:51:10.914 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-06T14:51:10.914 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:51:10.914 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-06T14:51:11.064 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-mgr-cephadm 2023-12-06T14:51:11.178 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-12-06T14:51:11.391 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-113.gece0d607.el8.noarch 5/5 2023-12-06T14:51:11.672 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-113.gece0d607.el8.noarch 5/5 2023-12-06T14:51:11.672 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-113.gece0d607.el8.noarch 1/5 2023-12-06T14:51:11.673 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2023-12-06T14:51:11.673 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/5 2023-12-06T14:51:11.673 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-12-06T14:51:11.926 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:16 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:51:12.359 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2023-12-06T14:51:12.359 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:51:12.359 INFO:teuthology.orchestra.run.smithi190.stdout:Installed: 2023-12-06T14:51:12.359 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-cephadm-2:17.2.7-113.gece0d607.el8.noarch 2023-12-06T14:51:12.360 INFO:teuthology.orchestra.run.smithi190.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-06T14:51:12.360 INFO:teuthology.orchestra.run.smithi190.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-06T14:51:12.360 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-06T14:51:12.360 INFO:teuthology.orchestra.run.smithi190.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-06T14:51:12.360 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:51:12.360 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2023-12-06T14:51:12.483 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum -y install ceph-fuse 2023-12-06T14:51:13.341 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:02:18 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:51:13.615 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-06T14:51:13.616 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:51:13.616 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2023-12-06T14:51:13.616 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:51:13.616 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2023-12-06T14:51:13.617 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm noarch 2:17.2.7-113.gece0d607.el8 ceph-noarch 121 k 2023-12-06T14:51:13.617 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2023-12-06T14:51:13.617 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-06T14:51:13.617 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-12-06T14:51:13.617 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-12-06T14:51:13.617 INFO:teuthology.orchestra.run.smithi152.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-06T14:51:13.617 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:51:13.617 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-12-06T14:51:13.617 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:51:13.617 INFO:teuthology.orchestra.run.smithi152.stdout:Install 5 Packages 2023-12-06T14:51:13.617 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:51:13.618 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 6.0 M 2023-12-06T14:51:13.618 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 26 M 2023-12-06T14:51:13.618 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-12-06T14:51:14.100 INFO:teuthology.orchestra.run.smithi152.stdout:(1/5): ceph-mgr-cephadm-17.2.7-113.gece0d607.el 399 kB/s | 121 kB 00:00 2023-12-06T14:51:14.126 INFO:teuthology.orchestra.run.smithi152.stdout:(2/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 1.6 MB/s | 538 kB 00:00 2023-12-06T14:51:14.459 INFO:teuthology.orchestra.run.smithi152.stdout:(3/5): python3-babel-2.5.1-7.el8.noarch.rpm 7.2 MB/s | 4.8 MB 00:00 2023-12-06T14:51:14.568 INFO:teuthology.orchestra.run.smithi152.stdout:(4/5): python3-natsort-7.1.1-2.el8.noarch.rpm 136 kB/s | 60 kB 00:00 2023-12-06T14:51:14.793 INFO:teuthology.orchestra.run.smithi152.stdout:(5/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 687 kB/s | 476 kB 00:00 2023-12-06T14:51:14.794 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-12-06T14:51:14.794 INFO:teuthology.orchestra.run.smithi152.stdout:Total 5.1 MB/s | 6.0 MB 00:01 2023-12-06T14:51:14.848 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-12-06T14:51:14.859 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-12-06T14:51:14.859 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-12-06T14:51:14.964 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-12-06T14:51:14.967 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-12-06T14:51:15.030 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2023-12-06T14:51:15.031 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:51:15.031 INFO:teuthology.orchestra.run.smithi190.stdout: Package Arch Version Repository Size 2023-12-06T14:51:15.031 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:51:15.031 INFO:teuthology.orchestra.run.smithi190.stdout:Installing: 2023-12-06T14:51:15.031 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-fuse x86_64 2:17.2.7-113.gece0d607.el8 ceph 875 k 2023-12-06T14:51:15.031 INFO:teuthology.orchestra.run.smithi190.stdout:Installing dependencies: 2023-12-06T14:51:15.031 INFO:teuthology.orchestra.run.smithi190.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-12-06T14:51:15.031 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:51:15.032 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction Summary 2023-12-06T14:51:15.032 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:51:15.032 INFO:teuthology.orchestra.run.smithi190.stdout:Install 2 Packages 2023-12-06T14:51:15.032 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:51:15.032 INFO:teuthology.orchestra.run.smithi190.stdout:Total download size: 958 k 2023-12-06T14:51:15.032 INFO:teuthology.orchestra.run.smithi190.stdout:Installed size: 3.0 M 2023-12-06T14:51:15.032 INFO:teuthology.orchestra.run.smithi190.stdout:Downloading Packages: 2023-12-06T14:51:15.254 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-12-06T14:51:15.396 INFO:teuthology.orchestra.run.smithi190.stdout:(1/2): fuse-2.9.7-17.el8.x86_64.rpm 257 kB/s | 83 kB 00:00 2023-12-06T14:51:15.471 INFO:teuthology.orchestra.run.smithi190.stdout:(2/2): ceph-fuse-17.2.7-113.gece0d607.el8.x86_6 2.1 MB/s | 875 kB 00:00 2023-12-06T14:51:15.472 INFO:teuthology.orchestra.run.smithi190.stdout:-------------------------------------------------------------------------------- 2023-12-06T14:51:15.472 INFO:teuthology.orchestra.run.smithi190.stdout:Total 2.1 MB/s | 958 kB 00:00 2023-12-06T14:51:15.482 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction check 2023-12-06T14:51:15.502 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction check succeeded. 2023-12-06T14:51:15.502 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction test 2023-12-06T14:51:15.562 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2023-12-06T14:51:15.587 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction test succeeded. 2023-12-06T14:51:15.590 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction 2023-12-06T14:51:15.757 INFO:teuthology.orchestra.run.smithi190.stdout: Preparing : 1/1 2023-12-06T14:51:16.025 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2023-12-06T14:51:16.274 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-fuse-2:17.2.7-113.gece0d607.el8.x86_64 2/2 2023-12-06T14:51:16.548 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-12-06T14:51:16.663 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-fuse-2:17.2.7-113.gece0d607.el8.x86_64 2/2 2023-12-06T14:51:16.663 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-fuse-2:17.2.7-113.gece0d607.el8.x86_64 1/2 2023-12-06T14:51:16.918 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2023-12-06T14:51:17.176 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-12-06T14:51:17.354 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2023-12-06T14:51:17.355 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:51:17.355 INFO:teuthology.orchestra.run.smithi190.stdout:Installed: 2023-12-06T14:51:17.355 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-fuse-2:17.2.7-113.gece0d607.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2023-12-06T14:51:17.355 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:51:17.355 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2023-12-06T14:51:17.372 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-113.gece0d607.el8.noarch 5/5 2023-12-06T14:51:17.573 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum -y install librados-devel 2023-12-06T14:51:17.650 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-113.gece0d607.el8.noarch 5/5 2023-12-06T14:51:17.650 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-113.gece0d607.el8.noarch 1/5 2023-12-06T14:51:17.651 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2023-12-06T14:51:17.651 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/5 2023-12-06T14:51:17.651 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-12-06T14:51:18.339 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2023-12-06T14:51:18.339 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:51:18.340 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-12-06T14:51:18.340 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm-2:17.2.7-113.gece0d607.el8.noarch 2023-12-06T14:51:18.340 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-06T14:51:18.340 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-06T14:51:18.340 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-06T14:51:18.340 INFO:teuthology.orchestra.run.smithi152.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-06T14:51:18.340 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:51:18.340 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-06T14:51:18.456 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:02:23 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:51:18.475 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-fuse 2023-12-06T14:51:19.337 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:24 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:51:20.150 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2023-12-06T14:51:20.151 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:51:20.151 INFO:teuthology.orchestra.run.smithi190.stdout: Package Arch Version Repo Size 2023-12-06T14:51:20.151 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:51:20.151 INFO:teuthology.orchestra.run.smithi190.stdout:Installing: 2023-12-06T14:51:20.151 INFO:teuthology.orchestra.run.smithi190.stdout: librados-devel x86_64 2:17.2.7-113.gece0d607.el8 ceph 130 k 2023-12-06T14:51:20.151 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:51:20.151 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction Summary 2023-12-06T14:51:20.151 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:51:20.152 INFO:teuthology.orchestra.run.smithi190.stdout:Install 1 Package 2023-12-06T14:51:20.152 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:51:20.152 INFO:teuthology.orchestra.run.smithi190.stdout:Total download size: 130 k 2023-12-06T14:51:20.152 INFO:teuthology.orchestra.run.smithi190.stdout:Installed size: 464 k 2023-12-06T14:51:20.152 INFO:teuthology.orchestra.run.smithi190.stdout:Downloading Packages: 2023-12-06T14:51:20.342 INFO:teuthology.orchestra.run.smithi190.stdout:librados-devel-17.2.7-113.gece0d607.el8.x86_64. 685 kB/s | 130 kB 00:00 2023-12-06T14:51:20.343 INFO:teuthology.orchestra.run.smithi190.stdout:-------------------------------------------------------------------------------- 2023-12-06T14:51:20.343 INFO:teuthology.orchestra.run.smithi190.stdout:Total 680 kB/s | 130 kB 00:00 2023-12-06T14:51:20.343 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction check 2023-12-06T14:51:20.348 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction check succeeded. 2023-12-06T14:51:20.348 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction test 2023-12-06T14:51:20.398 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction test succeeded. 2023-12-06T14:51:20.401 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction 2023-12-06T14:51:20.548 INFO:teuthology.orchestra.run.smithi190.stdout: Preparing : 1/1 2023-12-06T14:51:20.797 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librados-devel-2:17.2.7-113.gece0d607.el8.x86_64 1/1 2023-12-06T14:51:21.021 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-06T14:51:21.023 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:51:21.023 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2023-12-06T14:51:21.023 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:51:21.023 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2023-12-06T14:51:21.024 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse x86_64 2:17.2.7-113.gece0d607.el8 ceph 875 k 2023-12-06T14:51:21.024 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2023-12-06T14:51:21.024 INFO:teuthology.orchestra.run.smithi152.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-12-06T14:51:21.024 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:51:21.024 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-12-06T14:51:21.025 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:51:21.025 INFO:teuthology.orchestra.run.smithi152.stdout:Install 2 Packages 2023-12-06T14:51:21.025 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:51:21.025 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 958 k 2023-12-06T14:51:21.025 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 3.0 M 2023-12-06T14:51:21.025 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-12-06T14:51:21.090 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librados-devel-2:17.2.7-113.gece0d607.el8.x86_64 1/1 2023-12-06T14:51:21.418 INFO:teuthology.orchestra.run.smithi152.stdout:(1/2): fuse-2.9.7-17.el8.x86_64.rpm 234 kB/s | 83 kB 00:00 2023-12-06T14:51:21.518 INFO:teuthology.orchestra.run.smithi152.stdout:(2/2): ceph-fuse-17.2.7-113.gece0d607.el8.x86_6 1.9 MB/s | 875 kB 00:00 2023-12-06T14:51:21.518 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-12-06T14:51:21.519 INFO:teuthology.orchestra.run.smithi152.stdout:Total 1.9 MB/s | 958 kB 00:00 2023-12-06T14:51:21.530 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-12-06T14:51:21.551 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-12-06T14:51:21.551 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-12-06T14:51:21.638 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-12-06T14:51:21.641 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-12-06T14:51:21.751 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librados-devel-2:17.2.7-113.gece0d607.el8.x86_64 1/1 2023-12-06T14:51:21.752 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:51:21.752 INFO:teuthology.orchestra.run.smithi190.stdout:Installed: 2023-12-06T14:51:21.752 INFO:teuthology.orchestra.run.smithi190.stdout: librados-devel-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:51:21.752 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:51:21.752 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2023-12-06T14:51:21.803 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-12-06T14:51:21.989 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum -y install libcephfs2 2023-12-06T14:51:22.097 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2023-12-06T14:51:22.280 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-fuse-2:17.2.7-113.gece0d607.el8.x86_64 2/2 2023-12-06T14:51:22.673 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-fuse-2:17.2.7-113.gece0d607.el8.x86_64 2/2 2023-12-06T14:51:22.673 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-fuse-2:17.2.7-113.gece0d607.el8.x86_64 1/2 2023-12-06T14:51:22.856 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:02:27 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:51:23.399 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2023-12-06T14:51:23.400 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:51:23.400 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-12-06T14:51:23.400 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse-2:17.2.7-113.gece0d607.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2023-12-06T14:51:23.400 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:51:23.400 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-06T14:51:23.618 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install librados-devel 2023-12-06T14:51:24.312 INFO:teuthology.orchestra.run.smithi190.stdout:Package libcephfs2-2:17.2.7-113.gece0d607.el8.x86_64 is already installed. 2023-12-06T14:51:24.487 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:29 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:51:24.535 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2023-12-06T14:51:24.536 INFO:teuthology.orchestra.run.smithi190.stdout:Nothing to do. 2023-12-06T14:51:24.536 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2023-12-06T14:51:25.213 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum -y install libcephfs-devel 2023-12-06T14:51:26.072 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:02:31 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:51:26.148 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-06T14:51:26.149 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:51:26.149 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repo Size 2023-12-06T14:51:26.149 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:51:26.149 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2023-12-06T14:51:26.149 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel x86_64 2:17.2.7-113.gece0d607.el8 ceph 130 k 2023-12-06T14:51:26.149 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:51:26.149 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-12-06T14:51:26.149 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:51:26.149 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2023-12-06T14:51:26.149 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:51:26.150 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 130 k 2023-12-06T14:51:26.150 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 464 k 2023-12-06T14:51:26.150 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-12-06T14:51:26.446 INFO:teuthology.orchestra.run.smithi152.stdout:librados-devel-17.2.7-113.gece0d607.el8.x86_64. 439 kB/s | 130 kB 00:00 2023-12-06T14:51:26.446 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-12-06T14:51:26.447 INFO:teuthology.orchestra.run.smithi152.stdout:Total 437 kB/s | 130 kB 00:00 2023-12-06T14:51:26.447 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-12-06T14:51:26.452 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-12-06T14:51:26.452 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-12-06T14:51:26.502 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-12-06T14:51:26.505 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-12-06T14:51:26.667 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-12-06T14:51:26.903 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librados-devel-2:17.2.7-113.gece0d607.el8.x86_64 1/1 2023-12-06T14:51:27.192 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados-devel-2:17.2.7-113.gece0d607.el8.x86_64 1/1 2023-12-06T14:51:27.746 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2023-12-06T14:51:27.747 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:51:27.747 INFO:teuthology.orchestra.run.smithi190.stdout: Package Arch Version Repo Size 2023-12-06T14:51:27.747 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:51:27.747 INFO:teuthology.orchestra.run.smithi190.stdout:Installing: 2023-12-06T14:51:27.747 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs-devel x86_64 2:17.2.7-113.gece0d607.el8 ceph 25 k 2023-12-06T14:51:27.747 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:51:27.747 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction Summary 2023-12-06T14:51:27.747 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:51:27.747 INFO:teuthology.orchestra.run.smithi190.stdout:Install 1 Package 2023-12-06T14:51:27.747 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:51:27.748 INFO:teuthology.orchestra.run.smithi190.stdout:Total download size: 25 k 2023-12-06T14:51:27.748 INFO:teuthology.orchestra.run.smithi190.stdout:Installed size: 109 k 2023-12-06T14:51:27.748 INFO:teuthology.orchestra.run.smithi190.stdout:Downloading Packages: 2023-12-06T14:51:27.853 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados-devel-2:17.2.7-113.gece0d607.el8.x86_64 1/1 2023-12-06T14:51:27.853 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:51:27.854 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-12-06T14:51:27.854 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:51:27.854 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:51:27.854 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-06T14:51:27.982 INFO:teuthology.orchestra.run.smithi190.stdout:libcephfs-devel-17.2.7-113.gece0d607.el8.x86_64 106 kB/s | 25 kB 00:00 2023-12-06T14:51:27.983 INFO:teuthology.orchestra.run.smithi190.stdout:-------------------------------------------------------------------------------- 2023-12-06T14:51:27.983 INFO:teuthology.orchestra.run.smithi190.stdout:Total 105 kB/s | 25 kB 00:00 2023-12-06T14:51:27.983 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction check 2023-12-06T14:51:27.986 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction check succeeded. 2023-12-06T14:51:27.986 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction test 2023-12-06T14:51:27.988 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction test succeeded. 2023-12-06T14:51:27.991 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction 2023-12-06T14:51:28.042 INFO:teuthology.orchestra.run.smithi190.stdout: Preparing : 1/1 2023-12-06T14:51:28.052 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install libcephfs2 2023-12-06T14:51:28.231 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libcephfs-devel-2:17.2.7-113.gece0d607.el8.x86_64 1/1 2023-12-06T14:51:28.495 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-113.gece0d607.el8.x86_64 1/1 2023-12-06T14:51:28.920 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:33 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:51:29.141 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libcephfs-devel-2:17.2.7-113.gece0d607.el8.x86_64 1/1 2023-12-06T14:51:29.141 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:51:29.141 INFO:teuthology.orchestra.run.smithi190.stdout:Installed: 2023-12-06T14:51:29.141 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs-devel-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:51:29.142 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:51:29.142 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2023-12-06T14:51:29.255 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum -y install librados2 2023-12-06T14:51:30.120 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:02:35 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:51:30.373 INFO:teuthology.orchestra.run.smithi152.stdout:Package libcephfs2-2:17.2.7-113.gece0d607.el8.x86_64 is already installed. 2023-12-06T14:51:30.597 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-06T14:51:30.599 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2023-12-06T14:51:30.599 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-06T14:51:30.866 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install libcephfs-devel 2023-12-06T14:51:31.576 INFO:teuthology.orchestra.run.smithi190.stdout:Package librados2-2:17.2.7-113.gece0d607.el8.x86_64 is already installed. 2023-12-06T14:51:31.743 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:36 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:51:31.801 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2023-12-06T14:51:31.802 INFO:teuthology.orchestra.run.smithi190.stdout:Nothing to do. 2023-12-06T14:51:31.802 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2023-12-06T14:51:31.905 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum -y install librbd1 2023-12-06T14:51:32.765 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:02:37 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:51:33.442 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-06T14:51:33.443 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:51:33.443 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repo Size 2023-12-06T14:51:33.443 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:51:33.443 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2023-12-06T14:51:33.443 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel x86_64 2:17.2.7-113.gece0d607.el8 ceph 25 k 2023-12-06T14:51:33.443 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:51:33.444 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-12-06T14:51:33.444 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:51:33.444 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2023-12-06T14:51:33.444 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:51:33.444 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 25 k 2023-12-06T14:51:33.444 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 109 k 2023-12-06T14:51:33.444 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-12-06T14:51:33.585 INFO:teuthology.orchestra.run.smithi152.stdout:libcephfs-devel-17.2.7-113.gece0d607.el8.x86_64 177 kB/s | 25 kB 00:00 2023-12-06T14:51:33.585 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-12-06T14:51:33.585 INFO:teuthology.orchestra.run.smithi152.stdout:Total 175 kB/s | 25 kB 00:00 2023-12-06T14:51:33.586 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-12-06T14:51:33.589 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-12-06T14:51:33.589 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-12-06T14:51:33.591 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-12-06T14:51:33.594 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-12-06T14:51:33.647 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-12-06T14:51:33.836 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs-devel-2:17.2.7-113.gece0d607.el8.x86_64 1/1 2023-12-06T14:51:34.099 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-113.gece0d607.el8.x86_64 1/1 2023-12-06T14:51:34.210 INFO:teuthology.orchestra.run.smithi190.stdout:Package librbd1-2:17.2.7-113.gece0d607.el8.x86_64 is already installed. 2023-12-06T14:51:34.435 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2023-12-06T14:51:34.437 INFO:teuthology.orchestra.run.smithi190.stdout:Nothing to do. 2023-12-06T14:51:34.437 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2023-12-06T14:51:34.532 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum -y install python3-rados 2023-12-06T14:51:34.728 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs-devel-2:17.2.7-113.gece0d607.el8.x86_64 1/1 2023-12-06T14:51:34.729 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:51:34.729 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-12-06T14:51:34.729 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:51:34.729 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:51:34.729 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-06T14:51:34.848 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install librados2 2023-12-06T14:51:35.392 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:02:40 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:51:35.712 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:40 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:51:36.854 INFO:teuthology.orchestra.run.smithi190.stdout:Package python3-rados-2:17.2.7-113.gece0d607.el8.x86_64 is already installed. 2023-12-06T14:51:37.081 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2023-12-06T14:51:37.082 INFO:teuthology.orchestra.run.smithi190.stdout:Nothing to do. 2023-12-06T14:51:37.082 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2023-12-06T14:51:37.191 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum -y install python3-rgw 2023-12-06T14:51:37.200 INFO:teuthology.orchestra.run.smithi152.stdout:Package librados2-2:17.2.7-113.gece0d607.el8.x86_64 is already installed. 2023-12-06T14:51:37.425 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-06T14:51:37.426 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2023-12-06T14:51:37.426 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-06T14:51:37.606 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install librbd1 2023-12-06T14:51:38.049 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:02:43 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:51:38.468 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:43 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:51:39.502 INFO:teuthology.orchestra.run.smithi190.stdout:Package python3-rgw-2:17.2.7-113.gece0d607.el8.x86_64 is already installed. 2023-12-06T14:51:39.724 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2023-12-06T14:51:39.725 INFO:teuthology.orchestra.run.smithi190.stdout:Nothing to do. 2023-12-06T14:51:39.725 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2023-12-06T14:51:39.826 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum -y install python3-cephfs 2023-12-06T14:51:39.933 INFO:teuthology.orchestra.run.smithi152.stdout:Package librbd1-2:17.2.7-113.gece0d607.el8.x86_64 is already installed. 2023-12-06T14:51:40.156 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-06T14:51:40.157 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2023-12-06T14:51:40.158 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-06T14:51:40.268 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install python3-rados 2023-12-06T14:51:40.670 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:02:45 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:51:41.130 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:46 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:51:42.138 INFO:teuthology.orchestra.run.smithi190.stdout:Package python3-cephfs-2:17.2.7-113.gece0d607.el8.x86_64 is already installed. 2023-12-06T14:51:42.361 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2023-12-06T14:51:42.362 INFO:teuthology.orchestra.run.smithi190.stdout:Nothing to do. 2023-12-06T14:51:42.362 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2023-12-06T14:51:42.458 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum -y install python3-rbd 2023-12-06T14:51:42.595 INFO:teuthology.orchestra.run.smithi152.stdout:Package python3-rados-2:17.2.7-113.gece0d607.el8.x86_64 is already installed. 2023-12-06T14:51:42.819 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-06T14:51:42.821 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2023-12-06T14:51:42.821 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-06T14:51:42.936 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install python3-rgw 2023-12-06T14:51:43.317 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:02:48 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:51:43.794 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:48 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:51:44.772 INFO:teuthology.orchestra.run.smithi190.stdout:Package python3-rbd-2:17.2.7-113.gece0d607.el8.x86_64 is already installed. 2023-12-06T14:51:44.992 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2023-12-06T14:51:44.993 INFO:teuthology.orchestra.run.smithi190.stdout:Nothing to do. 2023-12-06T14:51:44.993 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2023-12-06T14:51:45.099 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum -y install rbd-fuse 2023-12-06T14:51:45.256 INFO:teuthology.orchestra.run.smithi152.stdout:Package python3-rgw-2:17.2.7-113.gece0d607.el8.x86_64 is already installed. 2023-12-06T14:51:45.487 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-06T14:51:45.488 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2023-12-06T14:51:45.488 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-06T14:51:45.587 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install python3-cephfs 2023-12-06T14:51:45.970 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:02:50 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:51:46.438 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:51 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:51:47.647 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2023-12-06T14:51:47.647 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:51:47.647 INFO:teuthology.orchestra.run.smithi190.stdout: Package Architecture Version Repository Size 2023-12-06T14:51:47.648 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:51:47.648 INFO:teuthology.orchestra.run.smithi190.stdout:Installing: 2023-12-06T14:51:47.648 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-fuse x86_64 2:17.2.7-113.gece0d607.el8 ceph 90 k 2023-12-06T14:51:47.648 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:51:47.648 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction Summary 2023-12-06T14:51:47.648 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:51:47.648 INFO:teuthology.orchestra.run.smithi190.stdout:Install 1 Package 2023-12-06T14:51:47.648 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:51:47.649 INFO:teuthology.orchestra.run.smithi190.stdout:Total download size: 90 k 2023-12-06T14:51:47.649 INFO:teuthology.orchestra.run.smithi190.stdout:Installed size: 264 k 2023-12-06T14:51:47.649 INFO:teuthology.orchestra.run.smithi190.stdout:Downloading Packages: 2023-12-06T14:51:47.906 INFO:teuthology.orchestra.run.smithi152.stdout:Package python3-cephfs-2:17.2.7-113.gece0d607.el8.x86_64 is already installed. 2023-12-06T14:51:48.130 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-06T14:51:48.131 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2023-12-06T14:51:48.131 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-06T14:51:48.341 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install python3-rbd 2023-12-06T14:51:48.370 INFO:teuthology.orchestra.run.smithi190.stdout:rbd-fuse-17.2.7-113.gece0d607.el8.x86_64.rpm 125 kB/s | 90 kB 00:00 2023-12-06T14:51:48.371 INFO:teuthology.orchestra.run.smithi190.stdout:-------------------------------------------------------------------------------- 2023-12-06T14:51:48.372 INFO:teuthology.orchestra.run.smithi190.stdout:Total 125 kB/s | 90 kB 00:00 2023-12-06T14:51:48.372 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction check 2023-12-06T14:51:48.383 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction check succeeded. 2023-12-06T14:51:48.383 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction test 2023-12-06T14:51:48.437 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction test succeeded. 2023-12-06T14:51:48.440 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction 2023-12-06T14:51:48.551 INFO:teuthology.orchestra.run.smithi190.stdout: Preparing : 1/1 2023-12-06T14:51:48.745 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : rbd-fuse-2:17.2.7-113.gece0d607.el8.x86_64 1/1 2023-12-06T14:51:49.019 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: rbd-fuse-2:17.2.7-113.gece0d607.el8.x86_64 1/1 2023-12-06T14:51:49.204 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:54 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:51:49.693 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : rbd-fuse-2:17.2.7-113.gece0d607.el8.x86_64 1/1 2023-12-06T14:51:49.693 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:51:49.693 INFO:teuthology.orchestra.run.smithi190.stdout:Installed: 2023-12-06T14:51:49.693 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-fuse-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:51:49.693 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:51:49.693 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2023-12-06T14:51:49.895 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum -y install rbd-mirror 2023-12-06T14:51:50.663 INFO:teuthology.orchestra.run.smithi152.stdout:Package python3-rbd-2:17.2.7-113.gece0d607.el8.x86_64 is already installed. 2023-12-06T14:51:50.753 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:02:55 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:51:50.888 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-06T14:51:50.890 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2023-12-06T14:51:50.890 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-06T14:51:51.001 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install rbd-fuse 2023-12-06T14:51:51.861 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:02:56 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:51:52.437 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2023-12-06T14:51:52.437 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:51:52.437 INFO:teuthology.orchestra.run.smithi190.stdout: Package Arch Version Repo Size 2023-12-06T14:51:52.437 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:51:52.437 INFO:teuthology.orchestra.run.smithi190.stdout:Installing: 2023-12-06T14:51:52.437 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-mirror x86_64 2:17.2.7-113.gece0d607.el8 ceph 3.5 M 2023-12-06T14:51:52.438 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:51:52.438 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction Summary 2023-12-06T14:51:52.438 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:51:52.438 INFO:teuthology.orchestra.run.smithi190.stdout:Install 1 Package 2023-12-06T14:51:52.438 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:51:52.438 INFO:teuthology.orchestra.run.smithi190.stdout:Total download size: 3.5 M 2023-12-06T14:51:52.438 INFO:teuthology.orchestra.run.smithi190.stdout:Installed size: 16 M 2023-12-06T14:51:52.439 INFO:teuthology.orchestra.run.smithi190.stdout:Downloading Packages: 2023-12-06T14:51:53.293 INFO:teuthology.orchestra.run.smithi190.stdout:rbd-mirror-17.2.7-113.gece0d607.el8.x86_64.rpm 4.0 MB/s | 3.5 MB 00:00 2023-12-06T14:51:53.293 INFO:teuthology.orchestra.run.smithi190.stdout:-------------------------------------------------------------------------------- 2023-12-06T14:51:53.294 INFO:teuthology.orchestra.run.smithi190.stdout:Total 4.0 MB/s | 3.5 MB 00:00 2023-12-06T14:51:53.294 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction check 2023-12-06T14:51:53.306 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction check succeeded. 2023-12-06T14:51:53.306 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction test 2023-12-06T14:51:53.369 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction test succeeded. 2023-12-06T14:51:53.373 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction 2023-12-06T14:51:53.534 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-06T14:51:53.535 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:51:53.535 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2023-12-06T14:51:53.535 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:51:53.535 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2023-12-06T14:51:53.535 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse x86_64 2:17.2.7-113.gece0d607.el8 ceph 90 k 2023-12-06T14:51:53.535 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:51:53.535 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-12-06T14:51:53.535 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:51:53.535 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2023-12-06T14:51:53.536 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:51:53.536 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 90 k 2023-12-06T14:51:53.536 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 264 k 2023-12-06T14:51:53.536 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-12-06T14:51:53.724 INFO:teuthology.orchestra.run.smithi152.stdout:rbd-fuse-17.2.7-113.gece0d607.el8.x86_64.rpm 483 kB/s | 90 kB 00:00 2023-12-06T14:51:53.724 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-12-06T14:51:53.724 INFO:teuthology.orchestra.run.smithi152.stdout:Total 480 kB/s | 90 kB 00:00 2023-12-06T14:51:53.725 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-12-06T14:51:53.734 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-12-06T14:51:53.734 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-12-06T14:51:53.784 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-12-06T14:51:53.787 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-12-06T14:51:53.817 INFO:teuthology.orchestra.run.smithi190.stdout: Preparing : 1/1 2023-12-06T14:51:53.897 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-12-06T14:51:54.012 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : rbd-mirror-2:17.2.7-113.gece0d607.el8.x86_64 1/1 2023-12-06T14:51:54.082 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-fuse-2:17.2.7-113.gece0d607.el8.x86_64 1/1 2023-12-06T14:51:54.371 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rbd-fuse-2:17.2.7-113.gece0d607.el8.x86_64 1/1 2023-12-06T14:51:54.431 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: rbd-mirror-2:17.2.7-113.gece0d607.el8.x86_64 1/1 2023-12-06T14:51:55.028 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-fuse-2:17.2.7-113.gece0d607.el8.x86_64 1/1 2023-12-06T14:51:55.028 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:51:55.028 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-12-06T14:51:55.028 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:51:55.028 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:51:55.028 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-06T14:51:55.135 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : rbd-mirror-2:17.2.7-113.gece0d607.el8.x86_64 1/1 2023-12-06T14:51:55.136 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:51:55.136 INFO:teuthology.orchestra.run.smithi190.stdout:Installed: 2023-12-06T14:51:55.136 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-mirror-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:51:55.136 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:51:55.136 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2023-12-06T14:51:55.229 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install rbd-mirror 2023-12-06T14:51:55.394 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum -y install rbd-nbd 2023-12-06T14:51:56.084 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:03:01 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:51:56.260 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:03:01 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:51:57.776 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-06T14:51:57.776 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:51:57.776 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repo Size 2023-12-06T14:51:57.776 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:51:57.776 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2023-12-06T14:51:57.776 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror x86_64 2:17.2.7-113.gece0d607.el8 ceph 3.5 M 2023-12-06T14:51:57.776 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:51:57.777 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-12-06T14:51:57.777 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:51:57.777 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2023-12-06T14:51:57.777 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:51:57.777 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 3.5 M 2023-12-06T14:51:57.777 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 16 M 2023-12-06T14:51:57.777 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-12-06T14:51:57.940 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2023-12-06T14:51:57.940 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:51:57.940 INFO:teuthology.orchestra.run.smithi190.stdout: Package Architecture Version Repository Size 2023-12-06T14:51:57.940 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:51:57.940 INFO:teuthology.orchestra.run.smithi190.stdout:Installing: 2023-12-06T14:51:57.940 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-nbd x86_64 2:17.2.7-113.gece0d607.el8 ceph 173 k 2023-12-06T14:51:57.940 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:51:57.940 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction Summary 2023-12-06T14:51:57.940 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2023-12-06T14:51:57.941 INFO:teuthology.orchestra.run.smithi190.stdout:Install 1 Package 2023-12-06T14:51:57.941 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:51:57.941 INFO:teuthology.orchestra.run.smithi190.stdout:Total download size: 173 k 2023-12-06T14:51:57.941 INFO:teuthology.orchestra.run.smithi190.stdout:Installed size: 552 k 2023-12-06T14:51:57.941 INFO:teuthology.orchestra.run.smithi190.stdout:Downloading Packages: 2023-12-06T14:51:58.371 INFO:teuthology.orchestra.run.smithi190.stdout:rbd-nbd-17.2.7-113.gece0d607.el8.x86_64.rpm 402 kB/s | 173 kB 00:00 2023-12-06T14:51:58.371 INFO:teuthology.orchestra.run.smithi190.stdout:-------------------------------------------------------------------------------- 2023-12-06T14:51:58.372 INFO:teuthology.orchestra.run.smithi190.stdout:Total 401 kB/s | 173 kB 00:00 2023-12-06T14:51:58.372 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction check 2023-12-06T14:51:58.383 INFO:teuthology.orchestra.run.smithi152.stdout:rbd-mirror-17.2.7-113.gece0d607.el8.x86_64.rpm 5.7 MB/s | 3.5 MB 00:00 2023-12-06T14:51:58.384 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction check succeeded. 2023-12-06T14:51:58.384 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction test 2023-12-06T14:51:58.384 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-12-06T14:51:58.384 INFO:teuthology.orchestra.run.smithi152.stdout:Total 5.7 MB/s | 3.5 MB 00:00 2023-12-06T14:51:58.385 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-12-06T14:51:58.396 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-12-06T14:51:58.396 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-12-06T14:51:58.434 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction test succeeded. 2023-12-06T14:51:58.437 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction 2023-12-06T14:51:58.458 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-12-06T14:51:58.461 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-12-06T14:51:58.574 INFO:teuthology.orchestra.run.smithi190.stdout: Preparing : 1/1 2023-12-06T14:51:58.774 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : rbd-nbd-2:17.2.7-113.gece0d607.el8.x86_64 1/1 2023-12-06T14:51:58.893 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-12-06T14:51:59.067 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: rbd-nbd-2:17.2.7-113.gece0d607.el8.x86_64 1/1 2023-12-06T14:51:59.074 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-mirror-2:17.2.7-113.gece0d607.el8.x86_64 1/1 2023-12-06T14:51:59.483 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rbd-mirror-2:17.2.7-113.gece0d607.el8.x86_64 1/1 2023-12-06T14:51:59.751 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : rbd-nbd-2:17.2.7-113.gece0d607.el8.x86_64 1/1 2023-12-06T14:51:59.751 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:51:59.751 INFO:teuthology.orchestra.run.smithi190.stdout:Installed: 2023-12-06T14:51:59.751 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-nbd-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:51:59.751 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:51:59.751 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2023-12-06T14:51:59.952 DEBUG:teuthology.parallel:result is None 2023-12-06T14:52:00.159 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-mirror-2:17.2.7-113.gece0d607.el8.x86_64 1/1 2023-12-06T14:52:00.159 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:52:00.159 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-12-06T14:52:00.160 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:52:00.160 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:52:00.160 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-06T14:52:00.398 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install rbd-nbd 2023-12-06T14:52:01.267 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:03:06 ago on Wed 06 Dec 2023 02:48:55 PM UTC. 2023-12-06T14:52:02.961 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-12-06T14:52:02.961 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:52:02.962 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2023-12-06T14:52:02.962 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:52:02.962 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2023-12-06T14:52:02.962 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd x86_64 2:17.2.7-113.gece0d607.el8 ceph 173 k 2023-12-06T14:52:02.962 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:52:02.962 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-12-06T14:52:02.962 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-12-06T14:52:02.962 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2023-12-06T14:52:02.962 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:52:02.962 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 173 k 2023-12-06T14:52:02.963 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 552 k 2023-12-06T14:52:02.963 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-12-06T14:52:03.154 INFO:teuthology.orchestra.run.smithi152.stdout:rbd-nbd-17.2.7-113.gece0d607.el8.x86_64.rpm 900 kB/s | 173 kB 00:00 2023-12-06T14:52:03.155 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-12-06T14:52:03.155 INFO:teuthology.orchestra.run.smithi152.stdout:Total 895 kB/s | 173 kB 00:00 2023-12-06T14:52:03.155 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-12-06T14:52:03.166 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-12-06T14:52:03.166 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-12-06T14:52:03.217 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-12-06T14:52:03.220 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-12-06T14:52:03.337 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-12-06T14:52:03.530 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-nbd-2:17.2.7-113.gece0d607.el8.x86_64 1/1 2023-12-06T14:52:03.827 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rbd-nbd-2:17.2.7-113.gece0d607.el8.x86_64 1/1 2023-12-06T14:52:04.499 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-nbd-2:17.2.7-113.gece0d607.el8.x86_64 1/1 2023-12-06T14:52:04.499 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:52:04.499 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-12-06T14:52:04.499 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd-2:17.2.7-113.gece0d607.el8.x86_64 2023-12-06T14:52:04.499 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:52:04.499 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-12-06T14:52:04.768 DEBUG:teuthology.parallel:result is None 2023-12-06T14:52:04.768 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-06T14:52:04.768 INFO:teuthology.packaging:ref: None 2023-12-06T14:52:04.768 INFO:teuthology.packaging:tag: None 2023-12-06T14:52:04.768 INFO:teuthology.packaging:branch: quincy 2023-12-06T14:52:04.768 INFO:teuthology.packaging:sha1: 0482646fcf78576d871bc87843257d82edb79541 2023-12-06T14:52:04.768 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-06T14:52:05.188 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-06T14:52:05.212 INFO:teuthology.orchestra.run.smithi152.stdout:17.2.7-113.gece0d607.el8 2023-12-06T14:52:05.213 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-113.gece0d607.el8 2023-12-06T14:52:05.213 INFO:teuthology.task.install:The correct ceph version 17.2.7-113.gece0d607 is installed. 2023-12-06T14:52:05.213 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-06T14:52:05.213 INFO:teuthology.packaging:ref: None 2023-12-06T14:52:05.213 INFO:teuthology.packaging:tag: None 2023-12-06T14:52:05.213 INFO:teuthology.packaging:branch: quincy 2023-12-06T14:52:05.213 INFO:teuthology.packaging:sha1: 0482646fcf78576d871bc87843257d82edb79541 2023-12-06T14:52:05.213 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2023-12-06T14:52:05.431 DEBUG:teuthology.orchestra.run.smithi190:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-06T14:52:05.457 INFO:teuthology.orchestra.run.smithi190.stdout:17.2.7-113.gece0d607.el8 2023-12-06T14:52:05.458 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-113.gece0d607.el8 2023-12-06T14:52:05.458 INFO:teuthology.task.install:The correct ceph version 17.2.7-113.gece0d607 is installed. 2023-12-06T14:52:05.458 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-06T14:52:05.458 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-06T14:52:05.458 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-06T14:52:05.489 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-06T14:52:05.489 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-06T14:52:05.531 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-06T14:52:05.531 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-06T14:52:05.531 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/daemon-helper 2023-12-06T14:52:05.560 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-06T14:52:05.629 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-06T14:52:05.629 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/daemon-helper 2023-12-06T14:52:05.661 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-06T14:52:05.733 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-06T14:52:05.733 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-06T14:52:05.733 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-06T14:52:05.762 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-06T14:52:05.832 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-06T14:52:05.832 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-06T14:52:05.862 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-06T14:52:05.932 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-06T14:52:05.932 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-06T14:52:05.933 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/stdin-killer 2023-12-06T14:52:05.962 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-06T14:52:06.031 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-06T14:52:06.032 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/stdin-killer 2023-12-06T14:52:06.060 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-06T14:52:06.130 INFO:teuthology.run_tasks:Running task print... 2023-12-06T14:52:06.141 INFO:teuthology.task.print:**** done install task... 2023-12-06T14:52:06.141 INFO:teuthology.run_tasks:Running task cephadm... 2023-12-06T14:52:06.239 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '0482646fcf78576d871bc87843257d82edb79541'} 2023-12-06T14:52:06.239 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2023-12-06T14:52:06.240 INFO:tasks.cephadm:Cluster fsid is 062f0e3c-9447-11ee-95a2-87774f69a715 2023-12-06T14:52:06.240 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-12-06T14:52:06.240 INFO:tasks.cephadm:No mon roles; fabricating mons 2023-12-06T14:52:06.240 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi152': '172.21.15.152', 'mon.smithi190': '172.21.15.190'} 2023-12-06T14:52:06.240 INFO:tasks.cephadm:Normalizing hostnames... 2023-12-06T14:52:06.240 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname $(hostname -s) 2023-12-06T14:52:06.270 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname $(hostname -s) 2023-12-06T14:52:06.299 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2023-12-06T14:52:06.300 DEBUG:teuthology.orchestra.run.smithi152:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-06T14:52:06.544 INFO:teuthology.orchestra.run.smithi152.stdout:-rw-rw-r--. 1 ubuntu ubuntu 367151 Dec 6 14:52 /home/ubuntu/cephtest/cephadm 2023-12-06T14:52:06.545 DEBUG:teuthology.orchestra.run.smithi190:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-06T14:52:06.779 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-rw-r--. 1 ubuntu ubuntu 367151 Dec 6 14:52 /home/ubuntu/cephtest/cephadm 2023-12-06T14:52:06.779 DEBUG:teuthology.orchestra.run.smithi152:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-06T14:52:06.801 DEBUG:teuthology.orchestra.run.smithi190:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-06T14:52:06.832 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2023-12-06T14:52:06.833 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2023-12-06T14:52:06.844 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2023-12-06T14:52:07.961 INFO:teuthology.orchestra.run.smithi152.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-06T14:52:08.022 INFO:teuthology.orchestra.run.smithi190.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-06T14:52:53.025 INFO:teuthology.orchestra.run.smithi190.stdout:{ 2023-12-06T14:52:53.026 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_version": "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)", 2023-12-06T14:52:53.026 INFO:teuthology.orchestra.run.smithi190.stdout: "image_id": "a5c6421f1c5fe063dab72126b739f503b14d5a6d98a783665fb1f951e704c21d", 2023-12-06T14:52:53.026 INFO:teuthology.orchestra.run.smithi190.stdout: "repo_digests": [ 2023-12-06T14:52:53.026 INFO:teuthology.orchestra.run.smithi190.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:6472617cbffae1c654a81c893b3dcc765ae43fb88703dee07a4f95a74a0d7739" 2023-12-06T14:52:53.026 INFO:teuthology.orchestra.run.smithi190.stdout: ] 2023-12-06T14:52:53.026 INFO:teuthology.orchestra.run.smithi190.stdout:} 2023-12-06T14:52:55.260 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-12-06T14:52:55.260 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_version": "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)", 2023-12-06T14:52:55.260 INFO:teuthology.orchestra.run.smithi152.stdout: "image_id": "a5c6421f1c5fe063dab72126b739f503b14d5a6d98a783665fb1f951e704c21d", 2023-12-06T14:52:55.261 INFO:teuthology.orchestra.run.smithi152.stdout: "repo_digests": [ 2023-12-06T14:52:55.261 INFO:teuthology.orchestra.run.smithi152.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:6472617cbffae1c654a81c893b3dcc765ae43fb88703dee07a4f95a74a0d7739" 2023-12-06T14:52:55.261 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2023-12-06T14:52:55.261 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-12-06T14:52:55.280 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /etc/ceph 2023-12-06T14:52:55.310 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /etc/ceph 2023-12-06T14:52:55.347 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 777 /etc/ceph 2023-12-06T14:52:55.376 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 777 /etc/ceph 2023-12-06T14:52:55.418 INFO:tasks.cephadm:Writing seed config... 2023-12-06T14:52:55.419 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2023-12-06T14:52:55.419 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2023-12-06T14:52:55.420 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2023-12-06T14:52:55.420 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2023-12-06T14:52:55.420 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2023-12-06T14:52:55.420 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-12-06T14:52:55.420 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-12-06T14:52:55.420 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2023-12-06T14:52:55.420 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2023-12-06T14:52:55.420 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-12-06T14:52:55.420 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-12-06T14:52:55.421 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2023-12-06T14:52:55.421 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-12-06T14:52:55.421 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-12-06T14:52:55.421 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-12-06T14:52:55.421 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-12-06T14:52:55.421 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-12-06T14:52:55.421 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-12-06T14:52:55.421 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-12-06T14:52:55.421 INFO:tasks.cephadm: override: [client] debug client = 20 2023-12-06T14:52:55.421 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-12-06T14:52:55.421 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-12-06T14:52:55.421 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-12-06T14:52:55.421 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2023-12-06T14:52:55.421 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-12-06T14:52:55.421 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2023-12-06T14:52:55.422 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-12-06T14:52:55.422 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-12-06T14:52:55.422 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-12-06T14:52:55.422 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-12-06T14:52:55.422 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-12-06T14:52:55.422 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-12-06T14:52:55.422 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-12-06T14:52:55.422 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-12-06T14:52:55.422 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-12-06T14:52:55.422 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-12-06T14:52:55.422 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-12-06T14:52:55.422 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-12-06T14:52:55.422 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-12-06T14:52:55.422 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-12-06T14:52:55.423 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-06T14:52:55.423 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-12-06T14:52:55.441 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 062f0e3c-9447-11ee-95a2-87774f69a715 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-12-06T14:52:55.441 DEBUG:teuthology.orchestra.run.smithi152:mon.smithi152> sudo journalctl -f -n 0 -u ceph-062f0e3c-9447-11ee-95a2-87774f69a715@mon.smithi152.service 2023-12-06T14:52:55.483 INFO:tasks.cephadm:Bootstrapping... 2023-12-06T14:52:55.483 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.152 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-12-06T14:52:55.509 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:-- Logs begin at Wed 2023-12-06 14:39:30 UTC. -- 2023-12-06T14:52:55.684 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-12-06T14:52:55.684 INFO:teuthology.orchestra.run.smithi152.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', '062f0e3c-9447-11ee-95a2-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.152', '--skip-admin-label'] 2023-12-06T14:52:55.714 INFO:teuthology.orchestra.run.smithi152.stdout:/bin/podman: stdout 4.6.1 2023-12-06T14:52:55.715 INFO:teuthology.orchestra.run.smithi152.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-12-06T14:52:55.715 INFO:teuthology.orchestra.run.smithi152.stdout:Verifying podman|docker is present... 2023-12-06T14:52:55.744 INFO:teuthology.orchestra.run.smithi152.stdout:/bin/podman: stdout 4.6.1 2023-12-06T14:52:55.744 INFO:teuthology.orchestra.run.smithi152.stdout:Verifying lvm2 is present... 2023-12-06T14:52:55.744 INFO:teuthology.orchestra.run.smithi152.stdout:Verifying time synchronization is in place... 2023-12-06T14:52:55.752 INFO:teuthology.orchestra.run.smithi152.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-06T14:52:55.752 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-06T14:52:55.757 INFO:teuthology.orchestra.run.smithi152.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-06T14:52:55.757 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stdout inactive 2023-12-06T14:52:55.763 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stdout enabled 2023-12-06T14:52:55.769 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stdout active 2023-12-06T14:52:55.769 INFO:teuthology.orchestra.run.smithi152.stdout:Unit chronyd.service is enabled and running 2023-12-06T14:52:55.769 INFO:teuthology.orchestra.run.smithi152.stdout:Repeating the final host check... 2023-12-06T14:52:55.797 INFO:teuthology.orchestra.run.smithi152.stdout:/bin/podman: stdout 4.6.1 2023-12-06T14:52:55.798 INFO:teuthology.orchestra.run.smithi152.stdout:podman (/bin/podman) version 4.6.1 is present 2023-12-06T14:52:55.798 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl is present 2023-12-06T14:52:55.798 INFO:teuthology.orchestra.run.smithi152.stdout:lvcreate is present 2023-12-06T14:52:55.803 INFO:teuthology.orchestra.run.smithi152.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-06T14:52:55.804 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-06T14:52:55.809 INFO:teuthology.orchestra.run.smithi152.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-06T14:52:55.809 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stdout inactive 2023-12-06T14:52:55.815 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stdout enabled 2023-12-06T14:52:55.821 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stdout active 2023-12-06T14:52:55.821 INFO:teuthology.orchestra.run.smithi152.stdout:Unit chronyd.service is enabled and running 2023-12-06T14:52:55.822 INFO:teuthology.orchestra.run.smithi152.stdout:Host looks OK 2023-12-06T14:52:55.822 INFO:teuthology.orchestra.run.smithi152.stdout:Cluster fsid: 062f0e3c-9447-11ee-95a2-87774f69a715 2023-12-06T14:52:55.822 INFO:teuthology.orchestra.run.smithi152.stdout:Acquiring lock 139921268304360 on /run/cephadm/062f0e3c-9447-11ee-95a2-87774f69a715.lock 2023-12-06T14:52:55.822 INFO:teuthology.orchestra.run.smithi152.stdout:Lock 139921268304360 acquired on /run/cephadm/062f0e3c-9447-11ee-95a2-87774f69a715.lock 2023-12-06T14:52:55.822 INFO:teuthology.orchestra.run.smithi152.stdout:Verifying IP 172.21.15.152 port 3300 ... 2023-12-06T14:52:55.822 INFO:teuthology.orchestra.run.smithi152.stdout:Verifying IP 172.21.15.152 port 6789 ... 2023-12-06T14:52:55.822 INFO:teuthology.orchestra.run.smithi152.stdout:Base mon IP(s) is [172.21.15.152:3300, 172.21.15.152:6789], mon addrv is [v2:172.21.15.152:3300,v1:172.21.15.152:6789] 2023-12-06T14:52:55.826 INFO:teuthology.orchestra.run.smithi152.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.152 metric 100 2023-12-06T14:52:55.826 INFO:teuthology.orchestra.run.smithi152.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.152 metric 100 2023-12-06T14:52:55.829 INFO:teuthology.orchestra.run.smithi152.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-12-06T14:52:55.829 INFO:teuthology.orchestra.run.smithi152.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2023-12-06T14:52:55.829 INFO:teuthology.orchestra.run.smithi152.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1797sec hoplimit 64 pref medium 2023-12-06T14:52:55.832 INFO:teuthology.orchestra.run.smithi152.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-12-06T14:52:55.833 INFO:teuthology.orchestra.run.smithi152.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-12-06T14:52:55.833 INFO:teuthology.orchestra.run.smithi152.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-06T14:52:55.833 INFO:teuthology.orchestra.run.smithi152.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2023-12-06T14:52:55.833 INFO:teuthology.orchestra.run.smithi152.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe88:6de3/64 scope link 2023-12-06T14:52:55.833 INFO:teuthology.orchestra.run.smithi152.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-06T14:52:55.833 INFO:teuthology.orchestra.run.smithi152.stdout:Mon IP `172.21.15.152` is in CIDR network `172.21.0.0/20` 2023-12-06T14:52:55.833 INFO:teuthology.orchestra.run.smithi152.stdout:Mon IP `172.21.15.152` is in CIDR network `172.21.0.0/20` 2023-12-06T14:52:55.833 INFO:teuthology.orchestra.run.smithi152.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-12-06T14:52:55.833 INFO:teuthology.orchestra.run.smithi152.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-12-06T14:52:55.834 INFO:teuthology.orchestra.run.smithi152.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-06T14:52:56.205 INFO:teuthology.orchestra.run.smithi152.stdout:/bin/podman: stdout a5c6421f1c5fe063dab72126b739f503b14d5a6d98a783665fb1f951e704c21d 2023-12-06T14:52:56.207 INFO:teuthology.orchestra.run.smithi152.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2023-12-06T14:52:56.207 INFO:teuthology.orchestra.run.smithi152.stdout:/bin/podman: stderr Getting image source signatures 2023-12-06T14:52:56.207 INFO:teuthology.orchestra.run.smithi152.stdout:/bin/podman: stderr Copying blob sha256:d3e436ac93e4b5a6d94c7ac8024df331e66e67275836276615dc044fd3cbf83a 2023-12-06T14:52:56.208 INFO:teuthology.orchestra.run.smithi152.stdout:/bin/podman: stderr Copying blob sha256:eaf4b8a28072afa5245860f19da05db525ad8839028db1c984057aa89563a4af 2023-12-06T14:52:56.208 INFO:teuthology.orchestra.run.smithi152.stdout:/bin/podman: stderr Copying config sha256:a5c6421f1c5fe063dab72126b739f503b14d5a6d98a783665fb1f951e704c21d 2023-12-06T14:52:56.208 INFO:teuthology.orchestra.run.smithi152.stdout:/bin/podman: stderr Writing manifest to image destination 2023-12-06T14:52:56.911 INFO:teuthology.orchestra.run.smithi152.stdout:ceph: stdout ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable) 2023-12-06T14:52:56.911 INFO:teuthology.orchestra.run.smithi152.stdout:Ceph version: ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable) 2023-12-06T14:52:56.911 INFO:teuthology.orchestra.run.smithi152.stdout:Extracting ceph user uid/gid from container image... 2023-12-06T14:52:57.525 INFO:teuthology.orchestra.run.smithi152.stdout:stat: stdout 167 167 2023-12-06T14:52:57.525 INFO:teuthology.orchestra.run.smithi152.stdout:Creating initial keys... 2023-12-06T14:52:58.125 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph-authtool: stdout AQDJinBlb+0KLxAAjbc7EkMUuwIkXlfeibjulA== 2023-12-06T14:52:58.717 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph-authtool: stdout AQDKinBlK+OrFhAAVC2FKyqdyyORc2nwg4wrEg== 2023-12-06T14:52:59.309 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph-authtool: stdout AQDKinBlNt5rORAAkgCq3WaprdMKlWet6MbC/A== 2023-12-06T14:52:59.310 INFO:teuthology.orchestra.run.smithi152.stdout:Creating initial monmap... 2023-12-06T14:52:59.921 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-06T14:52:59.921 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2023-12-06T14:52:59.921 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 062f0e3c-9447-11ee-95a2-87774f69a715 2023-12-06T14:52:59.921 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-06T14:52:59.921 INFO:teuthology.orchestra.run.smithi152.stdout:monmaptool for smithi152 [v2:172.21.15.152:3300,v1:172.21.15.152:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-06T14:52:59.921 INFO:teuthology.orchestra.run.smithi152.stdout:setting min_mon_release = octopus 2023-12-06T14:52:59.921 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/monmaptool: set fsid to 062f0e3c-9447-11ee-95a2-87774f69a715 2023-12-06T14:52:59.922 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-06T14:52:59.922 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:52:59.922 INFO:teuthology.orchestra.run.smithi152.stdout:Creating mon... 2023-12-06T14:53:00.538 INFO:teuthology.orchestra.run.smithi152.stdout:create mon.smithi152 on 2023-12-06T14:53:00.634 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-12-06T14:53:00.721 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-12-06T14:53:00.811 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-062f0e3c-9447-11ee-95a2-87774f69a715.target → /etc/systemd/system/ceph-062f0e3c-9447-11ee-95a2-87774f69a715.target. 2023-12-06T14:53:00.811 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-062f0e3c-9447-11ee-95a2-87774f69a715.target → /etc/systemd/system/ceph-062f0e3c-9447-11ee-95a2-87774f69a715.target. 2023-12-06T14:53:00.931 INFO:teuthology.orchestra.run.smithi152.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-062f0e3c-9447-11ee-95a2-87774f69a715@mon.smithi152 2023-12-06T14:53:00.931 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stderr Failed to reset failed state of unit ceph-062f0e3c-9447-11ee-95a2-87774f69a715@mon.smithi152.service: Unit ceph-062f0e3c-9447-11ee-95a2-87774f69a715@mon.smithi152.service not loaded. 2023-12-06T14:53:01.022 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-062f0e3c-9447-11ee-95a2-87774f69a715.target.wants/ceph-062f0e3c-9447-11ee-95a2-87774f69a715@mon.smithi152.service → /etc/systemd/system/ceph-062f0e3c-9447-11ee-95a2-87774f69a715@.service. 2023-12-06T14:53:01.127 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:01 smithi152 systemd[1]: Starting Ceph mon.smithi152 for 062f0e3c-9447-11ee-95a2-87774f69a715... 2023-12-06T14:53:01.388 INFO:teuthology.orchestra.run.smithi152.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-06T14:53:01.389 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stdout disabled 2023-12-06T14:53:01.396 INFO:teuthology.orchestra.run.smithi152.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-06T14:53:01.396 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stdout inactive 2023-12-06T14:53:01.396 INFO:teuthology.orchestra.run.smithi152.stdout:firewalld.service is not enabled 2023-12-06T14:53:01.396 INFO:teuthology.orchestra.run.smithi152.stdout:Not possible to enable service . firewalld.service is not available 2023-12-06T14:53:01.397 INFO:teuthology.orchestra.run.smithi152.stdout:Waiting for mon to start... 2023-12-06T14:53:01.397 INFO:teuthology.orchestra.run.smithi152.stdout:Waiting for mon... 2023-12-06T14:53:01.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:01 smithi152 bash[111433]: 2ab3d2ff577df0df5800f1a22eb2d6a3a5fb1f62984cb6ae8b929c25a7328784 2023-12-06T14:53:01.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:01 smithi152 systemd[1]: Started Ceph mon.smithi152 for 062f0e3c-9447-11ee-95a2-87774f69a715. 2023-12-06T14:53:01.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:01 smithi152 ceph-mon[111471]: mkfs 062f0e3c-9447-11ee-95a2-87774f69a715 2023-12-06T14:53:01.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:01 smithi152 ceph-mon[111471]: mon.smithi152 is new leader, mons smithi152 in quorum (ranks 0) 2023-12-06T14:53:02.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout cluster: 2023-12-06T14:53:02.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout id: 062f0e3c-9447-11ee-95a2-87774f69a715 2023-12-06T14:53:02.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-12-06T14:53:02.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout 2023-12-06T14:53:02.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout services: 2023-12-06T14:53:02.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi152 (age 0.442314s) 2023-12-06T14:53:02.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-12-06T14:53:02.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-12-06T14:53:02.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout 2023-12-06T14:53:02.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout data: 2023-12-06T14:53:02.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-12-06T14:53:02.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-12-06T14:53:02.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-12-06T14:53:02.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout pgs: 2023-12-06T14:53:02.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout 2023-12-06T14:53:02.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.778+0000 7f743b57d700 1 Processor -- start 2023-12-06T14:53:02.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.778+0000 7f743b57d700 1 -- start start 2023-12-06T14:53:02.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.778+0000 7f743b57d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7434076c00 0x7f7434104ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:02.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.778+0000 7f743b57d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7434105430 con 0x7f7434076c00 2023-12-06T14:53:02.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.778+0000 7f7439319700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7434076c00 0x7f7434104ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:02.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.779+0000 7f7439319700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7434076c00 0x7f7434104ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60584/0 (socket says 172.21.15.152:60584) 2023-12-06T14:53:02.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.779+0000 7f7439319700 1 -- 172.21.15.152:0/2346202271 learned_addr learned my addr 172.21.15.152:0/2346202271 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:02.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.779+0000 7f7439319700 1 -- 172.21.15.152:0/2346202271 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7434105570 con 0x7f7434076c00 2023-12-06T14:53:02.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.779+0000 7f7439319700 1 --2- 172.21.15.152:0/2346202271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7434076c00 0x7f7434104ef0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f74300098e0 tx=0x7f7430009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f80925e7e10e7d9f server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:02.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.779+0000 7f742bfff700 1 -- 172.21.15.152:0/2346202271 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f743000b860 con 0x7f7434076c00 2023-12-06T14:53:02.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.779+0000 7f742bfff700 1 -- 172.21.15.152:0/2346202271 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743000b9c0 con 0x7f7434076c00 2023-12-06T14:53:02.194 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.779+0000 7f742bfff700 1 -- 172.21.15.152:0/2346202271 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f743000bc90 con 0x7f7434076c00 2023-12-06T14:53:02.194 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.780+0000 7f743b57d700 1 -- 172.21.15.152:0/2346202271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7434076c00 msgr2=0x7f7434104ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:02.194 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.780+0000 7f743b57d700 1 --2- 172.21.15.152:0/2346202271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7434076c00 0x7f7434104ef0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f74300098e0 tx=0x7f7430009250 comp rx=0 tx=0).stop 2023-12-06T14:53:02.194 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.780+0000 7f743b57d700 1 -- 172.21.15.152:0/2346202271 shutdown_connections 2023-12-06T14:53:02.194 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.780+0000 7f743b57d700 1 --2- 172.21.15.152:0/2346202271 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7434076c00 0x7f7434104ef0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:02.194 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.780+0000 7f743b57d700 1 -- 172.21.15.152:0/2346202271 >> 172.21.15.152:0/2346202271 conn(0x7f74340fc980 msgr2=0x7f74340fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:02.194 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.780+0000 7f743b57d700 1 -- 172.21.15.152:0/2346202271 shutdown_connections 2023-12-06T14:53:02.194 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.780+0000 7f743b57d700 1 -- 172.21.15.152:0/2346202271 wait complete. 2023-12-06T14:53:02.194 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.780+0000 7f743b57d700 1 Processor -- start 2023-12-06T14:53:02.194 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.780+0000 7f743b57d700 1 -- start start 2023-12-06T14:53:02.194 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.780+0000 7f743b57d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7434076c00 0x7f7434102970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:02.194 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.780+0000 7f743b57d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7434100df0 con 0x7f7434076c00 2023-12-06T14:53:02.194 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.780+0000 7f7439319700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7434076c00 0x7f7434102970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:02.194 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.780+0000 7f7439319700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7434076c00 0x7f7434102970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60600/0 (socket says 172.21.15.152:60600) 2023-12-06T14:53:02.195 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.781+0000 7f7439319700 1 -- 172.21.15.152:0/1244668285 learned_addr learned my addr 172.21.15.152:0/1244668285 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:02.195 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.781+0000 7f7439319700 1 -- 172.21.15.152:0/1244668285 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74300094f0 con 0x7f7434076c00 2023-12-06T14:53:02.195 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.781+0000 7f7439319700 1 --2- 172.21.15.152:0/1244668285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7434076c00 0x7f7434102970 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7430009290 tx=0x7f7430016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:02.195 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.781+0000 7f7429ffb700 1 -- 172.21.15.152:0/1244668285 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f743001c5c0 con 0x7f7434076c00 2023-12-06T14:53:02.195 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.781+0000 7f7429ffb700 1 -- 172.21.15.152:0/1244668285 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743001c740 con 0x7f7434076c00 2023-12-06T14:53:02.195 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.781+0000 7f743b57d700 1 -- 172.21.15.152:0/1244668285 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7434100ff0 con 0x7f7434076c00 2023-12-06T14:53:02.195 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.781+0000 7f7429ffb700 1 -- 172.21.15.152:0/1244668285 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f743001ca50 con 0x7f7434076c00 2023-12-06T14:53:02.195 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.781+0000 7f743b57d700 1 -- 172.21.15.152:0/1244668285 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7434101400 con 0x7f7434076c00 2023-12-06T14:53:02.195 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.781+0000 7f7429ffb700 1 -- 172.21.15.152:0/1244668285 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f743001a450 con 0x7f7434076c00 2023-12-06T14:53:02.195 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.781+0000 7f7429ffb700 1 -- 172.21.15.152:0/1244668285 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f743002e790 con 0x7f7434076c00 2023-12-06T14:53:02.195 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.782+0000 7f743b57d700 1 -- 172.21.15.152:0/1244668285 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f743404bb80 con 0x7f7434076c00 2023-12-06T14:53:02.195 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.784+0000 7f7429ffb700 1 -- 172.21.15.152:0/1244668285 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f743001ce30 con 0x7f7434076c00 2023-12-06T14:53:02.195 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.853+0000 7f743b57d700 1 -- 172.21.15.152:0/1244668285 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f743410a180 con 0x7f7434076c00 2023-12-06T14:53:02.195 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.853+0000 7f7429ffb700 1 -- 172.21.15.152:0/1244668285 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f743001a840 con 0x7f7434076c00 2023-12-06T14:53:02.196 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.854+0000 7f743b57d700 1 -- 172.21.15.152:0/1244668285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7434076c00 msgr2=0x7f7434102970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:02.196 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.854+0000 7f743b57d700 1 --2- 172.21.15.152:0/1244668285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7434076c00 0x7f7434102970 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7430009290 tx=0x7f7430016000 comp rx=0 tx=0).stop 2023-12-06T14:53:02.196 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.854+0000 7f743b57d700 1 -- 172.21.15.152:0/1244668285 shutdown_connections 2023-12-06T14:53:02.196 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.854+0000 7f743b57d700 1 --2- 172.21.15.152:0/1244668285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7434076c00 0x7f7434102970 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:02.196 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.854+0000 7f743b57d700 1 -- 172.21.15.152:0/1244668285 >> 172.21.15.152:0/1244668285 conn(0x7f74340fc980 msgr2=0x7f74340fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:02.196 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.854+0000 7f743b57d700 1 -- 172.21.15.152:0/1244668285 shutdown_connections 2023-12-06T14:53:02.196 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:01.854+0000 7f743b57d700 1 -- 172.21.15.152:0/1244668285 wait complete. 2023-12-06T14:53:02.196 INFO:teuthology.orchestra.run.smithi152.stdout:mon is available 2023-12-06T14:53:02.196 INFO:teuthology.orchestra.run.smithi152.stdout:Assimilating anything we can from ceph.conf... 2023-12-06T14:53:02.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:02 smithi152 ceph-mon[111471]: mon.smithi152 is new leader, mons smithi152 in quorum (ranks 0) 2023-12-06T14:53:02.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:02 smithi152 ceph-mon[111471]: monmap e1: 1 mons at {smithi152=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-06T14:53:02.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:02 smithi152 ceph-mon[111471]: fsmap 2023-12-06T14:53:02.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:02 smithi152 ceph-mon[111471]: osdmap e1: 0 total, 0 up, 0 in 2023-12-06T14:53:02.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:02 smithi152 ceph-mon[111471]: mgrmap e1: no daemons active 2023-12-06T14:53:02.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:02 smithi152 ceph-mon[111471]: from='client.? 172.21.15.152:0/1244668285' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-12-06T14:53:03.044 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout 2023-12-06T14:53:03.052 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout [global] 2023-12-06T14:53:03.052 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout fsid = 062f0e3c-9447-11ee-95a2-87774f69a715 2023-12-06T14:53:03.052 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.152:3300,v1:172.21.15.152:6789] 2023-12-06T14:53:03.052 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-06T14:53:03.052 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-06T14:53:03.052 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-06T14:53:03.052 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-06T14:53:03.052 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout 2023-12-06T14:53:03.052 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-06T14:53:03.052 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-06T14:53:03.052 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout 2023-12-06T14:53:03.053 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout [osd] 2023-12-06T14:53:03.053 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-12-06T14:53:03.053 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-12-06T14:53:03.053 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-12-06T14:53:03.053 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-06T14:53:03.053 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-06T14:53:03.053 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.616+0000 7f3fa7759700 1 Processor -- start 2023-12-06T14:53:03.053 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.617+0000 7f3fa7759700 1 -- start start 2023-12-06T14:53:03.053 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.617+0000 7f3fa7759700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3fa0076c20 0x7f3fa0104ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:03.053 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.617+0000 7f3fa7759700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa0105410 con 0x7f3fa0076c20 2023-12-06T14:53:03.053 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.617+0000 7f3fa54f5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3fa0076c20 0x7f3fa0104ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:03.053 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.617+0000 7f3fa54f5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3fa0076c20 0x7f3fa0104ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60614/0 (socket says 172.21.15.152:60614) 2023-12-06T14:53:03.053 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.617+0000 7f3fa54f5700 1 -- 172.21.15.152:0/2414749037 learned_addr learned my addr 172.21.15.152:0/2414749037 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:03.053 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.617+0000 7f3fa54f5700 1 -- 172.21.15.152:0/2414749037 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa0105550 con 0x7f3fa0076c20 2023-12-06T14:53:03.053 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.617+0000 7f3fa54f5700 1 --2- 172.21.15.152:0/2414749037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3fa0076c20 0x7f3fa0104ed0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3f900098e0 tx=0x7f3f90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7ec705647d7d86b server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:03.054 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.618+0000 7f3f97fff700 1 -- 172.21.15.152:0/2414749037 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f9000b860 con 0x7f3fa0076c20 2023-12-06T14:53:03.054 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.618+0000 7f3f97fff700 1 -- 172.21.15.152:0/2414749037 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9000b9c0 con 0x7f3fa0076c20 2023-12-06T14:53:03.054 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.618+0000 7f3f97fff700 1 -- 172.21.15.152:0/2414749037 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f9000bc90 con 0x7f3fa0076c20 2023-12-06T14:53:03.054 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.618+0000 7f3fa7759700 1 -- 172.21.15.152:0/2414749037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3fa0076c20 msgr2=0x7f3fa0104ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:03.054 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.618+0000 7f3fa7759700 1 --2- 172.21.15.152:0/2414749037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3fa0076c20 0x7f3fa0104ed0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3f900098e0 tx=0x7f3f90009250 comp rx=0 tx=0).stop 2023-12-06T14:53:03.054 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.618+0000 7f3fa7759700 1 -- 172.21.15.152:0/2414749037 shutdown_connections 2023-12-06T14:53:03.054 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.618+0000 7f3fa7759700 1 --2- 172.21.15.152:0/2414749037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3fa0076c20 0x7f3fa0104ed0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:03.054 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.618+0000 7f3fa7759700 1 -- 172.21.15.152:0/2414749037 >> 172.21.15.152:0/2414749037 conn(0x7f3fa00fc980 msgr2=0x7f3fa00fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:03.054 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.618+0000 7f3fa7759700 1 -- 172.21.15.152:0/2414749037 shutdown_connections 2023-12-06T14:53:03.054 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.618+0000 7f3fa7759700 1 -- 172.21.15.152:0/2414749037 wait complete. 2023-12-06T14:53:03.054 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.619+0000 7f3fa7759700 1 Processor -- start 2023-12-06T14:53:03.054 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.619+0000 7f3fa7759700 1 -- start start 2023-12-06T14:53:03.054 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.619+0000 7f3fa7759700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3fa0076c20 0x7f3fa0102950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:03.054 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.619+0000 7f3fa7759700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa0100dd0 con 0x7f3fa0076c20 2023-12-06T14:53:03.055 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.619+0000 7f3fa54f5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3fa0076c20 0x7f3fa0102950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:03.055 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.619+0000 7f3fa54f5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3fa0076c20 0x7f3fa0102950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60624/0 (socket says 172.21.15.152:60624) 2023-12-06T14:53:03.055 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.619+0000 7f3fa54f5700 1 -- 172.21.15.152:0/1343780138 learned_addr learned my addr 172.21.15.152:0/1343780138 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:03.055 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.619+0000 7f3fa54f5700 1 -- 172.21.15.152:0/1343780138 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f900094f0 con 0x7f3fa0076c20 2023-12-06T14:53:03.055 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.619+0000 7f3fa54f5700 1 --2- 172.21.15.152:0/1343780138 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3fa0076c20 0x7f3fa0102950 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f3f90009290 tx=0x7f3f90016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:03.055 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.619+0000 7f3f95ffb700 1 -- 172.21.15.152:0/1343780138 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f9001c5c0 con 0x7f3fa0076c20 2023-12-06T14:53:03.055 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.619+0000 7f3f95ffb700 1 -- 172.21.15.152:0/1343780138 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9001c740 con 0x7f3fa0076c20 2023-12-06T14:53:03.055 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.619+0000 7f3fa7759700 1 -- 172.21.15.152:0/1343780138 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa0100fd0 con 0x7f3fa0076c20 2023-12-06T14:53:03.055 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.619+0000 7f3f95ffb700 1 -- 172.21.15.152:0/1343780138 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f9001ca50 con 0x7f3fa0076c20 2023-12-06T14:53:03.055 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.620+0000 7f3fa7759700 1 -- 172.21.15.152:0/1343780138 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa01013e0 con 0x7f3fa0076c20 2023-12-06T14:53:03.055 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.620+0000 7f3f95ffb700 1 -- 172.21.15.152:0/1343780138 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f3f9001a450 con 0x7f3fa0076c20 2023-12-06T14:53:03.055 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.620+0000 7f3f95ffb700 1 -- 172.21.15.152:0/1343780138 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f3f9002e790 con 0x7f3fa0076c20 2023-12-06T14:53:03.055 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.621+0000 7f3fa7759700 1 -- 172.21.15.152:0/1343780138 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fa010a690 con 0x7f3fa0076c20 2023-12-06T14:53:03.055 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.623+0000 7f3f95ffb700 1 -- 172.21.15.152:0/1343780138 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f3f9001ce30 con 0x7f3fa0076c20 2023-12-06T14:53:03.056 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.689+0000 7f3fa7759700 1 -- 172.21.15.152:0/1343780138 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f3fa01059f0 con 0x7f3fa0076c20 2023-12-06T14:53:03.056 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.693+0000 7f3f95ffb700 1 -- 172.21.15.152:0/1343780138 <== mon.0 v2:172.21.15.152:3300/0 7 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f3f9002e9f0 con 0x7f3fa0076c20 2023-12-06T14:53:03.056 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.693+0000 7f3f95ffb700 1 -- 172.21.15.152:0/1343780138 <== mon.0 v2:172.21.15.152:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+431 (secure 0 0 0) 0x7f3fa01059f0 con 0x7f3fa0076c20 2023-12-06T14:53:03.056 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.694+0000 7f3fa7759700 1 -- 172.21.15.152:0/1343780138 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3fa0076c20 msgr2=0x7f3fa0102950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:03.056 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.694+0000 7f3fa7759700 1 --2- 172.21.15.152:0/1343780138 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3fa0076c20 0x7f3fa0102950 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f3f90009290 tx=0x7f3f90016000 comp rx=0 tx=0).stop 2023-12-06T14:53:03.056 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.694+0000 7f3fa7759700 1 -- 172.21.15.152:0/1343780138 shutdown_connections 2023-12-06T14:53:03.056 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.694+0000 7f3fa7759700 1 --2- 172.21.15.152:0/1343780138 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3fa0076c20 0x7f3fa0102950 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:03.056 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.694+0000 7f3fa7759700 1 -- 172.21.15.152:0/1343780138 >> 172.21.15.152:0/1343780138 conn(0x7f3fa00fc980 msgr2=0x7f3fa00fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:03.056 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.694+0000 7f3fa7759700 1 -- 172.21.15.152:0/1343780138 shutdown_connections 2023-12-06T14:53:03.056 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:02.694+0000 7f3fa7759700 1 -- 172.21.15.152:0/1343780138 wait complete. 2023-12-06T14:53:03.056 INFO:teuthology.orchestra.run.smithi152.stdout:Generating new minimal ceph.conf... 2023-12-06T14:53:03.729 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:03 smithi152 ceph-mon[111471]: from='client.? 172.21.15.152:0/1343780138' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-12-06T14:53:03.729 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:03 smithi152 ceph-mon[111471]: from='client.? 172.21.15.152:0/1343780138' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-12-06T14:53:03.823 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.391+0000 7f83431a4700 1 Processor -- start 2023-12-06T14:53:03.823 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.391+0000 7f83431a4700 1 -- start start 2023-12-06T14:53:03.823 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.391+0000 7f83431a4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f833c070f80 0x7f833c107320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:03.823 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.391+0000 7f83431a4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833c102d10 con 0x7f833c070f80 2023-12-06T14:53:03.823 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.391+0000 7f8340f40700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f833c070f80 0x7f833c107320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:03.823 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.391+0000 7f8340f40700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f833c070f80 0x7f833c107320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60636/0 (socket says 172.21.15.152:60636) 2023-12-06T14:53:03.823 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.391+0000 7f8340f40700 1 -- 172.21.15.152:0/1109957340 learned_addr learned my addr 172.21.15.152:0/1109957340 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:03.823 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.391+0000 7f8340f40700 1 -- 172.21.15.152:0/1109957340 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f833c107860 con 0x7f833c070f80 2023-12-06T14:53:03.823 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.391+0000 7f8340f40700 1 --2- 172.21.15.152:0/1109957340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f833c070f80 0x7f833c107320 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f83300098e0 tx=0x7f8330009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e5b9f31892841c server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:03.823 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.391+0000 7f833b7fe700 1 -- 172.21.15.152:0/1109957340 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f833000b860 con 0x7f833c070f80 2023-12-06T14:53:03.823 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.391+0000 7f833b7fe700 1 -- 172.21.15.152:0/1109957340 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f833000be30 con 0x7f833c070f80 2023-12-06T14:53:03.824 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.392+0000 7f833b7fe700 1 -- 172.21.15.152:0/1109957340 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8330010380 con 0x7f833c070f80 2023-12-06T14:53:03.824 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.392+0000 7f83431a4700 1 -- 172.21.15.152:0/1109957340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f833c070f80 msgr2=0x7f833c107320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:03.824 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.392+0000 7f83431a4700 1 --2- 172.21.15.152:0/1109957340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f833c070f80 0x7f833c107320 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f83300098e0 tx=0x7f8330009250 comp rx=0 tx=0).stop 2023-12-06T14:53:03.824 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.392+0000 7f83431a4700 1 -- 172.21.15.152:0/1109957340 shutdown_connections 2023-12-06T14:53:03.824 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.392+0000 7f83431a4700 1 --2- 172.21.15.152:0/1109957340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f833c070f80 0x7f833c107320 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:03.824 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.392+0000 7f83431a4700 1 -- 172.21.15.152:0/1109957340 >> 172.21.15.152:0/1109957340 conn(0x7f833c0fc970 msgr2=0x7f833c0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:03.824 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.392+0000 7f83431a4700 1 -- 172.21.15.152:0/1109957340 shutdown_connections 2023-12-06T14:53:03.824 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.392+0000 7f83431a4700 1 -- 172.21.15.152:0/1109957340 wait complete. 2023-12-06T14:53:03.824 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.393+0000 7f83431a4700 1 Processor -- start 2023-12-06T14:53:03.824 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.393+0000 7f83431a4700 1 -- start start 2023-12-06T14:53:03.824 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.393+0000 7f83431a4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f833c070f80 0x7f833c113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:03.824 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.393+0000 7f83431a4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833c1138c0 con 0x7f833c070f80 2023-12-06T14:53:03.824 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.393+0000 7f8340f40700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f833c070f80 0x7f833c113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:03.824 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.393+0000 7f8340f40700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f833c070f80 0x7f833c113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60644/0 (socket says 172.21.15.152:60644) 2023-12-06T14:53:03.824 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.393+0000 7f8340f40700 1 -- 172.21.15.152:0/433326763 learned_addr learned my addr 172.21.15.152:0/433326763 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:03.825 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.393+0000 7f8340f40700 1 -- 172.21.15.152:0/433326763 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83300094f0 con 0x7f833c070f80 2023-12-06T14:53:03.825 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.393+0000 7f8340f40700 1 --2- 172.21.15.152:0/433326763 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f833c070f80 0x7f833c113380 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8330006b00 tx=0x7f8330009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:03.825 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.394+0000 7f83397fa700 1 -- 172.21.15.152:0/433326763 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8330010a80 con 0x7f833c070f80 2023-12-06T14:53:03.825 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.394+0000 7f83397fa700 1 -- 172.21.15.152:0/433326763 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f833001a430 con 0x7f833c070f80 2023-12-06T14:53:03.825 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.394+0000 7f83397fa700 1 -- 172.21.15.152:0/433326763 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f83300245b0 con 0x7f833c070f80 2023-12-06T14:53:03.825 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.394+0000 7f83431a4700 1 -- 172.21.15.152:0/433326763 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f833c113ac0 con 0x7f833c070f80 2023-12-06T14:53:03.825 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.394+0000 7f83431a4700 1 -- 172.21.15.152:0/433326763 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f833c113ed0 con 0x7f833c070f80 2023-12-06T14:53:03.825 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.394+0000 7f83397fa700 1 -- 172.21.15.152:0/433326763 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f8330024a60 con 0x7f833c070f80 2023-12-06T14:53:03.825 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.394+0000 7f83397fa700 1 -- 172.21.15.152:0/433326763 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f833002eaa0 con 0x7f833c070f80 2023-12-06T14:53:03.825 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.395+0000 7f83431a4700 1 -- 172.21.15.152:0/433326763 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f833c04bb80 con 0x7f833c070f80 2023-12-06T14:53:03.825 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.397+0000 7f83397fa700 1 -- 172.21.15.152:0/433326763 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f833002ed00 con 0x7f833c070f80 2023-12-06T14:53:03.825 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.464+0000 7f83431a4700 1 -- 172.21.15.152:0/433326763 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f833c1084f0 con 0x7f833c070f80 2023-12-06T14:53:03.825 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.464+0000 7f83397fa700 1 -- 172.21.15.152:0/433326763 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+177 (secure 0 0 0) 0x7f8330010be0 con 0x7f833c070f80 2023-12-06T14:53:03.826 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.465+0000 7f83431a4700 1 -- 172.21.15.152:0/433326763 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f833c070f80 msgr2=0x7f833c113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:03.826 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.465+0000 7f83431a4700 1 --2- 172.21.15.152:0/433326763 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f833c070f80 0x7f833c113380 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8330006b00 tx=0x7f8330009250 comp rx=0 tx=0).stop 2023-12-06T14:53:03.826 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.465+0000 7f83431a4700 1 -- 172.21.15.152:0/433326763 shutdown_connections 2023-12-06T14:53:03.826 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.465+0000 7f83431a4700 1 --2- 172.21.15.152:0/433326763 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f833c070f80 0x7f833c113380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:03.826 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.465+0000 7f83431a4700 1 -- 172.21.15.152:0/433326763 >> 172.21.15.152:0/433326763 conn(0x7f833c0fc970 msgr2=0x7f833c0fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:03.826 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.465+0000 7f83431a4700 1 -- 172.21.15.152:0/433326763 shutdown_connections 2023-12-06T14:53:03.826 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:03.465+0000 7f83431a4700 1 -- 172.21.15.152:0/433326763 wait complete. 2023-12-06T14:53:03.826 INFO:teuthology.orchestra.run.smithi152.stdout:Restarting the monitor... 2023-12-06T14:53:03.997 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:03 smithi152 systemd[1]: Stopping Ceph mon.smithi152 for 062f0e3c-9447-11ee-95a2-87774f69a715... 2023-12-06T14:53:04.250 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:03 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-mon-smithi152[111448]: 2023-12-06T14:53:03.996+0000 7fcffa182700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi152 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-06T14:53:04.250 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:03 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-mon-smithi152[111448]: 2023-12-06T14:53:03.996+0000 7fcffa182700 -1 mon.smithi152@0(leader) e1 *** Got Signal Terminated *** 2023-12-06T14:53:04.526 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 bash[111797]: ceph-062f0e3c-9447-11ee-95a2-87774f69a715-mon-smithi152 2023-12-06T14:53:04.826 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 systemd[1]: ceph-062f0e3c-9447-11ee-95a2-87774f69a715@mon.smithi152.service: Succeeded. 2023-12-06T14:53:04.826 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 systemd[1]: Stopped Ceph mon.smithi152 for 062f0e3c-9447-11ee-95a2-87774f69a715. 2023-12-06T14:53:04.826 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 systemd[1]: Starting Ceph mon.smithi152 for 062f0e3c-9447-11ee-95a2-87774f69a715... 2023-12-06T14:53:04.894 INFO:teuthology.orchestra.run.smithi152.stdout:Setting mon public_network to 172.21.0.0/20 2023-12-06T14:53:05.351 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: set uid:gid to 167:167 (ceph:ceph) 2023-12-06T14:53:05.351 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable), process ceph-mon, pid 7 2023-12-06T14:53:05.351 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: pidfile_write: ignore empty --pid-file 2023-12-06T14:53:05.351 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 bash[111916]: 2b9f6058715d403f505c3d38ea0bb59e392a47e0a0700e8c6d5796158058b652 2023-12-06T14:53:05.351 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: load: jerasure load: lrc 2023-12-06T14:53:05.351 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: RocksDB version: 6.15.5 2023-12-06T14:53:05.352 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2023-12-06T14:53:05.352 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Compile date Dec 5 2023 2023-12-06T14:53:05.352 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: DB SUMMARY 2023-12-06T14:53:05.352 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: DB Session ID: N0X8G8ZPK976RFBHCPNJ 2023-12-06T14:53:05.352 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: CURRENT file: CURRENT 2023-12-06T14:53:05.352 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: IDENTITY file: IDENTITY 2023-12-06T14:53:05.352 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2023-12-06T14:53:05.352 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi152/store.db dir, Total Num: 1, files: 000008.sst 2023-12-06T14:53:05.352 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi152/store.db: 000010.log size: 95358 ; 2023-12-06T14:53:05.352 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.error_if_exists: 0 2023-12-06T14:53:05.352 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.create_if_missing: 0 2023-12-06T14:53:05.352 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.paranoid_checks: 1 2023-12-06T14:53:05.352 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-06T14:53:05.352 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.env: 0x56335c307a80 2023-12-06T14:53:05.352 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.fs: Posix File System 2023-12-06T14:53:05.353 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.info_log: 0x56335cf98780 2023-12-06T14:53:05.353 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.max_file_opening_threads: 16 2023-12-06T14:53:05.353 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.statistics: (nil) 2023-12-06T14:53:05.353 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.use_fsync: 0 2023-12-06T14:53:05.353 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.max_log_file_size: 0 2023-12-06T14:53:05.353 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-06T14:53:05.353 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-06T14:53:05.353 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.keep_log_file_num: 1000 2023-12-06T14:53:05.353 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.recycle_log_file_num: 0 2023-12-06T14:53:05.353 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.allow_fallocate: 1 2023-12-06T14:53:05.353 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.allow_mmap_reads: 0 2023-12-06T14:53:05.353 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.allow_mmap_writes: 0 2023-12-06T14:53:05.353 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.use_direct_reads: 0 2023-12-06T14:53:05.353 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-06T14:53:05.353 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.create_missing_column_families: 0 2023-12-06T14:53:05.354 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.db_log_dir: 2023-12-06T14:53:05.354 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi152/store.db 2023-12-06T14:53:05.354 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-06T14:53:05.354 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-06T14:53:05.354 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-06T14:53:05.354 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-06T14:53:05.354 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-06T14:53:05.354 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-06T14:53:05.354 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.advise_random_on_open: 1 2023-12-06T14:53:05.354 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.db_write_buffer_size: 0 2023-12-06T14:53:05.354 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.write_buffer_manager: 0x56335dd08990 2023-12-06T14:53:05.354 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-06T14:53:05.354 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2023-12-06T14:53:05.354 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-06T14:53:05.354 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-06T14:53:05.355 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.rate_limiter: (nil) 2023-12-06T14:53:05.355 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-06T14:53:05.355 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.wal_recovery_mode: 2 2023-12-06T14:53:05.355 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.enable_thread_tracking: 0 2023-12-06T14:53:05.355 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.enable_pipelined_write: 0 2023-12-06T14:53:05.355 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.unordered_write: 0 2023-12-06T14:53:05.355 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-06T14:53:05.355 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-06T14:53:05.355 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-06T14:53:05.355 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-06T14:53:05.355 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.row_cache: None 2023-12-06T14:53:05.355 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.wal_filter: None 2023-12-06T14:53:05.355 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-06T14:53:05.355 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.allow_ingest_behind: 0 2023-12-06T14:53:05.355 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.preserve_deletes: 0 2023-12-06T14:53:05.355 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.two_write_queues: 0 2023-12-06T14:53:05.356 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.manual_wal_flush: 0 2023-12-06T14:53:05.356 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.atomic_flush: 0 2023-12-06T14:53:05.356 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-06T14:53:05.356 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-06T14:53:05.356 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-06T14:53:05.356 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.log_readahead_size: 0 2023-12-06T14:53:05.356 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-06T14:53:05.356 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.best_efforts_recovery: 0 2023-12-06T14:53:05.356 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-06T14:53:05.356 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-06T14:53:05.356 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.allow_data_in_errors: 0 2023-12-06T14:53:05.356 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.db_host_id: __hostname__ 2023-12-06T14:53:05.357 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.max_background_jobs: 2 2023-12-06T14:53:05.357 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.max_background_compactions: -1 2023-12-06T14:53:05.357 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.max_subcompactions: 1 2023-12-06T14:53:05.357 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-06T14:53:05.357 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-06T14:53:05.357 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-06T14:53:05.357 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.max_total_wal_size: 0 2023-12-06T14:53:05.357 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-06T14:53:05.357 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-06T14:53:05.357 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-06T14:53:05.357 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-06T14:53:05.358 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.max_open_files: -1 2023-12-06T14:53:05.358 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.bytes_per_sync: 0 2023-12-06T14:53:05.358 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-06T14:53:05.358 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-06T14:53:05.358 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.compaction_readahead_size: 0 2023-12-06T14:53:05.358 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.max_background_flushes: -1 2023-12-06T14:53:05.358 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Compression algorithms supported: 2023-12-06T14:53:05.358 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-06T14:53:05.358 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 systemd[1]: Started Ceph mon.smithi152 for 062f0e3c-9447-11ee-95a2-87774f69a715. 2023-12-06T14:53:05.358 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: kZSTD supported: 0 2023-12-06T14:53:05.358 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: kXpressCompression supported: 0 2023-12-06T14:53:05.358 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: kLZ4HCCompression supported: 1 2023-12-06T14:53:05.358 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: kZlibCompression supported: 1 2023-12-06T14:53:05.359 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: kSnappyCompression supported: 1 2023-12-06T14:53:05.359 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: kLZ4Compression supported: 1 2023-12-06T14:53:05.359 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: kBZip2Compression supported: 0 2023-12-06T14:53:05.359 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-06T14:53:05.359 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi152/store.db/MANIFEST-000009 2023-12-06T14:53:05.359 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2023-12-06T14:53:05.359 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-06T14:53:05.359 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.merge_operator: 2023-12-06T14:53:05.359 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.compaction_filter: None 2023-12-06T14:53:05.359 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.compaction_filter_factory: None 2023-12-06T14:53:05.359 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.sst_partitioner_factory: None 2023-12-06T14:53:05.359 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-06T14:53:05.359 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-06T14:53:05.359 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56335cfe8f90) 2023-12-06T14:53:05.359 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: cache_index_and_filter_blocks: 1 2023-12-06T14:53:05.360 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-06T14:53:05.360 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-06T14:53:05.360 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: pin_top_level_index_and_filter: 1 2023-12-06T14:53:05.360 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: index_type: 0 2023-12-06T14:53:05.360 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: data_block_index_type: 0 2023-12-06T14:53:05.360 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: index_shortening: 1 2023-12-06T14:53:05.360 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-06T14:53:05.360 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: hash_index_allow_collision: 1 2023-12-06T14:53:05.360 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: checksum: 1 2023-12-06T14:53:05.360 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: no_block_cache: 0 2023-12-06T14:53:05.360 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_cache: 0x56335d01b090 2023-12-06T14:53:05.360 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_cache_name: BinnedLRUCache 2023-12-06T14:53:05.360 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_cache_options: 2023-12-06T14:53:05.360 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: capacity : 536870912 2023-12-06T14:53:05.361 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: num_shard_bits : 4 2023-12-06T14:53:05.361 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: strict_capacity_limit : 0 2023-12-06T14:53:05.361 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: high_pri_pool_ratio: 0.000 2023-12-06T14:53:05.361 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_cache_compressed: (nil) 2023-12-06T14:53:05.361 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: persistent_cache: (nil) 2023-12-06T14:53:05.361 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_size: 4096 2023-12-06T14:53:05.361 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_size_deviation: 10 2023-12-06T14:53:05.361 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_restart_interval: 16 2023-12-06T14:53:05.361 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: index_block_restart_interval: 1 2023-12-06T14:53:05.361 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: metadata_block_size: 4096 2023-12-06T14:53:05.361 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: partition_filters: 0 2023-12-06T14:53:05.361 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: use_delta_encoding: 1 2023-12-06T14:53:05.361 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2023-12-06T14:53:05.361 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: whole_key_filtering: 1 2023-12-06T14:53:05.362 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: verify_compression: 0 2023-12-06T14:53:05.362 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: read_amp_bytes_per_bit: 0 2023-12-06T14:53:05.362 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: format_version: 4 2023-12-06T14:53:05.362 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: enable_index_compression: 1 2023-12-06T14:53:05.362 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_align: 0 2023-12-06T14:53:05.362 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.write_buffer_size: 33554432 2023-12-06T14:53:05.362 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.max_write_buffer_number: 2 2023-12-06T14:53:05.362 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.compression: NoCompression 2023-12-06T14:53:05.362 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.bottommost_compression: Disabled 2023-12-06T14:53:05.362 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.prefix_extractor: nullptr 2023-12-06T14:53:05.362 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-06T14:53:05.362 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.num_levels: 7 2023-12-06T14:53:05.362 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-06T14:53:05.363 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-06T14:53:05.363 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-06T14:53:05.363 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-06T14:53:05.363 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-06T14:53:05.363 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-06T14:53:05.363 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-06T14:53:05.363 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-06T14:53:05.363 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-06T14:53:05.363 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-06T14:53:05.363 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-06T14:53:05.363 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.compression_opts.level: 32767 2023-12-06T14:53:05.363 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.compression_opts.strategy: 0 2023-12-06T14:53:05.363 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-06T14:53:05.363 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-06T14:53:05.363 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-06T14:53:05.364 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.compression_opts.enabled: false 2023-12-06T14:53:05.364 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-06T14:53:05.364 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-06T14:53:05.364 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-06T14:53:05.364 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.target_file_size_base: 67108864 2023-12-06T14:53:05.364 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-06T14:53:05.364 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-06T14:53:05.364 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-06T14:53:05.364 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-06T14:53:05.364 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-06T14:53:05.364 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-06T14:53:05.364 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-06T14:53:05.364 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-06T14:53:05.364 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-06T14:53:05.364 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-06T14:53:05.365 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-06T14:53:05.365 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-06T14:53:05.365 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-06T14:53:05.365 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.arena_block_size: 4194304 2023-12-06T14:53:05.365 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-06T14:53:05.365 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-06T14:53:05.365 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2023-12-06T14:53:05.365 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.disable_auto_compactions: 0 2023-12-06T14:53:05.365 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-06T14:53:05.365 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-06T14:53:05.365 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-06T14:53:05.365 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-06T14:53:05.365 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-06T14:53:05.366 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-06T14:53:05.366 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-06T14:53:05.366 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-06T14:53:05.366 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-06T14:53:05.366 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-06T14:53:05.366 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.table_properties_collectors: 2023-12-06T14:53:05.366 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.inplace_update_support: 0 2023-12-06T14:53:05.366 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-06T14:53:05.366 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-06T14:53:05.366 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-06T14:53:05.366 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-06T14:53:05.366 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.bloom_locality: 0 2023-12-06T14:53:05.366 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.max_successive_merges: 0 2023-12-06T14:53:05.366 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-06T14:53:05.367 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.paranoid_file_checks: 0 2023-12-06T14:53:05.367 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.force_consistency_checks: 1 2023-12-06T14:53:05.367 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.report_bg_io_stats: 0 2023-12-06T14:53:05.367 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.ttl: 2592000 2023-12-06T14:53:05.367 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-06T14:53:05.367 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.enable_blob_files: false 2023-12-06T14:53:05.367 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.min_blob_size: 0 2023-12-06T14:53:05.367 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.blob_file_size: 268435456 2023-12-06T14:53:05.367 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-06T14:53:05.367 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-06T14:53:05.367 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-06T14:53:05.367 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi152/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-06T14:53:05.367 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2023-12-06T14:53:05.367 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2023-12-06T14:53:05.367 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701874384895586, "job": 1, "event": "recovery_started", "wal_files": [10]} 2023-12-06T14:53:05.367 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2023-12-06T14:53:05.368 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2023-12-06T14:53:05.368 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701874384896628, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 90884, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 88979, "index_size": 265, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13169, "raw_average_key_size": 49, "raw_value_size": 81757, "raw_average_value_size": 309, "num_data_blocks": 11, "num_entries": 264, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1701874384, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "678a2c97-dbc7-4ced-b25b-cacf5a5b7e85", "db_session_id": "N0X8G8ZPK976RFBHCPNJ"}} 2023-12-06T14:53:05.368 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2023-12-06T14:53:05.368 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701874384897075, "job": 1, "event": "recovery_finished"} 2023-12-06T14:53:05.368 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi152/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-06T14:53:05.368 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x56335cfaf180 2023-12-06T14:53:05.368 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: DB pointer 0x56335d084000 2023-12-06T14:53:05.368 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2023-12-06T14:53:05.368 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: rocksdb: [db/db_impl/db_impl.cc:903] 2023-12-06T14:53:05.368 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ** DB Stats ** 2023-12-06T14:53:05.369 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-06T14:53:05.369 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-06T14:53:05.369 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-06T14:53:05.369 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-06T14:53:05.369 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-06T14:53:05.369 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2023-12-06T14:53:05.369 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-06T14:53:05.369 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2023-12-06T14:53:05.369 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ** Compaction Stats [default] ** 2023-12-06T14:53:05.369 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-06T14:53:05.369 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-06T14:53:05.369 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: L0 2/0 90.55 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 126.2 0.00 0.00 1 0.001 0 0 2023-12-06T14:53:05.369 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Sum 2/0 90.55 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 126.2 0.00 0.00 1 0.001 0 0 2023-12-06T14:53:05.369 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 126.2 0.00 0.00 1 0.001 0 0 2023-12-06T14:53:05.369 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2023-12-06T14:53:05.369 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ** Compaction Stats [default] ** 2023-12-06T14:53:05.370 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-06T14:53:05.370 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-06T14:53:05.370 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 126.2 0.00 0.00 1 0.001 0 0 2023-12-06T14:53:05.370 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-06T14:53:05.370 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-06T14:53:05.370 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-06T14:53:05.370 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-06T14:53:05.370 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-06T14:53:05.370 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-06T14:53:05.370 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Cumulative compaction: 0.00 GB write, 23.15 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-06T14:53:05.370 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Interval compaction: 0.00 GB write, 23.15 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-06T14:53:05.370 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-06T14:53:05.370 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2023-12-06T14:53:05.370 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-06T14:53:05.370 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2023-12-06T14:53:05.371 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ** Compaction Stats [default] ** 2023-12-06T14:53:05.371 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-06T14:53:05.371 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-06T14:53:05.371 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: L0 2/0 90.55 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 126.2 0.00 0.00 1 0.001 0 0 2023-12-06T14:53:05.371 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Sum 2/0 90.55 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 126.2 0.00 0.00 1 0.001 0 0 2023-12-06T14:53:05.371 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2023-12-06T14:53:05.371 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2023-12-06T14:53:05.371 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ** Compaction Stats [default] ** 2023-12-06T14:53:05.371 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2023-12-06T14:53:05.371 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-06T14:53:05.371 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 126.2 0.00 0.00 1 0.001 0 0 2023-12-06T14:53:05.371 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-06T14:53:05.371 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-06T14:53:05.371 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-06T14:53:05.372 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-06T14:53:05.372 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-06T14:53:05.372 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-06T14:53:05.372 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Cumulative compaction: 0.00 GB write, 22.97 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-06T14:53:05.372 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-06T14:53:05.372 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-06T14:53:05.372 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2023-12-06T14:53:05.372 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-06T14:53:05.372 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: starting mon.smithi152 rank 0 at public addrs [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] at bind addrs [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi152 fsid 062f0e3c-9447-11ee-95a2-87774f69a715 2023-12-06T14:53:05.372 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: mon.smithi152@-1(???) e1 preinit fsid 062f0e3c-9447-11ee-95a2-87774f69a715 2023-12-06T14:53:05.372 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: mon.smithi152@-1(???).mds e1 new map 2023-12-06T14:53:05.372 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: mon.smithi152@-1(???).mds e1 print_map 2023-12-06T14:53:05.372 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: e1 2023-12-06T14:53:05.372 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-06T14:53:05.372 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-06T14:53:05.373 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: legacy client fscid: -1 2023-12-06T14:53:05.373 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2023-12-06T14:53:05.373 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: No filesystems configured 2023-12-06T14:53:05.373 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: mon.smithi152@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-06T14:53:05.373 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: mon.smithi152@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-06T14:53:05.373 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: mon.smithi152@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-06T14:53:05.373 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: mon.smithi152@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-06T14:53:05.373 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: mon.smithi152@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-12-06T14:53:05.373 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: mon.smithi152 is new leader, mons smithi152 in quorum (ranks 0) 2023-12-06T14:53:05.373 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: monmap e1: 1 mons at {smithi152=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-06T14:53:05.373 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: fsmap 2023-12-06T14:53:05.373 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: osdmap e1: 0 total, 0 up, 0 in 2023-12-06T14:53:05.373 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:04 smithi152 ceph-mon[111954]: mgrmap e1: no daemons active 2023-12-06T14:53:05.697 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.244+0000 7fe800613700 1 Processor -- start 2023-12-06T14:53:05.701 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.244+0000 7fe800613700 1 -- start start 2023-12-06T14:53:05.701 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.244+0000 7fe800613700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7f8071000 0x7fe7f8104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:05.701 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.244+0000 7fe800613700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f81053e0 con 0x7fe7f8071000 2023-12-06T14:53:05.701 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.244+0000 7fe7fe3af700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7f8071000 0x7fe7f8104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:05.701 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.245+0000 7fe7fe3af700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7f8071000 0x7fe7f8104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60646/0 (socket says 172.21.15.152:60646) 2023-12-06T14:53:05.701 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.245+0000 7fe7fe3af700 1 -- 172.21.15.152:0/4282267864 learned_addr learned my addr 172.21.15.152:0/4282267864 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:05.701 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.245+0000 7fe7fe3af700 1 -- 172.21.15.152:0/4282267864 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f8105520 con 0x7fe7f8071000 2023-12-06T14:53:05.701 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.245+0000 7fe7fe3af700 1 --2- 172.21.15.152:0/4282267864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7f8071000 0x7fe7f8104ea0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe7f40098e0 tx=0x7fe7f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ebff1f39c859f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:05.702 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.245+0000 7fe7fd3ad700 1 -- 172.21.15.152:0/4282267864 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7f400b860 con 0x7fe7f8071000 2023-12-06T14:53:05.702 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.245+0000 7fe7fd3ad700 1 -- 172.21.15.152:0/4282267864 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fe7f400be30 con 0x7fe7f8071000 2023-12-06T14:53:05.702 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.245+0000 7fe7fd3ad700 1 -- 172.21.15.152:0/4282267864 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7f4010380 con 0x7fe7f8071000 2023-12-06T14:53:05.702 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.246+0000 7fe800613700 1 -- 172.21.15.152:0/4282267864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7f8071000 msgr2=0x7fe7f8104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:05.702 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.246+0000 7fe800613700 1 --2- 172.21.15.152:0/4282267864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7f8071000 0x7fe7f8104ea0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe7f40098e0 tx=0x7fe7f4009250 comp rx=0 tx=0).stop 2023-12-06T14:53:05.702 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.246+0000 7fe800613700 1 -- 172.21.15.152:0/4282267864 shutdown_connections 2023-12-06T14:53:05.702 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.246+0000 7fe800613700 1 --2- 172.21.15.152:0/4282267864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7f8071000 0x7fe7f8104ea0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:05.702 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.246+0000 7fe800613700 1 -- 172.21.15.152:0/4282267864 >> 172.21.15.152:0/4282267864 conn(0x7fe7f80fc970 msgr2=0x7fe7f80fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:05.702 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.246+0000 7fe800613700 1 -- 172.21.15.152:0/4282267864 shutdown_connections 2023-12-06T14:53:05.702 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.246+0000 7fe800613700 1 -- 172.21.15.152:0/4282267864 wait complete. 2023-12-06T14:53:05.702 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.246+0000 7fe800613700 1 Processor -- start 2023-12-06T14:53:05.702 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.246+0000 7fe800613700 1 -- start start 2023-12-06T14:53:05.702 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.246+0000 7fe800613700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7f8071000 0x7fe7f8102920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:05.703 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.246+0000 7fe800613700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f8100da0 con 0x7fe7f8071000 2023-12-06T14:53:05.703 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.246+0000 7fe7fe3af700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7f8071000 0x7fe7f8102920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:05.703 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.247+0000 7fe7fe3af700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7f8071000 0x7fe7f8102920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60662/0 (socket says 172.21.15.152:60662) 2023-12-06T14:53:05.703 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.247+0000 7fe7fe3af700 1 -- 172.21.15.152:0/3895362423 learned_addr learned my addr 172.21.15.152:0/3895362423 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:05.703 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.247+0000 7fe7fe3af700 1 -- 172.21.15.152:0/3895362423 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f40094f0 con 0x7fe7f8071000 2023-12-06T14:53:05.703 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.247+0000 7fe7fe3af700 1 --2- 172.21.15.152:0/3895362423 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7f8071000 0x7fe7f8102920 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe7f4006b00 tx=0x7fe7f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:05.703 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.247+0000 7fe7eeffd700 1 -- 172.21.15.152:0/3895362423 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7f4010a80 con 0x7fe7f8071000 2023-12-06T14:53:05.703 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.247+0000 7fe7eeffd700 1 -- 172.21.15.152:0/3895362423 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fe7f401a430 con 0x7fe7f8071000 2023-12-06T14:53:05.703 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.247+0000 7fe800613700 1 -- 172.21.15.152:0/3895362423 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7f8100fa0 con 0x7fe7f8071000 2023-12-06T14:53:05.703 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.247+0000 7fe7eeffd700 1 -- 172.21.15.152:0/3895362423 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7f40245b0 con 0x7fe7f8071000 2023-12-06T14:53:05.703 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.247+0000 7fe800613700 1 -- 172.21.15.152:0/3895362423 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7f81013b0 con 0x7fe7f8071000 2023-12-06T14:53:05.703 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.247+0000 7fe7eeffd700 1 -- 172.21.15.152:0/3895362423 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fe7f4024a60 con 0x7fe7f8071000 2023-12-06T14:53:05.703 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.247+0000 7fe7eeffd700 1 -- 172.21.15.152:0/3895362423 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe7f402eaa0 con 0x7fe7f8071000 2023-12-06T14:53:05.703 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.248+0000 7fe800613700 1 -- 172.21.15.152:0/3895362423 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7f804bb80 con 0x7fe7f8071000 2023-12-06T14:53:05.703 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.250+0000 7fe7eeffd700 1 -- 172.21.15.152:0/3895362423 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fe7f402ec60 con 0x7fe7f8071000 2023-12-06T14:53:05.703 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.316+0000 7fe800613700 1 -- 172.21.15.152:0/3895362423 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fe7f8106300 con 0x7fe7f8071000 2023-12-06T14:53:05.704 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.321+0000 7fe7eeffd700 1 -- 172.21.15.152:0/3895362423 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fe7f402ee00 con 0x7fe7f8071000 2023-12-06T14:53:05.704 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.322+0000 7fe800613700 1 -- 172.21.15.152:0/3895362423 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7f8071000 msgr2=0x7fe7f8102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:05.704 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.322+0000 7fe800613700 1 --2- 172.21.15.152:0/3895362423 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7f8071000 0x7fe7f8102920 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe7f4006b00 tx=0x7fe7f4009250 comp rx=0 tx=0).stop 2023-12-06T14:53:05.704 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.322+0000 7fe800613700 1 -- 172.21.15.152:0/3895362423 shutdown_connections 2023-12-06T14:53:05.704 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.322+0000 7fe800613700 1 --2- 172.21.15.152:0/3895362423 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7f8071000 0x7fe7f8102920 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:05.704 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.322+0000 7fe800613700 1 -- 172.21.15.152:0/3895362423 >> 172.21.15.152:0/3895362423 conn(0x7fe7f80fc970 msgr2=0x7fe7f80fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:05.704 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.322+0000 7fe800613700 1 -- 172.21.15.152:0/3895362423 shutdown_connections 2023-12-06T14:53:05.704 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:05.322+0000 7fe800613700 1 -- 172.21.15.152:0/3895362423 wait complete. 2023-12-06T14:53:05.704 INFO:teuthology.orchestra.run.smithi152.stdout:Wrote config to /etc/ceph/ceph.conf 2023-12-06T14:53:05.704 INFO:teuthology.orchestra.run.smithi152.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-12-06T14:53:05.704 INFO:teuthology.orchestra.run.smithi152.stdout:Creating mgr... 2023-12-06T14:53:05.704 INFO:teuthology.orchestra.run.smithi152.stdout:Verifying port 9283 ... 2023-12-06T14:53:05.832 INFO:teuthology.orchestra.run.smithi152.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-062f0e3c-9447-11ee-95a2-87774f69a715@mgr.smithi152.meodco 2023-12-06T14:53:05.832 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stderr Failed to reset failed state of unit ceph-062f0e3c-9447-11ee-95a2-87774f69a715@mgr.smithi152.meodco.service: Unit ceph-062f0e3c-9447-11ee-95a2-87774f69a715@mgr.smithi152.meodco.service not loaded. 2023-12-06T14:53:05.925 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-062f0e3c-9447-11ee-95a2-87774f69a715.target.wants/ceph-062f0e3c-9447-11ee-95a2-87774f69a715@mgr.smithi152.meodco.service → /etc/systemd/system/ceph-062f0e3c-9447-11ee-95a2-87774f69a715@.service. 2023-12-06T14:53:06.348 INFO:teuthology.orchestra.run.smithi152.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-06T14:53:06.348 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stdout disabled 2023-12-06T14:53:06.357 INFO:teuthology.orchestra.run.smithi152.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-06T14:53:06.357 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stdout inactive 2023-12-06T14:53:06.357 INFO:teuthology.orchestra.run.smithi152.stdout:firewalld.service is not enabled 2023-12-06T14:53:06.357 INFO:teuthology.orchestra.run.smithi152.stdout:Not possible to enable service . firewalld.service is not available 2023-12-06T14:53:06.365 INFO:teuthology.orchestra.run.smithi152.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-06T14:53:06.365 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stdout disabled 2023-12-06T14:53:06.374 INFO:teuthology.orchestra.run.smithi152.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-06T14:53:06.374 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stdout inactive 2023-12-06T14:53:06.374 INFO:teuthology.orchestra.run.smithi152.stdout:firewalld.service is not enabled 2023-12-06T14:53:06.374 INFO:teuthology.orchestra.run.smithi152.stdout:Not possible to open ports <[9283]>. firewalld.service is not available 2023-12-06T14:53:06.374 INFO:teuthology.orchestra.run.smithi152.stdout:Waiting for mgr to start... 2023-12-06T14:53:06.374 INFO:teuthology.orchestra.run.smithi152.stdout:Waiting for mgr... 2023-12-06T14:53:06.630 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:06 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/3895362423' entity='client.admin' 2023-12-06T14:53:07.186 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout 2023-12-06T14:53:07.186 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout { 2023-12-06T14:53:07.186 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "fsid": "062f0e3c-9447-11ee-95a2-87774f69a715", 2023-12-06T14:53:07.186 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "health": { 2023-12-06T14:53:07.186 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-06T14:53:07.186 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-06T14:53:07.186 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-06T14:53:07.186 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2023-12-06T14:53:07.186 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-06T14:53:07.187 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-06T14:53:07.187 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout 0 2023-12-06T14:53:07.187 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout ], 2023-12-06T14:53:07.187 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-06T14:53:07.187 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "smithi152" 2023-12-06T14:53:07.187 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout ], 2023-12-06T14:53:07.187 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "quorum_age": 1, 2023-12-06T14:53:07.187 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-06T14:53:07.187 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-06T14:53:07.187 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-06T14:53:07.187 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-06T14:53:07.187 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2023-12-06T14:53:07.187 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-06T14:53:07.187 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-06T14:53:07.187 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-06T14:53:07.188 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-06T14:53:07.188 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-06T14:53:07.188 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-06T14:53:07.188 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-06T14:53:07.188 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-06T14:53:07.188 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2023-12-06T14:53:07.188 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-06T14:53:07.188 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-06T14:53:07.188 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-06T14:53:07.188 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-06T14:53:07.188 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-06T14:53:07.188 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-06T14:53:07.188 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-06T14:53:07.188 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-06T14:53:07.188 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-06T14:53:07.189 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2023-12-06T14:53:07.189 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-06T14:53:07.189 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-06T14:53:07.189 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-06T14:53:07.189 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-06T14:53:07.189 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2023-12-06T14:53:07.189 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-06T14:53:07.189 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-06T14:53:07.189 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-06T14:53:07.189 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-06T14:53:07.189 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-06T14:53:07.189 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-06T14:53:07.189 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "restful" 2023-12-06T14:53:07.189 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout ], 2023-12-06T14:53:07.190 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-06T14:53:07.190 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2023-12-06T14:53:07.190 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-06T14:53:07.190 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-06T14:53:07.190 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "modified": "2023-12-06T14:53:01.414383+0000", 2023-12-06T14:53:07.190 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-06T14:53:07.190 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2023-12-06T14:53:07.190 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-06T14:53:07.190 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout } 2023-12-06T14:53:07.190 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.759+0000 7fb108a0d700 1 Processor -- start 2023-12-06T14:53:07.190 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.759+0000 7fb108a0d700 1 -- start start 2023-12-06T14:53:07.190 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.759+0000 7fb108a0d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb104077bb0 0x7fb1040760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:07.191 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.759+0000 7fb108a0d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb104077fc0 con 0x7fb104077bb0 2023-12-06T14:53:07.191 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.760+0000 7fb10259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb104077bb0 0x7fb1040760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:07.191 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.760+0000 7fb10259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb104077bb0 0x7fb1040760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60680/0 (socket says 172.21.15.152:60680) 2023-12-06T14:53:07.191 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.760+0000 7fb10259c700 1 -- 172.21.15.152:0/2748604508 learned_addr learned my addr 172.21.15.152:0/2748604508 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:07.191 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.760+0000 7fb10259c700 1 -- 172.21.15.152:0/2748604508 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb104076600 con 0x7fb104077bb0 2023-12-06T14:53:07.191 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.760+0000 7fb10259c700 1 --2- 172.21.15.152:0/2748604508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb104077bb0 0x7fb1040760c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb0f40098e0 tx=0x7fb0f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c44a29d830dcfa45 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:07.191 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.760+0000 7fb10159a700 1 -- 172.21.15.152:0/2748604508 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb0f400b860 con 0x7fb104077bb0 2023-12-06T14:53:07.191 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.760+0000 7fb10159a700 1 -- 172.21.15.152:0/2748604508 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fb0f400be30 con 0x7fb104077bb0 2023-12-06T14:53:07.191 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.760+0000 7fb10159a700 1 -- 172.21.15.152:0/2748604508 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb0f4010380 con 0x7fb104077bb0 2023-12-06T14:53:07.191 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.761+0000 7fb108a0d700 1 -- 172.21.15.152:0/2748604508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb104077bb0 msgr2=0x7fb1040760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:07.191 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.761+0000 7fb108a0d700 1 --2- 172.21.15.152:0/2748604508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb104077bb0 0x7fb1040760c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb0f40098e0 tx=0x7fb0f4009250 comp rx=0 tx=0).stop 2023-12-06T14:53:07.191 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.761+0000 7fb108a0d700 1 -- 172.21.15.152:0/2748604508 shutdown_connections 2023-12-06T14:53:07.191 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.761+0000 7fb108a0d700 1 --2- 172.21.15.152:0/2748604508 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb104077bb0 0x7fb1040760c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:07.191 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.761+0000 7fb108a0d700 1 -- 172.21.15.152:0/2748604508 >> 172.21.15.152:0/2748604508 conn(0x7fb1040fd9a0 msgr2=0x7fb1040ffdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:07.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.761+0000 7fb108a0d700 1 -- 172.21.15.152:0/2748604508 shutdown_connections 2023-12-06T14:53:07.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.761+0000 7fb108a0d700 1 -- 172.21.15.152:0/2748604508 wait complete. 2023-12-06T14:53:07.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.761+0000 7fb108a0d700 1 Processor -- start 2023-12-06T14:53:07.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.762+0000 7fb108a0d700 1 -- start start 2023-12-06T14:53:07.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.762+0000 7fb108a0d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb104077bb0 0x7fb104113270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:07.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.762+0000 7fb108a0d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1041137b0 con 0x7fb104077bb0 2023-12-06T14:53:07.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.762+0000 7fb10259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb104077bb0 0x7fb104113270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:07.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.762+0000 7fb10259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb104077bb0 0x7fb104113270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60682/0 (socket says 172.21.15.152:60682) 2023-12-06T14:53:07.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.762+0000 7fb10259c700 1 -- 172.21.15.152:0/591817024 learned_addr learned my addr 172.21.15.152:0/591817024 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:07.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.762+0000 7fb10259c700 1 -- 172.21.15.152:0/591817024 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f40094f0 con 0x7fb104077bb0 2023-12-06T14:53:07.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.762+0000 7fb10259c700 1 --2- 172.21.15.152:0/591817024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb104077bb0 0x7fb104113270 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4006d40 tx=0x7fb0f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:07.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.762+0000 7fb0f2ffd700 1 -- 172.21.15.152:0/591817024 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb0f40107a0 con 0x7fb104077bb0 2023-12-06T14:53:07.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.762+0000 7fb0f2ffd700 1 -- 172.21.15.152:0/591817024 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fb0f4010d70 con 0x7fb104077bb0 2023-12-06T14:53:07.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.762+0000 7fb108a0d700 1 -- 172.21.15.152:0/591817024 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1041139b0 con 0x7fb104077bb0 2023-12-06T14:53:07.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.763+0000 7fb0f2ffd700 1 -- 172.21.15.152:0/591817024 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb0f401ad60 con 0x7fb104077bb0 2023-12-06T14:53:07.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.763+0000 7fb108a0d700 1 -- 172.21.15.152:0/591817024 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb104113dc0 con 0x7fb104077bb0 2023-12-06T14:53:07.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.763+0000 7fb0f2ffd700 1 -- 172.21.15.152:0/591817024 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fb0f40228b0 con 0x7fb104077bb0 2023-12-06T14:53:07.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.763+0000 7fb0f2ffd700 1 -- 172.21.15.152:0/591817024 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fb0f401e070 con 0x7fb104077bb0 2023-12-06T14:53:07.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.763+0000 7fb108a0d700 1 -- 172.21.15.152:0/591817024 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb10404bb80 con 0x7fb104077bb0 2023-12-06T14:53:07.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.767+0000 7fb0f2ffd700 1 -- 172.21.15.152:0/591817024 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fb0f402cbf0 con 0x7fb104077bb0 2023-12-06T14:53:07.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.839+0000 7fb108a0d700 1 -- 172.21.15.152:0/591817024 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fb1041084c0 con 0x7fb104077bb0 2023-12-06T14:53:07.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.839+0000 7fb0f2ffd700 1 -- 172.21.15.152:0/591817024 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fb0f402cd90 con 0x7fb104077bb0 2023-12-06T14:53:07.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.840+0000 7fb108a0d700 1 -- 172.21.15.152:0/591817024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb104077bb0 msgr2=0x7fb104113270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:07.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.840+0000 7fb108a0d700 1 --2- 172.21.15.152:0/591817024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb104077bb0 0x7fb104113270 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4006d40 tx=0x7fb0f4009250 comp rx=0 tx=0).stop 2023-12-06T14:53:07.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.840+0000 7fb108a0d700 1 -- 172.21.15.152:0/591817024 shutdown_connections 2023-12-06T14:53:07.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.840+0000 7fb108a0d700 1 --2- 172.21.15.152:0/591817024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb104077bb0 0x7fb104113270 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:07.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.840+0000 7fb108a0d700 1 -- 172.21.15.152:0/591817024 >> 172.21.15.152:0/591817024 conn(0x7fb1040fd9a0 msgr2=0x7fb1040ff0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:07.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.840+0000 7fb108a0d700 1 -- 172.21.15.152:0/591817024 shutdown_connections 2023-12-06T14:53:07.194 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:06.840+0000 7fb108a0d700 1 -- 172.21.15.152:0/591817024 wait complete. 2023-12-06T14:53:07.194 INFO:teuthology.orchestra.run.smithi152.stdout:mgr not available, waiting (1/15)... 2023-12-06T14:53:07.627 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:07 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/591817024' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-06T14:53:09.858 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:09 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/254261209' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-06T14:53:10.036 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout 2023-12-06T14:53:10.036 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout { 2023-12-06T14:53:10.036 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "fsid": "062f0e3c-9447-11ee-95a2-87774f69a715", 2023-12-06T14:53:10.036 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "health": { 2023-12-06T14:53:10.037 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-06T14:53:10.037 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-06T14:53:10.037 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-06T14:53:10.037 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2023-12-06T14:53:10.037 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-06T14:53:10.037 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-06T14:53:10.037 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout 0 2023-12-06T14:53:10.037 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout ], 2023-12-06T14:53:10.037 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-06T14:53:10.037 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "smithi152" 2023-12-06T14:53:10.037 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout ], 2023-12-06T14:53:10.037 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "quorum_age": 4, 2023-12-06T14:53:10.037 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-06T14:53:10.037 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-06T14:53:10.038 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-06T14:53:10.038 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-06T14:53:10.038 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2023-12-06T14:53:10.038 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-06T14:53:10.038 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-06T14:53:10.038 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-06T14:53:10.038 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-06T14:53:10.038 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-06T14:53:10.038 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-06T14:53:10.038 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-06T14:53:10.038 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-06T14:53:10.038 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2023-12-06T14:53:10.038 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-06T14:53:10.038 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-06T14:53:10.038 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-06T14:53:10.039 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-06T14:53:10.039 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-06T14:53:10.039 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-06T14:53:10.039 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-06T14:53:10.039 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-06T14:53:10.039 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-06T14:53:10.039 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2023-12-06T14:53:10.039 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-06T14:53:10.039 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-06T14:53:10.039 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-06T14:53:10.039 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-06T14:53:10.039 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2023-12-06T14:53:10.039 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-06T14:53:10.039 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-06T14:53:10.040 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-06T14:53:10.040 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-06T14:53:10.040 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-06T14:53:10.040 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-06T14:53:10.040 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "restful" 2023-12-06T14:53:10.040 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout ], 2023-12-06T14:53:10.040 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-06T14:53:10.040 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2023-12-06T14:53:10.040 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-06T14:53:10.040 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-06T14:53:10.040 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "modified": "2023-12-06T14:53:01.414383+0000", 2023-12-06T14:53:10.040 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-06T14:53:10.040 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2023-12-06T14:53:10.040 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-06T14:53:10.040 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout } 2023-12-06T14:53:10.041 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.601+0000 7f1be2adc700 1 Processor -- start 2023-12-06T14:53:10.041 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.601+0000 7f1be2adc700 1 -- start start 2023-12-06T14:53:10.041 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.601+0000 7f1be2adc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bdc1028e0 0x7f1bdc102cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:10.041 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.601+0000 7f1be2adc700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bdc103230 con 0x7f1bdc1028e0 2023-12-06T14:53:10.041 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.601+0000 7f1be0878700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bdc1028e0 0x7f1bdc102cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:10.041 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.601+0000 7f1be0878700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bdc1028e0 0x7f1bdc102cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50094/0 (socket says 172.21.15.152:50094) 2023-12-06T14:53:10.041 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.601+0000 7f1be0878700 1 -- 172.21.15.152:0/2125210517 learned_addr learned my addr 172.21.15.152:0/2125210517 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:10.041 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.601+0000 7f1be0878700 1 -- 172.21.15.152:0/2125210517 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bdc103370 con 0x7f1bdc1028e0 2023-12-06T14:53:10.041 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.602+0000 7f1be0878700 1 --2- 172.21.15.152:0/2125210517 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bdc1028e0 0x7f1bdc102cf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1bd00098e0 tx=0x7f1bd0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82fb454271151cf9 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:10.041 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.602+0000 7f1bdb7fe700 1 -- 172.21.15.152:0/2125210517 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1bd000b8f0 con 0x7f1bdc1028e0 2023-12-06T14:53:10.041 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.602+0000 7f1bdb7fe700 1 -- 172.21.15.152:0/2125210517 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f1bd0011420 con 0x7f1bdc1028e0 2023-12-06T14:53:10.041 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.602+0000 7f1bdb7fe700 1 -- 172.21.15.152:0/2125210517 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1bd0010540 con 0x7f1bdc1028e0 2023-12-06T14:53:10.041 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.602+0000 7f1be2adc700 1 -- 172.21.15.152:0/2125210517 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bdc1028e0 msgr2=0x7f1bdc102cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:10.041 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.602+0000 7f1be2adc700 1 --2- 172.21.15.152:0/2125210517 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bdc1028e0 0x7f1bdc102cf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1bd00098e0 tx=0x7f1bd0009250 comp rx=0 tx=0).stop 2023-12-06T14:53:10.041 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.603+0000 7f1be2adc700 1 -- 172.21.15.152:0/2125210517 shutdown_connections 2023-12-06T14:53:10.042 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.603+0000 7f1be2adc700 1 --2- 172.21.15.152:0/2125210517 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bdc1028e0 0x7f1bdc102cf0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:10.042 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.603+0000 7f1be2adc700 1 -- 172.21.15.152:0/2125210517 >> 172.21.15.152:0/2125210517 conn(0x7f1bdc0fc0b0 msgr2=0x7f1bdc0fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:10.042 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.603+0000 7f1be2adc700 1 -- 172.21.15.152:0/2125210517 shutdown_connections 2023-12-06T14:53:10.042 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.603+0000 7f1be2adc700 1 -- 172.21.15.152:0/2125210517 wait complete. 2023-12-06T14:53:10.042 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.603+0000 7f1be2adc700 1 Processor -- start 2023-12-06T14:53:10.042 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.603+0000 7f1be2adc700 1 -- start start 2023-12-06T14:53:10.042 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.603+0000 7f1be2adc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bdc1028e0 0x7f1bdc1133d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:10.042 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.603+0000 7f1be2adc700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bdc113910 con 0x7f1bdc1028e0 2023-12-06T14:53:10.042 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.604+0000 7f1be0878700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bdc1028e0 0x7f1bdc1133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:10.042 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.604+0000 7f1be0878700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bdc1028e0 0x7f1bdc1133d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50108/0 (socket says 172.21.15.152:50108) 2023-12-06T14:53:10.042 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.604+0000 7f1be0878700 1 -- 172.21.15.152:0/254261209 learned_addr learned my addr 172.21.15.152:0/254261209 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:10.042 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.604+0000 7f1be0878700 1 -- 172.21.15.152:0/254261209 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd00094f0 con 0x7f1bdc1028e0 2023-12-06T14:53:10.042 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.604+0000 7f1be0878700 1 --2- 172.21.15.152:0/254261209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bdc1028e0 0x7f1bdc1133d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0011d20 tx=0x7f1bd0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:10.043 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.604+0000 7f1bd97fa700 1 -- 172.21.15.152:0/254261209 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1bd000be80 con 0x7f1bdc1028e0 2023-12-06T14:53:10.043 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.604+0000 7f1bd97fa700 1 -- 172.21.15.152:0/254261209 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f1bd0010e80 con 0x7f1bdc1028e0 2023-12-06T14:53:10.043 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.604+0000 7f1be2adc700 1 -- 172.21.15.152:0/254261209 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bdc113b10 con 0x7f1bdc1028e0 2023-12-06T14:53:10.043 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.604+0000 7f1bd97fa700 1 -- 172.21.15.152:0/254261209 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1bd001ae80 con 0x7f1bdc1028e0 2023-12-06T14:53:10.043 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.604+0000 7f1be2adc700 1 -- 172.21.15.152:0/254261209 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bdc113f20 con 0x7f1bdc1028e0 2023-12-06T14:53:10.043 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.604+0000 7f1bd97fa700 1 -- 172.21.15.152:0/254261209 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f1bd0024790 con 0x7f1bdc1028e0 2023-12-06T14:53:10.043 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.604+0000 7f1bd97fa700 1 -- 172.21.15.152:0/254261209 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f1bd002ebd0 con 0x7f1bdc1028e0 2023-12-06T14:53:10.043 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.605+0000 7f1bc6ffd700 1 -- 172.21.15.152:0/254261209 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bbc0052b0 con 0x7f1bdc1028e0 2023-12-06T14:53:10.043 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.607+0000 7f1bd97fa700 1 -- 172.21.15.152:0/254261209 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f1bd001a430 con 0x7f1bdc1028e0 2023-12-06T14:53:10.043 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.678+0000 7f1bc6ffd700 1 -- 172.21.15.152:0/254261209 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f1bbc005830 con 0x7f1bdc1028e0 2023-12-06T14:53:10.043 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.679+0000 7f1bd97fa700 1 -- 172.21.15.152:0/254261209 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f1bd001a630 con 0x7f1bdc1028e0 2023-12-06T14:53:10.044 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.680+0000 7f1bc6ffd700 1 -- 172.21.15.152:0/254261209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bdc1028e0 msgr2=0x7f1bdc1133d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:10.044 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.680+0000 7f1bc6ffd700 1 --2- 172.21.15.152:0/254261209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bdc1028e0 0x7f1bdc1133d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0011d20 tx=0x7f1bd0009250 comp rx=0 tx=0).stop 2023-12-06T14:53:10.044 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.680+0000 7f1bc6ffd700 1 -- 172.21.15.152:0/254261209 shutdown_connections 2023-12-06T14:53:10.044 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.680+0000 7f1bc6ffd700 1 --2- 172.21.15.152:0/254261209 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bdc1028e0 0x7f1bdc1133d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:10.044 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.680+0000 7f1bc6ffd700 1 -- 172.21.15.152:0/254261209 >> 172.21.15.152:0/254261209 conn(0x7f1bdc0fc0b0 msgr2=0x7f1bdc0fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:10.044 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.680+0000 7f1bc6ffd700 1 -- 172.21.15.152:0/254261209 shutdown_connections 2023-12-06T14:53:10.044 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:09.680+0000 7f1bc6ffd700 1 -- 172.21.15.152:0/254261209 wait complete. 2023-12-06T14:53:10.044 INFO:teuthology.orchestra.run.smithi152.stdout:mgr not available, waiting (2/15)... 2023-12-06T14:53:12.817 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:12 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/1990275511' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-06T14:53:12.892 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout 2023-12-06T14:53:12.902 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout { 2023-12-06T14:53:12.902 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "fsid": "062f0e3c-9447-11ee-95a2-87774f69a715", 2023-12-06T14:53:12.902 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "health": { 2023-12-06T14:53:12.903 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-06T14:53:12.903 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-06T14:53:12.903 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-06T14:53:12.903 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2023-12-06T14:53:12.903 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-06T14:53:12.903 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-06T14:53:12.903 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout 0 2023-12-06T14:53:12.903 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout ], 2023-12-06T14:53:12.903 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-06T14:53:12.903 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "smithi152" 2023-12-06T14:53:12.903 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout ], 2023-12-06T14:53:12.903 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2023-12-06T14:53:12.903 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-06T14:53:12.903 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-06T14:53:12.903 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-06T14:53:12.904 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-06T14:53:12.904 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2023-12-06T14:53:12.904 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-06T14:53:12.904 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-06T14:53:12.904 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-06T14:53:12.904 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-06T14:53:12.904 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-06T14:53:12.904 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-06T14:53:12.904 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-06T14:53:12.904 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-06T14:53:12.904 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2023-12-06T14:53:12.904 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-06T14:53:12.904 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-06T14:53:12.904 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-06T14:53:12.904 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-06T14:53:12.904 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-06T14:53:12.905 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-06T14:53:12.905 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-06T14:53:12.905 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-06T14:53:12.905 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-06T14:53:12.905 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2023-12-06T14:53:12.905 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-06T14:53:12.905 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-06T14:53:12.905 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-06T14:53:12.905 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-06T14:53:12.905 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2023-12-06T14:53:12.905 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-06T14:53:12.905 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-06T14:53:12.905 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-06T14:53:12.905 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-06T14:53:12.905 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-06T14:53:12.906 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-06T14:53:12.906 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "restful" 2023-12-06T14:53:12.906 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout ], 2023-12-06T14:53:12.906 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-06T14:53:12.906 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2023-12-06T14:53:12.906 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-06T14:53:12.906 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-06T14:53:12.906 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "modified": "2023-12-06T14:53:01.414383+0000", 2023-12-06T14:53:12.906 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-06T14:53:12.906 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2023-12-06T14:53:12.906 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-06T14:53:12.906 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout } 2023-12-06T14:53:12.906 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.482+0000 7f52b0333700 1 Processor -- start 2023-12-06T14:53:12.906 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.482+0000 7f52b0333700 1 -- start start 2023-12-06T14:53:12.907 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.482+0000 7f52b0333700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52a8070fa0 0x7f52a8104f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:12.907 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.482+0000 7f52b0333700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a8105440 con 0x7f52a8070fa0 2023-12-06T14:53:12.907 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.483+0000 7f52ae0cf700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52a8070fa0 0x7f52a8104f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:12.907 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.483+0000 7f52ae0cf700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52a8070fa0 0x7f52a8104f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50122/0 (socket says 172.21.15.152:50122) 2023-12-06T14:53:12.907 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.483+0000 7f52ae0cf700 1 -- 172.21.15.152:0/2477948037 learned_addr learned my addr 172.21.15.152:0/2477948037 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:12.907 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.483+0000 7f52ae0cf700 1 -- 172.21.15.152:0/2477948037 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a8105580 con 0x7f52a8070fa0 2023-12-06T14:53:12.907 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.483+0000 7f52ae0cf700 1 --2- 172.21.15.152:0/2477948037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52a8070fa0 0x7f52a8104f00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f52a40098e0 tx=0x7f52a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=642de53cf19429a3 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:12.907 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.483+0000 7f52ad0cd700 1 -- 172.21.15.152:0/2477948037 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f52a400b860 con 0x7f52a8070fa0 2023-12-06T14:53:12.907 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.483+0000 7f52ad0cd700 1 -- 172.21.15.152:0/2477948037 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f52a400be30 con 0x7f52a8070fa0 2023-12-06T14:53:12.907 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.483+0000 7f52ad0cd700 1 -- 172.21.15.152:0/2477948037 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f52a4010380 con 0x7f52a8070fa0 2023-12-06T14:53:12.907 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.484+0000 7f52b0333700 1 -- 172.21.15.152:0/2477948037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52a8070fa0 msgr2=0x7f52a8104f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:12.907 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.484+0000 7f52b0333700 1 --2- 172.21.15.152:0/2477948037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52a8070fa0 0x7f52a8104f00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f52a40098e0 tx=0x7f52a4009250 comp rx=0 tx=0).stop 2023-12-06T14:53:12.907 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.484+0000 7f52b0333700 1 -- 172.21.15.152:0/2477948037 shutdown_connections 2023-12-06T14:53:12.907 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.484+0000 7f52b0333700 1 --2- 172.21.15.152:0/2477948037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52a8070fa0 0x7f52a8104f00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:12.907 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.484+0000 7f52b0333700 1 -- 172.21.15.152:0/2477948037 >> 172.21.15.152:0/2477948037 conn(0x7f52a80fc970 msgr2=0x7f52a80fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:12.908 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.484+0000 7f52b0333700 1 -- 172.21.15.152:0/2477948037 shutdown_connections 2023-12-06T14:53:12.908 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.484+0000 7f52b0333700 1 -- 172.21.15.152:0/2477948037 wait complete. 2023-12-06T14:53:12.908 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.485+0000 7f52b0333700 1 Processor -- start 2023-12-06T14:53:12.908 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.485+0000 7f52b0333700 1 -- start start 2023-12-06T14:53:12.908 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.485+0000 7f52b0333700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52a8070fa0 0x7f52a81111a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:12.908 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.485+0000 7f52b0333700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a81116e0 con 0x7f52a8070fa0 2023-12-06T14:53:12.908 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.485+0000 7f52ae0cf700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52a8070fa0 0x7f52a81111a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:12.908 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.485+0000 7f52ae0cf700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52a8070fa0 0x7f52a81111a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50138/0 (socket says 172.21.15.152:50138) 2023-12-06T14:53:12.908 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.485+0000 7f52ae0cf700 1 -- 172.21.15.152:0/1990275511 learned_addr learned my addr 172.21.15.152:0/1990275511 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:12.908 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.486+0000 7f52ae0cf700 1 -- 172.21.15.152:0/1990275511 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a40094f0 con 0x7f52a8070fa0 2023-12-06T14:53:12.908 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.486+0000 7f52ae0cf700 1 --2- 172.21.15.152:0/1990275511 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52a8070fa0 0x7f52a81111a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f52a4006b00 tx=0x7f52a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:12.908 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.486+0000 7f529effd700 1 -- 172.21.15.152:0/1990275511 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f52a4010a80 con 0x7f52a8070fa0 2023-12-06T14:53:12.908 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.486+0000 7f529effd700 1 -- 172.21.15.152:0/1990275511 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f52a401a430 con 0x7f52a8070fa0 2023-12-06T14:53:12.908 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.486+0000 7f52b0333700 1 -- 172.21.15.152:0/1990275511 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52a81118e0 con 0x7f52a8070fa0 2023-12-06T14:53:12.909 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.486+0000 7f529effd700 1 -- 172.21.15.152:0/1990275511 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f52a40245b0 con 0x7f52a8070fa0 2023-12-06T14:53:12.909 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.486+0000 7f52b0333700 1 -- 172.21.15.152:0/1990275511 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52a8111cf0 con 0x7f52a8070fa0 2023-12-06T14:53:12.909 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.486+0000 7f529effd700 1 -- 172.21.15.152:0/1990275511 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f52a4024ab0 con 0x7f52a8070fa0 2023-12-06T14:53:12.909 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.486+0000 7f529effd700 1 -- 172.21.15.152:0/1990275511 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f52a402eb00 con 0x7f52a8070fa0 2023-12-06T14:53:12.909 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.487+0000 7f52b0333700 1 -- 172.21.15.152:0/1990275511 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52a804bb80 con 0x7f52a8070fa0 2023-12-06T14:53:12.909 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.489+0000 7f529effd700 1 -- 172.21.15.152:0/1990275511 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f52a402ed60 con 0x7f52a8070fa0 2023-12-06T14:53:12.909 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.561+0000 7f52b0333700 1 -- 172.21.15.152:0/1990275511 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f52a810ab60 con 0x7f52a8070fa0 2023-12-06T14:53:12.909 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.562+0000 7f529effd700 1 -- 172.21.15.152:0/1990275511 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f52a4010be0 con 0x7f52a8070fa0 2023-12-06T14:53:12.909 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.563+0000 7f52b0333700 1 -- 172.21.15.152:0/1990275511 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52a8070fa0 msgr2=0x7f52a81111a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:12.909 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.563+0000 7f52b0333700 1 --2- 172.21.15.152:0/1990275511 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52a8070fa0 0x7f52a81111a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f52a4006b00 tx=0x7f52a4009250 comp rx=0 tx=0).stop 2023-12-06T14:53:12.909 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.563+0000 7f52b0333700 1 -- 172.21.15.152:0/1990275511 shutdown_connections 2023-12-06T14:53:12.909 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.563+0000 7f52b0333700 1 --2- 172.21.15.152:0/1990275511 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52a8070fa0 0x7f52a81111a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:12.909 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.563+0000 7f52b0333700 1 -- 172.21.15.152:0/1990275511 >> 172.21.15.152:0/1990275511 conn(0x7f52a80fc970 msgr2=0x7f52a80fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:12.909 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.563+0000 7f52b0333700 1 -- 172.21.15.152:0/1990275511 shutdown_connections 2023-12-06T14:53:12.909 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:12.563+0000 7f52b0333700 1 -- 172.21.15.152:0/1990275511 wait complete. 2023-12-06T14:53:12.910 INFO:teuthology.orchestra.run.smithi152.stdout:mgr not available, waiting (3/15)... 2023-12-06T14:53:13.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:13 smithi152 ceph-mon[111954]: Activating manager daemon smithi152.meodco 2023-12-06T14:53:13.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:13 smithi152 ceph-mon[111954]: mgrmap e2: smithi152.meodco(active, starting, since 0.00293683s) 2023-12-06T14:53:13.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:13 smithi152 ceph-mon[111954]: from='mgr.14100 172.21.15.152:0/3675249991' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-06T14:53:13.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:13 smithi152 ceph-mon[111954]: from='mgr.14100 172.21.15.152:0/3675249991' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-06T14:53:13.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:13 smithi152 ceph-mon[111954]: from='mgr.14100 172.21.15.152:0/3675249991' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-06T14:53:13.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:13 smithi152 ceph-mon[111954]: from='mgr.14100 172.21.15.152:0/3675249991' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-06T14:53:13.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:13 smithi152 ceph-mon[111954]: from='mgr.14100 172.21.15.152:0/3675249991' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mgr metadata", "who": "smithi152.meodco", "id": "smithi152.meodco"}]: dispatch 2023-12-06T14:53:13.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:13 smithi152 ceph-mon[111954]: Manager daemon smithi152.meodco is now available 2023-12-06T14:53:13.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:13 smithi152 ceph-mon[111954]: from='mgr.14100 172.21.15.152:0/3675249991' entity='mgr.smithi152.meodco' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.meodco/mirror_snapshot_schedule"}]: dispatch 2023-12-06T14:53:13.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:13 smithi152 ceph-mon[111954]: from='mgr.14100 172.21.15.152:0/3675249991' entity='mgr.smithi152.meodco' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.meodco/trash_purge_schedule"}]: dispatch 2023-12-06T14:53:13.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:13 smithi152 ceph-mon[111954]: from='mgr.14100 172.21.15.152:0/3675249991' entity='mgr.smithi152.meodco' 2023-12-06T14:53:13.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:13 smithi152 ceph-mon[111954]: from='mgr.14100 172.21.15.152:0/3675249991' entity='mgr.smithi152.meodco' 2023-12-06T14:53:13.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:13 smithi152 ceph-mon[111954]: from='mgr.14100 172.21.15.152:0/3675249991' entity='mgr.smithi152.meodco' 2023-12-06T14:53:15.095 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:14 smithi152 ceph-mon[111954]: mgrmap e3: smithi152.meodco(active, since 1.00919s) 2023-12-06T14:53:15.930 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout 2023-12-06T14:53:15.930 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout { 2023-12-06T14:53:15.930 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "fsid": "062f0e3c-9447-11ee-95a2-87774f69a715", 2023-12-06T14:53:15.931 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "health": { 2023-12-06T14:53:15.931 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-06T14:53:15.931 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-06T14:53:15.931 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-06T14:53:15.931 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2023-12-06T14:53:15.931 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-06T14:53:15.931 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-06T14:53:15.931 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout 0 2023-12-06T14:53:15.931 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout ], 2023-12-06T14:53:15.931 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-06T14:53:15.932 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "smithi152" 2023-12-06T14:53:15.932 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout ], 2023-12-06T14:53:15.932 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2023-12-06T14:53:15.932 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-06T14:53:15.932 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-06T14:53:15.932 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2023-12-06T14:53:15.932 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-06T14:53:15.932 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2023-12-06T14:53:15.932 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-06T14:53:15.932 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-06T14:53:15.933 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-06T14:53:15.933 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-06T14:53:15.933 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-06T14:53:15.933 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-06T14:53:15.933 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-06T14:53:15.933 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-06T14:53:15.933 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2023-12-06T14:53:15.933 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-06T14:53:15.933 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-06T14:53:15.933 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-06T14:53:15.933 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-06T14:53:15.933 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-06T14:53:15.934 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-06T14:53:15.934 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-06T14:53:15.934 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-06T14:53:15.934 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-06T14:53:15.934 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2023-12-06T14:53:15.934 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-06T14:53:15.934 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-06T14:53:15.934 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-06T14:53:15.934 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-06T14:53:15.934 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2023-12-06T14:53:15.934 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-06T14:53:15.934 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-06T14:53:15.934 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-06T14:53:15.935 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-06T14:53:15.935 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-06T14:53:15.935 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-06T14:53:15.935 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "restful" 2023-12-06T14:53:15.935 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout ], 2023-12-06T14:53:15.935 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-06T14:53:15.935 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2023-12-06T14:53:15.936 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-06T14:53:15.936 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-06T14:53:15.936 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "modified": "2023-12-06T14:53:01.414383+0000", 2023-12-06T14:53:15.936 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-06T14:53:15.936 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout }, 2023-12-06T14:53:15.936 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-06T14:53:15.936 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout } 2023-12-06T14:53:15.936 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.287+0000 7fe99393f700 1 Processor -- start 2023-12-06T14:53:15.936 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.287+0000 7fe99393f700 1 -- start start 2023-12-06T14:53:15.937 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.287+0000 7fe99393f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe98c071000 0x7fe98c104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:15.937 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.287+0000 7fe99393f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c1053e0 con 0x7fe98c071000 2023-12-06T14:53:15.937 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.287+0000 7fe9916db700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe98c071000 0x7fe98c104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:15.937 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.287+0000 7fe9916db700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe98c071000 0x7fe98c104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50206/0 (socket says 172.21.15.152:50206) 2023-12-06T14:53:15.937 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.287+0000 7fe9916db700 1 -- 172.21.15.152:0/3157327513 learned_addr learned my addr 172.21.15.152:0/3157327513 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:15.937 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.288+0000 7fe9916db700 1 -- 172.21.15.152:0/3157327513 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98c105520 con 0x7fe98c071000 2023-12-06T14:53:15.937 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.288+0000 7fe9916db700 1 --2- 172.21.15.152:0/3157327513 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe98c071000 0x7fe98c104ea0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe9880098e0 tx=0x7fe988009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11494fb282f9b47b server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:15.937 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.288+0000 7fe983fff700 1 -- 172.21.15.152:0/3157327513 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe98800b860 con 0x7fe98c071000 2023-12-06T14:53:15.938 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.288+0000 7fe983fff700 1 -- 172.21.15.152:0/3157327513 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fe98800be30 con 0x7fe98c071000 2023-12-06T14:53:15.938 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.288+0000 7fe983fff700 1 -- 172.21.15.152:0/3157327513 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe988010380 con 0x7fe98c071000 2023-12-06T14:53:15.938 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.288+0000 7fe99393f700 1 -- 172.21.15.152:0/3157327513 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe98c071000 msgr2=0x7fe98c104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:15.938 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.288+0000 7fe99393f700 1 --2- 172.21.15.152:0/3157327513 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe98c071000 0x7fe98c104ea0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe9880098e0 tx=0x7fe988009250 comp rx=0 tx=0).stop 2023-12-06T14:53:15.938 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.288+0000 7fe99393f700 1 -- 172.21.15.152:0/3157327513 shutdown_connections 2023-12-06T14:53:15.938 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.288+0000 7fe99393f700 1 --2- 172.21.15.152:0/3157327513 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe98c071000 0x7fe98c104ea0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:15.938 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.288+0000 7fe99393f700 1 -- 172.21.15.152:0/3157327513 >> 172.21.15.152:0/3157327513 conn(0x7fe98c0fc970 msgr2=0x7fe98c0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:15.939 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.288+0000 7fe99393f700 1 -- 172.21.15.152:0/3157327513 shutdown_connections 2023-12-06T14:53:15.939 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.289+0000 7fe99393f700 1 -- 172.21.15.152:0/3157327513 wait complete. 2023-12-06T14:53:15.939 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.289+0000 7fe99393f700 1 Processor -- start 2023-12-06T14:53:15.939 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.289+0000 7fe99393f700 1 -- start start 2023-12-06T14:53:15.939 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.289+0000 7fe99393f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe98c071000 0x7fe98c111160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:15.939 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.289+0000 7fe99393f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c1116a0 con 0x7fe98c071000 2023-12-06T14:53:15.939 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.289+0000 7fe9916db700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe98c071000 0x7fe98c111160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:15.940 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.289+0000 7fe9916db700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe98c071000 0x7fe98c111160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50208/0 (socket says 172.21.15.152:50208) 2023-12-06T14:53:15.940 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.289+0000 7fe9916db700 1 -- 172.21.15.152:0/958573804 learned_addr learned my addr 172.21.15.152:0/958573804 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:15.940 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.289+0000 7fe9916db700 1 -- 172.21.15.152:0/958573804 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9880094f0 con 0x7fe98c071000 2023-12-06T14:53:15.940 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.290+0000 7fe9916db700 1 --2- 172.21.15.152:0/958573804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe98c071000 0x7fe98c111160 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe988006d40 tx=0x7fe988009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:15.940 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.290+0000 7fe981ffb700 1 -- 172.21.15.152:0/958573804 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe9880109b0 con 0x7fe98c071000 2023-12-06T14:53:15.940 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.290+0000 7fe981ffb700 1 -- 172.21.15.152:0/958573804 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fe988024440 con 0x7fe98c071000 2023-12-06T14:53:15.940 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.290+0000 7fe99393f700 1 -- 172.21.15.152:0/958573804 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe98c1118a0 con 0x7fe98c071000 2023-12-06T14:53:15.941 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.290+0000 7fe981ffb700 1 -- 172.21.15.152:0/958573804 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe98801a5f0 con 0x7fe98c071000 2023-12-06T14:53:15.941 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.290+0000 7fe99393f700 1 -- 172.21.15.152:0/958573804 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe98c111cb0 con 0x7fe98c071000 2023-12-06T14:53:15.941 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.291+0000 7fe981ffb700 1 -- 172.21.15.152:0/958573804 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 3) v1 ==== 43164+0+0 (secure 0 0 0) 0x7fe98801a820 con 0x7fe98c071000 2023-12-06T14:53:15.941 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.291+0000 7fe981ffb700 1 --2- 172.21.15.152:0/958573804 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7fe9780364c0 0x7fe978038970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:15.941 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.291+0000 7fe981ffb700 1 -- 172.21.15.152:0/958573804 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe98804a2b0 con 0x7fe98c071000 2023-12-06T14:53:15.941 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.291+0000 7fe990eda700 1 --2- 172.21.15.152:0/958573804 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7fe9780364c0 0x7fe978038970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:15.941 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.291+0000 7fe99393f700 1 -- 172.21.15.152:0/958573804 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe98c04bb80 con 0x7fe98c071000 2023-12-06T14:53:15.942 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.291+0000 7fe990eda700 1 --2- 172.21.15.152:0/958573804 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7fe9780364c0 0x7fe978038970 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe97c009990 tx=0x7fe97c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:15.942 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.297+0000 7fe981ffb700 1 -- 172.21.15.152:0/958573804 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe988022340 con 0x7fe98c071000 2023-12-06T14:53:15.942 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.551+0000 7fe99393f700 1 -- 172.21.15.152:0/958573804 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fe98c10ac00 con 0x7fe98c071000 2023-12-06T14:53:15.942 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.551+0000 7fe981ffb700 1 -- 172.21.15.152:0/958573804 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fe988018b40 con 0x7fe98c071000 2023-12-06T14:53:15.942 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.553+0000 7fe99393f700 1 -- 172.21.15.152:0/958573804 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7fe9780364c0 msgr2=0x7fe978038970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:15.942 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.553+0000 7fe99393f700 1 --2- 172.21.15.152:0/958573804 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7fe9780364c0 0x7fe978038970 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe97c009990 tx=0x7fe97c006e40 comp rx=0 tx=0).stop 2023-12-06T14:53:15.942 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.553+0000 7fe99393f700 1 -- 172.21.15.152:0/958573804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe98c071000 msgr2=0x7fe98c111160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:15.942 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.553+0000 7fe99393f700 1 --2- 172.21.15.152:0/958573804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe98c071000 0x7fe98c111160 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe988006d40 tx=0x7fe988009250 comp rx=0 tx=0).stop 2023-12-06T14:53:15.943 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.553+0000 7fe99393f700 1 -- 172.21.15.152:0/958573804 shutdown_connections 2023-12-06T14:53:15.943 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.553+0000 7fe99393f700 1 --2- 172.21.15.152:0/958573804 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7fe9780364c0 0x7fe978038970 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:15.943 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.553+0000 7fe99393f700 1 --2- 172.21.15.152:0/958573804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe98c071000 0x7fe98c111160 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:15.943 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.553+0000 7fe99393f700 1 -- 172.21.15.152:0/958573804 >> 172.21.15.152:0/958573804 conn(0x7fe98c0fc970 msgr2=0x7fe98c0fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:15.943 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.553+0000 7fe99393f700 1 -- 172.21.15.152:0/958573804 shutdown_connections 2023-12-06T14:53:15.943 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:15.553+0000 7fe99393f700 1 -- 172.21.15.152:0/958573804 wait complete. 2023-12-06T14:53:15.943 INFO:teuthology.orchestra.run.smithi152.stdout:mgr is available 2023-12-06T14:53:16.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:15 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/958573804' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-06T14:53:16.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:15 smithi152 ceph-mon[111954]: mgrmap e4: smithi152.meodco(active, since 3s) 2023-12-06T14:53:16.789 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout 2023-12-06T14:53:16.790 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout [global] 2023-12-06T14:53:16.790 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout fsid = 062f0e3c-9447-11ee-95a2-87774f69a715 2023-12-06T14:53:16.790 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-06T14:53:16.790 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-06T14:53:16.790 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-06T14:53:16.790 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-06T14:53:16.790 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout 2023-12-06T14:53:16.790 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-06T14:53:16.790 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-06T14:53:16.790 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout 2023-12-06T14:53:16.790 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout [osd] 2023-12-06T14:53:16.790 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-12-06T14:53:16.790 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-12-06T14:53:16.791 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-12-06T14:53:16.791 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-06T14:53:16.791 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-06T14:53:16.791 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.248+0000 7f3f427b5700 1 Processor -- start 2023-12-06T14:53:16.791 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.248+0000 7f3f427b5700 1 -- start start 2023-12-06T14:53:16.791 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.248+0000 7f3f427b5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f3c070f20 0x7f3f3c104f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:16.791 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.248+0000 7f3f427b5700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c1054c0 con 0x7f3f3c070f20 2023-12-06T14:53:16.791 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.248+0000 7f3f3bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f3c070f20 0x7f3f3c104f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:16.791 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.248+0000 7f3f3bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f3c070f20 0x7f3f3c104f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50218/0 (socket says 172.21.15.152:50218) 2023-12-06T14:53:16.791 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.248+0000 7f3f3bfff700 1 -- 172.21.15.152:0/2687770180 learned_addr learned my addr 172.21.15.152:0/2687770180 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:16.791 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.248+0000 7f3f3bfff700 1 -- 172.21.15.152:0/2687770180 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f3c105600 con 0x7f3f3c070f20 2023-12-06T14:53:16.791 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.248+0000 7f3f3bfff700 1 --2- 172.21.15.152:0/2687770180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f3c070f20 0x7f3f3c104f80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c0098e0 tx=0x7f3f2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44bc936e5df534e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:16.791 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.249+0000 7f3f3affd700 1 -- 172.21.15.152:0/2687770180 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f2c00b860 con 0x7f3f3c070f20 2023-12-06T14:53:16.791 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.249+0000 7f3f3affd700 1 -- 172.21.15.152:0/2687770180 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f3f2c00be30 con 0x7f3f3c070f20 2023-12-06T14:53:16.791 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.249+0000 7f3f3affd700 1 -- 172.21.15.152:0/2687770180 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f2c010380 con 0x7f3f3c070f20 2023-12-06T14:53:16.792 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.249+0000 7f3f427b5700 1 -- 172.21.15.152:0/2687770180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f3c070f20 msgr2=0x7f3f3c104f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:16.792 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.249+0000 7f3f427b5700 1 --2- 172.21.15.152:0/2687770180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f3c070f20 0x7f3f3c104f80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c0098e0 tx=0x7f3f2c009250 comp rx=0 tx=0).stop 2023-12-06T14:53:16.792 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.249+0000 7f3f427b5700 1 -- 172.21.15.152:0/2687770180 shutdown_connections 2023-12-06T14:53:16.792 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.249+0000 7f3f427b5700 1 --2- 172.21.15.152:0/2687770180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f3c070f20 0x7f3f3c104f80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:16.792 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.249+0000 7f3f427b5700 1 -- 172.21.15.152:0/2687770180 >> 172.21.15.152:0/2687770180 conn(0x7f3f3c0fc970 msgr2=0x7f3f3c0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:16.792 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.249+0000 7f3f427b5700 1 -- 172.21.15.152:0/2687770180 shutdown_connections 2023-12-06T14:53:16.792 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.249+0000 7f3f427b5700 1 -- 172.21.15.152:0/2687770180 wait complete. 2023-12-06T14:53:16.792 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.250+0000 7f3f427b5700 1 Processor -- start 2023-12-06T14:53:16.792 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.250+0000 7f3f427b5700 1 -- start start 2023-12-06T14:53:16.792 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.250+0000 7f3f427b5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f3c070f20 0x7f3f3c111160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:16.792 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.250+0000 7f3f427b5700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c1116a0 con 0x7f3f3c070f20 2023-12-06T14:53:16.792 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.250+0000 7f3f3bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f3c070f20 0x7f3f3c111160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:16.792 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.250+0000 7f3f3bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f3c070f20 0x7f3f3c111160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50226/0 (socket says 172.21.15.152:50226) 2023-12-06T14:53:16.792 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.250+0000 7f3f3bfff700 1 -- 172.21.15.152:0/1097412728 learned_addr learned my addr 172.21.15.152:0/1097412728 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:16.792 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.251+0000 7f3f3bfff700 1 -- 172.21.15.152:0/1097412728 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f2c0094f0 con 0x7f3f3c070f20 2023-12-06T14:53:16.793 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.251+0000 7f3f3bfff700 1 --2- 172.21.15.152:0/1097412728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f3c070f20 0x7f3f3c111160 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c006d40 tx=0x7f3f2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:16.793 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.251+0000 7f3f38ff9700 1 -- 172.21.15.152:0/1097412728 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f2c0109b0 con 0x7f3f3c070f20 2023-12-06T14:53:16.793 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.251+0000 7f3f38ff9700 1 -- 172.21.15.152:0/1097412728 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f3f2c024440 con 0x7f3f3c070f20 2023-12-06T14:53:16.793 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.251+0000 7f3f427b5700 1 -- 172.21.15.152:0/1097412728 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f3c1118a0 con 0x7f3f3c070f20 2023-12-06T14:53:16.793 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.251+0000 7f3f38ff9700 1 -- 172.21.15.152:0/1097412728 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f2c01a5f0 con 0x7f3f3c070f20 2023-12-06T14:53:16.793 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.251+0000 7f3f427b5700 1 -- 172.21.15.152:0/1097412728 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f3c111cb0 con 0x7f3f3c070f20 2023-12-06T14:53:16.793 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.252+0000 7f3f38ff9700 1 -- 172.21.15.152:0/1097412728 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 4) v1 ==== 43270+0+0 (secure 0 0 0) 0x7f3f2c01a820 con 0x7f3f3c070f20 2023-12-06T14:53:16.793 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.252+0000 7f3f38ff9700 1 --2- 172.21.15.152:0/1097412728 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7f3f240365f0 0x7f3f24038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:16.793 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.252+0000 7f3f38ff9700 1 -- 172.21.15.152:0/1097412728 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f3f2c04a3b0 con 0x7f3f3c070f20 2023-12-06T14:53:16.793 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.252+0000 7f3f3b7fe700 1 --2- 172.21.15.152:0/1097412728 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7f3f240365f0 0x7f3f24038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:16.793 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.252+0000 7f3f427b5700 1 -- 172.21.15.152:0/1097412728 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f3c04bb80 con 0x7f3f3c070f20 2023-12-06T14:53:16.793 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.252+0000 7f3f3b7fe700 1 --2- 172.21.15.152:0/1097412728 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7f3f240365f0 0x7f3f24038aa0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3f30009990 tx=0x7f3f30006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:16.793 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.257+0000 7f3f38ff9700 1 -- 172.21.15.152:0/1097412728 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3f2c01aad0 con 0x7f3f3c070f20 2023-12-06T14:53:16.793 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.437+0000 7f3f427b5700 1 -- 172.21.15.152:0/1097412728 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f3f3c106320 con 0x7f3f3c070f20 2023-12-06T14:53:16.793 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.438+0000 7f3f38ff9700 1 -- 172.21.15.152:0/1097412728 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f3f2c048020 con 0x7f3f3c070f20 2023-12-06T14:53:16.794 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.440+0000 7f3f427b5700 1 -- 172.21.15.152:0/1097412728 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7f3f240365f0 msgr2=0x7f3f24038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:16.794 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.440+0000 7f3f427b5700 1 --2- 172.21.15.152:0/1097412728 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7f3f240365f0 0x7f3f24038aa0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3f30009990 tx=0x7f3f30006e40 comp rx=0 tx=0).stop 2023-12-06T14:53:16.794 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.440+0000 7f3f427b5700 1 -- 172.21.15.152:0/1097412728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f3c070f20 msgr2=0x7f3f3c111160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:16.794 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.440+0000 7f3f427b5700 1 --2- 172.21.15.152:0/1097412728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f3c070f20 0x7f3f3c111160 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c006d40 tx=0x7f3f2c009250 comp rx=0 tx=0).stop 2023-12-06T14:53:16.794 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.440+0000 7f3f427b5700 1 -- 172.21.15.152:0/1097412728 shutdown_connections 2023-12-06T14:53:16.794 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.440+0000 7f3f427b5700 1 --2- 172.21.15.152:0/1097412728 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7f3f240365f0 0x7f3f24038aa0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:16.794 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.440+0000 7f3f427b5700 1 --2- 172.21.15.152:0/1097412728 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f3c070f20 0x7f3f3c111160 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:16.794 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.440+0000 7f3f427b5700 1 -- 172.21.15.152:0/1097412728 >> 172.21.15.152:0/1097412728 conn(0x7f3f3c0fc970 msgr2=0x7f3f3c0fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:16.794 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.440+0000 7f3f427b5700 1 -- 172.21.15.152:0/1097412728 shutdown_connections 2023-12-06T14:53:16.794 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:16.440+0000 7f3f427b5700 1 -- 172.21.15.152:0/1097412728 wait complete. 2023-12-06T14:53:16.794 INFO:teuthology.orchestra.run.smithi152.stdout:Enabling cephadm module... 2023-12-06T14:53:17.127 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:16 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/1097412728' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-12-06T14:53:18.212 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:17 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/3797950186' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-12-06T14:53:18.271 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.138+0000 7fec955d6700 1 Processor -- start 2023-12-06T14:53:18.272 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.138+0000 7fec955d6700 1 -- start start 2023-12-06T14:53:18.272 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.138+0000 7fec955d6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec901038f0 0x7fec90103d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:18.272 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.138+0000 7fec955d6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec90104240 con 0x7fec901038f0 2023-12-06T14:53:18.272 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.138+0000 7fec8effd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec901038f0 0x7fec90103d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:18.272 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.138+0000 7fec8effd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec901038f0 0x7fec90103d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50242/0 (socket says 172.21.15.152:50242) 2023-12-06T14:53:18.272 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.138+0000 7fec8effd700 1 -- 172.21.15.152:0/997992783 learned_addr learned my addr 172.21.15.152:0/997992783 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:18.272 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.138+0000 7fec8effd700 1 -- 172.21.15.152:0/997992783 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec90104380 con 0x7fec901038f0 2023-12-06T14:53:18.272 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.139+0000 7fec8effd700 1 --2- 172.21.15.152:0/997992783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec901038f0 0x7fec90103d00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fec800098e0 tx=0x7fec80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b0a9ae01e8d303 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:18.272 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.139+0000 7fec8dffb700 1 -- 172.21.15.152:0/997992783 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec8000b860 con 0x7fec901038f0 2023-12-06T14:53:18.272 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.139+0000 7fec8dffb700 1 -- 172.21.15.152:0/997992783 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fec8000be30 con 0x7fec901038f0 2023-12-06T14:53:18.272 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.139+0000 7fec8dffb700 1 -- 172.21.15.152:0/997992783 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec80010380 con 0x7fec901038f0 2023-12-06T14:53:18.272 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.139+0000 7fec955d6700 1 -- 172.21.15.152:0/997992783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec901038f0 msgr2=0x7fec90103d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:18.272 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.139+0000 7fec955d6700 1 --2- 172.21.15.152:0/997992783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec901038f0 0x7fec90103d00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fec800098e0 tx=0x7fec80009250 comp rx=0 tx=0).stop 2023-12-06T14:53:18.272 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.139+0000 7fec955d6700 1 -- 172.21.15.152:0/997992783 shutdown_connections 2023-12-06T14:53:18.273 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.139+0000 7fec955d6700 1 --2- 172.21.15.152:0/997992783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec901038f0 0x7fec90103d00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:18.273 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.139+0000 7fec955d6700 1 -- 172.21.15.152:0/997992783 >> 172.21.15.152:0/997992783 conn(0x7fec900fc0b0 msgr2=0x7fec900fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:18.273 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.139+0000 7fec955d6700 1 -- 172.21.15.152:0/997992783 shutdown_connections 2023-12-06T14:53:18.273 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.139+0000 7fec955d6700 1 -- 172.21.15.152:0/997992783 wait complete. 2023-12-06T14:53:18.273 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.140+0000 7fec955d6700 1 Processor -- start 2023-12-06T14:53:18.273 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.140+0000 7fec955d6700 1 -- start start 2023-12-06T14:53:18.273 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.140+0000 7fec955d6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec901038f0 0x7fec90103130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:18.273 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.140+0000 7fec955d6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec901015b0 con 0x7fec901038f0 2023-12-06T14:53:18.273 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.140+0000 7fec8effd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec901038f0 0x7fec90103130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:18.273 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.140+0000 7fec8effd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec901038f0 0x7fec90103130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50256/0 (socket says 172.21.15.152:50256) 2023-12-06T14:53:18.273 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.140+0000 7fec8effd700 1 -- 172.21.15.152:0/3797950186 learned_addr learned my addr 172.21.15.152:0/3797950186 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:18.273 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.141+0000 7fec8effd700 1 -- 172.21.15.152:0/3797950186 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec800094f0 con 0x7fec901038f0 2023-12-06T14:53:18.273 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.141+0000 7fec8effd700 1 --2- 172.21.15.152:0/3797950186 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec901038f0 0x7fec90103130 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fec80006b00 tx=0x7fec80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:18.273 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.141+0000 7fec777fe700 1 -- 172.21.15.152:0/3797950186 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec800109b0 con 0x7fec901038f0 2023-12-06T14:53:18.273 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.141+0000 7fec777fe700 1 -- 172.21.15.152:0/3797950186 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fec80024440 con 0x7fec901038f0 2023-12-06T14:53:18.274 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.141+0000 7fec955d6700 1 -- 172.21.15.152:0/3797950186 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec901017b0 con 0x7fec901038f0 2023-12-06T14:53:18.274 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.141+0000 7fec777fe700 1 -- 172.21.15.152:0/3797950186 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec8001a5f0 con 0x7fec901038f0 2023-12-06T14:53:18.274 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.141+0000 7fec955d6700 1 -- 172.21.15.152:0/3797950186 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec90101bc0 con 0x7fec901038f0 2023-12-06T14:53:18.274 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.142+0000 7fec777fe700 1 -- 172.21.15.152:0/3797950186 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 4) v1 ==== 43270+0+0 (secure 0 0 0) 0x7fec8001a860 con 0x7fec901038f0 2023-12-06T14:53:18.274 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.142+0000 7fec955d6700 1 -- 172.21.15.152:0/3797950186 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec9004bb80 con 0x7fec901038f0 2023-12-06T14:53:18.274 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.142+0000 7fec777fe700 1 --2- 172.21.15.152:0/3797950186 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7fec780365f0 0x7fec78038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:18.274 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.142+0000 7fec777fe700 1 -- 172.21.15.152:0/3797950186 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fec8004a780 con 0x7fec901038f0 2023-12-06T14:53:18.274 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.142+0000 7fec8e7fc700 1 --2- 172.21.15.152:0/3797950186 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7fec780365f0 0x7fec78038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:18.274 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.142+0000 7fec8e7fc700 1 --2- 172.21.15.152:0/3797950186 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7fec780365f0 0x7fec78038aa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fec84009990 tx=0x7fec84006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:18.274 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.147+0000 7fec777fe700 1 -- 172.21.15.152:0/3797950186 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fec8001ab10 con 0x7fec901038f0 2023-12-06T14:53:18.274 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.379+0000 7fec955d6700 1 -- 172.21.15.152:0/3797950186 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fec90100dd0 con 0x7fec901038f0 2023-12-06T14:53:18.274 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.919+0000 7fec777fe700 1 -- 172.21.15.152:0/3797950186 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fec8000fdc0 con 0x7fec901038f0 2023-12-06T14:53:18.274 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.920+0000 7fec777fe700 1 -- 172.21.15.152:0/3797950186 <== mon.0 v2:172.21.15.152:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fec80018b40 con 0x7fec901038f0 2023-12-06T14:53:18.274 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.922+0000 7fec955d6700 1 -- 172.21.15.152:0/3797950186 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7fec780365f0 msgr2=0x7fec78038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:18.275 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.922+0000 7fec955d6700 1 --2- 172.21.15.152:0/3797950186 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7fec780365f0 0x7fec78038aa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fec84009990 tx=0x7fec84006e40 comp rx=0 tx=0).stop 2023-12-06T14:53:18.275 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.922+0000 7fec955d6700 1 -- 172.21.15.152:0/3797950186 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec901038f0 msgr2=0x7fec90103130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:18.275 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.922+0000 7fec955d6700 1 --2- 172.21.15.152:0/3797950186 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec901038f0 0x7fec90103130 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fec80006b00 tx=0x7fec80009250 comp rx=0 tx=0).stop 2023-12-06T14:53:18.275 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.922+0000 7fec955d6700 1 -- 172.21.15.152:0/3797950186 shutdown_connections 2023-12-06T14:53:18.275 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.922+0000 7fec955d6700 1 --2- 172.21.15.152:0/3797950186 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7fec780365f0 0x7fec78038aa0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:18.275 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.922+0000 7fec955d6700 1 --2- 172.21.15.152:0/3797950186 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec901038f0 0x7fec90103130 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:18.275 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.922+0000 7fec955d6700 1 -- 172.21.15.152:0/3797950186 >> 172.21.15.152:0/3797950186 conn(0x7fec900fc0b0 msgr2=0x7fec900fe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:18.275 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.922+0000 7fec955d6700 1 -- 172.21.15.152:0/3797950186 shutdown_connections 2023-12-06T14:53:18.275 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:17.922+0000 7fec955d6700 1 -- 172.21.15.152:0/3797950186 wait complete. 2023-12-06T14:53:19.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:18 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/3797950186' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-12-06T14:53:19.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:18 smithi152 ceph-mon[111954]: mgrmap e5: smithi152.meodco(active, since 5s) 2023-12-06T14:53:19.242 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:18 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/845368457' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-06T14:53:21.189 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout { 2023-12-06T14:53:21.189 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-12-06T14:53:21.190 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-06T14:53:21.190 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "active_name": "smithi152.meodco", 2023-12-06T14:53:21.190 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-06T14:53:21.190 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout } 2023-12-06T14:53:21.190 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.606+0000 7fe075b64700 1 Processor -- start 2023-12-06T14:53:21.190 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.606+0000 7fe075b64700 1 -- start start 2023-12-06T14:53:21.190 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.607+0000 7fe075b64700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0701011d0 0x7fe0701015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:21.190 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.607+0000 7fe075b64700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe070101b20 con 0x7fe0701011d0 2023-12-06T14:53:21.190 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.607+0000 7fe06f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0701011d0 0x7fe0701015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:21.190 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.607+0000 7fe06f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0701011d0 0x7fe0701015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50276/0 (socket says 172.21.15.152:50276) 2023-12-06T14:53:21.190 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.607+0000 7fe06f7fe700 1 -- 172.21.15.152:0/3065107165 learned_addr learned my addr 172.21.15.152:0/3065107165 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:21.190 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.607+0000 7fe06f7fe700 1 -- 172.21.15.152:0/3065107165 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe070101c60 con 0x7fe0701011d0 2023-12-06T14:53:21.190 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.607+0000 7fe06f7fe700 1 --2- 172.21.15.152:0/3065107165 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0701011d0 0x7fe0701015e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe0600098e0 tx=0x7fe060009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1598af0f5fb7e0c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:21.191 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.607+0000 7fe06e7fc700 1 -- 172.21.15.152:0/3065107165 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe06000b860 con 0x7fe0701011d0 2023-12-06T14:53:21.191 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.607+0000 7fe06e7fc700 1 -- 172.21.15.152:0/3065107165 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fe06000be30 con 0x7fe0701011d0 2023-12-06T14:53:21.191 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.607+0000 7fe06e7fc700 1 -- 172.21.15.152:0/3065107165 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe060010380 con 0x7fe0701011d0 2023-12-06T14:53:21.191 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.608+0000 7fe075b64700 1 -- 172.21.15.152:0/3065107165 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0701011d0 msgr2=0x7fe0701015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:21.191 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.608+0000 7fe075b64700 1 --2- 172.21.15.152:0/3065107165 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0701011d0 0x7fe0701015e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe0600098e0 tx=0x7fe060009250 comp rx=0 tx=0).stop 2023-12-06T14:53:21.191 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.608+0000 7fe075b64700 1 -- 172.21.15.152:0/3065107165 shutdown_connections 2023-12-06T14:53:21.191 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.608+0000 7fe075b64700 1 --2- 172.21.15.152:0/3065107165 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0701011d0 0x7fe0701015e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:21.191 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.608+0000 7fe075b64700 1 -- 172.21.15.152:0/3065107165 >> 172.21.15.152:0/3065107165 conn(0x7fe0700fc970 msgr2=0x7fe0700fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:21.191 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.608+0000 7fe075b64700 1 -- 172.21.15.152:0/3065107165 shutdown_connections 2023-12-06T14:53:21.191 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.608+0000 7fe075b64700 1 -- 172.21.15.152:0/3065107165 wait complete. 2023-12-06T14:53:21.191 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.609+0000 7fe075b64700 1 Processor -- start 2023-12-06T14:53:21.191 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.609+0000 7fe075b64700 1 -- start start 2023-12-06T14:53:21.191 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.609+0000 7fe075b64700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0701011d0 0x7fe070111150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:21.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.609+0000 7fe075b64700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe070111690 con 0x7fe0701011d0 2023-12-06T14:53:21.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.609+0000 7fe06f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0701011d0 0x7fe070111150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:21.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.609+0000 7fe06f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0701011d0 0x7fe070111150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:50284/0 (socket says 172.21.15.152:50284) 2023-12-06T14:53:21.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.609+0000 7fe06f7fe700 1 -- 172.21.15.152:0/845368457 learned_addr learned my addr 172.21.15.152:0/845368457 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:21.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.609+0000 7fe06f7fe700 1 -- 172.21.15.152:0/845368457 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0600094f0 con 0x7fe0701011d0 2023-12-06T14:53:21.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.609+0000 7fe06f7fe700 1 --2- 172.21.15.152:0/845368457 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0701011d0 0x7fe070111150 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe060000c00 tx=0x7fe060009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:21.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.610+0000 7fe057fff700 1 -- 172.21.15.152:0/845368457 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe060010a80 con 0x7fe0701011d0 2023-12-06T14:53:21.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.610+0000 7fe057fff700 1 -- 172.21.15.152:0/845368457 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fe06001a430 con 0x7fe0701011d0 2023-12-06T14:53:21.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.610+0000 7fe075b64700 1 -- 172.21.15.152:0/845368457 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe070111890 con 0x7fe0701011d0 2023-12-06T14:53:21.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.610+0000 7fe057fff700 1 -- 172.21.15.152:0/845368457 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe0600245b0 con 0x7fe0701011d0 2023-12-06T14:53:21.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.610+0000 7fe075b64700 1 -- 172.21.15.152:0/845368457 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe070111ca0 con 0x7fe0701011d0 2023-12-06T14:53:21.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.611+0000 7fe075b64700 1 -- 172.21.15.152:0/845368457 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe07004bb80 con 0x7fe0701011d0 2023-12-06T14:53:21.192 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.611+0000 7fe057fff700 1 -- 172.21.15.152:0/845368457 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fe0600247a0 con 0x7fe0701011d0 2023-12-06T14:53:21.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.611+0000 7fe057fff700 1 --2- 172.21.15.152:0/845368457 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7fe058036640 0x7fe058038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:21.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.611+0000 7fe057fff700 1 -- 172.21.15.152:0/845368457 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe06004ac80 con 0x7fe0701011d0 2023-12-06T14:53:21.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.611+0000 7fe06effd700 1 -- 172.21.15.152:0/845368457 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7fe058036640 msgr2=0x7fe058038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/1793082857 2023-12-06T14:53:21.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.611+0000 7fe06effd700 1 --2- 172.21.15.152:0/845368457 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7fe058036640 0x7fe058038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-06T14:53:21.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.616+0000 7fe057fff700 1 -- 172.21.15.152:0/845368457 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe060018350 con 0x7fe0701011d0 2023-12-06T14:53:21.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.812+0000 7fe06effd700 1 -- 172.21.15.152:0/845368457 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7fe058036640 msgr2=0x7fe058038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/1793082857 2023-12-06T14:53:21.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.812+0000 7fe06effd700 1 --2- 172.21.15.152:0/845368457 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7fe058036640 0x7fe058038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-06T14:53:21.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.856+0000 7fe075b64700 1 -- 172.21.15.152:0/845368457 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fe070112910 con 0x7fe0701011d0 2023-12-06T14:53:21.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.857+0000 7fe057fff700 1 -- 172.21.15.152:0/845368457 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7fe060023b80 con 0x7fe0701011d0 2023-12-06T14:53:21.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.859+0000 7fe075b64700 1 -- 172.21.15.152:0/845368457 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7fe058036640 msgr2=0x7fe058038af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-06T14:53:21.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.859+0000 7fe075b64700 1 --2- 172.21.15.152:0/845368457 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7fe058036640 0x7fe058038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:21.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.859+0000 7fe075b64700 1 -- 172.21.15.152:0/845368457 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0701011d0 msgr2=0x7fe070111150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:21.193 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.859+0000 7fe075b64700 1 --2- 172.21.15.152:0/845368457 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0701011d0 0x7fe070111150 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe060000c00 tx=0x7fe060009250 comp rx=0 tx=0).stop 2023-12-06T14:53:21.194 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.859+0000 7fe075b64700 1 -- 172.21.15.152:0/845368457 shutdown_connections 2023-12-06T14:53:21.194 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.859+0000 7fe075b64700 1 --2- 172.21.15.152:0/845368457 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7fe058036640 0x7fe058038af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:21.194 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.859+0000 7fe075b64700 1 --2- 172.21.15.152:0/845368457 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe0701011d0 0x7fe070111150 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:21.194 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.859+0000 7fe075b64700 1 -- 172.21.15.152:0/845368457 >> 172.21.15.152:0/845368457 conn(0x7fe0700fc970 msgr2=0x7fe070070bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:21.194 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.859+0000 7fe075b64700 1 -- 172.21.15.152:0/845368457 shutdown_connections 2023-12-06T14:53:21.194 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:18.859+0000 7fe075b64700 1 -- 172.21.15.152:0/845368457 wait complete. 2023-12-06T14:53:21.194 INFO:teuthology.orchestra.run.smithi152.stdout:Waiting for the mgr to restart... 2023-12-06T14:53:21.194 INFO:teuthology.orchestra.run.smithi152.stdout:Waiting for mgr epoch 5... 2023-12-06T14:53:24.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:24 smithi152 ceph-mon[111954]: Active manager daemon smithi152.meodco restarted 2023-12-06T14:53:24.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:24 smithi152 ceph-mon[111954]: Activating manager daemon smithi152.meodco 2023-12-06T14:53:24.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:24 smithi152 ceph-mon[111954]: osdmap e2: 0 total, 0 up, 0 in 2023-12-06T14:53:24.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:24 smithi152 ceph-mon[111954]: mgrmap e6: smithi152.meodco(active, starting, since 0.00320301s) 2023-12-06T14:53:24.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:24 smithi152 ceph-mon[111954]: from='mgr.14120 172.21.15.152:0/303232505' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-06T14:53:24.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:24 smithi152 ceph-mon[111954]: from='mgr.14120 172.21.15.152:0/303232505' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mgr metadata", "who": "smithi152.meodco", "id": "smithi152.meodco"}]: dispatch 2023-12-06T14:53:24.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:24 smithi152 ceph-mon[111954]: from='mgr.14120 172.21.15.152:0/303232505' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-06T14:53:24.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:24 smithi152 ceph-mon[111954]: from='mgr.14120 172.21.15.152:0/303232505' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-06T14:53:24.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:24 smithi152 ceph-mon[111954]: from='mgr.14120 172.21.15.152:0/303232505' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-06T14:53:24.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:24 smithi152 ceph-mon[111954]: Manager daemon smithi152.meodco is now available 2023-12-06T14:53:24.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:24 smithi152 ceph-mon[111954]: from='mgr.14120 172.21.15.152:0/303232505' entity='mgr.smithi152.meodco' 2023-12-06T14:53:24.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:24 smithi152 ceph-mon[111954]: from='mgr.14120 172.21.15.152:0/303232505' entity='mgr.smithi152.meodco' 2023-12-06T14:53:24.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:24 smithi152 ceph-mon[111954]: from='mgr.14120 172.21.15.152:0/303232505' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:53:24.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:24 smithi152 ceph-mon[111954]: from='mgr.14120 172.21.15.152:0/303232505' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:53:24.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:24 smithi152 ceph-mon[111954]: from='mgr.14120 172.21.15.152:0/303232505' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:53:25.877 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:25 smithi152 ceph-mon[111954]: Found migration_current of "None". Setting to last migration. 2023-12-06T14:53:25.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:25 smithi152 ceph-mon[111954]: from='mgr.14120 172.21.15.152:0/303232505' entity='mgr.smithi152.meodco' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.meodco/mirror_snapshot_schedule"}]: dispatch 2023-12-06T14:53:25.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:25 smithi152 ceph-mon[111954]: from='mgr.14120 172.21.15.152:0/303232505' entity='mgr.smithi152.meodco' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.meodco/trash_purge_schedule"}]: dispatch 2023-12-06T14:53:25.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:25 smithi152 ceph-mon[111954]: mgrmap e7: smithi152.meodco(active, since 1.00537s) 2023-12-06T14:53:26.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:26 smithi152 ceph-mon[111954]: [06/Dec/2023:14:53:25] ENGINE Bus STARTING 2023-12-06T14:53:26.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:26 smithi152 ceph-mon[111954]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-12-06T14:53:26.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:26 smithi152 ceph-mon[111954]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-12-06T14:53:26.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:26 smithi152 ceph-mon[111954]: [06/Dec/2023:14:53:25] ENGINE Serving on https://172.21.15.152:7150 2023-12-06T14:53:26.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:26 smithi152 ceph-mon[111954]: [06/Dec/2023:14:53:25] ENGINE Bus STARTED 2023-12-06T14:53:26.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:26 smithi152 ceph-mon[111954]: from='mgr.14120 172.21.15.152:0/303232505' entity='mgr.smithi152.meodco' 2023-12-06T14:53:26.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:26 smithi152 ceph-mon[111954]: from='mgr.14120 172.21.15.152:0/303232505' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:53:27.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:27 smithi152 ceph-mon[111954]: mgrmap e8: smithi152.meodco(active, since 2s) 2023-12-06T14:53:28.063 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout { 2023-12-06T14:53:28.063 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-12-06T14:53:28.063 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-06T14:53:28.063 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout } 2023-12-06T14:53:28.063 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.008+0000 7fb9d27cd700 1 Processor -- start 2023-12-06T14:53:28.063 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.009+0000 7fb9d27cd700 1 -- start start 2023-12-06T14:53:28.063 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.009+0000 7fb9d27cd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9cc1011d0 0x7fb9cc1015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:28.064 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.009+0000 7fb9d27cd700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc101b20 con 0x7fb9cc1011d0 2023-12-06T14:53:28.064 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.009+0000 7fb9cbfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9cc1011d0 0x7fb9cc1015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:28.064 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.009+0000 7fb9cbfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9cc1011d0 0x7fb9cc1015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39316/0 (socket says 172.21.15.152:39316) 2023-12-06T14:53:28.064 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.009+0000 7fb9cbfff700 1 -- 172.21.15.152:0/3731079913 learned_addr learned my addr 172.21.15.152:0/3731079913 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:28.064 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.009+0000 7fb9cbfff700 1 -- 172.21.15.152:0/3731079913 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9cc101c60 con 0x7fb9cc1011d0 2023-12-06T14:53:28.064 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.009+0000 7fb9cbfff700 1 --2- 172.21.15.152:0/3731079913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9cc1011d0 0x7fb9cc1015e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc0098e0 tx=0x7fb9bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38097dae0e0f1b13 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:28.064 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.009+0000 7fb9caffd700 1 -- 172.21.15.152:0/3731079913 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb9bc00b860 con 0x7fb9cc1011d0 2023-12-06T14:53:28.064 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.010+0000 7fb9caffd700 1 -- 172.21.15.152:0/3731079913 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fb9bc00be30 con 0x7fb9cc1011d0 2023-12-06T14:53:28.064 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.010+0000 7fb9caffd700 1 -- 172.21.15.152:0/3731079913 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb9bc010380 con 0x7fb9cc1011d0 2023-12-06T14:53:28.064 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.010+0000 7fb9d27cd700 1 -- 172.21.15.152:0/3731079913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9cc1011d0 msgr2=0x7fb9cc1015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:28.064 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.010+0000 7fb9d27cd700 1 --2- 172.21.15.152:0/3731079913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9cc1011d0 0x7fb9cc1015e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc0098e0 tx=0x7fb9bc009250 comp rx=0 tx=0).stop 2023-12-06T14:53:28.065 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.010+0000 7fb9d27cd700 1 -- 172.21.15.152:0/3731079913 shutdown_connections 2023-12-06T14:53:28.065 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.010+0000 7fb9d27cd700 1 --2- 172.21.15.152:0/3731079913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9cc1011d0 0x7fb9cc1015e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:28.065 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.010+0000 7fb9d27cd700 1 -- 172.21.15.152:0/3731079913 >> 172.21.15.152:0/3731079913 conn(0x7fb9cc0fc970 msgr2=0x7fb9cc0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:28.065 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.010+0000 7fb9d27cd700 1 -- 172.21.15.152:0/3731079913 shutdown_connections 2023-12-06T14:53:28.065 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.010+0000 7fb9d27cd700 1 -- 172.21.15.152:0/3731079913 wait complete. 2023-12-06T14:53:28.065 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.011+0000 7fb9d27cd700 1 Processor -- start 2023-12-06T14:53:28.065 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.011+0000 7fb9d27cd700 1 -- start start 2023-12-06T14:53:28.065 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.011+0000 7fb9d27cd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9cc1011d0 0x7fb9cc111140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:28.065 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.011+0000 7fb9d27cd700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc111680 con 0x7fb9cc1011d0 2023-12-06T14:53:28.065 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.011+0000 7fb9cbfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9cc1011d0 0x7fb9cc111140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:28.065 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.011+0000 7fb9cbfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9cc1011d0 0x7fb9cc111140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39332/0 (socket says 172.21.15.152:39332) 2023-12-06T14:53:28.065 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.011+0000 7fb9cbfff700 1 -- 172.21.15.152:0/2767614401 learned_addr learned my addr 172.21.15.152:0/2767614401 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:28.065 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.012+0000 7fb9cbfff700 1 -- 172.21.15.152:0/2767614401 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9bc0094f0 con 0x7fb9cc1011d0 2023-12-06T14:53:28.065 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.012+0000 7fb9cbfff700 1 --2- 172.21.15.152:0/2767614401 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9cc1011d0 0x7fb9cc111140 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc006b00 tx=0x7fb9bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:28.065 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.012+0000 7fb9c8ff9700 1 -- 172.21.15.152:0/2767614401 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb9bc0109b0 con 0x7fb9cc1011d0 2023-12-06T14:53:28.066 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.012+0000 7fb9d27cd700 1 -- 172.21.15.152:0/2767614401 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9cc111880 con 0x7fb9cc1011d0 2023-12-06T14:53:28.066 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.012+0000 7fb9c8ff9700 1 -- 172.21.15.152:0/2767614401 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fb9bc024440 con 0x7fb9cc1011d0 2023-12-06T14:53:28.066 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.012+0000 7fb9c8ff9700 1 -- 172.21.15.152:0/2767614401 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb9bc01a5f0 con 0x7fb9cc1011d0 2023-12-06T14:53:28.066 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.012+0000 7fb9d27cd700 1 -- 172.21.15.152:0/2767614401 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9cc111c90 con 0x7fb9cc1011d0 2023-12-06T14:53:28.066 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.013+0000 7fb9c8ff9700 1 -- 172.21.15.152:0/2767614401 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fb9bc01a8b0 con 0x7fb9cc1011d0 2023-12-06T14:53:28.066 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.013+0000 7fb9c8ff9700 1 --2- 172.21.15.152:0/2767614401 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7fb9b40365f0 0x7fb9b4038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:28.066 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.013+0000 7fb9d27cd700 1 -- 172.21.15.152:0/2767614401 --> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb9cc04bb80 con 0x7fb9b40365f0 2023-12-06T14:53:28.066 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.013+0000 7fb9c8ff9700 1 -- 172.21.15.152:0/2767614401 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fb9bc04b590 con 0x7fb9cc1011d0 2023-12-06T14:53:28.066 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.013+0000 7fb9cb7fe700 1 -- 172.21.15.152:0/2767614401 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7fb9b40365f0 msgr2=0x7fb9b4038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/1793082857 2023-12-06T14:53:28.066 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.013+0000 7fb9cb7fe700 1 --2- 172.21.15.152:0/2767614401 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7fb9b40365f0 0x7fb9b4038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-06T14:53:28.066 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.214+0000 7fb9cb7fe700 1 -- 172.21.15.152:0/2767614401 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7fb9b40365f0 msgr2=0x7fb9b4038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/1793082857 2023-12-06T14:53:28.066 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.214+0000 7fb9cb7fe700 1 --2- 172.21.15.152:0/2767614401 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7fb9b40365f0 0x7fb9b4038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-06T14:53:28.066 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.615+0000 7fb9cb7fe700 1 -- 172.21.15.152:0/2767614401 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7fb9b40365f0 msgr2=0x7fb9b4038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/1793082857 2023-12-06T14:53:28.066 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:22.615+0000 7fb9cb7fe700 1 --2- 172.21.15.152:0/2767614401 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7fb9b40365f0 0x7fb9b4038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-06T14:53:28.067 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:23.416+0000 7fb9cb7fe700 1 -- 172.21.15.152:0/2767614401 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7fb9b40365f0 msgr2=0x7fb9b4038aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/1793082857 2023-12-06T14:53:28.067 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:23.416+0000 7fb9cb7fe700 1 --2- 172.21.15.152:0/2767614401 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7fb9b40365f0 0x7fb9b4038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-06T14:53:28.067 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:24.416+0000 7fb9c8ff9700 1 -- 172.21.15.152:0/2767614401 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mgrmap(e 6) v1 ==== 43048+0+0 (secure 0 0 0) 0x7fb9bc00fdc0 con 0x7fb9cc1011d0 2023-12-06T14:53:28.067 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:24.416+0000 7fb9c8ff9700 1 -- 172.21.15.152:0/2767614401 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7fb9b40365f0 msgr2=0x7fb9b4038aa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-06T14:53:28.067 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:24.416+0000 7fb9c8ff9700 1 --2- 172.21.15.152:0/2767614401 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7fb9b40365f0 0x7fb9b4038aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:28.067 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:25.417+0000 7fb9c8ff9700 1 -- 172.21.15.152:0/2767614401 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mgrmap(e 7) v1 ==== 43175+0+0 (secure 0 0 0) 0x7fb9bc024990 con 0x7fb9cc1011d0 2023-12-06T14:53:28.067 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:25.417+0000 7fb9c8ff9700 1 --2- 172.21.15.152:0/2767614401 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7fb9b4039db0 0x7fb9b403c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:28.067 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:25.417+0000 7fb9c8ff9700 1 -- 172.21.15.152:0/2767614401 --> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb9cc04bb80 con 0x7fb9b4039db0 2023-12-06T14:53:28.067 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:25.417+0000 7fb9cb7fe700 1 --2- 172.21.15.152:0/2767614401 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7fb9b4039db0 0x7fb9b403c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:28.067 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:25.418+0000 7fb9cb7fe700 1 --2- 172.21.15.152:0/2767614401 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7fb9b4039db0 0x7fb9b403c190 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb9c00039d0 tx=0x7fb9c0009350 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:28.067 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:25.418+0000 7fb9c8ff9700 1 -- 172.21.15.152:0/2767614401 <== mgr.14120 v2:172.21.15.152:6800/2466555973 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7fb9cc04bb80 con 0x7fb9b4039db0 2023-12-06T14:53:28.067 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:25.424+0000 7fb9d27cd700 1 -- 172.21.15.152:0/2767614401 --> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fb9cc102fe0 con 0x7fb9b4039db0 2023-12-06T14:53:28.067 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:25.425+0000 7fb9c8ff9700 1 -- 172.21.15.152:0/2767614401 <== mgr.14120 v2:172.21.15.152:6800/2466555973 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fb9cc102fe0 con 0x7fb9b4039db0 2023-12-06T14:53:28.067 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:25.425+0000 7fb9d27cd700 1 -- 172.21.15.152:0/2767614401 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7fb9b4039db0 msgr2=0x7fb9b403c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:28.067 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:25.425+0000 7fb9d27cd700 1 --2- 172.21.15.152:0/2767614401 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7fb9b4039db0 0x7fb9b403c190 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb9c00039d0 tx=0x7fb9c0009350 comp rx=0 tx=0).stop 2023-12-06T14:53:28.068 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:25.425+0000 7fb9d27cd700 1 -- 172.21.15.152:0/2767614401 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9cc1011d0 msgr2=0x7fb9cc111140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:28.068 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:25.425+0000 7fb9d27cd700 1 --2- 172.21.15.152:0/2767614401 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9cc1011d0 0x7fb9cc111140 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc006b00 tx=0x7fb9bc009250 comp rx=0 tx=0).stop 2023-12-06T14:53:28.068 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:25.425+0000 7fb9d27cd700 1 -- 172.21.15.152:0/2767614401 shutdown_connections 2023-12-06T14:53:28.068 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:25.425+0000 7fb9d27cd700 1 --2- 172.21.15.152:0/2767614401 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7fb9b4039db0 0x7fb9b403c190 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:28.068 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:25.425+0000 7fb9d27cd700 1 --2- 172.21.15.152:0/2767614401 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9cc1011d0 0x7fb9cc111140 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:28.068 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:25.425+0000 7fb9d27cd700 1 --2- 172.21.15.152:0/2767614401 >> [v2:172.21.15.152:6800/1793082857,v1:172.21.15.152:6801/1793082857] conn(0x7fb9b40365f0 0x7fb9b4038aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:28.068 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:25.425+0000 7fb9d27cd700 1 -- 172.21.15.152:0/2767614401 >> 172.21.15.152:0/2767614401 conn(0x7fb9cc0fc970 msgr2=0x7fb9cc0fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:28.068 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:25.425+0000 7fb9d27cd700 1 -- 172.21.15.152:0/2767614401 shutdown_connections 2023-12-06T14:53:28.068 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:25.425+0000 7fb9d27cd700 1 -- 172.21.15.152:0/2767614401 wait complete. 2023-12-06T14:53:28.068 INFO:teuthology.orchestra.run.smithi152.stdout:mgr epoch 5 is available 2023-12-06T14:53:28.068 INFO:teuthology.orchestra.run.smithi152.stdout:Setting orchestrator backend to cephadm... 2023-12-06T14:53:29.260 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.710+0000 7f91ab2a3700 1 Processor -- start 2023-12-06T14:53:29.261 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.711+0000 7f91ab2a3700 1 -- start start 2023-12-06T14:53:29.261 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.711+0000 7f91ab2a3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91a41038f0 0x7f91a4103d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:29.261 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.711+0000 7f91ab2a3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a4104240 con 0x7f91a41038f0 2023-12-06T14:53:29.261 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.711+0000 7f91a903f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91a41038f0 0x7f91a4103d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:29.261 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.711+0000 7f91a903f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91a41038f0 0x7f91a4103d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39424/0 (socket says 172.21.15.152:39424) 2023-12-06T14:53:29.261 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.711+0000 7f91a903f700 1 -- 172.21.15.152:0/3857481321 learned_addr learned my addr 172.21.15.152:0/3857481321 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:29.261 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.711+0000 7f91a903f700 1 -- 172.21.15.152:0/3857481321 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a4104380 con 0x7f91a41038f0 2023-12-06T14:53:29.261 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.711+0000 7f91a903f700 1 --2- 172.21.15.152:0/3857481321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91a41038f0 0x7f91a4103d00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f91a00098e0 tx=0x7f91a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2396a84661e6266 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:29.261 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.712+0000 7f9197fff700 1 -- 172.21.15.152:0/3857481321 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f91a000b860 con 0x7f91a41038f0 2023-12-06T14:53:29.261 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.712+0000 7f9197fff700 1 -- 172.21.15.152:0/3857481321 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f91a000be30 con 0x7f91a41038f0 2023-12-06T14:53:29.261 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.712+0000 7f9197fff700 1 -- 172.21.15.152:0/3857481321 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f91a0010380 con 0x7f91a41038f0 2023-12-06T14:53:29.261 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.712+0000 7f91ab2a3700 1 -- 172.21.15.152:0/3857481321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91a41038f0 msgr2=0x7f91a4103d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:29.261 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.712+0000 7f91ab2a3700 1 --2- 172.21.15.152:0/3857481321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91a41038f0 0x7f91a4103d00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f91a00098e0 tx=0x7f91a0009250 comp rx=0 tx=0).stop 2023-12-06T14:53:29.262 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.712+0000 7f91ab2a3700 1 -- 172.21.15.152:0/3857481321 shutdown_connections 2023-12-06T14:53:29.262 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.712+0000 7f91ab2a3700 1 --2- 172.21.15.152:0/3857481321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91a41038f0 0x7f91a4103d00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:29.262 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.712+0000 7f91ab2a3700 1 -- 172.21.15.152:0/3857481321 >> 172.21.15.152:0/3857481321 conn(0x7f91a40fc0b0 msgr2=0x7f91a40fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:29.262 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.712+0000 7f91ab2a3700 1 -- 172.21.15.152:0/3857481321 shutdown_connections 2023-12-06T14:53:29.262 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.712+0000 7f91ab2a3700 1 -- 172.21.15.152:0/3857481321 wait complete. 2023-12-06T14:53:29.262 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.713+0000 7f91ab2a3700 1 Processor -- start 2023-12-06T14:53:29.262 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.713+0000 7f91ab2a3700 1 -- start start 2023-12-06T14:53:29.262 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.713+0000 7f91ab2a3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91a41038f0 0x7f91a4111130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:29.262 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.713+0000 7f91ab2a3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a4111670 con 0x7f91a41038f0 2023-12-06T14:53:29.262 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.713+0000 7f91a903f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91a41038f0 0x7f91a4111130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:29.262 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.713+0000 7f91a903f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91a41038f0 0x7f91a4111130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39432/0 (socket says 172.21.15.152:39432) 2023-12-06T14:53:29.262 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.713+0000 7f91a903f700 1 -- 172.21.15.152:0/271206018 learned_addr learned my addr 172.21.15.152:0/271206018 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:29.262 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.714+0000 7f91a903f700 1 -- 172.21.15.152:0/271206018 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a00094f0 con 0x7f91a41038f0 2023-12-06T14:53:29.262 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.714+0000 7f91a903f700 1 --2- 172.21.15.152:0/271206018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91a41038f0 0x7f91a4111130 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f91a0000c00 tx=0x7f91a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:29.263 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.714+0000 7f9195ffb700 1 -- 172.21.15.152:0/271206018 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f91a0010a80 con 0x7f91a41038f0 2023-12-06T14:53:29.263 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.714+0000 7f9195ffb700 1 -- 172.21.15.152:0/271206018 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f91a001a430 con 0x7f91a41038f0 2023-12-06T14:53:29.263 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.714+0000 7f91ab2a3700 1 -- 172.21.15.152:0/271206018 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a4111870 con 0x7f91a41038f0 2023-12-06T14:53:29.263 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.714+0000 7f9195ffb700 1 -- 172.21.15.152:0/271206018 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f91a00245b0 con 0x7f91a41038f0 2023-12-06T14:53:29.263 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.714+0000 7f91ab2a3700 1 -- 172.21.15.152:0/271206018 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91a4111c80 con 0x7f91a41038f0 2023-12-06T14:53:29.263 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.715+0000 7f9195ffb700 1 -- 172.21.15.152:0/271206018 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f91a00247a0 con 0x7f91a41038f0 2023-12-06T14:53:29.263 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.715+0000 7f91ab2a3700 1 -- 172.21.15.152:0/271206018 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91a404bb80 con 0x7f91a41038f0 2023-12-06T14:53:29.263 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.715+0000 7f9195ffb700 1 --2- 172.21.15.152:0/271206018 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f9190036640 0x7f9190038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:29.263 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.715+0000 7f9195ffb700 1 -- 172.21.15.152:0/271206018 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f91a004aca0 con 0x7f91a41038f0 2023-12-06T14:53:29.263 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.715+0000 7f91a883e700 1 --2- 172.21.15.152:0/271206018 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f9190036640 0x7f9190038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:29.263 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.715+0000 7f91a883e700 1 --2- 172.21.15.152:0/271206018 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f9190036640 0x7f9190038af0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9198009990 tx=0x7f9198006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:29.263 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.720+0000 7f9195ffb700 1 -- 172.21.15.152:0/271206018 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f91a0023570 con 0x7f91a41038f0 2023-12-06T14:53:29.263 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.913+0000 7f91ab2a3700 1 -- 172.21.15.152:0/271206018 --> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f91a410afd0 con 0x7f9190036640 2023-12-06T14:53:29.263 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.918+0000 7f9195ffb700 1 -- 172.21.15.152:0/271206018 <== mgr.14120 v2:172.21.15.152:6800/2466555973 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f91a410afd0 con 0x7f9190036640 2023-12-06T14:53:29.264 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.921+0000 7f91ab2a3700 1 -- 172.21.15.152:0/271206018 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f9190036640 msgr2=0x7f9190038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:29.264 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.921+0000 7f91ab2a3700 1 --2- 172.21.15.152:0/271206018 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f9190036640 0x7f9190038af0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9198009990 tx=0x7f9198006e40 comp rx=0 tx=0).stop 2023-12-06T14:53:29.264 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.921+0000 7f91ab2a3700 1 -- 172.21.15.152:0/271206018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91a41038f0 msgr2=0x7f91a4111130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:29.264 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.921+0000 7f91ab2a3700 1 --2- 172.21.15.152:0/271206018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91a41038f0 0x7f91a4111130 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f91a0000c00 tx=0x7f91a0009250 comp rx=0 tx=0).stop 2023-12-06T14:53:29.264 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.921+0000 7f91ab2a3700 1 -- 172.21.15.152:0/271206018 shutdown_connections 2023-12-06T14:53:29.264 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.921+0000 7f91ab2a3700 1 --2- 172.21.15.152:0/271206018 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f9190036640 0x7f9190038af0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:29.264 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.921+0000 7f91ab2a3700 1 --2- 172.21.15.152:0/271206018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91a41038f0 0x7f91a4111130 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:29.264 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.921+0000 7f91ab2a3700 1 -- 172.21.15.152:0/271206018 >> 172.21.15.152:0/271206018 conn(0x7f91a40fc0b0 msgr2=0x7f91a40fe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:29.264 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.921+0000 7f91ab2a3700 1 -- 172.21.15.152:0/271206018 shutdown_connections 2023-12-06T14:53:29.264 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:28.921+0000 7f91ab2a3700 1 -- 172.21.15.152:0/271206018 wait complete. 2023-12-06T14:53:30.117 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:29 smithi152 ceph-mon[111954]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:53:30.117 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:29 smithi152 ceph-mon[111954]: from='mgr.14120 172.21.15.152:0/303232505' entity='mgr.smithi152.meodco' 2023-12-06T14:53:30.118 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:29 smithi152 ceph-mon[111954]: from='mgr.14120 172.21.15.152:0/303232505' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:53:30.185 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout value unchanged 2023-12-06T14:53:30.186 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.621+0000 7f1462dfa700 1 Processor -- start 2023-12-06T14:53:30.186 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.621+0000 7f1462dfa700 1 -- start start 2023-12-06T14:53:30.186 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.621+0000 7f1462dfa700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f145c078d00 0x7f145c077210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:30.186 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.621+0000 7f1462dfa700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145c079110 con 0x7f145c078d00 2023-12-06T14:53:30.186 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.621+0000 7f1460b96700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f145c078d00 0x7f145c077210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:30.186 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.621+0000 7f1460b96700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f145c078d00 0x7f145c077210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57600/0 (socket says 172.21.15.152:57600) 2023-12-06T14:53:30.186 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.621+0000 7f1460b96700 1 -- 172.21.15.152:0/1302129234 learned_addr learned my addr 172.21.15.152:0/1302129234 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:30.186 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.621+0000 7f1460b96700 1 -- 172.21.15.152:0/1302129234 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f145c077750 con 0x7f145c078d00 2023-12-06T14:53:30.186 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.622+0000 7f1460b96700 1 --2- 172.21.15.152:0/1302129234 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f145c078d00 0x7f145c077210 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f14500098e0 tx=0x7f1450009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ef6e9326cb5fa2a server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:30.186 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.622+0000 7f145b7fe700 1 -- 172.21.15.152:0/1302129234 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f145000b860 con 0x7f145c078d00 2023-12-06T14:53:30.186 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.622+0000 7f145b7fe700 1 -- 172.21.15.152:0/1302129234 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f145000be30 con 0x7f145c078d00 2023-12-06T14:53:30.186 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.622+0000 7f145b7fe700 1 -- 172.21.15.152:0/1302129234 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1450010380 con 0x7f145c078d00 2023-12-06T14:53:30.186 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.622+0000 7f1462dfa700 1 -- 172.21.15.152:0/1302129234 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f145c078d00 msgr2=0x7f145c077210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:30.186 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.622+0000 7f1462dfa700 1 --2- 172.21.15.152:0/1302129234 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f145c078d00 0x7f145c077210 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f14500098e0 tx=0x7f1450009250 comp rx=0 tx=0).stop 2023-12-06T14:53:30.187 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.622+0000 7f1462dfa700 1 -- 172.21.15.152:0/1302129234 shutdown_connections 2023-12-06T14:53:30.187 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.622+0000 7f1462dfa700 1 --2- 172.21.15.152:0/1302129234 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f145c078d00 0x7f145c077210 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:30.187 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.622+0000 7f1462dfa700 1 -- 172.21.15.152:0/1302129234 >> 172.21.15.152:0/1302129234 conn(0x7f145c0fda10 msgr2=0x7f145c0ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:30.187 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.622+0000 7f1462dfa700 1 -- 172.21.15.152:0/1302129234 shutdown_connections 2023-12-06T14:53:30.187 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.622+0000 7f1462dfa700 1 -- 172.21.15.152:0/1302129234 wait complete. 2023-12-06T14:53:30.187 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.623+0000 7f1462dfa700 1 Processor -- start 2023-12-06T14:53:30.187 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.623+0000 7f1462dfa700 1 -- start start 2023-12-06T14:53:30.187 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.623+0000 7f1462dfa700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f145c078d00 0x7f145c113310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:30.187 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.623+0000 7f1462dfa700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145c113850 con 0x7f145c078d00 2023-12-06T14:53:30.187 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.623+0000 7f1460b96700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f145c078d00 0x7f145c113310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:30.187 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.623+0000 7f1460b96700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f145c078d00 0x7f145c113310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57608/0 (socket says 172.21.15.152:57608) 2023-12-06T14:53:30.187 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.623+0000 7f1460b96700 1 -- 172.21.15.152:0/3903410814 learned_addr learned my addr 172.21.15.152:0/3903410814 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:30.187 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.624+0000 7f1460b96700 1 -- 172.21.15.152:0/3903410814 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14500094f0 con 0x7f145c078d00 2023-12-06T14:53:30.187 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.624+0000 7f1460b96700 1 --2- 172.21.15.152:0/3903410814 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f145c078d00 0x7f145c113310 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f14500090b0 tx=0x7f1450009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:30.187 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.624+0000 7f14597fa700 1 -- 172.21.15.152:0/3903410814 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f14500109b0 con 0x7f145c078d00 2023-12-06T14:53:30.188 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.624+0000 7f14597fa700 1 -- 172.21.15.152:0/3903410814 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f145001a430 con 0x7f145c078d00 2023-12-06T14:53:30.188 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.624+0000 7f14597fa700 1 -- 172.21.15.152:0/3903410814 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f14500245b0 con 0x7f145c078d00 2023-12-06T14:53:30.188 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.624+0000 7f1462dfa700 1 -- 172.21.15.152:0/3903410814 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f145c113a50 con 0x7f145c078d00 2023-12-06T14:53:30.188 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.624+0000 7f1462dfa700 1 -- 172.21.15.152:0/3903410814 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f145c113e60 con 0x7f145c078d00 2023-12-06T14:53:30.188 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.625+0000 7f14597fa700 1 -- 172.21.15.152:0/3903410814 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f1450024870 con 0x7f145c078d00 2023-12-06T14:53:30.188 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.625+0000 7f14597fa700 1 --2- 172.21.15.152:0/3903410814 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f144c0365a0 0x7f144c038a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:30.188 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.625+0000 7f14597fa700 1 -- 172.21.15.152:0/3903410814 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f145004a6d0 con 0x7f145c078d00 2023-12-06T14:53:30.188 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.625+0000 7f145bfff700 1 --2- 172.21.15.152:0/3903410814 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f144c0365a0 0x7f144c038a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:30.188 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.625+0000 7f1462dfa700 1 -- 172.21.15.152:0/3903410814 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f145c04bb80 con 0x7f145c078d00 2023-12-06T14:53:30.188 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.625+0000 7f145bfff700 1 --2- 172.21.15.152:0/3903410814 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f144c0365a0 0x7f144c038a50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1448009990 tx=0x7f1448006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:30.188 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.630+0000 7f14597fa700 1 -- 172.21.15.152:0/3903410814 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f145002c340 con 0x7f145c078d00 2023-12-06T14:53:30.189 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.811+0000 7f1462dfa700 1 -- 172.21.15.152:0/3903410814 --> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f145c10cef0 con 0x7f144c0365a0 2023-12-06T14:53:30.189 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.812+0000 7f14597fa700 1 -- 172.21.15.152:0/3903410814 <== mgr.14120 v2:172.21.15.152:6800/2466555973 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f145c10cef0 con 0x7f144c0365a0 2023-12-06T14:53:30.189 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.814+0000 7f1462dfa700 1 -- 172.21.15.152:0/3903410814 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f144c0365a0 msgr2=0x7f144c038a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:30.189 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.814+0000 7f1462dfa700 1 --2- 172.21.15.152:0/3903410814 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f144c0365a0 0x7f144c038a50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1448009990 tx=0x7f1448006e40 comp rx=0 tx=0).stop 2023-12-06T14:53:30.189 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.814+0000 7f1462dfa700 1 -- 172.21.15.152:0/3903410814 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f145c078d00 msgr2=0x7f145c113310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:30.189 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.814+0000 7f1462dfa700 1 --2- 172.21.15.152:0/3903410814 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f145c078d00 0x7f145c113310 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f14500090b0 tx=0x7f1450009250 comp rx=0 tx=0).stop 2023-12-06T14:53:30.189 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.814+0000 7f1462dfa700 1 -- 172.21.15.152:0/3903410814 shutdown_connections 2023-12-06T14:53:30.190 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.814+0000 7f1462dfa700 1 --2- 172.21.15.152:0/3903410814 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f144c0365a0 0x7f144c038a50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:30.190 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.814+0000 7f1462dfa700 1 --2- 172.21.15.152:0/3903410814 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f145c078d00 0x7f145c113310 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:30.190 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.814+0000 7f1462dfa700 1 -- 172.21.15.152:0/3903410814 >> 172.21.15.152:0/3903410814 conn(0x7f145c0fda10 msgr2=0x7f145c0ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:30.190 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.814+0000 7f1462dfa700 1 -- 172.21.15.152:0/3903410814 shutdown_connections 2023-12-06T14:53:30.190 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:29.814+0000 7f1462dfa700 1 -- 172.21.15.152:0/3903410814 wait complete. 2023-12-06T14:53:30.190 INFO:teuthology.orchestra.run.smithi152.stdout:Generating ssh key... 2023-12-06T14:53:31.270 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:30 smithi152 ceph-mon[111954]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:53:31.344 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.520+0000 7f353ac7a700 1 Processor -- start 2023-12-06T14:53:31.344 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.520+0000 7f353ac7a700 1 -- start start 2023-12-06T14:53:31.344 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.521+0000 7f353ac7a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3534102900 0x7f3534102d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:31.344 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.521+0000 7f353ac7a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3534103250 con 0x7f3534102900 2023-12-06T14:53:31.344 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.521+0000 7f3538a16700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3534102900 0x7f3534102d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:31.344 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.521+0000 7f3538a16700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3534102900 0x7f3534102d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57620/0 (socket says 172.21.15.152:57620) 2023-12-06T14:53:31.344 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.521+0000 7f3538a16700 1 -- 172.21.15.152:0/2479340765 learned_addr learned my addr 172.21.15.152:0/2479340765 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:31.344 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.521+0000 7f3538a16700 1 -- 172.21.15.152:0/2479340765 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3534103390 con 0x7f3534102900 2023-12-06T14:53:31.345 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.521+0000 7f3538a16700 1 --2- 172.21.15.152:0/2479340765 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3534102900 0x7f3534102d10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f35280098e0 tx=0x7f3528009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af30e306285072a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:31.345 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.521+0000 7f35337fe700 1 -- 172.21.15.152:0/2479340765 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f352800b860 con 0x7f3534102900 2023-12-06T14:53:31.345 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.521+0000 7f35337fe700 1 -- 172.21.15.152:0/2479340765 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f352800be30 con 0x7f3534102900 2023-12-06T14:53:31.345 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.521+0000 7f35337fe700 1 -- 172.21.15.152:0/2479340765 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3528010380 con 0x7f3534102900 2023-12-06T14:53:31.345 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.522+0000 7f353ac7a700 1 -- 172.21.15.152:0/2479340765 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3534102900 msgr2=0x7f3534102d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:31.345 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.522+0000 7f353ac7a700 1 --2- 172.21.15.152:0/2479340765 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3534102900 0x7f3534102d10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f35280098e0 tx=0x7f3528009250 comp rx=0 tx=0).stop 2023-12-06T14:53:31.345 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.522+0000 7f353ac7a700 1 -- 172.21.15.152:0/2479340765 shutdown_connections 2023-12-06T14:53:31.345 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.522+0000 7f353ac7a700 1 --2- 172.21.15.152:0/2479340765 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3534102900 0x7f3534102d10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:31.345 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.522+0000 7f353ac7a700 1 -- 172.21.15.152:0/2479340765 >> 172.21.15.152:0/2479340765 conn(0x7f35340fc0b0 msgr2=0x7f35340fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:31.345 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.522+0000 7f353ac7a700 1 -- 172.21.15.152:0/2479340765 shutdown_connections 2023-12-06T14:53:31.345 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.522+0000 7f353ac7a700 1 -- 172.21.15.152:0/2479340765 wait complete. 2023-12-06T14:53:31.345 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.522+0000 7f353ac7a700 1 Processor -- start 2023-12-06T14:53:31.345 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.523+0000 7f353ac7a700 1 -- start start 2023-12-06T14:53:31.345 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.523+0000 7f353ac7a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3534102900 0x7f3534113320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:31.346 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.523+0000 7f353ac7a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3534113860 con 0x7f3534102900 2023-12-06T14:53:31.346 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.523+0000 7f3538a16700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3534102900 0x7f3534113320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:31.346 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.523+0000 7f3538a16700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3534102900 0x7f3534113320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57624/0 (socket says 172.21.15.152:57624) 2023-12-06T14:53:31.346 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.523+0000 7f3538a16700 1 -- 172.21.15.152:0/2652196710 learned_addr learned my addr 172.21.15.152:0/2652196710 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:31.346 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.523+0000 7f3538a16700 1 -- 172.21.15.152:0/2652196710 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35280094f0 con 0x7f3534102900 2023-12-06T14:53:31.346 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.523+0000 7f3538a16700 1 --2- 172.21.15.152:0/2652196710 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3534102900 0x7f3534113320 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3528006b00 tx=0x7f3528009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:31.346 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.523+0000 7f35317fa700 1 -- 172.21.15.152:0/2652196710 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f35280109b0 con 0x7f3534102900 2023-12-06T14:53:31.346 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.524+0000 7f35317fa700 1 -- 172.21.15.152:0/2652196710 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f3528024440 con 0x7f3534102900 2023-12-06T14:53:31.346 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.524+0000 7f353ac7a700 1 -- 172.21.15.152:0/2652196710 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3534113a60 con 0x7f3534102900 2023-12-06T14:53:31.346 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.524+0000 7f35317fa700 1 -- 172.21.15.152:0/2652196710 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f352801a5f0 con 0x7f3534102900 2023-12-06T14:53:31.346 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.524+0000 7f353ac7a700 1 -- 172.21.15.152:0/2652196710 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3534113e70 con 0x7f3534102900 2023-12-06T14:53:31.346 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.524+0000 7f35317fa700 1 -- 172.21.15.152:0/2652196710 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f3528010b10 con 0x7f3534102900 2023-12-06T14:53:31.346 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.525+0000 7f35317fa700 1 --2- 172.21.15.152:0/2652196710 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f3524036640 0x7f3524038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:31.346 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.525+0000 7f353ac7a700 1 -- 172.21.15.152:0/2652196710 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f353404bb80 con 0x7f3534102900 2023-12-06T14:53:31.347 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.525+0000 7f35317fa700 1 -- 172.21.15.152:0/2652196710 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f352804a560 con 0x7f3534102900 2023-12-06T14:53:31.347 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.525+0000 7f3533fff700 1 --2- 172.21.15.152:0/2652196710 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f3524036640 0x7f3524038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:31.347 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.525+0000 7f3533fff700 1 --2- 172.21.15.152:0/2652196710 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f3524036640 0x7f3524038af0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3520009990 tx=0x7f3520006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:31.347 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.529+0000 7f35317fa700 1 -- 172.21.15.152:0/2652196710 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f352802d3f0 con 0x7f3534102900 2023-12-06T14:53:31.347 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.712+0000 7f353ac7a700 1 -- 172.21.15.152:0/2652196710 --> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f353410d1d0 con 0x7f3524036640 2023-12-06T14:53:31.347 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.991+0000 7f35317fa700 1 -- 172.21.15.152:0/2652196710 <== mgr.14120 v2:172.21.15.152:6800/2466555973 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f353410d1d0 con 0x7f3524036640 2023-12-06T14:53:31.347 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.994+0000 7f353ac7a700 1 -- 172.21.15.152:0/2652196710 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f3524036640 msgr2=0x7f3524038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:31.347 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.994+0000 7f353ac7a700 1 --2- 172.21.15.152:0/2652196710 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f3524036640 0x7f3524038af0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3520009990 tx=0x7f3520006e40 comp rx=0 tx=0).stop 2023-12-06T14:53:31.347 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.994+0000 7f353ac7a700 1 -- 172.21.15.152:0/2652196710 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3534102900 msgr2=0x7f3534113320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:31.347 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.994+0000 7f353ac7a700 1 --2- 172.21.15.152:0/2652196710 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3534102900 0x7f3534113320 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3528006b00 tx=0x7f3528009250 comp rx=0 tx=0).stop 2023-12-06T14:53:31.347 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.994+0000 7f353ac7a700 1 -- 172.21.15.152:0/2652196710 shutdown_connections 2023-12-06T14:53:31.347 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.994+0000 7f353ac7a700 1 --2- 172.21.15.152:0/2652196710 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f3524036640 0x7f3524038af0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:31.347 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.994+0000 7f353ac7a700 1 --2- 172.21.15.152:0/2652196710 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3534102900 0x7f3534113320 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:31.347 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.994+0000 7f353ac7a700 1 -- 172.21.15.152:0/2652196710 >> 172.21.15.152:0/2652196710 conn(0x7f35340fc0b0 msgr2=0x7f35340fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:31.347 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.994+0000 7f353ac7a700 1 -- 172.21.15.152:0/2652196710 shutdown_connections 2023-12-06T14:53:31.348 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:30.994+0000 7f353ac7a700 1 -- 172.21.15.152:0/2652196710 wait complete. 2023-12-06T14:53:32.225 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:31 smithi152 ceph-mon[111954]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:53:32.225 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:31 smithi152 ceph-mon[111954]: Generating ssh key... 2023-12-06T14:53:32.225 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:31 smithi152 ceph-mon[111954]: from='mgr.14120 172.21.15.152:0/303232505' entity='mgr.smithi152.meodco' 2023-12-06T14:53:32.225 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:31 smithi152 ceph-mon[111954]: from='mgr.14120 172.21.15.152:0/303232505' entity='mgr.smithi152.meodco' 2023-12-06T14:53:32.278 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGyyG9PvXCCnTrFbdGkzdwKQmJpSu50ql4YSNPuBVqNzXAgwI83oy/8zEtANPL3z0iHPho1DhhBpxVohaDTXy42BS6j6tloHxWGUmJESFTwvRZR8beW3kRI3Q0ViDQftcMjRIJG5mCQ4cjhXdlIZ2j+pywOw3GfqWyo7VCvwoovHDkXC8BwHX9Byajs1j84rXU6k3cjNkp+5nj8BNFFmHZSHXZV8oAgJjbUlaNpzpNPpk/rlOUeBQu4OnDM5hl/B5mNP7Ea7JO4wTVGq/BqXtcB8cWKcLMvfdKRgUPSUE1EL1xCRfwr1UvJDNx3bzdA0ohir+HCU5gxRL3MABIYxUno67o4Sny8IxwHlNF+a7/ywkxZE/sHm4nLezF5D9pSa4LaRRpECzhHpTVOjD5pBAIJbADHOzR8OFEpm62xhsP+kQ1oBRyW6J6NWSppHOAjRE1flt5D3lLz9pYzvgwtna4kzqAO2os2eoCODMnwmqayxMSL0oOUC2iywFrxNclD+M= ceph-062f0e3c-9447-11ee-95a2-87774f69a715 2023-12-06T14:53:32.278 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.729+0000 7fbb8afb7700 1 Processor -- start 2023-12-06T14:53:32.278 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.729+0000 7fbb8afb7700 1 -- start start 2023-12-06T14:53:32.278 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.729+0000 7fbb8afb7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb84071000 0x7fbb84104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:32.278 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.729+0000 7fbb8afb7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb841053e0 con 0x7fbb84071000 2023-12-06T14:53:32.279 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.729+0000 7fbb88d53700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb84071000 0x7fbb84104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:32.279 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.729+0000 7fbb88d53700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb84071000 0x7fbb84104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57632/0 (socket says 172.21.15.152:57632) 2023-12-06T14:53:32.279 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.729+0000 7fbb88d53700 1 -- 172.21.15.152:0/1556943312 learned_addr learned my addr 172.21.15.152:0/1556943312 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:32.279 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.729+0000 7fbb88d53700 1 -- 172.21.15.152:0/1556943312 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb84105520 con 0x7fbb84071000 2023-12-06T14:53:32.279 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.729+0000 7fbb88d53700 1 --2- 172.21.15.152:0/1556943312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb84071000 0x7fbb84104ea0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbb780098e0 tx=0x7fbb78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d1ca855f473219 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:32.279 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.730+0000 7fbb837fe700 1 -- 172.21.15.152:0/1556943312 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb7800b860 con 0x7fbb84071000 2023-12-06T14:53:32.279 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.730+0000 7fbb837fe700 1 -- 172.21.15.152:0/1556943312 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fbb7800be30 con 0x7fbb84071000 2023-12-06T14:53:32.279 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.730+0000 7fbb837fe700 1 -- 172.21.15.152:0/1556943312 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb78010380 con 0x7fbb84071000 2023-12-06T14:53:32.279 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.730+0000 7fbb8afb7700 1 -- 172.21.15.152:0/1556943312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb84071000 msgr2=0x7fbb84104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:32.279 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.730+0000 7fbb8afb7700 1 --2- 172.21.15.152:0/1556943312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb84071000 0x7fbb84104ea0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbb780098e0 tx=0x7fbb78009250 comp rx=0 tx=0).stop 2023-12-06T14:53:32.279 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.730+0000 7fbb8afb7700 1 -- 172.21.15.152:0/1556943312 shutdown_connections 2023-12-06T14:53:32.279 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.730+0000 7fbb8afb7700 1 --2- 172.21.15.152:0/1556943312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb84071000 0x7fbb84104ea0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:32.279 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.730+0000 7fbb8afb7700 1 -- 172.21.15.152:0/1556943312 >> 172.21.15.152:0/1556943312 conn(0x7fbb840fc970 msgr2=0x7fbb840fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:32.280 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.730+0000 7fbb8afb7700 1 -- 172.21.15.152:0/1556943312 shutdown_connections 2023-12-06T14:53:32.280 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.730+0000 7fbb8afb7700 1 -- 172.21.15.152:0/1556943312 wait complete. 2023-12-06T14:53:32.280 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.731+0000 7fbb8afb7700 1 Processor -- start 2023-12-06T14:53:32.280 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.731+0000 7fbb8afb7700 1 -- start start 2023-12-06T14:53:32.280 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.731+0000 7fbb8afb7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb84071000 0x7fbb84102920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:32.280 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.731+0000 7fbb8afb7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb84100da0 con 0x7fbb84071000 2023-12-06T14:53:32.280 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.731+0000 7fbb88d53700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb84071000 0x7fbb84102920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:32.280 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.731+0000 7fbb88d53700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb84071000 0x7fbb84102920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57640/0 (socket says 172.21.15.152:57640) 2023-12-06T14:53:32.280 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.731+0000 7fbb88d53700 1 -- 172.21.15.152:0/697261383 learned_addr learned my addr 172.21.15.152:0/697261383 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:32.280 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.731+0000 7fbb88d53700 1 -- 172.21.15.152:0/697261383 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb780094f0 con 0x7fbb84071000 2023-12-06T14:53:32.280 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.732+0000 7fbb88d53700 1 --2- 172.21.15.152:0/697261383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb84071000 0x7fbb84102920 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbb78006b00 tx=0x7fbb78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:32.280 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.732+0000 7fbb817fa700 1 -- 172.21.15.152:0/697261383 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb78010a80 con 0x7fbb84071000 2023-12-06T14:53:32.280 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.732+0000 7fbb817fa700 1 -- 172.21.15.152:0/697261383 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fbb7801a430 con 0x7fbb84071000 2023-12-06T14:53:32.280 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.732+0000 7fbb8afb7700 1 -- 172.21.15.152:0/697261383 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb84100fa0 con 0x7fbb84071000 2023-12-06T14:53:32.280 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.732+0000 7fbb817fa700 1 -- 172.21.15.152:0/697261383 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb780245b0 con 0x7fbb84071000 2023-12-06T14:53:32.281 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.732+0000 7fbb8afb7700 1 -- 172.21.15.152:0/697261383 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb841013b0 con 0x7fbb84071000 2023-12-06T14:53:32.281 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.733+0000 7fbb817fa700 1 -- 172.21.15.152:0/697261383 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fbb78010be0 con 0x7fbb84071000 2023-12-06T14:53:32.281 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.733+0000 7fbb8afb7700 1 -- 172.21.15.152:0/697261383 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb8404bb80 con 0x7fbb84071000 2023-12-06T14:53:32.281 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.733+0000 7fbb817fa700 1 --2- 172.21.15.152:0/697261383 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7fbb74036640 0x7fbb74038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:32.281 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.733+0000 7fbb817fa700 1 -- 172.21.15.152:0/697261383 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fbb7804aaf0 con 0x7fbb84071000 2023-12-06T14:53:32.281 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.733+0000 7fbb83fff700 1 --2- 172.21.15.152:0/697261383 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7fbb74036640 0x7fbb74038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:32.281 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.733+0000 7fbb83fff700 1 --2- 172.21.15.152:0/697261383 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7fbb74036640 0x7fbb74038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbb70009990 tx=0x7fbb70006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:32.281 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.737+0000 7fbb817fa700 1 -- 172.21.15.152:0/697261383 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fbb7801a5a0 con 0x7fbb84071000 2023-12-06T14:53:32.281 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.921+0000 7fbb8afb7700 1 -- 172.21.15.152:0/697261383 --> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb8410adb0 con 0x7fbb74036640 2023-12-06T14:53:32.281 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.921+0000 7fbb817fa700 1 -- 172.21.15.152:0/697261383 <== mgr.14120 v2:172.21.15.152:6800/2466555973 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7fbb8410adb0 con 0x7fbb74036640 2023-12-06T14:53:32.281 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.923+0000 7fbb8afb7700 1 -- 172.21.15.152:0/697261383 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7fbb74036640 msgr2=0x7fbb74038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:32.281 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.923+0000 7fbb8afb7700 1 --2- 172.21.15.152:0/697261383 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7fbb74036640 0x7fbb74038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbb70009990 tx=0x7fbb70006e40 comp rx=0 tx=0).stop 2023-12-06T14:53:32.281 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.923+0000 7fbb8afb7700 1 -- 172.21.15.152:0/697261383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb84071000 msgr2=0x7fbb84102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:32.281 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.923+0000 7fbb8afb7700 1 --2- 172.21.15.152:0/697261383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb84071000 0x7fbb84102920 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbb78006b00 tx=0x7fbb78009250 comp rx=0 tx=0).stop 2023-12-06T14:53:32.282 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.924+0000 7fbb8afb7700 1 -- 172.21.15.152:0/697261383 shutdown_connections 2023-12-06T14:53:32.282 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.924+0000 7fbb8afb7700 1 --2- 172.21.15.152:0/697261383 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7fbb74036640 0x7fbb74038af0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:32.282 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.924+0000 7fbb8afb7700 1 --2- 172.21.15.152:0/697261383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb84071000 0x7fbb84102920 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:32.282 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.924+0000 7fbb8afb7700 1 -- 172.21.15.152:0/697261383 >> 172.21.15.152:0/697261383 conn(0x7fbb840fc970 msgr2=0x7fbb840fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:32.282 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.924+0000 7fbb8afb7700 1 -- 172.21.15.152:0/697261383 shutdown_connections 2023-12-06T14:53:32.282 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:31.924+0000 7fbb8afb7700 1 -- 172.21.15.152:0/697261383 wait complete. 2023-12-06T14:53:32.282 INFO:teuthology.orchestra.run.smithi152.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-12-06T14:53:32.282 INFO:teuthology.orchestra.run.smithi152.stdout:Adding key to root@localhost authorized_keys... 2023-12-06T14:53:32.282 INFO:teuthology.orchestra.run.smithi152.stdout:Adding host smithi152... 2023-12-06T14:53:33.127 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:32 smithi152 ceph-mon[111954]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:53:34.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:33 smithi152 ceph-mon[111954]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi152", "addr": "172.21.15.152", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:53:34.763 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout Added host 'smithi152' with addr '172.21.15.152' 2023-12-06T14:53:34.763 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.619+0000 7fc96d601700 1 Processor -- start 2023-12-06T14:53:34.763 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.620+0000 7fc96d601700 1 -- start start 2023-12-06T14:53:34.764 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.620+0000 7fc96d601700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc968102900 0x7fc968102d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:34.764 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.620+0000 7fc96d601700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc968103250 con 0x7fc968102900 2023-12-06T14:53:34.764 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.620+0000 7fc966ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc968102900 0x7fc968102d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:34.764 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.620+0000 7fc966ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc968102900 0x7fc968102d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57650/0 (socket says 172.21.15.152:57650) 2023-12-06T14:53:34.764 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.620+0000 7fc966ffd700 1 -- 172.21.15.152:0/3990193143 learned_addr learned my addr 172.21.15.152:0/3990193143 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:34.764 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.620+0000 7fc966ffd700 1 -- 172.21.15.152:0/3990193143 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc968103390 con 0x7fc968102900 2023-12-06T14:53:34.764 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.620+0000 7fc966ffd700 1 --2- 172.21.15.152:0/3990193143 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc968102900 0x7fc968102d10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc9580098e0 tx=0x7fc958009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a997a3319e7c574 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:34.764 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.620+0000 7fc965ffb700 1 -- 172.21.15.152:0/3990193143 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc95800b860 con 0x7fc968102900 2023-12-06T14:53:34.764 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.620+0000 7fc965ffb700 1 -- 172.21.15.152:0/3990193143 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fc95800be30 con 0x7fc968102900 2023-12-06T14:53:34.764 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.620+0000 7fc965ffb700 1 -- 172.21.15.152:0/3990193143 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc958010380 con 0x7fc968102900 2023-12-06T14:53:34.764 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.621+0000 7fc96d601700 1 -- 172.21.15.152:0/3990193143 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc968102900 msgr2=0x7fc968102d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:34.764 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.621+0000 7fc96d601700 1 --2- 172.21.15.152:0/3990193143 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc968102900 0x7fc968102d10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc9580098e0 tx=0x7fc958009250 comp rx=0 tx=0).stop 2023-12-06T14:53:34.764 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.621+0000 7fc96d601700 1 -- 172.21.15.152:0/3990193143 shutdown_connections 2023-12-06T14:53:34.764 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.621+0000 7fc96d601700 1 --2- 172.21.15.152:0/3990193143 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc968102900 0x7fc968102d10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:34.765 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.621+0000 7fc96d601700 1 -- 172.21.15.152:0/3990193143 >> 172.21.15.152:0/3990193143 conn(0x7fc9680fc0b0 msgr2=0x7fc9680fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:34.765 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.621+0000 7fc96d601700 1 -- 172.21.15.152:0/3990193143 shutdown_connections 2023-12-06T14:53:34.765 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.621+0000 7fc96d601700 1 -- 172.21.15.152:0/3990193143 wait complete. 2023-12-06T14:53:34.765 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.622+0000 7fc96d601700 1 Processor -- start 2023-12-06T14:53:34.765 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.622+0000 7fc96d601700 1 -- start start 2023-12-06T14:53:34.765 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.622+0000 7fc96d601700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc968102900 0x7fc968113350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:34.765 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.622+0000 7fc96d601700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc968113890 con 0x7fc968102900 2023-12-06T14:53:34.765 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.622+0000 7fc966ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc968102900 0x7fc968113350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:34.765 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.622+0000 7fc966ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc968102900 0x7fc968113350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57666/0 (socket says 172.21.15.152:57666) 2023-12-06T14:53:34.765 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.622+0000 7fc966ffd700 1 -- 172.21.15.152:0/3319112352 learned_addr learned my addr 172.21.15.152:0/3319112352 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:34.765 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.622+0000 7fc966ffd700 1 -- 172.21.15.152:0/3319112352 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9580094f0 con 0x7fc968102900 2023-12-06T14:53:34.765 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.622+0000 7fc966ffd700 1 --2- 172.21.15.152:0/3319112352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc968102900 0x7fc968113350 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc958006b00 tx=0x7fc958009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:34.765 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.622+0000 7fc95f7fe700 1 -- 172.21.15.152:0/3319112352 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc9580109b0 con 0x7fc968102900 2023-12-06T14:53:34.765 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.622+0000 7fc95f7fe700 1 -- 172.21.15.152:0/3319112352 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7fc958024440 con 0x7fc968102900 2023-12-06T14:53:34.765 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.622+0000 7fc95f7fe700 1 -- 172.21.15.152:0/3319112352 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc95801a5f0 con 0x7fc968102900 2023-12-06T14:53:34.766 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.623+0000 7fc96d601700 1 -- 172.21.15.152:0/3319112352 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc968113a90 con 0x7fc968102900 2023-12-06T14:53:34.766 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.623+0000 7fc96d601700 1 -- 172.21.15.152:0/3319112352 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc968113ea0 con 0x7fc968102900 2023-12-06T14:53:34.766 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.623+0000 7fc95f7fe700 1 -- 172.21.15.152:0/3319112352 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fc95801a860 con 0x7fc968102900 2023-12-06T14:53:34.766 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.623+0000 7fc95f7fe700 1 --2- 172.21.15.152:0/3319112352 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7fc954036640 0x7fc954038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:34.766 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.623+0000 7fc95f7fe700 1 -- 172.21.15.152:0/3319112352 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fc95804a590 con 0x7fc968102900 2023-12-06T14:53:34.766 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.624+0000 7fc9667fc700 1 --2- 172.21.15.152:0/3319112352 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7fc954036640 0x7fc954038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:34.766 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.624+0000 7fc96d601700 1 -- 172.21.15.152:0/3319112352 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc96804bb80 con 0x7fc968102900 2023-12-06T14:53:34.766 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.624+0000 7fc9667fc700 1 --2- 172.21.15.152:0/3319112352 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7fc954036640 0x7fc954038af0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc950009990 tx=0x7fc950006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:34.766 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.628+0000 7fc95f7fe700 1 -- 172.21.15.152:0/3319112352 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc95801ab60 con 0x7fc968102900 2023-12-06T14:53:34.766 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:32.815+0000 7fc96d601700 1 -- 172.21.15.152:0/3319112352 --> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi152", "addr": "172.21.15.152", "target": ["mon-mgr", ""]}) v1 -- 0x7fc96810ce90 con 0x7fc954036640 2023-12-06T14:53:34.766 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:34.447+0000 7fc95f7fe700 1 -- 172.21.15.152:0/3319112352 <== mgr.14120 v2:172.21.15.152:6800/2466555973 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fc96810ce90 con 0x7fc954036640 2023-12-06T14:53:34.766 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:34.449+0000 7fc96d601700 1 -- 172.21.15.152:0/3319112352 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7fc954036640 msgr2=0x7fc954038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:34.766 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:34.449+0000 7fc96d601700 1 --2- 172.21.15.152:0/3319112352 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7fc954036640 0x7fc954038af0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc950009990 tx=0x7fc950006e40 comp rx=0 tx=0).stop 2023-12-06T14:53:34.766 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:34.449+0000 7fc96d601700 1 -- 172.21.15.152:0/3319112352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc968102900 msgr2=0x7fc968113350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:34.767 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:34.449+0000 7fc96d601700 1 --2- 172.21.15.152:0/3319112352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc968102900 0x7fc968113350 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc958006b00 tx=0x7fc958009250 comp rx=0 tx=0).stop 2023-12-06T14:53:34.767 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:34.450+0000 7fc96d601700 1 -- 172.21.15.152:0/3319112352 shutdown_connections 2023-12-06T14:53:34.767 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:34.450+0000 7fc96d601700 1 --2- 172.21.15.152:0/3319112352 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7fc954036640 0x7fc954038af0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:34.767 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:34.450+0000 7fc96d601700 1 --2- 172.21.15.152:0/3319112352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc968102900 0x7fc968113350 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:34.767 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:34.450+0000 7fc96d601700 1 -- 172.21.15.152:0/3319112352 >> 172.21.15.152:0/3319112352 conn(0x7fc9680fc0b0 msgr2=0x7fc9680fe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:34.767 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:34.450+0000 7fc96d601700 1 -- 172.21.15.152:0/3319112352 shutdown_connections 2023-12-06T14:53:34.767 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:34.450+0000 7fc96d601700 1 -- 172.21.15.152:0/3319112352 wait complete. 2023-12-06T14:53:34.767 INFO:teuthology.orchestra.run.smithi152.stdout:Deploying mon service with default placement... 2023-12-06T14:53:35.127 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:34 smithi152 ceph-mon[111954]: Deploying cephadm binary to smithi152 2023-12-06T14:53:35.127 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:34 smithi152 ceph-mon[111954]: from='mgr.14120 172.21.15.152:0/303232505' entity='mgr.smithi152.meodco' 2023-12-06T14:53:35.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:34 smithi152 ceph-mon[111954]: from='mgr.14120 172.21.15.152:0/303232505' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:53:35.786 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-12-06T14:53:35.786 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.170+0000 7f3e61a3a700 1 Processor -- start 2023-12-06T14:53:35.786 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.170+0000 7f3e61a3a700 1 -- start start 2023-12-06T14:53:35.786 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.170+0000 7f3e61a3a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e5c1011c0 0x7f3e5c1015d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:35.786 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.170+0000 7f3e61a3a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c101b10 con 0x7f3e5c1011c0 2023-12-06T14:53:35.787 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.171+0000 7f3e5affd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e5c1011c0 0x7f3e5c1015d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:35.787 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.171+0000 7f3e5affd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e5c1011c0 0x7f3e5c1015d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57682/0 (socket says 172.21.15.152:57682) 2023-12-06T14:53:35.787 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.171+0000 7f3e5affd700 1 -- 172.21.15.152:0/111932502 learned_addr learned my addr 172.21.15.152:0/111932502 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:35.787 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.171+0000 7f3e5affd700 1 -- 172.21.15.152:0/111932502 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e5c101c50 con 0x7f3e5c1011c0 2023-12-06T14:53:35.787 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.171+0000 7f3e5affd700 1 --2- 172.21.15.152:0/111932502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e5c1011c0 0x7f3e5c1015d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3e540098e0 tx=0x7f3e54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=396abd6637c6f153 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:35.787 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.171+0000 7f3e59ffb700 1 -- 172.21.15.152:0/111932502 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e5400b860 con 0x7f3e5c1011c0 2023-12-06T14:53:35.787 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.171+0000 7f3e59ffb700 1 -- 172.21.15.152:0/111932502 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f3e5400be30 con 0x7f3e5c1011c0 2023-12-06T14:53:35.787 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.171+0000 7f3e59ffb700 1 -- 172.21.15.152:0/111932502 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e54010380 con 0x7f3e5c1011c0 2023-12-06T14:53:35.787 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.172+0000 7f3e61a3a700 1 -- 172.21.15.152:0/111932502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e5c1011c0 msgr2=0x7f3e5c1015d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:35.787 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.172+0000 7f3e61a3a700 1 --2- 172.21.15.152:0/111932502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e5c1011c0 0x7f3e5c1015d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3e540098e0 tx=0x7f3e54009250 comp rx=0 tx=0).stop 2023-12-06T14:53:35.787 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.172+0000 7f3e61a3a700 1 -- 172.21.15.152:0/111932502 shutdown_connections 2023-12-06T14:53:35.787 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.172+0000 7f3e61a3a700 1 --2- 172.21.15.152:0/111932502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e5c1011c0 0x7f3e5c1015d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:35.787 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.172+0000 7f3e61a3a700 1 -- 172.21.15.152:0/111932502 >> 172.21.15.152:0/111932502 conn(0x7f3e5c0fc980 msgr2=0x7f3e5c0fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:35.787 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.172+0000 7f3e61a3a700 1 -- 172.21.15.152:0/111932502 shutdown_connections 2023-12-06T14:53:35.787 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.172+0000 7f3e61a3a700 1 -- 172.21.15.152:0/111932502 wait complete. 2023-12-06T14:53:35.788 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.173+0000 7f3e61a3a700 1 Processor -- start 2023-12-06T14:53:35.788 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.173+0000 7f3e61a3a700 1 -- start start 2023-12-06T14:53:35.788 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.173+0000 7f3e61a3a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e5c1011c0 0x7f3e5c107560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:35.788 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.173+0000 7f3e61a3a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c1059e0 con 0x7f3e5c1011c0 2023-12-06T14:53:35.788 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.173+0000 7f3e5affd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e5c1011c0 0x7f3e5c107560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:35.788 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.173+0000 7f3e5affd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e5c1011c0 0x7f3e5c107560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57696/0 (socket says 172.21.15.152:57696) 2023-12-06T14:53:35.788 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.173+0000 7f3e5affd700 1 -- 172.21.15.152:0/3183002160 learned_addr learned my addr 172.21.15.152:0/3183002160 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:35.788 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.174+0000 7f3e5affd700 1 -- 172.21.15.152:0/3183002160 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e540094f0 con 0x7f3e5c1011c0 2023-12-06T14:53:35.788 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.174+0000 7f3e5affd700 1 --2- 172.21.15.152:0/3183002160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e5c1011c0 0x7f3e5c107560 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3e54006b00 tx=0x7f3e54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:35.788 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.174+0000 7f3e437fe700 1 -- 172.21.15.152:0/3183002160 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e540109b0 con 0x7f3e5c1011c0 2023-12-06T14:53:35.788 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.174+0000 7f3e437fe700 1 -- 172.21.15.152:0/3183002160 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1009+0+0 (secure 0 0 0) 0x7f3e54024440 con 0x7f3e5c1011c0 2023-12-06T14:53:35.788 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.174+0000 7f3e61a3a700 1 -- 172.21.15.152:0/3183002160 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e5c105be0 con 0x7f3e5c1011c0 2023-12-06T14:53:35.788 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.174+0000 7f3e437fe700 1 -- 172.21.15.152:0/3183002160 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e5401a5f0 con 0x7f3e5c1011c0 2023-12-06T14:53:35.788 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.174+0000 7f3e61a3a700 1 -- 172.21.15.152:0/3183002160 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e5c105ff0 con 0x7f3e5c1011c0 2023-12-06T14:53:35.789 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.175+0000 7f3e437fe700 1 -- 172.21.15.152:0/3183002160 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f3e5401a860 con 0x7f3e5c1011c0 2023-12-06T14:53:35.789 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.175+0000 7f3e437fe700 1 --2- 172.21.15.152:0/3183002160 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f3e44036640 0x7f3e44038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:35.789 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.175+0000 7f3e437fe700 1 -- 172.21.15.152:0/3183002160 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f3e5404b510 con 0x7f3e5c1011c0 2023-12-06T14:53:35.789 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.175+0000 7f3e5a7fc700 1 --2- 172.21.15.152:0/3183002160 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f3e44036640 0x7f3e44038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:35.789 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.175+0000 7f3e61a3a700 1 -- 172.21.15.152:0/3183002160 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e5c05f270 con 0x7f3e5c1011c0 2023-12-06T14:53:35.789 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.176+0000 7f3e5a7fc700 1 --2- 172.21.15.152:0/3183002160 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f3e44036640 0x7f3e44038af0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3e50009990 tx=0x7f3e50006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:35.789 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.180+0000 7f3e437fe700 1 -- 172.21.15.152:0/3183002160 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3e5401ab60 con 0x7f3e5c1011c0 2023-12-06T14:53:35.789 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.384+0000 7f3e61a3a700 1 -- 172.21.15.152:0/3183002160 --> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e5c106370 con 0x7f3e44036640 2023-12-06T14:53:35.789 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.389+0000 7f3e437fe700 1 -- 172.21.15.152:0/3183002160 <== mgr.14120 v2:172.21.15.152:6800/2466555973 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f3e5c106370 con 0x7f3e44036640 2023-12-06T14:53:35.789 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.392+0000 7f3e61a3a700 1 -- 172.21.15.152:0/3183002160 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f3e44036640 msgr2=0x7f3e44038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:35.789 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.392+0000 7f3e61a3a700 1 --2- 172.21.15.152:0/3183002160 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f3e44036640 0x7f3e44038af0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3e50009990 tx=0x7f3e50006e40 comp rx=0 tx=0).stop 2023-12-06T14:53:35.789 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.392+0000 7f3e61a3a700 1 -- 172.21.15.152:0/3183002160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e5c1011c0 msgr2=0x7f3e5c107560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:35.789 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.392+0000 7f3e61a3a700 1 --2- 172.21.15.152:0/3183002160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e5c1011c0 0x7f3e5c107560 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3e54006b00 tx=0x7f3e54009250 comp rx=0 tx=0).stop 2023-12-06T14:53:35.789 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.393+0000 7f3e61a3a700 1 -- 172.21.15.152:0/3183002160 shutdown_connections 2023-12-06T14:53:35.790 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.393+0000 7f3e61a3a700 1 --2- 172.21.15.152:0/3183002160 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f3e44036640 0x7f3e44038af0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:35.790 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.393+0000 7f3e61a3a700 1 --2- 172.21.15.152:0/3183002160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e5c1011c0 0x7f3e5c107560 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:35.790 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.393+0000 7f3e61a3a700 1 -- 172.21.15.152:0/3183002160 >> 172.21.15.152:0/3183002160 conn(0x7f3e5c0fc980 msgr2=0x7f3e5c0767f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:35.790 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.393+0000 7f3e61a3a700 1 -- 172.21.15.152:0/3183002160 shutdown_connections 2023-12-06T14:53:35.790 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:35.393+0000 7f3e61a3a700 1 -- 172.21.15.152:0/3183002160 wait complete. 2023-12-06T14:53:35.790 INFO:teuthology.orchestra.run.smithi152.stdout:Deploying mgr service with default placement... 2023-12-06T14:53:36.377 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:35 smithi152 ceph-mon[111954]: Added host smithi152 2023-12-06T14:53:36.377 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:35 smithi152 ceph-mon[111954]: from='mgr.14120 172.21.15.152:0/303232505' entity='mgr.smithi152.meodco' 2023-12-06T14:53:36.803 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-12-06T14:53:36.804 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.236+0000 7f52a4b40700 1 Processor -- start 2023-12-06T14:53:36.804 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.236+0000 7f52a4b40700 1 -- start start 2023-12-06T14:53:36.804 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.236+0000 7f52a4b40700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52a0076c20 0x7f52a0104ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:36.804 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.236+0000 7f52a4b40700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a0105420 con 0x7f52a0076c20 2023-12-06T14:53:36.804 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.236+0000 7f529e59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52a0076c20 0x7f52a0104ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:36.804 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.237+0000 7f529e59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52a0076c20 0x7f52a0104ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57704/0 (socket says 172.21.15.152:57704) 2023-12-06T14:53:36.804 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.237+0000 7f529e59c700 1 -- 172.21.15.152:0/2777167603 learned_addr learned my addr 172.21.15.152:0/2777167603 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:36.804 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.237+0000 7f529e59c700 1 -- 172.21.15.152:0/2777167603 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a0105560 con 0x7f52a0076c20 2023-12-06T14:53:36.804 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.237+0000 7f529e59c700 1 --2- 172.21.15.152:0/2777167603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52a0076c20 0x7f52a0104ee0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f52900098e0 tx=0x7f5290009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a418973e049dd2e server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:36.805 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.237+0000 7f529d59a700 1 -- 172.21.15.152:0/2777167603 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f529000b860 con 0x7f52a0076c20 2023-12-06T14:53:36.805 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.237+0000 7f529d59a700 1 -- 172.21.15.152:0/2777167603 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f529000be70 con 0x7f52a0076c20 2023-12-06T14:53:36.805 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.237+0000 7f529d59a700 1 -- 172.21.15.152:0/2777167603 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5290010380 con 0x7f52a0076c20 2023-12-06T14:53:36.805 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.238+0000 7f52a4b40700 1 -- 172.21.15.152:0/2777167603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52a0076c20 msgr2=0x7f52a0104ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:36.805 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.238+0000 7f52a4b40700 1 --2- 172.21.15.152:0/2777167603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52a0076c20 0x7f52a0104ee0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f52900098e0 tx=0x7f5290009250 comp rx=0 tx=0).stop 2023-12-06T14:53:36.805 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.238+0000 7f52a4b40700 1 -- 172.21.15.152:0/2777167603 shutdown_connections 2023-12-06T14:53:36.805 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.238+0000 7f52a4b40700 1 --2- 172.21.15.152:0/2777167603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52a0076c20 0x7f52a0104ee0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:36.805 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.238+0000 7f52a4b40700 1 -- 172.21.15.152:0/2777167603 >> 172.21.15.152:0/2777167603 conn(0x7f52a00fc950 msgr2=0x7f52a00fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:36.805 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.238+0000 7f52a4b40700 1 -- 172.21.15.152:0/2777167603 shutdown_connections 2023-12-06T14:53:36.805 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.238+0000 7f52a4b40700 1 -- 172.21.15.152:0/2777167603 wait complete. 2023-12-06T14:53:36.805 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.238+0000 7f52a4b40700 1 Processor -- start 2023-12-06T14:53:36.805 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.239+0000 7f52a4b40700 1 -- start start 2023-12-06T14:53:36.805 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.239+0000 7f52a4b40700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52a0076c20 0x7f52a01111a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:36.805 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.239+0000 7f52a4b40700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a01116e0 con 0x7f52a0076c20 2023-12-06T14:53:36.805 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.239+0000 7f529e59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52a0076c20 0x7f52a01111a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:36.806 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.239+0000 7f529e59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52a0076c20 0x7f52a01111a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57718/0 (socket says 172.21.15.152:57718) 2023-12-06T14:53:36.806 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.239+0000 7f529e59c700 1 -- 172.21.15.152:0/1929234681 learned_addr learned my addr 172.21.15.152:0/1929234681 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:36.806 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.239+0000 7f529e59c700 1 -- 172.21.15.152:0/1929234681 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52900094f0 con 0x7f52a0076c20 2023-12-06T14:53:36.806 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.239+0000 7f529e59c700 1 --2- 172.21.15.152:0/1929234681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52a0076c20 0x7f52a01111a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5290006d40 tx=0x7f5290009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:36.806 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.239+0000 7f528effd700 1 -- 172.21.15.152:0/1929234681 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5290010960 con 0x7f52a0076c20 2023-12-06T14:53:36.806 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.239+0000 7f528effd700 1 -- 172.21.15.152:0/1929234681 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f529001a430 con 0x7f52a0076c20 2023-12-06T14:53:36.806 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.239+0000 7f528effd700 1 -- 172.21.15.152:0/1929234681 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f52900245b0 con 0x7f52a0076c20 2023-12-06T14:53:36.806 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.239+0000 7f52a4b40700 1 -- 172.21.15.152:0/1929234681 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52a01118e0 con 0x7f52a0076c20 2023-12-06T14:53:36.806 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.239+0000 7f52a4b40700 1 -- 172.21.15.152:0/1929234681 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52a0111cf0 con 0x7f52a0076c20 2023-12-06T14:53:36.806 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.240+0000 7f528effd700 1 -- 172.21.15.152:0/1929234681 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f529002d3f0 con 0x7f52a0076c20 2023-12-06T14:53:36.807 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.240+0000 7f52a4b40700 1 -- 172.21.15.152:0/1929234681 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52a004bb80 con 0x7f52a0076c20 2023-12-06T14:53:36.807 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.241+0000 7f528effd700 1 --2- 172.21.15.152:0/1929234681 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f52880365f0 0x7f5288038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:36.807 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.241+0000 7f528effd700 1 -- 172.21.15.152:0/1929234681 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f529004a130 con 0x7f52a0076c20 2023-12-06T14:53:36.807 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.241+0000 7f529dd9b700 1 --2- 172.21.15.152:0/1929234681 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f52880365f0 0x7f5288038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:36.807 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.241+0000 7f529dd9b700 1 --2- 172.21.15.152:0/1929234681 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f52880365f0 0x7f5288038aa0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5294009990 tx=0x7f5294006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:36.807 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.249+0000 7f528effd700 1 -- 172.21.15.152:0/1929234681 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f529002b8e0 con 0x7f52a0076c20 2023-12-06T14:53:36.807 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.451+0000 7f52a4b40700 1 -- 172.21.15.152:0/1929234681 --> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f52a010aff0 con 0x7f52880365f0 2023-12-06T14:53:36.807 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.458+0000 7f528effd700 1 -- 172.21.15.152:0/1929234681 <== mgr.14120 v2:172.21.15.152:6800/2466555973 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f52a010aff0 con 0x7f52880365f0 2023-12-06T14:53:36.807 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.460+0000 7f52a4b40700 1 -- 172.21.15.152:0/1929234681 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f52880365f0 msgr2=0x7f5288038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:36.807 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.460+0000 7f52a4b40700 1 --2- 172.21.15.152:0/1929234681 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f52880365f0 0x7f5288038aa0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5294009990 tx=0x7f5294006e40 comp rx=0 tx=0).stop 2023-12-06T14:53:36.808 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.461+0000 7f52a4b40700 1 -- 172.21.15.152:0/1929234681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52a0076c20 msgr2=0x7f52a01111a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:36.808 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.461+0000 7f52a4b40700 1 --2- 172.21.15.152:0/1929234681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52a0076c20 0x7f52a01111a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5290006d40 tx=0x7f5290009250 comp rx=0 tx=0).stop 2023-12-06T14:53:36.808 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.461+0000 7f52a4b40700 1 -- 172.21.15.152:0/1929234681 shutdown_connections 2023-12-06T14:53:36.808 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.461+0000 7f52a4b40700 1 --2- 172.21.15.152:0/1929234681 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f52880365f0 0x7f5288038aa0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:36.808 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.461+0000 7f52a4b40700 1 --2- 172.21.15.152:0/1929234681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52a0076c20 0x7f52a01111a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:36.808 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.461+0000 7f52a4b40700 1 -- 172.21.15.152:0/1929234681 >> 172.21.15.152:0/1929234681 conn(0x7f52a00fc950 msgr2=0x7f52a00fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:36.808 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.461+0000 7f52a4b40700 1 -- 172.21.15.152:0/1929234681 shutdown_connections 2023-12-06T14:53:36.808 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:36.461+0000 7f52a4b40700 1 -- 172.21.15.152:0/1929234681 wait complete. 2023-12-06T14:53:36.808 INFO:teuthology.orchestra.run.smithi152.stdout:Deploying crash service with default placement... 2023-12-06T14:53:37.115 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:36 smithi152 ceph-mon[111954]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:53:37.116 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:36 smithi152 ceph-mon[111954]: Saving service mon spec with placement count:5 2023-12-06T14:53:37.116 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:36 smithi152 ceph-mon[111954]: from='mgr.14120 172.21.15.152:0/303232505' entity='mgr.smithi152.meodco' 2023-12-06T14:53:37.116 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:36 smithi152 ceph-mon[111954]: from='mgr.14120 172.21.15.152:0/303232505' entity='mgr.smithi152.meodco' 2023-12-06T14:53:37.116 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:36 smithi152 ceph-mon[111954]: from='mgr.14120 172.21.15.152:0/303232505' entity='mgr.smithi152.meodco' 2023-12-06T14:53:37.696 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2023-12-06T14:53:37.696 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.161+0000 7f9840c39700 1 Processor -- start 2023-12-06T14:53:37.696 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.161+0000 7f9840c39700 1 -- start start 2023-12-06T14:53:37.696 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.162+0000 7f9840c39700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f983c1039c0 0x7f983c103dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:37.696 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.162+0000 7f9840c39700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983c104310 con 0x7f983c1039c0 2023-12-06T14:53:37.696 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.162+0000 7f983a59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f983c1039c0 0x7f983c103dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:37.696 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.162+0000 7f983a59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f983c1039c0 0x7f983c103dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57730/0 (socket says 172.21.15.152:57730) 2023-12-06T14:53:37.696 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.162+0000 7f983a59c700 1 -- 172.21.15.152:0/2226390689 learned_addr learned my addr 172.21.15.152:0/2226390689 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:37.696 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.162+0000 7f983a59c700 1 -- 172.21.15.152:0/2226390689 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983c101fb0 con 0x7f983c1039c0 2023-12-06T14:53:37.696 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.162+0000 7f983a59c700 1 --2- 172.21.15.152:0/2226390689 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f983c1039c0 0x7f983c103dd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f98340098e0 tx=0x7f9834009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9072d83a85dad01f server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:37.697 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.163+0000 7f983959a700 1 -- 172.21.15.152:0/2226390689 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f983400b860 con 0x7f983c1039c0 2023-12-06T14:53:37.697 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.163+0000 7f983959a700 1 -- 172.21.15.152:0/2226390689 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f983400be70 con 0x7f983c1039c0 2023-12-06T14:53:37.697 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.163+0000 7f983959a700 1 -- 172.21.15.152:0/2226390689 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9834010380 con 0x7f983c1039c0 2023-12-06T14:53:37.697 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.163+0000 7f9840c39700 1 -- 172.21.15.152:0/2226390689 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f983c1039c0 msgr2=0x7f983c103dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:37.697 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.163+0000 7f9840c39700 1 --2- 172.21.15.152:0/2226390689 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f983c1039c0 0x7f983c103dd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f98340098e0 tx=0x7f9834009250 comp rx=0 tx=0).stop 2023-12-06T14:53:37.697 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.163+0000 7f9840c39700 1 -- 172.21.15.152:0/2226390689 shutdown_connections 2023-12-06T14:53:37.697 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.163+0000 7f9840c39700 1 --2- 172.21.15.152:0/2226390689 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f983c1039c0 0x7f983c103dd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:37.697 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.163+0000 7f9840c39700 1 -- 172.21.15.152:0/2226390689 >> 172.21.15.152:0/2226390689 conn(0x7f983c0fda40 msgr2=0x7f983c0ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:37.697 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.163+0000 7f9840c39700 1 -- 172.21.15.152:0/2226390689 shutdown_connections 2023-12-06T14:53:37.697 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.163+0000 7f9840c39700 1 -- 172.21.15.152:0/2226390689 wait complete. 2023-12-06T14:53:37.697 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.164+0000 7f9840c39700 1 Processor -- start 2023-12-06T14:53:37.697 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.164+0000 7f9840c39700 1 -- start start 2023-12-06T14:53:37.697 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.164+0000 7f9840c39700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f983c1039c0 0x7f983c111130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:37.697 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.164+0000 7f9840c39700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983c111670 con 0x7f983c1039c0 2023-12-06T14:53:37.698 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.164+0000 7f983a59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f983c1039c0 0x7f983c111130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:37.698 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.164+0000 7f983a59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f983c1039c0 0x7f983c111130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57742/0 (socket says 172.21.15.152:57742) 2023-12-06T14:53:37.698 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.164+0000 7f983a59c700 1 -- 172.21.15.152:0/1250283186 learned_addr learned my addr 172.21.15.152:0/1250283186 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:37.698 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.164+0000 7f983a59c700 1 -- 172.21.15.152:0/1250283186 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98340094f0 con 0x7f983c1039c0 2023-12-06T14:53:37.698 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.164+0000 7f983a59c700 1 --2- 172.21.15.152:0/1250283186 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f983c1039c0 0x7f983c111130 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9834003080 tx=0x7f9834009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:37.698 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.165+0000 7f9832ffd700 1 -- 172.21.15.152:0/1250283186 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9834010800 con 0x7f983c1039c0 2023-12-06T14:53:37.698 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.165+0000 7f9832ffd700 1 -- 172.21.15.152:0/1250283186 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9834010e10 con 0x7f983c1039c0 2023-12-06T14:53:37.698 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.165+0000 7f9840c39700 1 -- 172.21.15.152:0/1250283186 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f983c111870 con 0x7f983c1039c0 2023-12-06T14:53:37.698 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.165+0000 7f9832ffd700 1 -- 172.21.15.152:0/1250283186 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f983401a430 con 0x7f983c1039c0 2023-12-06T14:53:37.698 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.165+0000 7f9840c39700 1 -- 172.21.15.152:0/1250283186 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f983c111c80 con 0x7f983c1039c0 2023-12-06T14:53:37.698 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.165+0000 7f9832ffd700 1 -- 172.21.15.152:0/1250283186 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f983401a660 con 0x7f983c1039c0 2023-12-06T14:53:37.698 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.166+0000 7f9832ffd700 1 --2- 172.21.15.152:0/1250283186 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f9828036640 0x7f9828038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:37.698 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.166+0000 7f9832ffd700 1 -- 172.21.15.152:0/1250283186 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f983404a640 con 0x7f983c1039c0 2023-12-06T14:53:37.699 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.166+0000 7f9839d9b700 1 --2- 172.21.15.152:0/1250283186 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f9828036640 0x7f9828038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:37.699 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.166+0000 7f9840c39700 1 -- 172.21.15.152:0/1250283186 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f983c05f270 con 0x7f983c1039c0 2023-12-06T14:53:37.699 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.166+0000 7f9839d9b700 1 --2- 172.21.15.152:0/1250283186 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f9828036640 0x7f9828038af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9824009990 tx=0x7f9824006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:37.699 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.170+0000 7f9832ffd700 1 -- 172.21.15.152:0/1250283186 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9834024790 con 0x7f983c1039c0 2023-12-06T14:53:37.699 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.380+0000 7f9840c39700 1 -- 172.21.15.152:0/1250283186 --> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f983c10acf0 con 0x7f9828036640 2023-12-06T14:53:37.699 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.387+0000 7f9832ffd700 1 -- 172.21.15.152:0/1250283186 <== mgr.14120 v2:172.21.15.152:6800/2466555973 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f983c10acf0 con 0x7f9828036640 2023-12-06T14:53:37.699 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.389+0000 7f9840c39700 1 -- 172.21.15.152:0/1250283186 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f9828036640 msgr2=0x7f9828038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:37.699 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.389+0000 7f9840c39700 1 --2- 172.21.15.152:0/1250283186 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f9828036640 0x7f9828038af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9824009990 tx=0x7f9824006e40 comp rx=0 tx=0).stop 2023-12-06T14:53:37.699 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.389+0000 7f9840c39700 1 -- 172.21.15.152:0/1250283186 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f983c1039c0 msgr2=0x7f983c111130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:37.699 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.389+0000 7f9840c39700 1 --2- 172.21.15.152:0/1250283186 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f983c1039c0 0x7f983c111130 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9834003080 tx=0x7f9834009250 comp rx=0 tx=0).stop 2023-12-06T14:53:37.699 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.390+0000 7f9840c39700 1 -- 172.21.15.152:0/1250283186 shutdown_connections 2023-12-06T14:53:37.699 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.390+0000 7f9840c39700 1 --2- 172.21.15.152:0/1250283186 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f9828036640 0x7f9828038af0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:37.699 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.390+0000 7f9840c39700 1 --2- 172.21.15.152:0/1250283186 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f983c1039c0 0x7f983c111130 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:37.699 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.390+0000 7f9840c39700 1 -- 172.21.15.152:0/1250283186 >> 172.21.15.152:0/1250283186 conn(0x7f983c0fda40 msgr2=0x7f983c0ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:37.700 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.390+0000 7f9840c39700 1 -- 172.21.15.152:0/1250283186 shutdown_connections 2023-12-06T14:53:37.700 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:37.390+0000 7f9840c39700 1 -- 172.21.15.152:0/1250283186 wait complete. 2023-12-06T14:53:37.700 INFO:teuthology.orchestra.run.smithi152.stdout:Deploying prometheus service with default placement... 2023-12-06T14:53:38.127 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:37 smithi152 ceph-mon[111954]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:53:38.127 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:37 smithi152 ceph-mon[111954]: Saving service mgr spec with placement count:2 2023-12-06T14:53:38.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:37 smithi152 ceph-mon[111954]: from='mgr.14120 172.21.15.152:0/303232505' entity='mgr.smithi152.meodco' 2023-12-06T14:53:38.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:37 smithi152 ceph-mon[111954]: from='mgr.14120 172.21.15.152:0/303232505' entity='mgr.smithi152.meodco' 2023-12-06T14:53:38.719 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2023-12-06T14:53:38.719 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.080+0000 7f0bd0293700 1 Processor -- start 2023-12-06T14:53:38.719 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.080+0000 7f0bd0293700 1 -- start start 2023-12-06T14:53:38.719 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.080+0000 7f0bd0293700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bc81027d0 0x7f0bc8102be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:38.719 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.080+0000 7f0bd0293700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc8103120 con 0x7f0bc81027d0 2023-12-06T14:53:38.719 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.081+0000 7f0bce02f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bc81027d0 0x7f0bc8102be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:38.719 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.081+0000 7f0bce02f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bc81027d0 0x7f0bc8102be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57746/0 (socket says 172.21.15.152:57746) 2023-12-06T14:53:38.719 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.081+0000 7f0bce02f700 1 -- 172.21.15.152:0/3117325285 learned_addr learned my addr 172.21.15.152:0/3117325285 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:38.719 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.081+0000 7f0bce02f700 1 -- 172.21.15.152:0/3117325285 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc8103260 con 0x7f0bc81027d0 2023-12-06T14:53:38.719 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.081+0000 7f0bce02f700 1 --2- 172.21.15.152:0/3117325285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bc81027d0 0x7f0bc8102be0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40098e0 tx=0x7f0bc4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212bf97f976302ae server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:38.719 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.081+0000 7f0bcd02d700 1 -- 172.21.15.152:0/3117325285 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0bc400b860 con 0x7f0bc81027d0 2023-12-06T14:53:38.719 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.081+0000 7f0bcd02d700 1 -- 172.21.15.152:0/3117325285 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0bc400be70 con 0x7f0bc81027d0 2023-12-06T14:53:38.720 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.081+0000 7f0bcd02d700 1 -- 172.21.15.152:0/3117325285 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0bc4010380 con 0x7f0bc81027d0 2023-12-06T14:53:38.720 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.082+0000 7f0bd0293700 1 -- 172.21.15.152:0/3117325285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bc81027d0 msgr2=0x7f0bc8102be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:38.720 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.082+0000 7f0bd0293700 1 --2- 172.21.15.152:0/3117325285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bc81027d0 0x7f0bc8102be0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40098e0 tx=0x7f0bc4009250 comp rx=0 tx=0).stop 2023-12-06T14:53:38.720 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.082+0000 7f0bd0293700 1 -- 172.21.15.152:0/3117325285 shutdown_connections 2023-12-06T14:53:38.720 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.082+0000 7f0bd0293700 1 --2- 172.21.15.152:0/3117325285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bc81027d0 0x7f0bc8102be0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:38.720 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.082+0000 7f0bd0293700 1 -- 172.21.15.152:0/3117325285 >> 172.21.15.152:0/3117325285 conn(0x7f0bc80fc0b0 msgr2=0x7f0bc80fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:38.720 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.082+0000 7f0bd0293700 1 -- 172.21.15.152:0/3117325285 shutdown_connections 2023-12-06T14:53:38.720 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.082+0000 7f0bd0293700 1 -- 172.21.15.152:0/3117325285 wait complete. 2023-12-06T14:53:38.720 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.082+0000 7f0bd0293700 1 Processor -- start 2023-12-06T14:53:38.721 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.082+0000 7f0bd0293700 1 -- start start 2023-12-06T14:53:38.721 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.082+0000 7f0bd0293700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bc81027d0 0x7f0bc8113e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:38.721 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.082+0000 7f0bd0293700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc81010d0 con 0x7f0bc81027d0 2023-12-06T14:53:38.721 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.083+0000 7f0bce02f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bc81027d0 0x7f0bc8113e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:38.721 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.083+0000 7f0bce02f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bc81027d0 0x7f0bc8113e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57752/0 (socket says 172.21.15.152:57752) 2023-12-06T14:53:38.721 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.083+0000 7f0bce02f700 1 -- 172.21.15.152:0/1772783944 learned_addr learned my addr 172.21.15.152:0/1772783944 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:38.721 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.083+0000 7f0bce02f700 1 -- 172.21.15.152:0/1772783944 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc40094f0 con 0x7f0bc81027d0 2023-12-06T14:53:38.721 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.083+0000 7f0bce02f700 1 --2- 172.21.15.152:0/1772783944 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bc81027d0 0x7f0bc8113e60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4011b60 tx=0x7f0bc4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:38.721 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.083+0000 7f0bbeffd700 1 -- 172.21.15.152:0/1772783944 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0bc4010850 con 0x7f0bc81027d0 2023-12-06T14:53:38.721 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.083+0000 7f0bbeffd700 1 -- 172.21.15.152:0/1772783944 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0bc4010e60 con 0x7f0bc81027d0 2023-12-06T14:53:38.721 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.083+0000 7f0bd0293700 1 -- 172.21.15.152:0/1772783944 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc81012d0 con 0x7f0bc81027d0 2023-12-06T14:53:38.721 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.083+0000 7f0bbeffd700 1 -- 172.21.15.152:0/1772783944 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0bc401ae20 con 0x7f0bc81027d0 2023-12-06T14:53:38.721 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.083+0000 7f0bd0293700 1 -- 172.21.15.152:0/1772783944 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc8114560 con 0x7f0bc81027d0 2023-12-06T14:53:38.721 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.084+0000 7f0bbeffd700 1 -- 172.21.15.152:0/1772783944 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f0bc402d3f0 con 0x7f0bc81027d0 2023-12-06T14:53:38.722 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.084+0000 7f0bbeffd700 1 --2- 172.21.15.152:0/1772783944 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f0bb4036640 0x7f0bb4038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:38.722 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.084+0000 7f0bbeffd700 1 -- 172.21.15.152:0/1772783944 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f0bc404a360 con 0x7f0bc81027d0 2023-12-06T14:53:38.722 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.084+0000 7f0bd0293700 1 -- 172.21.15.152:0/1772783944 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bc810a0e0 con 0x7f0bc81027d0 2023-12-06T14:53:38.722 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.084+0000 7f0bcd82e700 1 --2- 172.21.15.152:0/1772783944 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f0bb4036640 0x7f0bb4038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:38.722 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.084+0000 7f0bcd82e700 1 --2- 172.21.15.152:0/1772783944 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f0bb4036640 0x7f0bb4038af0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8009990 tx=0x7f0bb8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:38.722 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.089+0000 7f0bbeffd700 1 -- 172.21.15.152:0/1772783944 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0bc402b2f0 con 0x7f0bc81027d0 2023-12-06T14:53:38.722 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.296+0000 7f0bd0293700 1 -- 172.21.15.152:0/1772783944 --> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f0bc802b150 con 0x7f0bb4036640 2023-12-06T14:53:38.722 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.300+0000 7f0bbeffd700 1 -- 172.21.15.152:0/1772783944 <== mgr.14120 v2:172.21.15.152:6800/2466555973 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f0bc802b150 con 0x7f0bb4036640 2023-12-06T14:53:38.722 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.302+0000 7f0bd0293700 1 -- 172.21.15.152:0/1772783944 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f0bb4036640 msgr2=0x7f0bb4038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:38.722 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.302+0000 7f0bd0293700 1 --2- 172.21.15.152:0/1772783944 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f0bb4036640 0x7f0bb4038af0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8009990 tx=0x7f0bb8006e40 comp rx=0 tx=0).stop 2023-12-06T14:53:38.722 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.302+0000 7f0bd0293700 1 -- 172.21.15.152:0/1772783944 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bc81027d0 msgr2=0x7f0bc8113e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:38.722 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.302+0000 7f0bd0293700 1 --2- 172.21.15.152:0/1772783944 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bc81027d0 0x7f0bc8113e60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4011b60 tx=0x7f0bc4009250 comp rx=0 tx=0).stop 2023-12-06T14:53:38.722 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.303+0000 7f0bd0293700 1 -- 172.21.15.152:0/1772783944 shutdown_connections 2023-12-06T14:53:38.722 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.303+0000 7f0bd0293700 1 --2- 172.21.15.152:0/1772783944 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f0bb4036640 0x7f0bb4038af0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:38.723 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.303+0000 7f0bd0293700 1 --2- 172.21.15.152:0/1772783944 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0bc81027d0 0x7f0bc8113e60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:38.723 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.303+0000 7f0bd0293700 1 -- 172.21.15.152:0/1772783944 >> 172.21.15.152:0/1772783944 conn(0x7f0bc80fc0b0 msgr2=0x7f0bc80fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:38.723 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.303+0000 7f0bd0293700 1 -- 172.21.15.152:0/1772783944 shutdown_connections 2023-12-06T14:53:38.723 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:38.303+0000 7f0bd0293700 1 -- 172.21.15.152:0/1772783944 wait complete. 2023-12-06T14:53:38.723 INFO:teuthology.orchestra.run.smithi152.stdout:Deploying grafana service with default placement... 2023-12-06T14:53:39.332 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:38 smithi152 ceph-mon[111954]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:53:39.332 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:38 smithi152 ceph-mon[111954]: Saving service crash spec with placement * 2023-12-06T14:53:39.332 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:38 smithi152 ceph-mon[111954]: from='mgr.14120 172.21.15.152:0/303232505' entity='mgr.smithi152.meodco' 2023-12-06T14:53:39.332 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:38 smithi152 ceph-mon[111954]: from='mgr.14120 172.21.15.152:0/303232505' entity='mgr.smithi152.meodco' 2023-12-06T14:53:39.843 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2023-12-06T14:53:39.843 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.272+0000 7f79886ab700 1 Processor -- start 2023-12-06T14:53:39.843 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.272+0000 7f79886ab700 1 -- start start 2023-12-06T14:53:39.843 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.273+0000 7f79886ab700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79801011c0 0x7f79801015d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:39.843 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.273+0000 7f79886ab700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7980101b10 con 0x7f79801011c0 2023-12-06T14:53:39.843 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.273+0000 7f7986447700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79801011c0 0x7f79801015d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:39.844 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.273+0000 7f7986447700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79801011c0 0x7f79801015d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57758/0 (socket says 172.21.15.152:57758) 2023-12-06T14:53:39.844 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.273+0000 7f7986447700 1 -- 172.21.15.152:0/198707644 learned_addr learned my addr 172.21.15.152:0/198707644 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:39.844 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.273+0000 7f7986447700 1 -- 172.21.15.152:0/198707644 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7980101c50 con 0x7f79801011c0 2023-12-06T14:53:39.844 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.273+0000 7f7986447700 1 --2- 172.21.15.152:0/198707644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79801011c0 0x7f79801015d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f797c0098e0 tx=0x7f797c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ab9e66d7aa859df server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:39.844 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.273+0000 7f7985445700 1 -- 172.21.15.152:0/198707644 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f797c00b860 con 0x7f79801011c0 2023-12-06T14:53:39.844 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.274+0000 7f7985445700 1 -- 172.21.15.152:0/198707644 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f797c00be70 con 0x7f79801011c0 2023-12-06T14:53:39.844 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.274+0000 7f7985445700 1 -- 172.21.15.152:0/198707644 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f797c010380 con 0x7f79801011c0 2023-12-06T14:53:39.844 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.274+0000 7f79886ab700 1 -- 172.21.15.152:0/198707644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79801011c0 msgr2=0x7f79801015d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:39.844 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.274+0000 7f79886ab700 1 --2- 172.21.15.152:0/198707644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79801011c0 0x7f79801015d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f797c0098e0 tx=0x7f797c009250 comp rx=0 tx=0).stop 2023-12-06T14:53:39.844 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.274+0000 7f79886ab700 1 -- 172.21.15.152:0/198707644 shutdown_connections 2023-12-06T14:53:39.844 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.274+0000 7f79886ab700 1 --2- 172.21.15.152:0/198707644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79801011c0 0x7f79801015d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:39.844 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.274+0000 7f79886ab700 1 -- 172.21.15.152:0/198707644 >> 172.21.15.152:0/198707644 conn(0x7f79800fc980 msgr2=0x7f79800fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:39.844 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.274+0000 7f79886ab700 1 -- 172.21.15.152:0/198707644 shutdown_connections 2023-12-06T14:53:39.844 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.274+0000 7f79886ab700 1 -- 172.21.15.152:0/198707644 wait complete. 2023-12-06T14:53:39.844 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.275+0000 7f79886ab700 1 Processor -- start 2023-12-06T14:53:39.845 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.275+0000 7f79886ab700 1 -- start start 2023-12-06T14:53:39.845 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.275+0000 7f79886ab700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79801011c0 0x7f7980111190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:39.845 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.275+0000 7f79886ab700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79801116d0 con 0x7f79801011c0 2023-12-06T14:53:39.845 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.275+0000 7f7986447700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79801011c0 0x7f7980111190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:39.845 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.275+0000 7f7986447700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79801011c0 0x7f7980111190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57772/0 (socket says 172.21.15.152:57772) 2023-12-06T14:53:39.845 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.275+0000 7f7986447700 1 -- 172.21.15.152:0/1693852322 learned_addr learned my addr 172.21.15.152:0/1693852322 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:39.845 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.275+0000 7f7986447700 1 -- 172.21.15.152:0/1693852322 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797c0094f0 con 0x7f79801011c0 2023-12-06T14:53:39.845 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.275+0000 7f7986447700 1 --2- 172.21.15.152:0/1693852322 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79801011c0 0x7f7980111190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f797c011b60 tx=0x7f797c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:39.845 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.275+0000 7f7976ffd700 1 -- 172.21.15.152:0/1693852322 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f797c010850 con 0x7f79801011c0 2023-12-06T14:53:39.845 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.276+0000 7f7976ffd700 1 -- 172.21.15.152:0/1693852322 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f797c010e60 con 0x7f79801011c0 2023-12-06T14:53:39.845 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.276+0000 7f79886ab700 1 -- 172.21.15.152:0/1693852322 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79801118d0 con 0x7f79801011c0 2023-12-06T14:53:39.845 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.276+0000 7f7976ffd700 1 -- 172.21.15.152:0/1693852322 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f797c01ae20 con 0x7f79801011c0 2023-12-06T14:53:39.845 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.276+0000 7f79886ab700 1 -- 172.21.15.152:0/1693852322 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7980111ce0 con 0x7f79801011c0 2023-12-06T14:53:39.845 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.276+0000 7f7976ffd700 1 -- 172.21.15.152:0/1693852322 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f797c02d3f0 con 0x7f79801011c0 2023-12-06T14:53:39.846 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.276+0000 7f7976ffd700 1 --2- 172.21.15.152:0/1693852322 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f796c036640 0x7f796c038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:39.846 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.276+0000 7f79886ab700 1 -- 172.21.15.152:0/1693852322 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f798004bb80 con 0x7f79801011c0 2023-12-06T14:53:39.846 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.277+0000 7f7976ffd700 1 -- 172.21.15.152:0/1693852322 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f797c04a1d0 con 0x7f79801011c0 2023-12-06T14:53:39.846 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.277+0000 7f7985c46700 1 --2- 172.21.15.152:0/1693852322 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f796c036640 0x7f796c038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:39.846 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.277+0000 7f7985c46700 1 --2- 172.21.15.152:0/1693852322 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f796c036640 0x7f796c038af0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7970009990 tx=0x7f7970006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:39.846 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.281+0000 7f7976ffd700 1 -- 172.21.15.152:0/1693852322 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f797c02b8e0 con 0x7f79801011c0 2023-12-06T14:53:39.846 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.481+0000 7f79886ab700 1 -- 172.21.15.152:0/1693852322 --> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f79800feca0 con 0x7f796c036640 2023-12-06T14:53:39.846 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.485+0000 7f7976ffd700 1 -- 172.21.15.152:0/1693852322 <== mgr.14120 v2:172.21.15.152:6800/2466555973 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f79800feca0 con 0x7f796c036640 2023-12-06T14:53:39.846 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.487+0000 7f79886ab700 1 -- 172.21.15.152:0/1693852322 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f796c036640 msgr2=0x7f796c038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:39.846 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.487+0000 7f79886ab700 1 --2- 172.21.15.152:0/1693852322 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f796c036640 0x7f796c038af0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7970009990 tx=0x7f7970006e40 comp rx=0 tx=0).stop 2023-12-06T14:53:39.846 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.487+0000 7f79886ab700 1 -- 172.21.15.152:0/1693852322 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79801011c0 msgr2=0x7f7980111190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:39.846 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.487+0000 7f79886ab700 1 --2- 172.21.15.152:0/1693852322 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79801011c0 0x7f7980111190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f797c011b60 tx=0x7f797c009250 comp rx=0 tx=0).stop 2023-12-06T14:53:39.846 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.487+0000 7f79886ab700 1 -- 172.21.15.152:0/1693852322 shutdown_connections 2023-12-06T14:53:39.847 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.487+0000 7f79886ab700 1 --2- 172.21.15.152:0/1693852322 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f796c036640 0x7f796c038af0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:39.847 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.487+0000 7f79886ab700 1 --2- 172.21.15.152:0/1693852322 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79801011c0 0x7f7980111190 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:39.847 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.487+0000 7f79886ab700 1 -- 172.21.15.152:0/1693852322 >> 172.21.15.152:0/1693852322 conn(0x7f79800fc980 msgr2=0x7f7980076810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:39.847 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.487+0000 7f79886ab700 1 -- 172.21.15.152:0/1693852322 shutdown_connections 2023-12-06T14:53:39.847 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:39.487+0000 7f79886ab700 1 -- 172.21.15.152:0/1693852322 wait complete. 2023-12-06T14:53:39.847 INFO:teuthology.orchestra.run.smithi152.stdout:Deploying node-exporter service with default placement... 2023-12-06T14:53:40.377 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:39 smithi152 ceph-mon[111954]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:53:40.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:39 smithi152 ceph-mon[111954]: Saving service prometheus spec with placement count:1 2023-12-06T14:53:40.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:39 smithi152 ceph-mon[111954]: from='mgr.14120 172.21.15.152:0/303232505' entity='mgr.smithi152.meodco' 2023-12-06T14:53:40.751 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2023-12-06T14:53:40.752 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.201+0000 7faf0a25e700 1 Processor -- start 2023-12-06T14:53:40.752 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.201+0000 7faf0a25e700 1 -- start start 2023-12-06T14:53:40.752 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.201+0000 7faf0a25e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf041022d0 0x7faf041026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:40.752 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.201+0000 7faf0a25e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf04102c20 con 0x7faf041022d0 2023-12-06T14:53:40.752 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.201+0000 7faf037fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf041022d0 0x7faf041026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:40.752 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.201+0000 7faf037fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf041022d0 0x7faf041026e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45246/0 (socket says 172.21.15.152:45246) 2023-12-06T14:53:40.752 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.201+0000 7faf037fe700 1 -- 172.21.15.152:0/1396460424 learned_addr learned my addr 172.21.15.152:0/1396460424 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:40.752 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.201+0000 7faf037fe700 1 -- 172.21.15.152:0/1396460424 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf04102d60 con 0x7faf041022d0 2023-12-06T14:53:40.752 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.201+0000 7faf037fe700 1 --2- 172.21.15.152:0/1396460424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf041022d0 0x7faf041026e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faef40098e0 tx=0x7faef4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3701004969aaa3b server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:40.752 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.202+0000 7faf027fc700 1 -- 172.21.15.152:0/1396460424 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faef400b860 con 0x7faf041022d0 2023-12-06T14:53:40.752 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.202+0000 7faf027fc700 1 -- 172.21.15.152:0/1396460424 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faef400be70 con 0x7faf041022d0 2023-12-06T14:53:40.753 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.202+0000 7faf027fc700 1 -- 172.21.15.152:0/1396460424 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faef4010380 con 0x7faf041022d0 2023-12-06T14:53:40.753 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.202+0000 7faf0a25e700 1 -- 172.21.15.152:0/1396460424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf041022d0 msgr2=0x7faf041026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:40.753 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.202+0000 7faf0a25e700 1 --2- 172.21.15.152:0/1396460424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf041022d0 0x7faf041026e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faef40098e0 tx=0x7faef4009250 comp rx=0 tx=0).stop 2023-12-06T14:53:40.753 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.202+0000 7faf0a25e700 1 -- 172.21.15.152:0/1396460424 shutdown_connections 2023-12-06T14:53:40.753 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.202+0000 7faf0a25e700 1 --2- 172.21.15.152:0/1396460424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf041022d0 0x7faf041026e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:40.753 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.202+0000 7faf0a25e700 1 -- 172.21.15.152:0/1396460424 >> 172.21.15.152:0/1396460424 conn(0x7faf040fda50 msgr2=0x7faf040ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:40.753 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.202+0000 7faf0a25e700 1 -- 172.21.15.152:0/1396460424 shutdown_connections 2023-12-06T14:53:40.753 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.202+0000 7faf0a25e700 1 -- 172.21.15.152:0/1396460424 wait complete. 2023-12-06T14:53:40.753 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.203+0000 7faf0a25e700 1 Processor -- start 2023-12-06T14:53:40.753 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.203+0000 7faf0a25e700 1 -- start start 2023-12-06T14:53:40.753 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.203+0000 7faf0a25e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf041022d0 0x7faf04111180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:40.753 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.203+0000 7faf0a25e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf041116c0 con 0x7faf041022d0 2023-12-06T14:53:40.754 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.203+0000 7faf037fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf041022d0 0x7faf04111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:40.754 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.203+0000 7faf037fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf041022d0 0x7faf04111180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45260/0 (socket says 172.21.15.152:45260) 2023-12-06T14:53:40.754 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.203+0000 7faf037fe700 1 -- 172.21.15.152:0/2357769694 learned_addr learned my addr 172.21.15.152:0/2357769694 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:40.754 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.204+0000 7faf037fe700 1 -- 172.21.15.152:0/2357769694 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef40094f0 con 0x7faf041022d0 2023-12-06T14:53:40.754 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.204+0000 7faf037fe700 1 --2- 172.21.15.152:0/2357769694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf041022d0 0x7faf04111180 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faef4011b60 tx=0x7faef4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:40.754 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.204+0000 7faeebfff700 1 -- 172.21.15.152:0/2357769694 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faef4010850 con 0x7faf041022d0 2023-12-06T14:53:40.754 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.204+0000 7faeebfff700 1 -- 172.21.15.152:0/2357769694 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faef4010e60 con 0x7faf041022d0 2023-12-06T14:53:40.754 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.204+0000 7faeebfff700 1 -- 172.21.15.152:0/2357769694 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faef401ae20 con 0x7faf041022d0 2023-12-06T14:53:40.754 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.204+0000 7faf0a25e700 1 -- 172.21.15.152:0/2357769694 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf041118c0 con 0x7faf041022d0 2023-12-06T14:53:40.754 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.204+0000 7faf0a25e700 1 -- 172.21.15.152:0/2357769694 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf04111cd0 con 0x7faf041022d0 2023-12-06T14:53:40.754 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.205+0000 7faeebfff700 1 -- 172.21.15.152:0/2357769694 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7faef402d3f0 con 0x7faf041022d0 2023-12-06T14:53:40.754 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.205+0000 7faeebfff700 1 --2- 172.21.15.152:0/2357769694 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7faeec036640 0x7faeec038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:40.755 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.205+0000 7faf0a25e700 1 -- 172.21.15.152:0/2357769694 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf0404bb80 con 0x7faf041022d0 2023-12-06T14:53:40.755 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.205+0000 7faeebfff700 1 -- 172.21.15.152:0/2357769694 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7faef404a310 con 0x7faf041022d0 2023-12-06T14:53:40.755 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.205+0000 7faf02ffd700 1 --2- 172.21.15.152:0/2357769694 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7faeec036640 0x7faeec038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:40.755 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.205+0000 7faf02ffd700 1 --2- 172.21.15.152:0/2357769694 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7faeec036640 0x7faeec038af0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7faef8009990 tx=0x7faef8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:40.755 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.210+0000 7faeebfff700 1 -- 172.21.15.152:0/2357769694 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7faef402b6b0 con 0x7faf041022d0 2023-12-06T14:53:40.755 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.401+0000 7faf0a25e700 1 -- 172.21.15.152:0/2357769694 --> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7faf0410b000 con 0x7faeec036640 2023-12-06T14:53:40.755 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.405+0000 7faeebfff700 1 -- 172.21.15.152:0/2357769694 <== mgr.14120 v2:172.21.15.152:6800/2466555973 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7faf0410b000 con 0x7faeec036640 2023-12-06T14:53:40.755 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.407+0000 7faf0a25e700 1 -- 172.21.15.152:0/2357769694 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7faeec036640 msgr2=0x7faeec038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:40.755 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.407+0000 7faf0a25e700 1 --2- 172.21.15.152:0/2357769694 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7faeec036640 0x7faeec038af0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7faef8009990 tx=0x7faef8006e40 comp rx=0 tx=0).stop 2023-12-06T14:53:40.755 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.407+0000 7faf0a25e700 1 -- 172.21.15.152:0/2357769694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf041022d0 msgr2=0x7faf04111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:40.755 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.407+0000 7faf0a25e700 1 --2- 172.21.15.152:0/2357769694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf041022d0 0x7faf04111180 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faef4011b60 tx=0x7faef4009250 comp rx=0 tx=0).stop 2023-12-06T14:53:40.755 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.407+0000 7faf0a25e700 1 -- 172.21.15.152:0/2357769694 shutdown_connections 2023-12-06T14:53:40.756 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.407+0000 7faf0a25e700 1 --2- 172.21.15.152:0/2357769694 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7faeec036640 0x7faeec038af0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:40.756 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.407+0000 7faf0a25e700 1 --2- 172.21.15.152:0/2357769694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faf041022d0 0x7faf04111180 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:40.756 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.407+0000 7faf0a25e700 1 -- 172.21.15.152:0/2357769694 >> 172.21.15.152:0/2357769694 conn(0x7faf040fda50 msgr2=0x7faf040ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:40.756 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.407+0000 7faf0a25e700 1 -- 172.21.15.152:0/2357769694 shutdown_connections 2023-12-06T14:53:40.756 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:40.407+0000 7faf0a25e700 1 -- 172.21.15.152:0/2357769694 wait complete. 2023-12-06T14:53:40.756 INFO:teuthology.orchestra.run.smithi152.stdout:Deploying alertmanager service with default placement... 2023-12-06T14:53:41.375 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:40 smithi152 ceph-mon[111954]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:53:41.375 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:40 smithi152 ceph-mon[111954]: Saving service grafana spec with placement count:1 2023-12-06T14:53:41.375 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:40 smithi152 ceph-mon[111954]: from='mgr.14120 172.21.15.152:0/303232505' entity='mgr.smithi152.meodco' 2023-12-06T14:53:41.719 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2023-12-06T14:53:41.719 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.144+0000 7fe15ad15700 1 Processor -- start 2023-12-06T14:53:41.719 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.144+0000 7fe15ad15700 1 -- start start 2023-12-06T14:53:41.719 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.144+0000 7fe15ad15700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe154070f60 0x7fe1541072a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:41.719 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.144+0000 7fe15ad15700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe154102c90 con 0x7fe154070f60 2023-12-06T14:53:41.719 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.144+0000 7fe158ab1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe154070f60 0x7fe1541072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:41.719 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.144+0000 7fe158ab1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe154070f60 0x7fe1541072a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45266/0 (socket says 172.21.15.152:45266) 2023-12-06T14:53:41.719 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.144+0000 7fe158ab1700 1 -- 172.21.15.152:0/850462228 learned_addr learned my addr 172.21.15.152:0/850462228 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:41.719 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.144+0000 7fe158ab1700 1 -- 172.21.15.152:0/850462228 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1541077e0 con 0x7fe154070f60 2023-12-06T14:53:41.719 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.145+0000 7fe158ab1700 1 --2- 172.21.15.152:0/850462228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe154070f60 0x7fe1541072a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe1480098e0 tx=0x7fe148009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c46c25389e5205cd server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:41.719 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.145+0000 7fe1537fe700 1 -- 172.21.15.152:0/850462228 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe14800b860 con 0x7fe154070f60 2023-12-06T14:53:41.720 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.145+0000 7fe1537fe700 1 -- 172.21.15.152:0/850462228 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe14800be70 con 0x7fe154070f60 2023-12-06T14:53:41.720 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.145+0000 7fe1537fe700 1 -- 172.21.15.152:0/850462228 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe148010380 con 0x7fe154070f60 2023-12-06T14:53:41.720 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.145+0000 7fe15ad15700 1 -- 172.21.15.152:0/850462228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe154070f60 msgr2=0x7fe1541072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:41.720 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.145+0000 7fe15ad15700 1 --2- 172.21.15.152:0/850462228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe154070f60 0x7fe1541072a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe1480098e0 tx=0x7fe148009250 comp rx=0 tx=0).stop 2023-12-06T14:53:41.720 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.145+0000 7fe15ad15700 1 -- 172.21.15.152:0/850462228 shutdown_connections 2023-12-06T14:53:41.720 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.145+0000 7fe15ad15700 1 --2- 172.21.15.152:0/850462228 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe154070f60 0x7fe1541072a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:41.720 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.145+0000 7fe15ad15700 1 -- 172.21.15.152:0/850462228 >> 172.21.15.152:0/850462228 conn(0x7fe1540fc870 msgr2=0x7fe1540fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:41.720 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.145+0000 7fe15ad15700 1 -- 172.21.15.152:0/850462228 shutdown_connections 2023-12-06T14:53:41.720 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.145+0000 7fe15ad15700 1 -- 172.21.15.152:0/850462228 wait complete. 2023-12-06T14:53:41.720 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.146+0000 7fe15ad15700 1 Processor -- start 2023-12-06T14:53:41.720 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.146+0000 7fe15ad15700 1 -- start start 2023-12-06T14:53:41.720 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.147+0000 7fe15ad15700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe154070f60 0x7fe154113250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:41.720 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.147+0000 7fe15ad15700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe154113790 con 0x7fe154070f60 2023-12-06T14:53:41.720 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.147+0000 7fe158ab1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe154070f60 0x7fe154113250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:41.721 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.147+0000 7fe158ab1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe154070f60 0x7fe154113250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45274/0 (socket says 172.21.15.152:45274) 2023-12-06T14:53:41.721 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.147+0000 7fe158ab1700 1 -- 172.21.15.152:0/2628887855 learned_addr learned my addr 172.21.15.152:0/2628887855 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:41.721 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.147+0000 7fe158ab1700 1 -- 172.21.15.152:0/2628887855 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1480094f0 con 0x7fe154070f60 2023-12-06T14:53:41.721 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.147+0000 7fe158ab1700 1 --2- 172.21.15.152:0/2628887855 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe154070f60 0x7fe154113250 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe14800ba70 tx=0x7fe148009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:41.721 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.147+0000 7fe1517fa700 1 -- 172.21.15.152:0/2628887855 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe148010960 con 0x7fe154070f60 2023-12-06T14:53:41.721 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.147+0000 7fe15ad15700 1 -- 172.21.15.152:0/2628887855 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe154113990 con 0x7fe154070f60 2023-12-06T14:53:41.721 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.147+0000 7fe1517fa700 1 -- 172.21.15.152:0/2628887855 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe148024430 con 0x7fe154070f60 2023-12-06T14:53:41.721 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.147+0000 7fe1517fa700 1 -- 172.21.15.152:0/2628887855 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe14801a5f0 con 0x7fe154070f60 2023-12-06T14:53:41.721 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.147+0000 7fe15ad15700 1 -- 172.21.15.152:0/2628887855 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe154113da0 con 0x7fe154070f60 2023-12-06T14:53:41.721 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.148+0000 7fe1517fa700 1 -- 172.21.15.152:0/2628887855 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fe14801a8b0 con 0x7fe154070f60 2023-12-06T14:53:41.721 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.148+0000 7fe1517fa700 1 --2- 172.21.15.152:0/2628887855 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7fe1440365f0 0x7fe144038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:41.721 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.148+0000 7fe1517fa700 1 -- 172.21.15.152:0/2628887855 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fe14804a320 con 0x7fe154070f60 2023-12-06T14:53:41.721 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.148+0000 7fe153fff700 1 --2- 172.21.15.152:0/2628887855 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7fe1440365f0 0x7fe144038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:41.721 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.148+0000 7fe15ad15700 1 -- 172.21.15.152:0/2628887855 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe15404bb80 con 0x7fe154070f60 2023-12-06T14:53:41.722 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.149+0000 7fe153fff700 1 --2- 172.21.15.152:0/2628887855 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7fe1440365f0 0x7fe144038aa0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe140009990 tx=0x7fe140006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:41.722 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.153+0000 7fe1517fa700 1 -- 172.21.15.152:0/2628887855 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe148022330 con 0x7fe154070f60 2023-12-06T14:53:41.722 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.346+0000 7fe15ad15700 1 -- 172.21.15.152:0/2628887855 --> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7fe15410ceb0 con 0x7fe1440365f0 2023-12-06T14:53:41.722 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.350+0000 7fe1517fa700 1 -- 172.21.15.152:0/2628887855 <== mgr.14120 v2:172.21.15.152:6800/2466555973 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7fe15410ceb0 con 0x7fe1440365f0 2023-12-06T14:53:41.722 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.352+0000 7fe15ad15700 1 -- 172.21.15.152:0/2628887855 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7fe1440365f0 msgr2=0x7fe144038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:41.722 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.352+0000 7fe15ad15700 1 --2- 172.21.15.152:0/2628887855 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7fe1440365f0 0x7fe144038aa0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe140009990 tx=0x7fe140006e40 comp rx=0 tx=0).stop 2023-12-06T14:53:41.722 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.352+0000 7fe15ad15700 1 -- 172.21.15.152:0/2628887855 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe154070f60 msgr2=0x7fe154113250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:41.722 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.352+0000 7fe15ad15700 1 --2- 172.21.15.152:0/2628887855 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe154070f60 0x7fe154113250 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe14800ba70 tx=0x7fe148009250 comp rx=0 tx=0).stop 2023-12-06T14:53:41.722 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.352+0000 7fe15ad15700 1 -- 172.21.15.152:0/2628887855 shutdown_connections 2023-12-06T14:53:41.722 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.352+0000 7fe15ad15700 1 --2- 172.21.15.152:0/2628887855 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7fe1440365f0 0x7fe144038aa0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:41.722 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.352+0000 7fe15ad15700 1 --2- 172.21.15.152:0/2628887855 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe154070f60 0x7fe154113250 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:41.722 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.352+0000 7fe15ad15700 1 -- 172.21.15.152:0/2628887855 >> 172.21.15.152:0/2628887855 conn(0x7fe1540fc870 msgr2=0x7fe1540fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:41.722 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.352+0000 7fe15ad15700 1 -- 172.21.15.152:0/2628887855 shutdown_connections 2023-12-06T14:53:41.722 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:41.352+0000 7fe15ad15700 1 -- 172.21.15.152:0/2628887855 wait complete. 2023-12-06T14:53:42.127 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:41 smithi152 ceph-mon[111954]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:53:42.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:41 smithi152 ceph-mon[111954]: Saving service node-exporter spec with placement * 2023-12-06T14:53:42.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:41 smithi152 ceph-mon[111954]: from='mgr.14120 172.21.15.152:0/303232505' entity='mgr.smithi152.meodco' 2023-12-06T14:53:42.651 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.089+0000 7fe632abe700 1 Processor -- start 2023-12-06T14:53:42.652 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.089+0000 7fe632abe700 1 -- start start 2023-12-06T14:53:42.652 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.089+0000 7fe632abe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe62c1011d0 0x7fe62c1015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:42.652 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.089+0000 7fe632abe700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62c101b20 con 0x7fe62c1011d0 2023-12-06T14:53:42.652 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.089+0000 7fe63085a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe62c1011d0 0x7fe62c1015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:42.652 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.089+0000 7fe63085a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe62c1011d0 0x7fe62c1015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45276/0 (socket says 172.21.15.152:45276) 2023-12-06T14:53:42.652 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.089+0000 7fe63085a700 1 -- 172.21.15.152:0/3826284753 learned_addr learned my addr 172.21.15.152:0/3826284753 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:42.652 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.089+0000 7fe63085a700 1 -- 172.21.15.152:0/3826284753 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe62c101c60 con 0x7fe62c1011d0 2023-12-06T14:53:42.652 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.090+0000 7fe63085a700 1 --2- 172.21.15.152:0/3826284753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe62c1011d0 0x7fe62c1015e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe6200098e0 tx=0x7fe620009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d61f532ff0502a server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:42.652 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.090+0000 7fe62b7fe700 1 -- 172.21.15.152:0/3826284753 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe62000b860 con 0x7fe62c1011d0 2023-12-06T14:53:42.652 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.090+0000 7fe62b7fe700 1 -- 172.21.15.152:0/3826284753 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe62000be70 con 0x7fe62c1011d0 2023-12-06T14:53:42.652 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.090+0000 7fe62b7fe700 1 -- 172.21.15.152:0/3826284753 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe620010380 con 0x7fe62c1011d0 2023-12-06T14:53:42.652 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.090+0000 7fe632abe700 1 -- 172.21.15.152:0/3826284753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe62c1011d0 msgr2=0x7fe62c1015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:42.653 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.090+0000 7fe632abe700 1 --2- 172.21.15.152:0/3826284753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe62c1011d0 0x7fe62c1015e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe6200098e0 tx=0x7fe620009250 comp rx=0 tx=0).stop 2023-12-06T14:53:42.653 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.090+0000 7fe632abe700 1 -- 172.21.15.152:0/3826284753 shutdown_connections 2023-12-06T14:53:42.653 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.090+0000 7fe632abe700 1 --2- 172.21.15.152:0/3826284753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe62c1011d0 0x7fe62c1015e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:42.653 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.090+0000 7fe632abe700 1 -- 172.21.15.152:0/3826284753 >> 172.21.15.152:0/3826284753 conn(0x7fe62c0fc970 msgr2=0x7fe62c0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:42.653 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.090+0000 7fe632abe700 1 -- 172.21.15.152:0/3826284753 shutdown_connections 2023-12-06T14:53:42.653 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.090+0000 7fe632abe700 1 -- 172.21.15.152:0/3826284753 wait complete. 2023-12-06T14:53:42.653 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.091+0000 7fe632abe700 1 Processor -- start 2023-12-06T14:53:42.653 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.091+0000 7fe632abe700 1 -- start start 2023-12-06T14:53:42.653 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.091+0000 7fe632abe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe62c1011d0 0x7fe62c1111b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:42.653 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.091+0000 7fe632abe700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62c1116f0 con 0x7fe62c1011d0 2023-12-06T14:53:42.653 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.091+0000 7fe63085a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe62c1011d0 0x7fe62c1111b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:42.653 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.091+0000 7fe63085a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe62c1011d0 0x7fe62c1111b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45278/0 (socket says 172.21.15.152:45278) 2023-12-06T14:53:42.653 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.091+0000 7fe63085a700 1 -- 172.21.15.152:0/572150417 learned_addr learned my addr 172.21.15.152:0/572150417 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:42.653 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.091+0000 7fe63085a700 1 -- 172.21.15.152:0/572150417 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6200094f0 con 0x7fe62c1011d0 2023-12-06T14:53:42.653 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.092+0000 7fe63085a700 1 --2- 172.21.15.152:0/572150417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe62c1011d0 0x7fe62c1111b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe62000c010 tx=0x7fe620009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:42.654 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.092+0000 7fe6297fa700 1 -- 172.21.15.152:0/572150417 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe620010960 con 0x7fe62c1011d0 2023-12-06T14:53:42.654 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.092+0000 7fe6297fa700 1 -- 172.21.15.152:0/572150417 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe62001a430 con 0x7fe62c1011d0 2023-12-06T14:53:42.654 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.092+0000 7fe632abe700 1 -- 172.21.15.152:0/572150417 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe62c1118f0 con 0x7fe62c1011d0 2023-12-06T14:53:42.654 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.092+0000 7fe6297fa700 1 -- 172.21.15.152:0/572150417 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe620019580 con 0x7fe62c1011d0 2023-12-06T14:53:42.654 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.092+0000 7fe632abe700 1 -- 172.21.15.152:0/572150417 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe62c111d00 con 0x7fe62c1011d0 2023-12-06T14:53:42.654 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.093+0000 7fe6297fa700 1 -- 172.21.15.152:0/572150417 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fe6200197b0 con 0x7fe62c1011d0 2023-12-06T14:53:42.654 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.093+0000 7fe6297fa700 1 --2- 172.21.15.152:0/572150417 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7fe61c036640 0x7fe61c038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:42.654 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.093+0000 7fe6297fa700 1 -- 172.21.15.152:0/572150417 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fe62004a400 con 0x7fe62c1011d0 2023-12-06T14:53:42.654 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.093+0000 7fe62bfff700 1 --2- 172.21.15.152:0/572150417 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7fe61c036640 0x7fe61c038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:42.654 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.093+0000 7fe632abe700 1 -- 172.21.15.152:0/572150417 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe62c04bb80 con 0x7fe62c1011d0 2023-12-06T14:53:42.654 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.093+0000 7fe62bfff700 1 --2- 172.21.15.152:0/572150417 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7fe61c036640 0x7fe61c038af0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe618009990 tx=0x7fe618006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:42.654 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.097+0000 7fe6297fa700 1 -- 172.21.15.152:0/572150417 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe62002bb80 con 0x7fe62c1011d0 2023-12-06T14:53:42.654 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.278+0000 7fe632abe700 1 -- 172.21.15.152:0/572150417 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fe62c102fb0 con 0x7fe62c1011d0 2023-12-06T14:53:42.655 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.284+0000 7fe6297fa700 1 -- 172.21.15.152:0/572150417 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fe620023e00 con 0x7fe62c1011d0 2023-12-06T14:53:42.655 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.286+0000 7fe632abe700 1 -- 172.21.15.152:0/572150417 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7fe61c036640 msgr2=0x7fe61c038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:42.655 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.286+0000 7fe632abe700 1 --2- 172.21.15.152:0/572150417 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7fe61c036640 0x7fe61c038af0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe618009990 tx=0x7fe618006e40 comp rx=0 tx=0).stop 2023-12-06T14:53:42.655 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.286+0000 7fe632abe700 1 -- 172.21.15.152:0/572150417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe62c1011d0 msgr2=0x7fe62c1111b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:42.655 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.286+0000 7fe632abe700 1 --2- 172.21.15.152:0/572150417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe62c1011d0 0x7fe62c1111b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe62000c010 tx=0x7fe620009250 comp rx=0 tx=0).stop 2023-12-06T14:53:42.655 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.287+0000 7fe632abe700 1 -- 172.21.15.152:0/572150417 shutdown_connections 2023-12-06T14:53:42.655 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.287+0000 7fe632abe700 1 --2- 172.21.15.152:0/572150417 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7fe61c036640 0x7fe61c038af0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:42.655 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.287+0000 7fe632abe700 1 --2- 172.21.15.152:0/572150417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe62c1011d0 0x7fe62c1111b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:42.655 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.287+0000 7fe632abe700 1 -- 172.21.15.152:0/572150417 >> 172.21.15.152:0/572150417 conn(0x7fe62c0fc970 msgr2=0x7fe62c070b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:42.655 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.287+0000 7fe632abe700 1 -- 172.21.15.152:0/572150417 shutdown_connections 2023-12-06T14:53:42.655 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:42.287+0000 7fe632abe700 1 -- 172.21.15.152:0/572150417 wait complete. 2023-12-06T14:53:43.237 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:42 smithi152 ceph-mon[111954]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:53:43.237 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:42 smithi152 ceph-mon[111954]: Saving service alertmanager spec with placement count:1 2023-12-06T14:53:43.237 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:42 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/572150417' entity='client.admin' 2023-12-06T14:53:43.524 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.015+0000 7fd91695f700 1 Processor -- start 2023-12-06T14:53:43.524 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.015+0000 7fd91695f700 1 -- start start 2023-12-06T14:53:43.524 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.015+0000 7fd91695f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd910076c60 0x7fd910104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:43.524 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.015+0000 7fd91695f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9101053e0 con 0x7fd910076c60 2023-12-06T14:53:43.524 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.015+0000 7fd90ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd910076c60 0x7fd910104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:43.525 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.015+0000 7fd90ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd910076c60 0x7fd910104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45280/0 (socket says 172.21.15.152:45280) 2023-12-06T14:53:43.525 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.015+0000 7fd90ffff700 1 -- 172.21.15.152:0/52537743 learned_addr learned my addr 172.21.15.152:0/52537743 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:43.525 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.015+0000 7fd90ffff700 1 -- 172.21.15.152:0/52537743 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd910105520 con 0x7fd910076c60 2023-12-06T14:53:43.525 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.015+0000 7fd90ffff700 1 --2- 172.21.15.152:0/52537743 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd910076c60 0x7fd910104ea0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd9000098e0 tx=0x7fd900009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=452726a50618e83a server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:43.525 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.016+0000 7fd90effd700 1 -- 172.21.15.152:0/52537743 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd90000b860 con 0x7fd910076c60 2023-12-06T14:53:43.525 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.016+0000 7fd90effd700 1 -- 172.21.15.152:0/52537743 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd90000be70 con 0x7fd910076c60 2023-12-06T14:53:43.525 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.016+0000 7fd90effd700 1 -- 172.21.15.152:0/52537743 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd900010380 con 0x7fd910076c60 2023-12-06T14:53:43.525 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.016+0000 7fd91695f700 1 -- 172.21.15.152:0/52537743 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd910076c60 msgr2=0x7fd910104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:43.525 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.016+0000 7fd91695f700 1 --2- 172.21.15.152:0/52537743 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd910076c60 0x7fd910104ea0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd9000098e0 tx=0x7fd900009250 comp rx=0 tx=0).stop 2023-12-06T14:53:43.525 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.016+0000 7fd91695f700 1 -- 172.21.15.152:0/52537743 shutdown_connections 2023-12-06T14:53:43.525 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.016+0000 7fd91695f700 1 --2- 172.21.15.152:0/52537743 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd910076c60 0x7fd910104ea0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:43.525 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.016+0000 7fd91695f700 1 -- 172.21.15.152:0/52537743 >> 172.21.15.152:0/52537743 conn(0x7fd9100fc950 msgr2=0x7fd9100fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:43.525 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.016+0000 7fd91695f700 1 -- 172.21.15.152:0/52537743 shutdown_connections 2023-12-06T14:53:43.525 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.016+0000 7fd91695f700 1 -- 172.21.15.152:0/52537743 wait complete. 2023-12-06T14:53:43.525 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.017+0000 7fd91695f700 1 Processor -- start 2023-12-06T14:53:43.526 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.017+0000 7fd91695f700 1 -- start start 2023-12-06T14:53:43.526 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.017+0000 7fd91695f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd910076c60 0x7fd910102920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:43.526 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.017+0000 7fd91695f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd910100da0 con 0x7fd910076c60 2023-12-06T14:53:43.526 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.017+0000 7fd90ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd910076c60 0x7fd910102920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:43.526 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.017+0000 7fd90ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd910076c60 0x7fd910102920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45282/0 (socket says 172.21.15.152:45282) 2023-12-06T14:53:43.526 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.017+0000 7fd90ffff700 1 -- 172.21.15.152:0/1392515038 learned_addr learned my addr 172.21.15.152:0/1392515038 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:43.526 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.018+0000 7fd90ffff700 1 -- 172.21.15.152:0/1392515038 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9000094f0 con 0x7fd910076c60 2023-12-06T14:53:43.526 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.018+0000 7fd90ffff700 1 --2- 172.21.15.152:0/1392515038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd910076c60 0x7fd910102920 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd900006d40 tx=0x7fd900009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:43.526 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.018+0000 7fd90cff9700 1 -- 172.21.15.152:0/1392515038 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd900010960 con 0x7fd910076c60 2023-12-06T14:53:43.526 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.018+0000 7fd90cff9700 1 -- 172.21.15.152:0/1392515038 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd90001a430 con 0x7fd910076c60 2023-12-06T14:53:43.526 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.018+0000 7fd91695f700 1 -- 172.21.15.152:0/1392515038 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd910100fa0 con 0x7fd910076c60 2023-12-06T14:53:43.527 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.018+0000 7fd90cff9700 1 -- 172.21.15.152:0/1392515038 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd9000245b0 con 0x7fd910076c60 2023-12-06T14:53:43.527 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.018+0000 7fd91695f700 1 -- 172.21.15.152:0/1392515038 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9101013b0 con 0x7fd910076c60 2023-12-06T14:53:43.527 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.019+0000 7fd91695f700 1 -- 172.21.15.152:0/1392515038 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd91004bb80 con 0x7fd910076c60 2023-12-06T14:53:43.527 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.019+0000 7fd90cff9700 1 -- 172.21.15.152:0/1392515038 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7fd90001a9f0 con 0x7fd910076c60 2023-12-06T14:53:43.527 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.020+0000 7fd90cff9700 1 --2- 172.21.15.152:0/1392515038 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7fd8f80365f0 0x7fd8f8038aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:43.527 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.020+0000 7fd90cff9700 1 -- 172.21.15.152:0/1392515038 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd90004a3a0 con 0x7fd910076c60 2023-12-06T14:53:43.527 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.020+0000 7fd90f7fe700 1 --2- 172.21.15.152:0/1392515038 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7fd8f80365f0 0x7fd8f8038aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:43.527 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.020+0000 7fd90f7fe700 1 --2- 172.21.15.152:0/1392515038 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7fd8f80365f0 0x7fd8f8038aa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd904009990 tx=0x7fd904006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:43.527 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.024+0000 7fd90cff9700 1 -- 172.21.15.152:0/1392515038 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd900018db0 con 0x7fd910076c60 2023-12-06T14:53:43.527 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.205+0000 7fd91695f700 1 -- 172.21.15.152:0/1392515038 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7fd910106300 con 0x7fd910076c60 2023-12-06T14:53:43.527 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.211+0000 7fd90cff9700 1 -- 172.21.15.152:0/1392515038 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7fd900018350 con 0x7fd910076c60 2023-12-06T14:53:43.527 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.213+0000 7fd91695f700 1 -- 172.21.15.152:0/1392515038 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7fd8f80365f0 msgr2=0x7fd8f8038aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:43.527 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.213+0000 7fd91695f700 1 --2- 172.21.15.152:0/1392515038 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7fd8f80365f0 0x7fd8f8038aa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd904009990 tx=0x7fd904006e40 comp rx=0 tx=0).stop 2023-12-06T14:53:43.527 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.213+0000 7fd91695f700 1 -- 172.21.15.152:0/1392515038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd910076c60 msgr2=0x7fd910102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:43.527 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.213+0000 7fd91695f700 1 --2- 172.21.15.152:0/1392515038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd910076c60 0x7fd910102920 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd900006d40 tx=0x7fd900009250 comp rx=0 tx=0).stop 2023-12-06T14:53:43.528 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.213+0000 7fd91695f700 1 -- 172.21.15.152:0/1392515038 shutdown_connections 2023-12-06T14:53:43.528 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.213+0000 7fd91695f700 1 --2- 172.21.15.152:0/1392515038 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7fd8f80365f0 0x7fd8f8038aa0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:43.528 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.213+0000 7fd91695f700 1 --2- 172.21.15.152:0/1392515038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd910076c60 0x7fd910102920 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:43.528 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.213+0000 7fd91695f700 1 -- 172.21.15.152:0/1392515038 >> 172.21.15.152:0/1392515038 conn(0x7fd9100fc950 msgr2=0x7fd9100fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:43.528 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.213+0000 7fd91695f700 1 -- 172.21.15.152:0/1392515038 shutdown_connections 2023-12-06T14:53:43.528 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.213+0000 7fd91695f700 1 -- 172.21.15.152:0/1392515038 wait complete. 2023-12-06T14:53:43.528 INFO:teuthology.orchestra.run.smithi152.stdout:Enabling the dashboard module... 2023-12-06T14:53:44.533 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:44 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/1392515038' entity='client.admin' 2023-12-06T14:53:44.533 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:44 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/1774470379' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-12-06T14:53:44.626 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.898+0000 7f7242db9700 1 Processor -- start 2023-12-06T14:53:44.626 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.898+0000 7f7242db9700 1 -- start start 2023-12-06T14:53:44.626 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.898+0000 7f7242db9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f723c1022b0 0x7f723c1026c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:44.626 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.898+0000 7f7242db9700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723c102c00 con 0x7f723c1022b0 2023-12-06T14:53:44.626 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.898+0000 7f7240b55700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f723c1022b0 0x7f723c1026c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:44.626 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.898+0000 7f7240b55700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f723c1022b0 0x7f723c1026c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45294/0 (socket says 172.21.15.152:45294) 2023-12-06T14:53:44.626 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.898+0000 7f7240b55700 1 -- 172.21.15.152:0/2729798413 learned_addr learned my addr 172.21.15.152:0/2729798413 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:44.626 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.898+0000 7f7240b55700 1 -- 172.21.15.152:0/2729798413 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f723c102d40 con 0x7f723c1022b0 2023-12-06T14:53:44.627 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.899+0000 7f7240b55700 1 --2- 172.21.15.152:0/2729798413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f723c1022b0 0x7f723c1026c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f72300098e0 tx=0x7f7230009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e96ee2713b64fc server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:44.627 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.899+0000 7f723b7fe700 1 -- 172.21.15.152:0/2729798413 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f723000b860 con 0x7f723c1022b0 2023-12-06T14:53:44.627 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.899+0000 7f723b7fe700 1 -- 172.21.15.152:0/2729798413 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f723000be70 con 0x7f723c1022b0 2023-12-06T14:53:44.627 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.899+0000 7f723b7fe700 1 -- 172.21.15.152:0/2729798413 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7230010380 con 0x7f723c1022b0 2023-12-06T14:53:44.627 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.899+0000 7f7242db9700 1 -- 172.21.15.152:0/2729798413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f723c1022b0 msgr2=0x7f723c1026c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:44.627 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.899+0000 7f7242db9700 1 --2- 172.21.15.152:0/2729798413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f723c1022b0 0x7f723c1026c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f72300098e0 tx=0x7f7230009250 comp rx=0 tx=0).stop 2023-12-06T14:53:44.627 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.899+0000 7f7242db9700 1 -- 172.21.15.152:0/2729798413 shutdown_connections 2023-12-06T14:53:44.627 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.899+0000 7f7242db9700 1 --2- 172.21.15.152:0/2729798413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f723c1022b0 0x7f723c1026c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:44.627 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.899+0000 7f7242db9700 1 -- 172.21.15.152:0/2729798413 >> 172.21.15.152:0/2729798413 conn(0x7f723c0fda10 msgr2=0x7f723c0ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:44.627 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.899+0000 7f7242db9700 1 -- 172.21.15.152:0/2729798413 shutdown_connections 2023-12-06T14:53:44.627 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.900+0000 7f7242db9700 1 -- 172.21.15.152:0/2729798413 wait complete. 2023-12-06T14:53:44.627 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.900+0000 7f7242db9700 1 Processor -- start 2023-12-06T14:53:44.627 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.900+0000 7f7242db9700 1 -- start start 2023-12-06T14:53:44.627 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.900+0000 7f7242db9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f723c1022b0 0x7f723c111190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:44.627 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.900+0000 7f7242db9700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723c1116d0 con 0x7f723c1022b0 2023-12-06T14:53:44.628 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.900+0000 7f7240b55700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f723c1022b0 0x7f723c111190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:44.628 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.901+0000 7f7240b55700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f723c1022b0 0x7f723c111190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45296/0 (socket says 172.21.15.152:45296) 2023-12-06T14:53:44.628 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.901+0000 7f7240b55700 1 -- 172.21.15.152:0/1774470379 learned_addr learned my addr 172.21.15.152:0/1774470379 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:44.628 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.901+0000 7f7240b55700 1 -- 172.21.15.152:0/1774470379 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72300094f0 con 0x7f723c1022b0 2023-12-06T14:53:44.628 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.901+0000 7f7240b55700 1 --2- 172.21.15.152:0/1774470379 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f723c1022b0 0x7f723c111190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f723000c010 tx=0x7f7230009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:44.628 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.901+0000 7f72397fa700 1 -- 172.21.15.152:0/1774470379 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7230010960 con 0x7f723c1022b0 2023-12-06T14:53:44.628 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.901+0000 7f72397fa700 1 -- 172.21.15.152:0/1774470379 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f723001a430 con 0x7f723c1022b0 2023-12-06T14:53:44.628 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.901+0000 7f72397fa700 1 -- 172.21.15.152:0/1774470379 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7230019580 con 0x7f723c1022b0 2023-12-06T14:53:44.628 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.901+0000 7f7242db9700 1 -- 172.21.15.152:0/1774470379 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f723c1118d0 con 0x7f723c1022b0 2023-12-06T14:53:44.628 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.901+0000 7f7242db9700 1 -- 172.21.15.152:0/1774470379 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f723c111ce0 con 0x7f723c1022b0 2023-12-06T14:53:44.628 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.902+0000 7f72397fa700 1 -- 172.21.15.152:0/1774470379 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 8) v1 ==== 43281+0+0 (secure 0 0 0) 0x7f72300197b0 con 0x7f723c1022b0 2023-12-06T14:53:44.628 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.902+0000 7f7242db9700 1 -- 172.21.15.152:0/1774470379 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f723c04bb80 con 0x7f723c1022b0 2023-12-06T14:53:44.628 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.902+0000 7f72397fa700 1 --2- 172.21.15.152:0/1774470379 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f722c036640 0x7f722c038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:44.628 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.902+0000 7f72397fa700 1 -- 172.21.15.152:0/1774470379 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f723004a520 con 0x7f723c1022b0 2023-12-06T14:53:44.628 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.902+0000 7f723bfff700 1 --2- 172.21.15.152:0/1774470379 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f722c036640 0x7f722c038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:44.629 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.903+0000 7f723bfff700 1 --2- 172.21.15.152:0/1774470379 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f722c036640 0x7f722c038af0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7228009990 tx=0x7f7228006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:44.629 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:43.907+0000 7f72397fa700 1 -- 172.21.15.152:0/1774470379 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f723002bd10 con 0x7f723c1022b0 2023-12-06T14:53:44.629 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:44.139+0000 7f7242db9700 1 -- 172.21.15.152:0/1774470379 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f723c10af70 con 0x7f723c1022b0 2023-12-06T14:53:44.629 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:44.211+0000 7f72397fa700 1 -- 172.21.15.152:0/1774470379 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f723001a5a0 con 0x7f723c1022b0 2023-12-06T14:53:44.629 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:44.212+0000 7f72397fa700 1 -- 172.21.15.152:0/1774470379 <== mon.0 v2:172.21.15.152:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f723004ab80 con 0x7f723c1022b0 2023-12-06T14:53:44.629 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:44.214+0000 7f7242db9700 1 -- 172.21.15.152:0/1774470379 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f722c036640 msgr2=0x7f722c038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:44.629 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:44.214+0000 7f7242db9700 1 --2- 172.21.15.152:0/1774470379 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f722c036640 0x7f722c038af0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7228009990 tx=0x7f7228006e40 comp rx=0 tx=0).stop 2023-12-06T14:53:44.629 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:44.214+0000 7f7242db9700 1 -- 172.21.15.152:0/1774470379 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f723c1022b0 msgr2=0x7f723c111190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:44.629 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:44.214+0000 7f7242db9700 1 --2- 172.21.15.152:0/1774470379 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f723c1022b0 0x7f723c111190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f723000c010 tx=0x7f7230009250 comp rx=0 tx=0).stop 2023-12-06T14:53:44.629 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:44.214+0000 7f7242db9700 1 -- 172.21.15.152:0/1774470379 shutdown_connections 2023-12-06T14:53:44.629 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:44.214+0000 7f7242db9700 1 --2- 172.21.15.152:0/1774470379 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f722c036640 0x7f722c038af0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:44.629 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:44.214+0000 7f7242db9700 1 --2- 172.21.15.152:0/1774470379 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f723c1022b0 0x7f723c111190 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:44.629 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:44.215+0000 7f7242db9700 1 -- 172.21.15.152:0/1774470379 >> 172.21.15.152:0/1774470379 conn(0x7f723c0fda10 msgr2=0x7f723c0ff1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:44.629 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:44.215+0000 7f7242db9700 1 -- 172.21.15.152:0/1774470379 shutdown_connections 2023-12-06T14:53:44.629 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:44.215+0000 7f7242db9700 1 -- 172.21.15.152:0/1774470379 wait complete. 2023-12-06T14:53:45.548 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:45 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/1774470379' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-12-06T14:53:45.548 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:45 smithi152 ceph-mon[111954]: mgrmap e9: smithi152.meodco(active, since 19s) 2023-12-06T14:53:45.629 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout { 2023-12-06T14:53:45.635 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-12-06T14:53:45.635 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-06T14:53:45.635 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "active_name": "smithi152.meodco", 2023-12-06T14:53:45.635 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-06T14:53:45.635 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout } 2023-12-06T14:53:45.635 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.015+0000 7f44a25e4700 1 Processor -- start 2023-12-06T14:53:45.635 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.015+0000 7f44a25e4700 1 -- start start 2023-12-06T14:53:45.635 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.015+0000 7f44a25e4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f449c070f80 0x7f449c107320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:45.636 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.015+0000 7f44a25e4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449c102d10 con 0x7f449c070f80 2023-12-06T14:53:45.636 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.015+0000 7f449bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f449c070f80 0x7f449c107320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:45.636 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.015+0000 7f449bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f449c070f80 0x7f449c107320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45308/0 (socket says 172.21.15.152:45308) 2023-12-06T14:53:45.636 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.015+0000 7f449bfff700 1 -- 172.21.15.152:0/2010292398 learned_addr learned my addr 172.21.15.152:0/2010292398 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:45.636 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.016+0000 7f449bfff700 1 -- 172.21.15.152:0/2010292398 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449c107860 con 0x7f449c070f80 2023-12-06T14:53:45.636 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.016+0000 7f449bfff700 1 --2- 172.21.15.152:0/2010292398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f449c070f80 0x7f449c107320 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f448c0098e0 tx=0x7f448c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad740e948735ee7 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:45.636 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.016+0000 7f449affd700 1 -- 172.21.15.152:0/2010292398 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f448c00b860 con 0x7f449c070f80 2023-12-06T14:53:45.636 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.016+0000 7f449affd700 1 -- 172.21.15.152:0/2010292398 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f448c00be70 con 0x7f449c070f80 2023-12-06T14:53:45.636 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.016+0000 7f449affd700 1 -- 172.21.15.152:0/2010292398 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f448c010380 con 0x7f449c070f80 2023-12-06T14:53:45.636 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.016+0000 7f44a25e4700 1 -- 172.21.15.152:0/2010292398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f449c070f80 msgr2=0x7f449c107320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:45.636 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.016+0000 7f44a25e4700 1 --2- 172.21.15.152:0/2010292398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f449c070f80 0x7f449c107320 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f448c0098e0 tx=0x7f448c009250 comp rx=0 tx=0).stop 2023-12-06T14:53:45.636 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.016+0000 7f44a25e4700 1 -- 172.21.15.152:0/2010292398 shutdown_connections 2023-12-06T14:53:45.636 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.016+0000 7f44a25e4700 1 --2- 172.21.15.152:0/2010292398 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f449c070f80 0x7f449c107320 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:45.636 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.017+0000 7f44a25e4700 1 -- 172.21.15.152:0/2010292398 >> 172.21.15.152:0/2010292398 conn(0x7f449c0fc970 msgr2=0x7f449c0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:45.637 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.017+0000 7f44a25e4700 1 -- 172.21.15.152:0/2010292398 shutdown_connections 2023-12-06T14:53:45.637 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.017+0000 7f44a25e4700 1 -- 172.21.15.152:0/2010292398 wait complete. 2023-12-06T14:53:45.637 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.017+0000 7f44a25e4700 1 Processor -- start 2023-12-06T14:53:45.637 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.017+0000 7f44a25e4700 1 -- start start 2023-12-06T14:53:45.637 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.018+0000 7f44a25e4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f449c070f80 0x7f449c1133c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:45.637 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.018+0000 7f44a25e4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449c113900 con 0x7f449c070f80 2023-12-06T14:53:45.637 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.018+0000 7f449bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f449c070f80 0x7f449c1133c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:45.637 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.018+0000 7f449bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f449c070f80 0x7f449c1133c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45320/0 (socket says 172.21.15.152:45320) 2023-12-06T14:53:45.637 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.018+0000 7f449bfff700 1 -- 172.21.15.152:0/2752293258 learned_addr learned my addr 172.21.15.152:0/2752293258 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:45.637 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.018+0000 7f449bfff700 1 -- 172.21.15.152:0/2752293258 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f448c0094f0 con 0x7f449c070f80 2023-12-06T14:53:45.637 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.018+0000 7f449bfff700 1 --2- 172.21.15.152:0/2752293258 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f449c070f80 0x7f449c1133c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f448c0094c0 tx=0x7f448c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:45.637 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.018+0000 7f4498ff9700 1 -- 172.21.15.152:0/2752293258 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f448c010850 con 0x7f449c070f80 2023-12-06T14:53:45.637 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.018+0000 7f4498ff9700 1 -- 172.21.15.152:0/2752293258 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f448c010e60 con 0x7f449c070f80 2023-12-06T14:53:45.637 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.019+0000 7f44a25e4700 1 -- 172.21.15.152:0/2752293258 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f449c113b00 con 0x7f449c070f80 2023-12-06T14:53:45.637 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.019+0000 7f4498ff9700 1 -- 172.21.15.152:0/2752293258 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f448c01a430 con 0x7f449c070f80 2023-12-06T14:53:45.637 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.019+0000 7f44a25e4700 1 -- 172.21.15.152:0/2752293258 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f449c113f10 con 0x7f449c070f80 2023-12-06T14:53:45.638 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.019+0000 7f4498ff9700 1 -- 172.21.15.152:0/2752293258 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f448c01a660 con 0x7f449c070f80 2023-12-06T14:53:45.638 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.019+0000 7f44a25e4700 1 -- 172.21.15.152:0/2752293258 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f449c04bb80 con 0x7f449c070f80 2023-12-06T14:53:45.638 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.020+0000 7f4498ff9700 1 --2- 172.21.15.152:0/2752293258 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f4484036690 0x7f4484038b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:45.638 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.020+0000 7f4498ff9700 1 -- 172.21.15.152:0/2752293258 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f448c04a440 con 0x7f449c070f80 2023-12-06T14:53:45.638 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.020+0000 7f449b7fe700 1 -- 172.21.15.152:0/2752293258 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f4484036690 msgr2=0x7f4484038b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/2466555973 2023-12-06T14:53:45.638 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.020+0000 7f449b7fe700 1 --2- 172.21.15.152:0/2752293258 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f4484036690 0x7f4484038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-06T14:53:45.638 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.024+0000 7f4498ff9700 1 -- 172.21.15.152:0/2752293258 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f448c018b40 con 0x7f449c070f80 2023-12-06T14:53:45.638 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.221+0000 7f449b7fe700 1 -- 172.21.15.152:0/2752293258 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f4484036690 msgr2=0x7f4484038b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/2466555973 2023-12-06T14:53:45.638 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.221+0000 7f449b7fe700 1 --2- 172.21.15.152:0/2752293258 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f4484036690 0x7f4484038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-06T14:53:45.638 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.269+0000 7f44a25e4700 1 -- 172.21.15.152:0/2752293258 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f449c10d180 con 0x7f449c070f80 2023-12-06T14:53:45.638 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.269+0000 7f4498ff9700 1 -- 172.21.15.152:0/2752293258 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f448c018b40 con 0x7f449c070f80 2023-12-06T14:53:45.638 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.271+0000 7f44a25e4700 1 -- 172.21.15.152:0/2752293258 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f4484036690 msgr2=0x7f4484038b40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-06T14:53:45.638 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.271+0000 7f44a25e4700 1 --2- 172.21.15.152:0/2752293258 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f4484036690 0x7f4484038b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:45.639 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.271+0000 7f44a25e4700 1 -- 172.21.15.152:0/2752293258 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f449c070f80 msgr2=0x7f449c1133c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:45.639 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.271+0000 7f44a25e4700 1 --2- 172.21.15.152:0/2752293258 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f449c070f80 0x7f449c1133c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f448c0094c0 tx=0x7f448c009250 comp rx=0 tx=0).stop 2023-12-06T14:53:45.639 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.271+0000 7f44a25e4700 1 -- 172.21.15.152:0/2752293258 shutdown_connections 2023-12-06T14:53:45.639 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.271+0000 7f44a25e4700 1 --2- 172.21.15.152:0/2752293258 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f4484036690 0x7f4484038b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:45.639 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.271+0000 7f44a25e4700 1 --2- 172.21.15.152:0/2752293258 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f449c070f80 0x7f449c1133c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:45.639 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.271+0000 7f44a25e4700 1 -- 172.21.15.152:0/2752293258 >> 172.21.15.152:0/2752293258 conn(0x7f449c0fc970 msgr2=0x7f449c0fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:45.639 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.272+0000 7f44a25e4700 1 -- 172.21.15.152:0/2752293258 shutdown_connections 2023-12-06T14:53:45.639 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.272+0000 7f44a25e4700 1 -- 172.21.15.152:0/2752293258 wait complete. 2023-12-06T14:53:45.639 INFO:teuthology.orchestra.run.smithi152.stdout:Waiting for the mgr to restart... 2023-12-06T14:53:45.639 INFO:teuthology.orchestra.run.smithi152.stdout:Waiting for mgr epoch 9... 2023-12-06T14:53:46.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:46 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/2752293258' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-06T14:53:51.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:50 smithi152 ceph-mon[111954]: Active manager daemon smithi152.meodco restarted 2023-12-06T14:53:51.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:50 smithi152 ceph-mon[111954]: Activating manager daemon smithi152.meodco 2023-12-06T14:53:51.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:50 smithi152 ceph-mon[111954]: osdmap e3: 0 total, 0 up, 0 in 2023-12-06T14:53:51.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:50 smithi152 ceph-mon[111954]: mgrmap e10: smithi152.meodco(active, starting, since 0.0032905s) 2023-12-06T14:53:51.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:50 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-06T14:53:51.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:50 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mgr metadata", "who": "smithi152.meodco", "id": "smithi152.meodco"}]: dispatch 2023-12-06T14:53:51.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:50 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-06T14:53:51.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:50 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-06T14:53:51.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:50 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-06T14:53:51.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:50 smithi152 ceph-mon[111954]: Manager daemon smithi152.meodco is now available 2023-12-06T14:53:51.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:50 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:53:51.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:50 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:53:51.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:50 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.meodco/mirror_snapshot_schedule"}]: dispatch 2023-12-06T14:53:51.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:50 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.meodco/trash_purge_schedule"}]: dispatch 2023-12-06T14:53:52.118 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout { 2023-12-06T14:53:52.118 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-12-06T14:53:52.118 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-06T14:53:52.118 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout } 2023-12-06T14:53:52.118 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.977+0000 7f3f9e592700 1 Processor -- start 2023-12-06T14:53:52.118 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.977+0000 7f3f9e592700 1 -- start start 2023-12-06T14:53:52.119 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.978+0000 7f3f9e592700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f981011d0 0x7f3f981015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:52.119 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.978+0000 7f3f9e592700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f98101b20 con 0x7f3f981011d0 2023-12-06T14:53:52.119 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.978+0000 7f3f97fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f981011d0 0x7f3f981015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:52.119 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.978+0000 7f3f97fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f981011d0 0x7f3f981015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45322/0 (socket says 172.21.15.152:45322) 2023-12-06T14:53:52.119 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.978+0000 7f3f97fff700 1 -- 172.21.15.152:0/1513285612 learned_addr learned my addr 172.21.15.152:0/1513285612 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:52.119 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.978+0000 7f3f97fff700 1 -- 172.21.15.152:0/1513285612 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f98101c60 con 0x7f3f981011d0 2023-12-06T14:53:52.119 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.978+0000 7f3f97fff700 1 --2- 172.21.15.152:0/1513285612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f981011d0 0x7f3f981015e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3f880098e0 tx=0x7f3f88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b2727f642d0c9b server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:52.119 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.978+0000 7f3f96ffd700 1 -- 172.21.15.152:0/1513285612 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f8800b860 con 0x7f3f981011d0 2023-12-06T14:53:52.119 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.978+0000 7f3f96ffd700 1 -- 172.21.15.152:0/1513285612 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3f8800be70 con 0x7f3f981011d0 2023-12-06T14:53:52.119 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.978+0000 7f3f96ffd700 1 -- 172.21.15.152:0/1513285612 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f88010380 con 0x7f3f981011d0 2023-12-06T14:53:52.119 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.979+0000 7f3f9e592700 1 -- 172.21.15.152:0/1513285612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f981011d0 msgr2=0x7f3f981015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:52.119 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.979+0000 7f3f9e592700 1 --2- 172.21.15.152:0/1513285612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f981011d0 0x7f3f981015e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3f880098e0 tx=0x7f3f88009250 comp rx=0 tx=0).stop 2023-12-06T14:53:52.119 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.979+0000 7f3f9e592700 1 -- 172.21.15.152:0/1513285612 shutdown_connections 2023-12-06T14:53:52.119 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.979+0000 7f3f9e592700 1 --2- 172.21.15.152:0/1513285612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f981011d0 0x7f3f981015e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:52.119 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.979+0000 7f3f9e592700 1 -- 172.21.15.152:0/1513285612 >> 172.21.15.152:0/1513285612 conn(0x7f3f980fc970 msgr2=0x7f3f980fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:52.120 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.979+0000 7f3f9e592700 1 -- 172.21.15.152:0/1513285612 shutdown_connections 2023-12-06T14:53:52.120 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.979+0000 7f3f9e592700 1 -- 172.21.15.152:0/1513285612 wait complete. 2023-12-06T14:53:52.120 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.980+0000 7f3f9e592700 1 Processor -- start 2023-12-06T14:53:52.120 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.980+0000 7f3f9e592700 1 -- start start 2023-12-06T14:53:52.120 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.980+0000 7f3f9e592700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f981011d0 0x7f3f98111180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:52.120 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.980+0000 7f3f9e592700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f981116c0 con 0x7f3f981011d0 2023-12-06T14:53:52.120 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.980+0000 7f3f97fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f981011d0 0x7f3f98111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:52.120 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.980+0000 7f3f97fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f981011d0 0x7f3f98111180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45328/0 (socket says 172.21.15.152:45328) 2023-12-06T14:53:52.120 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.980+0000 7f3f97fff700 1 -- 172.21.15.152:0/2349966038 learned_addr learned my addr 172.21.15.152:0/2349966038 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:52.120 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.980+0000 7f3f97fff700 1 -- 172.21.15.152:0/2349966038 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f880094f0 con 0x7f3f981011d0 2023-12-06T14:53:52.120 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.980+0000 7f3f97fff700 1 --2- 172.21.15.152:0/2349966038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f981011d0 0x7f3f98111180 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3f88011b60 tx=0x7f3f88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:52.120 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.981+0000 7f3f94ff9700 1 -- 172.21.15.152:0/2349966038 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f88010850 con 0x7f3f981011d0 2023-12-06T14:53:52.120 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.981+0000 7f3f94ff9700 1 -- 172.21.15.152:0/2349966038 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3f88010e60 con 0x7f3f981011d0 2023-12-06T14:53:52.120 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.981+0000 7f3f9e592700 1 -- 172.21.15.152:0/2349966038 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f981118c0 con 0x7f3f981011d0 2023-12-06T14:53:52.121 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.981+0000 7f3f94ff9700 1 -- 172.21.15.152:0/2349966038 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f8801ae20 con 0x7f3f981011d0 2023-12-06T14:53:52.121 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.981+0000 7f3f9e592700 1 -- 172.21.15.152:0/2349966038 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f98111cd0 con 0x7f3f981011d0 2023-12-06T14:53:52.121 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.981+0000 7f3f94ff9700 1 -- 172.21.15.152:0/2349966038 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 9) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f3f8802d3f0 con 0x7f3f981011d0 2023-12-06T14:53:52.121 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.982+0000 7f3f94ff9700 1 --2- 172.21.15.152:0/2349966038 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f3f80036640 0x7f3f80038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:52.121 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.982+0000 7f3f94ff9700 1 -- 172.21.15.152:0/2349966038 --> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3f80039200 con 0x7f3f80036640 2023-12-06T14:53:52.121 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.982+0000 7f3f94ff9700 1 -- 172.21.15.152:0/2349966038 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f3f8804a4e0 con 0x7f3f981011d0 2023-12-06T14:53:52.121 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.982+0000 7f3f977fe700 1 -- 172.21.15.152:0/2349966038 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f3f80036640 msgr2=0x7f3f80038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/2466555973 2023-12-06T14:53:52.121 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:45.982+0000 7f3f977fe700 1 --2- 172.21.15.152:0/2349966038 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f3f80036640 0x7f3f80038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-06T14:53:52.121 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:46.183+0000 7f3f977fe700 1 -- 172.21.15.152:0/2349966038 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f3f80036640 msgr2=0x7f3f80038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/2466555973 2023-12-06T14:53:52.121 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:46.183+0000 7f3f977fe700 1 --2- 172.21.15.152:0/2349966038 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f3f80036640 0x7f3f80038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-06T14:53:52.121 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:46.584+0000 7f3f977fe700 1 -- 172.21.15.152:0/2349966038 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f3f80036640 msgr2=0x7f3f80038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/2466555973 2023-12-06T14:53:52.121 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:46.584+0000 7f3f977fe700 1 --2- 172.21.15.152:0/2349966038 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f3f80036640 0x7f3f80038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-06T14:53:52.121 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:47.385+0000 7f3f977fe700 1 -- 172.21.15.152:0/2349966038 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f3f80036640 msgr2=0x7f3f80038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/2466555973 2023-12-06T14:53:52.121 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:47.385+0000 7f3f977fe700 1 --2- 172.21.15.152:0/2349966038 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f3f80036640 0x7f3f80038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-06T14:53:52.122 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:48.986+0000 7f3f977fe700 1 -- 172.21.15.152:0/2349966038 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f3f80036640 msgr2=0x7f3f80038af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/2466555973 2023-12-06T14:53:52.122 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:48.986+0000 7f3f977fe700 1 --2- 172.21.15.152:0/2349966038 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f3f80036640 0x7f3f80038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-06T14:53:52.122 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:50.750+0000 7f3f94ff9700 1 -- 172.21.15.152:0/2349966038 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mgrmap(e 10) v1 ==== 43061+0+0 (secure 0 0 0) 0x7f3f8802d740 con 0x7f3f981011d0 2023-12-06T14:53:52.122 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:50.750+0000 7f3f94ff9700 1 -- 172.21.15.152:0/2349966038 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f3f80036640 msgr2=0x7f3f80038af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-06T14:53:52.122 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:50.750+0000 7f3f94ff9700 1 --2- 172.21.15.152:0/2349966038 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f3f80036640 0x7f3f80038af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:52.122 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:51.752+0000 7f3f94ff9700 1 -- 172.21.15.152:0/2349966038 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mgrmap(e 11) v1 ==== 43188+0+0 (secure 0 0 0) 0x7f3f88016d20 con 0x7f3f981011d0 2023-12-06T14:53:52.122 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:51.752+0000 7f3f94ff9700 1 --2- 172.21.15.152:0/2349966038 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f3f80039fb0 0x7f3f8003c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:52.122 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:51.752+0000 7f3f94ff9700 1 -- 172.21.15.152:0/2349966038 --> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3f80039200 con 0x7f3f80039fb0 2023-12-06T14:53:52.122 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:51.752+0000 7f3f977fe700 1 --2- 172.21.15.152:0/2349966038 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f3f80039fb0 0x7f3f8003c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:52.122 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:51.753+0000 7f3f977fe700 1 --2- 172.21.15.152:0/2349966038 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f3f80039fb0 0x7f3f8003c390 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c0039d0 tx=0x7f3f8c0092f0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:52.122 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:51.753+0000 7f3f94ff9700 1 -- 172.21.15.152:0/2349966038 <== mgr.14162 v2:172.21.15.152:6800/3517650686 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f3f80039200 con 0x7f3f80039fb0 2023-12-06T14:53:52.122 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:51.759+0000 7f3f9e592700 1 -- 172.21.15.152:0/2349966038 --> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f3f9804bb80 con 0x7f3f80039fb0 2023-12-06T14:53:52.122 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:51.760+0000 7f3f94ff9700 1 -- 172.21.15.152:0/2349966038 <== mgr.14162 v2:172.21.15.152:6800/3517650686 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f3f9804bb80 con 0x7f3f80039fb0 2023-12-06T14:53:52.122 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:51.760+0000 7f3f9e592700 1 -- 172.21.15.152:0/2349966038 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f3f80039fb0 msgr2=0x7f3f8003c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:52.122 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:51.760+0000 7f3f9e592700 1 --2- 172.21.15.152:0/2349966038 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f3f80039fb0 0x7f3f8003c390 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c0039d0 tx=0x7f3f8c0092f0 comp rx=0 tx=0).stop 2023-12-06T14:53:52.123 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:51.760+0000 7f3f9e592700 1 -- 172.21.15.152:0/2349966038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f981011d0 msgr2=0x7f3f98111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:52.123 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:51.760+0000 7f3f9e592700 1 --2- 172.21.15.152:0/2349966038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f981011d0 0x7f3f98111180 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3f88011b60 tx=0x7f3f88009250 comp rx=0 tx=0).stop 2023-12-06T14:53:52.123 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:51.760+0000 7f3f9e592700 1 -- 172.21.15.152:0/2349966038 shutdown_connections 2023-12-06T14:53:52.123 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:51.760+0000 7f3f9e592700 1 --2- 172.21.15.152:0/2349966038 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f3f80039fb0 0x7f3f8003c390 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:52.123 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:51.760+0000 7f3f9e592700 1 --2- 172.21.15.152:0/2349966038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f981011d0 0x7f3f98111180 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:52.123 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:51.760+0000 7f3f9e592700 1 --2- 172.21.15.152:0/2349966038 >> [v2:172.21.15.152:6800/2466555973,v1:172.21.15.152:6801/2466555973] conn(0x7f3f80036640 0x7f3f80038af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:52.123 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:51.760+0000 7f3f9e592700 1 -- 172.21.15.152:0/2349966038 >> 172.21.15.152:0/2349966038 conn(0x7f3f980fc970 msgr2=0x7f3f980fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:52.123 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:51.760+0000 7f3f9e592700 1 -- 172.21.15.152:0/2349966038 shutdown_connections 2023-12-06T14:53:52.123 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:51.760+0000 7f3f9e592700 1 -- 172.21.15.152:0/2349966038 wait complete. 2023-12-06T14:53:52.123 INFO:teuthology.orchestra.run.smithi152.stdout:mgr epoch 9 is available 2023-12-06T14:53:52.123 INFO:teuthology.orchestra.run.smithi152.stdout:Generating a dashboard self-signed certificate... 2023-12-06T14:53:52.877 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:52 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:53:52.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:52 smithi152 ceph-mon[111954]: mgrmap e11: smithi152.meodco(active, since 1.00571s) 2023-12-06T14:53:52.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:52 smithi152 ceph-mon[111954]: [06/Dec/2023:14:53:51] ENGINE Bus STARTING 2023-12-06T14:53:52.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:52 smithi152 ceph-mon[111954]: [06/Dec/2023:14:53:52] ENGINE Serving on https://172.21.15.152:7150 2023-12-06T14:53:52.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:52 smithi152 ceph-mon[111954]: [06/Dec/2023:14:53:52] ENGINE Bus STARTED 2023-12-06T14:53:52.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:52 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:53:52.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:52 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:53:53.437 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-12-06T14:53:53.437 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.475+0000 7f372228e700 1 Processor -- start 2023-12-06T14:53:53.437 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.475+0000 7f372228e700 1 -- start start 2023-12-06T14:53:53.437 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.475+0000 7f372228e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f371c1011d0 0x7f371c1015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:53.437 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.475+0000 7f372228e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371c101b20 con 0x7f371c1011d0 2023-12-06T14:53:53.437 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.475+0000 7f371bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f371c1011d0 0x7f371c1015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:53.438 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.475+0000 7f371bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f371c1011d0 0x7f371c1015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:55282/0 (socket says 172.21.15.152:55282) 2023-12-06T14:53:53.438 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.475+0000 7f371bfff700 1 -- 172.21.15.152:0/963339129 learned_addr learned my addr 172.21.15.152:0/963339129 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:53.438 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.475+0000 7f371bfff700 1 -- 172.21.15.152:0/963339129 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f371c101c60 con 0x7f371c1011d0 2023-12-06T14:53:53.438 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.475+0000 7f371bfff700 1 --2- 172.21.15.152:0/963339129 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f371c1011d0 0x7f371c1015e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f370c0098e0 tx=0x7f370c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=298631ebac569e77 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:53.438 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.476+0000 7f371affd700 1 -- 172.21.15.152:0/963339129 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f370c00b860 con 0x7f371c1011d0 2023-12-06T14:53:53.438 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.476+0000 7f371affd700 1 -- 172.21.15.152:0/963339129 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f370c00be70 con 0x7f371c1011d0 2023-12-06T14:53:53.438 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.476+0000 7f371affd700 1 -- 172.21.15.152:0/963339129 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f370c010380 con 0x7f371c1011d0 2023-12-06T14:53:53.438 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.476+0000 7f372228e700 1 -- 172.21.15.152:0/963339129 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f371c1011d0 msgr2=0x7f371c1015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:53.438 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.476+0000 7f372228e700 1 --2- 172.21.15.152:0/963339129 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f371c1011d0 0x7f371c1015e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f370c0098e0 tx=0x7f370c009250 comp rx=0 tx=0).stop 2023-12-06T14:53:53.438 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.476+0000 7f372228e700 1 -- 172.21.15.152:0/963339129 shutdown_connections 2023-12-06T14:53:53.438 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.476+0000 7f372228e700 1 --2- 172.21.15.152:0/963339129 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f371c1011d0 0x7f371c1015e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:53.439 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.476+0000 7f372228e700 1 -- 172.21.15.152:0/963339129 >> 172.21.15.152:0/963339129 conn(0x7f371c0fc970 msgr2=0x7f371c0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:53.439 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.476+0000 7f372228e700 1 -- 172.21.15.152:0/963339129 shutdown_connections 2023-12-06T14:53:53.439 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.476+0000 7f372228e700 1 -- 172.21.15.152:0/963339129 wait complete. 2023-12-06T14:53:53.439 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.477+0000 7f372228e700 1 Processor -- start 2023-12-06T14:53:53.439 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.477+0000 7f372228e700 1 -- start start 2023-12-06T14:53:53.439 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.477+0000 7f372228e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f371c1011d0 0x7f371c113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:53.439 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.477+0000 7f372228e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371c1138c0 con 0x7f371c1011d0 2023-12-06T14:53:53.440 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.478+0000 7f371bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f371c1011d0 0x7f371c113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:53.440 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.478+0000 7f371bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f371c1011d0 0x7f371c113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:55290/0 (socket says 172.21.15.152:55290) 2023-12-06T14:53:53.440 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.478+0000 7f371bfff700 1 -- 172.21.15.152:0/1373249520 learned_addr learned my addr 172.21.15.152:0/1373249520 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:53.440 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.478+0000 7f371bfff700 1 -- 172.21.15.152:0/1373249520 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370c0094f0 con 0x7f371c1011d0 2023-12-06T14:53:53.440 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.478+0000 7f371bfff700 1 --2- 172.21.15.152:0/1373249520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f371c1011d0 0x7f371c113380 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f370c00c010 tx=0x7f370c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:53.440 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.478+0000 7f3718ff9700 1 -- 172.21.15.152:0/1373249520 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f370c010960 con 0x7f371c1011d0 2023-12-06T14:53:53.440 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.478+0000 7f3718ff9700 1 -- 172.21.15.152:0/1373249520 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f370c01a430 con 0x7f371c1011d0 2023-12-06T14:53:53.440 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.478+0000 7f372228e700 1 -- 172.21.15.152:0/1373249520 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f371c113ac0 con 0x7f371c1011d0 2023-12-06T14:53:53.440 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.478+0000 7f3718ff9700 1 -- 172.21.15.152:0/1373249520 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f370c0245b0 con 0x7f371c1011d0 2023-12-06T14:53:53.440 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.478+0000 7f372228e700 1 -- 172.21.15.152:0/1373249520 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f371c113ed0 con 0x7f371c1011d0 2023-12-06T14:53:53.440 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.479+0000 7f3718ff9700 1 -- 172.21.15.152:0/1373249520 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 11) v1 ==== 43188+0+0 (secure 0 0 0) 0x7f370c0247f0 con 0x7f371c1011d0 2023-12-06T14:53:53.440 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.479+0000 7f3718ff9700 1 --2- 172.21.15.152:0/1373249520 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f3704036510 0x7f37040389c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:53.441 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.479+0000 7f372228e700 1 -- 172.21.15.152:0/1373249520 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f371c04bb80 con 0x7f371c1011d0 2023-12-06T14:53:53.441 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.479+0000 7f3718ff9700 1 -- 172.21.15.152:0/1373249520 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f370c04b4b0 con 0x7f371c1011d0 2023-12-06T14:53:53.441 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.479+0000 7f371b7fe700 1 --2- 172.21.15.152:0/1373249520 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f3704036510 0x7f37040389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:53.441 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.480+0000 7f371b7fe700 1 --2- 172.21.15.152:0/1373249520 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f3704036510 0x7f37040389c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3710009990 tx=0x7f3710006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:53.441 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.484+0000 7f3718ff9700 1 -- 172.21.15.152:0/1373249520 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f370c02c340 con 0x7f371c1011d0 2023-12-06T14:53:53.441 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.679+0000 7f372228e700 1 -- 172.21.15.152:0/1373249520 --> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f371c0fec30 con 0x7f3704036510 2023-12-06T14:53:53.441 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.882+0000 7f3718ff9700 1 -- 172.21.15.152:0/1373249520 <== mgr.14162 v2:172.21.15.152:6800/3517650686 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f371c0fec30 con 0x7f3704036510 2023-12-06T14:53:53.442 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.884+0000 7f372228e700 1 -- 172.21.15.152:0/1373249520 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f3704036510 msgr2=0x7f37040389c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:53.442 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.884+0000 7f372228e700 1 --2- 172.21.15.152:0/1373249520 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f3704036510 0x7f37040389c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3710009990 tx=0x7f3710006e40 comp rx=0 tx=0).stop 2023-12-06T14:53:53.442 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.884+0000 7f372228e700 1 -- 172.21.15.152:0/1373249520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f371c1011d0 msgr2=0x7f371c113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:53.442 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.884+0000 7f372228e700 1 --2- 172.21.15.152:0/1373249520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f371c1011d0 0x7f371c113380 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f370c00c010 tx=0x7f370c009250 comp rx=0 tx=0).stop 2023-12-06T14:53:53.442 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.884+0000 7f372228e700 1 -- 172.21.15.152:0/1373249520 shutdown_connections 2023-12-06T14:53:53.442 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.884+0000 7f372228e700 1 --2- 172.21.15.152:0/1373249520 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f3704036510 0x7f37040389c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:53.442 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.884+0000 7f372228e700 1 --2- 172.21.15.152:0/1373249520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f371c1011d0 0x7f371c113380 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:53.443 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.884+0000 7f372228e700 1 -- 172.21.15.152:0/1373249520 >> 172.21.15.152:0/1373249520 conn(0x7f371c0fc970 msgr2=0x7f371c070bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:53.443 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.884+0000 7f372228e700 1 -- 172.21.15.152:0/1373249520 shutdown_connections 2023-12-06T14:53:53.443 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:52.885+0000 7f372228e700 1 -- 172.21.15.152:0/1373249520 wait complete. 2023-12-06T14:53:53.443 INFO:teuthology.orchestra.run.smithi152.stdout:Creating initial admin user... 2023-12-06T14:53:54.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:53 smithi152 ceph-mon[111954]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:53:54.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:53 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:53:54.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:53 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:53:54.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:53 smithi152 ceph-mon[111954]: mgrmap e12: smithi152.meodco(active, since 2s) 2023-12-06T14:53:54.767 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$9jIMP2IeWR8C/lQLjuTc9uS/n0waE1nfTh0JjSIMRKbsz/HeEuQui", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1701874434, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-12-06T14:53:54.767 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.968+0000 7f82e8035700 1 Processor -- start 2023-12-06T14:53:54.767 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.969+0000 7f82e8035700 1 -- start start 2023-12-06T14:53:54.767 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.969+0000 7f82e8035700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82e0070fc0 0x7f82e0104ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:54.767 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.969+0000 7f82e8035700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e0105420 con 0x7f82e0070fc0 2023-12-06T14:53:54.767 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.969+0000 7f82e5dd1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82e0070fc0 0x7f82e0104ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:54.767 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.969+0000 7f82e5dd1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82e0070fc0 0x7f82e0104ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:55296/0 (socket says 172.21.15.152:55296) 2023-12-06T14:53:54.767 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.969+0000 7f82e5dd1700 1 -- 172.21.15.152:0/494739517 learned_addr learned my addr 172.21.15.152:0/494739517 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:54.767 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.969+0000 7f82e5dd1700 1 -- 172.21.15.152:0/494739517 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e0105560 con 0x7f82e0070fc0 2023-12-06T14:53:54.767 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.969+0000 7f82e5dd1700 1 --2- 172.21.15.152:0/494739517 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82e0070fc0 0x7f82e0104ee0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f82d00098e0 tx=0x7f82d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47da0a4c584d2e44 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:54.768 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.969+0000 7f82e4dcf700 1 -- 172.21.15.152:0/494739517 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f82d000b860 con 0x7f82e0070fc0 2023-12-06T14:53:54.768 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.969+0000 7f82e4dcf700 1 -- 172.21.15.152:0/494739517 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f82d000be70 con 0x7f82e0070fc0 2023-12-06T14:53:54.768 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.969+0000 7f82e4dcf700 1 -- 172.21.15.152:0/494739517 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f82d0010380 con 0x7f82e0070fc0 2023-12-06T14:53:54.768 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.970+0000 7f82e8035700 1 -- 172.21.15.152:0/494739517 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82e0070fc0 msgr2=0x7f82e0104ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:54.768 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.970+0000 7f82e8035700 1 --2- 172.21.15.152:0/494739517 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82e0070fc0 0x7f82e0104ee0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f82d00098e0 tx=0x7f82d0009250 comp rx=0 tx=0).stop 2023-12-06T14:53:54.768 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.970+0000 7f82e8035700 1 -- 172.21.15.152:0/494739517 shutdown_connections 2023-12-06T14:53:54.768 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.970+0000 7f82e8035700 1 --2- 172.21.15.152:0/494739517 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82e0070fc0 0x7f82e0104ee0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:54.768 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.970+0000 7f82e8035700 1 -- 172.21.15.152:0/494739517 >> 172.21.15.152:0/494739517 conn(0x7f82e00fc970 msgr2=0x7f82e00fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:54.768 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.970+0000 7f82e8035700 1 -- 172.21.15.152:0/494739517 shutdown_connections 2023-12-06T14:53:54.768 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.970+0000 7f82e8035700 1 -- 172.21.15.152:0/494739517 wait complete. 2023-12-06T14:53:54.768 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.971+0000 7f82e8035700 1 Processor -- start 2023-12-06T14:53:54.768 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.971+0000 7f82e8035700 1 -- start start 2023-12-06T14:53:54.768 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.971+0000 7f82e8035700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82e0070fc0 0x7f82e01111a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:54.768 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.971+0000 7f82e8035700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e01116e0 con 0x7f82e0070fc0 2023-12-06T14:53:54.768 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.971+0000 7f82e5dd1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82e0070fc0 0x7f82e01111a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:54.769 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.971+0000 7f82e5dd1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82e0070fc0 0x7f82e01111a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:55310/0 (socket says 172.21.15.152:55310) 2023-12-06T14:53:54.769 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.971+0000 7f82e5dd1700 1 -- 172.21.15.152:0/1361911530 learned_addr learned my addr 172.21.15.152:0/1361911530 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:54.769 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.971+0000 7f82e5dd1700 1 -- 172.21.15.152:0/1361911530 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d00094f0 con 0x7f82e0070fc0 2023-12-06T14:53:54.769 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.971+0000 7f82e5dd1700 1 --2- 172.21.15.152:0/1361911530 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82e0070fc0 0x7f82e01111a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f82d00094c0 tx=0x7f82d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:54.769 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.972+0000 7f82d67fc700 1 -- 172.21.15.152:0/1361911530 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f82d0010850 con 0x7f82e0070fc0 2023-12-06T14:53:54.769 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.972+0000 7f82d67fc700 1 -- 172.21.15.152:0/1361911530 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f82d0010e60 con 0x7f82e0070fc0 2023-12-06T14:53:54.769 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.972+0000 7f82e8035700 1 -- 172.21.15.152:0/1361911530 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e01118e0 con 0x7f82e0070fc0 2023-12-06T14:53:54.769 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.972+0000 7f82d67fc700 1 -- 172.21.15.152:0/1361911530 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f82d001a430 con 0x7f82e0070fc0 2023-12-06T14:53:54.769 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.972+0000 7f82e8035700 1 -- 172.21.15.152:0/1361911530 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e0111cf0 con 0x7f82e0070fc0 2023-12-06T14:53:54.769 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.972+0000 7f82d67fc700 1 -- 172.21.15.152:0/1361911530 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7f82d001a6b0 con 0x7f82e0070fc0 2023-12-06T14:53:54.769 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.972+0000 7f82e8035700 1 -- 172.21.15.152:0/1361911530 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e004bb80 con 0x7f82e0070fc0 2023-12-06T14:53:54.769 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.973+0000 7f82d67fc700 1 --2- 172.21.15.152:0/1361911530 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f82cc036640 0x7f82cc038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:54.769 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.973+0000 7f82d67fc700 1 -- 172.21.15.152:0/1361911530 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f82d004a540 con 0x7f82e0070fc0 2023-12-06T14:53:54.769 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.973+0000 7f82e55d0700 1 --2- 172.21.15.152:0/1361911530 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f82cc036640 0x7f82cc038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:54.769 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.973+0000 7f82e55d0700 1 --2- 172.21.15.152:0/1361911530 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f82cc036640 0x7f82cc038af0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f82dc009990 tx=0x7f82dc006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:54.770 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:53.977+0000 7f82d67fc700 1 -- 172.21.15.152:0/1361911530 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f82d00189a0 con 0x7f82e0070fc0 2023-12-06T14:53:54.770 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:54.179+0000 7f82e8035700 1 -- 172.21.15.152:0/1361911530 --> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f82e01062e0 con 0x7f82cc036640 2023-12-06T14:53:54.770 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:54.396+0000 7f82d67fc700 1 -- 172.21.15.152:0/1361911530 <== mgr.14162 v2:172.21.15.152:6800/3517650686 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f82e01062e0 con 0x7f82cc036640 2023-12-06T14:53:54.770 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:54.398+0000 7f82e8035700 1 -- 172.21.15.152:0/1361911530 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f82cc036640 msgr2=0x7f82cc038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:54.770 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:54.398+0000 7f82e8035700 1 --2- 172.21.15.152:0/1361911530 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f82cc036640 0x7f82cc038af0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f82dc009990 tx=0x7f82dc006e40 comp rx=0 tx=0).stop 2023-12-06T14:53:54.770 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:54.398+0000 7f82e8035700 1 -- 172.21.15.152:0/1361911530 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82e0070fc0 msgr2=0x7f82e01111a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:54.770 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:54.398+0000 7f82e8035700 1 --2- 172.21.15.152:0/1361911530 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82e0070fc0 0x7f82e01111a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f82d00094c0 tx=0x7f82d0009250 comp rx=0 tx=0).stop 2023-12-06T14:53:54.770 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:54.398+0000 7f82e8035700 1 -- 172.21.15.152:0/1361911530 shutdown_connections 2023-12-06T14:53:54.770 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:54.398+0000 7f82e8035700 1 --2- 172.21.15.152:0/1361911530 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f82cc036640 0x7f82cc038af0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:54.770 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:54.398+0000 7f82e8035700 1 --2- 172.21.15.152:0/1361911530 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82e0070fc0 0x7f82e01111a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:54.771 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:54.398+0000 7f82e8035700 1 -- 172.21.15.152:0/1361911530 >> 172.21.15.152:0/1361911530 conn(0x7f82e00fc970 msgr2=0x7f82e00fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:54.771 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:54.398+0000 7f82e8035700 1 -- 172.21.15.152:0/1361911530 shutdown_connections 2023-12-06T14:53:54.771 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:54.398+0000 7f82e8035700 1 -- 172.21.15.152:0/1361911530 wait complete. 2023-12-06T14:53:54.771 INFO:teuthology.orchestra.run.smithi152.stdout:Fetching dashboard port number... 2023-12-06T14:53:55.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:54 smithi152 ceph-mon[111954]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:53:55.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:54 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:53:55.709 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stdout 8443 2023-12-06T14:53:55.709 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.152+0000 7fad39dde700 1 Processor -- start 2023-12-06T14:53:55.709 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.152+0000 7fad39dde700 1 -- start start 2023-12-06T14:53:55.709 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.152+0000 7fad39dde700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad34070fc0 0x7fad34104ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:55.709 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.152+0000 7fad39dde700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad34105420 con 0x7fad34070fc0 2023-12-06T14:53:55.709 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.153+0000 7fad337fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad34070fc0 0x7fad34104ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:55.709 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.153+0000 7fad337fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad34070fc0 0x7fad34104ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:55314/0 (socket says 172.21.15.152:55314) 2023-12-06T14:53:55.709 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.153+0000 7fad337fe700 1 -- 172.21.15.152:0/417026997 learned_addr learned my addr 172.21.15.152:0/417026997 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:55.710 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.153+0000 7fad337fe700 1 -- 172.21.15.152:0/417026997 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad34105560 con 0x7fad34070fc0 2023-12-06T14:53:55.710 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.153+0000 7fad337fe700 1 --2- 172.21.15.152:0/417026997 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad34070fc0 0x7fad34104ee0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fad280098e0 tx=0x7fad28009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c0c48c6c4ccf813 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:55.710 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.153+0000 7fad327fc700 1 -- 172.21.15.152:0/417026997 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad2800b860 con 0x7fad34070fc0 2023-12-06T14:53:55.710 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.153+0000 7fad327fc700 1 -- 172.21.15.152:0/417026997 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fad2800be70 con 0x7fad34070fc0 2023-12-06T14:53:55.710 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.153+0000 7fad327fc700 1 -- 172.21.15.152:0/417026997 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad28010380 con 0x7fad34070fc0 2023-12-06T14:53:55.710 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.154+0000 7fad39dde700 1 -- 172.21.15.152:0/417026997 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad34070fc0 msgr2=0x7fad34104ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:55.710 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.154+0000 7fad39dde700 1 --2- 172.21.15.152:0/417026997 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad34070fc0 0x7fad34104ee0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fad280098e0 tx=0x7fad28009250 comp rx=0 tx=0).stop 2023-12-06T14:53:55.710 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.154+0000 7fad39dde700 1 -- 172.21.15.152:0/417026997 shutdown_connections 2023-12-06T14:53:55.710 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.154+0000 7fad39dde700 1 --2- 172.21.15.152:0/417026997 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad34070fc0 0x7fad34104ee0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:55.710 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.154+0000 7fad39dde700 1 -- 172.21.15.152:0/417026997 >> 172.21.15.152:0/417026997 conn(0x7fad340fc970 msgr2=0x7fad340fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:55.710 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.154+0000 7fad39dde700 1 -- 172.21.15.152:0/417026997 shutdown_connections 2023-12-06T14:53:55.710 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.154+0000 7fad39dde700 1 -- 172.21.15.152:0/417026997 wait complete. 2023-12-06T14:53:55.711 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.154+0000 7fad39dde700 1 Processor -- start 2023-12-06T14:53:55.711 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.154+0000 7fad39dde700 1 -- start start 2023-12-06T14:53:55.711 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.155+0000 7fad39dde700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad34070fc0 0x7fad34102960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:55.711 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.155+0000 7fad39dde700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad34100de0 con 0x7fad34070fc0 2023-12-06T14:53:55.711 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.155+0000 7fad337fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad34070fc0 0x7fad34102960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:55.711 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.155+0000 7fad337fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad34070fc0 0x7fad34102960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:55324/0 (socket says 172.21.15.152:55324) 2023-12-06T14:53:55.711 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.155+0000 7fad337fe700 1 -- 172.21.15.152:0/3552336413 learned_addr learned my addr 172.21.15.152:0/3552336413 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:55.711 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.155+0000 7fad337fe700 1 -- 172.21.15.152:0/3552336413 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad280094f0 con 0x7fad34070fc0 2023-12-06T14:53:55.711 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.155+0000 7fad337fe700 1 --2- 172.21.15.152:0/3552336413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad34070fc0 0x7fad34102960 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fad28006d40 tx=0x7fad28009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:55.711 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.155+0000 7fad1bfff700 1 -- 172.21.15.152:0/3552336413 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad28010960 con 0x7fad34070fc0 2023-12-06T14:53:55.711 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.155+0000 7fad1bfff700 1 -- 172.21.15.152:0/3552336413 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fad2801a430 con 0x7fad34070fc0 2023-12-06T14:53:55.711 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.155+0000 7fad1bfff700 1 -- 172.21.15.152:0/3552336413 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad280245b0 con 0x7fad34070fc0 2023-12-06T14:53:55.711 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.155+0000 7fad39dde700 1 -- 172.21.15.152:0/3552336413 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad34100fe0 con 0x7fad34070fc0 2023-12-06T14:53:55.711 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.155+0000 7fad39dde700 1 -- 172.21.15.152:0/3552336413 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad341013f0 con 0x7fad34070fc0 2023-12-06T14:53:55.712 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.156+0000 7fad1bfff700 1 -- 172.21.15.152:0/3552336413 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7fad2802d3f0 con 0x7fad34070fc0 2023-12-06T14:53:55.712 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.156+0000 7fad39dde700 1 -- 172.21.15.152:0/3552336413 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad3404bb80 con 0x7fad34070fc0 2023-12-06T14:53:55.712 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.156+0000 7fad1bfff700 1 --2- 172.21.15.152:0/3552336413 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fad1c036640 0x7fad1c038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:55.712 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.157+0000 7fad1bfff700 1 -- 172.21.15.152:0/3552336413 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fad2804a380 con 0x7fad34070fc0 2023-12-06T14:53:55.712 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.157+0000 7fad32ffd700 1 --2- 172.21.15.152:0/3552336413 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fad1c036640 0x7fad1c038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:55.712 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.157+0000 7fad32ffd700 1 --2- 172.21.15.152:0/3552336413 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fad1c036640 0x7fad1c038af0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fad24009990 tx=0x7fad24006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:55.712 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.161+0000 7fad1bfff700 1 -- 172.21.15.152:0/3552336413 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fad28018b00 con 0x7fad34070fc0 2023-12-06T14:53:55.712 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.344+0000 7fad39dde700 1 -- 172.21.15.152:0/3552336413 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7fad341062e0 con 0x7fad34070fc0 2023-12-06T14:53:55.712 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.344+0000 7fad1bfff700 1 -- 172.21.15.152:0/3552336413 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7fad28018b00 con 0x7fad34070fc0 2023-12-06T14:53:55.712 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.346+0000 7fad39dde700 1 -- 172.21.15.152:0/3552336413 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fad1c036640 msgr2=0x7fad1c038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:55.712 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.346+0000 7fad39dde700 1 --2- 172.21.15.152:0/3552336413 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fad1c036640 0x7fad1c038af0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fad24009990 tx=0x7fad24006e40 comp rx=0 tx=0).stop 2023-12-06T14:53:55.712 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.346+0000 7fad39dde700 1 -- 172.21.15.152:0/3552336413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad34070fc0 msgr2=0x7fad34102960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:55.712 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.346+0000 7fad39dde700 1 --2- 172.21.15.152:0/3552336413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad34070fc0 0x7fad34102960 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fad28006d40 tx=0x7fad28009250 comp rx=0 tx=0).stop 2023-12-06T14:53:55.712 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.346+0000 7fad39dde700 1 -- 172.21.15.152:0/3552336413 shutdown_connections 2023-12-06T14:53:55.712 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.346+0000 7fad39dde700 1 --2- 172.21.15.152:0/3552336413 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fad1c036640 0x7fad1c038af0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:55.712 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.346+0000 7fad39dde700 1 --2- 172.21.15.152:0/3552336413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad34070fc0 0x7fad34102960 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:55.713 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.346+0000 7fad39dde700 1 -- 172.21.15.152:0/3552336413 >> 172.21.15.152:0/3552336413 conn(0x7fad340fc970 msgr2=0x7fad340fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:55.713 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.346+0000 7fad39dde700 1 -- 172.21.15.152:0/3552336413 shutdown_connections 2023-12-06T14:53:55.713 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:55.346+0000 7fad39dde700 1 -- 172.21.15.152:0/3552336413 wait complete. 2023-12-06T14:53:55.713 INFO:teuthology.orchestra.run.smithi152.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-06T14:53:55.713 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stdout disabled 2023-12-06T14:53:55.721 INFO:teuthology.orchestra.run.smithi152.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-06T14:53:55.721 INFO:teuthology.orchestra.run.smithi152.stdout:systemctl: stdout inactive 2023-12-06T14:53:55.721 INFO:teuthology.orchestra.run.smithi152.stdout:firewalld.service is not enabled 2023-12-06T14:53:55.721 INFO:teuthology.orchestra.run.smithi152.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-12-06T14:53:55.723 INFO:teuthology.orchestra.run.smithi152.stdout:Ceph Dashboard is now available at: 2023-12-06T14:53:55.723 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:53:55.723 INFO:teuthology.orchestra.run.smithi152.stdout: URL: https://smithi152.front.sepia.ceph.com:8443/ 2023-12-06T14:53:55.723 INFO:teuthology.orchestra.run.smithi152.stdout: User: admin 2023-12-06T14:53:55.724 INFO:teuthology.orchestra.run.smithi152.stdout: Password: zqdi1b4gkx 2023-12-06T14:53:55.724 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:53:55.725 INFO:teuthology.orchestra.run.smithi152.stdout:Saving cluster configuration to /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config directory 2023-12-06T14:53:55.725 INFO:teuthology.orchestra.run.smithi152.stdout:Enabling autotune for osd_memory_target 2023-12-06T14:53:56.127 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:55 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/3552336413' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-12-06T14:53:56.673 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.110+0000 7fc204dce700 1 Processor -- start 2023-12-06T14:53:56.673 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.110+0000 7fc204dce700 1 -- start start 2023-12-06T14:53:56.674 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.111+0000 7fc204dce700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc200070fc0 0x7fc200104ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:56.674 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.111+0000 7fc204dce700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc200105420 con 0x7fc200070fc0 2023-12-06T14:53:56.674 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.111+0000 7fc1fe59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc200070fc0 0x7fc200104ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:56.674 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.111+0000 7fc1fe59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc200070fc0 0x7fc200104ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:55340/0 (socket says 172.21.15.152:55340) 2023-12-06T14:53:56.674 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.111+0000 7fc1fe59c700 1 -- 172.21.15.152:0/3843403145 learned_addr learned my addr 172.21.15.152:0/3843403145 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:56.674 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.111+0000 7fc1fe59c700 1 -- 172.21.15.152:0/3843403145 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc200105560 con 0x7fc200070fc0 2023-12-06T14:53:56.674 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.111+0000 7fc1fe59c700 1 --2- 172.21.15.152:0/3843403145 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc200070fc0 0x7fc200104ee0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc1f40098e0 tx=0x7fc1f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ba4f2a2060b85f server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:56.674 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.112+0000 7fc1fd59a700 1 -- 172.21.15.152:0/3843403145 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1f400b860 con 0x7fc200070fc0 2023-12-06T14:53:56.674 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.112+0000 7fc1fd59a700 1 -- 172.21.15.152:0/3843403145 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc1f400be70 con 0x7fc200070fc0 2023-12-06T14:53:56.674 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.112+0000 7fc1fd59a700 1 -- 172.21.15.152:0/3843403145 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1f4010380 con 0x7fc200070fc0 2023-12-06T14:53:56.674 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.112+0000 7fc204dce700 1 -- 172.21.15.152:0/3843403145 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc200070fc0 msgr2=0x7fc200104ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:56.674 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.112+0000 7fc204dce700 1 --2- 172.21.15.152:0/3843403145 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc200070fc0 0x7fc200104ee0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc1f40098e0 tx=0x7fc1f4009250 comp rx=0 tx=0).stop 2023-12-06T14:53:56.674 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.112+0000 7fc204dce700 1 -- 172.21.15.152:0/3843403145 shutdown_connections 2023-12-06T14:53:56.674 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.112+0000 7fc204dce700 1 --2- 172.21.15.152:0/3843403145 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc200070fc0 0x7fc200104ee0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:56.675 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.112+0000 7fc204dce700 1 -- 172.21.15.152:0/3843403145 >> 172.21.15.152:0/3843403145 conn(0x7fc2000fc970 msgr2=0x7fc2000fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:56.675 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.112+0000 7fc204dce700 1 -- 172.21.15.152:0/3843403145 shutdown_connections 2023-12-06T14:53:56.675 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.112+0000 7fc204dce700 1 -- 172.21.15.152:0/3843403145 wait complete. 2023-12-06T14:53:56.675 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.113+0000 7fc204dce700 1 Processor -- start 2023-12-06T14:53:56.675 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.113+0000 7fc204dce700 1 -- start start 2023-12-06T14:53:56.675 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.113+0000 7fc204dce700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc200070fc0 0x7fc2001111c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:56.675 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.113+0000 7fc204dce700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc200111700 con 0x7fc200070fc0 2023-12-06T14:53:56.675 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.113+0000 7fc1fe59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc200070fc0 0x7fc2001111c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:56.675 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.113+0000 7fc1fe59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc200070fc0 0x7fc2001111c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:55348/0 (socket says 172.21.15.152:55348) 2023-12-06T14:53:56.675 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.113+0000 7fc1fe59c700 1 -- 172.21.15.152:0/1413659357 learned_addr learned my addr 172.21.15.152:0/1413659357 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:56.675 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.113+0000 7fc1fe59c700 1 -- 172.21.15.152:0/1413659357 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f40094f0 con 0x7fc200070fc0 2023-12-06T14:53:56.675 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.113+0000 7fc1fe59c700 1 --2- 172.21.15.152:0/1413659357 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc200070fc0 0x7fc2001111c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc1f40094c0 tx=0x7fc1f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:56.675 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.114+0000 7fc1eeffd700 1 -- 172.21.15.152:0/1413659357 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1f4010850 con 0x7fc200070fc0 2023-12-06T14:53:56.675 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.114+0000 7fc204dce700 1 -- 172.21.15.152:0/1413659357 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc200111900 con 0x7fc200070fc0 2023-12-06T14:53:56.675 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.114+0000 7fc1eeffd700 1 -- 172.21.15.152:0/1413659357 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc1f4010e60 con 0x7fc200070fc0 2023-12-06T14:53:56.675 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.114+0000 7fc1eeffd700 1 -- 172.21.15.152:0/1413659357 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1f401a430 con 0x7fc200070fc0 2023-12-06T14:53:56.676 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.114+0000 7fc204dce700 1 -- 172.21.15.152:0/1413659357 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc200111d10 con 0x7fc200070fc0 2023-12-06T14:53:56.676 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.114+0000 7fc1eeffd700 1 -- 172.21.15.152:0/1413659357 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 12) v1 ==== 43294+0+0 (secure 0 0 0) 0x7fc1f401a6b0 con 0x7fc200070fc0 2023-12-06T14:53:56.676 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.115+0000 7fc1eeffd700 1 --2- 172.21.15.152:0/1413659357 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fc1e8036640 0x7fc1e8038af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:56.676 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.115+0000 7fc1eeffd700 1 -- 172.21.15.152:0/1413659357 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fc1f404a500 con 0x7fc200070fc0 2023-12-06T14:53:56.676 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.115+0000 7fc1fdd9b700 1 --2- 172.21.15.152:0/1413659357 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fc1e8036640 0x7fc1e8038af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:56.676 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.115+0000 7fc204dce700 1 -- 172.21.15.152:0/1413659357 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc20004bb80 con 0x7fc200070fc0 2023-12-06T14:53:56.676 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.115+0000 7fc1fdd9b700 1 --2- 172.21.15.152:0/1413659357 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fc1e8036640 0x7fc1e8038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0009990 tx=0x7fc1f0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:56.676 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.119+0000 7fc1eeffd700 1 -- 172.21.15.152:0/1413659357 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc1f40189a0 con 0x7fc200070fc0 2023-12-06T14:53:56.676 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.299+0000 7fc204dce700 1 -- 172.21.15.152:0/1413659357 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7fc2001062e0 con 0x7fc200070fc0 2023-12-06T14:53:56.676 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.299+0000 7fc1eeffd700 1 -- 172.21.15.152:0/1413659357 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7fc1f4048030 con 0x7fc200070fc0 2023-12-06T14:53:56.676 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.301+0000 7fc204dce700 1 -- 172.21.15.152:0/1413659357 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fc1e8036640 msgr2=0x7fc1e8038af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:56.676 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.301+0000 7fc204dce700 1 --2- 172.21.15.152:0/1413659357 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fc1e8036640 0x7fc1e8038af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0009990 tx=0x7fc1f0006e40 comp rx=0 tx=0).stop 2023-12-06T14:53:56.676 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.301+0000 7fc204dce700 1 -- 172.21.15.152:0/1413659357 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc200070fc0 msgr2=0x7fc2001111c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:56.676 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.301+0000 7fc204dce700 1 --2- 172.21.15.152:0/1413659357 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc200070fc0 0x7fc2001111c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc1f40094c0 tx=0x7fc1f4009250 comp rx=0 tx=0).stop 2023-12-06T14:53:56.677 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.301+0000 7fc204dce700 1 -- 172.21.15.152:0/1413659357 shutdown_connections 2023-12-06T14:53:56.677 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.301+0000 7fc204dce700 1 --2- 172.21.15.152:0/1413659357 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fc1e8036640 0x7fc1e8038af0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:56.677 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.301+0000 7fc204dce700 1 --2- 172.21.15.152:0/1413659357 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc200070fc0 0x7fc2001111c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:56.677 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.301+0000 7fc204dce700 1 -- 172.21.15.152:0/1413659357 >> 172.21.15.152:0/1413659357 conn(0x7fc2000fc970 msgr2=0x7fc2000fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:56.677 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.301+0000 7fc204dce700 1 -- 172.21.15.152:0/1413659357 shutdown_connections 2023-12-06T14:53:56.677 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:56.302+0000 7fc204dce700 1 -- 172.21.15.152:0/1413659357 wait complete. 2023-12-06T14:53:57.726 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.068+0000 7f1ce3de7700 1 Processor -- start 2023-12-06T14:53:57.727 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.068+0000 7f1ce3de7700 1 -- start start 2023-12-06T14:53:57.727 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.068+0000 7f1ce3de7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cdc070f20 0x7f1cdc104f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:57.727 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.068+0000 7f1ce3de7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cdc1054c0 con 0x7f1cdc070f20 2023-12-06T14:53:57.727 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.068+0000 7f1ce1b83700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cdc070f20 0x7f1cdc104f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:57.727 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.069+0000 7f1ce1b83700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cdc070f20 0x7f1cdc104f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:55360/0 (socket says 172.21.15.152:55360) 2023-12-06T14:53:57.727 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.069+0000 7f1ce1b83700 1 -- 172.21.15.152:0/2665775923 learned_addr learned my addr 172.21.15.152:0/2665775923 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:57.727 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.069+0000 7f1ce1b83700 1 -- 172.21.15.152:0/2665775923 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cdc105600 con 0x7f1cdc070f20 2023-12-06T14:53:57.727 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.069+0000 7f1ce1b83700 1 --2- 172.21.15.152:0/2665775923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cdc070f20 0x7f1cdc104f80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc0098e0 tx=0x7f1ccc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=845400fcbccbd1c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:57.727 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.069+0000 7f1ce0b81700 1 -- 172.21.15.152:0/2665775923 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ccc00b860 con 0x7f1cdc070f20 2023-12-06T14:53:57.727 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.069+0000 7f1ce0b81700 1 -- 172.21.15.152:0/2665775923 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1ccc00be70 con 0x7f1cdc070f20 2023-12-06T14:53:57.727 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.069+0000 7f1ce0b81700 1 -- 172.21.15.152:0/2665775923 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ccc010380 con 0x7f1cdc070f20 2023-12-06T14:53:57.727 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.070+0000 7f1ce3de7700 1 -- 172.21.15.152:0/2665775923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cdc070f20 msgr2=0x7f1cdc104f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:57.728 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.070+0000 7f1ce3de7700 1 --2- 172.21.15.152:0/2665775923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cdc070f20 0x7f1cdc104f80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc0098e0 tx=0x7f1ccc009250 comp rx=0 tx=0).stop 2023-12-06T14:53:57.728 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.070+0000 7f1ce3de7700 1 -- 172.21.15.152:0/2665775923 shutdown_connections 2023-12-06T14:53:57.728 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.070+0000 7f1ce3de7700 1 --2- 172.21.15.152:0/2665775923 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cdc070f20 0x7f1cdc104f80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:57.728 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.070+0000 7f1ce3de7700 1 -- 172.21.15.152:0/2665775923 >> 172.21.15.152:0/2665775923 conn(0x7f1cdc0fc970 msgr2=0x7f1cdc0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:57.728 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.070+0000 7f1ce3de7700 1 -- 172.21.15.152:0/2665775923 shutdown_connections 2023-12-06T14:53:57.729 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.070+0000 7f1ce3de7700 1 -- 172.21.15.152:0/2665775923 wait complete. 2023-12-06T14:53:57.729 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.070+0000 7f1ce3de7700 1 Processor -- start 2023-12-06T14:53:57.729 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.070+0000 7f1ce3de7700 1 -- start start 2023-12-06T14:53:57.729 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.070+0000 7f1ce3de7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cdc070f20 0x7f1cdc1111d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:57.729 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.070+0000 7f1ce3de7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cdc111710 con 0x7f1cdc070f20 2023-12-06T14:53:57.729 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.070+0000 7f1ce1b83700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cdc070f20 0x7f1cdc1111d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:57.729 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.071+0000 7f1ce1b83700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cdc070f20 0x7f1cdc1111d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:55374/0 (socket says 172.21.15.152:55374) 2023-12-06T14:53:57.729 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.071+0000 7f1ce1b83700 1 -- 172.21.15.152:0/1427099852 learned_addr learned my addr 172.21.15.152:0/1427099852 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:57.729 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.071+0000 7f1ce1b83700 1 -- 172.21.15.152:0/1427099852 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ccc0094f0 con 0x7f1cdc070f20 2023-12-06T14:53:57.729 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.071+0000 7f1ce1b83700 1 --2- 172.21.15.152:0/1427099852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cdc070f20 0x7f1cdc1111d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc011b60 tx=0x7f1ccc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:57.729 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.071+0000 7f1cd27fc700 1 -- 172.21.15.152:0/1427099852 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ccc010800 con 0x7f1cdc070f20 2023-12-06T14:53:57.729 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.071+0000 7f1cd27fc700 1 -- 172.21.15.152:0/1427099852 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1ccc010e10 con 0x7f1cdc070f20 2023-12-06T14:53:57.729 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.071+0000 7f1ce3de7700 1 -- 172.21.15.152:0/1427099852 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cdc111910 con 0x7f1cdc070f20 2023-12-06T14:53:57.730 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.071+0000 7f1cd27fc700 1 -- 172.21.15.152:0/1427099852 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ccc01aea0 con 0x7f1cdc070f20 2023-12-06T14:53:57.730 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.071+0000 7f1ce3de7700 1 -- 172.21.15.152:0/1427099852 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cdc111d20 con 0x7f1cdc070f20 2023-12-06T14:53:57.730 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.072+0000 7f1cd27fc700 1 -- 172.21.15.152:0/1427099852 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7f1ccc010960 con 0x7f1cdc070f20 2023-12-06T14:53:57.730 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.072+0000 7f1cd27fc700 1 --2- 172.21.15.152:0/1427099852 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f1cc8036730 0x7f1cc8038be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:57.730 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.072+0000 7f1ce3de7700 1 -- 172.21.15.152:0/1427099852 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cdc04bb80 con 0x7f1cdc070f20 2023-12-06T14:53:57.730 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.072+0000 7f1cd27fc700 1 -- 172.21.15.152:0/1427099852 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f1ccc04a610 con 0x7f1cdc070f20 2023-12-06T14:53:57.730 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.072+0000 7f1ce1382700 1 --2- 172.21.15.152:0/1427099852 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f1cc8036730 0x7f1cc8038be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:57.730 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.072+0000 7f1ce1382700 1 --2- 172.21.15.152:0/1427099852 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f1cc8036730 0x7f1cc8038be0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8009990 tx=0x7f1cd8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:57.730 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.077+0000 7f1cd27fc700 1 -- 172.21.15.152:0/1427099852 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1ccc01a430 con 0x7f1cdc070f20 2023-12-06T14:53:57.730 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.363+0000 7f1ce3de7700 1 -- 172.21.15.152:0/1427099852 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f1cdc106320 con 0x7f1cdc070f20 2023-12-06T14:53:57.730 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.366+0000 7f1cd27fc700 1 -- 172.21.15.152:0/1427099852 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7f1ccc031030 con 0x7f1cdc070f20 2023-12-06T14:53:57.730 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.368+0000 7f1ce3de7700 1 -- 172.21.15.152:0/1427099852 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f1cc8036730 msgr2=0x7f1cc8038be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:57.730 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.368+0000 7f1ce3de7700 1 --2- 172.21.15.152:0/1427099852 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f1cc8036730 0x7f1cc8038be0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8009990 tx=0x7f1cd8006e40 comp rx=0 tx=0).stop 2023-12-06T14:53:57.730 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.368+0000 7f1ce3de7700 1 -- 172.21.15.152:0/1427099852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cdc070f20 msgr2=0x7f1cdc1111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:57.731 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.368+0000 7f1ce3de7700 1 --2- 172.21.15.152:0/1427099852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cdc070f20 0x7f1cdc1111d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc011b60 tx=0x7f1ccc009250 comp rx=0 tx=0).stop 2023-12-06T14:53:57.731 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.368+0000 7f1ce3de7700 1 -- 172.21.15.152:0/1427099852 shutdown_connections 2023-12-06T14:53:57.731 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.368+0000 7f1ce3de7700 1 --2- 172.21.15.152:0/1427099852 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f1cc8036730 0x7f1cc8038be0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:57.731 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.368+0000 7f1ce3de7700 1 --2- 172.21.15.152:0/1427099852 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cdc070f20 0x7f1cdc1111d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:57.731 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.368+0000 7f1ce3de7700 1 -- 172.21.15.152:0/1427099852 >> 172.21.15.152:0/1427099852 conn(0x7f1cdc0fc970 msgr2=0x7f1cdc0fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:57.731 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.368+0000 7f1ce3de7700 1 -- 172.21.15.152:0/1427099852 shutdown_connections 2023-12-06T14:53:57.731 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr 2023-12-06T14:53:57.368+0000 7f1ce3de7700 1 -- 172.21.15.152:0/1427099852 wait complete. 2023-12-06T14:53:57.731 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-12-06T14:53:57.731 INFO:teuthology.orchestra.run.smithi152.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-12-06T14:53:57.731 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:53:57.731 INFO:teuthology.orchestra.run.smithi152.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-12-06T14:53:57.732 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:53:57.732 INFO:teuthology.orchestra.run.smithi152.stdout:Or, if you are only running a single cluster on this host: 2023-12-06T14:53:57.732 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:53:57.732 INFO:teuthology.orchestra.run.smithi152.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-12-06T14:53:57.732 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:53:57.732 INFO:teuthology.orchestra.run.smithi152.stdout:Please consider enabling telemetry to help improve Ceph: 2023-12-06T14:53:57.732 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:53:57.732 INFO:teuthology.orchestra.run.smithi152.stdout: ceph telemetry on 2023-12-06T14:53:57.732 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:53:57.732 INFO:teuthology.orchestra.run.smithi152.stdout:For more information see: 2023-12-06T14:53:57.732 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:53:57.732 INFO:teuthology.orchestra.run.smithi152.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2023-12-06T14:53:57.732 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:53:57.732 INFO:teuthology.orchestra.run.smithi152.stdout:Bootstrap complete. 2023-12-06T14:53:57.755 INFO:tasks.cephadm:Fetching config... 2023-12-06T14:53:57.756 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-06T14:53:57.756 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-12-06T14:53:57.816 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-12-06T14:53:57.816 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-06T14:53:57.816 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-12-06T14:53:57.874 INFO:tasks.cephadm:Fetching mon keyring... 2023-12-06T14:53:57.874 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-06T14:53:57.874 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/keyring of=/dev/stdout 2023-12-06T14:53:57.943 INFO:tasks.cephadm:Fetching pub ssh key... 2023-12-06T14:53:57.943 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-06T14:53:57.943 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-12-06T14:53:58.002 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-12-06T14:53:58.003 DEBUG:teuthology.orchestra.run.smithi152:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGyyG9PvXCCnTrFbdGkzdwKQmJpSu50ql4YSNPuBVqNzXAgwI83oy/8zEtANPL3z0iHPho1DhhBpxVohaDTXy42BS6j6tloHxWGUmJESFTwvRZR8beW3kRI3Q0ViDQftcMjRIJG5mCQ4cjhXdlIZ2j+pywOw3GfqWyo7VCvwoovHDkXC8BwHX9Byajs1j84rXU6k3cjNkp+5nj8BNFFmHZSHXZV8oAgJjbUlaNpzpNPpk/rlOUeBQu4OnDM5hl/B5mNP7Ea7JO4wTVGq/BqXtcB8cWKcLMvfdKRgUPSUE1EL1xCRfwr1UvJDNx3bzdA0ohir+HCU5gxRL3MABIYxUno67o4Sny8IxwHlNF+a7/ywkxZE/sHm4nLezF5D9pSa4LaRRpECzhHpTVOjD5pBAIJbADHOzR8OFEpm62xhsP+kQ1oBRyW6J6NWSppHOAjRE1flt5D3lLz9pYzvgwtna4kzqAO2os2eoCODMnwmqayxMSL0oOUC2iywFrxNclD+M= ceph-062f0e3c-9447-11ee-95a2-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-06T14:53:58.067 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:57 smithi152 ceph-mon[111954]: mgrmap e13: smithi152.meodco(active, since 6s) 2023-12-06T14:53:58.067 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:53:57 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/1427099852' entity='client.admin' 2023-12-06T14:53:58.079 INFO:teuthology.orchestra.run.smithi152.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGyyG9PvXCCnTrFbdGkzdwKQmJpSu50ql4YSNPuBVqNzXAgwI83oy/8zEtANPL3z0iHPho1DhhBpxVohaDTXy42BS6j6tloHxWGUmJESFTwvRZR8beW3kRI3Q0ViDQftcMjRIJG5mCQ4cjhXdlIZ2j+pywOw3GfqWyo7VCvwoovHDkXC8BwHX9Byajs1j84rXU6k3cjNkp+5nj8BNFFmHZSHXZV8oAgJjbUlaNpzpNPpk/rlOUeBQu4OnDM5hl/B5mNP7Ea7JO4wTVGq/BqXtcB8cWKcLMvfdKRgUPSUE1EL1xCRfwr1UvJDNx3bzdA0ohir+HCU5gxRL3MABIYxUno67o4Sny8IxwHlNF+a7/ywkxZE/sHm4nLezF5D9pSa4LaRRpECzhHpTVOjD5pBAIJbADHOzR8OFEpm62xhsP+kQ1oBRyW6J6NWSppHOAjRE1flt5D3lLz9pYzvgwtna4kzqAO2os2eoCODMnwmqayxMSL0oOUC2iywFrxNclD+M= ceph-062f0e3c-9447-11ee-95a2-87774f69a715 2023-12-06T14:53:58.090 DEBUG:teuthology.orchestra.run.smithi190:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGyyG9PvXCCnTrFbdGkzdwKQmJpSu50ql4YSNPuBVqNzXAgwI83oy/8zEtANPL3z0iHPho1DhhBpxVohaDTXy42BS6j6tloHxWGUmJESFTwvRZR8beW3kRI3Q0ViDQftcMjRIJG5mCQ4cjhXdlIZ2j+pywOw3GfqWyo7VCvwoovHDkXC8BwHX9Byajs1j84rXU6k3cjNkp+5nj8BNFFmHZSHXZV8oAgJjbUlaNpzpNPpk/rlOUeBQu4OnDM5hl/B5mNP7Ea7JO4wTVGq/BqXtcB8cWKcLMvfdKRgUPSUE1EL1xCRfwr1UvJDNx3bzdA0ohir+HCU5gxRL3MABIYxUno67o4Sny8IxwHlNF+a7/ywkxZE/sHm4nLezF5D9pSa4LaRRpECzhHpTVOjD5pBAIJbADHOzR8OFEpm62xhsP+kQ1oBRyW6J6NWSppHOAjRE1flt5D3lLz9pYzvgwtna4kzqAO2os2eoCODMnwmqayxMSL0oOUC2iywFrxNclD+M= ceph-062f0e3c-9447-11ee-95a2-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-06T14:53:58.134 INFO:teuthology.orchestra.run.smithi190.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGyyG9PvXCCnTrFbdGkzdwKQmJpSu50ql4YSNPuBVqNzXAgwI83oy/8zEtANPL3z0iHPho1DhhBpxVohaDTXy42BS6j6tloHxWGUmJESFTwvRZR8beW3kRI3Q0ViDQftcMjRIJG5mCQ4cjhXdlIZ2j+pywOw3GfqWyo7VCvwoovHDkXC8BwHX9Byajs1j84rXU6k3cjNkp+5nj8BNFFmHZSHXZV8oAgJjbUlaNpzpNPpk/rlOUeBQu4OnDM5hl/B5mNP7Ea7JO4wTVGq/BqXtcB8cWKcLMvfdKRgUPSUE1EL1xCRfwr1UvJDNx3bzdA0ohir+HCU5gxRL3MABIYxUno67o4Sny8IxwHlNF+a7/ywkxZE/sHm4nLezF5D9pSa4LaRRpECzhHpTVOjD5pBAIJbADHOzR8OFEpm62xhsP+kQ1oBRyW6J6NWSppHOAjRE1flt5D3lLz9pYzvgwtna4kzqAO2os2eoCODMnwmqayxMSL0oOUC2iywFrxNclD+M= ceph-062f0e3c-9447-11ee-95a2-87774f69a715 2023-12-06T14:53:58.146 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-12-06T14:53:58.408 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:53:59.534 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.534+0000 7f8f6f882700 1 -- 172.21.15.152:0/2848751031 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f680fb770 msgr2=0x7f8f680fbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:59.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.534+0000 7f8f6f882700 1 --2- 172.21.15.152:0/2848751031 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f680fb770 0x7f8f680fbb80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8f640048c0 tx=0x7f8f64009e30 comp rx=0 tx=0).stop 2023-12-06T14:53:59.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.534+0000 7f8f6f882700 1 -- 172.21.15.152:0/2848751031 shutdown_connections 2023-12-06T14:53:59.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.534+0000 7f8f6f882700 1 --2- 172.21.15.152:0/2848751031 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f680fb770 0x7f8f680fbb80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:59.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.534+0000 7f8f6f882700 1 -- 172.21.15.152:0/2848751031 >> 172.21.15.152:0/2848751031 conn(0x7f8f680f6e50 msgr2=0x7f8f680f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:59.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.534+0000 7f8f6f882700 1 -- 172.21.15.152:0/2848751031 shutdown_connections 2023-12-06T14:53:59.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.534+0000 7f8f6f882700 1 -- 172.21.15.152:0/2848751031 wait complete. 2023-12-06T14:53:59.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.534+0000 7f8f6f882700 1 Processor -- start 2023-12-06T14:53:59.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.535+0000 7f8f6f882700 1 -- start start 2023-12-06T14:53:59.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.535+0000 7f8f6f882700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f680fb770 0x7f8f6810b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:59.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.535+0000 7f8f6f882700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6810bec0 con 0x7f8f680fb770 2023-12-06T14:53:59.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.535+0000 7f8f6d61e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f680fb770 0x7f8f6810b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:59.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.535+0000 7f8f6d61e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f680fb770 0x7f8f6810b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47012/0 (socket says 172.21.15.152:47012) 2023-12-06T14:53:59.535 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.535+0000 7f8f6d61e700 1 -- 172.21.15.152:0/2870462032 learned_addr learned my addr 172.21.15.152:0/2870462032 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:53:59.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.535+0000 7f8f6d61e700 1 -- 172.21.15.152:0/2870462032 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f64005040 con 0x7f8f680fb770 2023-12-06T14:53:59.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.535+0000 7f8f6d61e700 1 --2- 172.21.15.152:0/2870462032 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f680fb770 0x7f8f6810b980 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8f64009680 tx=0x7f8f64009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:59.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.535+0000 7f8f5dffb700 1 -- 172.21.15.152:0/2870462032 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8f64004e60 con 0x7f8f680fb770 2023-12-06T14:53:59.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.535+0000 7f8f5dffb700 1 -- 172.21.15.152:0/2870462032 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8f6400be50 con 0x7f8f680fb770 2023-12-06T14:53:59.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.535+0000 7f8f5dffb700 1 -- 172.21.15.152:0/2870462032 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8f6401e6b0 con 0x7f8f680fb770 2023-12-06T14:53:59.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.535+0000 7f8f6f882700 1 -- 172.21.15.152:0/2870462032 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f6810c0c0 con 0x7f8f680fb770 2023-12-06T14:53:59.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.536+0000 7f8f6f882700 1 -- 172.21.15.152:0/2870462032 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f6810cd60 con 0x7f8f680fb770 2023-12-06T14:53:59.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.537+0000 7f8f5dffb700 1 -- 172.21.15.152:0/2870462032 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7f8f64013630 con 0x7f8f680fb770 2023-12-06T14:53:59.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.537+0000 7f8f5dffb700 1 --2- 172.21.15.152:0/2870462032 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f8f54036720 0x7f8f54038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:53:59.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.537+0000 7f8f5dffb700 1 -- 172.21.15.152:0/2870462032 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8f6404c490 con 0x7f8f680fb770 2023-12-06T14:53:59.538 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.537+0000 7f8f6ce1d700 1 --2- 172.21.15.152:0/2870462032 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f8f54036720 0x7f8f54038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:53:59.538 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.537+0000 7f8f6f882700 1 -- 172.21.15.152:0/2870462032 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f6810c550 con 0x7f8f680fb770 2023-12-06T14:53:59.538 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.537+0000 7f8f6ce1d700 1 --2- 172.21.15.152:0/2870462032 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f8f54036720 0x7f8f54038bd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8f58009990 tx=0x7f8f58006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:53:59.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.542+0000 7f8f5dffb700 1 -- 172.21.15.152:0/2870462032 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8f640119c0 con 0x7f8f680fb770 2023-12-06T14:53:59.737 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.737+0000 7f8f6f882700 1 -- 172.21.15.152:0/2870462032 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f8f6805f270 con 0x7f8f680fb770 2023-12-06T14:53:59.743 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.744+0000 7f8f5dffb700 1 -- 172.21.15.152:0/2870462032 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f8f64011370 con 0x7f8f680fb770 2023-12-06T14:53:59.746 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.746+0000 7f8f6f882700 1 -- 172.21.15.152:0/2870462032 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f8f54036720 msgr2=0x7f8f54038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:59.746 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.746+0000 7f8f6f882700 1 --2- 172.21.15.152:0/2870462032 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f8f54036720 0x7f8f54038bd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8f58009990 tx=0x7f8f58006e40 comp rx=0 tx=0).stop 2023-12-06T14:53:59.746 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.746+0000 7f8f6f882700 1 -- 172.21.15.152:0/2870462032 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f680fb770 msgr2=0x7f8f6810b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:53:59.746 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.746+0000 7f8f6f882700 1 --2- 172.21.15.152:0/2870462032 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f680fb770 0x7f8f6810b980 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8f64009680 tx=0x7f8f64009e30 comp rx=0 tx=0).stop 2023-12-06T14:53:59.746 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.746+0000 7f8f6f882700 1 -- 172.21.15.152:0/2870462032 shutdown_connections 2023-12-06T14:53:59.746 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.746+0000 7f8f6f882700 1 --2- 172.21.15.152:0/2870462032 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f8f54036720 0x7f8f54038bd0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:59.747 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.746+0000 7f8f6f882700 1 --2- 172.21.15.152:0/2870462032 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f680fb770 0x7f8f6810b980 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:53:59.747 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.746+0000 7f8f6f882700 1 -- 172.21.15.152:0/2870462032 >> 172.21.15.152:0/2870462032 conn(0x7f8f680f6e50 msgr2=0x7f8f680f7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:53:59.747 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.746+0000 7f8f6f882700 1 -- 172.21.15.152:0/2870462032 shutdown_connections 2023-12-06T14:53:59.747 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:53:59.746+0000 7f8f6f882700 1 -- 172.21.15.152:0/2870462032 wait complete. 2023-12-06T14:54:00.141 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-12-06T14:54:00.141 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-12-06T14:54:00.438 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:54:00.812 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:00 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:00.813 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:00 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:00.813 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:00 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "who": "osd/host:smithi152", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:54:00.813 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:00 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:00.813 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:00 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-06T14:54:00.813 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:00 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-06T14:54:00.813 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:00 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:54:00.813 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:00 smithi152 ceph-mon[111954]: Deploying daemon crash.smithi152 on smithi152 2023-12-06T14:54:00.813 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:00 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/2870462032' entity='client.admin' 2023-12-06T14:54:01.672 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.672+0000 7f6c114e9700 1 -- 172.21.15.152:0/250761023 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c0c0fb770 msgr2=0x7f6c0c0fbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:01.672 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.672+0000 7f6c114e9700 1 --2- 172.21.15.152:0/250761023 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c0c0fb770 0x7f6c0c0fbb80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6c040048c0 tx=0x7f6c04009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:01.672 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.672+0000 7f6c114e9700 1 -- 172.21.15.152:0/250761023 shutdown_connections 2023-12-06T14:54:01.672 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.672+0000 7f6c114e9700 1 --2- 172.21.15.152:0/250761023 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c0c0fb770 0x7f6c0c0fbb80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:01.672 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.672+0000 7f6c114e9700 1 -- 172.21.15.152:0/250761023 >> 172.21.15.152:0/250761023 conn(0x7f6c0c0f6e50 msgr2=0x7f6c0c0f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:01.673 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.672+0000 7f6c114e9700 1 -- 172.21.15.152:0/250761023 shutdown_connections 2023-12-06T14:54:01.673 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.672+0000 7f6c114e9700 1 -- 172.21.15.152:0/250761023 wait complete. 2023-12-06T14:54:01.674 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.673+0000 7f6c114e9700 1 Processor -- start 2023-12-06T14:54:01.674 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.673+0000 7f6c114e9700 1 -- start start 2023-12-06T14:54:01.674 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.673+0000 7f6c114e9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c0c0fb770 0x7f6c0c10cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:01.674 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.673+0000 7f6c114e9700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c10d010 con 0x7f6c0c0fb770 2023-12-06T14:54:01.674 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.673+0000 7f6c0affd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c0c0fb770 0x7f6c0c10cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:54:01.674 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.673+0000 7f6c0affd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c0c0fb770 0x7f6c0c10cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47018/0 (socket says 172.21.15.152:47018) 2023-12-06T14:54:01.674 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.673+0000 7f6c0affd700 1 -- 172.21.15.152:0/95002970 learned_addr learned my addr 172.21.15.152:0/95002970 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:54:01.674 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.673+0000 7f6c0affd700 1 -- 172.21.15.152:0/95002970 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c04005040 con 0x7f6c0c0fb770 2023-12-06T14:54:01.675 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.674+0000 7f6c0affd700 1 --2- 172.21.15.152:0/95002970 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c0c0fb770 0x7f6c0c10cad0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6c04009330 tx=0x7f6c04009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:54:01.675 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.674+0000 7f6bf37fe700 1 -- 172.21.15.152:0/95002970 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c040096b0 con 0x7f6c0c0fb770 2023-12-06T14:54:01.675 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.674+0000 7f6bf37fe700 1 -- 172.21.15.152:0/95002970 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6c04009810 con 0x7f6c0c0fb770 2023-12-06T14:54:01.675 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.674+0000 7f6c114e9700 1 -- 172.21.15.152:0/95002970 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c0c10d210 con 0x7f6c0c0fb770 2023-12-06T14:54:01.675 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.674+0000 7f6bf37fe700 1 -- 172.21.15.152:0/95002970 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c0401c5b0 con 0x7f6c0c0fb770 2023-12-06T14:54:01.675 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.674+0000 7f6c114e9700 1 -- 172.21.15.152:0/95002970 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c0c10deb0 con 0x7f6c0c0fb770 2023-12-06T14:54:01.676 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.675+0000 7f6bf37fe700 1 -- 172.21.15.152:0/95002970 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7f6c0401c820 con 0x7f6c0c0fb770 2023-12-06T14:54:01.676 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.675+0000 7f6c114e9700 1 -- 172.21.15.152:0/95002970 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c0c05f270 con 0x7f6c0c0fb770 2023-12-06T14:54:01.676 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.675+0000 7f6bf37fe700 1 --2- 172.21.15.152:0/95002970 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f6bf4036720 0x7f6bf4038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:01.676 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.675+0000 7f6bf37fe700 1 -- 172.21.15.152:0/95002970 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f6c04049b00 con 0x7f6c0c0fb770 2023-12-06T14:54:01.676 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.675+0000 7f6c0a7fc700 1 --2- 172.21.15.152:0/95002970 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f6bf4036720 0x7f6bf4038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:54:01.676 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.675+0000 7f6c0a7fc700 1 --2- 172.21.15.152:0/95002970 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f6bf4036720 0x7f6bf4038bd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6c00009990 tx=0x7f6c00006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:54:01.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.679+0000 7f6bf37fe700 1 -- 172.21.15.152:0/95002970 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6c04023300 con 0x7f6c0c0fb770 2023-12-06T14:54:01.874 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.874+0000 7f6c114e9700 1 -- 172.21.15.152:0/95002970 --> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c0c10ea70 con 0x7f6bf4036720 2023-12-06T14:54:01.877 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.878+0000 7f6bf37fe700 1 -- 172.21.15.152:0/95002970 <== mgr.14162 v2:172.21.15.152:6800/3517650686 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f6c0c10ea70 con 0x7f6bf4036720 2023-12-06T14:54:01.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.880+0000 7f6c114e9700 1 -- 172.21.15.152:0/95002970 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f6bf4036720 msgr2=0x7f6bf4038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:01.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.880+0000 7f6c114e9700 1 --2- 172.21.15.152:0/95002970 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f6bf4036720 0x7f6bf4038bd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6c00009990 tx=0x7f6c00006e40 comp rx=0 tx=0).stop 2023-12-06T14:54:01.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.880+0000 7f6c114e9700 1 -- 172.21.15.152:0/95002970 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c0c0fb770 msgr2=0x7f6c0c10cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:01.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.880+0000 7f6c114e9700 1 --2- 172.21.15.152:0/95002970 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c0c0fb770 0x7f6c0c10cad0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6c04009330 tx=0x7f6c04009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:01.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.880+0000 7f6c114e9700 1 -- 172.21.15.152:0/95002970 shutdown_connections 2023-12-06T14:54:01.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.880+0000 7f6c114e9700 1 --2- 172.21.15.152:0/95002970 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f6bf4036720 0x7f6bf4038bd0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:01.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.880+0000 7f6c114e9700 1 --2- 172.21.15.152:0/95002970 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c0c0fb770 0x7f6c0c10cad0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:01.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.880+0000 7f6c114e9700 1 -- 172.21.15.152:0/95002970 >> 172.21.15.152:0/95002970 conn(0x7f6c0c0f6e50 msgr2=0x7f6c0c065e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:01.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.880+0000 7f6c114e9700 1 -- 172.21.15.152:0/95002970 shutdown_connections 2023-12-06T14:54:01.881 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:01.880+0000 7f6c114e9700 1 -- 172.21.15.152:0/95002970 wait complete. 2023-12-06T14:54:02.308 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi190 2023-12-06T14:54:02.308 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-06T14:54:02.308 DEBUG:teuthology.orchestra.run.smithi190:> dd of=/etc/ceph/ceph.conf 2023-12-06T14:54:02.330 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-06T14:54:02.330 DEBUG:teuthology.orchestra.run.smithi190:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-06T14:54:02.391 INFO:tasks.cephadm:Adding host smithi190 to orchestrator... 2023-12-06T14:54:02.391 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph orch host add smithi190 2023-12-06T14:54:02.772 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:54:02.941 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:02 smithi152 ceph-mon[111954]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:54:02.941 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:02 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:02.941 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:02 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:02.941 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:02 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:02.941 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:02 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:02.941 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:02 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:03.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:03.787+0000 7fcde69d9700 1 -- 172.21.15.152:0/4243163765 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcde0066430 msgr2=0x7fcde00ff4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:03.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:03.787+0000 7fcde69d9700 1 --2- 172.21.15.152:0/4243163765 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcde0066430 0x7fcde00ff4b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcdd00048c0 tx=0x7fcdd0009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:03.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:03.787+0000 7fcde69d9700 1 -- 172.21.15.152:0/4243163765 shutdown_connections 2023-12-06T14:54:03.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:03.787+0000 7fcde69d9700 1 --2- 172.21.15.152:0/4243163765 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcde0066430 0x7fcde00ff4b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:03.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:03.787+0000 7fcde69d9700 1 -- 172.21.15.152:0/4243163765 >> 172.21.15.152:0/4243163765 conn(0x7fcde00f6ec0 msgr2=0x7fcde00f92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:03.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:03.787+0000 7fcde69d9700 1 -- 172.21.15.152:0/4243163765 shutdown_connections 2023-12-06T14:54:03.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:03.787+0000 7fcde69d9700 1 -- 172.21.15.152:0/4243163765 wait complete. 2023-12-06T14:54:03.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:03.787+0000 7fcde69d9700 1 Processor -- start 2023-12-06T14:54:03.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:03.787+0000 7fcde69d9700 1 -- start start 2023-12-06T14:54:03.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:03.788+0000 7fcde69d9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcde0066430 0x7fcde010ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:03.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:03.788+0000 7fcde69d9700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde010cfa0 con 0x7fcde0066430 2023-12-06T14:54:03.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:03.788+0000 7fcddffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcde0066430 0x7fcde010ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:54:03.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:03.788+0000 7fcddffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcde0066430 0x7fcde010ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47054/0 (socket says 172.21.15.152:47054) 2023-12-06T14:54:03.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:03.788+0000 7fcddffff700 1 -- 172.21.15.152:0/1624987924 learned_addr learned my addr 172.21.15.152:0/1624987924 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:54:03.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:03.788+0000 7fcddffff700 1 -- 172.21.15.152:0/1624987924 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd0005040 con 0x7fcde0066430 2023-12-06T14:54:03.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:03.788+0000 7fcddffff700 1 --2- 172.21.15.152:0/1624987924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcde0066430 0x7fcde010ca60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcdd000b690 tx=0x7fcdd0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:54:03.790 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:03.788+0000 7fcddcff9700 1 -- 172.21.15.152:0/1624987924 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcdd0009650 con 0x7fcde0066430 2023-12-06T14:54:03.790 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:03.788+0000 7fcddcff9700 1 -- 172.21.15.152:0/1624987924 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcdd00097b0 con 0x7fcde0066430 2023-12-06T14:54:03.790 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:03.788+0000 7fcddcff9700 1 -- 172.21.15.152:0/1624987924 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcdd001c5d0 con 0x7fcde0066430 2023-12-06T14:54:03.790 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:03.788+0000 7fcde69d9700 1 -- 172.21.15.152:0/1624987924 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcde010d1a0 con 0x7fcde0066430 2023-12-06T14:54:03.790 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:03.788+0000 7fcde69d9700 1 -- 172.21.15.152:0/1624987924 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde010de40 con 0x7fcde0066430 2023-12-06T14:54:03.791 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:03.789+0000 7fcddcff9700 1 -- 172.21.15.152:0/1624987924 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7fcdd001c730 con 0x7fcde0066430 2023-12-06T14:54:03.791 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:03.789+0000 7fcde69d9700 1 -- 172.21.15.152:0/1624987924 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcde005f270 con 0x7fcde0066430 2023-12-06T14:54:03.791 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:03.790+0000 7fcddcff9700 1 --2- 172.21.15.152:0/1624987924 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fcdc8036720 0x7fcdc8038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:03.791 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:03.790+0000 7fcddcff9700 1 -- 172.21.15.152:0/1624987924 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fcdd00499e0 con 0x7fcde0066430 2023-12-06T14:54:03.791 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:03.790+0000 7fcddf7fe700 1 --2- 172.21.15.152:0/1624987924 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fcdc8036720 0x7fcdc8038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:54:03.791 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:03.790+0000 7fcddf7fe700 1 --2- 172.21.15.152:0/1624987924 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fcdc8036720 0x7fcdc8038bd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4009990 tx=0x7fcdd4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:54:03.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:03.795+0000 7fcddcff9700 1 -- 172.21.15.152:0/1624987924 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fcdd0025400 con 0x7fcde0066430 2023-12-06T14:54:04.001 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:04.000+0000 7fcde69d9700 1 -- 172.21.15.152:0/1624987924 --> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi190", "target": ["mon-mgr", ""]}) v1 -- 0x7fcde010ea20 con 0x7fcdc8036720 2023-12-06T14:54:04.377 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:03 smithi152 ceph-mon[111954]: Deploying daemon node-exporter.smithi152 on smithi152 2023-12-06T14:54:05.377 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:04 smithi152 ceph-mon[111954]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi190", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:54:05.840 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:05.839+0000 7fcddcff9700 1 -- 172.21.15.152:0/1624987924 <== mgr.14162 v2:172.21.15.152:6800/3517650686 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fcde010ea20 con 0x7fcdc8036720 2023-12-06T14:54:05.840 INFO:teuthology.orchestra.run.smithi152.stdout:Added host 'smithi190' with addr '172.21.15.190' 2023-12-06T14:54:05.841 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:05.841+0000 7fcde69d9700 1 -- 172.21.15.152:0/1624987924 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fcdc8036720 msgr2=0x7fcdc8038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:05.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:05.841+0000 7fcde69d9700 1 --2- 172.21.15.152:0/1624987924 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fcdc8036720 0x7fcdc8038bd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4009990 tx=0x7fcdd4006e40 comp rx=0 tx=0).stop 2023-12-06T14:54:05.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:05.842+0000 7fcde69d9700 1 -- 172.21.15.152:0/1624987924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcde0066430 msgr2=0x7fcde010ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:05.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:05.842+0000 7fcde69d9700 1 --2- 172.21.15.152:0/1624987924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcde0066430 0x7fcde010ca60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcdd000b690 tx=0x7fcdd0009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:05.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:05.842+0000 7fcde69d9700 1 -- 172.21.15.152:0/1624987924 shutdown_connections 2023-12-06T14:54:05.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:05.842+0000 7fcde69d9700 1 --2- 172.21.15.152:0/1624987924 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fcdc8036720 0x7fcdc8038bd0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:05.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:05.842+0000 7fcde69d9700 1 --2- 172.21.15.152:0/1624987924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcde0066430 0x7fcde010ca60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:05.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:05.842+0000 7fcde69d9700 1 -- 172.21.15.152:0/1624987924 >> 172.21.15.152:0/1624987924 conn(0x7fcde00f6ec0 msgr2=0x7fcde00f7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:05.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:05.842+0000 7fcde69d9700 1 -- 172.21.15.152:0/1624987924 shutdown_connections 2023-12-06T14:54:05.842 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:05.842+0000 7fcde69d9700 1 -- 172.21.15.152:0/1624987924 wait complete. 2023-12-06T14:54:06.109 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:05 smithi152 ceph-mon[111954]: Deploying cephadm binary to smithi190 2023-12-06T14:54:06.109 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:05 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:06.109 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:05 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:06.354 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph orch host ls --format=json 2023-12-06T14:54:06.730 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:54:07.199 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:06 smithi152 ceph-mon[111954]: Added host smithi190 2023-12-06T14:54:07.200 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:06 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:07.200 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:06 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:07.200 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:06 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:07.200 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:06 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:07.724 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.724+0000 7fa24131a700 1 -- 172.21.15.152:0/3863634145 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa23c0fc880 msgr2=0x7fa23c0fcc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:07.725 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.724+0000 7fa24131a700 1 --2- 172.21.15.152:0/3863634145 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa23c0fc880 0x7fa23c0fcc90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa2300048c0 tx=0x7fa230009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:07.725 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.724+0000 7fa24131a700 1 -- 172.21.15.152:0/3863634145 shutdown_connections 2023-12-06T14:54:07.725 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.724+0000 7fa24131a700 1 --2- 172.21.15.152:0/3863634145 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa23c0fc880 0x7fa23c0fcc90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:07.725 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.724+0000 7fa24131a700 1 -- 172.21.15.152:0/3863634145 >> 172.21.15.152:0/3863634145 conn(0x7fa23c0f7f40 msgr2=0x7fa23c0fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:07.725 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.724+0000 7fa24131a700 1 -- 172.21.15.152:0/3863634145 shutdown_connections 2023-12-06T14:54:07.725 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.724+0000 7fa24131a700 1 -- 172.21.15.152:0/3863634145 wait complete. 2023-12-06T14:54:07.725 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.725+0000 7fa24131a700 1 Processor -- start 2023-12-06T14:54:07.725 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.725+0000 7fa24131a700 1 -- start start 2023-12-06T14:54:07.726 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.725+0000 7fa24131a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa23c0fc880 0x7fa23c10caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:07.726 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.725+0000 7fa24131a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c10cfe0 con 0x7fa23c0fc880 2023-12-06T14:54:07.726 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.725+0000 7fa23affd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa23c0fc880 0x7fa23c10caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:54:07.727 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.725+0000 7fa23affd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa23c0fc880 0x7fa23c10caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47074/0 (socket says 172.21.15.152:47074) 2023-12-06T14:54:07.727 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.725+0000 7fa23affd700 1 -- 172.21.15.152:0/3002143950 learned_addr learned my addr 172.21.15.152:0/3002143950 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:54:07.727 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.725+0000 7fa23affd700 1 -- 172.21.15.152:0/3002143950 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa230005040 con 0x7fa23c0fc880 2023-12-06T14:54:07.727 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.726+0000 7fa23affd700 1 --2- 172.21.15.152:0/3002143950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa23c0fc880 0x7fa23c10caa0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa230009330 tx=0x7fa230009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:54:07.727 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.726+0000 7fa2237fe700 1 -- 172.21.15.152:0/3002143950 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa2300096b0 con 0x7fa23c0fc880 2023-12-06T14:54:07.727 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.726+0000 7fa2237fe700 1 -- 172.21.15.152:0/3002143950 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa230009810 con 0x7fa23c0fc880 2023-12-06T14:54:07.727 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.726+0000 7fa2237fe700 1 -- 172.21.15.152:0/3002143950 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa23001c5b0 con 0x7fa23c0fc880 2023-12-06T14:54:07.727 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.726+0000 7fa24131a700 1 -- 172.21.15.152:0/3002143950 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa23c10d1e0 con 0x7fa23c0fc880 2023-12-06T14:54:07.727 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.726+0000 7fa24131a700 1 -- 172.21.15.152:0/3002143950 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa23c10de80 con 0x7fa23c0fc880 2023-12-06T14:54:07.728 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.727+0000 7fa24131a700 1 -- 172.21.15.152:0/3002143950 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa23c05f270 con 0x7fa23c0fc880 2023-12-06T14:54:07.728 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.727+0000 7fa2237fe700 1 -- 172.21.15.152:0/3002143950 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7fa230013420 con 0x7fa23c0fc880 2023-12-06T14:54:07.728 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.727+0000 7fa2237fe700 1 --2- 172.21.15.152:0/3002143950 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fa2240366d0 0x7fa224038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:07.728 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.727+0000 7fa2237fe700 1 -- 172.21.15.152:0/3002143950 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa230049a10 con 0x7fa23c0fc880 2023-12-06T14:54:07.728 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.727+0000 7fa23a7fc700 1 --2- 172.21.15.152:0/3002143950 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fa2240366d0 0x7fa224038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:54:07.728 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.728+0000 7fa23a7fc700 1 --2- 172.21.15.152:0/3002143950 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fa2240366d0 0x7fa224038b80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa22c009990 tx=0x7fa22c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:54:07.731 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.732+0000 7fa2237fe700 1 -- 172.21.15.152:0/3002143950 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa2300119c0 con 0x7fa23c0fc880 2023-12-06T14:54:07.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.921+0000 7fa24131a700 1 -- 172.21.15.152:0/3002143950 --> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa23c10ea40 con 0x7fa2240366d0 2023-12-06T14:54:07.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.922+0000 7fa2237fe700 1 -- 172.21.15.152:0/3002143950 <== mgr.14162 v2:172.21.15.152:6800/3517650686 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+161 (secure 0 0 0) 0x7fa23c10ea40 con 0x7fa2240366d0 2023-12-06T14:54:07.922 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:54:07.922 INFO:teuthology.orchestra.run.smithi152.stdout:[{"addr": "172.21.15.152", "hostname": "smithi152", "labels": [], "status": ""}, {"addr": "172.21.15.190", "hostname": "smithi190", "labels": [], "status": ""}] 2023-12-06T14:54:07.924 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.924+0000 7fa24131a700 1 -- 172.21.15.152:0/3002143950 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fa2240366d0 msgr2=0x7fa224038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:07.924 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.924+0000 7fa24131a700 1 --2- 172.21.15.152:0/3002143950 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fa2240366d0 0x7fa224038b80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa22c009990 tx=0x7fa22c006e40 comp rx=0 tx=0).stop 2023-12-06T14:54:07.924 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.924+0000 7fa24131a700 1 -- 172.21.15.152:0/3002143950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa23c0fc880 msgr2=0x7fa23c10caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:07.924 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.924+0000 7fa24131a700 1 --2- 172.21.15.152:0/3002143950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa23c0fc880 0x7fa23c10caa0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa230009330 tx=0x7fa230009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:07.924 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.924+0000 7fa24131a700 1 -- 172.21.15.152:0/3002143950 shutdown_connections 2023-12-06T14:54:07.924 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.924+0000 7fa24131a700 1 --2- 172.21.15.152:0/3002143950 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fa2240366d0 0x7fa224038b80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:07.924 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.924+0000 7fa24131a700 1 --2- 172.21.15.152:0/3002143950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa23c0fc880 0x7fa23c10caa0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:07.924 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.924+0000 7fa24131a700 1 -- 172.21.15.152:0/3002143950 >> 172.21.15.152:0/3002143950 conn(0x7fa23c0f7f40 msgr2=0x7fa23c0f8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:07.924 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.924+0000 7fa24131a700 1 -- 172.21.15.152:0/3002143950 shutdown_connections 2023-12-06T14:54:07.924 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:07.924+0000 7fa24131a700 1 -- 172.21.15.152:0/3002143950 wait complete. 2023-12-06T14:54:08.362 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:07 smithi152 ceph-mon[111954]: Deploying daemon alertmanager.smithi152 on smithi152 2023-12-06T14:54:08.387 INFO:tasks.cephadm:Setting crush tunables to default 2023-12-06T14:54:08.387 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph osd crush tunables default 2023-12-06T14:54:09.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:08 smithi152 ceph-mon[111954]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-06T14:54:09.759 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:54:11.350 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.350+0000 7fe79b176700 1 -- 172.21.15.152:0/3278195872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7940fc870 msgr2=0x7fe7940fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:11.350 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.350+0000 7fe79b176700 1 --2- 172.21.15.152:0/3278195872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7940fc870 0x7fe7940fcc80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe7880048c0 tx=0x7fe788009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:11.351 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.350+0000 7fe79b176700 1 -- 172.21.15.152:0/3278195872 shutdown_connections 2023-12-06T14:54:11.351 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.350+0000 7fe79b176700 1 --2- 172.21.15.152:0/3278195872 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7940fc870 0x7fe7940fcc80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:11.351 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.350+0000 7fe79b176700 1 -- 172.21.15.152:0/3278195872 >> 172.21.15.152:0/3278195872 conn(0x7fe7940f7f50 msgr2=0x7fe7940fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:11.351 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.350+0000 7fe79b176700 1 -- 172.21.15.152:0/3278195872 shutdown_connections 2023-12-06T14:54:11.351 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.350+0000 7fe79b176700 1 -- 172.21.15.152:0/3278195872 wait complete. 2023-12-06T14:54:11.352 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.351+0000 7fe79b176700 1 Processor -- start 2023-12-06T14:54:11.352 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.351+0000 7fe79b176700 1 -- start start 2023-12-06T14:54:11.352 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.352+0000 7fe79b176700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7940fc870 0x7fe79410ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:11.352 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.352+0000 7fe79b176700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79410cfd0 con 0x7fe7940fc870 2023-12-06T14:54:11.352 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.352+0000 7fe798f12700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7940fc870 0x7fe79410ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:54:11.353 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.352+0000 7fe798f12700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7940fc870 0x7fe79410ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:39564/0 (socket says 172.21.15.152:39564) 2023-12-06T14:54:11.353 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.352+0000 7fe798f12700 1 -- 172.21.15.152:0/3895904583 learned_addr learned my addr 172.21.15.152:0/3895904583 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:54:11.353 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.352+0000 7fe798f12700 1 -- 172.21.15.152:0/3895904583 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe788005040 con 0x7fe7940fc870 2023-12-06T14:54:11.353 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.352+0000 7fe798f12700 1 --2- 172.21.15.152:0/3895904583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7940fc870 0x7fe79410ca90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe78800b690 tx=0x7fe788009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:54:11.353 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.352+0000 7fe7917fa700 1 -- 172.21.15.152:0/3895904583 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe788009650 con 0x7fe7940fc870 2023-12-06T14:54:11.353 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.352+0000 7fe79b176700 1 -- 172.21.15.152:0/3895904583 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe79410d1d0 con 0x7fe7940fc870 2023-12-06T14:54:11.353 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.352+0000 7fe7917fa700 1 -- 172.21.15.152:0/3895904583 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe7880097b0 con 0x7fe7940fc870 2023-12-06T14:54:11.353 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.352+0000 7fe7917fa700 1 -- 172.21.15.152:0/3895904583 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe78801c5d0 con 0x7fe7940fc870 2023-12-06T14:54:11.353 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.352+0000 7fe79b176700 1 -- 172.21.15.152:0/3895904583 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe79410de70 con 0x7fe7940fc870 2023-12-06T14:54:11.354 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.353+0000 7fe7917fa700 1 -- 172.21.15.152:0/3895904583 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7fe78801c840 con 0x7fe7940fc870 2023-12-06T14:54:11.354 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.353+0000 7fe7917fa700 1 --2- 172.21.15.152:0/3895904583 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fe7840366d0 0x7fe784038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:11.354 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.353+0000 7fe7917fa700 1 -- 172.21.15.152:0/3895904583 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe788049a50 con 0x7fe7940fc870 2023-12-06T14:54:11.354 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.353+0000 7fe793fff700 1 --2- 172.21.15.152:0/3895904583 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fe7840366d0 0x7fe784038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:54:11.354 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.353+0000 7fe79b176700 1 -- 172.21.15.152:0/3895904583 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe79405f270 con 0x7fe7940fc870 2023-12-06T14:54:11.354 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.354+0000 7fe793fff700 1 --2- 172.21.15.152:0/3895904583 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fe7840366d0 0x7fe784038b80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe780009990 tx=0x7fe780006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:54:11.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.358+0000 7fe7917fa700 1 -- 172.21.15.152:0/3895904583 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe788023300 con 0x7fe7940fc870 2023-12-06T14:54:11.551 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.551+0000 7fe79b176700 1 -- 172.21.15.152:0/3895904583 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fe79410e880 con 0x7fe7940fc870 2023-12-06T14:54:11.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.807+0000 7fe7917fa700 1 -- 172.21.15.152:0/3895904583 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7fe788011b60 con 0x7fe7940fc870 2023-12-06T14:54:11.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.809+0000 7fe79b176700 1 -- 172.21.15.152:0/3895904583 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fe7840366d0 msgr2=0x7fe784038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:11.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.809+0000 7fe79b176700 1 --2- 172.21.15.152:0/3895904583 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fe7840366d0 0x7fe784038b80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe780009990 tx=0x7fe780006e40 comp rx=0 tx=0).stop 2023-12-06T14:54:11.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.809+0000 7fe79b176700 1 -- 172.21.15.152:0/3895904583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7940fc870 msgr2=0x7fe79410ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:11.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.809+0000 7fe79b176700 1 --2- 172.21.15.152:0/3895904583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7940fc870 0x7fe79410ca90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe78800b690 tx=0x7fe788009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:11.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.809+0000 7fe79b176700 1 -- 172.21.15.152:0/3895904583 shutdown_connections 2023-12-06T14:54:11.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.809+0000 7fe79b176700 1 --2- 172.21.15.152:0/3895904583 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fe7840366d0 0x7fe784038b80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:11.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.809+0000 7fe79b176700 1 --2- 172.21.15.152:0/3895904583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7940fc870 0x7fe79410ca90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:11.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.809+0000 7fe79b176700 1 -- 172.21.15.152:0/3895904583 >> 172.21.15.152:0/3895904583 conn(0x7fe7940f7f50 msgr2=0x7fe7940f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:11.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.809+0000 7fe79b176700 1 -- 172.21.15.152:0/3895904583 shutdown_connections 2023-12-06T14:54:11.810 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:54:11.809+0000 7fe79b176700 1 -- 172.21.15.152:0/3895904583 wait complete. 2023-12-06T14:54:11.811 INFO:teuthology.orchestra.run.smithi152.stderr:adjusted tunables profile to default 2023-12-06T14:54:12.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:11 smithi152 ceph-mon[111954]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:54:12.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:11 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:12.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:11 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/3895904583' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-12-06T14:54:12.279 INFO:tasks.cephadm:Adding mon.smithi152 on smithi152 2023-12-06T14:54:12.279 INFO:tasks.cephadm:Adding mon.smithi190 on smithi190 2023-12-06T14:54:12.279 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph orch apply mon '2;smithi152:172.21.15.152=smithi152;smithi190:172.21.15.190=smithi190' 2023-12-06T14:54:12.571 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-06T14:54:12.629 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-06T14:54:13.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:12 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/3895904583' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-12-06T14:54:13.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:12 smithi152 ceph-mon[111954]: osdmap e4: 0 total, 0 up, 0 in 2023-12-06T14:54:13.861 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:13.859+0000 7ffac4c99700 1 -- 172.21.15.190:0/4073932000 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffac00fb770 msgr2=0x7ffac00fbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:13.862 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:13.859+0000 7ffac4c99700 1 --2- 172.21.15.190:0/4073932000 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffac00fb770 0x7ffac00fbb80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ffaa80048c0 tx=0x7ffaa8009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:13.862 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:13.860+0000 7ffac4c99700 1 -- 172.21.15.190:0/4073932000 shutdown_connections 2023-12-06T14:54:13.862 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:13.860+0000 7ffac4c99700 1 --2- 172.21.15.190:0/4073932000 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffac00fb770 0x7ffac00fbb80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:13.862 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:13.860+0000 7ffac4c99700 1 -- 172.21.15.190:0/4073932000 >> 172.21.15.190:0/4073932000 conn(0x7ffac00f6e50 msgr2=0x7ffac00f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:13.862 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:13.860+0000 7ffac4c99700 1 -- 172.21.15.190:0/4073932000 shutdown_connections 2023-12-06T14:54:13.862 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:13.860+0000 7ffac4c99700 1 -- 172.21.15.190:0/4073932000 wait complete. 2023-12-06T14:54:13.862 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:13.860+0000 7ffac4c99700 1 Processor -- start 2023-12-06T14:54:13.862 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:13.860+0000 7ffac4c99700 1 -- start start 2023-12-06T14:54:13.862 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:13.860+0000 7ffac4c99700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffac00fb770 0x7ffac010f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:13.862 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:13.860+0000 7ffac4c99700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac00662a0 con 0x7ffac00fb770 2023-12-06T14:54:13.862 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:13.861+0000 7ffabe59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffac00fb770 0x7ffac010f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:54:13.862 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:13.861+0000 7ffabe59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffac00fb770 0x7ffac010f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.190:36292/0 (socket says 172.21.15.190:36292) 2023-12-06T14:54:13.862 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:13.861+0000 7ffabe59c700 1 -- 172.21.15.190:0/2992287054 learned_addr learned my addr 172.21.15.190:0/2992287054 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-12-06T14:54:13.863 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:13.861+0000 7ffabe59c700 1 -- 172.21.15.190:0/2992287054 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa8005040 con 0x7ffac00fb770 2023-12-06T14:54:13.863 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:13.861+0000 7ffabe59c700 1 --2- 172.21.15.190:0/2992287054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffac00fb770 0x7ffac010f7a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800b690 tx=0x7ffaa8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:54:13.863 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:13.861+0000 7ffab6ffd700 1 -- 172.21.15.190:0/2992287054 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffaa8009650 con 0x7ffac00fb770 2023-12-06T14:54:13.863 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:13.861+0000 7ffab6ffd700 1 -- 172.21.15.190:0/2992287054 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffaa80097b0 con 0x7ffac00fb770 2023-12-06T14:54:13.863 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:13.861+0000 7ffac4c99700 1 -- 172.21.15.190:0/2992287054 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac00664a0 con 0x7ffac00fb770 2023-12-06T14:54:13.863 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:13.861+0000 7ffab6ffd700 1 -- 172.21.15.190:0/2992287054 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffaa801c5d0 con 0x7ffac00fb770 2023-12-06T14:54:13.863 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:13.861+0000 7ffac4c99700 1 -- 172.21.15.190:0/2992287054 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac010ff20 con 0x7ffac00fb770 2023-12-06T14:54:13.864 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:13.862+0000 7ffab6ffd700 1 -- 172.21.15.190:0/2992287054 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7ffaa8013420 con 0x7ffac00fb770 2023-12-06T14:54:13.864 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:13.862+0000 7ffac4c99700 1 -- 172.21.15.190:0/2992287054 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffac0105400 con 0x7ffac00fb770 2023-12-06T14:54:13.864 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:13.862+0000 7ffab6ffd700 1 --2- 172.21.15.190:0/2992287054 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7ffaac036720 0x7ffaac038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:13.864 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:13.862+0000 7ffab6ffd700 1 -- 172.21.15.190:0/2992287054 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ffaa8049a10 con 0x7ffac00fb770 2023-12-06T14:54:13.864 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:13.862+0000 7ffabdd9b700 1 --2- 172.21.15.190:0/2992287054 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7ffaac036720 0x7ffaac038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:54:13.864 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:13.863+0000 7ffabdd9b700 1 --2- 172.21.15.190:0/2992287054 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7ffaac036720 0x7ffaac038bd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ffab0009990 tx=0x7ffab0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:54:13.867 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:13.867+0000 7ffab6ffd700 1 -- 172.21.15.190:0/2992287054 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ffaa8025400 con 0x7ffac00fb770 2023-12-06T14:54:14.054 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:14.054+0000 7ffac4c99700 1 -- 172.21.15.190:0/2992287054 --> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi152:172.21.15.152=smithi152;smithi190:172.21.15.190=smithi190", "target": ["mon-mgr", ""]}) v1 -- 0x7ffac002b260 con 0x7ffaac036720 2023-12-06T14:54:14.063 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:14.063+0000 7ffab6ffd700 1 -- 172.21.15.190:0/2992287054 <== mgr.14162 v2:172.21.15.152:6800/3517650686 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7ffac002b260 con 0x7ffaac036720 2023-12-06T14:54:14.063 INFO:teuthology.orchestra.run.smithi190.stdout:Scheduled mon update... 2023-12-06T14:54:14.065 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:14.065+0000 7ffac4c99700 1 -- 172.21.15.190:0/2992287054 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7ffaac036720 msgr2=0x7ffaac038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:14.065 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:14.065+0000 7ffac4c99700 1 --2- 172.21.15.190:0/2992287054 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7ffaac036720 0x7ffaac038bd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ffab0009990 tx=0x7ffab0006e40 comp rx=0 tx=0).stop 2023-12-06T14:54:14.065 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:14.065+0000 7ffac4c99700 1 -- 172.21.15.190:0/2992287054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffac00fb770 msgr2=0x7ffac010f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:14.065 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:14.065+0000 7ffac4c99700 1 --2- 172.21.15.190:0/2992287054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffac00fb770 0x7ffac010f7a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800b690 tx=0x7ffaa8009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:14.065 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:14.065+0000 7ffac4c99700 1 -- 172.21.15.190:0/2992287054 shutdown_connections 2023-12-06T14:54:14.065 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:14.065+0000 7ffac4c99700 1 --2- 172.21.15.190:0/2992287054 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7ffaac036720 0x7ffaac038bd0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:14.065 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:14.065+0000 7ffac4c99700 1 --2- 172.21.15.190:0/2992287054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffac00fb770 0x7ffac010f7a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:14.066 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:14.065+0000 7ffac4c99700 1 -- 172.21.15.190:0/2992287054 >> 172.21.15.190:0/2992287054 conn(0x7ffac00f6e50 msgr2=0x7ffac00f7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:14.066 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:14.065+0000 7ffac4c99700 1 -- 172.21.15.190:0/2992287054 shutdown_connections 2023-12-06T14:54:14.066 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:14.065+0000 7ffac4c99700 1 -- 172.21.15.190:0/2992287054 wait complete. 2023-12-06T14:54:14.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:13 smithi152 ceph-mon[111954]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:54:14.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:13 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:14.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:13 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:14.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:13 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:14.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:13 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:14.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:13 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:14.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:13 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:14.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:13 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-06T14:54:14.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:13 smithi152 ceph-mon[111954]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-06T14:54:14.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:13 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:14.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:13 smithi152 ceph-mon[111954]: Deploying daemon grafana.smithi152 on smithi152 2023-12-06T14:54:14.447 DEBUG:teuthology.orchestra.run.smithi190:mon.smithi190> sudo journalctl -f -n 0 -u ceph-062f0e3c-9447-11ee-95a2-87774f69a715@mon.smithi190.service 2023-12-06T14:54:14.450 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-06T14:54:14.451 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-06T14:54:14.479 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:-- Logs begin at Wed 2023-12-06 14:39:30 UTC. -- 2023-12-06T14:54:14.745 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-06T14:54:14.803 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-06T14:54:15.377 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:15 smithi152 ceph-mon[111954]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi152:172.21.15.152=smithi152;smithi190:172.21.15.190=smithi190", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:54:15.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:15 smithi152 ceph-mon[111954]: Saving service mon spec with placement smithi152:172.21.15.152=smithi152;smithi190:172.21.15.190=smithi190;count:2 2023-12-06T14:54:15.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:15 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:15.759 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:15.759+0000 7f59fd192700 1 -- 172.21.15.190:0/1209525166 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59f80fc860 msgr2=0x7f59f80fcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:15.759 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:15.759+0000 7f59fd192700 1 --2- 172.21.15.190:0/1209525166 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59f80fc860 0x7f59f80fcc70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f59ec0048c0 tx=0x7f59ec009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:15.759 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:15.759+0000 7f59fd192700 1 -- 172.21.15.190:0/1209525166 shutdown_connections 2023-12-06T14:54:15.759 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:15.759+0000 7f59fd192700 1 --2- 172.21.15.190:0/1209525166 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59f80fc860 0x7f59f80fcc70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:15.759 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:15.759+0000 7f59fd192700 1 -- 172.21.15.190:0/1209525166 >> 172.21.15.190:0/1209525166 conn(0x7f59f80f7fe0 msgr2=0x7f59f80fa3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:15.760 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:15.759+0000 7f59fd192700 1 -- 172.21.15.190:0/1209525166 shutdown_connections 2023-12-06T14:54:15.760 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:15.759+0000 7f59fd192700 1 -- 172.21.15.190:0/1209525166 wait complete. 2023-12-06T14:54:15.760 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:15.760+0000 7f59fd192700 1 Processor -- start 2023-12-06T14:54:15.760 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:15.760+0000 7f59fd192700 1 -- start start 2023-12-06T14:54:15.760 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:15.760+0000 7f59fd192700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59f80fc860 0x7f59f810ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:15.760 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:15.760+0000 7f59fd192700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f810cfb0 con 0x7f59f80fc860 2023-12-06T14:54:15.760 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:15.760+0000 7f59f6d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59f80fc860 0x7f59f810ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:54:15.760 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:15.760+0000 7f59f6d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59f80fc860 0x7f59f810ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.190:36310/0 (socket says 172.21.15.190:36310) 2023-12-06T14:54:15.760 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:15.760+0000 7f59f6d9d700 1 -- 172.21.15.190:0/158295247 learned_addr learned my addr 172.21.15.190:0/158295247 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-12-06T14:54:15.760 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:15.760+0000 7f59f6d9d700 1 -- 172.21.15.190:0/158295247 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ec005040 con 0x7f59f80fc860 2023-12-06T14:54:15.762 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:15.760+0000 7f59f6d9d700 1 --2- 172.21.15.190:0/158295247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59f80fc860 0x7f59f810ca70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f59ec009040 tx=0x7f59ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:54:15.762 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:15.761+0000 7f59df7fe700 1 -- 172.21.15.190:0/158295247 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f59ec009620 con 0x7f59f80fc860 2023-12-06T14:54:15.762 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:15.761+0000 7f59fd192700 1 -- 172.21.15.190:0/158295247 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59f810d1b0 con 0x7f59f80fc860 2023-12-06T14:54:15.762 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:15.761+0000 7f59df7fe700 1 -- 172.21.15.190:0/158295247 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f59ec009780 con 0x7f59f80fc860 2023-12-06T14:54:15.762 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:15.761+0000 7f59df7fe700 1 -- 172.21.15.190:0/158295247 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f59ec01c5b0 con 0x7f59f80fc860 2023-12-06T14:54:15.762 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:15.761+0000 7f59fd192700 1 -- 172.21.15.190:0/158295247 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59f810de50 con 0x7f59f80fc860 2023-12-06T14:54:15.762 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:15.761+0000 7f59df7fe700 1 -- 172.21.15.190:0/158295247 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7f59ec01c870 con 0x7f59f80fc860 2023-12-06T14:54:15.762 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:15.761+0000 7f59df7fe700 1 --2- 172.21.15.190:0/158295247 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f59e00366d0 0x7f59e0038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:15.762 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:15.761+0000 7f59fd192700 1 -- 172.21.15.190:0/158295247 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59f805f270 con 0x7f59f80fc860 2023-12-06T14:54:15.763 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:15.762+0000 7f59df7fe700 1 -- 172.21.15.190:0/158295247 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f59ec0498a0 con 0x7f59f80fc860 2023-12-06T14:54:15.765 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:15.762+0000 7f59f659c700 1 --2- 172.21.15.190:0/158295247 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f59e00366d0 0x7f59e0038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:54:15.765 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:15.762+0000 7f59f659c700 1 --2- 172.21.15.190:0/158295247 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f59e00366d0 0x7f59e0038b80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f59e8009990 tx=0x7f59e8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:54:15.766 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:15.767+0000 7f59df7fe700 1 -- 172.21.15.190:0/158295247 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f59ec023300 con 0x7f59f80fc860 2023-12-06T14:54:16.020 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:16.020+0000 7f59fd192700 1 -- 172.21.15.190:0/158295247 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f59f810e970 con 0x7f59f80fc860 2023-12-06T14:54:16.020 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:16.021+0000 7f59df7fe700 1 -- 172.21.15.190:0/158295247 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f59ec011b60 con 0x7f59f80fc860 2023-12-06T14:54:16.021 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:54:16.021 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":1,"fsid":"062f0e3c-9447-11ee-95a2-87774f69a715","modified":"2023-12-06T14:52:59.570400Z","created":"2023-12-06T14:52:59.570400Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi152","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-06T14:54:16.023 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:16.023+0000 7f59fd192700 1 -- 172.21.15.190:0/158295247 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f59e00366d0 msgr2=0x7f59e0038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:16.023 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:16.023+0000 7f59fd192700 1 --2- 172.21.15.190:0/158295247 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f59e00366d0 0x7f59e0038b80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f59e8009990 tx=0x7f59e8006e40 comp rx=0 tx=0).stop 2023-12-06T14:54:16.023 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:16.023+0000 7f59fd192700 1 -- 172.21.15.190:0/158295247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59f80fc860 msgr2=0x7f59f810ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:16.023 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:16.023+0000 7f59fd192700 1 --2- 172.21.15.190:0/158295247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59f80fc860 0x7f59f810ca70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f59ec009040 tx=0x7f59ec009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:16.023 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:16.023+0000 7f59fd192700 1 -- 172.21.15.190:0/158295247 shutdown_connections 2023-12-06T14:54:16.023 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:16.023+0000 7f59fd192700 1 --2- 172.21.15.190:0/158295247 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f59e00366d0 0x7f59e0038b80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:16.023 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:16.023+0000 7f59fd192700 1 --2- 172.21.15.190:0/158295247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59f80fc860 0x7f59f810ca70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:16.023 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:16.023+0000 7f59fd192700 1 -- 172.21.15.190:0/158295247 >> 172.21.15.190:0/158295247 conn(0x7f59f80f7fe0 msgr2=0x7f59f80f8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:16.023 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:16.023+0000 7f59fd192700 1 -- 172.21.15.190:0/158295247 shutdown_connections 2023-12-06T14:54:16.023 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:16.023+0000 7f59fd192700 1 -- 172.21.15.190:0/158295247 wait complete. 2023-12-06T14:54:16.024 INFO:teuthology.orchestra.run.smithi190.stderr:dumped monmap epoch 1 2023-12-06T14:54:16.377 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:16 smithi152 ceph-mon[111954]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:54:16.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:16 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:16.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:16 smithi152 ceph-mon[111954]: from='client.? 172.21.15.190:0/158295247' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-06T14:54:17.388 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-06T14:54:17.389 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-06T14:54:17.683 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-06T14:54:17.742 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-06T14:54:18.377 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:18 smithi152 ceph-mon[111954]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:54:18.692 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.689+0000 7fc380d56700 1 -- 172.21.15.190:0/3444636257 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc37c0fb780 msgr2=0x7fc37c0fbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:18.692 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.689+0000 7fc380d56700 1 --2- 172.21.15.190:0/3444636257 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc37c0fb780 0x7fc37c0fbb90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc3700048c0 tx=0x7fc370009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:18.693 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.690+0000 7fc380d56700 1 -- 172.21.15.190:0/3444636257 shutdown_connections 2023-12-06T14:54:18.693 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.690+0000 7fc380d56700 1 --2- 172.21.15.190:0/3444636257 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc37c0fb780 0x7fc37c0fbb90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:18.693 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.690+0000 7fc380d56700 1 -- 172.21.15.190:0/3444636257 >> 172.21.15.190:0/3444636257 conn(0x7fc37c0f6e40 msgr2=0x7fc37c0f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:18.693 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.690+0000 7fc380d56700 1 -- 172.21.15.190:0/3444636257 shutdown_connections 2023-12-06T14:54:18.693 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.690+0000 7fc380d56700 1 -- 172.21.15.190:0/3444636257 wait complete. 2023-12-06T14:54:18.693 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.690+0000 7fc380d56700 1 Processor -- start 2023-12-06T14:54:18.693 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.690+0000 7fc380d56700 1 -- start start 2023-12-06T14:54:18.693 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.690+0000 7fc380d56700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc37c0fb780 0x7fc37c10f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:18.693 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.690+0000 7fc380d56700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c065a10 con 0x7fc37c0fb780 2023-12-06T14:54:18.693 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.690+0000 7fc37a59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc37c0fb780 0x7fc37c10f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:54:18.693 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.690+0000 7fc37a59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc37c0fb780 0x7fc37c10f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.190:36326/0 (socket says 172.21.15.190:36326) 2023-12-06T14:54:18.693 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.690+0000 7fc37a59c700 1 -- 172.21.15.190:0/1118603909 learned_addr learned my addr 172.21.15.190:0/1118603909 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-12-06T14:54:18.693 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.691+0000 7fc37a59c700 1 -- 172.21.15.190:0/1118603909 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc370005040 con 0x7fc37c0fb780 2023-12-06T14:54:18.694 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.691+0000 7fc37a59c700 1 --2- 172.21.15.190:0/1118603909 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc37c0fb780 0x7fc37c10f7c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc370009330 tx=0x7fc370009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:54:18.694 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.691+0000 7fc36affd700 1 -- 172.21.15.190:0/1118603909 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc3700096b0 con 0x7fc37c0fb780 2023-12-06T14:54:18.694 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.691+0000 7fc380d56700 1 -- 172.21.15.190:0/1118603909 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc37c065c10 con 0x7fc37c0fb780 2023-12-06T14:54:18.694 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.691+0000 7fc36affd700 1 -- 172.21.15.190:0/1118603909 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc370009810 con 0x7fc37c0fb780 2023-12-06T14:54:18.694 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.691+0000 7fc36affd700 1 -- 172.21.15.190:0/1118603909 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc37001c5b0 con 0x7fc37c0fb780 2023-12-06T14:54:18.694 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.691+0000 7fc380d56700 1 -- 172.21.15.190:0/1118603909 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc37c10ff40 con 0x7fc37c0fb780 2023-12-06T14:54:18.694 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.692+0000 7fc36affd700 1 -- 172.21.15.190:0/1118603909 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7fc370013420 con 0x7fc37c0fb780 2023-12-06T14:54:18.694 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.692+0000 7fc380d56700 1 -- 172.21.15.190:0/1118603909 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc37c105410 con 0x7fc37c0fb780 2023-12-06T14:54:18.694 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.692+0000 7fc36affd700 1 --2- 172.21.15.190:0/1118603909 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fc3640366d0 0x7fc364038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:18.694 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.692+0000 7fc36affd700 1 -- 172.21.15.190:0/1118603909 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fc370049ac0 con 0x7fc37c0fb780 2023-12-06T14:54:18.694 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.692+0000 7fc379d9b700 1 --2- 172.21.15.190:0/1118603909 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fc3640366d0 0x7fc364038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:54:18.694 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.693+0000 7fc379d9b700 1 --2- 172.21.15.190:0/1118603909 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fc3640366d0 0x7fc364038b80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc36c009990 tx=0x7fc36c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:54:18.700 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.701+0000 7fc36affd700 1 -- 172.21.15.190:0/1118603909 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc3700119c0 con 0x7fc37c0fb780 2023-12-06T14:54:18.953 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.954+0000 7fc380d56700 1 -- 172.21.15.190:0/1118603909 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc37c04bb80 con 0x7fc37c0fb780 2023-12-06T14:54:18.953 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.954+0000 7fc36affd700 1 -- 172.21.15.190:0/1118603909 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fc370011370 con 0x7fc37c0fb780 2023-12-06T14:54:18.954 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:54:18.954 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":1,"fsid":"062f0e3c-9447-11ee-95a2-87774f69a715","modified":"2023-12-06T14:52:59.570400Z","created":"2023-12-06T14:52:59.570400Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi152","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-06T14:54:18.955 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.956+0000 7fc380d56700 1 -- 172.21.15.190:0/1118603909 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fc3640366d0 msgr2=0x7fc364038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:18.955 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.956+0000 7fc380d56700 1 --2- 172.21.15.190:0/1118603909 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fc3640366d0 0x7fc364038b80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc36c009990 tx=0x7fc36c006e40 comp rx=0 tx=0).stop 2023-12-06T14:54:18.956 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.956+0000 7fc380d56700 1 -- 172.21.15.190:0/1118603909 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc37c0fb780 msgr2=0x7fc37c10f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:18.956 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.956+0000 7fc380d56700 1 --2- 172.21.15.190:0/1118603909 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc37c0fb780 0x7fc37c10f7c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc370009330 tx=0x7fc370009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:18.956 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.956+0000 7fc380d56700 1 -- 172.21.15.190:0/1118603909 shutdown_connections 2023-12-06T14:54:18.956 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.956+0000 7fc380d56700 1 --2- 172.21.15.190:0/1118603909 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fc3640366d0 0x7fc364038b80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:18.956 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.956+0000 7fc380d56700 1 --2- 172.21.15.190:0/1118603909 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc37c0fb780 0x7fc37c10f7c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:18.956 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.956+0000 7fc380d56700 1 -- 172.21.15.190:0/1118603909 >> 172.21.15.190:0/1118603909 conn(0x7fc37c0f6e40 msgr2=0x7fc37c0f7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:18.956 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.956+0000 7fc380d56700 1 -- 172.21.15.190:0/1118603909 shutdown_connections 2023-12-06T14:54:18.956 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:18.956+0000 7fc380d56700 1 -- 172.21.15.190:0/1118603909 wait complete. 2023-12-06T14:54:18.956 INFO:teuthology.orchestra.run.smithi190.stderr:dumped monmap epoch 1 2023-12-06T14:54:19.377 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:19 smithi152 ceph-mon[111954]: from='client.? 172.21.15.190:0/1118603909' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-06T14:54:20.345 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-06T14:54:20.346 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-06T14:54:20.377 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:20 smithi152 ceph-mon[111954]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:54:20.634 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-06T14:54:20.698 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-06T14:54:21.699 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.699+0000 7f6e33dab700 1 -- 172.21.15.190:0/3730602997 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e2c0fc880 msgr2=0x7f6e2c0fcc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:21.699 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.699+0000 7f6e33dab700 1 --2- 172.21.15.190:0/3730602997 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e2c0fc880 0x7f6e2c0fcc90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c0048c0 tx=0x7f6e1c009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:21.699 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.699+0000 7f6e33dab700 1 -- 172.21.15.190:0/3730602997 shutdown_connections 2023-12-06T14:54:21.699 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.699+0000 7f6e33dab700 1 --2- 172.21.15.190:0/3730602997 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e2c0fc880 0x7f6e2c0fcc90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:21.700 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.699+0000 7f6e33dab700 1 -- 172.21.15.190:0/3730602997 >> 172.21.15.190:0/3730602997 conn(0x7f6e2c0f7f20 msgr2=0x7f6e2c0fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:21.700 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.699+0000 7f6e33dab700 1 -- 172.21.15.190:0/3730602997 shutdown_connections 2023-12-06T14:54:21.700 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.699+0000 7f6e33dab700 1 -- 172.21.15.190:0/3730602997 wait complete. 2023-12-06T14:54:21.700 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.700+0000 7f6e33dab700 1 Processor -- start 2023-12-06T14:54:21.700 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.700+0000 7f6e33dab700 1 -- start start 2023-12-06T14:54:21.700 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.700+0000 7f6e33dab700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e2c0fc880 0x7f6e2c10cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:21.700 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.700+0000 7f6e33dab700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c10d010 con 0x7f6e2c0fc880 2023-12-06T14:54:21.700 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.700+0000 7f6e31b47700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e2c0fc880 0x7f6e2c10cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:54:21.700 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.700+0000 7f6e31b47700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e2c0fc880 0x7f6e2c10cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.190:33592/0 (socket says 172.21.15.190:33592) 2023-12-06T14:54:21.700 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.700+0000 7f6e31b47700 1 -- 172.21.15.190:0/40224383 learned_addr learned my addr 172.21.15.190:0/40224383 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-12-06T14:54:21.702 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.700+0000 7f6e31b47700 1 -- 172.21.15.190:0/40224383 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e1c005040 con 0x7f6e2c0fc880 2023-12-06T14:54:21.702 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.700+0000 7f6e31b47700 1 --2- 172.21.15.190:0/40224383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e2c0fc880 0x7f6e2c10cad0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c009330 tx=0x7f6e1c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:54:21.702 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.701+0000 7f6e227fc700 1 -- 172.21.15.190:0/40224383 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6e1c0096b0 con 0x7f6e2c0fc880 2023-12-06T14:54:21.702 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.701+0000 7f6e227fc700 1 -- 172.21.15.190:0/40224383 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6e1c009810 con 0x7f6e2c0fc880 2023-12-06T14:54:21.702 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.701+0000 7f6e33dab700 1 -- 172.21.15.190:0/40224383 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e2c10d210 con 0x7f6e2c0fc880 2023-12-06T14:54:21.702 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.701+0000 7f6e227fc700 1 -- 172.21.15.190:0/40224383 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6e1c01c5b0 con 0x7f6e2c0fc880 2023-12-06T14:54:21.702 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.701+0000 7f6e33dab700 1 -- 172.21.15.190:0/40224383 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e2c10deb0 con 0x7f6e2c0fc880 2023-12-06T14:54:21.702 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.701+0000 7f6e227fc700 1 -- 172.21.15.190:0/40224383 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7f6e1c01c870 con 0x7f6e2c0fc880 2023-12-06T14:54:21.702 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.701+0000 7f6e33dab700 1 -- 172.21.15.190:0/40224383 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e2c05f270 con 0x7f6e2c0fc880 2023-12-06T14:54:21.702 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.702+0000 7f6e227fc700 1 --2- 172.21.15.190:0/40224383 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f6e180366d0 0x7f6e18038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:21.702 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.702+0000 7f6e227fc700 1 -- 172.21.15.190:0/40224383 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f6e1c049bc0 con 0x7f6e2c0fc880 2023-12-06T14:54:21.702 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.702+0000 7f6e31346700 1 --2- 172.21.15.190:0/40224383 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f6e180366d0 0x7f6e18038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:54:21.702 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.702+0000 7f6e31346700 1 --2- 172.21.15.190:0/40224383 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f6e180366d0 0x7f6e18038b80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6e28009990 tx=0x7f6e28006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:54:21.706 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.706+0000 7f6e227fc700 1 -- 172.21.15.190:0/40224383 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6e1c011550 con 0x7f6e2c0fc880 2023-12-06T14:54:21.958 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.959+0000 7f6e33dab700 1 -- 172.21.15.190:0/40224383 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6e2c10ea00 con 0x7f6e2c0fc880 2023-12-06T14:54:21.959 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.960+0000 7f6e227fc700 1 -- 172.21.15.190:0/40224383 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f6e1c011370 con 0x7f6e2c0fc880 2023-12-06T14:54:21.959 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:54:21.959 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":1,"fsid":"062f0e3c-9447-11ee-95a2-87774f69a715","modified":"2023-12-06T14:52:59.570400Z","created":"2023-12-06T14:52:59.570400Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi152","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-06T14:54:21.961 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.962+0000 7f6e33dab700 1 -- 172.21.15.190:0/40224383 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f6e180366d0 msgr2=0x7f6e18038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:21.961 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.962+0000 7f6e33dab700 1 --2- 172.21.15.190:0/40224383 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f6e180366d0 0x7f6e18038b80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6e28009990 tx=0x7f6e28006e40 comp rx=0 tx=0).stop 2023-12-06T14:54:21.961 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.962+0000 7f6e33dab700 1 -- 172.21.15.190:0/40224383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e2c0fc880 msgr2=0x7f6e2c10cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:21.961 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.962+0000 7f6e33dab700 1 --2- 172.21.15.190:0/40224383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e2c0fc880 0x7f6e2c10cad0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c009330 tx=0x7f6e1c009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:21.961 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.962+0000 7f6e33dab700 1 -- 172.21.15.190:0/40224383 shutdown_connections 2023-12-06T14:54:21.961 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.962+0000 7f6e33dab700 1 --2- 172.21.15.190:0/40224383 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f6e180366d0 0x7f6e18038b80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:21.961 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.962+0000 7f6e33dab700 1 --2- 172.21.15.190:0/40224383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e2c0fc880 0x7f6e2c10cad0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:21.961 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.962+0000 7f6e33dab700 1 -- 172.21.15.190:0/40224383 >> 172.21.15.190:0/40224383 conn(0x7f6e2c0f7f20 msgr2=0x7f6e2c0f8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:21.962 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.962+0000 7f6e33dab700 1 -- 172.21.15.190:0/40224383 shutdown_connections 2023-12-06T14:54:21.962 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:21.962+0000 7f6e33dab700 1 -- 172.21.15.190:0/40224383 wait complete. 2023-12-06T14:54:21.962 INFO:teuthology.orchestra.run.smithi190.stderr:dumped monmap epoch 1 2023-12-06T14:54:22.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:22 smithi152 ceph-mon[111954]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:54:22.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:22 smithi152 ceph-mon[111954]: from='client.? 172.21.15.190:0/40224383' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-06T14:54:23.339 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-06T14:54:23.340 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-06T14:54:23.632 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-06T14:54:23.693 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-06T14:54:24.137 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:24 smithi152 ceph-mon[111954]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:54:24.137 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:24 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:24.137 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:24 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:24.137 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:24 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:24.137 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:24 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:24.137 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:24 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:24.138 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:24 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:24.634 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.632+0000 7ff08d8c4700 1 -- 172.21.15.190:0/3276380134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0880fd3c0 msgr2=0x7ff0880ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:24.634 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.632+0000 7ff08d8c4700 1 --2- 172.21.15.190:0/3276380134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0880fd3c0 0x7ff0880ff7a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff0780048c0 tx=0x7ff078009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:24.634 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.632+0000 7ff08d8c4700 1 -- 172.21.15.190:0/3276380134 shutdown_connections 2023-12-06T14:54:24.634 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.632+0000 7ff08d8c4700 1 --2- 172.21.15.190:0/3276380134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0880fd3c0 0x7ff0880ff7a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:24.634 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.632+0000 7ff08d8c4700 1 -- 172.21.15.190:0/3276380134 >> 172.21.15.190:0/3276380134 conn(0x7ff0880f6e40 msgr2=0x7ff0880f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:24.634 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.632+0000 7ff08d8c4700 1 -- 172.21.15.190:0/3276380134 shutdown_connections 2023-12-06T14:54:24.634 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.632+0000 7ff08d8c4700 1 -- 172.21.15.190:0/3276380134 wait complete. 2023-12-06T14:54:24.634 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.632+0000 7ff08d8c4700 1 Processor -- start 2023-12-06T14:54:24.634 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.632+0000 7ff08d8c4700 1 -- start start 2023-12-06T14:54:24.634 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.633+0000 7ff08d8c4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0880fd3c0 0x7ff08810ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:24.634 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.633+0000 7ff08d8c4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08810cfa0 con 0x7ff0880fd3c0 2023-12-06T14:54:24.635 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.633+0000 7ff086ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0880fd3c0 0x7ff08810ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:54:24.635 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.633+0000 7ff086ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0880fd3c0 0x7ff08810ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.190:33622/0 (socket says 172.21.15.190:33622) 2023-12-06T14:54:24.635 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.633+0000 7ff086ffd700 1 -- 172.21.15.190:0/1810013451 learned_addr learned my addr 172.21.15.190:0/1810013451 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-12-06T14:54:24.635 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.633+0000 7ff086ffd700 1 -- 172.21.15.190:0/1810013451 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff078005040 con 0x7ff0880fd3c0 2023-12-06T14:54:24.635 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.633+0000 7ff086ffd700 1 --2- 172.21.15.190:0/1810013451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0880fd3c0 0x7ff08810ca60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff07800b690 tx=0x7ff078009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:54:24.635 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.633+0000 7ff06f7fe700 1 -- 172.21.15.190:0/1810013451 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff078009650 con 0x7ff0880fd3c0 2023-12-06T14:54:24.635 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.633+0000 7ff08d8c4700 1 -- 172.21.15.190:0/1810013451 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff08810d1a0 con 0x7ff0880fd3c0 2023-12-06T14:54:24.635 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.633+0000 7ff06f7fe700 1 -- 172.21.15.190:0/1810013451 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff0780097b0 con 0x7ff0880fd3c0 2023-12-06T14:54:24.635 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.633+0000 7ff06f7fe700 1 -- 172.21.15.190:0/1810013451 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff07801c5b0 con 0x7ff0880fd3c0 2023-12-06T14:54:24.635 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.633+0000 7ff08d8c4700 1 -- 172.21.15.190:0/1810013451 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff08810de40 con 0x7ff0880fd3c0 2023-12-06T14:54:24.636 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.634+0000 7ff06f7fe700 1 -- 172.21.15.190:0/1810013451 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7ff078013420 con 0x7ff0880fd3c0 2023-12-06T14:54:24.636 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.634+0000 7ff08d8c4700 1 -- 172.21.15.190:0/1810013451 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff08805f270 con 0x7ff0880fd3c0 2023-12-06T14:54:24.636 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.634+0000 7ff06f7fe700 1 --2- 172.21.15.190:0/1810013451 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7ff0700366d0 0x7ff070038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:24.636 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.634+0000 7ff06f7fe700 1 -- 172.21.15.190:0/1810013451 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff078049910 con 0x7ff0880fd3c0 2023-12-06T14:54:24.636 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.634+0000 7ff0867fc700 1 --2- 172.21.15.190:0/1810013451 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7ff0700366d0 0x7ff070038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:54:24.636 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.635+0000 7ff0867fc700 1 --2- 172.21.15.190:0/1810013451 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7ff0700366d0 0x7ff070038b80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff07c009990 tx=0x7ff07c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:54:24.639 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.639+0000 7ff06f7fe700 1 -- 172.21.15.190:0/1810013451 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff078013a60 con 0x7ff0880fd3c0 2023-12-06T14:54:24.895 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.894+0000 7ff08d8c4700 1 -- 172.21.15.190:0/1810013451 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff08810e990 con 0x7ff0880fd3c0 2023-12-06T14:54:24.895 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.895+0000 7ff06f7fe700 1 -- 172.21.15.190:0/1810013451 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7ff078011370 con 0x7ff0880fd3c0 2023-12-06T14:54:24.896 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:54:24.896 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":1,"fsid":"062f0e3c-9447-11ee-95a2-87774f69a715","modified":"2023-12-06T14:52:59.570400Z","created":"2023-12-06T14:52:59.570400Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi152","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-06T14:54:24.897 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.897+0000 7ff08d8c4700 1 -- 172.21.15.190:0/1810013451 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7ff0700366d0 msgr2=0x7ff070038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:24.897 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.897+0000 7ff08d8c4700 1 --2- 172.21.15.190:0/1810013451 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7ff0700366d0 0x7ff070038b80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff07c009990 tx=0x7ff07c006e40 comp rx=0 tx=0).stop 2023-12-06T14:54:24.897 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.897+0000 7ff08d8c4700 1 -- 172.21.15.190:0/1810013451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0880fd3c0 msgr2=0x7ff08810ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:24.897 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.897+0000 7ff08d8c4700 1 --2- 172.21.15.190:0/1810013451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0880fd3c0 0x7ff08810ca60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff07800b690 tx=0x7ff078009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:24.897 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.897+0000 7ff08d8c4700 1 -- 172.21.15.190:0/1810013451 shutdown_connections 2023-12-06T14:54:24.897 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.897+0000 7ff08d8c4700 1 --2- 172.21.15.190:0/1810013451 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7ff0700366d0 0x7ff070038b80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:24.898 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.897+0000 7ff08d8c4700 1 --2- 172.21.15.190:0/1810013451 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0880fd3c0 0x7ff08810ca60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:24.898 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.897+0000 7ff08d8c4700 1 -- 172.21.15.190:0/1810013451 >> 172.21.15.190:0/1810013451 conn(0x7ff0880f6e40 msgr2=0x7ff0880f7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:24.898 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.897+0000 7ff08d8c4700 1 -- 172.21.15.190:0/1810013451 shutdown_connections 2023-12-06T14:54:24.898 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:24.897+0000 7ff08d8c4700 1 -- 172.21.15.190:0/1810013451 wait complete. 2023-12-06T14:54:24.898 INFO:teuthology.orchestra.run.smithi190.stderr:dumped monmap epoch 1 2023-12-06T14:54:25.377 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:25 smithi152 ceph-mon[111954]: Deploying daemon prometheus.smithi152 on smithi152 2023-12-06T14:54:25.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:25 smithi152 ceph-mon[111954]: from='client.? 172.21.15.190:0/1810013451' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-06T14:54:26.271 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-06T14:54:26.271 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-06T14:54:26.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:26 smithi152 ceph-mon[111954]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:54:26.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:26 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:26.550 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-06T14:54:26.616 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-06T14:54:27.537 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.535+0000 7fb7bd885700 1 -- 172.21.15.190:0/3341582909 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7b80fb770 msgr2=0x7fb7b80fbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:27.537 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.535+0000 7fb7bd885700 1 --2- 172.21.15.190:0/3341582909 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7b80fb770 0x7fb7b80fbb80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac0048c0 tx=0x7fb7ac009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:27.537 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.535+0000 7fb7bd885700 1 -- 172.21.15.190:0/3341582909 shutdown_connections 2023-12-06T14:54:27.538 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.535+0000 7fb7bd885700 1 --2- 172.21.15.190:0/3341582909 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7b80fb770 0x7fb7b80fbb80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:27.538 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.535+0000 7fb7bd885700 1 -- 172.21.15.190:0/3341582909 >> 172.21.15.190:0/3341582909 conn(0x7fb7b80f6e50 msgr2=0x7fb7b80f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:27.538 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.535+0000 7fb7bd885700 1 -- 172.21.15.190:0/3341582909 shutdown_connections 2023-12-06T14:54:27.538 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.535+0000 7fb7bd885700 1 -- 172.21.15.190:0/3341582909 wait complete. 2023-12-06T14:54:27.538 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.536+0000 7fb7bd885700 1 Processor -- start 2023-12-06T14:54:27.538 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.536+0000 7fb7bd885700 1 -- start start 2023-12-06T14:54:27.538 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.536+0000 7fb7bd885700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7b80fb770 0x7fb7b80f8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:27.538 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.536+0000 7fb7bd885700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b80f7360 con 0x7fb7b80fb770 2023-12-06T14:54:27.538 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.536+0000 7fb7b6ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7b80fb770 0x7fb7b80f8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:54:27.538 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.536+0000 7fb7b6ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7b80fb770 0x7fb7b80f8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.190:33638/0 (socket says 172.21.15.190:33638) 2023-12-06T14:54:27.538 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.536+0000 7fb7b6ffd700 1 -- 172.21.15.190:0/1232527006 learned_addr learned my addr 172.21.15.190:0/1232527006 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-12-06T14:54:27.538 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.536+0000 7fb7b6ffd700 1 -- 172.21.15.190:0/1232527006 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ac005040 con 0x7fb7b80fb770 2023-12-06T14:54:27.538 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.537+0000 7fb7b6ffd700 1 --2- 172.21.15.190:0/1232527006 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7b80fb770 0x7fb7b80f8ee0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac009330 tx=0x7fb7ac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:54:27.538 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.537+0000 7fb79f7fe700 1 -- 172.21.15.190:0/1232527006 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb7ac0096b0 con 0x7fb7b80fb770 2023-12-06T14:54:27.539 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.537+0000 7fb7bd885700 1 -- 172.21.15.190:0/1232527006 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7b80f7560 con 0x7fb7b80fb770 2023-12-06T14:54:27.539 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.537+0000 7fb79f7fe700 1 -- 172.21.15.190:0/1232527006 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb7ac009810 con 0x7fb7b80fb770 2023-12-06T14:54:27.539 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.537+0000 7fb79f7fe700 1 -- 172.21.15.190:0/1232527006 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb7ac01c5b0 con 0x7fb7b80fb770 2023-12-06T14:54:27.539 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.537+0000 7fb7bd885700 1 -- 172.21.15.190:0/1232527006 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7b80f7a50 con 0x7fb7b80fb770 2023-12-06T14:54:27.540 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.538+0000 7fb79f7fe700 1 -- 172.21.15.190:0/1232527006 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7fb7ac01c870 con 0x7fb7b80fb770 2023-12-06T14:54:27.540 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.538+0000 7fb79f7fe700 1 --2- 172.21.15.190:0/1232527006 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fb7a00366d0 0x7fb7a0038b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:27.540 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.538+0000 7fb79f7fe700 1 -- 172.21.15.190:0/1232527006 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fb7ac049ab0 con 0x7fb7b80fb770 2023-12-06T14:54:27.540 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.538+0000 7fb7bd885700 1 -- 172.21.15.190:0/1232527006 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7b8106410 con 0x7fb7b80fb770 2023-12-06T14:54:27.540 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.538+0000 7fb7b67fc700 1 --2- 172.21.15.190:0/1232527006 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fb7a00366d0 0x7fb7a0038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:54:27.540 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.538+0000 7fb7b67fc700 1 --2- 172.21.15.190:0/1232527006 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fb7a00366d0 0x7fb7a0038b80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8009990 tx=0x7fb7a8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:54:27.544 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.543+0000 7fb79f7fe700 1 -- 172.21.15.190:0/1232527006 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb7ac011dd0 con 0x7fb7b80fb770 2023-12-06T14:54:27.796 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.796+0000 7fb7bd885700 1 -- 172.21.15.190:0/1232527006 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb7b804bb80 con 0x7fb7b80fb770 2023-12-06T14:54:27.796 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.796+0000 7fb79f7fe700 1 -- 172.21.15.190:0/1232527006 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fb7ac034090 con 0x7fb7b80fb770 2023-12-06T14:54:27.797 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:54:27.797 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":1,"fsid":"062f0e3c-9447-11ee-95a2-87774f69a715","modified":"2023-12-06T14:52:59.570400Z","created":"2023-12-06T14:52:59.570400Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi152","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-06T14:54:27.798 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.798+0000 7fb7bd885700 1 -- 172.21.15.190:0/1232527006 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fb7a00366d0 msgr2=0x7fb7a0038b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:27.798 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.798+0000 7fb7bd885700 1 --2- 172.21.15.190:0/1232527006 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fb7a00366d0 0x7fb7a0038b80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8009990 tx=0x7fb7a8006e40 comp rx=0 tx=0).stop 2023-12-06T14:54:27.798 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.798+0000 7fb7bd885700 1 -- 172.21.15.190:0/1232527006 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7b80fb770 msgr2=0x7fb7b80f8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:27.798 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.798+0000 7fb7bd885700 1 --2- 172.21.15.190:0/1232527006 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7b80fb770 0x7fb7b80f8ee0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac009330 tx=0x7fb7ac009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:27.798 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.798+0000 7fb7bd885700 1 -- 172.21.15.190:0/1232527006 shutdown_connections 2023-12-06T14:54:27.799 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.798+0000 7fb7bd885700 1 --2- 172.21.15.190:0/1232527006 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fb7a00366d0 0x7fb7a0038b80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:27.799 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.798+0000 7fb7bd885700 1 --2- 172.21.15.190:0/1232527006 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7b80fb770 0x7fb7b80f8ee0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:27.799 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.798+0000 7fb7bd885700 1 -- 172.21.15.190:0/1232527006 >> 172.21.15.190:0/1232527006 conn(0x7fb7b80f6e50 msgr2=0x7fb7b80660c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:27.799 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.798+0000 7fb7bd885700 1 -- 172.21.15.190:0/1232527006 shutdown_connections 2023-12-06T14:54:27.799 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:27.798+0000 7fb7bd885700 1 -- 172.21.15.190:0/1232527006 wait complete. 2023-12-06T14:54:27.799 INFO:teuthology.orchestra.run.smithi190.stderr:dumped monmap epoch 1 2023-12-06T14:54:28.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:28 smithi152 ceph-mon[111954]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:54:28.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:28 smithi152 ceph-mon[111954]: from='client.? 172.21.15.190:0/1232527006' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-06T14:54:29.177 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-06T14:54:29.177 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-06T14:54:29.470 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-06T14:54:29.531 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-06T14:54:30.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:30 smithi152 ceph-mon[111954]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:54:30.584 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.582+0000 7f0eb626a700 1 -- 172.21.15.190:0/4190536979 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0eb00fc880 msgr2=0x7f0eb00fcc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:30.584 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.582+0000 7f0eb626a700 1 --2- 172.21.15.190:0/4190536979 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0eb00fc880 0x7f0eb00fcc90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0ea00048c0 tx=0x7f0ea0009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:30.584 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.582+0000 7f0eb626a700 1 -- 172.21.15.190:0/4190536979 shutdown_connections 2023-12-06T14:54:30.584 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.582+0000 7f0eb626a700 1 --2- 172.21.15.190:0/4190536979 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0eb00fc880 0x7f0eb00fcc90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:30.584 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.582+0000 7f0eb626a700 1 -- 172.21.15.190:0/4190536979 >> 172.21.15.190:0/4190536979 conn(0x7f0eb00f7f20 msgr2=0x7f0eb00fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:30.584 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.582+0000 7f0eb626a700 1 -- 172.21.15.190:0/4190536979 shutdown_connections 2023-12-06T14:54:30.584 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.582+0000 7f0eb626a700 1 -- 172.21.15.190:0/4190536979 wait complete. 2023-12-06T14:54:30.585 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.583+0000 7f0eb626a700 1 Processor -- start 2023-12-06T14:54:30.585 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.583+0000 7f0eb626a700 1 -- start start 2023-12-06T14:54:30.585 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.583+0000 7f0eb626a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0eb00fc880 0x7f0eb010cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:30.585 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.583+0000 7f0eb626a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb010d010 con 0x7f0eb00fc880 2023-12-06T14:54:30.585 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.583+0000 7f0eaffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0eb00fc880 0x7f0eb010cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:54:30.585 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.583+0000 7f0eaffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0eb00fc880 0x7f0eb010cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.190:39188/0 (socket says 172.21.15.190:39188) 2023-12-06T14:54:30.585 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.583+0000 7f0eaffff700 1 -- 172.21.15.190:0/1977145732 learned_addr learned my addr 172.21.15.190:0/1977145732 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-12-06T14:54:30.585 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.584+0000 7f0eaffff700 1 -- 172.21.15.190:0/1977145732 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea0005040 con 0x7f0eb00fc880 2023-12-06T14:54:30.585 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.584+0000 7f0eaffff700 1 --2- 172.21.15.190:0/1977145732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0eb00fc880 0x7f0eb010cad0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0ea000b690 tx=0x7f0ea0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:54:30.585 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.584+0000 7f0eacff9700 1 -- 172.21.15.190:0/1977145732 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ea0009650 con 0x7f0eb00fc880 2023-12-06T14:54:30.585 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.584+0000 7f0eacff9700 1 -- 172.21.15.190:0/1977145732 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0ea00097b0 con 0x7f0eb00fc880 2023-12-06T14:54:30.585 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.584+0000 7f0eb626a700 1 -- 172.21.15.190:0/1977145732 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb010d210 con 0x7f0eb00fc880 2023-12-06T14:54:30.585 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.584+0000 7f0eacff9700 1 -- 172.21.15.190:0/1977145732 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ea001c5d0 con 0x7f0eb00fc880 2023-12-06T14:54:30.585 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.584+0000 7f0eb626a700 1 -- 172.21.15.190:0/1977145732 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb010deb0 con 0x7f0eb00fc880 2023-12-06T14:54:30.586 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.585+0000 7f0eacff9700 1 -- 172.21.15.190:0/1977145732 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7f0ea001c730 con 0x7f0eb00fc880 2023-12-06T14:54:30.586 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.585+0000 7f0eb626a700 1 -- 172.21.15.190:0/1977145732 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eb005f270 con 0x7f0eb00fc880 2023-12-06T14:54:30.586 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.585+0000 7f0eacff9700 1 --2- 172.21.15.190:0/1977145732 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f0e98036720 0x7f0e98038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:30.587 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.585+0000 7f0eacff9700 1 -- 172.21.15.190:0/1977145732 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f0ea0049b10 con 0x7f0eb00fc880 2023-12-06T14:54:30.587 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.585+0000 7f0eaf7fe700 1 --2- 172.21.15.190:0/1977145732 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f0e98036720 0x7f0e98038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:54:30.587 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.586+0000 7f0eaf7fe700 1 --2- 172.21.15.190:0/1977145732 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f0e98036720 0x7f0e98038bd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4009990 tx=0x7f0ea4006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:54:30.590 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.590+0000 7f0eacff9700 1 -- 172.21.15.190:0/1977145732 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0ea00123c0 con 0x7f0eb00fc880 2023-12-06T14:54:30.842 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.842+0000 7f0eb626a700 1 -- 172.21.15.190:0/1977145732 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0eb010ea00 con 0x7f0eb00fc880 2023-12-06T14:54:30.842 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.842+0000 7f0eacff9700 1 -- 172.21.15.190:0/1977145732 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f0ea0023300 con 0x7f0eb00fc880 2023-12-06T14:54:30.843 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:54:30.843 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":1,"fsid":"062f0e3c-9447-11ee-95a2-87774f69a715","modified":"2023-12-06T14:52:59.570400Z","created":"2023-12-06T14:52:59.570400Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi152","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-06T14:54:30.844 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.844+0000 7f0eb626a700 1 -- 172.21.15.190:0/1977145732 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f0e98036720 msgr2=0x7f0e98038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:30.844 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.844+0000 7f0eb626a700 1 --2- 172.21.15.190:0/1977145732 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f0e98036720 0x7f0e98038bd0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4009990 tx=0x7f0ea4006e40 comp rx=0 tx=0).stop 2023-12-06T14:54:30.845 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.844+0000 7f0eb626a700 1 -- 172.21.15.190:0/1977145732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0eb00fc880 msgr2=0x7f0eb010cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:30.845 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.844+0000 7f0eb626a700 1 --2- 172.21.15.190:0/1977145732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0eb00fc880 0x7f0eb010cad0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0ea000b690 tx=0x7f0ea0009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:30.845 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.844+0000 7f0eb626a700 1 -- 172.21.15.190:0/1977145732 shutdown_connections 2023-12-06T14:54:30.845 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.844+0000 7f0eb626a700 1 --2- 172.21.15.190:0/1977145732 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f0e98036720 0x7f0e98038bd0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:30.845 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.844+0000 7f0eb626a700 1 --2- 172.21.15.190:0/1977145732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0eb00fc880 0x7f0eb010cad0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:30.845 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.844+0000 7f0eb626a700 1 -- 172.21.15.190:0/1977145732 >> 172.21.15.190:0/1977145732 conn(0x7f0eb00f7f20 msgr2=0x7f0eb00f8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:30.845 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.844+0000 7f0eb626a700 1 -- 172.21.15.190:0/1977145732 shutdown_connections 2023-12-06T14:54:30.845 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:30.844+0000 7f0eb626a700 1 -- 172.21.15.190:0/1977145732 wait complete. 2023-12-06T14:54:30.845 INFO:teuthology.orchestra.run.smithi190.stderr:dumped monmap epoch 1 2023-12-06T14:54:31.377 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:31 smithi152 ceph-mon[111954]: from='client.? 172.21.15.190:0/1977145732' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-06T14:54:32.207 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-06T14:54:32.207 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-06T14:54:32.360 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:32 smithi152 ceph-mon[111954]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:54:32.488 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-06T14:54:32.546 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-06T14:54:33.507 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.507+0000 7f81e08ea700 1 -- 172.21.15.190:0/1743126421 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81dc0fc880 msgr2=0x7f81dc0fcc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:33.507 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.507+0000 7f81e08ea700 1 --2- 172.21.15.190:0/1743126421 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81dc0fc880 0x7f81dc0fcc90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f81cc0048c0 tx=0x7f81cc009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:33.508 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.507+0000 7f81e08ea700 1 -- 172.21.15.190:0/1743126421 shutdown_connections 2023-12-06T14:54:33.508 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.507+0000 7f81e08ea700 1 --2- 172.21.15.190:0/1743126421 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81dc0fc880 0x7f81dc0fcc90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:33.508 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.507+0000 7f81e08ea700 1 -- 172.21.15.190:0/1743126421 >> 172.21.15.190:0/1743126421 conn(0x7f81dc0f7f20 msgr2=0x7f81dc0fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:33.508 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.507+0000 7f81e08ea700 1 -- 172.21.15.190:0/1743126421 shutdown_connections 2023-12-06T14:54:33.508 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.507+0000 7f81e08ea700 1 -- 172.21.15.190:0/1743126421 wait complete. 2023-12-06T14:54:33.508 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.507+0000 7f81e08ea700 1 Processor -- start 2023-12-06T14:54:33.508 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.507+0000 7f81e08ea700 1 -- start start 2023-12-06T14:54:33.509 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.507+0000 7f81e08ea700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81dc0fc880 0x7f81dc10cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:33.509 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.508+0000 7f81e08ea700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc10d010 con 0x7f81dc0fc880 2023-12-06T14:54:33.509 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.508+0000 7f81da59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81dc0fc880 0x7f81dc10cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:54:33.509 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.508+0000 7f81da59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81dc0fc880 0x7f81dc10cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.190:39208/0 (socket says 172.21.15.190:39208) 2023-12-06T14:54:33.509 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.508+0000 7f81da59c700 1 -- 172.21.15.190:0/1502302618 learned_addr learned my addr 172.21.15.190:0/1502302618 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-12-06T14:54:33.510 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.508+0000 7f81da59c700 1 -- 172.21.15.190:0/1502302618 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81cc005040 con 0x7f81dc0fc880 2023-12-06T14:54:33.510 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.508+0000 7f81da59c700 1 --2- 172.21.15.190:0/1502302618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81dc0fc880 0x7f81dc10cad0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f81cc00b690 tx=0x7f81cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:54:33.510 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.508+0000 7f81caffd700 1 -- 172.21.15.190:0/1502302618 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f81cc009650 con 0x7f81dc0fc880 2023-12-06T14:54:33.510 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.508+0000 7f81caffd700 1 -- 172.21.15.190:0/1502302618 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f81cc0097b0 con 0x7f81dc0fc880 2023-12-06T14:54:33.510 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.508+0000 7f81e08ea700 1 -- 172.21.15.190:0/1502302618 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81dc10d210 con 0x7f81dc0fc880 2023-12-06T14:54:33.510 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.508+0000 7f81caffd700 1 -- 172.21.15.190:0/1502302618 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f81cc01c5d0 con 0x7f81dc0fc880 2023-12-06T14:54:33.510 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.509+0000 7f81e08ea700 1 -- 172.21.15.190:0/1502302618 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81dc10deb0 con 0x7f81dc0fc880 2023-12-06T14:54:33.511 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.509+0000 7f81caffd700 1 -- 172.21.15.190:0/1502302618 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 13) v1 ==== 43338+0+0 (secure 0 0 0) 0x7f81cc01c730 con 0x7f81dc0fc880 2023-12-06T14:54:33.511 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.510+0000 7f81caffd700 1 --2- 172.21.15.190:0/1502302618 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f81c4036720 0x7f81c4038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:33.511 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.510+0000 7f81caffd700 1 -- 172.21.15.190:0/1502302618 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f81cc049940 con 0x7f81dc0fc880 2023-12-06T14:54:33.511 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.510+0000 7f81e08ea700 1 -- 172.21.15.190:0/1502302618 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81dc05f270 con 0x7f81dc0fc880 2023-12-06T14:54:33.511 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.510+0000 7f81d9d9b700 1 --2- 172.21.15.190:0/1502302618 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f81c4036720 0x7f81c4038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:54:33.511 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.510+0000 7f81d9d9b700 1 --2- 172.21.15.190:0/1502302618 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f81c4036720 0x7f81c4038bd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f81d0009990 tx=0x7f81d0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:54:33.515 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.515+0000 7f81caffd700 1 -- 172.21.15.190:0/1502302618 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f81cc0123c0 con 0x7f81dc0fc880 2023-12-06T14:54:33.769 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.768+0000 7f81e08ea700 1 -- 172.21.15.190:0/1502302618 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f81dc04bb80 con 0x7f81dc0fc880 2023-12-06T14:54:33.769 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.769+0000 7f81caffd700 1 -- 172.21.15.190:0/1502302618 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f81cc023300 con 0x7f81dc0fc880 2023-12-06T14:54:33.769 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:54:33.770 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":1,"fsid":"062f0e3c-9447-11ee-95a2-87774f69a715","modified":"2023-12-06T14:52:59.570400Z","created":"2023-12-06T14:52:59.570400Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi152","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-06T14:54:33.771 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.771+0000 7f81e08ea700 1 -- 172.21.15.190:0/1502302618 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f81c4036720 msgr2=0x7f81c4038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:33.771 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.771+0000 7f81e08ea700 1 --2- 172.21.15.190:0/1502302618 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f81c4036720 0x7f81c4038bd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f81d0009990 tx=0x7f81d0006e40 comp rx=0 tx=0).stop 2023-12-06T14:54:33.771 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.771+0000 7f81e08ea700 1 -- 172.21.15.190:0/1502302618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81dc0fc880 msgr2=0x7f81dc10cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:33.771 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.771+0000 7f81e08ea700 1 --2- 172.21.15.190:0/1502302618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81dc0fc880 0x7f81dc10cad0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f81cc00b690 tx=0x7f81cc009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:33.771 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.771+0000 7f81e08ea700 1 -- 172.21.15.190:0/1502302618 shutdown_connections 2023-12-06T14:54:33.772 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.771+0000 7f81e08ea700 1 --2- 172.21.15.190:0/1502302618 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f81c4036720 0x7f81c4038bd0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:33.772 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.771+0000 7f81e08ea700 1 --2- 172.21.15.190:0/1502302618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81dc0fc880 0x7f81dc10cad0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:33.772 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.771+0000 7f81e08ea700 1 -- 172.21.15.190:0/1502302618 >> 172.21.15.190:0/1502302618 conn(0x7f81dc0f7f20 msgr2=0x7f81dc0f8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:33.772 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.771+0000 7f81e08ea700 1 -- 172.21.15.190:0/1502302618 shutdown_connections 2023-12-06T14:54:33.772 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:33.771+0000 7f81e08ea700 1 -- 172.21.15.190:0/1502302618 wait complete. 2023-12-06T14:54:33.772 INFO:teuthology.orchestra.run.smithi190.stderr:dumped monmap epoch 1 2023-12-06T14:54:34.377 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:34 smithi152 ceph-mon[111954]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:54:34.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:34 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:34.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:34 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:34.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:34 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:34.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:34 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2023-12-06T14:54:34.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:34 smithi152 ceph-mon[111954]: from='client.? 172.21.15.190:0/1502302618' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-06T14:54:35.171 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-06T14:54:35.171 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-06T14:54:35.467 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-06T14:54:35.531 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-06T14:54:35.765 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:35 smithi152 ceph-mon[111954]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2023-12-06T14:54:35.765 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:35 smithi152 ceph-mon[111954]: mgrmap e14: smithi152.meodco(active, since 43s) 2023-12-06T14:54:36.532 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.531+0000 7f2251e2e700 1 -- 172.21.15.190:0/3554395151 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f224c065a80 msgr2=0x7f224c0ff450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:36.532 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.531+0000 7f2251e2e700 1 --2- 172.21.15.190:0/3554395151 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f224c065a80 0x7f224c0ff450 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f22340048c0 tx=0x7f2234009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:36.532 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.531+0000 7f2251e2e700 1 -- 172.21.15.190:0/3554395151 shutdown_connections 2023-12-06T14:54:36.533 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.531+0000 7f2251e2e700 1 --2- 172.21.15.190:0/3554395151 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f224c065a80 0x7f224c0ff450 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:36.533 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.531+0000 7f2251e2e700 1 -- 172.21.15.190:0/3554395151 >> 172.21.15.190:0/3554395151 conn(0x7f224c0f6e40 msgr2=0x7f224c0f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:36.533 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.531+0000 7f2251e2e700 1 -- 172.21.15.190:0/3554395151 shutdown_connections 2023-12-06T14:54:36.533 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.531+0000 7f2251e2e700 1 -- 172.21.15.190:0/3554395151 wait complete. 2023-12-06T14:54:36.533 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.531+0000 7f2251e2e700 1 Processor -- start 2023-12-06T14:54:36.533 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.531+0000 7f2251e2e700 1 -- start start 2023-12-06T14:54:36.533 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.532+0000 7f2251e2e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f224c065a80 0x7f224c10ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:36.533 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.532+0000 7f2251e2e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224c10cfa0 con 0x7f224c065a80 2023-12-06T14:54:36.533 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.532+0000 7f224b7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f224c065a80 0x7f224c10ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:54:36.533 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.532+0000 7f224b7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f224c065a80 0x7f224c10ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.190:39228/0 (socket says 172.21.15.190:39228) 2023-12-06T14:54:36.533 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.532+0000 7f224b7fe700 1 -- 172.21.15.190:0/504607555 learned_addr learned my addr 172.21.15.190:0/504607555 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-12-06T14:54:36.535 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.532+0000 7f224b7fe700 1 -- 172.21.15.190:0/504607555 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2234005040 con 0x7f224c065a80 2023-12-06T14:54:36.535 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.532+0000 7f224b7fe700 1 --2- 172.21.15.190:0/504607555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f224c065a80 0x7f224c10ca60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f223400b690 tx=0x7f2234009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:54:36.535 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.532+0000 7f2243fff700 1 -- 172.21.15.190:0/504607555 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2234009650 con 0x7f224c065a80 2023-12-06T14:54:36.535 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.533+0000 7f2243fff700 1 -- 172.21.15.190:0/504607555 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f22340097b0 con 0x7f224c065a80 2023-12-06T14:54:36.535 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.533+0000 7f2243fff700 1 -- 172.21.15.190:0/504607555 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f223401c5b0 con 0x7f224c065a80 2023-12-06T14:54:36.535 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.533+0000 7f2251e2e700 1 -- 172.21.15.190:0/504607555 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f224c10d1a0 con 0x7f224c065a80 2023-12-06T14:54:36.535 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.533+0000 7f2251e2e700 1 -- 172.21.15.190:0/504607555 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f224c10de40 con 0x7f224c065a80 2023-12-06T14:54:36.535 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.533+0000 7f2243fff700 1 -- 172.21.15.190:0/504607555 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 14) v1 ==== 43352+0+0 (secure 0 0 0) 0x7f223401c870 con 0x7f224c065a80 2023-12-06T14:54:36.535 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.533+0000 7f2243fff700 1 --2- 172.21.15.190:0/504607555 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f2238036720 0x7f2238038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:36.535 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.533+0000 7f2251e2e700 1 -- 172.21.15.190:0/504607555 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f224c05f270 con 0x7f224c065a80 2023-12-06T14:54:36.535 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.534+0000 7f2243fff700 1 -- 172.21.15.190:0/504607555 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f2234049a20 con 0x7f224c065a80 2023-12-06T14:54:36.535 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.534+0000 7f224affd700 1 -- 172.21.15.190:0/504607555 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f2238036720 msgr2=0x7f2238038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/3517650686 2023-12-06T14:54:36.536 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.534+0000 7f224affd700 1 --2- 172.21.15.190:0/504607555 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f2238036720 0x7f2238038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-06T14:54:36.539 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.539+0000 7f2243fff700 1 -- 172.21.15.190:0/504607555 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f22340119c0 con 0x7f224c065a80 2023-12-06T14:54:36.735 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.735+0000 7f224affd700 1 -- 172.21.15.190:0/504607555 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f2238036720 msgr2=0x7f2238038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/3517650686 2023-12-06T14:54:36.735 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.735+0000 7f224affd700 1 --2- 172.21.15.190:0/504607555 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f2238036720 0x7f2238038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-06T14:54:36.792 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.792+0000 7f2251e2e700 1 -- 172.21.15.190:0/504607555 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f224c10e990 con 0x7f224c065a80 2023-12-06T14:54:36.793 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.792+0000 7f2243fff700 1 -- 172.21.15.190:0/504607555 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f2234021450 con 0x7f224c065a80 2023-12-06T14:54:36.793 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:54:36.794 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":1,"fsid":"062f0e3c-9447-11ee-95a2-87774f69a715","modified":"2023-12-06T14:52:59.570400Z","created":"2023-12-06T14:52:59.570400Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi152","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-06T14:54:36.795 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.794+0000 7f2251e2e700 1 -- 172.21.15.190:0/504607555 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f2238036720 msgr2=0x7f2238038bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-06T14:54:36.795 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.794+0000 7f2251e2e700 1 --2- 172.21.15.190:0/504607555 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f2238036720 0x7f2238038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:36.795 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.794+0000 7f2251e2e700 1 -- 172.21.15.190:0/504607555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f224c065a80 msgr2=0x7f224c10ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:36.795 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.794+0000 7f2251e2e700 1 --2- 172.21.15.190:0/504607555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f224c065a80 0x7f224c10ca60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f223400b690 tx=0x7f2234009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:36.795 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.795+0000 7f2251e2e700 1 -- 172.21.15.190:0/504607555 shutdown_connections 2023-12-06T14:54:36.795 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.795+0000 7f2251e2e700 1 --2- 172.21.15.190:0/504607555 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7f2238036720 0x7f2238038bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:36.796 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.795+0000 7f2251e2e700 1 --2- 172.21.15.190:0/504607555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f224c065a80 0x7f224c10ca60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:36.796 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.795+0000 7f2251e2e700 1 -- 172.21.15.190:0/504607555 >> 172.21.15.190:0/504607555 conn(0x7f224c0f6e40 msgr2=0x7f224c0f7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:36.796 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.795+0000 7f2251e2e700 1 -- 172.21.15.190:0/504607555 shutdown_connections 2023-12-06T14:54:36.796 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:36.795+0000 7f2251e2e700 1 -- 172.21.15.190:0/504607555 wait complete. 2023-12-06T14:54:36.796 INFO:teuthology.orchestra.run.smithi190.stderr:dumped monmap epoch 1 2023-12-06T14:54:37.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:36 smithi152 ceph-mon[111954]: from='client.? 172.21.15.190:0/504607555' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-06T14:54:38.168 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-06T14:54:38.169 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-06T14:54:38.454 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-06T14:54:38.514 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-06T14:54:39.487 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.485+0000 7fb14b317700 1 -- 172.21.15.190:0/2881148568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1440fd3c0 msgr2=0x7fb1440ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:39.487 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.485+0000 7fb14b317700 1 --2- 172.21.15.190:0/2881148568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1440fd3c0 0x7fb1440ff7a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb1340048c0 tx=0x7fb134009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:39.488 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.485+0000 7fb14b317700 1 -- 172.21.15.190:0/2881148568 shutdown_connections 2023-12-06T14:54:39.488 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.485+0000 7fb14b317700 1 --2- 172.21.15.190:0/2881148568 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1440fd3c0 0x7fb1440ff7a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:39.488 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.485+0000 7fb14b317700 1 -- 172.21.15.190:0/2881148568 >> 172.21.15.190:0/2881148568 conn(0x7fb1440f6e40 msgr2=0x7fb1440f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:39.488 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.485+0000 7fb14b317700 1 -- 172.21.15.190:0/2881148568 shutdown_connections 2023-12-06T14:54:39.488 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.485+0000 7fb14b317700 1 -- 172.21.15.190:0/2881148568 wait complete. 2023-12-06T14:54:39.488 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.486+0000 7fb14b317700 1 Processor -- start 2023-12-06T14:54:39.488 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.486+0000 7fb14b317700 1 -- start start 2023-12-06T14:54:39.488 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.486+0000 7fb14b317700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1440fd3c0 0x7fb14410ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:39.488 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.486+0000 7fb14b317700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14410cfa0 con 0x7fb1440fd3c0 2023-12-06T14:54:39.488 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.486+0000 7fb1490b3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1440fd3c0 0x7fb14410ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:54:39.488 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.486+0000 7fb1490b3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1440fd3c0 0x7fb14410ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.190:46876/0 (socket says 172.21.15.190:46876) 2023-12-06T14:54:39.488 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.486+0000 7fb1490b3700 1 -- 172.21.15.190:0/1463120920 learned_addr learned my addr 172.21.15.190:0/1463120920 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-12-06T14:54:39.488 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.486+0000 7fb1490b3700 1 -- 172.21.15.190:0/1463120920 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb134005040 con 0x7fb1440fd3c0 2023-12-06T14:54:39.489 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.487+0000 7fb1490b3700 1 --2- 172.21.15.190:0/1463120920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1440fd3c0 0x7fb14410ca60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb13400b690 tx=0x7fb134009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:54:39.489 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.487+0000 7fb139ffb700 1 -- 172.21.15.190:0/1463120920 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb134009650 con 0x7fb1440fd3c0 2023-12-06T14:54:39.489 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.487+0000 7fb139ffb700 1 -- 172.21.15.190:0/1463120920 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb1340097b0 con 0x7fb1440fd3c0 2023-12-06T14:54:39.489 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.487+0000 7fb14b317700 1 -- 172.21.15.190:0/1463120920 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb14410d1a0 con 0x7fb1440fd3c0 2023-12-06T14:54:39.489 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.487+0000 7fb139ffb700 1 -- 172.21.15.190:0/1463120920 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb13401c5b0 con 0x7fb1440fd3c0 2023-12-06T14:54:39.489 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.487+0000 7fb14b317700 1 -- 172.21.15.190:0/1463120920 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb14410de40 con 0x7fb1440fd3c0 2023-12-06T14:54:39.490 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.488+0000 7fb139ffb700 1 -- 172.21.15.190:0/1463120920 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 14) v1 ==== 43352+0+0 (secure 0 0 0) 0x7fb13401c870 con 0x7fb1440fd3c0 2023-12-06T14:54:39.490 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.488+0000 7fb139ffb700 1 --2- 172.21.15.190:0/1463120920 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fb130036720 0x7fb130038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:39.490 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.488+0000 7fb139ffb700 1 -- 172.21.15.190:0/1463120920 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fb134049950 con 0x7fb1440fd3c0 2023-12-06T14:54:39.490 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.488+0000 7fb1488b2700 1 -- 172.21.15.190:0/1463120920 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fb130036720 msgr2=0x7fb130038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/3517650686 2023-12-06T14:54:39.490 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.488+0000 7fb14b317700 1 -- 172.21.15.190:0/1463120920 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb14405f270 con 0x7fb1440fd3c0 2023-12-06T14:54:39.490 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.488+0000 7fb1488b2700 1 --2- 172.21.15.190:0/1463120920 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fb130036720 0x7fb130038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-06T14:54:39.493 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.493+0000 7fb139ffb700 1 -- 172.21.15.190:0/1463120920 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb134011db0 con 0x7fb1440fd3c0 2023-12-06T14:54:39.689 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.689+0000 7fb1488b2700 1 -- 172.21.15.190:0/1463120920 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fb130036720 msgr2=0x7fb130038bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/3517650686 2023-12-06T14:54:39.689 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.689+0000 7fb1488b2700 1 --2- 172.21.15.190:0/1463120920 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fb130036720 0x7fb130038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-06T14:54:39.748 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.747+0000 7fb14b317700 1 -- 172.21.15.190:0/1463120920 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb14410e8f0 con 0x7fb1440fd3c0 2023-12-06T14:54:39.748 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.748+0000 7fb139ffb700 1 -- 172.21.15.190:0/1463120920 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fb134011370 con 0x7fb1440fd3c0 2023-12-06T14:54:39.748 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:54:39.748 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":1,"fsid":"062f0e3c-9447-11ee-95a2-87774f69a715","modified":"2023-12-06T14:52:59.570400Z","created":"2023-12-06T14:52:59.570400Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi152","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-06T14:54:39.751 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.750+0000 7fb14b317700 1 -- 172.21.15.190:0/1463120920 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fb130036720 msgr2=0x7fb130038bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-06T14:54:39.751 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.750+0000 7fb14b317700 1 --2- 172.21.15.190:0/1463120920 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fb130036720 0x7fb130038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:39.751 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.750+0000 7fb14b317700 1 -- 172.21.15.190:0/1463120920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1440fd3c0 msgr2=0x7fb14410ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:39.751 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.750+0000 7fb14b317700 1 --2- 172.21.15.190:0/1463120920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1440fd3c0 0x7fb14410ca60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb13400b690 tx=0x7fb134009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:39.751 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.750+0000 7fb14b317700 1 -- 172.21.15.190:0/1463120920 shutdown_connections 2023-12-06T14:54:39.751 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.750+0000 7fb14b317700 1 --2- 172.21.15.190:0/1463120920 >> [v2:172.21.15.152:6800/3517650686,v1:172.21.15.152:6801/3517650686] conn(0x7fb130036720 0x7fb130038bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:39.751 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.750+0000 7fb14b317700 1 --2- 172.21.15.190:0/1463120920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1440fd3c0 0x7fb14410ca60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:39.751 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.750+0000 7fb14b317700 1 -- 172.21.15.190:0/1463120920 >> 172.21.15.190:0/1463120920 conn(0x7fb1440f6e40 msgr2=0x7fb1440f7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:39.751 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.750+0000 7fb14b317700 1 -- 172.21.15.190:0/1463120920 shutdown_connections 2023-12-06T14:54:39.751 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:39.750+0000 7fb14b317700 1 -- 172.21.15.190:0/1463120920 wait complete. 2023-12-06T14:54:39.752 INFO:teuthology.orchestra.run.smithi190.stderr:dumped monmap epoch 1 2023-12-06T14:54:40.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:39 smithi152 ceph-mon[111954]: from='client.? 172.21.15.190:0/1463120920' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-06T14:54:41.071 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-06T14:54:41.072 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-06T14:54:41.106 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:41 smithi152 ceph-mon[111954]: Active manager daemon smithi152.meodco restarted 2023-12-06T14:54:41.107 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:41 smithi152 ceph-mon[111954]: Activating manager daemon smithi152.meodco 2023-12-06T14:54:41.107 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:41 smithi152 ceph-mon[111954]: osdmap e5: 0 total, 0 up, 0 in 2023-12-06T14:54:41.107 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:41 smithi152 ceph-mon[111954]: mgrmap e15: smithi152.meodco(active, starting, since 0.00364593s) 2023-12-06T14:54:41.107 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:41 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-06T14:54:41.107 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:41 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mgr metadata", "who": "smithi152.meodco", "id": "smithi152.meodco"}]: dispatch 2023-12-06T14:54:41.107 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:41 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-06T14:54:41.107 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:41 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-06T14:54:41.107 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:41 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-06T14:54:41.107 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:41 smithi152 ceph-mon[111954]: Manager daemon smithi152.meodco is now available 2023-12-06T14:54:41.107 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:41 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:54:41.108 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:41 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:54:41.366 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-06T14:54:41.433 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-06T14:54:42.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:42 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:42.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:42 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:54:42.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:42 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.meodco/mirror_snapshot_schedule"}]: dispatch 2023-12-06T14:54:42.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:42 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.meodco/trash_purge_schedule"}]: dispatch 2023-12-06T14:54:42.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:42 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:42.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:42 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:42.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:42 smithi152 ceph-mon[111954]: mgrmap e16: smithi152.meodco(active, since 1.00476s) 2023-12-06T14:54:42.420 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.419+0000 7f22a5a3c700 1 -- 172.21.15.190:0/1082564969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22a0065aa0 msgr2=0x7f22a00ff430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:42.420 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.419+0000 7f22a5a3c700 1 --2- 172.21.15.190:0/1082564969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22a0065aa0 0x7f22a00ff430 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f22900048c0 tx=0x7f2290009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:42.420 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.419+0000 7f22a5a3c700 1 -- 172.21.15.190:0/1082564969 shutdown_connections 2023-12-06T14:54:42.420 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.419+0000 7f22a5a3c700 1 --2- 172.21.15.190:0/1082564969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22a0065aa0 0x7f22a00ff430 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:42.420 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.419+0000 7f22a5a3c700 1 -- 172.21.15.190:0/1082564969 >> 172.21.15.190:0/1082564969 conn(0x7f22a00f6e40 msgr2=0x7f22a00f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:42.420 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.420+0000 7f22a5a3c700 1 -- 172.21.15.190:0/1082564969 shutdown_connections 2023-12-06T14:54:42.420 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.420+0000 7f22a5a3c700 1 -- 172.21.15.190:0/1082564969 wait complete. 2023-12-06T14:54:42.422 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.420+0000 7f22a5a3c700 1 Processor -- start 2023-12-06T14:54:42.422 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.421+0000 7f22a5a3c700 1 -- start start 2023-12-06T14:54:42.422 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.421+0000 7f22a5a3c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22a0065aa0 0x7f22a010ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:42.422 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.421+0000 7f22a5a3c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a010f250 con 0x7f22a0065aa0 2023-12-06T14:54:42.422 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.421+0000 7f229effd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22a0065aa0 0x7f22a010ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:54:42.422 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.421+0000 7f229effd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22a0065aa0 0x7f22a010ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.190:46900/0 (socket says 172.21.15.190:46900) 2023-12-06T14:54:42.422 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.421+0000 7f229effd700 1 -- 172.21.15.190:0/1427366293 learned_addr learned my addr 172.21.15.190:0/1427366293 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-12-06T14:54:42.422 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.421+0000 7f229effd700 1 -- 172.21.15.190:0/1427366293 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2290005040 con 0x7f22a0065aa0 2023-12-06T14:54:42.422 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.421+0000 7f229effd700 1 --2- 172.21.15.190:0/1427366293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22a0065aa0 0x7f22a010ed10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2290009040 tx=0x7f2290009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:54:42.422 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.421+0000 7f22877fe700 1 -- 172.21.15.190:0/1427366293 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2290009620 con 0x7f22a0065aa0 2023-12-06T14:54:42.422 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.421+0000 7f22877fe700 1 -- 172.21.15.190:0/1427366293 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2290009780 con 0x7f22a0065aa0 2023-12-06T14:54:42.422 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.421+0000 7f22a5a3c700 1 -- 172.21.15.190:0/1427366293 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a010f450 con 0x7f22a0065aa0 2023-12-06T14:54:42.422 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.421+0000 7f22877fe700 1 -- 172.21.15.190:0/1427366293 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f229001c5b0 con 0x7f22a0065aa0 2023-12-06T14:54:42.423 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.422+0000 7f22a5a3c700 1 -- 172.21.15.190:0/1427366293 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a010ffb0 con 0x7f22a0065aa0 2023-12-06T14:54:42.423 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.422+0000 7f22877fe700 1 -- 172.21.15.190:0/1427366293 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 16) v1 ==== 43202+0+0 (secure 0 0 0) 0x7f229001c820 con 0x7f22a0065aa0 2023-12-06T14:54:42.423 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.422+0000 7f22a5a3c700 1 -- 172.21.15.190:0/1427366293 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22a004bb80 con 0x7f22a0065aa0 2023-12-06T14:54:42.424 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.423+0000 7f22877fe700 1 --2- 172.21.15.190:0/1427366293 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f22880365b0 0x7f2288038a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:42.424 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.423+0000 7f22877fe700 1 -- 172.21.15.190:0/1427366293 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f2290049730 con 0x7f22a0065aa0 2023-12-06T14:54:42.424 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.423+0000 7f229e7fc700 1 --2- 172.21.15.190:0/1427366293 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f22880365b0 0x7f2288038a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:54:42.424 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.423+0000 7f229e7fc700 1 --2- 172.21.15.190:0/1427366293 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f22880365b0 0x7f2288038a60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2294009990 tx=0x7f2294006e40 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:54:42.427 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.427+0000 7f22877fe700 1 -- 172.21.15.190:0/1427366293 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2290011dd0 con 0x7f22a0065aa0 2023-12-06T14:54:42.701 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.700+0000 7f22a5a3c700 1 -- 172.21.15.190:0/1427366293 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f22a0110e30 con 0x7f22a0065aa0 2023-12-06T14:54:42.701 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.701+0000 7f22877fe700 1 -- 172.21.15.190:0/1427366293 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f2290011370 con 0x7f22a0065aa0 2023-12-06T14:54:42.701 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:54:42.701 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":1,"fsid":"062f0e3c-9447-11ee-95a2-87774f69a715","modified":"2023-12-06T14:52:59.570400Z","created":"2023-12-06T14:52:59.570400Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi152","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-06T14:54:42.703 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.703+0000 7f22a5a3c700 1 -- 172.21.15.190:0/1427366293 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f22880365b0 msgr2=0x7f2288038a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:42.703 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.703+0000 7f22a5a3c700 1 --2- 172.21.15.190:0/1427366293 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f22880365b0 0x7f2288038a60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2294009990 tx=0x7f2294006e40 comp rx=0 tx=0).stop 2023-12-06T14:54:42.703 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.703+0000 7f22a5a3c700 1 -- 172.21.15.190:0/1427366293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22a0065aa0 msgr2=0x7f22a010ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:42.703 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.703+0000 7f22a5a3c700 1 --2- 172.21.15.190:0/1427366293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22a0065aa0 0x7f22a010ed10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2290009040 tx=0x7f2290009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:42.703 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.703+0000 7f22a5a3c700 1 -- 172.21.15.190:0/1427366293 shutdown_connections 2023-12-06T14:54:42.703 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.703+0000 7f22a5a3c700 1 --2- 172.21.15.190:0/1427366293 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f22880365b0 0x7f2288038a60 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:42.704 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.703+0000 7f22a5a3c700 1 --2- 172.21.15.190:0/1427366293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22a0065aa0 0x7f22a010ed10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:42.704 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.703+0000 7f22a5a3c700 1 -- 172.21.15.190:0/1427366293 >> 172.21.15.190:0/1427366293 conn(0x7f22a00f6e40 msgr2=0x7f22a00f7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:42.704 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.703+0000 7f22a5a3c700 1 -- 172.21.15.190:0/1427366293 shutdown_connections 2023-12-06T14:54:42.704 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:42.703+0000 7f22a5a3c700 1 -- 172.21.15.190:0/1427366293 wait complete. 2023-12-06T14:54:42.704 INFO:teuthology.orchestra.run.smithi190.stderr:dumped monmap epoch 1 2023-12-06T14:54:43.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:43 smithi152 ceph-mon[111954]: [06/Dec/2023:14:54:41] ENGINE Bus STARTING 2023-12-06T14:54:43.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:43 smithi152 ceph-mon[111954]: [06/Dec/2023:14:54:41] ENGINE Serving on https://172.21.15.152:7150 2023-12-06T14:54:43.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:43 smithi152 ceph-mon[111954]: [06/Dec/2023:14:54:41] ENGINE Bus STARTED 2023-12-06T14:54:43.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:43 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:43.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:43 smithi152 ceph-mon[111954]: from='client.? 172.21.15.190:0/1427366293' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-06T14:54:43.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:43 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:44.091 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-06T14:54:44.092 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-06T14:54:44.369 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-06T14:54:44.377 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:44 smithi152 ceph-mon[111954]: mgrmap e17: smithi152.meodco(active, since 2s) 2023-12-06T14:54:44.426 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-06T14:54:45.627 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:45 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:45.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:45 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:45.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:45 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:45.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:45 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:45.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:45 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "who": "osd/host:smithi152", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:54:45.683 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.682+0000 7f3b56747700 1 -- 172.21.15.190:0/3292575223 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b50065aa0 msgr2=0x7f3b50101830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:45.683 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.682+0000 7f3b56747700 1 --2- 172.21.15.190:0/3292575223 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b50065aa0 0x7f3b50101830 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3b400048c0 tx=0x7f3b40009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:45.683 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.682+0000 7f3b56747700 1 -- 172.21.15.190:0/3292575223 shutdown_connections 2023-12-06T14:54:45.683 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.682+0000 7f3b56747700 1 --2- 172.21.15.190:0/3292575223 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b50065aa0 0x7f3b50101830 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:45.683 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.682+0000 7f3b56747700 1 -- 172.21.15.190:0/3292575223 >> 172.21.15.190:0/3292575223 conn(0x7f3b500f6e40 msgr2=0x7f3b500f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:45.683 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.683+0000 7f3b56747700 1 -- 172.21.15.190:0/3292575223 shutdown_connections 2023-12-06T14:54:45.684 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.683+0000 7f3b56747700 1 -- 172.21.15.190:0/3292575223 wait complete. 2023-12-06T14:54:45.684 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.683+0000 7f3b56747700 1 Processor -- start 2023-12-06T14:54:45.685 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.683+0000 7f3b56747700 1 -- start start 2023-12-06T14:54:45.685 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.683+0000 7f3b56747700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b50065aa0 0x7f3b5010ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:45.686 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.683+0000 7f3b56747700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5010f230 con 0x7f3b50065aa0 2023-12-06T14:54:45.686 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.684+0000 7f3b4ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b50065aa0 0x7f3b5010ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:54:45.686 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.684+0000 7f3b4ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b50065aa0 0x7f3b5010ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.190:46922/0 (socket says 172.21.15.190:46922) 2023-12-06T14:54:45.686 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.684+0000 7f3b4ffff700 1 -- 172.21.15.190:0/3634973520 learned_addr learned my addr 172.21.15.190:0/3634973520 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-12-06T14:54:45.686 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.684+0000 7f3b4ffff700 1 -- 172.21.15.190:0/3634973520 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b40005040 con 0x7f3b50065aa0 2023-12-06T14:54:45.686 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.684+0000 7f3b4ffff700 1 --2- 172.21.15.190:0/3634973520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b50065aa0 0x7f3b5010ecf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3b4000b690 tx=0x7f3b40009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:54:45.686 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.684+0000 7f3b4cff9700 1 -- 172.21.15.190:0/3634973520 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3b40009650 con 0x7f3b50065aa0 2023-12-06T14:54:45.686 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.684+0000 7f3b56747700 1 -- 172.21.15.190:0/3634973520 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b5010f430 con 0x7f3b50065aa0 2023-12-06T14:54:45.686 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.684+0000 7f3b4cff9700 1 -- 172.21.15.190:0/3634973520 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3b400097b0 con 0x7f3b50065aa0 2023-12-06T14:54:45.686 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.684+0000 7f3b4cff9700 1 -- 172.21.15.190:0/3634973520 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3b4001c5b0 con 0x7f3b50065aa0 2023-12-06T14:54:45.686 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.684+0000 7f3b56747700 1 -- 172.21.15.190:0/3634973520 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b5010ff90 con 0x7f3b50065aa0 2023-12-06T14:54:45.687 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.685+0000 7f3b4cff9700 1 -- 172.21.15.190:0/3634973520 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) v1 ==== 43396+0+0 (secure 0 0 0) 0x7f3b4001c870 con 0x7f3b50065aa0 2023-12-06T14:54:45.687 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.685+0000 7f3b4cff9700 1 --2- 172.21.15.190:0/3634973520 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f3b380367c0 0x7f3b38038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:45.687 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.685+0000 7f3b56747700 1 -- 172.21.15.190:0/3634973520 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b5004bb80 con 0x7f3b50065aa0 2023-12-06T14:54:45.687 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.685+0000 7f3b4cff9700 1 -- 172.21.15.190:0/3634973520 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f3b40049e20 con 0x7f3b50065aa0 2023-12-06T14:54:45.687 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.685+0000 7f3b4f7fe700 1 --2- 172.21.15.190:0/3634973520 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f3b380367c0 0x7f3b38038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:54:45.687 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.686+0000 7f3b4f7fe700 1 --2- 172.21.15.190:0/3634973520 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f3b380367c0 0x7f3b38038c70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3b44009990 tx=0x7f3b44006e40 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:54:45.690 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.690+0000 7f3b4cff9700 1 -- 172.21.15.190:0/3634973520 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3b40023300 con 0x7f3b50065aa0 2023-12-06T14:54:45.965 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.965+0000 7f3b56747700 1 -- 172.21.15.190:0/3634973520 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f3b50110e10 con 0x7f3b50065aa0 2023-12-06T14:54:45.966 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.966+0000 7f3b4cff9700 1 -- 172.21.15.190:0/3634973520 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f3b4001e0c0 con 0x7f3b50065aa0 2023-12-06T14:54:45.966 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:54:45.966 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":1,"fsid":"062f0e3c-9447-11ee-95a2-87774f69a715","modified":"2023-12-06T14:52:59.570400Z","created":"2023-12-06T14:52:59.570400Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi152","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-06T14:54:45.968 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.968+0000 7f3b56747700 1 -- 172.21.15.190:0/3634973520 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f3b380367c0 msgr2=0x7f3b38038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:45.968 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.968+0000 7f3b56747700 1 --2- 172.21.15.190:0/3634973520 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f3b380367c0 0x7f3b38038c70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3b44009990 tx=0x7f3b44006e40 comp rx=0 tx=0).stop 2023-12-06T14:54:45.968 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.968+0000 7f3b56747700 1 -- 172.21.15.190:0/3634973520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b50065aa0 msgr2=0x7f3b5010ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:45.968 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.968+0000 7f3b56747700 1 --2- 172.21.15.190:0/3634973520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b50065aa0 0x7f3b5010ecf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3b4000b690 tx=0x7f3b40009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:45.968 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.968+0000 7f3b56747700 1 -- 172.21.15.190:0/3634973520 shutdown_connections 2023-12-06T14:54:45.968 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.968+0000 7f3b56747700 1 --2- 172.21.15.190:0/3634973520 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f3b380367c0 0x7f3b38038c70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:45.968 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.968+0000 7f3b56747700 1 --2- 172.21.15.190:0/3634973520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b50065aa0 0x7f3b5010ecf0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:45.969 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.968+0000 7f3b56747700 1 -- 172.21.15.190:0/3634973520 >> 172.21.15.190:0/3634973520 conn(0x7f3b500f6e40 msgr2=0x7f3b500f7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:45.969 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.968+0000 7f3b56747700 1 -- 172.21.15.190:0/3634973520 shutdown_connections 2023-12-06T14:54:45.969 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:45.968+0000 7f3b56747700 1 -- 172.21.15.190:0/3634973520 wait complete. 2023-12-06T14:54:45.969 INFO:teuthology.orchestra.run.smithi190.stderr:dumped monmap epoch 1 2023-12-06T14:54:46.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:46 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:46.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:46 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:46.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:46 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:46.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:46 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:46.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:46 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "who": "osd/host:smithi190", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:54:46.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:46 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:54:46.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:46 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:54:46.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:46 smithi152 ceph-mon[111954]: Updating smithi152:/etc/ceph/ceph.conf 2023-12-06T14:54:46.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:46 smithi152 ceph-mon[111954]: Updating smithi190:/etc/ceph/ceph.conf 2023-12-06T14:54:46.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:46 smithi152 ceph-mon[111954]: Updating smithi152:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-06T14:54:46.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:46 smithi152 ceph-mon[111954]: Updating smithi190:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-06T14:54:46.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:46 smithi152 ceph-mon[111954]: from='client.? 172.21.15.190:0/3634973520' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-06T14:54:46.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:46 smithi152 ceph-mon[111954]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2023-12-06T14:54:46.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:46 smithi152 ceph-mon[111954]: Updating smithi190:/etc/ceph/ceph.client.admin.keyring 2023-12-06T14:54:46.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:46 smithi152 ceph-mon[111954]: Updating smithi152:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-06T14:54:46.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:46 smithi152 ceph-mon[111954]: Updating smithi190:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-06T14:54:47.353 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-06T14:54:47.354 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-06T14:54:47.709 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-06T14:54:48.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:47 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:48.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:47 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:48.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:47 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:48.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:47 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:48.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:47 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:48.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:47 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi190", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-06T14:54:48.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:47 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi190", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-06T14:54:48.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:47 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:54:48.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:47 smithi152 ceph-mon[111954]: Deploying daemon crash.smithi190 on smithi190 2023-12-06T14:54:48.981 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:48.980+0000 7f3e1e61b700 1 -- 172.21.15.190:0/808606579 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e181028f0 msgr2=0x7f3e18102cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:48.981 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:48.980+0000 7f3e1e61b700 1 --2- 172.21.15.190:0/808606579 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e181028f0 0x7f3e18102cc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3e080048c0 tx=0x7f3e08009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:48.981 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:48.980+0000 7f3e1e61b700 1 -- 172.21.15.190:0/808606579 shutdown_connections 2023-12-06T14:54:48.981 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:48.980+0000 7f3e1e61b700 1 --2- 172.21.15.190:0/808606579 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e181028f0 0x7f3e18102cc0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:48.981 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:48.980+0000 7f3e1e61b700 1 -- 172.21.15.190:0/808606579 >> 172.21.15.190:0/808606579 conn(0x7f3e180715e0 msgr2=0x7f3e180719e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:48.981 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:48.980+0000 7f3e1e61b700 1 -- 172.21.15.190:0/808606579 shutdown_connections 2023-12-06T14:54:48.981 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:48.980+0000 7f3e1e61b700 1 -- 172.21.15.190:0/808606579 wait complete. 2023-12-06T14:54:48.981 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:48.980+0000 7f3e1e61b700 1 Processor -- start 2023-12-06T14:54:48.982 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:48.981+0000 7f3e1e61b700 1 -- start start 2023-12-06T14:54:48.982 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:48.981+0000 7f3e1e61b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e181028f0 0x7f3e18112b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:48.982 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:48.981+0000 7f3e1e61b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e18113090 con 0x7f3e181028f0 2023-12-06T14:54:48.983 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:48.981+0000 7f3e17fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e181028f0 0x7f3e18112b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:54:48.983 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:48.981+0000 7f3e17fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e181028f0 0x7f3e18112b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.190:46950/0 (socket says 172.21.15.190:46950) 2023-12-06T14:54:48.983 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:48.981+0000 7f3e17fff700 1 -- 172.21.15.190:0/4122014544 learned_addr learned my addr 172.21.15.190:0/4122014544 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-12-06T14:54:48.984 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:48.981+0000 7f3e17fff700 1 -- 172.21.15.190:0/4122014544 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e08005040 con 0x7f3e181028f0 2023-12-06T14:54:48.984 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:48.982+0000 7f3e17fff700 1 --2- 172.21.15.190:0/4122014544 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e181028f0 0x7f3e18112b50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009300 tx=0x7f3e08009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:54:48.984 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:48.982+0000 7f3e14ff9700 1 -- 172.21.15.190:0/4122014544 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e08004e60 con 0x7f3e181028f0 2023-12-06T14:54:48.984 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:48.982+0000 7f3e14ff9700 1 -- 172.21.15.190:0/4122014544 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3e08013420 con 0x7f3e181028f0 2023-12-06T14:54:48.984 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:48.982+0000 7f3e1e61b700 1 -- 172.21.15.190:0/4122014544 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e18113290 con 0x7f3e181028f0 2023-12-06T14:54:48.984 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:48.982+0000 7f3e14ff9700 1 -- 172.21.15.190:0/4122014544 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e0801c5b0 con 0x7f3e181028f0 2023-12-06T14:54:48.984 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:48.982+0000 7f3e1e61b700 1 -- 172.21.15.190:0/4122014544 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e1810ca10 con 0x7f3e181028f0 2023-12-06T14:54:48.984 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:48.983+0000 7f3e14ff9700 1 -- 172.21.15.190:0/4122014544 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) v1 ==== 43396+0+0 (secure 0 0 0) 0x7f3e08009600 con 0x7f3e181028f0 2023-12-06T14:54:48.984 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:48.983+0000 7f3e1e61b700 1 -- 172.21.15.190:0/4122014544 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e1805f270 con 0x7f3e181028f0 2023-12-06T14:54:48.984 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:48.983+0000 7f3e14ff9700 1 --2- 172.21.15.190:0/4122014544 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f3e000367c0 0x7f3e00038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:48.984 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:48.983+0000 7f3e14ff9700 1 -- 172.21.15.190:0/4122014544 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f3e08049950 con 0x7f3e181028f0 2023-12-06T14:54:48.984 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:48.983+0000 7f3e177fe700 1 --2- 172.21.15.190:0/4122014544 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f3e000367c0 0x7f3e00038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:54:48.985 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:48.984+0000 7f3e177fe700 1 --2- 172.21.15.190:0/4122014544 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f3e000367c0 0x7f3e00038c70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c009990 tx=0x7f3e0c006e40 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:54:48.988 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:48.988+0000 7f3e14ff9700 1 -- 172.21.15.190:0/4122014544 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3e08025400 con 0x7f3e181028f0 2023-12-06T14:54:49.284 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:49.283+0000 7f3e1e61b700 1 -- 172.21.15.190:0/4122014544 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f3e1810e130 con 0x7f3e181028f0 2023-12-06T14:54:49.285 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:49.284+0000 7f3e14ff9700 1 -- 172.21.15.190:0/4122014544 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f3e08011370 con 0x7f3e181028f0 2023-12-06T14:54:49.285 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:54:49.285 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":1,"fsid":"062f0e3c-9447-11ee-95a2-87774f69a715","modified":"2023-12-06T14:52:59.570400Z","created":"2023-12-06T14:52:59.570400Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi152","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-06T14:54:49.286 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:49.286+0000 7f3e1e61b700 1 -- 172.21.15.190:0/4122014544 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f3e000367c0 msgr2=0x7f3e00038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:49.286 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:49.286+0000 7f3e1e61b700 1 --2- 172.21.15.190:0/4122014544 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f3e000367c0 0x7f3e00038c70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c009990 tx=0x7f3e0c006e40 comp rx=0 tx=0).stop 2023-12-06T14:54:49.287 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:49.286+0000 7f3e1e61b700 1 -- 172.21.15.190:0/4122014544 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e181028f0 msgr2=0x7f3e18112b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:49.287 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:49.286+0000 7f3e1e61b700 1 --2- 172.21.15.190:0/4122014544 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e181028f0 0x7f3e18112b50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009300 tx=0x7f3e08009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:49.287 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:49.286+0000 7f3e1e61b700 1 -- 172.21.15.190:0/4122014544 shutdown_connections 2023-12-06T14:54:49.287 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:49.286+0000 7f3e1e61b700 1 --2- 172.21.15.190:0/4122014544 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f3e000367c0 0x7f3e00038c70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:49.287 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:49.286+0000 7f3e1e61b700 1 --2- 172.21.15.190:0/4122014544 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3e181028f0 0x7f3e18112b50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:49.287 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:49.286+0000 7f3e1e61b700 1 -- 172.21.15.190:0/4122014544 >> 172.21.15.190:0/4122014544 conn(0x7f3e180715e0 msgr2=0x7f3e18103ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:49.287 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:49.286+0000 7f3e1e61b700 1 -- 172.21.15.190:0/4122014544 shutdown_connections 2023-12-06T14:54:49.287 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:49.286+0000 7f3e1e61b700 1 -- 172.21.15.190:0/4122014544 wait complete. 2023-12-06T14:54:49.287 INFO:teuthology.orchestra.run.smithi190.stderr:dumped monmap epoch 1 2023-12-06T14:54:50.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:49 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:50.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:49 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:50.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:49 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:50.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:49 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:50.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:49 smithi152 ceph-mon[111954]: Deploying daemon node-exporter.smithi190 on smithi190 2023-12-06T14:54:50.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:49 smithi152 ceph-mon[111954]: from='client.? 172.21.15.190:0/4122014544' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-06T14:54:50.676 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-06T14:54:50.676 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-06T14:54:51.441 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-06T14:54:52.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:52 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:52.684 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.684+0000 7f4f8816a700 1 -- 172.21.15.190:0/1127469463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f801028f0 msgr2=0x7f4f80102cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:52.684 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.684+0000 7f4f8816a700 1 --2- 172.21.15.190:0/1127469463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f801028f0 0x7f4f80102cc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c0048c0 tx=0x7f4f7c009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:52.684 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.684+0000 7f4f8816a700 1 -- 172.21.15.190:0/1127469463 shutdown_connections 2023-12-06T14:54:52.684 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.684+0000 7f4f8816a700 1 --2- 172.21.15.190:0/1127469463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f801028f0 0x7f4f80102cc0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:52.684 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.684+0000 7f4f8816a700 1 -- 172.21.15.190:0/1127469463 >> 172.21.15.190:0/1127469463 conn(0x7f4f80071d60 msgr2=0x7f4f80072160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:52.684 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.684+0000 7f4f8816a700 1 -- 172.21.15.190:0/1127469463 shutdown_connections 2023-12-06T14:54:52.684 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.684+0000 7f4f8816a700 1 -- 172.21.15.190:0/1127469463 wait complete. 2023-12-06T14:54:52.685 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.685+0000 7f4f8816a700 1 Processor -- start 2023-12-06T14:54:52.686 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.685+0000 7f4f8816a700 1 -- start start 2023-12-06T14:54:52.686 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.685+0000 7f4f8816a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f801028f0 0x7f4f80112be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:52.686 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.685+0000 7f4f8816a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f80113120 con 0x7f4f801028f0 2023-12-06T14:54:52.686 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.685+0000 7f4f85f06700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f801028f0 0x7f4f80112be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:54:52.686 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.685+0000 7f4f85f06700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f801028f0 0x7f4f80112be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.190:37326/0 (socket says 172.21.15.190:37326) 2023-12-06T14:54:52.686 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.685+0000 7f4f85f06700 1 -- 172.21.15.190:0/1221505361 learned_addr learned my addr 172.21.15.190:0/1221505361 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-12-06T14:54:52.686 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.685+0000 7f4f85f06700 1 -- 172.21.15.190:0/1221505361 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f7c005040 con 0x7f4f801028f0 2023-12-06T14:54:52.686 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.686+0000 7f4f85f06700 1 --2- 172.21.15.190:0/1221505361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f801028f0 0x7f4f80112be0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c009300 tx=0x7f4f7c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:54:52.686 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.686+0000 7f4f767fc700 1 -- 172.21.15.190:0/1221505361 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4f7c004e60 con 0x7f4f801028f0 2023-12-06T14:54:52.686 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.686+0000 7f4f8816a700 1 -- 172.21.15.190:0/1221505361 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f80113320 con 0x7f4f801028f0 2023-12-06T14:54:52.686 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.686+0000 7f4f767fc700 1 -- 172.21.15.190:0/1221505361 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4f7c013420 con 0x7f4f801028f0 2023-12-06T14:54:52.686 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.686+0000 7f4f767fc700 1 -- 172.21.15.190:0/1221505361 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4f7c01c5b0 con 0x7f4f801028f0 2023-12-06T14:54:52.686 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.686+0000 7f4f8816a700 1 -- 172.21.15.190:0/1221505361 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f80113790 con 0x7f4f801028f0 2023-12-06T14:54:52.686 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.687+0000 7f4f767fc700 1 -- 172.21.15.190:0/1221505361 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) v1 ==== 43396+0+0 (secure 0 0 0) 0x7f4f7c01c7f0 con 0x7f4f801028f0 2023-12-06T14:54:52.687 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.687+0000 7f4f767fc700 1 --2- 172.21.15.190:0/1221505361 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f4f6c0367c0 0x7f4f6c038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:52.687 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.687+0000 7f4f767fc700 1 -- 172.21.15.190:0/1221505361 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f4f7c049960 con 0x7f4f801028f0 2023-12-06T14:54:52.687 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.687+0000 7f4f8816a700 1 -- 172.21.15.190:0/1221505361 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f8005f270 con 0x7f4f801028f0 2023-12-06T14:54:52.687 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.687+0000 7f4f85705700 1 --2- 172.21.15.190:0/1221505361 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f4f6c0367c0 0x7f4f6c038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:54:52.688 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.687+0000 7f4f85705700 1 --2- 172.21.15.190:0/1221505361 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f4f6c0367c0 0x7f4f6c038c70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4f70009990 tx=0x7f4f70006e40 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:54:52.691 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.692+0000 7f4f767fc700 1 -- 172.21.15.190:0/1221505361 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4f7c023300 con 0x7f4f801028f0 2023-12-06T14:54:52.980 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.980+0000 7f4f8816a700 1 -- 172.21.15.190:0/1221505361 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4f80106b80 con 0x7f4f801028f0 2023-12-06T14:54:52.980 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.981+0000 7f4f767fc700 1 -- 172.21.15.190:0/1221505361 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f4f7c011b60 con 0x7f4f801028f0 2023-12-06T14:54:52.980 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:54:52.981 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":1,"fsid":"062f0e3c-9447-11ee-95a2-87774f69a715","modified":"2023-12-06T14:52:59.570400Z","created":"2023-12-06T14:52:59.570400Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi152","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-06T14:54:52.983 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.984+0000 7f4f8816a700 1 -- 172.21.15.190:0/1221505361 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f4f6c0367c0 msgr2=0x7f4f6c038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:52.984 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.984+0000 7f4f8816a700 1 --2- 172.21.15.190:0/1221505361 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f4f6c0367c0 0x7f4f6c038c70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4f70009990 tx=0x7f4f70006e40 comp rx=0 tx=0).stop 2023-12-06T14:54:52.984 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.984+0000 7f4f8816a700 1 -- 172.21.15.190:0/1221505361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f801028f0 msgr2=0x7f4f80112be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:52.984 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.984+0000 7f4f8816a700 1 --2- 172.21.15.190:0/1221505361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f801028f0 0x7f4f80112be0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c009300 tx=0x7f4f7c009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:52.984 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.984+0000 7f4f8816a700 1 -- 172.21.15.190:0/1221505361 shutdown_connections 2023-12-06T14:54:52.984 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.984+0000 7f4f8816a700 1 --2- 172.21.15.190:0/1221505361 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f4f6c0367c0 0x7f4f6c038c70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:52.984 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.984+0000 7f4f8816a700 1 --2- 172.21.15.190:0/1221505361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f801028f0 0x7f4f80112be0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:52.984 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.984+0000 7f4f8816a700 1 -- 172.21.15.190:0/1221505361 >> 172.21.15.190:0/1221505361 conn(0x7f4f80071d60 msgr2=0x7f4f80103eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:52.984 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.984+0000 7f4f8816a700 1 -- 172.21.15.190:0/1221505361 shutdown_connections 2023-12-06T14:54:52.984 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:52.984+0000 7f4f8816a700 1 -- 172.21.15.190:0/1221505361 wait complete. 2023-12-06T14:54:52.984 INFO:teuthology.orchestra.run.smithi190.stderr:dumped monmap epoch 1 2023-12-06T14:54:53.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:53 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:53.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:53 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:53.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:53 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:53.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:53 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:53.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:53 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi190.ubusrr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-06T14:54:53.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:53 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi190.ubusrr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-06T14:54:53.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:53 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-06T14:54:53.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:53 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:54:53.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:53 smithi152 ceph-mon[111954]: Deploying daemon mgr.smithi190.ubusrr on smithi190 2023-12-06T14:54:53.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:53 smithi152 ceph-mon[111954]: from='client.? 172.21.15.190:0/1221505361' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-06T14:54:54.622 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-06T14:54:54.623 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-06T14:54:54.922 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-06T14:54:55.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:55 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:55.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:55 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:55.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:55 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:55.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:55 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:55.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:55 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-06T14:54:55.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:55 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:54:55.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:55 smithi152 ceph-mon[111954]: Deploying daemon mon.smithi190 on smithi190 2023-12-06T14:54:56.226 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.225+0000 7f685406e700 1 -- 172.21.15.190:0/3542240415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f684c1028f0 msgr2=0x7f684c102cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:56.226 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.225+0000 7f685406e700 1 --2- 172.21.15.190:0/3542240415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f684c1028f0 0x7f684c102cc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f68480048c0 tx=0x7f6848009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:56.226 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.225+0000 7f685406e700 1 -- 172.21.15.190:0/3542240415 shutdown_connections 2023-12-06T14:54:56.226 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.225+0000 7f685406e700 1 --2- 172.21.15.190:0/3542240415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f684c1028f0 0x7f684c102cc0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:56.226 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.225+0000 7f685406e700 1 -- 172.21.15.190:0/3542240415 >> 172.21.15.190:0/3542240415 conn(0x7f684c0715e0 msgr2=0x7f684c0719e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:56.227 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.225+0000 7f685406e700 1 -- 172.21.15.190:0/3542240415 shutdown_connections 2023-12-06T14:54:56.227 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.225+0000 7f685406e700 1 -- 172.21.15.190:0/3542240415 wait complete. 2023-12-06T14:54:56.227 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.226+0000 7f685406e700 1 Processor -- start 2023-12-06T14:54:56.227 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.226+0000 7f685406e700 1 -- start start 2023-12-06T14:54:56.227 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.226+0000 7f685406e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f684c1028f0 0x7f684c0fb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:56.227 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.226+0000 7f685406e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684c0fbd20 con 0x7f684c1028f0 2023-12-06T14:54:56.227 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.226+0000 7f6851e0a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f684c1028f0 0x7f684c0fb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:54:56.227 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.226+0000 7f6851e0a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f684c1028f0 0x7f684c0fb7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.190:37372/0 (socket says 172.21.15.190:37372) 2023-12-06T14:54:56.227 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.226+0000 7f6851e0a700 1 -- 172.21.15.190:0/1576818601 learned_addr learned my addr 172.21.15.190:0/1576818601 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-12-06T14:54:56.227 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.227+0000 7f6851e0a700 1 -- 172.21.15.190:0/1576818601 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6848005040 con 0x7f684c1028f0 2023-12-06T14:54:56.227 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.227+0000 7f6851e0a700 1 --2- 172.21.15.190:0/1576818601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f684c1028f0 0x7f684c0fb7e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6848009300 tx=0x7f6848009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:54:56.227 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.227+0000 7f68427fc700 1 -- 172.21.15.190:0/1576818601 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6848004e60 con 0x7f684c1028f0 2023-12-06T14:54:56.227 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.227+0000 7f685406e700 1 -- 172.21.15.190:0/1576818601 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f684c0fbf20 con 0x7f684c1028f0 2023-12-06T14:54:56.228 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.227+0000 7f68427fc700 1 -- 172.21.15.190:0/1576818601 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6848013420 con 0x7f684c1028f0 2023-12-06T14:54:56.228 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.227+0000 7f68427fc700 1 -- 172.21.15.190:0/1576818601 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f684801c5b0 con 0x7f684c1028f0 2023-12-06T14:54:56.228 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.227+0000 7f685406e700 1 -- 172.21.15.190:0/1576818601 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f684c0fc410 con 0x7f684c1028f0 2023-12-06T14:54:56.228 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.228+0000 7f685406e700 1 -- 172.21.15.190:0/1576818601 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f684c101b60 con 0x7f684c1028f0 2023-12-06T14:54:56.228 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.228+0000 7f68427fc700 1 -- 172.21.15.190:0/1576818601 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 17) v1 ==== 43396+0+0 (secure 0 0 0) 0x7f6848009600 con 0x7f684c1028f0 2023-12-06T14:54:56.229 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.228+0000 7f68427fc700 1 --2- 172.21.15.190:0/1576818601 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f68380367c0 0x7f6838038c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:54:56.229 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.228+0000 7f68427fc700 1 -- 172.21.15.190:0/1576818601 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f6848049950 con 0x7f684c1028f0 2023-12-06T14:54:56.229 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.228+0000 7f6851609700 1 --2- 172.21.15.190:0/1576818601 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f68380367c0 0x7f6838038c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:54:56.229 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.229+0000 7f6851609700 1 --2- 172.21.15.190:0/1576818601 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f68380367c0 0x7f6838038c70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f683c009990 tx=0x7f683c006e40 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:54:56.232 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.233+0000 7f68427fc700 1 -- 172.21.15.190:0/1576818601 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6848025400 con 0x7f684c1028f0 2023-12-06T14:54:56.520 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.521+0000 7f685406e700 1 -- 172.21.15.190:0/1576818601 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f684c04bbb0 con 0x7f684c1028f0 2023-12-06T14:54:56.520 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.521+0000 7f68427fc700 1 -- 172.21.15.190:0/1576818601 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f6848011370 con 0x7f684c1028f0 2023-12-06T14:54:56.521 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:54:56.521 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":1,"fsid":"062f0e3c-9447-11ee-95a2-87774f69a715","modified":"2023-12-06T14:52:59.570400Z","created":"2023-12-06T14:52:59.570400Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi152","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-06T14:54:56.523 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.523+0000 7f685406e700 1 -- 172.21.15.190:0/1576818601 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f68380367c0 msgr2=0x7f6838038c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:56.523 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.523+0000 7f685406e700 1 --2- 172.21.15.190:0/1576818601 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f68380367c0 0x7f6838038c70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f683c009990 tx=0x7f683c006e40 comp rx=0 tx=0).stop 2023-12-06T14:54:56.523 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.523+0000 7f685406e700 1 -- 172.21.15.190:0/1576818601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f684c1028f0 msgr2=0x7f684c0fb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:54:56.523 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.523+0000 7f685406e700 1 --2- 172.21.15.190:0/1576818601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f684c1028f0 0x7f684c0fb7e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6848009300 tx=0x7f6848009e30 comp rx=0 tx=0).stop 2023-12-06T14:54:56.523 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.523+0000 7f685406e700 1 -- 172.21.15.190:0/1576818601 shutdown_connections 2023-12-06T14:54:56.523 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.523+0000 7f685406e700 1 --2- 172.21.15.190:0/1576818601 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f68380367c0 0x7f6838038c70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:56.523 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.523+0000 7f685406e700 1 --2- 172.21.15.190:0/1576818601 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f684c1028f0 0x7f684c0fb7e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:54:56.523 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.523+0000 7f685406e700 1 -- 172.21.15.190:0/1576818601 >> 172.21.15.190:0/1576818601 conn(0x7f684c0715e0 msgr2=0x7f684c103ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:54:56.523 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.523+0000 7f685406e700 1 -- 172.21.15.190:0/1576818601 shutdown_connections 2023-12-06T14:54:56.523 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:54:56.523+0000 7f685406e700 1 -- 172.21.15.190:0/1576818601 wait complete. 2023-12-06T14:54:56.524 INFO:teuthology.orchestra.run.smithi190.stderr:dumped monmap epoch 1 2023-12-06T14:54:56.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:56 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:54:56.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:56 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:56.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:54:56 smithi152 ceph-mon[111954]: from='client.? 172.21.15.190:0/1576818601' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-06T14:54:57.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 systemd[1]: Started Ceph mon.smithi190 for 062f0e3c-9447-11ee-95a2-87774f69a715. 2023-12-06T14:54:57.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: mon.smithi190@-1(???) e0 preinit fsid 062f0e3c-9447-11ee-95a2-87774f69a715 2023-12-06T14:54:57.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: mon.smithi190@-1(synchronizing).mds e1 new map 2023-12-06T14:54:57.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: mon.smithi190@-1(synchronizing).mds e1 print_map 2023-12-06T14:54:57.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: e1 2023-12-06T14:54:57.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-06T14:54:57.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-06T14:54:57.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: legacy client fscid: -1 2023-12-06T14:54:57.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: 2023-12-06T14:54:57.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: No filesystems configured 2023-12-06T14:54:57.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: mon.smithi190@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-12-06T14:54:57.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: mon.smithi190@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-12-06T14:54:57.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: mon.smithi190@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-12-06T14:54:57.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: mon.smithi190@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-12-06T14:54:57.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: mon.smithi190@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-12-06T14:54:57.574 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: mon.smithi190@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-12-06T14:54:57.574 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: mon.smithi190@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2023-12-06T14:54:57.574 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: mon.smithi190@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-06T14:54:57.574 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: mon.smithi190@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-06T14:54:57.574 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: mon.smithi190@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-06T14:54:57.574 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: mon.smithi190@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2023-12-06T14:54:57.574 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/3895904583' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-12-06T14:54:57.574 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: osdmap e4: 0 total, 0 up, 0 in 2023-12-06T14:54:57.574 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:54:57.574 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.574 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.574 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.574 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.575 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.575 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.575 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-06T14:54:57.575 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-06T14:54:57.575 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.575 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: Deploying daemon grafana.smithi152 on smithi152 2023-12-06T14:54:57.575 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi152:172.21.15.152=smithi152;smithi190:172.21.15.190=smithi190", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:54:57.575 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: Saving service mon spec with placement smithi152:172.21.15.152=smithi152;smithi190:172.21.15.190=smithi190;count:2 2023-12-06T14:54:57.575 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.575 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:54:57.575 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.575 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='client.? 172.21.15.190:0/158295247' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-06T14:54:57.575 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:54:57.575 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='client.? 172.21.15.190:0/1118603909' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-06T14:54:57.575 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:54:57.575 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:54:57.576 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='client.? 172.21.15.190:0/40224383' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-06T14:54:57.576 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:54:57.576 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.576 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.576 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.576 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.576 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.576 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.576 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: Deploying daemon prometheus.smithi152 on smithi152 2023-12-06T14:54:57.576 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='client.? 172.21.15.190:0/1810013451' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-06T14:54:57.576 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:54:57.576 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.576 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:54:57.576 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='client.? 172.21.15.190:0/1232527006' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-06T14:54:57.576 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:54:57.577 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='client.? 172.21.15.190:0/1977145732' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-06T14:54:57.577 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:54:57.577 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:54:57.577 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.577 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.577 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.578 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2023-12-06T14:54:57.578 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='client.? 172.21.15.190:0/1502302618' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-06T14:54:57.578 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14162 172.21.15.152:0/2910042497' entity='mgr.smithi152.meodco' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2023-12-06T14:54:57.578 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: mgrmap e14: smithi152.meodco(active, since 43s) 2023-12-06T14:54:57.578 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='client.? 172.21.15.190:0/504607555' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-06T14:54:57.579 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='client.? 172.21.15.190:0/1463120920' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-06T14:54:57.579 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: Active manager daemon smithi152.meodco restarted 2023-12-06T14:54:57.579 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: Activating manager daemon smithi152.meodco 2023-12-06T14:54:57.579 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: osdmap e5: 0 total, 0 up, 0 in 2023-12-06T14:54:57.579 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: mgrmap e15: smithi152.meodco(active, starting, since 0.00364593s) 2023-12-06T14:54:57.579 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-06T14:54:57.579 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mgr metadata", "who": "smithi152.meodco", "id": "smithi152.meodco"}]: dispatch 2023-12-06T14:54:57.579 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-06T14:54:57.579 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-06T14:54:57.579 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-06T14:54:57.579 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: Manager daemon smithi152.meodco is now available 2023-12-06T14:54:57.579 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:54:57.579 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:54:57.580 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.580 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:54:57.580 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.meodco/mirror_snapshot_schedule"}]: dispatch 2023-12-06T14:54:57.580 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.meodco/trash_purge_schedule"}]: dispatch 2023-12-06T14:54:57.580 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.580 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.580 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: mgrmap e16: smithi152.meodco(active, since 1.00476s) 2023-12-06T14:54:57.580 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: [06/Dec/2023:14:54:41] ENGINE Bus STARTING 2023-12-06T14:54:57.580 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: [06/Dec/2023:14:54:41] ENGINE Serving on https://172.21.15.152:7150 2023-12-06T14:54:57.580 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: [06/Dec/2023:14:54:41] ENGINE Bus STARTED 2023-12-06T14:54:57.580 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.580 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='client.? 172.21.15.190:0/1427366293' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-06T14:54:57.580 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.580 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: mgrmap e17: smithi152.meodco(active, since 2s) 2023-12-06T14:54:57.581 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.581 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.581 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.581 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.581 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "who": "osd/host:smithi152", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:54:57.581 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.581 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.581 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.581 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.581 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "who": "osd/host:smithi190", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:54:57.581 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:54:57.581 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:54:57.581 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: Updating smithi152:/etc/ceph/ceph.conf 2023-12-06T14:54:57.581 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: Updating smithi190:/etc/ceph/ceph.conf 2023-12-06T14:54:57.581 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: Updating smithi152:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-06T14:54:57.582 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: Updating smithi190:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-06T14:54:57.582 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='client.? 172.21.15.190:0/3634973520' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-06T14:54:57.582 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2023-12-06T14:54:57.582 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: Updating smithi190:/etc/ceph/ceph.client.admin.keyring 2023-12-06T14:54:57.582 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: Updating smithi152:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-06T14:54:57.582 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: Updating smithi190:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-06T14:54:57.582 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.582 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.582 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.582 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.582 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.582 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi190", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-06T14:54:57.582 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi190", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-06T14:54:57.583 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:54:57.583 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: Deploying daemon crash.smithi190 on smithi190 2023-12-06T14:54:57.583 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.583 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.583 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.583 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.583 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: Deploying daemon node-exporter.smithi190 on smithi190 2023-12-06T14:54:57.583 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='client.? 172.21.15.190:0/4122014544' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-06T14:54:57.583 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.584 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.584 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.584 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.584 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.584 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi190.ubusrr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-06T14:54:57.584 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi190.ubusrr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-06T14:54:57.584 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-06T14:54:57.584 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:54:57.584 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: Deploying daemon mgr.smithi190.ubusrr on smithi190 2023-12-06T14:54:57.584 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='client.? 172.21.15.190:0/1221505361' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-06T14:54:57.584 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.584 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.584 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.584 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.584 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-06T14:54:57.585 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:54:57.585 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: Deploying daemon mon.smithi190 on smithi190 2023-12-06T14:54:57.585 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:54:57.585 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:54:57.585 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: from='client.? 172.21.15.190:0/1576818601' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-06T14:54:57.585 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: mon.smithi190@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2023-12-06T14:54:57.585 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:54:57 smithi190 ceph-mon[121340]: mon.smithi190@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2023-12-06T14:54:57.971 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2023-12-06T14:54:57.971 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-06T14:54:58.250 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi190/config 2023-12-06T14:55:02.477 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.474+0000 7f7fa5ef2700 1 -- 172.21.15.190:0/1869009506 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f88003580 msgr2=0x7f7f88005a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:55:02.478 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.474+0000 7f7fa5ef2700 1 --2- 172.21.15.190:0/1869009506 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f88003580 0x7f7f88005a00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0073770 tx=0x7f7f9000b040 comp rx=0 tx=0).stop 2023-12-06T14:55:02.478 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.475+0000 7f7fa5ef2700 1 -- 172.21.15.190:0/1869009506 shutdown_connections 2023-12-06T14:55:02.478 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.475+0000 7f7fa5ef2700 1 --2- 172.21.15.190:0/1869009506 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f88003580 0x7f7f88005a00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:55:02.478 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.475+0000 7f7fa5ef2700 1 -- 172.21.15.190:0/1869009506 >> 172.21.15.190:0/1869009506 conn(0x7f7fa0071760 msgr2=0x7f7fa0071b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:55:02.478 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.475+0000 7f7fa5ef2700 1 -- 172.21.15.190:0/1869009506 shutdown_connections 2023-12-06T14:55:02.478 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.475+0000 7f7fa5ef2700 1 -- 172.21.15.190:0/1869009506 wait complete. 2023-12-06T14:55:02.478 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.475+0000 7f7fa5ef2700 1 Processor -- start 2023-12-06T14:55:02.478 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.475+0000 7f7fa5ef2700 1 -- start start 2023-12-06T14:55:02.478 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.476+0000 7f7fa5ef2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f88003580 0x7f7fa0112be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:55:02.478 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.476+0000 7f7fa5ef2700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fa0113120 0x7f7fa010caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:55:02.478 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.476+0000 7f7fa5ef2700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa01136e0 con 0x7f7f88003580 2023-12-06T14:55:02.478 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.476+0000 7f7fa5ef2700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa010cfe0 con 0x7f7fa0113120 2023-12-06T14:55:02.478 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.476+0000 7f7f9f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f88003580 0x7f7fa0112be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:55:02.478 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.476+0000 7f7f9f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f88003580 0x7f7fa0112be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.190:37394/0 (socket says 172.21.15.190:37394) 2023-12-06T14:55:02.479 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.476+0000 7f7f9effd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fa0113120 0x7f7fa010caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:55:02.479 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.476+0000 7f7f9f7fe700 1 -- 172.21.15.190:0/833729125 learned_addr learned my addr 172.21.15.190:0/833729125 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-12-06T14:55:02.479 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.476+0000 7f7f9effd700 1 -- 172.21.15.190:0/833729125 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fa0113120 msgr2=0x7f7fa010caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-12-06T14:55:02.479 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.476+0000 7f7f9effd700 1 -- 172.21.15.190:0/833729125 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fa0113120 msgr2=0x7f7fa010caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-06T14:55:02.479 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.476+0000 7f7f9effd700 1 --2- 172.21.15.190:0/833729125 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fa0113120 0x7f7fa010caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-12-06T14:55:02.479 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.476+0000 7f7f9effd700 1 --2- 172.21.15.190:0/833729125 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fa0113120 0x7f7fa010caa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-06T14:55:02.479 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.477+0000 7f7f9f7fe700 1 -- 172.21.15.190:0/833729125 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fa0113120 msgr2=0x7f7fa010caa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-06T14:55:02.479 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.477+0000 7f7f9f7fe700 1 --2- 172.21.15.190:0/833729125 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fa0113120 0x7f7fa010caa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:55:02.479 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.477+0000 7f7f9f7fe700 1 -- 172.21.15.190:0/833729125 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f90005040 con 0x7f7f88003580 2023-12-06T14:55:02.479 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.477+0000 7f7f9f7fe700 1 --2- 172.21.15.190:0/833729125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f88003580 0x7f7fa0112be0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7f900158b0 tx=0x7f7f9000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:55:02.479 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.477+0000 7f7f87fff700 1 -- 172.21.15.190:0/833729125 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f90015ee0 con 0x7f7f88003580 2023-12-06T14:55:02.479 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.477+0000 7f7f87fff700 1 -- 172.21.15.190:0/833729125 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7f900095c0 con 0x7f7f88003580 2023-12-06T14:55:02.479 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.477+0000 7f7fa5ef2700 1 -- 172.21.15.190:0/833729125 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fa010d260 con 0x7f7f88003580 2023-12-06T14:55:02.479 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.477+0000 7f7f87fff700 1 -- 172.21.15.190:0/833729125 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f90020cf0 con 0x7f7f88003580 2023-12-06T14:55:02.480 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.477+0000 7f7fa5ef2700 1 -- 172.21.15.190:0/833729125 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa010d7a0 con 0x7f7f88003580 2023-12-06T14:55:02.480 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.478+0000 7f7fa5ef2700 1 -- 172.21.15.190:0/833729125 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa005f270 con 0x7f7f88003580 2023-12-06T14:55:02.480 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.478+0000 7f7f87fff700 1 -- 172.21.15.190:0/833729125 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 86393+0+0 (secure 0 0 0) 0x7f7f9001e070 con 0x7f7f88003580 2023-12-06T14:55:02.480 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.479+0000 7f7f87fff700 1 --2- 172.21.15.190:0/833729125 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f7f8c069020 0x7f7f8c06b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:55:02.481 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.479+0000 7f7f87fff700 1 -- 172.21.15.190:0/833729125 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f7f9001c070 con 0x7f7f88003580 2023-12-06T14:55:02.481 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.479+0000 7f7f9effd700 1 --2- 172.21.15.190:0/833729125 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f7f8c069020 0x7f7f8c06b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:55:02.481 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.479+0000 7f7f9effd700 1 --2- 172.21.15.190:0/833729125 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f7f8c069020 0x7f7f8c06b4d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7f94006f30 tx=0x7f7f94008040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:55:02.483 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.483+0000 7f7f87fff700 1 -- 172.21.15.190:0/833729125 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7f900580a0 con 0x7f7f88003580 2023-12-06T14:55:02.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:02 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-06T14:55:02.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:02 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi190"}]: dispatch 2023-12-06T14:55:02.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:02 smithi152 ceph-mon[111954]: mon.smithi152 calling monitor election 2023-12-06T14:55:02.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:02 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi190"}]: dispatch 2023-12-06T14:55:02.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:02 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi190"}]: dispatch 2023-12-06T14:55:02.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:02 smithi152 ceph-mon[111954]: mon.smithi190 calling monitor election 2023-12-06T14:55:02.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:02 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi190"}]: dispatch 2023-12-06T14:55:02.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:02 smithi152 ceph-mon[111954]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:55:02.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:02 smithi152 ceph-mon[111954]: from='mgr.? 172.21.15.190:0/1484905562' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi190.ubusrr/crt"}]: dispatch 2023-12-06T14:55:02.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:02 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi190"}]: dispatch 2023-12-06T14:55:02.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:02 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi190"}]: dispatch 2023-12-06T14:55:02.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:02 smithi152 ceph-mon[111954]: mon.smithi152 is new leader, mons smithi152,smithi190 in quorum (ranks 0,1) 2023-12-06T14:55:02.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:02 smithi152 ceph-mon[111954]: monmap e2: 2 mons at {smithi152=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0],smithi190=[v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-06T14:55:02.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:02 smithi152 ceph-mon[111954]: fsmap 2023-12-06T14:55:02.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:02 smithi152 ceph-mon[111954]: osdmap e5: 0 total, 0 up, 0 in 2023-12-06T14:55:02.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:02 smithi152 ceph-mon[111954]: mgrmap e17: smithi152.meodco(active, since 21s) 2023-12-06T14:55:02.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:02 smithi152 ceph-mon[111954]: Standby manager daemon smithi190.ubusrr started 2023-12-06T14:55:02.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:02 smithi152 ceph-mon[111954]: from='mgr.? 172.21.15.190:0/1484905562' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-06T14:55:02.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:02 smithi152 ceph-mon[111954]: overall HEALTH_OK 2023-12-06T14:55:02.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:02 smithi152 ceph-mon[111954]: from='mgr.? 172.21.15.190:0/1484905562' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi190.ubusrr/key"}]: dispatch 2023-12-06T14:55:02.630 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:02 smithi152 ceph-mon[111954]: from='mgr.? 172.21.15.190:0/1484905562' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-06T14:55:02.630 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:02 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:02.630 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:02 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:02.754 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.753+0000 7f7fa5ef2700 1 -- 172.21.15.190:0/833729125 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7fa010e1c0 con 0x7f7f88003580 2023-12-06T14:55:02.754 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.754+0000 7f7f87fff700 1 -- 172.21.15.190:0/833729125 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1021 (secure 0 0 0) 0x7f7f90086810 con 0x7f7f88003580 2023-12-06T14:55:02.754 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-06T14:55:02.757 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":2,"fsid":"062f0e3c-9447-11ee-95a2-87774f69a715","modified":"2023-12-06T14:54:57.254208Z","created":"2023-12-06T14:52:59.570400Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi152","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi190","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:3300","nonce":0},{"type":"v1","addr":"172.21.15.190:6789","nonce":0}]},"addr":"172.21.15.190:6789/0","public_addr":"172.21.15.190:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-12-06T14:55:02.758 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.756+0000 7f7fa5ef2700 1 -- 172.21.15.190:0/833729125 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f7f8c069020 msgr2=0x7f7f8c06b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:55:02.758 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.756+0000 7f7fa5ef2700 1 --2- 172.21.15.190:0/833729125 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f7f8c069020 0x7f7f8c06b4d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7f94006f30 tx=0x7f7f94008040 comp rx=0 tx=0).stop 2023-12-06T14:55:02.758 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.756+0000 7f7fa5ef2700 1 -- 172.21.15.190:0/833729125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f88003580 msgr2=0x7f7fa0112be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:55:02.758 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.756+0000 7f7fa5ef2700 1 --2- 172.21.15.190:0/833729125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f88003580 0x7f7fa0112be0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7f900158b0 tx=0x7f7f9000b040 comp rx=0 tx=0).stop 2023-12-06T14:55:02.758 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.756+0000 7f7fa5ef2700 1 -- 172.21.15.190:0/833729125 shutdown_connections 2023-12-06T14:55:02.758 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.756+0000 7f7fa5ef2700 1 --2- 172.21.15.190:0/833729125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f88003580 0x7f7fa0112be0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:55:02.758 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.756+0000 7f7fa5ef2700 1 --2- 172.21.15.190:0/833729125 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f7f8c069020 0x7f7f8c06b4d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:55:02.758 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.756+0000 7f7fa5ef2700 1 --2- 172.21.15.190:0/833729125 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fa0113120 0x7f7fa010caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:55:02.758 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.756+0000 7f7fa5ef2700 1 -- 172.21.15.190:0/833729125 >> 172.21.15.190:0/833729125 conn(0x7f7fa0071760 msgr2=0x7f7fa0105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:55:02.758 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.756+0000 7f7fa5ef2700 1 -- 172.21.15.190:0/833729125 shutdown_connections 2023-12-06T14:55:02.758 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:55:02.756+0000 7f7fa5ef2700 1 -- 172.21.15.190:0/833729125 wait complete. 2023-12-06T14:55:02.758 INFO:teuthology.orchestra.run.smithi190.stderr:dumped monmap epoch 2 2023-12-06T14:55:02.781 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:02 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-06T14:55:02.781 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:02 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi190"}]: dispatch 2023-12-06T14:55:02.781 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:02 smithi190 ceph-mon[121340]: mon.smithi152 calling monitor election 2023-12-06T14:55:02.781 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:02 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi190"}]: dispatch 2023-12-06T14:55:02.781 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:02 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi190"}]: dispatch 2023-12-06T14:55:02.782 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:02 smithi190 ceph-mon[121340]: mon.smithi190 calling monitor election 2023-12-06T14:55:02.782 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:02 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi190"}]: dispatch 2023-12-06T14:55:02.782 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:02 smithi190 ceph-mon[121340]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:55:02.782 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:02 smithi190 ceph-mon[121340]: from='mgr.? 172.21.15.190:0/1484905562' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi190.ubusrr/crt"}]: dispatch 2023-12-06T14:55:02.782 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:02 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi190"}]: dispatch 2023-12-06T14:55:02.782 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:02 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi190"}]: dispatch 2023-12-06T14:55:02.782 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:02 smithi190 ceph-mon[121340]: mon.smithi152 is new leader, mons smithi152,smithi190 in quorum (ranks 0,1) 2023-12-06T14:55:02.782 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:02 smithi190 ceph-mon[121340]: monmap e2: 2 mons at {smithi152=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0],smithi190=[v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-06T14:55:02.782 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:02 smithi190 ceph-mon[121340]: fsmap 2023-12-06T14:55:02.782 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:02 smithi190 ceph-mon[121340]: osdmap e5: 0 total, 0 up, 0 in 2023-12-06T14:55:02.782 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:02 smithi190 ceph-mon[121340]: mgrmap e17: smithi152.meodco(active, since 21s) 2023-12-06T14:55:02.782 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:02 smithi190 ceph-mon[121340]: Standby manager daemon smithi190.ubusrr started 2023-12-06T14:55:02.782 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:02 smithi190 ceph-mon[121340]: from='mgr.? 172.21.15.190:0/1484905562' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-06T14:55:02.783 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:02 smithi190 ceph-mon[121340]: overall HEALTH_OK 2023-12-06T14:55:02.783 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:02 smithi190 ceph-mon[121340]: from='mgr.? 172.21.15.190:0/1484905562' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi190.ubusrr/key"}]: dispatch 2023-12-06T14:55:02.783 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:02 smithi190 ceph-mon[121340]: from='mgr.? 172.21.15.190:0/1484905562' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-06T14:55:02.783 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:02 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:02.783 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:02 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:03.156 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-12-06T14:55:03.157 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph config generate-minimal-conf 2023-12-06T14:55:03.429 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:55:03.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:03 smithi152 ceph-mon[111954]: mgrmap e18: smithi152.meodco(active, since 21s), standbys: smithi190.ubusrr 2023-12-06T14:55:03.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:03 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mgr metadata", "who": "smithi190.ubusrr", "id": "smithi190.ubusrr"}]: dispatch 2023-12-06T14:55:03.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:03 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:03.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:03 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:03.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:03 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:03.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:03 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:55:03.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:03 smithi152 ceph-mon[111954]: from='client.? 172.21.15.190:0/833729125' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-06T14:55:03.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:03 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi190"}]: dispatch 2023-12-06T14:55:03.723 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:03 smithi190 ceph-mon[121340]: mgrmap e18: smithi152.meodco(active, since 21s), standbys: smithi190.ubusrr 2023-12-06T14:55:03.724 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:03 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mgr metadata", "who": "smithi190.ubusrr", "id": "smithi190.ubusrr"}]: dispatch 2023-12-06T14:55:03.724 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:03 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:03.724 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:03 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:03.724 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:03 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:03.724 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:03 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:55:03.724 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:03 smithi190 ceph-mon[121340]: from='client.? 172.21.15.190:0/833729125' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-06T14:55:03.724 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:03 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi190"}]: dispatch 2023-12-06T14:55:04.478 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:04 smithi152 ceph-mon[111954]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:55:04.478 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:04 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:04.478 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:04 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:04.478 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:04 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:55:04.479 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:04 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:55:04.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:04 smithi190 ceph-mon[121340]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:55:04.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:04 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:04.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:04 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:04.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:04 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:55:04.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:04 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:55:05.243 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.243+0000 7ffba6215700 1 -- 172.21.15.152:0/4034065042 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffba01028f0 msgr2=0x7ffba0102cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:55:05.244 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.243+0000 7ffba6215700 1 --2- 172.21.15.152:0/4034065042 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffba01028f0 0x7ffba0102cc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ffb900048c0 tx=0x7ffb90009e30 comp rx=0 tx=0).stop 2023-12-06T14:55:05.244 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.243+0000 7ffba6215700 1 -- 172.21.15.152:0/4034065042 shutdown_connections 2023-12-06T14:55:05.244 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.243+0000 7ffba6215700 1 --2- 172.21.15.152:0/4034065042 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffba01028f0 0x7ffba0102cc0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:55:05.244 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.243+0000 7ffba6215700 1 -- 172.21.15.152:0/4034065042 >> 172.21.15.152:0/4034065042 conn(0x7ffba00715e0 msgr2=0x7ffba00719e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:55:05.244 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.244+0000 7ffba6215700 1 -- 172.21.15.152:0/4034065042 shutdown_connections 2023-12-06T14:55:05.244 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.244+0000 7ffba6215700 1 -- 172.21.15.152:0/4034065042 wait complete. 2023-12-06T14:55:05.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.244+0000 7ffba6215700 1 Processor -- start 2023-12-06T14:55:05.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.244+0000 7ffba6215700 1 -- start start 2023-12-06T14:55:05.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.245+0000 7ffba6215700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffba01028f0 0x7ffba0112ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:55:05.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.245+0000 7ffba6215700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffba01131e0 0x7ffba010cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:55:05.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.245+0000 7ffba6215700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba01137f0 con 0x7ffba01028f0 2023-12-06T14:55:05.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.245+0000 7ffba6215700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba010d080 con 0x7ffba01131e0 2023-12-06T14:55:05.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.245+0000 7ffb9f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffba01028f0 0x7ffba0112ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:55:05.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.245+0000 7ffb9f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffba01028f0 0x7ffba0112ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34568/0 (socket says 172.21.15.152:34568) 2023-12-06T14:55:05.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.245+0000 7ffb9f7fe700 1 -- 172.21.15.152:0/229580591 learned_addr learned my addr 172.21.15.152:0/229580591 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:55:05.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.245+0000 7ffb9f7fe700 1 -- 172.21.15.152:0/229580591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffba01131e0 msgr2=0x7ffba010cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:55:05.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.245+0000 7ffb9effd700 1 --2- 172.21.15.152:0/229580591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffba01131e0 0x7ffba010cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:55:05.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.245+0000 7ffb9f7fe700 1 --2- 172.21.15.152:0/229580591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffba01131e0 0x7ffba010cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:55:05.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.245+0000 7ffb9f7fe700 1 -- 172.21.15.152:0/229580591 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb90005040 con 0x7ffba01028f0 2023-12-06T14:55:05.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.245+0000 7ffb9effd700 1 --2- 172.21.15.152:0/229580591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffba01131e0 0x7ffba010cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-06T14:55:05.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.245+0000 7ffb9f7fe700 1 --2- 172.21.15.152:0/229580591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffba01028f0 0x7ffba0112ca0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ffb9000bfe0 tx=0x7ffb90009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:55:05.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.245+0000 7ffb87fff700 1 -- 172.21.15.152:0/229580591 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb9000e040 con 0x7ffba01028f0 2023-12-06T14:55:05.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.245+0000 7ffba6215700 1 -- 172.21.15.152:0/229580591 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffba010d300 con 0x7ffba01028f0 2023-12-06T14:55:05.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.245+0000 7ffb87fff700 1 -- 172.21.15.152:0/229580591 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffb90013420 con 0x7ffba01028f0 2023-12-06T14:55:05.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.245+0000 7ffb87fff700 1 -- 172.21.15.152:0/229580591 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb9001c630 con 0x7ffba01028f0 2023-12-06T14:55:05.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.245+0000 7ffba6215700 1 -- 172.21.15.152:0/229580591 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffba010d8c0 con 0x7ffba01028f0 2023-12-06T14:55:05.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.247+0000 7ffba6215700 1 -- 172.21.15.152:0/229580591 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffba005f270 con 0x7ffba01028f0 2023-12-06T14:55:05.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.247+0000 7ffb87fff700 1 -- 172.21.15.152:0/229580591 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 86393+0+0 (secure 0 0 0) 0x7ffb900139e0 con 0x7ffba01028f0 2023-12-06T14:55:05.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.247+0000 7ffb87fff700 1 --2- 172.21.15.152:0/229580591 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7ffb88069030 0x7ffb8806b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:55:05.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.247+0000 7ffb87fff700 1 -- 172.21.15.152:0/229580591 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7ffb90087010 con 0x7ffba01028f0 2023-12-06T14:55:05.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.247+0000 7ffb9effd700 1 --2- 172.21.15.152:0/229580591 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7ffb88069030 0x7ffb8806b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:55:05.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.248+0000 7ffb9effd700 1 --2- 172.21.15.152:0/229580591 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7ffb88069030 0x7ffb8806b4e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ffb940079f0 tx=0x7ffb94008040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:55:05.251 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.252+0000 7ffb87fff700 1 -- 172.21.15.152:0/229580591 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ffb90058050 con 0x7ffba01028f0 2023-12-06T14:55:05.449 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.449+0000 7ffba6215700 1 -- 172.21.15.152:0/229580591 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7ffba010e280 con 0x7ffba01028f0 2023-12-06T14:55:05.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.449+0000 7ffb87fff700 1 -- 172.21.15.152:0/229580591 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+227 (secure 0 0 0) 0x7ffb900867c0 con 0x7ffba01028f0 2023-12-06T14:55:05.450 INFO:teuthology.orchestra.run.smithi152.stdout:# minimal ceph.conf for 062f0e3c-9447-11ee-95a2-87774f69a715 2023-12-06T14:55:05.450 INFO:teuthology.orchestra.run.smithi152.stdout:[global] 2023-12-06T14:55:05.450 INFO:teuthology.orchestra.run.smithi152.stdout: fsid = 062f0e3c-9447-11ee-95a2-87774f69a715 2023-12-06T14:55:05.450 INFO:teuthology.orchestra.run.smithi152.stdout: mon_host = [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] 2023-12-06T14:55:05.451 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.451+0000 7ffba6215700 1 -- 172.21.15.152:0/229580591 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7ffb88069030 msgr2=0x7ffb8806b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:55:05.452 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.451+0000 7ffba6215700 1 --2- 172.21.15.152:0/229580591 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7ffb88069030 0x7ffb8806b4e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ffb940079f0 tx=0x7ffb94008040 comp rx=0 tx=0).stop 2023-12-06T14:55:05.452 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.451+0000 7ffba6215700 1 -- 172.21.15.152:0/229580591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffba01028f0 msgr2=0x7ffba0112ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:55:05.452 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.451+0000 7ffba6215700 1 --2- 172.21.15.152:0/229580591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffba01028f0 0x7ffba0112ca0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ffb9000bfe0 tx=0x7ffb90009e30 comp rx=0 tx=0).stop 2023-12-06T14:55:05.452 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.451+0000 7ffba6215700 1 -- 172.21.15.152:0/229580591 shutdown_connections 2023-12-06T14:55:05.452 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.451+0000 7ffba6215700 1 --2- 172.21.15.152:0/229580591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffba01028f0 0x7ffba0112ca0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:55:05.452 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.451+0000 7ffba6215700 1 --2- 172.21.15.152:0/229580591 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7ffb88069030 0x7ffb8806b4e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:55:05.452 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.451+0000 7ffba6215700 1 --2- 172.21.15.152:0/229580591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffba01131e0 0x7ffba010cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:55:05.452 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.451+0000 7ffba6215700 1 -- 172.21.15.152:0/229580591 >> 172.21.15.152:0/229580591 conn(0x7ffba00715e0 msgr2=0x7ffba0103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:55:05.452 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.452+0000 7ffba6215700 1 -- 172.21.15.152:0/229580591 shutdown_connections 2023-12-06T14:55:05.452 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:05.452+0000 7ffba6215700 1 -- 172.21.15.152:0/229580591 wait complete. 2023-12-06T14:55:05.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:05 smithi152 ceph-mon[111954]: Updating smithi152:/etc/ceph/ceph.conf 2023-12-06T14:55:05.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:05 smithi152 ceph-mon[111954]: Updating smithi190:/etc/ceph/ceph.conf 2023-12-06T14:55:05.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:05 smithi152 ceph-mon[111954]: Updating smithi152:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-06T14:55:05.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:05 smithi152 ceph-mon[111954]: Updating smithi190:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-06T14:55:05.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:05 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:05.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:05 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:05.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:05 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:05.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:05 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:05.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:05 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:05.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:05 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-06T14:55:05.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:05 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-06T14:55:05.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:05 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:55:05.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:05 smithi190 ceph-mon[121340]: Updating smithi152:/etc/ceph/ceph.conf 2023-12-06T14:55:05.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:05 smithi190 ceph-mon[121340]: Updating smithi190:/etc/ceph/ceph.conf 2023-12-06T14:55:05.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:05 smithi190 ceph-mon[121340]: Updating smithi152:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-06T14:55:05.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:05 smithi190 ceph-mon[121340]: Updating smithi190:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-06T14:55:05.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:05 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:05.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:05 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:05.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:05 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:05.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:05 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:05.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:05 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:05.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:05 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-06T14:55:05.824 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:05 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-06T14:55:05.824 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:05 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:55:06.114 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-12-06T14:55:06.114 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-06T14:55:06.114 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.conf 2023-12-06T14:55:06.143 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-06T14:55:06.144 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-06T14:55:06.211 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-06T14:55:06.212 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/ceph/ceph.conf 2023-12-06T14:55:06.248 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-06T14:55:06.248 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-06T14:55:06.319 INFO:tasks.cephadm:Deploying OSDs... 2023-12-06T14:55:06.319 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-06T14:55:06.319 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/scratch_devs of=/dev/stdout 2023-12-06T14:55:06.339 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-06T14:55:06.339 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_1 2023-12-06T14:55:06.398 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-06T14:55:06.399 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-06T14:55:06.399 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 389517 Links: 1 2023-12-06T14:55:06.399 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-06T14:55:06.399 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2023-12-06T14:55:06.399 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2023-12-06 14:54:32.933919066 +0000 2023-12-06T14:55:06.399 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2023-12-06 14:47:19.723970707 +0000 2023-12-06T14:55:06.399 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2023-12-06 14:47:19.723970707 +0000 2023-12-06T14:55:06.399 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2023-12-06T14:55:06.399 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-06T14:55:06.465 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2023-12-06T14:55:06.465 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2023-12-06T14:55:06.465 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000196287 s, 2.6 MB/s 2023-12-06T14:55:06.466 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-06T14:55:06.526 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_2 2023-12-06T14:55:06.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:06 smithi190 ceph-mon[121340]: Reconfiguring mon.smithi152 (unknown last config time)... 2023-12-06T14:55:06.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:06 smithi190 ceph-mon[121340]: Reconfiguring daemon mon.smithi152 on smithi152 2023-12-06T14:55:06.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:06 smithi190 ceph-mon[121340]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:55:06.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:06 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/229580591' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:55:06.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:06 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:06.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:06 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:06.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:06 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.meodco", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-06T14:55:06.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:06 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-06T14:55:06.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:06 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:55:06.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:06 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:06.585 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-06T14:55:06.586 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-06T14:55:06.586 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 398407 Links: 1 2023-12-06T14:55:06.586 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-06T14:55:06.586 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2023-12-06T14:55:06.586 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2023-12-06 14:54:32.933919066 +0000 2023-12-06T14:55:06.586 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2023-12-06 14:47:20.231964518 +0000 2023-12-06T14:55:06.586 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2023-12-06 14:47:20.231964518 +0000 2023-12-06T14:55:06.586 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2023-12-06T14:55:06.587 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-06T14:55:06.651 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:06 smithi152 ceph-mon[111954]: Reconfiguring mon.smithi152 (unknown last config time)... 2023-12-06T14:55:06.651 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:06 smithi152 ceph-mon[111954]: Reconfiguring daemon mon.smithi152 on smithi152 2023-12-06T14:55:06.651 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:06 smithi152 ceph-mon[111954]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:55:06.651 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:06 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/229580591' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:55:06.651 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:06 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:06.652 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:06 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:06.652 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:06 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.meodco", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-06T14:55:06.652 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:06 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-06T14:55:06.652 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:06 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:55:06.652 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:06 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:06.653 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2023-12-06T14:55:06.653 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2023-12-06T14:55:06.653 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000213997 s, 2.4 MB/s 2023-12-06T14:55:06.654 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-06T14:55:06.714 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_3 2023-12-06T14:55:06.771 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-06T14:55:06.772 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-06T14:55:06.772 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 389592 Links: 1 2023-12-06T14:55:06.772 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-06T14:55:06.772 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2023-12-06T14:55:06.772 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2023-12-06 14:54:32.933919066 +0000 2023-12-06T14:55:06.772 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2023-12-06 14:47:20.750958194 +0000 2023-12-06T14:55:06.772 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2023-12-06 14:47:20.750958194 +0000 2023-12-06T14:55:06.772 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2023-12-06T14:55:06.773 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-06T14:55:06.837 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2023-12-06T14:55:06.838 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2023-12-06T14:55:06.838 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000214298 s, 2.4 MB/s 2023-12-06T14:55:06.839 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-06T14:55:06.898 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_4 2023-12-06T14:55:06.958 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-06T14:55:06.958 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-06T14:55:06.958 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 399473 Links: 1 2023-12-06T14:55:06.959 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-06T14:55:06.959 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2023-12-06T14:55:06.959 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2023-12-06 14:54:32.933919066 +0000 2023-12-06T14:55:06.959 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2023-12-06 14:47:21.265951919 +0000 2023-12-06T14:55:06.959 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2023-12-06 14:47:21.265951919 +0000 2023-12-06T14:55:06.959 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2023-12-06T14:55:06.959 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-06T14:55:07.024 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2023-12-06T14:55:07.025 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2023-12-06T14:55:07.025 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000207907 s, 2.5 MB/s 2023-12-06T14:55:07.026 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-06T14:55:07.085 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-06T14:55:07.085 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/scratch_devs of=/dev/stdout 2023-12-06T14:55:07.107 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-06T14:55:07.107 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_1 2023-12-06T14:55:07.168 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-06T14:55:07.168 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-06T14:55:07.168 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 6h/6d Inode: 398396 Links: 1 2023-12-06T14:55:07.168 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-06T14:55:07.168 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:device_t:s0 2023-12-06T14:55:07.169 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2023-12-06 14:54:56.812051747 +0000 2023-12-06T14:55:07.169 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2023-12-06 14:47:19.127616740 +0000 2023-12-06T14:55:07.169 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2023-12-06 14:47:19.127616740 +0000 2023-12-06T14:55:07.169 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2023-12-06T14:55:07.169 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-06T14:55:07.239 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2023-12-06T14:55:07.239 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2023-12-06T14:55:07.239 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000256682 s, 2.0 MB/s 2023-12-06T14:55:07.240 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-06T14:55:07.301 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_2 2023-12-06T14:55:07.361 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-06T14:55:07.361 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-06T14:55:07.361 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 6h/6d Inode: 395594 Links: 1 2023-12-06T14:55:07.362 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-06T14:55:07.362 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:device_t:s0 2023-12-06T14:55:07.362 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2023-12-06 14:54:56.812051747 +0000 2023-12-06T14:55:07.362 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2023-12-06 14:47:19.640602051 +0000 2023-12-06T14:55:07.362 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2023-12-06 14:47:19.640602051 +0000 2023-12-06T14:55:07.362 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2023-12-06T14:55:07.363 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-06T14:55:07.428 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2023-12-06T14:55:07.428 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2023-12-06T14:55:07.428 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000205401 s, 2.5 MB/s 2023-12-06T14:55:07.429 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-06T14:55:07.489 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_3 2023-12-06T14:55:07.548 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-06T14:55:07.548 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-06T14:55:07.548 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 6h/6d Inode: 395643 Links: 1 2023-12-06T14:55:07.548 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-06T14:55:07.548 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:device_t:s0 2023-12-06T14:55:07.548 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2023-12-06 14:54:56.812051747 +0000 2023-12-06T14:55:07.548 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2023-12-06 14:47:20.157587248 +0000 2023-12-06T14:55:07.548 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2023-12-06 14:47:20.157587248 +0000 2023-12-06T14:55:07.548 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2023-12-06T14:55:07.549 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-06T14:55:07.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:07 smithi190 ceph-mon[121340]: Reconfiguring mgr.smithi152.meodco (unknown last config time)... 2023-12-06T14:55:07.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:07 smithi190 ceph-mon[121340]: Reconfiguring daemon mgr.smithi152.meodco on smithi152 2023-12-06T14:55:07.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:07 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:07.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:07 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:07.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:07 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-06T14:55:07.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:07 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:55:07.598 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2023-12-06T14:55:07.598 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2023-12-06T14:55:07.598 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000220581 s, 2.3 MB/s 2023-12-06T14:55:07.599 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-06T14:55:07.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:07 smithi152 ceph-mon[111954]: Reconfiguring mgr.smithi152.meodco (unknown last config time)... 2023-12-06T14:55:07.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:07 smithi152 ceph-mon[111954]: Reconfiguring daemon mgr.smithi152.meodco on smithi152 2023-12-06T14:55:07.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:07 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:07.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:07 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:07.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:07 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-06T14:55:07.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:07 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:55:07.658 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_4 2023-12-06T14:55:07.716 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-06T14:55:07.716 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-06T14:55:07.716 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 6h/6d Inode: 398542 Links: 1 2023-12-06T14:55:07.716 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-06T14:55:07.716 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:device_t:s0 2023-12-06T14:55:07.716 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2023-12-06 14:54:56.812051747 +0000 2023-12-06T14:55:07.716 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2023-12-06 14:47:20.680572273 +0000 2023-12-06T14:55:07.717 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2023-12-06 14:47:20.680572273 +0000 2023-12-06T14:55:07.717 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2023-12-06T14:55:07.717 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-06T14:55:07.782 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2023-12-06T14:55:07.782 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2023-12-06T14:55:07.782 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000207432 s, 2.5 MB/s 2023-12-06T14:55:07.783 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-06T14:55:07.842 INFO:tasks.cephadm:Deploying osd.0 on smithi152 with /dev/vg_nvme/lv_4... 2023-12-06T14:55:07.842 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-06T14:55:08.125 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:55:08.508 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:08 smithi152 ceph-mon[111954]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:55:08.508 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:08 smithi152 ceph-mon[111954]: Reconfiguring crash.smithi152 (monmap changed)... 2023-12-06T14:55:08.509 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:08 smithi152 ceph-mon[111954]: Reconfiguring daemon crash.smithi152 on smithi152 2023-12-06T14:55:08.509 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:08 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:08.509 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:08 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:08.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:08 smithi190 ceph-mon[121340]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:55:08.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:08 smithi190 ceph-mon[121340]: Reconfiguring crash.smithi152 (monmap changed)... 2023-12-06T14:55:08.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:08 smithi190 ceph-mon[121340]: Reconfiguring daemon crash.smithi152 on smithi152 2023-12-06T14:55:08.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:08 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:08.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:08 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:09.479 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:09 smithi152 ceph-mon[111954]: Reconfiguring alertmanager.smithi152 (dependencies changed)... 2023-12-06T14:55:09.479 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:09 smithi152 ceph-mon[111954]: Reconfiguring daemon alertmanager.smithi152 on smithi152 2023-12-06T14:55:09.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:09 smithi190 ceph-mon[121340]: Reconfiguring alertmanager.smithi152 (dependencies changed)... 2023-12-06T14:55:09.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:09 smithi190 ceph-mon[121340]: Reconfiguring daemon alertmanager.smithi152 on smithi152 2023-12-06T14:55:10.174 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-06T14:55:10.174 INFO:teuthology.orchestra.run.smithi152.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-06T14:55:10.174 INFO:teuthology.orchestra.run.smithi152.stderr: stderr: 10+0 records in 2023-12-06T14:55:10.174 INFO:teuthology.orchestra.run.smithi152.stderr:10+0 records out 2023-12-06T14:55:10.174 INFO:teuthology.orchestra.run.smithi152.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110899 s, 946 MB/s 2023-12-06T14:55:10.174 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping successful for: 2023-12-06T14:55:10.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:10 smithi152 ceph-mon[111954]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:55:10.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:10 smithi190 ceph-mon[121340]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:55:10.860 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi152:vg_nvme/lv_4 2023-12-06T14:55:11.425 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:55:11.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:11 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:55:11.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:11 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:55:12.524 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:12.524+0000 7f0649872700 1 -- 172.21.15.152:0/3524536305 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06440fcbf0 msgr2=0x7f06440fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:55:12.524 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:12.524+0000 7f0649872700 1 --2- 172.21.15.152:0/3524536305 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06440fcbf0 0x7f06440fd000 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f063c009ce0 tx=0x7f063c004d10 comp rx=0 tx=0).stop 2023-12-06T14:55:12.525 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:12.524+0000 7f0649872700 1 -- 172.21.15.152:0/3524536305 shutdown_connections 2023-12-06T14:55:12.525 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:12.524+0000 7f0649872700 1 --2- 172.21.15.152:0/3524536305 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06440fde00 0x7f06440fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:55:12.525 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:12.524+0000 7f0649872700 1 --2- 172.21.15.152:0/3524536305 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06440fcbf0 0x7f06440fd000 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:55:12.525 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:12.524+0000 7f0649872700 1 -- 172.21.15.152:0/3524536305 >> 172.21.15.152:0/3524536305 conn(0x7f06440f82d0 msgr2=0x7f06440fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:55:12.525 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:12.524+0000 7f0649872700 1 -- 172.21.15.152:0/3524536305 shutdown_connections 2023-12-06T14:55:12.525 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:12.524+0000 7f0649872700 1 -- 172.21.15.152:0/3524536305 wait complete. 2023-12-06T14:55:12.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:12.525+0000 7f0649872700 1 Processor -- start 2023-12-06T14:55:12.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:12.525+0000 7f0649872700 1 -- start start 2023-12-06T14:55:12.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:12.525+0000 7f0649872700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06440fcbf0 0x7f064410d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:55:12.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:12.525+0000 7f0649872700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06440fde00 0x7f064410dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:55:12.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:12.525+0000 7f0649872700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064410e270 con 0x7f06440fde00 2023-12-06T14:55:12.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:12.525+0000 7f0649872700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064410eb10 con 0x7f06440fcbf0 2023-12-06T14:55:12.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:12.525+0000 7f06427fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06440fde00 0x7f064410dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:55:12.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:12.525+0000 7f06427fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06440fde00 0x7f064410dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48968/0 (socket says 172.21.15.152:48968) 2023-12-06T14:55:12.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:12.525+0000 7f06427fc700 1 -- 172.21.15.152:0/2706587532 learned_addr learned my addr 172.21.15.152:0/2706587532 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:55:12.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:12.525+0000 7f0642ffd700 1 --2- 172.21.15.152:0/2706587532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06440fcbf0 0x7f064410d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:55:12.528 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:12.525+0000 7f06427fc700 1 -- 172.21.15.152:0/2706587532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06440fcbf0 msgr2=0x7f064410d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:55:12.528 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:12.525+0000 7f06427fc700 1 --2- 172.21.15.152:0/2706587532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06440fcbf0 0x7f064410d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:55:12.528 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:12.525+0000 7f06427fc700 1 -- 172.21.15.152:0/2706587532 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c009940 con 0x7f06440fde00 2023-12-06T14:55:12.528 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:12.525+0000 7f0642ffd700 1 --2- 172.21.15.152:0/2706587532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06440fcbf0 0x7f064410d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-06T14:55:12.528 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:12.526+0000 7f06427fc700 1 --2- 172.21.15.152:0/2706587532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06440fde00 0x7f064410dc70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0638002a50 tx=0x7f06380046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:55:12.528 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:12.526+0000 7f062b7fe700 1 -- 172.21.15.152:0/2706587532 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0638007cc0 con 0x7f06440fde00 2023-12-06T14:55:12.528 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:12.526+0000 7f062b7fe700 1 -- 172.21.15.152:0/2706587532 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f063800f040 con 0x7f06440fde00 2023-12-06T14:55:12.528 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:12.526+0000 7f0649872700 1 -- 172.21.15.152:0/2706587532 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f064410edf0 con 0x7f06440fde00 2023-12-06T14:55:12.528 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:12.526+0000 7f062b7fe700 1 -- 172.21.15.152:0/2706587532 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0638009540 con 0x7f06440fde00 2023-12-06T14:55:12.528 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:12.526+0000 7f0649872700 1 -- 172.21.15.152:0/2706587532 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f064410f330 con 0x7f06440fde00 2023-12-06T14:55:12.529 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:12.527+0000 7f0649872700 1 -- 172.21.15.152:0/2706587532 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06441075d0 con 0x7f06440fde00 2023-12-06T14:55:12.529 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:12.527+0000 7f062b7fe700 1 -- 172.21.15.152:0/2706587532 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 86393+0+0 (secure 0 0 0) 0x7f06380096a0 con 0x7f06440fde00 2023-12-06T14:55:12.529 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:12.528+0000 7f062b7fe700 1 --2- 172.21.15.152:0/2706587532 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f062c068ed0 0x7f062c06b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:55:12.529 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:12.528+0000 7f0642ffd700 1 --2- 172.21.15.152:0/2706587532 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f062c068ed0 0x7f062c06b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:55:12.530 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:12.528+0000 7f062b7fe700 1 -- 172.21.15.152:0/2706587532 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f06380859b0 con 0x7f06440fde00 2023-12-06T14:55:12.530 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:12.528+0000 7f0642ffd700 1 --2- 172.21.15.152:0/2706587532 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f062c068ed0 0x7f062c06b380 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f063c005010 tx=0x7f063c004d10 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:55:12.532 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:12.532+0000 7f062b7fe700 1 -- 172.21.15.152:0/2706587532 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f06380569f0 con 0x7f06440fde00 2023-12-06T14:55:12.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:12 smithi152 ceph-mon[111954]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:55:12.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:12 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:12.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:12 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:12.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:12 smithi152 ceph-mon[111954]: Reconfiguring grafana.smithi152 (dependencies changed)... 2023-12-06T14:55:12.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:12 smithi152 ceph-mon[111954]: Reconfiguring daemon grafana.smithi152 on smithi152 2023-12-06T14:55:12.728 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:12.728+0000 7f0649872700 1 -- 172.21.15.152:0/2706587532 --> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f064410f610 con 0x7f062c068ed0 2023-12-06T14:55:12.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:12 smithi190 ceph-mon[121340]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:55:12.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:12 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:12.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:12 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:12.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:12 smithi190 ceph-mon[121340]: Reconfiguring grafana.smithi152 (dependencies changed)... 2023-12-06T14:55:12.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:12 smithi190 ceph-mon[121340]: Reconfiguring daemon grafana.smithi152 on smithi152 2023-12-06T14:55:13.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:13 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-06T14:55:13.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:13 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-06T14:55:13.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:13 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:55:13.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:13 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-06T14:55:13.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:13 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-06T14:55:13.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:13 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:55:14.519 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:14 smithi152 ceph-mon[111954]: from='client.14244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:55:14.519 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:14 smithi152 ceph-mon[111954]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:55:14.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:14 smithi190 ceph-mon[121340]: from='client.14244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:55:14.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:14 smithi190 ceph-mon[121340]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:55:16.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:15 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:16.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:15 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:16.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:15 smithi190 ceph-mon[121340]: Reconfiguring prometheus.smithi152 (dependencies changed)... 2023-12-06T14:55:16.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:15 smithi190 ceph-mon[121340]: Reconfiguring daemon prometheus.smithi152 on smithi152 2023-12-06T14:55:16.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:15 smithi190 ceph-mon[121340]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:55:16.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:15 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/1696675056' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72a62158-6e7d-42af-8212-f6ae2b8df6e7"}]: dispatch 2023-12-06T14:55:16.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:15 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/1696675056' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72a62158-6e7d-42af-8212-f6ae2b8df6e7"}]': finished 2023-12-06T14:55:16.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:15 smithi190 ceph-mon[121340]: osdmap e6: 1 total, 0 up, 1 in 2023-12-06T14:55:16.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:15 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-06T14:55:16.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:15 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:16.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:15 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:16.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:15 smithi152 ceph-mon[111954]: Reconfiguring prometheus.smithi152 (dependencies changed)... 2023-12-06T14:55:16.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:15 smithi152 ceph-mon[111954]: Reconfiguring daemon prometheus.smithi152 on smithi152 2023-12-06T14:55:16.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:15 smithi152 ceph-mon[111954]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:55:16.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:15 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/1696675056' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72a62158-6e7d-42af-8212-f6ae2b8df6e7"}]: dispatch 2023-12-06T14:55:16.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:15 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/1696675056' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72a62158-6e7d-42af-8212-f6ae2b8df6e7"}]': finished 2023-12-06T14:55:16.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:15 smithi152 ceph-mon[111954]: osdmap e6: 1 total, 0 up, 1 in 2023-12-06T14:55:16.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:15 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-06T14:55:17.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:16 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/2219897' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-06T14:55:17.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:16 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/2219897' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-06T14:55:18.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:17 smithi190 ceph-mon[121340]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:55:18.377 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:17 smithi152 ceph-mon[111954]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:55:20.117 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:20 smithi152 ceph-mon[111954]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:55:20.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:20 smithi190 ceph-mon[121340]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:55:22.117 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:22 smithi152 ceph-mon[111954]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:55:22.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:22 smithi190 ceph-mon[121340]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:55:24.523 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:24 smithi190 ceph-mon[121340]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:55:24.523 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:24 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:24.523 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:24 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:24.524 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:24 smithi190 ceph-mon[121340]: Reconfiguring crash.smithi190 (monmap changed)... 2023-12-06T14:55:24.524 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:24 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi190", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-06T14:55:24.524 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:24 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:55:24.524 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:24 smithi190 ceph-mon[121340]: Reconfiguring daemon crash.smithi190 on smithi190 2023-12-06T14:55:24.524 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:24 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:24.524 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:24 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:24.524 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:24 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-06T14:55:24.524 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:24 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:55:24.524 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:24 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi190.ubusrr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-06T14:55:24.524 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:24 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-06T14:55:24.524 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:24 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:55:24.594 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:24 smithi152 ceph-mon[111954]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:55:24.594 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:24 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:24.594 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:24 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:24.594 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:24 smithi152 ceph-mon[111954]: Reconfiguring crash.smithi190 (monmap changed)... 2023-12-06T14:55:24.594 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:24 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi190", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-06T14:55:24.594 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:24 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:55:24.594 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:24 smithi152 ceph-mon[111954]: Reconfiguring daemon crash.smithi190 on smithi190 2023-12-06T14:55:24.594 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:24 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:24.595 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:24 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:24.595 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:24 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-06T14:55:24.595 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:24 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:55:24.595 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:24 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi190.ubusrr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-06T14:55:24.595 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:24 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-06T14:55:24.595 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:24 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:55:25.503 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:25 smithi190 ceph-mon[121340]: Deploying daemon osd.0 on smithi152 2023-12-06T14:55:25.504 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:25 smithi190 ceph-mon[121340]: Reconfiguring mgr.smithi190.ubusrr (monmap changed)... 2023-12-06T14:55:25.504 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:25 smithi190 ceph-mon[121340]: Reconfiguring daemon mgr.smithi190.ubusrr on smithi190 2023-12-06T14:55:25.504 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:25 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:25.504 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:25 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:25.504 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:25 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-06T14:55:25.504 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:25 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-06T14:55:25.504 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:25 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:55:25.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:25 smithi152 ceph-mon[111954]: Deploying daemon osd.0 on smithi152 2023-12-06T14:55:25.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:25 smithi152 ceph-mon[111954]: Reconfiguring mgr.smithi190.ubusrr (monmap changed)... 2023-12-06T14:55:25.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:25 smithi152 ceph-mon[111954]: Reconfiguring daemon mgr.smithi190.ubusrr on smithi190 2023-12-06T14:55:25.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:25 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:25.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:25 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:25.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:25 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-06T14:55:25.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:25 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-06T14:55:25.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:25 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:55:26.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:26 smithi152 ceph-mon[111954]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:55:26.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:26 smithi152 ceph-mon[111954]: Reconfiguring mon.smithi190 (monmap changed)... 2023-12-06T14:55:26.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:26 smithi152 ceph-mon[111954]: Reconfiguring daemon mon.smithi190 on smithi190 2023-12-06T14:55:26.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:26 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:55:26.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:26 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:26.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:26 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:26.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:26 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-06T14:55:26.528 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:26 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi152.front.sepia.ceph.com:9093"}]: dispatch 2023-12-06T14:55:26.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:26 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:26.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:26 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-06T14:55:26.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:26 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi152.front.sepia.ceph.com:3000"}]: dispatch 2023-12-06T14:55:26.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:26 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:26.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:26 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-06T14:55:26.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:26 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi152.front.sepia.ceph.com:9095"}]: dispatch 2023-12-06T14:55:26.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:26 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:26.529 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:26 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:55:26.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:26 smithi190 ceph-mon[121340]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:55:26.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:26 smithi190 ceph-mon[121340]: Reconfiguring mon.smithi190 (monmap changed)... 2023-12-06T14:55:26.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:26 smithi190 ceph-mon[121340]: Reconfiguring daemon mon.smithi190 on smithi190 2023-12-06T14:55:26.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:26 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:55:26.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:26 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:26.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:26 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:26.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:26 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-06T14:55:26.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:26 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi152.front.sepia.ceph.com:9093"}]: dispatch 2023-12-06T14:55:26.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:26 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:26.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:26 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-06T14:55:26.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:26 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi152.front.sepia.ceph.com:3000"}]: dispatch 2023-12-06T14:55:26.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:26 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:26.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:26 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-06T14:55:26.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:26 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi152.front.sepia.ceph.com:9095"}]: dispatch 2023-12-06T14:55:26.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:26 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:26.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:26 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:55:27.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:27 smithi152 ceph-mon[111954]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-06T14:55:27.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:27 smithi152 ceph-mon[111954]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi152.front.sepia.ceph.com:9093"}]: dispatch 2023-12-06T14:55:27.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:27 smithi152 ceph-mon[111954]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-06T14:55:27.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:27 smithi152 ceph-mon[111954]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi152.front.sepia.ceph.com:3000"}]: dispatch 2023-12-06T14:55:27.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:27 smithi152 ceph-mon[111954]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-06T14:55:27.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:27 smithi152 ceph-mon[111954]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi152.front.sepia.ceph.com:9095"}]: dispatch 2023-12-06T14:55:27.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:27 smithi190 ceph-mon[121340]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-06T14:55:27.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:27 smithi190 ceph-mon[121340]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi152.front.sepia.ceph.com:9093"}]: dispatch 2023-12-06T14:55:27.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:27 smithi190 ceph-mon[121340]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-06T14:55:27.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:27 smithi190 ceph-mon[121340]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi152.front.sepia.ceph.com:3000"}]: dispatch 2023-12-06T14:55:27.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:27 smithi190 ceph-mon[121340]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-06T14:55:27.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:27 smithi190 ceph-mon[121340]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi152.front.sepia.ceph.com:9095"}]: dispatch 2023-12-06T14:55:28.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:28 smithi152 ceph-mon[111954]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:55:28.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:28 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:28.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:28 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:28.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:28 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:28.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:28 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:28.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:28 smithi190 ceph-mon[121340]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:55:28.826 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:28 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:28.826 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:28 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:28.826 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:28 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:28.826 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:28 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:30.488 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:30 smithi190 ceph-mon[121340]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:55:30.488 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:30 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:30.488 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:30 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:30.488 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:30 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:55:30.489 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:30 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:55:30.489 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:30 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:30.489 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:30 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:55:30.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:30 smithi152 ceph-mon[111954]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:55:30.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:30 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:30.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:30 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:30.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:30 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:55:30.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:30 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:55:30.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:30 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:30.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:30 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:55:30.933 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 0 on host 'smithi152' 2023-12-06T14:55:30.933 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:30.932+0000 7f062b7fe700 1 -- 172.21.15.152:0/2706587532 <== mgr.14210 v2:172.21.15.152:6800/3317409709 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f064410f610 con 0x7f062c068ed0 2023-12-06T14:55:30.935 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:30.934+0000 7f0649872700 1 -- 172.21.15.152:0/2706587532 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f062c068ed0 msgr2=0x7f062c06b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:55:30.935 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:30.934+0000 7f0649872700 1 --2- 172.21.15.152:0/2706587532 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f062c068ed0 0x7f062c06b380 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f063c005010 tx=0x7f063c004d10 comp rx=0 tx=0).stop 2023-12-06T14:55:30.935 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:30.934+0000 7f0649872700 1 -- 172.21.15.152:0/2706587532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06440fde00 msgr2=0x7f064410dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:55:30.935 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:30.934+0000 7f0649872700 1 --2- 172.21.15.152:0/2706587532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06440fde00 0x7f064410dc70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0638002a50 tx=0x7f06380046b0 comp rx=0 tx=0).stop 2023-12-06T14:55:30.935 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:30.934+0000 7f0649872700 1 -- 172.21.15.152:0/2706587532 shutdown_connections 2023-12-06T14:55:30.935 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:30.934+0000 7f0649872700 1 --2- 172.21.15.152:0/2706587532 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f062c068ed0 0x7f062c06b380 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:55:30.935 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:30.934+0000 7f0649872700 1 --2- 172.21.15.152:0/2706587532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06440fcbf0 0x7f064410d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:55:30.935 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:30.934+0000 7f0649872700 1 --2- 172.21.15.152:0/2706587532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06440fde00 0x7f064410dc70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:55:30.935 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:30.934+0000 7f0649872700 1 -- 172.21.15.152:0/2706587532 >> 172.21.15.152:0/2706587532 conn(0x7f06440f82d0 msgr2=0x7f06440fa580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:55:30.935 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:30.935+0000 7f0649872700 1 -- 172.21.15.152:0/2706587532 shutdown_connections 2023-12-06T14:55:30.935 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:30.935+0000 7f0649872700 1 -- 172.21.15.152:0/2706587532 wait complete. 2023-12-06T14:55:31.367 DEBUG:teuthology.orchestra.run.smithi152:osd.0> sudo journalctl -f -n 0 -u ceph-062f0e3c-9447-11ee-95a2-87774f69a715@osd.0.service 2023-12-06T14:55:31.369 INFO:tasks.cephadm:Deploying osd.1 on smithi152 with /dev/vg_nvme/lv_3... 2023-12-06T14:55:31.369 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-06T14:55:31.401 INFO:journalctl@ceph.osd.0.smithi152.stdout:-- Logs begin at Wed 2023-12-06 14:39:30 UTC. -- 2023-12-06T14:55:31.672 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:55:32.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:31 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:32.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:31 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:32.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:31 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:32.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:31 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:32.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:31 smithi190 ceph-mon[121340]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:55:32.128 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 14:55:31 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-0[135495]: 2023-12-06T14:55:31.897+0000 7f4fb0d4d540 -1 osd.0 0 log_to_monitors true 2023-12-06T14:55:32.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:31 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:32.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:31 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:32.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:31 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:32.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:31 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:32.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:31 smithi152 ceph-mon[111954]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:55:32.877 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:32 smithi152 ceph-mon[111954]: from='osd.0 [v2:172.21.15.152:6802/3829936777,v1:172.21.15.152:6803/3829936777]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-06T14:55:32.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:32 smithi152 ceph-mon[111954]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-06T14:55:33.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:32 smithi190 ceph-mon[121340]: from='osd.0 [v2:172.21.15.152:6802/3829936777,v1:172.21.15.152:6803/3829936777]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-06T14:55:33.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:32 smithi190 ceph-mon[121340]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-06T14:55:33.146 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-06T14:55:33.146 INFO:teuthology.orchestra.run.smithi152.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-06T14:55:33.146 INFO:teuthology.orchestra.run.smithi152.stderr: stderr: 10+0 records in 2023-12-06T14:55:33.146 INFO:teuthology.orchestra.run.smithi152.stderr:10+0 records out 2023-12-06T14:55:33.146 INFO:teuthology.orchestra.run.smithi152.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.011103 s, 944 MB/s 2023-12-06T14:55:33.147 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping successful for: 2023-12-06T14:55:33.651 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi152:vg_nvme/lv_3 2023-12-06T14:55:33.977 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:55:34.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:33 smithi190 ceph-mon[121340]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-06T14:55:34.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:33 smithi190 ceph-mon[121340]: osdmap e7: 1 total, 0 up, 1 in 2023-12-06T14:55:34.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:33 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-06T14:55:34.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:33 smithi190 ceph-mon[121340]: from='osd.0 [v2:172.21.15.152:6802/3829936777,v1:172.21.15.152:6803/3829936777]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-06T14:55:34.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:33 smithi190 ceph-mon[121340]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-06T14:55:34.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:33 smithi190 ceph-mon[121340]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:55:34.092 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 14:55:33 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-0[135495]: 2023-12-06T14:55:33.813+0000 7f4fa7532700 -1 osd.0 0 waiting for initial osdmap 2023-12-06T14:55:34.093 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 14:55:33 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-0[135495]: 2023-12-06T14:55:33.816+0000 7f4fa232d700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-06T14:55:34.093 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:33 smithi152 ceph-mon[111954]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-06T14:55:34.093 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:33 smithi152 ceph-mon[111954]: osdmap e7: 1 total, 0 up, 1 in 2023-12-06T14:55:34.093 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:33 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-06T14:55:34.093 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:33 smithi152 ceph-mon[111954]: from='osd.0 [v2:172.21.15.152:6802/3829936777,v1:172.21.15.152:6803/3829936777]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-06T14:55:34.093 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:33 smithi152 ceph-mon[111954]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-06T14:55:34.093 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:33 smithi152 ceph-mon[111954]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:55:34.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:34.946+0000 7fe8f597a700 1 -- 172.21.15.152:0/1880313037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8f00fcd00 msgr2=0x7fe8f00fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:55:34.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:34.946+0000 7fe8f597a700 1 --2- 172.21.15.152:0/1880313037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8f00fcd00 0x7fe8f00fd150 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8004940 tx=0x7fe8d8009e30 comp rx=0 tx=0).stop 2023-12-06T14:55:34.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:34.946+0000 7fe8f597a700 1 -- 172.21.15.152:0/1880313037 shutdown_connections 2023-12-06T14:55:34.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:34.946+0000 7fe8f597a700 1 --2- 172.21.15.152:0/1880313037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8f00fcd00 0x7fe8f00fd150 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:55:34.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:34.946+0000 7fe8f597a700 1 --2- 172.21.15.152:0/1880313037 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8f00fbaf0 0x7fe8f00fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:55:34.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:34.946+0000 7fe8f597a700 1 -- 172.21.15.152:0/1880313037 >> 172.21.15.152:0/1880313037 conn(0x7fe8f00f71b0 msgr2=0x7fe8f00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:55:34.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:34.946+0000 7fe8f597a700 1 -- 172.21.15.152:0/1880313037 shutdown_connections 2023-12-06T14:55:34.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:34.946+0000 7fe8f597a700 1 -- 172.21.15.152:0/1880313037 wait complete. 2023-12-06T14:55:34.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:34.947+0000 7fe8f597a700 1 Processor -- start 2023-12-06T14:55:34.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:34.947+0000 7fe8f597a700 1 -- start start 2023-12-06T14:55:34.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:34.947+0000 7fe8f597a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8f00fbaf0 0x7fe8f010c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:55:34.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:34.947+0000 7fe8f597a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8f00fcd00 0x7fe8f010c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:55:34.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:34.947+0000 7fe8f597a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f010cf30 con 0x7fe8f00fbaf0 2023-12-06T14:55:34.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:34.947+0000 7fe8f597a700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f010d7d0 con 0x7fe8f00fcd00 2023-12-06T14:55:34.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:34.947+0000 7fe8eeffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8f00fbaf0 0x7fe8f010c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:55:34.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:34.947+0000 7fe8eeffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8f00fbaf0 0x7fe8f010c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48160/0 (socket says 172.21.15.152:48160) 2023-12-06T14:55:34.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:34.947+0000 7fe8eeffd700 1 -- 172.21.15.152:0/1227140717 learned_addr learned my addr 172.21.15.152:0/1227140717 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:55:34.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:34.947+0000 7fe8ee7fc700 1 --2- 172.21.15.152:0/1227140717 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8f00fcd00 0x7fe8f010c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:55:34.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:34.947+0000 7fe8eeffd700 1 -- 172.21.15.152:0/1227140717 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8f00fcd00 msgr2=0x7fe8f010c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:55:34.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:34.947+0000 7fe8eeffd700 1 --2- 172.21.15.152:0/1227140717 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8f00fcd00 0x7fe8f010c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:55:34.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:34.947+0000 7fe8eeffd700 1 -- 172.21.15.152:0/1227140717 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d8005040 con 0x7fe8f00fbaf0 2023-12-06T14:55:34.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:34.947+0000 7fe8ee7fc700 1 --2- 172.21.15.152:0/1227140717 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8f00fcd00 0x7fe8f010c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-06T14:55:34.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:34.948+0000 7fe8eeffd700 1 --2- 172.21.15.152:0/1227140717 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8f00fbaf0 0x7fe8f010c3f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe8e000ca90 tx=0x7fe8e0007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:55:34.950 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:34.948+0000 7fe8e77fe700 1 -- 172.21.15.152:0/1227140717 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8e000aa50 con 0x7fe8f00fbaf0 2023-12-06T14:55:34.950 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:34.948+0000 7fe8e77fe700 1 -- 172.21.15.152:0/1227140717 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe8e000abb0 con 0x7fe8f00fbaf0 2023-12-06T14:55:34.950 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:34.948+0000 7fe8f597a700 1 -- 172.21.15.152:0/1227140717 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8f010dab0 con 0x7fe8f00fbaf0 2023-12-06T14:55:34.950 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:34.948+0000 7fe8e77fe700 1 -- 172.21.15.152:0/1227140717 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8e00115e0 con 0x7fe8f00fbaf0 2023-12-06T14:55:34.950 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:34.948+0000 7fe8f597a700 1 -- 172.21.15.152:0/1227140717 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8f010dff0 con 0x7fe8f00fbaf0 2023-12-06T14:55:34.951 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:34.949+0000 7fe8f597a700 1 -- 172.21.15.152:0/1227140717 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8f004bb80 con 0x7fe8f00fbaf0 2023-12-06T14:55:34.951 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:34.949+0000 7fe8e77fe700 1 -- 172.21.15.152:0/1227140717 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 86393+0+0 (secure 0 0 0) 0x7fe8e000ad20 con 0x7fe8f00fbaf0 2023-12-06T14:55:34.951 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:34.949+0000 7fe8e77fe700 1 --2- 172.21.15.152:0/1227140717 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fe8dc068ed0 0x7fe8dc06b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:55:34.951 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:34.950+0000 7fe8ee7fc700 1 --2- 172.21.15.152:0/1227140717 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fe8dc068ed0 0x7fe8dc06b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:55:34.951 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:34.950+0000 7fe8e77fe700 1 -- 172.21.15.152:0/1227140717 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1978+0+0 (secure 0 0 0) 0x7fe8e0086590 con 0x7fe8f00fbaf0 2023-12-06T14:55:34.951 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:34.950+0000 7fe8ee7fc700 1 --2- 172.21.15.152:0/1227140717 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fe8dc068ed0 0x7fe8dc06b380 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8009fd0 tx=0x7fe8d8009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:55:34.953 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:34 smithi152 ceph-mon[111954]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2023-12-06T14:55:34.953 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:34 smithi152 ceph-mon[111954]: osdmap e8: 1 total, 0 up, 1 in 2023-12-06T14:55:34.953 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:34 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-06T14:55:34.953 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:34 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-06T14:55:34.953 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:34 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:34.953 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:34 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:34.954 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:34.954+0000 7fe8e77fe700 1 -- 172.21.15.152:0/1227140717 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe8e0057370 con 0x7fe8f00fbaf0 2023-12-06T14:55:35.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:34 smithi190 ceph-mon[121340]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2023-12-06T14:55:35.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:34 smithi190 ceph-mon[121340]: osdmap e8: 1 total, 0 up, 1 in 2023-12-06T14:55:35.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:34 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-06T14:55:35.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:34 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-06T14:55:35.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:34 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:35.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:34 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:35.158 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:35.158+0000 7fe8f597a700 1 -- 172.21.15.152:0/1227140717 --> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8f010e420 con 0x7fe8dc068ed0 2023-12-06T14:55:36.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:35 smithi190 ceph-mon[121340]: purged_snaps scrub starts 2023-12-06T14:55:36.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:35 smithi190 ceph-mon[121340]: purged_snaps scrub ok 2023-12-06T14:55:36.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:35 smithi190 ceph-mon[121340]: osd.0 [v2:172.21.15.152:6802/3829936777,v1:172.21.15.152:6803/3829936777] boot 2023-12-06T14:55:36.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:35 smithi190 ceph-mon[121340]: osdmap e9: 1 total, 1 up, 1 in 2023-12-06T14:55:36.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:35 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-06T14:55:36.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:35 smithi190 ceph-mon[121340]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:55:36.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:35 smithi190 ceph-mon[121340]: from='client.14262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:55:36.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:35 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-06T14:55:36.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:35 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-06T14:55:36.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:35 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:55:36.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:35 smithi152 ceph-mon[111954]: purged_snaps scrub starts 2023-12-06T14:55:36.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:35 smithi152 ceph-mon[111954]: purged_snaps scrub ok 2023-12-06T14:55:36.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:35 smithi152 ceph-mon[111954]: osd.0 [v2:172.21.15.152:6802/3829936777,v1:172.21.15.152:6803/3829936777] boot 2023-12-06T14:55:36.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:35 smithi152 ceph-mon[111954]: osdmap e9: 1 total, 1 up, 1 in 2023-12-06T14:55:36.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:35 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-06T14:55:36.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:35 smithi152 ceph-mon[111954]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-06T14:55:36.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:35 smithi152 ceph-mon[111954]: from='client.14262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:55:36.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:35 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-06T14:55:36.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:35 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-06T14:55:36.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:35 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:55:37.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:36 smithi152 ceph-mon[111954]: osdmap e10: 1 total, 1 up, 1 in 2023-12-06T14:55:37.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:36 smithi190 ceph-mon[121340]: osdmap e10: 1 total, 1 up, 1 in 2023-12-06T14:55:38.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:37 smithi152 ceph-mon[111954]: pgmap v26: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-06T14:55:38.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:37 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:38.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:37 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:38.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:37 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:55:38.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:37 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:38.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:37 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:55:38.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:37 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:55:38.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:37 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:38.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:37 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:55:38.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:37 smithi190 ceph-mon[121340]: pgmap v26: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-06T14:55:38.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:37 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:38.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:37 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:38.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:37 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:55:38.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:37 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:38.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:37 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:55:38.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:37 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:55:38.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:37 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:38.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:37 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:55:39.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:38 smithi190 ceph-mon[121340]: Detected new or changed devices on smithi152 2023-12-06T14:55:39.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:38 smithi190 ceph-mon[121340]: Adjusting osd_memory_target on smithi152 to 12898M 2023-12-06T14:55:39.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:38 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/3683433818' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "50dee56b-c95b-4361-ad0d-4f71198f9105"}]: dispatch 2023-12-06T14:55:39.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:38 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/3683433818' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "50dee56b-c95b-4361-ad0d-4f71198f9105"}]': finished 2023-12-06T14:55:39.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:38 smithi190 ceph-mon[121340]: osdmap e11: 2 total, 1 up, 2 in 2023-12-06T14:55:39.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:38 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-06T14:55:39.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:38 smithi152 ceph-mon[111954]: Detected new or changed devices on smithi152 2023-12-06T14:55:39.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:38 smithi152 ceph-mon[111954]: Adjusting osd_memory_target on smithi152 to 12898M 2023-12-06T14:55:39.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:38 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/3683433818' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "50dee56b-c95b-4361-ad0d-4f71198f9105"}]: dispatch 2023-12-06T14:55:39.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:38 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/3683433818' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "50dee56b-c95b-4361-ad0d-4f71198f9105"}]': finished 2023-12-06T14:55:39.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:38 smithi152 ceph-mon[111954]: osdmap e11: 2 total, 1 up, 2 in 2023-12-06T14:55:39.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:38 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-06T14:55:40.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:40 smithi190 ceph-mon[121340]: pgmap v28: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-06T14:55:40.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:40 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:40.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:40 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:40.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:40 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/1792701884' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-06T14:55:40.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:40 smithi152 ceph-mon[111954]: pgmap v28: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-06T14:55:40.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:40 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:40.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:40 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:40.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:40 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/1792701884' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-06T14:55:41.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:41 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:41.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:41 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:41.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:41 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:55:41.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:41 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:55:41.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:41 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:41.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:41 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:55:41.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:41 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:41.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:41 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:41.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:41 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:55:41.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:41 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:55:41.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:41 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:41.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:41 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:55:42.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:42 smithi152 ceph-mon[111954]: pgmap v29: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-06T14:55:42.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:42 smithi190 ceph-mon[121340]: pgmap v29: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-06T14:55:44.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:44 smithi190 ceph-mon[121340]: pgmap v30: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-06T14:55:44.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:44 smithi152 ceph-mon[111954]: pgmap v30: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-06T14:55:45.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:45 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-06T14:55:45.525 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:45 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:55:45.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:45 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-06T14:55:45.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:45 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:55:46.624 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:46 smithi152 ceph-mon[111954]: Deploying daemon osd.1 on smithi152 2023-12-06T14:55:46.624 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:46 smithi152 ceph-mon[111954]: pgmap v31: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-06T14:55:46.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:46 smithi190 ceph-mon[121340]: Deploying daemon osd.1 on smithi152 2023-12-06T14:55:46.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:46 smithi190 ceph-mon[121340]: pgmap v31: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-06T14:55:48.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:48 smithi152 ceph-mon[111954]: pgmap v32: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-06T14:55:48.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:48 smithi190 ceph-mon[121340]: pgmap v32: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-06T14:55:49.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:49 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:49.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:49 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:49.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:49 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:55:49.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:49 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:49.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:49 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:49.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:49 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:55:50.575 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:50 smithi152 ceph-mon[111954]: pgmap v33: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-06T14:55:50.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:50.757+0000 7fe8e77fe700 1 -- 172.21.15.152:0/1227140717 <== mgr.14210 v2:172.21.15.152:6800/3317409709 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe8f010e420 con 0x7fe8dc068ed0 2023-12-06T14:55:50.758 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 1 on host 'smithi152' 2023-12-06T14:55:50.760 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:50.759+0000 7fe8f597a700 1 -- 172.21.15.152:0/1227140717 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fe8dc068ed0 msgr2=0x7fe8dc06b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:55:50.761 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:50.759+0000 7fe8f597a700 1 --2- 172.21.15.152:0/1227140717 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fe8dc068ed0 0x7fe8dc06b380 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8009fd0 tx=0x7fe8d8009e30 comp rx=0 tx=0).stop 2023-12-06T14:55:50.761 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:50.759+0000 7fe8f597a700 1 -- 172.21.15.152:0/1227140717 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8f00fbaf0 msgr2=0x7fe8f010c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:55:50.761 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:50.759+0000 7fe8f597a700 1 --2- 172.21.15.152:0/1227140717 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8f00fbaf0 0x7fe8f010c3f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe8e000ca90 tx=0x7fe8e0007f00 comp rx=0 tx=0).stop 2023-12-06T14:55:50.761 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:50.759+0000 7fe8f597a700 1 -- 172.21.15.152:0/1227140717 shutdown_connections 2023-12-06T14:55:50.761 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:50.759+0000 7fe8f597a700 1 --2- 172.21.15.152:0/1227140717 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8f00fbaf0 0x7fe8f010c3f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:55:50.761 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:50.759+0000 7fe8f597a700 1 --2- 172.21.15.152:0/1227140717 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fe8dc068ed0 0x7fe8dc06b380 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:55:50.761 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:50.759+0000 7fe8f597a700 1 --2- 172.21.15.152:0/1227140717 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8f00fcd00 0x7fe8f010c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:55:50.761 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:50.759+0000 7fe8f597a700 1 -- 172.21.15.152:0/1227140717 >> 172.21.15.152:0/1227140717 conn(0x7fe8f00f71b0 msgr2=0x7fe8f00fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:55:50.761 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:50.759+0000 7fe8f597a700 1 -- 172.21.15.152:0/1227140717 shutdown_connections 2023-12-06T14:55:50.761 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:50.759+0000 7fe8f597a700 1 -- 172.21.15.152:0/1227140717 wait complete. 2023-12-06T14:55:50.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:50 smithi190 ceph-mon[121340]: pgmap v33: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-06T14:55:51.327 DEBUG:teuthology.orchestra.run.smithi152:osd.1> sudo journalctl -f -n 0 -u ceph-062f0e3c-9447-11ee-95a2-87774f69a715@osd.1.service 2023-12-06T14:55:51.329 INFO:tasks.cephadm:Deploying osd.2 on smithi152 with /dev/vg_nvme/lv_2... 2023-12-06T14:55:51.329 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-06T14:55:51.363 INFO:journalctl@ceph.osd.1.smithi152.stdout:-- Logs begin at Wed 2023-12-06 14:39:30 UTC. -- 2023-12-06T14:55:51.756 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:55:52.018 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:51 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:52.018 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:51 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:52.018 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:51 smithi152 ceph-mon[111954]: pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-06T14:55:52.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:51 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:52.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:51 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:52.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:51 smithi190 ceph-mon[121340]: pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-06T14:55:52.537 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 14:55:52 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-1[144858]: 2023-12-06T14:55:52.372+0000 7fe51e33b540 -1 osd.1 0 log_to_monitors true 2023-12-06T14:55:53.055 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-06T14:55:53.055 INFO:teuthology.orchestra.run.smithi152.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-06T14:55:53.056 INFO:teuthology.orchestra.run.smithi152.stderr: stderr: 10+0 records in 2023-12-06T14:55:53.056 INFO:teuthology.orchestra.run.smithi152.stderr:10+0 records out 2023-12-06T14:55:53.056 INFO:teuthology.orchestra.run.smithi152.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0114904 s, 913 MB/s 2023-12-06T14:55:53.056 INFO:teuthology.orchestra.run.smithi152.stderr: stderr: 2023-12-06T14:55:53.056 INFO:teuthology.orchestra.run.smithi152.stderr:--> Zapping successful for: 2023-12-06T14:55:53.098 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:52 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:53.099 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:52 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:53.099 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:52 smithi152 ceph-mon[111954]: from='osd.1 [v2:172.21.15.152:6810/1158477634,v1:172.21.15.152:6811/1158477634]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-06T14:55:53.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:52 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:53.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:52 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:53.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:52 smithi190 ceph-mon[121340]: from='osd.1 [v2:172.21.15.152:6810/1158477634,v1:172.21.15.152:6811/1158477634]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-06T14:55:53.582 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi152:vg_nvme/lv_2 2023-12-06T14:55:53.921 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:55:54.128 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 14:55:53 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-1[144858]: 2023-12-06T14:55:53.865+0000 7fe514b20700 -1 osd.1 0 waiting for initial osdmap 2023-12-06T14:55:54.128 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 14:55:53 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-1[144858]: 2023-12-06T14:55:53.871+0000 7fe51091d700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-06T14:55:54.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:53 smithi152 ceph-mon[111954]: from='osd.1 [v2:172.21.15.152:6810/1158477634,v1:172.21.15.152:6811/1158477634]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-06T14:55:54.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:53 smithi152 ceph-mon[111954]: osdmap e12: 2 total, 1 up, 2 in 2023-12-06T14:55:54.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:53 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-06T14:55:54.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:53 smithi152 ceph-mon[111954]: from='osd.1 [v2:172.21.15.152:6810/1158477634,v1:172.21.15.152:6811/1158477634]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-06T14:55:54.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:53 smithi152 ceph-mon[111954]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-06T14:55:54.161 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:53 smithi190 ceph-mon[121340]: from='osd.1 [v2:172.21.15.152:6810/1158477634,v1:172.21.15.152:6811/1158477634]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-06T14:55:54.161 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:53 smithi190 ceph-mon[121340]: osdmap e12: 2 total, 1 up, 2 in 2023-12-06T14:55:54.161 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:53 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-06T14:55:54.161 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:53 smithi190 ceph-mon[121340]: from='osd.1 [v2:172.21.15.152:6810/1158477634,v1:172.21.15.152:6811/1158477634]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-06T14:55:54.161 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:53 smithi190 ceph-mon[121340]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-06T14:55:55.044 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:54 smithi152 ceph-mon[111954]: from='osd.1 [v2:172.21.15.152:6810/1158477634,v1:172.21.15.152:6811/1158477634]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2023-12-06T14:55:55.044 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:54 smithi152 ceph-mon[111954]: osdmap e13: 2 total, 1 up, 2 in 2023-12-06T14:55:55.044 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:54 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-06T14:55:55.044 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:54 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-06T14:55:55.222 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:55.219+0000 7f78df128700 1 -- 172.21.15.152:0/4174737417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78d80fd110 msgr2=0x7f78d80fd520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:55:55.222 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:55.219+0000 7f78df128700 1 --2- 172.21.15.152:0/4174737417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78d80fd110 0x7f78d80fd520 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f78cc004940 tx=0x7f78cc009e30 comp rx=0 tx=0).stop 2023-12-06T14:55:55.222 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:55.219+0000 7f78df128700 1 -- 172.21.15.152:0/4174737417 shutdown_connections 2023-12-06T14:55:55.222 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:55.219+0000 7f78df128700 1 --2- 172.21.15.152:0/4174737417 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78d80fbdd0 0x7f78d80fc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:55:55.222 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:55.219+0000 7f78df128700 1 --2- 172.21.15.152:0/4174737417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78d80fd110 0x7f78d80fd520 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:55:55.222 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:55.219+0000 7f78df128700 1 -- 172.21.15.152:0/4174737417 >> 172.21.15.152:0/4174737417 conn(0x7f78d80f6950 msgr2=0x7f78d80f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:55:55.222 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:55.219+0000 7f78df128700 1 -- 172.21.15.152:0/4174737417 shutdown_connections 2023-12-06T14:55:55.222 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:55.219+0000 7f78df128700 1 -- 172.21.15.152:0/4174737417 wait complete. 2023-12-06T14:55:55.222 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:55.219+0000 7f78df128700 1 Processor -- start 2023-12-06T14:55:55.222 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:55.219+0000 7f78df128700 1 -- start start 2023-12-06T14:55:55.222 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:55.220+0000 7f78df128700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78d80fbdd0 0x7f78d8110330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:55:55.223 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:55.220+0000 7f78df128700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78d80fd110 0x7f78d8112880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:55:55.223 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:55.220+0000 7f78df128700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d80fbb10 con 0x7f78d80fd110 2023-12-06T14:55:55.223 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:55.220+0000 7f78df128700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d80fbc50 con 0x7f78d80fbdd0 2023-12-06T14:55:55.223 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:55.220+0000 7f78d7fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78d80fd110 0x7f78d8112880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:55:55.223 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:55.220+0000 7f78d7fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78d80fd110 0x7f78d8112880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46602/0 (socket says 172.21.15.152:46602) 2023-12-06T14:55:55.223 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:55.220+0000 7f78d7fff700 1 -- 172.21.15.152:0/4262071981 learned_addr learned my addr 172.21.15.152:0/4262071981 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:55:55.223 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:55.220+0000 7f78dcec4700 1 --2- 172.21.15.152:0/4262071981 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78d80fbdd0 0x7f78d8110330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:55:55.223 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:55.220+0000 7f78d7fff700 1 -- 172.21.15.152:0/4262071981 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78d80fbdd0 msgr2=0x7f78d8110330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:55:55.223 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:55.220+0000 7f78d7fff700 1 --2- 172.21.15.152:0/4262071981 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78d80fbdd0 0x7f78d8110330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:55:55.223 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:55.220+0000 7f78d7fff700 1 -- 172.21.15.152:0/4262071981 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78cc005040 con 0x7f78d80fd110 2023-12-06T14:55:55.223 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:55.220+0000 7f78d7fff700 1 --2- 172.21.15.152:0/4262071981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78d80fd110 0x7f78d8112880 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f78c400b7c0 tx=0x7f78c4009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:55:55.223 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:55.220+0000 7f78d57fa700 1 -- 172.21.15.152:0/4262071981 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78c400f6f0 con 0x7f78d80fd110 2023-12-06T14:55:55.223 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:55.220+0000 7f78d57fa700 1 -- 172.21.15.152:0/4262071981 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f78c400fd00 con 0x7f78d80fd110 2023-12-06T14:55:55.223 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:55.220+0000 7f78df128700 1 -- 172.21.15.152:0/4262071981 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d8112f30 con 0x7f78d80fd110 2023-12-06T14:55:55.223 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:55.220+0000 7f78d57fa700 1 -- 172.21.15.152:0/4262071981 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78c4011e60 con 0x7f78d80fd110 2023-12-06T14:55:55.224 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:55.221+0000 7f78df128700 1 -- 172.21.15.152:0/4262071981 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d8113440 con 0x7f78d80fd110 2023-12-06T14:55:55.224 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:55.221+0000 7f78df128700 1 -- 172.21.15.152:0/4262071981 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78d804bb80 con 0x7f78d80fd110 2023-12-06T14:55:55.224 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:55.222+0000 7f78d57fa700 1 -- 172.21.15.152:0/4262071981 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 18) v1 ==== 86393+0+0 (secure 0 0 0) 0x7f78c4011690 con 0x7f78d80fd110 2023-12-06T14:55:55.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:55.222+0000 7f78d57fa700 1 --2- 172.21.15.152:0/4262071981 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f78c8068ed0 0x7f78c806b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:55:55.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:55.222+0000 7f78d57fa700 1 -- 172.21.15.152:0/4262071981 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2410+0+0 (secure 0 0 0) 0x7f78c4085e80 con 0x7f78d80fd110 2023-12-06T14:55:55.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:55.222+0000 7f78dcec4700 1 --2- 172.21.15.152:0/4262071981 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f78c8068ed0 0x7f78c806b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:55:55.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:55.223+0000 7f78dcec4700 1 --2- 172.21.15.152:0/4262071981 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f78c8068ed0 0x7f78c806b380 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f78cc000c00 tx=0x7f78cc009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:55:55.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:55.227+0000 7f78d57fa700 1 -- 172.21.15.152:0/4262071981 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f78c4053020 con 0x7f78d80fd110 2023-12-06T14:55:55.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:54 smithi190 ceph-mon[121340]: from='osd.1 [v2:172.21.15.152:6810/1158477634,v1:172.21.15.152:6811/1158477634]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2023-12-06T14:55:55.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:54 smithi190 ceph-mon[121340]: osdmap e13: 2 total, 1 up, 2 in 2023-12-06T14:55:55.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:54 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-06T14:55:55.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:54 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-06T14:55:55.435 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:55:55.434+0000 7f78df128700 1 -- 172.21.15.152:0/4262071981 --> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f78d8113690 con 0x7f78c8068ed0 2023-12-06T14:55:56.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:55 smithi152 ceph-mon[111954]: purged_snaps scrub starts 2023-12-06T14:55:56.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:55 smithi152 ceph-mon[111954]: purged_snaps scrub ok 2023-12-06T14:55:56.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:55 smithi152 ceph-mon[111954]: osd.1 [v2:172.21.15.152:6810/1158477634,v1:172.21.15.152:6811/1158477634] boot 2023-12-06T14:55:56.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:55 smithi152 ceph-mon[111954]: osdmap e14: 2 total, 2 up, 2 in 2023-12-06T14:55:56.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:55 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-06T14:55:56.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:55 smithi152 ceph-mon[111954]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-06T14:55:56.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:55 smithi152 ceph-mon[111954]: Detected new or changed devices on smithi152 2023-12-06T14:55:56.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:55 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:56.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:55 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:56.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:55 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:55:56.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:55 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:55:56.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:55 smithi152 ceph-mon[111954]: Adjusting osd_memory_target on smithi152 to 6449M 2023-12-06T14:55:56.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:55 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:56.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:55 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:55:56.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:55 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:55:56.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:55 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:56.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:55 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:55:56.130 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:55 smithi152 ceph-mon[111954]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:55:56.130 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:55 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-06T14:55:56.130 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:55 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-06T14:55:56.130 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:55 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:55:56.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:55 smithi190 ceph-mon[121340]: purged_snaps scrub starts 2023-12-06T14:55:56.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:55 smithi190 ceph-mon[121340]: purged_snaps scrub ok 2023-12-06T14:55:56.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:55 smithi190 ceph-mon[121340]: osd.1 [v2:172.21.15.152:6810/1158477634,v1:172.21.15.152:6811/1158477634] boot 2023-12-06T14:55:56.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:55 smithi190 ceph-mon[121340]: osdmap e14: 2 total, 2 up, 2 in 2023-12-06T14:55:56.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:55 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-06T14:55:56.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:55 smithi190 ceph-mon[121340]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2023-12-06T14:55:56.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:55 smithi190 ceph-mon[121340]: Detected new or changed devices on smithi152 2023-12-06T14:55:56.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:55 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:56.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:55 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:56.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:55 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:55:56.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:55 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:55:56.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:55 smithi190 ceph-mon[121340]: Adjusting osd_memory_target on smithi152 to 6449M 2023-12-06T14:55:56.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:55 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:56.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:55 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:55:56.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:55 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:55:56.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:55 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:56.324 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:55 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:55:56.324 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:55 smithi190 ceph-mon[121340]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi152:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:55:56.324 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:55 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-06T14:55:56.324 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:55 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-06T14:55:56.324 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:55 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:55:57.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:56 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:55:57.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:56 smithi152 ceph-mon[111954]: osdmap e15: 2 total, 2 up, 2 in 2023-12-06T14:55:57.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:56 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:55:57.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:56 smithi190 ceph-mon[121340]: osdmap e15: 2 total, 2 up, 2 in 2023-12-06T14:55:58.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:57 smithi190 ceph-mon[121340]: pgmap v41: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-06T14:55:58.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:57 smithi152 ceph-mon[111954]: pgmap v41: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-06T14:55:59.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:58 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/3498964542' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8dce6383-8296-4737-99d9-427bbd62f9a9"}]: dispatch 2023-12-06T14:55:59.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:58 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/3498964542' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8dce6383-8296-4737-99d9-427bbd62f9a9"}]': finished 2023-12-06T14:55:59.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:58 smithi190 ceph-mon[121340]: osdmap e16: 3 total, 2 up, 3 in 2023-12-06T14:55:59.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:58 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-06T14:55:59.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:58 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/217785167' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-06T14:55:59.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:58 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:59.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:58 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:59.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:58 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:55:59.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:58 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:55:59.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:58 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:59.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:58 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/3498964542' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8dce6383-8296-4737-99d9-427bbd62f9a9"}]: dispatch 2023-12-06T14:55:59.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:58 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/3498964542' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8dce6383-8296-4737-99d9-427bbd62f9a9"}]': finished 2023-12-06T14:55:59.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:58 smithi152 ceph-mon[111954]: osdmap e16: 3 total, 2 up, 3 in 2023-12-06T14:55:59.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:58 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-06T14:55:59.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:58 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/217785167' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-06T14:55:59.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:58 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:59.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:58 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:55:59.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:58 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:55:59.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:58 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:55:59.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:58 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:00.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:55:59 smithi190 ceph-mon[121340]: pgmap v43: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-06T14:56:00.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:55:59 smithi152 ceph-mon[111954]: pgmap v43: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-06T14:56:02.215 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:01 smithi152 ceph-mon[111954]: pgmap v44: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-06T14:56:02.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:01 smithi190 ceph-mon[121340]: pgmap v44: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-06T14:56:04.267 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:03 smithi152 ceph-mon[111954]: pgmap v45: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-06T14:56:04.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:03 smithi190 ceph-mon[121340]: pgmap v45: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-06T14:56:05.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:04 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-06T14:56:05.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:04 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:56:05.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:04 smithi190 ceph-mon[121340]: Deploying daemon osd.2 on smithi152 2023-12-06T14:56:05.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:04 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-06T14:56:05.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:04 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:56:05.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:04 smithi152 ceph-mon[111954]: Deploying daemon osd.2 on smithi152 2023-12-06T14:56:06.017 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:05 smithi152 ceph-mon[111954]: pgmap v46: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-06T14:56:06.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:05 smithi190 ceph-mon[121340]: pgmap v46: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-06T14:56:08.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:08 smithi152 ceph-mon[111954]: pgmap v47: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-06T14:56:08.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:08 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:08.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:08 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:08.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:08 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:56:08.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:08 smithi190 ceph-mon[121340]: pgmap v47: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-06T14:56:08.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:08 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:08.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:08 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:08.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:08 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:56:10.161 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:10 smithi152 ceph-mon[111954]: pgmap v48: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-06T14:56:10.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:56:10.180+0000 7f78d57fa700 1 -- 172.21.15.152:0/4262071981 <== mgr.14210 v2:172.21.15.152:6800/3317409709 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f78d8113690 con 0x7f78c8068ed0 2023-12-06T14:56:10.181 INFO:teuthology.orchestra.run.smithi152.stdout:Created osd(s) 2 on host 'smithi152' 2023-12-06T14:56:10.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:56:10.184+0000 7f78df128700 1 -- 172.21.15.152:0/4262071981 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f78c8068ed0 msgr2=0x7f78c806b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:56:10.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:56:10.184+0000 7f78df128700 1 --2- 172.21.15.152:0/4262071981 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f78c8068ed0 0x7f78c806b380 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f78cc000c00 tx=0x7f78cc009e30 comp rx=0 tx=0).stop 2023-12-06T14:56:10.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:56:10.184+0000 7f78df128700 1 -- 172.21.15.152:0/4262071981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78d80fd110 msgr2=0x7f78d8112880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:56:10.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:56:10.184+0000 7f78df128700 1 --2- 172.21.15.152:0/4262071981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78d80fd110 0x7f78d8112880 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f78c400b7c0 tx=0x7f78c4009220 comp rx=0 tx=0).stop 2023-12-06T14:56:10.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:56:10.184+0000 7f78df128700 1 -- 172.21.15.152:0/4262071981 shutdown_connections 2023-12-06T14:56:10.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:56:10.184+0000 7f78df128700 1 --2- 172.21.15.152:0/4262071981 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f78c8068ed0 0x7f78c806b380 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:56:10.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:56:10.184+0000 7f78df128700 1 --2- 172.21.15.152:0/4262071981 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78d80fbdd0 0x7f78d8110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:56:10.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:56:10.184+0000 7f78df128700 1 --2- 172.21.15.152:0/4262071981 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78d80fd110 0x7f78d8112880 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:56:10.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:56:10.184+0000 7f78df128700 1 -- 172.21.15.152:0/4262071981 >> 172.21.15.152:0/4262071981 conn(0x7f78d80f6950 msgr2=0x7f78d8100010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:56:10.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:56:10.184+0000 7f78df128700 1 -- 172.21.15.152:0/4262071981 shutdown_connections 2023-12-06T14:56:10.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:56:10.184+0000 7f78df128700 1 -- 172.21.15.152:0/4262071981 wait complete. 2023-12-06T14:56:10.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:10 smithi190 ceph-mon[121340]: pgmap v48: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-06T14:56:10.706 DEBUG:teuthology.orchestra.run.smithi152:osd.2> sudo journalctl -f -n 0 -u ceph-062f0e3c-9447-11ee-95a2-87774f69a715@osd.2.service 2023-12-06T14:56:10.708 INFO:tasks.cephadm:Deploying osd.3 on smithi190 with /dev/vg_nvme/lv_4... 2023-12-06T14:56:10.709 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-06T14:56:10.740 INFO:journalctl@ceph.osd.2.smithi152.stdout:-- Logs begin at Wed 2023-12-06 14:39:30 UTC. -- 2023-12-06T14:56:10.975 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi190/config 2023-12-06T14:56:11.364 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:11 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:11.365 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:11 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:11.365 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:11 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:56:11.432 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:11 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:11.433 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:11 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:11.433 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:11 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:56:12.118 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 14:56:11 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-2[154671]: 2023-12-06T14:56:11.800+0000 7f4d51a33540 -1 osd.2 0 log_to_monitors true 2023-12-06T14:56:12.237 INFO:teuthology.orchestra.run.smithi190.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-06T14:56:12.237 INFO:teuthology.orchestra.run.smithi190.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-06T14:56:12.237 INFO:teuthology.orchestra.run.smithi190.stderr: stderr: 10+0 records in 2023-12-06T14:56:12.238 INFO:teuthology.orchestra.run.smithi190.stderr:10+0 records out 2023-12-06T14:56:12.238 INFO:teuthology.orchestra.run.smithi190.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0110981 s, 945 MB/s 2023-12-06T14:56:12.238 INFO:teuthology.orchestra.run.smithi190.stderr:--> Zapping successful for: 2023-12-06T14:56:12.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:12 smithi152 ceph-mon[111954]: pgmap v49: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-06T14:56:12.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:12 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:12.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:12 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:12.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:12 smithi152 ceph-mon[111954]: from='osd.2 [v2:172.21.15.152:6818/3416520485,v1:172.21.15.152:6819/3416520485]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-06T14:56:12.536 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:12 smithi190 ceph-mon[121340]: pgmap v49: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-06T14:56:12.536 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:12 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:12.536 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:12 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:12.536 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:12 smithi190 ceph-mon[121340]: from='osd.2 [v2:172.21.15.152:6818/3416520485,v1:172.21.15.152:6819/3416520485]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-06T14:56:12.612 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi190:vg_nvme/lv_4 2023-12-06T14:56:12.868 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi190/config 2023-12-06T14:56:13.840 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:13.834+0000 7f5aac5ad700 1 -- 172.21.15.190:0/3854200263 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5aa4066920 msgr2=0x7f5aa40ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:56:13.840 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:13.834+0000 7f5aac5ad700 1 --2- 172.21.15.190:0/3854200263 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5aa4066920 0x7f5aa40ff7a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0004940 tx=0x7f5aa0009e30 comp rx=0 tx=0).stop 2023-12-06T14:56:13.840 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:13.835+0000 7f5aac5ad700 1 -- 172.21.15.190:0/3854200263 shutdown_connections 2023-12-06T14:56:13.840 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:13.835+0000 7f5aac5ad700 1 --2- 172.21.15.190:0/3854200263 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5aa40ffd70 0x7f5aa41021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:56:13.840 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:13.835+0000 7f5aac5ad700 1 --2- 172.21.15.190:0/3854200263 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5aa4066920 0x7f5aa40ff7a0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:56:13.841 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:13.835+0000 7f5aac5ad700 1 -- 172.21.15.190:0/3854200263 >> 172.21.15.190:0/3854200263 conn(0x7f5aa40f71b0 msgr2=0x7f5aa40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:56:13.841 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:13.835+0000 7f5aac5ad700 1 -- 172.21.15.190:0/3854200263 shutdown_connections 2023-12-06T14:56:13.841 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:13.835+0000 7f5aac5ad700 1 -- 172.21.15.190:0/3854200263 wait complete. 2023-12-06T14:56:13.841 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:13.835+0000 7f5aac5ad700 1 Processor -- start 2023-12-06T14:56:13.841 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:13.835+0000 7f5aac5ad700 1 -- start start 2023-12-06T14:56:13.841 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:13.835+0000 7f5aac5ad700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5aa4066920 0x7f5aa410d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:56:13.842 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:13.835+0000 7f5aac5ad700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5aa40ffd70 0x7f5aa410dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:56:13.842 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:13.835+0000 7f5aac5ad700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa410e150 con 0x7f5aa40ffd70 2023-12-06T14:56:13.842 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:13.835+0000 7f5aac5ad700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa410e990 con 0x7f5aa4066920 2023-12-06T14:56:13.842 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:13.835+0000 7f5aaa349700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5aa4066920 0x7f5aa410d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:56:13.842 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:13.836+0000 7f5aaa349700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5aa4066920 0x7f5aa410d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:45028/0 (socket says 172.21.15.190:45028) 2023-12-06T14:56:13.842 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:13.836+0000 7f5aaa349700 1 -- 172.21.15.190:0/2564561417 learned_addr learned my addr 172.21.15.190:0/2564561417 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-12-06T14:56:13.843 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:13.836+0000 7f5aa9b48700 1 --2- 172.21.15.190:0/2564561417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5aa40ffd70 0x7f5aa410dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:56:13.843 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:13.836+0000 7f5aaa349700 1 -- 172.21.15.190:0/2564561417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5aa40ffd70 msgr2=0x7f5aa410dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:56:13.843 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:13.836+0000 7f5aaa349700 1 --2- 172.21.15.190:0/2564561417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5aa40ffd70 0x7f5aa410dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:56:13.843 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:13.836+0000 7f5aaa349700 1 -- 172.21.15.190:0/2564561417 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa0005040 con 0x7f5aa4066920 2023-12-06T14:56:13.843 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:13.836+0000 7f5aaa349700 1 --2- 172.21.15.190:0/2564561417 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5aa4066920 0x7f5aa410d580 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0009fd0 tx=0x7f5aa0009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:56:13.843 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:13.836+0000 7f5a9affd700 1 -- 172.21.15.190:0/2564561417 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5aa000e040 con 0x7f5aa4066920 2023-12-06T14:56:13.843 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:13.836+0000 7f5aac5ad700 1 -- 172.21.15.190:0/2564561417 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aa410ec10 con 0x7f5aa4066920 2023-12-06T14:56:13.844 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:13.836+0000 7f5a9affd700 1 -- 172.21.15.190:0/2564561417 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5aa0004290 con 0x7f5aa4066920 2023-12-06T14:56:13.844 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:13.836+0000 7f5a9affd700 1 -- 172.21.15.190:0/2564561417 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5aa001c3f0 con 0x7f5aa4066920 2023-12-06T14:56:13.844 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:13.836+0000 7f5aac5ad700 1 -- 172.21.15.190:0/2564561417 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aa410f150 con 0x7f5aa4066920 2023-12-06T14:56:13.844 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:13.837+0000 7f5aac5ad700 1 -- 172.21.15.190:0/2564561417 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aa404bb80 con 0x7f5aa4066920 2023-12-06T14:56:13.844 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:13.837+0000 7f5a9affd700 1 -- 172.21.15.190:0/2564561417 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 18) v1 ==== 86393+0+0 (secure 0 0 0) 0x7f5aa0013420 con 0x7f5aa4066920 2023-12-06T14:56:13.844 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:13.838+0000 7f5a9affd700 1 --2- 172.21.15.190:0/2564561417 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f5a90068ed0 0x7f5a9006b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:56:13.845 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:13.838+0000 7f5a9affd700 1 -- 172.21.15.190:0/2564561417 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 2562+0+0 (secure 0 0 0) 0x7f5aa00875b0 con 0x7f5aa4066920 2023-12-06T14:56:13.845 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:13.838+0000 7f5aa9b48700 1 --2- 172.21.15.190:0/2564561417 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f5a90068ed0 0x7f5a9006b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:56:13.845 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:13.838+0000 7f5aa9b48700 1 --2- 172.21.15.190:0/2564561417 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f5a90068ed0 0x7f5a9006b380 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5a94006fd0 tx=0x7f5a94008040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:56:13.845 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:13.842+0000 7f5a9affd700 1 -- 172.21.15.190:0/2564561417 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5aa00580c0 con 0x7f5aa4066920 2023-12-06T14:56:13.992 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 14:56:13 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-2[154671]: 2023-12-06T14:56:13.680+0000 7f4d48218700 -1 osd.2 0 waiting for initial osdmap 2023-12-06T14:56:13.992 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 14:56:13 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-2[154671]: 2023-12-06T14:56:13.686+0000 7f4d44816700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-06T14:56:13.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:13 smithi152 ceph-mon[111954]: from='osd.2 [v2:172.21.15.152:6818/3416520485,v1:172.21.15.152:6819/3416520485]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-06T14:56:13.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:13 smithi152 ceph-mon[111954]: osdmap e17: 3 total, 2 up, 3 in 2023-12-06T14:56:13.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:13 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-06T14:56:13.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:13 smithi152 ceph-mon[111954]: from='osd.2 [v2:172.21.15.152:6818/3416520485,v1:172.21.15.152:6819/3416520485]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-06T14:56:13.993 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:13 smithi152 ceph-mon[111954]: pgmap v51: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-06T14:56:14.029 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:14.028+0000 7f5aac5ad700 1 -- 172.21.15.190:0/2564561417 --> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f5aa410f570 con 0x7f5a90068ed0 2023-12-06T14:56:14.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:13 smithi190 ceph-mon[121340]: from='osd.2 [v2:172.21.15.152:6818/3416520485,v1:172.21.15.152:6819/3416520485]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-06T14:56:14.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:13 smithi190 ceph-mon[121340]: osdmap e17: 3 total, 2 up, 3 in 2023-12-06T14:56:14.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:13 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-06T14:56:14.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:13 smithi190 ceph-mon[121340]: from='osd.2 [v2:172.21.15.152:6818/3416520485,v1:172.21.15.152:6819/3416520485]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-06T14:56:14.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:13 smithi190 ceph-mon[121340]: pgmap v51: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-06T14:56:14.766 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:14 smithi190 ceph-mon[121340]: from='osd.2 [v2:172.21.15.152:6818/3416520485,v1:172.21.15.152:6819/3416520485]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2023-12-06T14:56:14.766 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:14 smithi190 ceph-mon[121340]: osdmap e18: 3 total, 2 up, 3 in 2023-12-06T14:56:14.766 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:14 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-06T14:56:14.766 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:14 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-06T14:56:14.766 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:14 smithi190 ceph-mon[121340]: from='client.24129 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:56:14.766 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:14 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-06T14:56:14.766 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:14 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-06T14:56:14.766 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:14 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:56:14.766 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:14 smithi190 ceph-mon[121340]: Detected new or changed devices on smithi152 2023-12-06T14:56:14.766 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:14 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:14.767 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:14 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:14.767 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:14 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:56:14.767 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:14 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:56:14.767 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:14 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:56:14.767 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:14 smithi190 ceph-mon[121340]: Adjusting osd_memory_target on smithi152 to 4299M 2023-12-06T14:56:14.767 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:14 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:14.767 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:14 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:56:14.767 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:14 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:56:14.767 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:14 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:14.767 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:14 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:56:14.767 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:14 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:56:14.767 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:14 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:56:14.767 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:14 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:14.768 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:14 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-06T14:56:15.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:14 smithi152 ceph-mon[111954]: from='osd.2 [v2:172.21.15.152:6818/3416520485,v1:172.21.15.152:6819/3416520485]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]': finished 2023-12-06T14:56:15.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:14 smithi152 ceph-mon[111954]: osdmap e18: 3 total, 2 up, 3 in 2023-12-06T14:56:15.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:14 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-06T14:56:15.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:14 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-06T14:56:15.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:14 smithi152 ceph-mon[111954]: from='client.24129 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:56:15.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:14 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-06T14:56:15.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:14 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-06T14:56:15.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:14 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:56:15.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:14 smithi152 ceph-mon[111954]: Detected new or changed devices on smithi152 2023-12-06T14:56:15.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:14 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:15.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:14 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:15.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:14 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:56:15.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:14 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:56:15.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:14 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:56:15.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:14 smithi152 ceph-mon[111954]: Adjusting osd_memory_target on smithi152 to 4299M 2023-12-06T14:56:15.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:14 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:15.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:14 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:56:15.130 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:14 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:56:15.130 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:14 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:15.130 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:14 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:56:15.130 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:14 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:56:15.130 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:14 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:56:15.130 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:14 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:15.130 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:14 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-06T14:56:16.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:15 smithi190 ceph-mon[121340]: purged_snaps scrub starts 2023-12-06T14:56:16.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:15 smithi190 ceph-mon[121340]: purged_snaps scrub ok 2023-12-06T14:56:16.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:15 smithi190 ceph-mon[121340]: osd.2 [v2:172.21.15.152:6818/3416520485,v1:172.21.15.152:6819/3416520485] boot 2023-12-06T14:56:16.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:15 smithi190 ceph-mon[121340]: osdmap e19: 3 total, 3 up, 3 in 2023-12-06T14:56:16.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:15 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-06T14:56:16.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:15 smithi190 ceph-mon[121340]: pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-06T14:56:16.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:15 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-12-06T14:56:16.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:15 smithi152 ceph-mon[111954]: purged_snaps scrub starts 2023-12-06T14:56:16.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:15 smithi152 ceph-mon[111954]: purged_snaps scrub ok 2023-12-06T14:56:16.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:15 smithi152 ceph-mon[111954]: osd.2 [v2:172.21.15.152:6818/3416520485,v1:172.21.15.152:6819/3416520485] boot 2023-12-06T14:56:16.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:15 smithi152 ceph-mon[111954]: osdmap e19: 3 total, 3 up, 3 in 2023-12-06T14:56:16.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:15 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-06T14:56:16.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:15 smithi152 ceph-mon[111954]: pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2023-12-06T14:56:16.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:15 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2023-12-06T14:56:17.065 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 14:56:16 smithi152 sudo[159977]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-06T14:56:17.066 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 14:56:16 smithi152 sudo[159977]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-06T14:56:17.066 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 14:56:16 smithi152 sudo[159977]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-06T14:56:17.066 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 14:56:16 smithi152 sudo[159977]: pam_unix(sudo:session): session closed for user root 2023-12-06T14:56:17.066 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:16 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2023-12-06T14:56:17.066 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:16 smithi152 ceph-mon[111954]: osdmap e20: 3 total, 3 up, 3 in 2023-12-06T14:56:17.066 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:16 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-06T14:56:17.066 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:16 smithi152 ceph-mon[111954]: from='client.? 172.21.15.190:0/876368488' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea52387d-fb71-4ed5-bde5-85550b5cc117"}]: dispatch 2023-12-06T14:56:17.066 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:16 smithi152 ceph-mon[111954]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea52387d-fb71-4ed5-bde5-85550b5cc117"}]: dispatch 2023-12-06T14:56:17.066 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:16 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-06T14:56:17.066 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:16 smithi152 ceph-mon[111954]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea52387d-fb71-4ed5-bde5-85550b5cc117"}]': finished 2023-12-06T14:56:17.067 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:16 smithi152 ceph-mon[111954]: osdmap e21: 4 total, 3 up, 4 in 2023-12-06T14:56:17.067 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:16 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-06T14:56:17.067 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:16 smithi152 ceph-mon[111954]: from='client.? 172.21.15.190:0/4176141697' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-06T14:56:17.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:16 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2023-12-06T14:56:17.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:16 smithi190 ceph-mon[121340]: osdmap e20: 3 total, 3 up, 3 in 2023-12-06T14:56:17.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:16 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-06T14:56:17.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:16 smithi190 ceph-mon[121340]: from='client.? 172.21.15.190:0/876368488' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea52387d-fb71-4ed5-bde5-85550b5cc117"}]: dispatch 2023-12-06T14:56:17.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:16 smithi190 ceph-mon[121340]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea52387d-fb71-4ed5-bde5-85550b5cc117"}]: dispatch 2023-12-06T14:56:17.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:16 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-06T14:56:17.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:16 smithi190 ceph-mon[121340]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea52387d-fb71-4ed5-bde5-85550b5cc117"}]': finished 2023-12-06T14:56:17.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:16 smithi190 ceph-mon[121340]: osdmap e21: 4 total, 3 up, 4 in 2023-12-06T14:56:17.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:16 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-06T14:56:17.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:16 smithi190 ceph-mon[121340]: from='client.? 172.21.15.190:0/4176141697' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-06T14:56:17.321 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 14:56:17 smithi152 sudo[159980]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-06T14:56:17.321 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 14:56:17 smithi152 sudo[159980]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-06T14:56:17.321 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 14:56:17 smithi152 sudo[159980]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-06T14:56:17.321 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 14:56:17 smithi152 sudo[159980]: pam_unix(sudo:session): session closed for user root 2023-12-06T14:56:17.628 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 14:56:17 smithi152 sudo[159983]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-06T14:56:17.628 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 14:56:17 smithi152 sudo[159983]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-06T14:56:17.628 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 14:56:17 smithi152 sudo[159983]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-06T14:56:17.628 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 14:56:17 smithi152 sudo[159983]: pam_unix(sudo:session): session closed for user root 2023-12-06T14:56:17.628 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 14:56:17 smithi152 sudo[159986]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-06T14:56:17.628 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 14:56:17 smithi152 sudo[159986]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-06T14:56:17.628 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 14:56:17 smithi152 sudo[159986]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-06T14:56:17.628 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 14:56:17 smithi152 sudo[159986]: pam_unix(sudo:session): session closed for user root 2023-12-06T14:56:18.056 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:17 smithi152 ceph-mon[111954]: osdmap e22: 4 total, 3 up, 4 in 2023-12-06T14:56:18.056 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:17 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-06T14:56:18.057 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:17 smithi152 ceph-mon[111954]: pgmap v58: 1 pgs: 1 creating+peering; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-06T14:56:18.057 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:17 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:18.057 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 14:56:17 smithi152 sudo[159989]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-06T14:56:18.057 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 14:56:17 smithi152 sudo[159989]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-06T14:56:18.057 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 14:56:17 smithi152 sudo[159989]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-06T14:56:18.057 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 14:56:17 smithi152 sudo[159989]: pam_unix(sudo:session): session closed for user root 2023-12-06T14:56:18.307 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:18 smithi152 sudo[159995]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-06T14:56:18.308 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:18 smithi152 sudo[159995]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-06T14:56:18.308 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:18 smithi152 sudo[159995]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-06T14:56:18.308 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:18 smithi152 sudo[159995]: pam_unix(sudo:session): session closed for user root 2023-12-06T14:56:18.308 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 14:56:18 smithi152 sudo[159992]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-06T14:56:18.308 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 14:56:18 smithi152 sudo[159992]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-06T14:56:18.308 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 14:56:18 smithi152 sudo[159992]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-06T14:56:18.308 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 14:56:18 smithi152 sudo[159992]: pam_unix(sudo:session): session closed for user root 2023-12-06T14:56:18.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:17 smithi190 ceph-mon[121340]: osdmap e22: 4 total, 3 up, 4 in 2023-12-06T14:56:18.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:17 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-06T14:56:18.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:17 smithi190 ceph-mon[121340]: pgmap v58: 1 pgs: 1 creating+peering; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-06T14:56:18.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:17 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:18.547 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:18.545+0000 7f5a9affd700 1 -- 172.21.15.190:0/2564561417 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f5aa005d070 con 0x7f5aa4066920 2023-12-06T14:56:18.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:18 smithi152 sudo[159998]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-06T14:56:18.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:18 smithi152 sudo[159998]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-06T14:56:18.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:18 smithi152 sudo[159998]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-06T14:56:18.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:18 smithi152 sudo[159998]: pam_unix(sudo:session): session closed for user root 2023-12-06T14:56:19.035 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:18 smithi190 sudo[126279]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-06T14:56:19.035 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:18 smithi190 sudo[126279]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-06T14:56:19.036 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:18 smithi190 sudo[126279]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-06T14:56:19.036 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:18 smithi190 sudo[126279]: pam_unix(sudo:session): session closed for user root 2023-12-06T14:56:19.036 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:19 smithi190 sudo[126468]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-06T14:56:19.036 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:19 smithi190 sudo[126468]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-06T14:56:19.036 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:19 smithi190 sudo[126468]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-06T14:56:19.036 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:19 smithi190 sudo[126468]: pam_unix(sudo:session): session closed for user root 2023-12-06T14:56:19.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:19 smithi190 ceph-mon[121340]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-06T14:56:19.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:19 smithi190 ceph-mon[121340]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-06T14:56:19.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:19 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-06T14:56:19.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:19 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi190"}]: dispatch 2023-12-06T14:56:19.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:19 smithi190 ceph-mon[121340]: mgrmap e19: smithi152.meodco(active, since 97s), standbys: smithi190.ubusrr 2023-12-06T14:56:19.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:19 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-06T14:56:19.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:19 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi190"}]: dispatch 2023-12-06T14:56:19.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:19 smithi152 ceph-mon[111954]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-06T14:56:19.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:19 smithi152 ceph-mon[111954]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-06T14:56:19.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:19 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-06T14:56:19.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:19 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi190"}]: dispatch 2023-12-06T14:56:19.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:19 smithi152 ceph-mon[111954]: mgrmap e19: smithi152.meodco(active, since 97s), standbys: smithi190.ubusrr 2023-12-06T14:56:19.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:19 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-06T14:56:19.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:19 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi190"}]: dispatch 2023-12-06T14:56:20.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:20 smithi190 ceph-mon[121340]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-06T14:56:20.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:20 smithi190 ceph-mon[121340]: pgmap v59: 1 pgs: 1 creating+peering; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-06T14:56:20.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:20 smithi190 ceph-mon[121340]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-06T14:56:20.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:20 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:20.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:20 smithi152 ceph-mon[111954]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-06T14:56:20.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:20 smithi152 ceph-mon[111954]: pgmap v59: 1 pgs: 1 creating+peering; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2023-12-06T14:56:20.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:20 smithi152 ceph-mon[111954]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-06T14:56:20.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:20 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:22.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:22 smithi190 ceph-mon[121340]: pgmap v60: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-06T14:56:22.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:22 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-06T14:56:22.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:22 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:56:22.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:22 smithi152 ceph-mon[111954]: pgmap v60: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-06T14:56:22.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:22 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-06T14:56:22.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:22 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:56:23.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:23 smithi190 ceph-mon[121340]: Deploying daemon osd.3 on smithi190 2023-12-06T14:56:23.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:23 smithi152 ceph-mon[111954]: Deploying daemon osd.3 on smithi190 2023-12-06T14:56:24.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:24 smithi190 ceph-mon[121340]: pgmap v61: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-06T14:56:24.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:24 smithi152 ceph-mon[111954]: pgmap v61: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-06T14:56:26.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:26 smithi190 ceph-mon[121340]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-06T14:56:26.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:26 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:26.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:26 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:26.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:26 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:56:26.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:26 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:56:26.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:26 smithi152 ceph-mon[111954]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-06T14:56:26.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:26 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:26.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:26 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:26.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:26 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:56:26.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:26 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:56:27.980 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:27.979+0000 7f5a9affd700 1 -- 172.21.15.190:0/2564561417 <== mgr.14210 v2:172.21.15.152:6800/3317409709 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5aa410f570 con 0x7f5a90068ed0 2023-12-06T14:56:27.980 INFO:teuthology.orchestra.run.smithi190.stdout:Created osd(s) 3 on host 'smithi190' 2023-12-06T14:56:27.982 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:27.981+0000 7f5aac5ad700 1 -- 172.21.15.190:0/2564561417 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f5a90068ed0 msgr2=0x7f5a9006b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:56:27.982 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:27.981+0000 7f5aac5ad700 1 --2- 172.21.15.190:0/2564561417 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f5a90068ed0 0x7f5a9006b380 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5a94006fd0 tx=0x7f5a94008040 comp rx=0 tx=0).stop 2023-12-06T14:56:27.982 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:27.981+0000 7f5aac5ad700 1 -- 172.21.15.190:0/2564561417 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5aa4066920 msgr2=0x7f5aa410d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:56:27.982 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:27.981+0000 7f5aac5ad700 1 --2- 172.21.15.190:0/2564561417 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5aa4066920 0x7f5aa410d580 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0009fd0 tx=0x7f5aa0009e30 comp rx=0 tx=0).stop 2023-12-06T14:56:27.982 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:27.981+0000 7f5aac5ad700 1 -- 172.21.15.190:0/2564561417 shutdown_connections 2023-12-06T14:56:27.982 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:27.981+0000 7f5aac5ad700 1 --2- 172.21.15.190:0/2564561417 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f5a90068ed0 0x7f5a9006b380 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:56:27.982 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:27.981+0000 7f5aac5ad700 1 --2- 172.21.15.190:0/2564561417 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5aa4066920 0x7f5aa410d580 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:56:27.982 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:27.981+0000 7f5aac5ad700 1 --2- 172.21.15.190:0/2564561417 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5aa40ffd70 0x7f5aa410dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:56:27.982 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:27.981+0000 7f5aac5ad700 1 -- 172.21.15.190:0/2564561417 >> 172.21.15.190:0/2564561417 conn(0x7f5aa40f71b0 msgr2=0x7f5aa40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:56:27.982 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:27.981+0000 7f5aac5ad700 1 -- 172.21.15.190:0/2564561417 shutdown_connections 2023-12-06T14:56:27.982 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:27.981+0000 7f5aac5ad700 1 -- 172.21.15.190:0/2564561417 wait complete. 2023-12-06T14:56:28.390 DEBUG:teuthology.orchestra.run.smithi190:osd.3> sudo journalctl -f -n 0 -u ceph-062f0e3c-9447-11ee-95a2-87774f69a715@osd.3.service 2023-12-06T14:56:28.392 INFO:tasks.cephadm:Deploying osd.4 on smithi190 with /dev/vg_nvme/lv_3... 2023-12-06T14:56:28.392 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-06T14:56:28.421 INFO:journalctl@ceph.osd.3.smithi190.stdout:-- Logs begin at Wed 2023-12-06 14:39:30 UTC. -- 2023-12-06T14:56:28.681 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:28 smithi190 ceph-mon[121340]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-06T14:56:28.681 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:28 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:28.681 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:28 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:28.681 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:28 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:56:28.681 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:28 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:56:28.681 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:28 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:28.681 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:28 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:28.681 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:28 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:28.682 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:28 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:56:28.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:28 smithi152 ceph-mon[111954]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-06T14:56:28.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:28 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:28.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:28 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:28.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:28 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:56:28.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:28 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:56:28.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:28 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:28.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:28 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:28.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:28 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:28.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:28 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:56:29.042 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi190/config 2023-12-06T14:56:29.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:29 smithi190 ceph-mon[121340]: from='osd.3 [v2:172.21.15.190:6800/977527629,v1:172.21.15.190:6801/977527629]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-06T14:56:29.823 INFO:journalctl@ceph.osd.3.smithi190.stdout:Dec 06 14:56:29 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-3[127701]: 2023-12-06T14:56:29.522+0000 7f84ac228540 -1 osd.3 0 log_to_monitors true 2023-12-06T14:56:29.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:29 smithi152 ceph-mon[111954]: from='osd.3 [v2:172.21.15.190:6800/977527629,v1:172.21.15.190:6801/977527629]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-06T14:56:30.444 INFO:teuthology.orchestra.run.smithi190.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-06T14:56:30.445 INFO:teuthology.orchestra.run.smithi190.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-06T14:56:30.445 INFO:teuthology.orchestra.run.smithi190.stderr: stderr: 10+0 records in 2023-12-06T14:56:30.445 INFO:teuthology.orchestra.run.smithi190.stderr:10+0 records out 2023-12-06T14:56:30.445 INFO:teuthology.orchestra.run.smithi190.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110751 s, 947 MB/s 2023-12-06T14:56:30.445 INFO:teuthology.orchestra.run.smithi190.stderr:--> Zapping successful for: 2023-12-06T14:56:30.822 INFO:journalctl@ceph.osd.3.smithi190.stdout:Dec 06 14:56:30 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-3[127701]: 2023-12-06T14:56:30.546+0000 7f84a4210700 -1 osd.3 0 waiting for initial osdmap 2023-12-06T14:56:30.822 INFO:journalctl@ceph.osd.3.smithi190.stdout:Dec 06 14:56:30 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-3[127701]: 2023-12-06T14:56:30.551+0000 7f849e80a700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-06T14:56:30.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:30 smithi190 ceph-mon[121340]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-06T14:56:30.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:30 smithi190 ceph-mon[121340]: from='osd.3 [v2:172.21.15.190:6800/977527629,v1:172.21.15.190:6801/977527629]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-06T14:56:30.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:30 smithi190 ceph-mon[121340]: osdmap e23: 4 total, 3 up, 4 in 2023-12-06T14:56:30.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:30 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-06T14:56:30.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:30 smithi190 ceph-mon[121340]: from='osd.3 [v2:172.21.15.190:6800/977527629,v1:172.21.15.190:6801/977527629]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-12-06T14:56:30.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:30 smithi152 ceph-mon[111954]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2023-12-06T14:56:30.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:30 smithi152 ceph-mon[111954]: from='osd.3 [v2:172.21.15.190:6800/977527629,v1:172.21.15.190:6801/977527629]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-06T14:56:30.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:30 smithi152 ceph-mon[111954]: osdmap e23: 4 total, 3 up, 4 in 2023-12-06T14:56:30.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:30 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-06T14:56:30.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:30 smithi152 ceph-mon[111954]: from='osd.3 [v2:172.21.15.190:6800/977527629,v1:172.21.15.190:6801/977527629]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-12-06T14:56:31.203 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi190:vg_nvme/lv_3 2023-12-06T14:56:31.461 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi190/config 2023-12-06T14:56:31.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:31 smithi190 ceph-mon[121340]: from='osd.3 [v2:172.21.15.190:6800/977527629,v1:172.21.15.190:6801/977527629]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2023-12-06T14:56:31.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:31 smithi190 ceph-mon[121340]: osdmap e24: 4 total, 3 up, 4 in 2023-12-06T14:56:31.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:31 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-06T14:56:31.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:31 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-06T14:56:31.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:31 smithi190 ceph-mon[121340]: Detected new or changed devices on smithi190 2023-12-06T14:56:31.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:31 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:31.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:31 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:31.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:31 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:56:31.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:31 smithi190 ceph-mon[121340]: Adjusting osd_memory_target on smithi190 to 15970M 2023-12-06T14:56:31.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:31 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:31.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:31 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:56:31.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:31 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:56:31.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:31 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:31.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:31 smithi190 ceph-mon[121340]: pgmap v67: 1 pgs: 1 peering; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2023-12-06T14:56:31.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:31 smithi152 ceph-mon[111954]: from='osd.3 [v2:172.21.15.190:6800/977527629,v1:172.21.15.190:6801/977527629]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2023-12-06T14:56:31.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:31 smithi152 ceph-mon[111954]: osdmap e24: 4 total, 3 up, 4 in 2023-12-06T14:56:31.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:31 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-06T14:56:31.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:31 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-06T14:56:31.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:31 smithi152 ceph-mon[111954]: Detected new or changed devices on smithi190 2023-12-06T14:56:31.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:31 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:31.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:31 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:31.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:31 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:56:31.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:31 smithi152 ceph-mon[111954]: Adjusting osd_memory_target on smithi190 to 15970M 2023-12-06T14:56:31.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:31 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:31.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:31 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:56:31.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:31 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:56:31.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:31 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:31.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:31 smithi152 ceph-mon[111954]: pgmap v67: 1 pgs: 1 peering; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2023-12-06T14:56:32.452 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:32.450+0000 7fd20705f700 1 -- 172.21.15.190:0/3271317463 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2000fde00 msgr2=0x7fd2000fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:56:32.452 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:32.450+0000 7fd20705f700 1 --2- 172.21.15.190:0/3271317463 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2000fde00 0x7fd2000fe250 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec004940 tx=0x7fd1ec009e30 comp rx=0 tx=0).stop 2023-12-06T14:56:32.452 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:32.450+0000 7fd20705f700 1 -- 172.21.15.190:0/3271317463 shutdown_connections 2023-12-06T14:56:32.452 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:32.450+0000 7fd20705f700 1 --2- 172.21.15.190:0/3271317463 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2000fde00 0x7fd2000fe250 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:56:32.452 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:32.450+0000 7fd20705f700 1 --2- 172.21.15.190:0/3271317463 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2000fcbf0 0x7fd2000fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:56:32.452 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:32.450+0000 7fd20705f700 1 -- 172.21.15.190:0/3271317463 >> 172.21.15.190:0/3271317463 conn(0x7fd2000f82d0 msgr2=0x7fd2000fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:56:32.452 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:32.450+0000 7fd20705f700 1 -- 172.21.15.190:0/3271317463 shutdown_connections 2023-12-06T14:56:32.452 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:32.450+0000 7fd20705f700 1 -- 172.21.15.190:0/3271317463 wait complete. 2023-12-06T14:56:32.453 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:32.450+0000 7fd20705f700 1 Processor -- start 2023-12-06T14:56:32.453 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:32.450+0000 7fd20705f700 1 -- start start 2023-12-06T14:56:32.453 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:32.451+0000 7fd20705f700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2000fcbf0 0x7fd20010d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:56:32.453 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:32.451+0000 7fd20705f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2000fde00 0x7fd20010dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:56:32.453 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:32.451+0000 7fd20705f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20010e0b0 con 0x7fd2000fde00 2023-12-06T14:56:32.453 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:32.451+0000 7fd20705f700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20010e950 con 0x7fd2000fcbf0 2023-12-06T14:56:32.453 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:32.451+0000 7fd204dfb700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2000fcbf0 0x7fd20010d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:56:32.453 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:32.451+0000 7fd204dfb700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2000fcbf0 0x7fd20010d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:38210/0 (socket says 172.21.15.190:38210) 2023-12-06T14:56:32.453 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:32.451+0000 7fd204dfb700 1 -- 172.21.15.190:0/2714618359 learned_addr learned my addr 172.21.15.190:0/2714618359 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-12-06T14:56:32.453 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:32.451+0000 7fd204dfb700 1 -- 172.21.15.190:0/2714618359 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2000fde00 msgr2=0x7fd20010dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:56:32.453 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:32.451+0000 7fd204dfb700 1 --2- 172.21.15.190:0/2714618359 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2000fde00 0x7fd20010dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:56:32.453 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:32.451+0000 7fd204dfb700 1 -- 172.21.15.190:0/2714618359 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ec005040 con 0x7fd2000fcbf0 2023-12-06T14:56:32.453 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:32.451+0000 7fd204dfb700 1 --2- 172.21.15.190:0/2714618359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2000fcbf0 0x7fd20010d570 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4002a80 tx=0x7fd1f4004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:56:32.453 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:32.451+0000 7fd1fd7fa700 1 -- 172.21.15.190:0/2714618359 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1f4007cc0 con 0x7fd2000fcbf0 2023-12-06T14:56:32.454 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:32.451+0000 7fd1fd7fa700 1 -- 172.21.15.190:0/2714618359 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd1f400f040 con 0x7fd2000fcbf0 2023-12-06T14:56:32.454 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:32.451+0000 7fd20705f700 1 -- 172.21.15.190:0/2714618359 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd20010ec30 con 0x7fd2000fcbf0 2023-12-06T14:56:32.454 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:32.451+0000 7fd1fd7fa700 1 -- 172.21.15.190:0/2714618359 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1f400da20 con 0x7fd2000fcbf0 2023-12-06T14:56:32.454 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:32.451+0000 7fd20705f700 1 -- 172.21.15.190:0/2714618359 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd20010f170 con 0x7fd2000fcbf0 2023-12-06T14:56:32.455 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:32.452+0000 7fd20705f700 1 -- 172.21.15.190:0/2714618359 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd20004bb80 con 0x7fd2000fcbf0 2023-12-06T14:56:32.455 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:32.452+0000 7fd1fd7fa700 1 -- 172.21.15.190:0/2714618359 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fd1f400db80 con 0x7fd2000fcbf0 2023-12-06T14:56:32.455 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:32.453+0000 7fd1fd7fa700 1 --2- 172.21.15.190:0/2714618359 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fd1f0068f60 0x7fd1f006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:56:32.455 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:32.453+0000 7fd1fd7fa700 1 -- 172.21.15.190:0/2714618359 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3803+0+0 (secure 0 0 0) 0x7fd1f4086450 con 0x7fd2000fcbf0 2023-12-06T14:56:32.455 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:32.453+0000 7fd1fffff700 1 --2- 172.21.15.190:0/2714618359 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fd1f0068f60 0x7fd1f006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:56:32.455 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:32.454+0000 7fd1fffff700 1 --2- 172.21.15.190:0/2714618359 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fd1f0068f60 0x7fd1f006b410 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec00b3b0 tx=0x7fd1ec009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:56:32.457 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:32.457+0000 7fd1fd7fa700 1 -- 172.21.15.190:0/2714618359 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd1f4056a30 con 0x7fd2000fcbf0 2023-12-06T14:56:32.649 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:32.648+0000 7fd20705f700 1 -- 172.21.15.190:0/2714618359 --> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fd20010f6c0 con 0x7fd1f0068f60 2023-12-06T14:56:32.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:32 smithi190 ceph-mon[121340]: purged_snaps scrub starts 2023-12-06T14:56:32.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:32 smithi190 ceph-mon[121340]: purged_snaps scrub ok 2023-12-06T14:56:32.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:32 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-06T14:56:32.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:32 smithi190 ceph-mon[121340]: osd.3 [v2:172.21.15.190:6800/977527629,v1:172.21.15.190:6801/977527629] boot 2023-12-06T14:56:32.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:32 smithi190 ceph-mon[121340]: osdmap e25: 4 total, 4 up, 4 in 2023-12-06T14:56:32.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:32 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-06T14:56:32.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:32 smithi152 ceph-mon[111954]: purged_snaps scrub starts 2023-12-06T14:56:32.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:32 smithi152 ceph-mon[111954]: purged_snaps scrub ok 2023-12-06T14:56:32.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:32 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-06T14:56:32.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:32 smithi152 ceph-mon[111954]: osd.3 [v2:172.21.15.190:6800/977527629,v1:172.21.15.190:6801/977527629] boot 2023-12-06T14:56:32.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:32 smithi152 ceph-mon[111954]: osdmap e25: 4 total, 4 up, 4 in 2023-12-06T14:56:32.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:32 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-06T14:56:33.737 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:33 smithi190 ceph-mon[121340]: osdmap e26: 4 total, 4 up, 4 in 2023-12-06T14:56:33.737 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:33 smithi190 ceph-mon[121340]: from='client.24153 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:56:33.737 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:33 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-06T14:56:33.737 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:33 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-06T14:56:33.737 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:33 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:56:33.737 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:33 smithi190 ceph-mon[121340]: pgmap v70: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-06T14:56:33.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:33 smithi152 ceph-mon[111954]: osdmap e26: 4 total, 4 up, 4 in 2023-12-06T14:56:33.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:33 smithi152 ceph-mon[111954]: from='client.24153 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:56:33.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:33 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-06T14:56:33.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:33 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-06T14:56:33.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:33 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:56:33.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:33 smithi152 ceph-mon[111954]: pgmap v70: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-06T14:56:34.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:34 smithi190 ceph-mon[121340]: osdmap e27: 4 total, 4 up, 4 in 2023-12-06T14:56:34.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:34 smithi190 ceph-mon[121340]: from='client.? 172.21.15.190:0/542334943' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23efef41-308e-467c-9f90-ae159a8d43a2"}]: dispatch 2023-12-06T14:56:34.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:34 smithi190 ceph-mon[121340]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23efef41-308e-467c-9f90-ae159a8d43a2"}]: dispatch 2023-12-06T14:56:34.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:34 smithi190 ceph-mon[121340]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23efef41-308e-467c-9f90-ae159a8d43a2"}]': finished 2023-12-06T14:56:34.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:34 smithi190 ceph-mon[121340]: osdmap e28: 5 total, 4 up, 5 in 2023-12-06T14:56:34.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:34 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-06T14:56:34.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:34 smithi152 ceph-mon[111954]: osdmap e27: 4 total, 4 up, 4 in 2023-12-06T14:56:34.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:34 smithi152 ceph-mon[111954]: from='client.? 172.21.15.190:0/542334943' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23efef41-308e-467c-9f90-ae159a8d43a2"}]: dispatch 2023-12-06T14:56:34.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:34 smithi152 ceph-mon[111954]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23efef41-308e-467c-9f90-ae159a8d43a2"}]: dispatch 2023-12-06T14:56:34.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:34 smithi152 ceph-mon[111954]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23efef41-308e-467c-9f90-ae159a8d43a2"}]': finished 2023-12-06T14:56:34.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:34 smithi152 ceph-mon[111954]: osdmap e28: 5 total, 4 up, 5 in 2023-12-06T14:56:34.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:34 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-06T14:56:36.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:35 smithi190 ceph-mon[121340]: pgmap v73: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-06T14:56:36.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:35 smithi190 ceph-mon[121340]: from='client.? 172.21.15.190:0/4245474891' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-06T14:56:36.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:35 smithi190 ceph-mon[121340]: osdmap e29: 5 total, 4 up, 5 in 2023-12-06T14:56:36.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:35 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-06T14:56:36.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:35 smithi152 ceph-mon[111954]: pgmap v73: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-06T14:56:36.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:35 smithi152 ceph-mon[111954]: from='client.? 172.21.15.190:0/4245474891' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-06T14:56:36.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:35 smithi152 ceph-mon[111954]: osdmap e29: 5 total, 4 up, 5 in 2023-12-06T14:56:36.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:35 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-06T14:56:38.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:38 smithi190 ceph-mon[121340]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 130 KiB/s, 0 objects/s recovering 2023-12-06T14:56:38.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:38 smithi152 ceph-mon[111954]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 130 KiB/s, 0 objects/s recovering 2023-12-06T14:56:40.325 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:40 smithi190 ceph-mon[121340]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-06T14:56:40.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:40 smithi152 ceph-mon[111954]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-06T14:56:41.320 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:41 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-06T14:56:41.338 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:41 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:56:41.338 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:41 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:56:41.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:41 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-06T14:56:41.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:41 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:56:41.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:41 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:56:42.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:42 smithi190 ceph-mon[121340]: Deploying daemon osd.4 on smithi190 2023-12-06T14:56:42.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:42 smithi190 ceph-mon[121340]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 78 KiB/s, 0 objects/s recovering 2023-12-06T14:56:42.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:42 smithi152 ceph-mon[111954]: Deploying daemon osd.4 on smithi190 2023-12-06T14:56:42.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:42 smithi152 ceph-mon[111954]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 78 KiB/s, 0 objects/s recovering 2023-12-06T14:56:44.319 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:44 smithi190 ceph-mon[121340]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 68 KiB/s, 0 objects/s recovering 2023-12-06T14:56:44.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:44 smithi152 ceph-mon[111954]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 68 KiB/s, 0 objects/s recovering 2023-12-06T14:56:45.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:45 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:45.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:45 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:45.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:45 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:56:45.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:45 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:45.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:45 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:45.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:45 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:56:46.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:46 smithi152 ceph-mon[111954]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-06T14:56:46.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:46 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:46.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:46 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:46.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:46 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:56:46.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:46 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:56:46.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:46 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:46.802 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:46 smithi190 ceph-mon[121340]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-06T14:56:46.802 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:46 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:46.802 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:46 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:46.802 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:46 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:56:46.802 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:46 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:56:46.802 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:46 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:47.002 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:47.002+0000 7fd1fd7fa700 1 -- 172.21.15.190:0/2714618359 <== mgr.14210 v2:172.21.15.152:6800/3317409709 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd20010f6c0 con 0x7fd1f0068f60 2023-12-06T14:56:47.003 INFO:teuthology.orchestra.run.smithi190.stdout:Created osd(s) 4 on host 'smithi190' 2023-12-06T14:56:47.005 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:47.004+0000 7fd20705f700 1 -- 172.21.15.190:0/2714618359 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fd1f0068f60 msgr2=0x7fd1f006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:56:47.005 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:47.004+0000 7fd20705f700 1 --2- 172.21.15.190:0/2714618359 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fd1f0068f60 0x7fd1f006b410 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec00b3b0 tx=0x7fd1ec009e30 comp rx=0 tx=0).stop 2023-12-06T14:56:47.005 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:47.004+0000 7fd20705f700 1 -- 172.21.15.190:0/2714618359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2000fcbf0 msgr2=0x7fd20010d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:56:47.005 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:47.004+0000 7fd20705f700 1 --2- 172.21.15.190:0/2714618359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2000fcbf0 0x7fd20010d570 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4002a80 tx=0x7fd1f4004600 comp rx=0 tx=0).stop 2023-12-06T14:56:47.005 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:47.005+0000 7fd20705f700 1 -- 172.21.15.190:0/2714618359 shutdown_connections 2023-12-06T14:56:47.005 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:47.005+0000 7fd20705f700 1 --2- 172.21.15.190:0/2714618359 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fd1f0068f60 0x7fd1f006b410 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:56:47.005 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:47.005+0000 7fd20705f700 1 --2- 172.21.15.190:0/2714618359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2000fcbf0 0x7fd20010d570 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:56:47.005 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:47.005+0000 7fd20705f700 1 --2- 172.21.15.190:0/2714618359 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2000fde00 0x7fd20010dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:56:47.005 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:47.005+0000 7fd20705f700 1 -- 172.21.15.190:0/2714618359 >> 172.21.15.190:0/2714618359 conn(0x7fd2000f82d0 msgr2=0x7fd200101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:56:47.005 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:47.005+0000 7fd20705f700 1 -- 172.21.15.190:0/2714618359 shutdown_connections 2023-12-06T14:56:47.005 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:47.005+0000 7fd20705f700 1 -- 172.21.15.190:0/2714618359 wait complete. 2023-12-06T14:56:47.408 DEBUG:teuthology.orchestra.run.smithi190:osd.4> sudo journalctl -f -n 0 -u ceph-062f0e3c-9447-11ee-95a2-87774f69a715@osd.4.service 2023-12-06T14:56:47.410 INFO:tasks.cephadm:Deploying osd.5 on smithi190 with /dev/vg_nvme/lv_2... 2023-12-06T14:56:47.411 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-06T14:56:47.441 INFO:journalctl@ceph.osd.4.smithi190.stdout:-- Logs begin at Wed 2023-12-06 14:39:30 UTC. -- 2023-12-06T14:56:48.121 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi190/config 2023-12-06T14:56:48.233 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:47 smithi190 ceph-mon[121340]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2023-12-06T14:56:48.233 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:47 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:48.233 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:47 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:48.233 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:47 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:56:48.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:47 smithi152 ceph-mon[111954]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2023-12-06T14:56:48.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:47 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:48.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:47 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:48.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:47 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:56:48.572 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 14:56:48 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-4[136281]: 2023-12-06T14:56:48.402+0000 7f33471ed540 -1 osd.4 0 log_to_monitors true 2023-12-06T14:56:49.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:49 smithi190 ceph-mon[121340]: from='osd.4 [v2:172.21.15.190:6808/2742121756,v1:172.21.15.190:6809/2742121756]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-06T14:56:49.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:49 smithi190 ceph-mon[121340]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-06T14:56:49.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:49 smithi152 ceph-mon[111954]: from='osd.4 [v2:172.21.15.190:6808/2742121756,v1:172.21.15.190:6809/2742121756]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-06T14:56:49.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:49 smithi152 ceph-mon[111954]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-06T14:56:49.515 INFO:teuthology.orchestra.run.smithi190.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-06T14:56:49.515 INFO:teuthology.orchestra.run.smithi190.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-06T14:56:49.515 INFO:teuthology.orchestra.run.smithi190.stderr: stderr: 10+0 records in 2023-12-06T14:56:49.515 INFO:teuthology.orchestra.run.smithi190.stderr:10+0 records out 2023-12-06T14:56:49.515 INFO:teuthology.orchestra.run.smithi190.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0136904 s, 766 MB/s 2023-12-06T14:56:49.515 INFO:teuthology.orchestra.run.smithi190.stderr:--> Zapping successful for: 2023-12-06T14:56:50.105 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 14:56:50 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-4[136281]: 2023-12-06T14:56:50.018+0000 7f333d9d2700 -1 osd.4 0 waiting for initial osdmap 2023-12-06T14:56:50.106 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 14:56:50 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-4[136281]: 2023-12-06T14:56:50.025+0000 7f33397cf700 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-06T14:56:50.106 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:50 smithi190 ceph-mon[121340]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-06T14:56:50.106 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:50 smithi190 ceph-mon[121340]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-06T14:56:50.106 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:50 smithi190 ceph-mon[121340]: osdmap e30: 5 total, 4 up, 5 in 2023-12-06T14:56:50.106 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:50 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-06T14:56:50.106 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:50 smithi190 ceph-mon[121340]: from='osd.4 [v2:172.21.15.190:6808/2742121756,v1:172.21.15.190:6809/2742121756]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-12-06T14:56:50.106 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:50 smithi190 ceph-mon[121340]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-12-06T14:56:50.204 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi190:vg_nvme/lv_2 2023-12-06T14:56:50.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:50 smithi152 ceph-mon[111954]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-06T14:56:50.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:50 smithi152 ceph-mon[111954]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-06T14:56:50.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:50 smithi152 ceph-mon[111954]: osdmap e30: 5 total, 4 up, 5 in 2023-12-06T14:56:50.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:50 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-06T14:56:50.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:50 smithi152 ceph-mon[111954]: from='osd.4 [v2:172.21.15.190:6808/2742121756,v1:172.21.15.190:6809/2742121756]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-12-06T14:56:50.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:50 smithi152 ceph-mon[111954]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-12-06T14:56:50.465 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi190/config 2023-12-06T14:56:51.293 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:51 smithi190 ceph-mon[121340]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2023-12-06T14:56:51.293 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:51 smithi190 ceph-mon[121340]: osdmap e31: 5 total, 4 up, 5 in 2023-12-06T14:56:51.293 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:51 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-06T14:56:51.293 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:51 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-06T14:56:51.294 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:51 smithi190 ceph-mon[121340]: Detected new or changed devices on smithi190 2023-12-06T14:56:51.294 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:51 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:51.294 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:51 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:51.294 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:51 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:56:51.294 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:51 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:56:51.294 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:51 smithi190 ceph-mon[121340]: Adjusting osd_memory_target on smithi190 to 7985M 2023-12-06T14:56:51.294 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:51 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:51.294 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:51 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:56:51.294 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:51 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:56:51.294 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:51 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:51.294 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:51 smithi190 ceph-mon[121340]: osd.4 [v2:172.21.15.190:6808/2742121756,v1:172.21.15.190:6809/2742121756] boot 2023-12-06T14:56:51.294 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:51 smithi190 ceph-mon[121340]: osdmap e32: 5 total, 5 up, 5 in 2023-12-06T14:56:51.295 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:51 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-06T14:56:51.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:51 smithi152 ceph-mon[111954]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2023-12-06T14:56:51.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:51 smithi152 ceph-mon[111954]: osdmap e31: 5 total, 4 up, 5 in 2023-12-06T14:56:51.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:51 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-06T14:56:51.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:51 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-06T14:56:51.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:51 smithi152 ceph-mon[111954]: Detected new or changed devices on smithi190 2023-12-06T14:56:51.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:51 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:51.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:51 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:51.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:51 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:56:51.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:51 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:56:51.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:51 smithi152 ceph-mon[111954]: Adjusting osd_memory_target on smithi190 to 7985M 2023-12-06T14:56:51.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:51 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:51.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:51 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:56:51.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:51 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:56:51.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:51 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:56:51.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:51 smithi152 ceph-mon[111954]: osd.4 [v2:172.21.15.190:6808/2742121756,v1:172.21.15.190:6809/2742121756] boot 2023-12-06T14:56:51.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:51 smithi152 ceph-mon[111954]: osdmap e32: 5 total, 5 up, 5 in 2023-12-06T14:56:51.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:51 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-06T14:56:51.474 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:51.471+0000 7f6f81e73700 1 -- 172.21.15.190:0/3789385197 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f7c0fd0a0 msgr2=0x7f6f7c0fd4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:56:51.474 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:51.471+0000 7f6f81e73700 1 --2- 172.21.15.190:0/3789385197 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f7c0fd0a0 0x7f6f7c0fd4b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c004940 tx=0x7f6f6c009e30 comp rx=0 tx=0).stop 2023-12-06T14:56:51.474 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:51.471+0000 7f6f81e73700 1 -- 172.21.15.190:0/3789385197 shutdown_connections 2023-12-06T14:56:51.474 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:51.471+0000 7f6f81e73700 1 --2- 172.21.15.190:0/3789385197 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f7c0fbdf0 0x7f6f7c0fc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:56:51.474 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:51.472+0000 7f6f81e73700 1 --2- 172.21.15.190:0/3789385197 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f7c0fd0a0 0x7f6f7c0fd4b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:56:51.474 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:51.472+0000 7f6f81e73700 1 -- 172.21.15.190:0/3789385197 >> 172.21.15.190:0/3789385197 conn(0x7f6f7c0f6950 msgr2=0x7f6f7c0f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:56:51.474 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:51.472+0000 7f6f81e73700 1 -- 172.21.15.190:0/3789385197 shutdown_connections 2023-12-06T14:56:51.474 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:51.472+0000 7f6f81e73700 1 -- 172.21.15.190:0/3789385197 wait complete. 2023-12-06T14:56:51.474 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:51.472+0000 7f6f81e73700 1 Processor -- start 2023-12-06T14:56:51.474 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:51.472+0000 7f6f81e73700 1 -- start start 2023-12-06T14:56:51.474 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:51.472+0000 7f6f81e73700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f7c0fbdf0 0x7f6f7c110300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:56:51.475 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:51.472+0000 7f6f81e73700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f7c0fd0a0 0x7f6f7c112850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:56:51.475 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:51.472+0000 7f6f81e73700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c0fbb30 con 0x7f6f7c0fbdf0 2023-12-06T14:56:51.475 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:51.472+0000 7f6f81e73700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c0fbc70 con 0x7f6f7c0fd0a0 2023-12-06T14:56:51.475 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:51.472+0000 7f6f7affd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f7c0fd0a0 0x7f6f7c112850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:56:51.475 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:51.473+0000 7f6f7affd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f7c0fd0a0 0x7f6f7c112850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:45526/0 (socket says 172.21.15.190:45526) 2023-12-06T14:56:51.475 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:51.473+0000 7f6f7affd700 1 -- 172.21.15.190:0/1407529252 learned_addr learned my addr 172.21.15.190:0/1407529252 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-12-06T14:56:51.475 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:51.473+0000 7f6f7b7fe700 1 --2- 172.21.15.190:0/1407529252 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f7c0fbdf0 0x7f6f7c110300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:56:51.475 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:51.473+0000 7f6f7affd700 1 -- 172.21.15.190:0/1407529252 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f7c0fbdf0 msgr2=0x7f6f7c110300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:56:51.475 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:51.473+0000 7f6f7affd700 1 --2- 172.21.15.190:0/1407529252 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f7c0fbdf0 0x7f6f7c110300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:56:51.475 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:51.473+0000 7f6f7affd700 1 -- 172.21.15.190:0/1407529252 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6c005040 con 0x7f6f7c0fd0a0 2023-12-06T14:56:51.475 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:51.473+0000 7f6f7affd700 1 --2- 172.21.15.190:0/1407529252 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f7c0fd0a0 0x7f6f7c112850 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6f7000b790 tx=0x7f6f70009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:56:51.475 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:51.473+0000 7f6f63fff700 1 -- 172.21.15.190:0/1407529252 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f7000f770 con 0x7f6f7c0fd0a0 2023-12-06T14:56:51.475 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:51.473+0000 7f6f63fff700 1 -- 172.21.15.190:0/1407529252 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6f7000fd80 con 0x7f6f7c0fd0a0 2023-12-06T14:56:51.475 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:51.473+0000 7f6f81e73700 1 -- 172.21.15.190:0/1407529252 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f7c112f00 con 0x7f6f7c0fd0a0 2023-12-06T14:56:51.475 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:51.473+0000 7f6f63fff700 1 -- 172.21.15.190:0/1407529252 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f7000d310 con 0x7f6f7c0fd0a0 2023-12-06T14:56:51.476 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:51.473+0000 7f6f81e73700 1 -- 172.21.15.190:0/1407529252 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f7c113410 con 0x7f6f7c0fd0a0 2023-12-06T14:56:51.476 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:51.474+0000 7f6f63fff700 1 -- 172.21.15.190:0/1407529252 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f6f70010420 con 0x7f6f7c0fd0a0 2023-12-06T14:56:51.477 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:51.474+0000 7f6f81e73700 1 -- 172.21.15.190:0/1407529252 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f7c106560 con 0x7f6f7c0fd0a0 2023-12-06T14:56:51.477 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:51.475+0000 7f6f63fff700 1 --2- 172.21.15.190:0/1407529252 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f6f64068f60 0x7f6f6406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:56:51.477 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:51.475+0000 7f6f63fff700 1 -- 172.21.15.190:0/1407529252 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4202+0+0 (secure 0 0 0) 0x7f6f70086710 con 0x7f6f7c0fd0a0 2023-12-06T14:56:51.477 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:51.475+0000 7f6f7b7fe700 1 --2- 172.21.15.190:0/1407529252 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f6f64068f60 0x7f6f6406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:56:51.477 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:51.475+0000 7f6f7b7fe700 1 --2- 172.21.15.190:0/1407529252 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f6f64068f60 0x7f6f6406b410 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c00b3b0 tx=0x7f6f6c009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:56:51.479 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:51.479+0000 7f6f63fff700 1 -- 172.21.15.190:0/1407529252 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6f70053170 con 0x7f6f7c0fd0a0 2023-12-06T14:56:51.670 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:56:51.670+0000 7f6f81e73700 1 -- 172.21.15.190:0/1407529252 --> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f7c02b220 con 0x7f6f64068f60 2023-12-06T14:56:52.376 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:52 smithi190 ceph-mon[121340]: purged_snaps scrub starts 2023-12-06T14:56:52.376 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:52 smithi190 ceph-mon[121340]: purged_snaps scrub ok 2023-12-06T14:56:52.376 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:52 smithi190 ceph-mon[121340]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-06T14:56:52.377 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:52 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-06T14:56:52.377 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:52 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-06T14:56:52.377 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:52 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:56:52.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:52 smithi152 ceph-mon[111954]: purged_snaps scrub starts 2023-12-06T14:56:52.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:52 smithi152 ceph-mon[111954]: purged_snaps scrub ok 2023-12-06T14:56:52.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:52 smithi152 ceph-mon[111954]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2023-12-06T14:56:52.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:52 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-06T14:56:52.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:52 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-06T14:56:52.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:52 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:56:53.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:53 smithi190 ceph-mon[121340]: from='client.24171 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:56:53.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:53 smithi190 ceph-mon[121340]: osdmap e33: 5 total, 5 up, 5 in 2023-12-06T14:56:53.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:53 smithi152 ceph-mon[111954]: from='client.24171 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:56:53.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:53 smithi152 ceph-mon[111954]: osdmap e33: 5 total, 5 up, 5 in 2023-12-06T14:56:54.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:54 smithi190 ceph-mon[121340]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-06T14:56:54.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:54 smithi190 ceph-mon[121340]: from='client.? 172.21.15.190:0/969485100' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fe0aeff2-a9e0-4cb5-9cd9-fd0e3db4807f"}]: dispatch 2023-12-06T14:56:54.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:54 smithi190 ceph-mon[121340]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fe0aeff2-a9e0-4cb5-9cd9-fd0e3db4807f"}]: dispatch 2023-12-06T14:56:54.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:54 smithi190 ceph-mon[121340]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fe0aeff2-a9e0-4cb5-9cd9-fd0e3db4807f"}]': finished 2023-12-06T14:56:54.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:54 smithi190 ceph-mon[121340]: osdmap e34: 6 total, 5 up, 6 in 2023-12-06T14:56:54.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:54 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-06T14:56:54.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:54 smithi190 ceph-mon[121340]: from='client.? 172.21.15.190:0/2806610775' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-06T14:56:54.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:54 smithi152 ceph-mon[111954]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-06T14:56:54.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:54 smithi152 ceph-mon[111954]: from='client.? 172.21.15.190:0/969485100' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fe0aeff2-a9e0-4cb5-9cd9-fd0e3db4807f"}]: dispatch 2023-12-06T14:56:54.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:54 smithi152 ceph-mon[111954]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fe0aeff2-a9e0-4cb5-9cd9-fd0e3db4807f"}]: dispatch 2023-12-06T14:56:54.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:54 smithi152 ceph-mon[111954]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fe0aeff2-a9e0-4cb5-9cd9-fd0e3db4807f"}]': finished 2023-12-06T14:56:54.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:54 smithi152 ceph-mon[111954]: osdmap e34: 6 total, 5 up, 6 in 2023-12-06T14:56:54.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:54 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-06T14:56:54.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:54 smithi152 ceph-mon[111954]: from='client.? 172.21.15.190:0/2806610775' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-06T14:56:56.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:55 smithi190 ceph-mon[121340]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-06T14:56:56.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:55 smithi152 ceph-mon[111954]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-06T14:56:57.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:56 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:56:57.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:56 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:56:58.316 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:56:57 smithi190 ceph-mon[121340]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-06T14:56:58.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:56:57 smithi152 ceph-mon[111954]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-06T14:57:00.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:00 smithi190 ceph-mon[121340]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-06T14:57:00.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:00 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-06T14:57:00.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:00 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:57:00.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:00 smithi152 ceph-mon[111954]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-06T14:57:00.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:00 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-06T14:57:00.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:00 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:57:01.161 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:01 smithi190 ceph-mon[121340]: Deploying daemon osd.5 on smithi190 2023-12-06T14:57:01.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:01 smithi152 ceph-mon[111954]: Deploying daemon osd.5 on smithi190 2023-12-06T14:57:02.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:02 smithi190 ceph-mon[121340]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-06T14:57:02.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:02 smithi152 ceph-mon[111954]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-06T14:57:04.568 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:04 smithi190 ceph-mon[121340]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-06T14:57:04.568 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:04 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:57:04.568 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:04 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:57:04.568 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:04 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:57:04.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:04 smithi152 ceph-mon[111954]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-06T14:57:04.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:04 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:57:04.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:04 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:57:04.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:04 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:57:05.482 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:05.482+0000 7f6f63fff700 1 -- 172.21.15.190:0/1407529252 <== mgr.14210 v2:172.21.15.152:6800/3317409709 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6f7c02b220 con 0x7f6f64068f60 2023-12-06T14:57:05.483 INFO:teuthology.orchestra.run.smithi190.stdout:Created osd(s) 5 on host 'smithi190' 2023-12-06T14:57:05.485 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:05.484+0000 7f6f81e73700 1 -- 172.21.15.190:0/1407529252 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f6f64068f60 msgr2=0x7f6f6406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:05.485 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:05.484+0000 7f6f81e73700 1 --2- 172.21.15.190:0/1407529252 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f6f64068f60 0x7f6f6406b410 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c00b3b0 tx=0x7f6f6c009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:05.485 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:05.484+0000 7f6f81e73700 1 -- 172.21.15.190:0/1407529252 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f7c0fd0a0 msgr2=0x7f6f7c112850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:05.485 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:05.484+0000 7f6f81e73700 1 --2- 172.21.15.190:0/1407529252 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f7c0fd0a0 0x7f6f7c112850 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6f7000b790 tx=0x7f6f70009250 comp rx=0 tx=0).stop 2023-12-06T14:57:05.485 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:05.484+0000 7f6f81e73700 1 -- 172.21.15.190:0/1407529252 shutdown_connections 2023-12-06T14:57:05.485 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:05.484+0000 7f6f81e73700 1 --2- 172.21.15.190:0/1407529252 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f7c0fbdf0 0x7f6f7c110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:05.485 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:05.484+0000 7f6f81e73700 1 --2- 172.21.15.190:0/1407529252 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f6f64068f60 0x7f6f6406b410 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:05.485 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:05.484+0000 7f6f81e73700 1 --2- 172.21.15.190:0/1407529252 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6f7c0fd0a0 0x7f6f7c112850 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:05.485 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:05.484+0000 7f6f81e73700 1 -- 172.21.15.190:0/1407529252 >> 172.21.15.190:0/1407529252 conn(0x7f6f7c0f6950 msgr2=0x7f6f7c0f8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:05.485 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:05.484+0000 7f6f81e73700 1 -- 172.21.15.190:0/1407529252 shutdown_connections 2023-12-06T14:57:05.485 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:05.484+0000 7f6f81e73700 1 -- 172.21.15.190:0/1407529252 wait complete. 2023-12-06T14:57:05.829 DEBUG:teuthology.orchestra.run.smithi190:osd.5> sudo journalctl -f -n 0 -u ceph-062f0e3c-9447-11ee-95a2-87774f69a715@osd.5.service 2023-12-06T14:57:05.835 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2023-12-06T14:57:05.835 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph osd stat -f json 2023-12-06T14:57:05.865 INFO:journalctl@ceph.osd.5.smithi190.stdout:-- Logs begin at Wed 2023-12-06 14:39:30 UTC. -- 2023-12-06T14:57:06.108 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:57:06.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:06 smithi152 ceph-mon[111954]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-06T14:57:06.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:06 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:57:06.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:06 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:57:06.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:06 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:57:06.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:06 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:57:06.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:06 smithi190 ceph-mon[121340]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-06T14:57:06.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:06 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:57:06.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:06 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:57:06.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:06 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:57:06.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:06 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:57:07.061 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.061+0000 7f4f27248700 1 -- 172.21.15.152:0/3923895369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f200fbe10 msgr2=0x7f4f200fc280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:07.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.061+0000 7f4f27248700 1 --2- 172.21.15.152:0/3923895369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f200fbe10 0x7f4f200fc280 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c004940 tx=0x7f4f0c009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:07.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.061+0000 7f4f27248700 1 -- 172.21.15.152:0/3923895369 shutdown_connections 2023-12-06T14:57:07.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.061+0000 7f4f27248700 1 --2- 172.21.15.152:0/3923895369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f200fbe10 0x7f4f200fc280 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:07.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.061+0000 7f4f27248700 1 --2- 172.21.15.152:0/3923895369 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f200fd190 0x7f4f200fd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:07.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.061+0000 7f4f27248700 1 -- 172.21.15.152:0/3923895369 >> 172.21.15.152:0/3923895369 conn(0x7f4f200f6950 msgr2=0x7f4f200f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:07.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.061+0000 7f4f27248700 1 -- 172.21.15.152:0/3923895369 shutdown_connections 2023-12-06T14:57:07.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.061+0000 7f4f27248700 1 -- 172.21.15.152:0/3923895369 wait complete. 2023-12-06T14:57:07.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.062+0000 7f4f27248700 1 Processor -- start 2023-12-06T14:57:07.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.062+0000 7f4f27248700 1 -- start start 2023-12-06T14:57:07.063 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.062+0000 7f4f27248700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f200fbe10 0x7f4f20104850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:07.063 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.062+0000 7f4f27248700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f200fd190 0x7f4f20102cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:07.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.062+0000 7f4f27248700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f20103360 con 0x7f4f200fd190 2023-12-06T14:57:07.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.062+0000 7f4f27248700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f201034d0 con 0x7f4f200fbe10 2023-12-06T14:57:07.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.062+0000 7f4f1ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f200fd190 0x7f4f20102cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:07.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.062+0000 7f4f1ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f200fd190 0x7f4f20102cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42748/0 (socket says 172.21.15.152:42748) 2023-12-06T14:57:07.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.062+0000 7f4f1ffff700 1 -- 172.21.15.152:0/1085478693 learned_addr learned my addr 172.21.15.152:0/1085478693 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:57:07.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.062+0000 7f4f24fe4700 1 --2- 172.21.15.152:0/1085478693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f200fbe10 0x7f4f20104850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:07.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.062+0000 7f4f1ffff700 1 -- 172.21.15.152:0/1085478693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f200fbe10 msgr2=0x7f4f20104850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:07.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.062+0000 7f4f1ffff700 1 --2- 172.21.15.152:0/1085478693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f200fbe10 0x7f4f20104850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:07.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.062+0000 7f4f1ffff700 1 -- 172.21.15.152:0/1085478693 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0c005040 con 0x7f4f200fd190 2023-12-06T14:57:07.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.062+0000 7f4f1ffff700 1 --2- 172.21.15.152:0/1085478693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f200fd190 0x7f4f20102cd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c000c00 tx=0x7f4f0c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:07.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.063+0000 7f4f1d7fa700 1 -- 172.21.15.152:0/1085478693 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f0c00e040 con 0x7f4f200fd190 2023-12-06T14:57:07.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.063+0000 7f4f27248700 1 -- 172.21.15.152:0/1085478693 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f20103750 con 0x7f4f200fd190 2023-12-06T14:57:07.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.063+0000 7f4f1d7fa700 1 -- 172.21.15.152:0/1085478693 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4f0c004290 con 0x7f4f200fd190 2023-12-06T14:57:07.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.063+0000 7f4f1d7fa700 1 -- 172.21.15.152:0/1085478693 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f0c01c3f0 con 0x7f4f200fd190 2023-12-06T14:57:07.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.063+0000 7f4f27248700 1 -- 172.21.15.152:0/1085478693 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f201155c0 con 0x7f4f200fd190 2023-12-06T14:57:07.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.064+0000 7f4f27248700 1 -- 172.21.15.152:0/1085478693 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f2004bb80 con 0x7f4f200fd190 2023-12-06T14:57:07.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.064+0000 7f4f1d7fa700 1 -- 172.21.15.152:0/1085478693 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f4f0c013790 con 0x7f4f200fd190 2023-12-06T14:57:07.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.064+0000 7f4f1d7fa700 1 --2- 172.21.15.152:0/1085478693 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f4f10068fb0 0x7f4f1006b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:07.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.064+0000 7f4f1d7fa700 1 -- 172.21.15.152:0/1085478693 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4317+0+0 (secure 0 0 0) 0x7f4f0c087d30 con 0x7f4f200fd190 2023-12-06T14:57:07.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.064+0000 7f4f24fe4700 1 --2- 172.21.15.152:0/1085478693 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f4f10068fb0 0x7f4f1006b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:07.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.065+0000 7f4f24fe4700 1 --2- 172.21.15.152:0/1085478693 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f4f10068fb0 0x7f4f1006b460 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4f201045e0 tx=0x7f4f140091a0 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:07.070 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.069+0000 7f4f1d7fa700 1 -- 172.21.15.152:0/1085478693 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4f0c08d020 con 0x7f4f200fd190 2023-12-06T14:57:07.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.261+0000 7f4f27248700 1 -- 172.21.15.152:0/1085478693 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f4f20115990 con 0x7f4f200fd190 2023-12-06T14:57:07.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.261+0000 7f4f1d7fa700 1 -- 172.21.15.152:0/1085478693 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v34) v1 ==== 74+0+130 (secure 0 0 0) 0x7f4f0c058070 con 0x7f4f200fd190 2023-12-06T14:57:07.262 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:57:07.263 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.263+0000 7f4f27248700 1 -- 172.21.15.152:0/1085478693 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f4f10068fb0 msgr2=0x7f4f1006b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:07.263 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.263+0000 7f4f27248700 1 --2- 172.21.15.152:0/1085478693 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f4f10068fb0 0x7f4f1006b460 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4f201045e0 tx=0x7f4f140091a0 comp rx=0 tx=0).stop 2023-12-06T14:57:07.263 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.263+0000 7f4f27248700 1 -- 172.21.15.152:0/1085478693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f200fd190 msgr2=0x7f4f20102cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:07.264 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.263+0000 7f4f27248700 1 --2- 172.21.15.152:0/1085478693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f200fd190 0x7f4f20102cd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c000c00 tx=0x7f4f0c009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:07.264 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.263+0000 7f4f27248700 1 -- 172.21.15.152:0/1085478693 shutdown_connections 2023-12-06T14:57:07.264 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.263+0000 7f4f27248700 1 --2- 172.21.15.152:0/1085478693 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f4f10068fb0 0x7f4f1006b460 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:07.264 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.263+0000 7f4f27248700 1 --2- 172.21.15.152:0/1085478693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f200fbe10 0x7f4f20104850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:07.264 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.263+0000 7f4f27248700 1 --2- 172.21.15.152:0/1085478693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f200fd190 0x7f4f20102cd0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:07.264 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.263+0000 7f4f27248700 1 -- 172.21.15.152:0/1085478693 >> 172.21.15.152:0/1085478693 conn(0x7f4f200f6950 msgr2=0x7f4f20100050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:07.264 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.263+0000 7f4f27248700 1 -- 172.21.15.152:0/1085478693 shutdown_connections 2023-12-06T14:57:07.264 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:07.263+0000 7f4f27248700 1 -- 172.21.15.152:0/1085478693 wait complete. 2023-12-06T14:57:07.517 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 14:57:07 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-5[145013]: 2023-12-06T14:57:07.183+0000 7f377b14d540 -1 osd.5 0 log_to_monitors true 2023-12-06T14:57:07.641 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":34,"num_osds":6,"num_up_osds":5,"osd_up_since":1701874611,"num_in_osds":6,"osd_in_since":1701874613,"num_remapped_pgs":0} 2023-12-06T14:57:08.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:08 smithi152 ceph-mon[111954]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-06T14:57:08.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:08 smithi152 ceph-mon[111954]: from='osd.5 [v2:172.21.15.190:6816/3073656058,v1:172.21.15.190:6817/3073656058]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-06T14:57:08.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:08 smithi152 ceph-mon[111954]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-06T14:57:08.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:08 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/1085478693' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-06T14:57:08.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:08 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:57:08.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:08 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:57:08.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:08 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:57:08.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:08 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:57:08.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:08 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:57:08.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:08 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:57:08.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:08 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:57:08.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:08 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:57:08.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:08 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:57:08.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:08 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:57:08.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:08 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:57:08.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:08 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:57:08.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:08 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:57:08.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:08 smithi190 ceph-mon[121340]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-06T14:57:08.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:08 smithi190 ceph-mon[121340]: from='osd.5 [v2:172.21.15.190:6816/3073656058,v1:172.21.15.190:6817/3073656058]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-06T14:57:08.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:08 smithi190 ceph-mon[121340]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-06T14:57:08.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:08 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/1085478693' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-06T14:57:08.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:08 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:57:08.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:08 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:57:08.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:08 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:57:08.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:08 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:57:08.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:08 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:57:08.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:08 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:57:08.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:08 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:57:08.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:08 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:57:08.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:08 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:57:08.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:08 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:57:08.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:08 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:57:08.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:08 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:57:08.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:08 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:57:08.643 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph osd stat -f json 2023-12-06T14:57:08.909 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:57:09.345 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:09 smithi152 ceph-mon[111954]: Detected new or changed devices on smithi190 2023-12-06T14:57:09.345 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:09 smithi152 ceph-mon[111954]: Adjusting osd_memory_target on smithi190 to 5323M 2023-12-06T14:57:09.345 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:09 smithi152 ceph-mon[111954]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-06T14:57:09.346 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:09 smithi152 ceph-mon[111954]: osdmap e35: 6 total, 5 up, 6 in 2023-12-06T14:57:09.346 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:09 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-06T14:57:09.346 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:09 smithi152 ceph-mon[111954]: from='osd.5 [v2:172.21.15.190:6816/3073656058,v1:172.21.15.190:6817/3073656058]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-12-06T14:57:09.346 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:09 smithi152 ceph-mon[111954]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-12-06T14:57:09.572 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 14:57:09 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-5[145013]: 2023-12-06T14:57:09.130+0000 7f3771932700 -1 osd.5 0 waiting for initial osdmap 2023-12-06T14:57:09.573 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 14:57:09 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-5[145013]: 2023-12-06T14:57:09.140+0000 7f376bf2c700 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-06T14:57:09.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:09 smithi190 ceph-mon[121340]: Detected new or changed devices on smithi190 2023-12-06T14:57:09.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:09 smithi190 ceph-mon[121340]: Adjusting osd_memory_target on smithi190 to 5323M 2023-12-06T14:57:09.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:09 smithi190 ceph-mon[121340]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-06T14:57:09.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:09 smithi190 ceph-mon[121340]: osdmap e35: 6 total, 5 up, 6 in 2023-12-06T14:57:09.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:09 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-06T14:57:09.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:09 smithi190 ceph-mon[121340]: from='osd.5 [v2:172.21.15.190:6816/3073656058,v1:172.21.15.190:6817/3073656058]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-12-06T14:57:09.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:09 smithi190 ceph-mon[121340]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-12-06T14:57:09.852 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:09.852+0000 7f77febe8700 1 -- 172.21.15.152:0/3771529334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77f80fbb00 msgr2=0x7f77f80fbf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:09.852 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:09.852+0000 7f77febe8700 1 --2- 172.21.15.152:0/3771529334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77f80fbb00 0x7f77f80fbf10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f77ec004940 tx=0x7f77ec009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:09.852 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:09.852+0000 7f77febe8700 1 -- 172.21.15.152:0/3771529334 shutdown_connections 2023-12-06T14:57:09.852 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:09.852+0000 7f77febe8700 1 --2- 172.21.15.152:0/3771529334 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77f80fcd10 0x7f77f80fd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:09.852 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:09.852+0000 7f77febe8700 1 --2- 172.21.15.152:0/3771529334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77f80fbb00 0x7f77f80fbf10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:09.852 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:09.852+0000 7f77febe8700 1 -- 172.21.15.152:0/3771529334 >> 172.21.15.152:0/3771529334 conn(0x7f77f80f71c0 msgr2=0x7f77f80f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:09.852 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:09.852+0000 7f77febe8700 1 -- 172.21.15.152:0/3771529334 shutdown_connections 2023-12-06T14:57:09.853 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:09.852+0000 7f77febe8700 1 -- 172.21.15.152:0/3771529334 wait complete. 2023-12-06T14:57:09.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:09.852+0000 7f77febe8700 1 Processor -- start 2023-12-06T14:57:09.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:09.853+0000 7f77febe8700 1 -- start start 2023-12-06T14:57:09.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:09.853+0000 7f77febe8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77f80fbb00 0x7f77f810d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:09.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:09.853+0000 7f77febe8700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77f80fcd10 0x7f77f810db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:09.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:09.853+0000 7f77febe8700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f810e100 con 0x7f77f80fbb00 2023-12-06T14:57:09.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:09.853+0000 7f77febe8700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f810e9a0 con 0x7f77f80fcd10 2023-12-06T14:57:09.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:09.853+0000 7f77fc984700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77f80fbb00 0x7f77f810d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:09.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:09.853+0000 7f77fc984700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77f80fbb00 0x7f77f810d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52132/0 (socket says 172.21.15.152:52132) 2023-12-06T14:57:09.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:09.853+0000 7f77fc984700 1 -- 172.21.15.152:0/2830969975 learned_addr learned my addr 172.21.15.152:0/2830969975 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:57:09.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:09.853+0000 7f77f7fff700 1 --2- 172.21.15.152:0/2830969975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77f80fcd10 0x7f77f810db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:09.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:09.853+0000 7f77fc984700 1 -- 172.21.15.152:0/2830969975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77f80fcd10 msgr2=0x7f77f810db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:09.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:09.853+0000 7f77fc984700 1 --2- 172.21.15.152:0/2830969975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77f80fcd10 0x7f77f810db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:09.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:09.853+0000 7f77fc984700 1 -- 172.21.15.152:0/2830969975 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ec005040 con 0x7f77f80fbb00 2023-12-06T14:57:09.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:09.853+0000 7f77f7fff700 1 --2- 172.21.15.152:0/2830969975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77f80fcd10 0x7f77f810db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-06T14:57:09.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:09.853+0000 7f77fc984700 1 --2- 172.21.15.152:0/2830969975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77f80fbb00 0x7f77f810d5c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f77ec004f90 tx=0x7f77ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:09.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:09.853+0000 7f77f57fa700 1 -- 172.21.15.152:0/2830969975 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77ec00e040 con 0x7f77f80fbb00 2023-12-06T14:57:09.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:09.854+0000 7f77f57fa700 1 -- 172.21.15.152:0/2830969975 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f77ec00bcd0 con 0x7f77f80fbb00 2023-12-06T14:57:09.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:09.854+0000 7f77f57fa700 1 -- 172.21.15.152:0/2830969975 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77ec01c630 con 0x7f77f80fbb00 2023-12-06T14:57:09.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:09.854+0000 7f77febe8700 1 -- 172.21.15.152:0/2830969975 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f810ec20 con 0x7f77f80fbb00 2023-12-06T14:57:09.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:09.854+0000 7f77febe8700 1 -- 172.21.15.152:0/2830969975 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f810f160 con 0x7f77f80fbb00 2023-12-06T14:57:09.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:09.854+0000 7f77febe8700 1 -- 172.21.15.152:0/2830969975 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f804bb80 con 0x7f77f80fbb00 2023-12-06T14:57:09.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:09.855+0000 7f77f57fa700 1 -- 172.21.15.152:0/2830969975 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f77ec013960 con 0x7f77f80fbb00 2023-12-06T14:57:09.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:09.855+0000 7f77f57fa700 1 --2- 172.21.15.152:0/2830969975 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f77e8068f60 0x7f77e806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:09.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:09.855+0000 7f77f57fa700 1 -- 172.21.15.152:0/2830969975 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4354+0+0 (secure 0 0 0) 0x7f77ec087df0 con 0x7f77f80fbb00 2023-12-06T14:57:09.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:09.855+0000 7f77f7fff700 1 --2- 172.21.15.152:0/2830969975 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f77e8068f60 0x7f77e806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:09.857 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:09.856+0000 7f77f7fff700 1 --2- 172.21.15.152:0/2830969975 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f77e8068f60 0x7f77e806b410 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f77e40041d0 tx=0x7f77e4009040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:09.859 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:09.860+0000 7f77f57fa700 1 -- 172.21.15.152:0/2830969975 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f77ec0581a0 con 0x7f77f80fbb00 2023-12-06T14:57:10.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:10.042+0000 7f77febe8700 1 -- 172.21.15.152:0/2830969975 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f77f81044c0 con 0x7f77f80fbb00 2023-12-06T14:57:10.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:10.042+0000 7f77f57fa700 1 -- 172.21.15.152:0/2830969975 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v36) v1 ==== 74+0+130 (secure 0 0 0) 0x7f77ec057d30 con 0x7f77f80fbb00 2023-12-06T14:57:10.042 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:57:10.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:10.044+0000 7f77febe8700 1 -- 172.21.15.152:0/2830969975 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f77e8068f60 msgr2=0x7f77e806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:10.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:10.044+0000 7f77febe8700 1 --2- 172.21.15.152:0/2830969975 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f77e8068f60 0x7f77e806b410 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f77e40041d0 tx=0x7f77e4009040 comp rx=0 tx=0).stop 2023-12-06T14:57:10.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:10.044+0000 7f77febe8700 1 -- 172.21.15.152:0/2830969975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77f80fbb00 msgr2=0x7f77f810d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:10.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:10.044+0000 7f77febe8700 1 --2- 172.21.15.152:0/2830969975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77f80fbb00 0x7f77f810d5c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f77ec004f90 tx=0x7f77ec009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:10.045 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:10.044+0000 7f77febe8700 1 -- 172.21.15.152:0/2830969975 shutdown_connections 2023-12-06T14:57:10.045 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:10.044+0000 7f77febe8700 1 --2- 172.21.15.152:0/2830969975 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77f80fbb00 0x7f77f810d5c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:10.045 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:10.044+0000 7f77febe8700 1 --2- 172.21.15.152:0/2830969975 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f77e8068f60 0x7f77e806b410 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:10.045 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:10.044+0000 7f77febe8700 1 --2- 172.21.15.152:0/2830969975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77f80fcd10 0x7f77f810db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:10.045 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:10.044+0000 7f77febe8700 1 -- 172.21.15.152:0/2830969975 >> 172.21.15.152:0/2830969975 conn(0x7f77f80f71c0 msgr2=0x7f77f8065be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:10.045 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:10.044+0000 7f77febe8700 1 -- 172.21.15.152:0/2830969975 shutdown_connections 2023-12-06T14:57:10.045 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:10.044+0000 7f77febe8700 1 -- 172.21.15.152:0/2830969975 wait complete. 2023-12-06T14:57:10.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:10 smithi152 ceph-mon[111954]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-06T14:57:10.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:10 smithi152 ceph-mon[111954]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2023-12-06T14:57:10.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:10 smithi152 ceph-mon[111954]: osdmap e36: 6 total, 5 up, 6 in 2023-12-06T14:57:10.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:10 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-06T14:57:10.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:10 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-06T14:57:10.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:10 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/2830969975' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-06T14:57:10.415 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":36,"num_osds":6,"num_up_osds":5,"osd_up_since":1701874611,"num_in_osds":6,"osd_in_since":1701874613,"num_remapped_pgs":0} 2023-12-06T14:57:10.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:10 smithi190 ceph-mon[121340]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-06T14:57:10.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:10 smithi190 ceph-mon[121340]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2023-12-06T14:57:10.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:10 smithi190 ceph-mon[121340]: osdmap e36: 6 total, 5 up, 6 in 2023-12-06T14:57:10.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:10 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-06T14:57:10.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:10 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-06T14:57:10.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:10 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/2830969975' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-06T14:57:11.416 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph osd stat -f json 2023-12-06T14:57:11.450 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:11 smithi152 ceph-mon[111954]: purged_snaps scrub starts 2023-12-06T14:57:11.451 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:11 smithi152 ceph-mon[111954]: purged_snaps scrub ok 2023-12-06T14:57:11.451 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:11 smithi152 ceph-mon[111954]: osd.5 [v2:172.21.15.190:6816/3073656058,v1:172.21.15.190:6817/3073656058] boot 2023-12-06T14:57:11.451 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:11 smithi152 ceph-mon[111954]: osdmap e37: 6 total, 6 up, 6 in 2023-12-06T14:57:11.451 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:11 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-06T14:57:11.451 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:11 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:57:11.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:11 smithi190 ceph-mon[121340]: purged_snaps scrub starts 2023-12-06T14:57:11.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:11 smithi190 ceph-mon[121340]: purged_snaps scrub ok 2023-12-06T14:57:11.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:11 smithi190 ceph-mon[121340]: osd.5 [v2:172.21.15.190:6816/3073656058,v1:172.21.15.190:6817/3073656058] boot 2023-12-06T14:57:11.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:11 smithi190 ceph-mon[121340]: osdmap e37: 6 total, 6 up, 6 in 2023-12-06T14:57:11.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:11 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-06T14:57:11.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:11 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:57:11.690 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:57:12.486 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:12 smithi152 ceph-mon[111954]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-06T14:57:12.486 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:12 smithi152 ceph-mon[111954]: osdmap e38: 6 total, 6 up, 6 in 2023-12-06T14:57:12.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:12 smithi190 ceph-mon[121340]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2023-12-06T14:57:12.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:12 smithi190 ceph-mon[121340]: osdmap e38: 6 total, 6 up, 6 in 2023-12-06T14:57:12.702 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.701+0000 7f4e8a451700 1 -- 172.21.15.152:0/3922172103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e840fcd00 msgr2=0x7f4e840fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:12.702 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.701+0000 7f4e8a451700 1 --2- 172.21.15.152:0/3922172103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e840fcd00 0x7f4e840fd150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4e78004940 tx=0x7f4e78009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:12.702 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.701+0000 7f4e8a451700 1 -- 172.21.15.152:0/3922172103 shutdown_connections 2023-12-06T14:57:12.702 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.701+0000 7f4e8a451700 1 --2- 172.21.15.152:0/3922172103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e840fcd00 0x7f4e840fd150 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:12.702 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.701+0000 7f4e8a451700 1 --2- 172.21.15.152:0/3922172103 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e840fbaf0 0x7f4e840fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:12.702 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.701+0000 7f4e8a451700 1 -- 172.21.15.152:0/3922172103 >> 172.21.15.152:0/3922172103 conn(0x7f4e840f7190 msgr2=0x7f4e840f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:12.703 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.701+0000 7f4e8a451700 1 -- 172.21.15.152:0/3922172103 shutdown_connections 2023-12-06T14:57:12.703 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.701+0000 7f4e8a451700 1 -- 172.21.15.152:0/3922172103 wait complete. 2023-12-06T14:57:12.703 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.702+0000 7f4e8a451700 1 Processor -- start 2023-12-06T14:57:12.703 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.702+0000 7f4e8a451700 1 -- start start 2023-12-06T14:57:12.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.702+0000 7f4e8a451700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e840fbaf0 0x7f4e8410c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:12.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.702+0000 7f4e8a451700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e840fcd00 0x7f4e8410c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:12.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.702+0000 7f4e8a451700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8410cf10 con 0x7f4e840fbaf0 2023-12-06T14:57:12.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.702+0000 7f4e8a451700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8410d7b0 con 0x7f4e840fcd00 2023-12-06T14:57:12.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.703+0000 7f4e83fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e840fbaf0 0x7f4e8410c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:12.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.703+0000 7f4e83fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e840fbaf0 0x7f4e8410c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52144/0 (socket says 172.21.15.152:52144) 2023-12-06T14:57:12.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.703+0000 7f4e83fff700 1 -- 172.21.15.152:0/1222486776 learned_addr learned my addr 172.21.15.152:0/1222486776 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:57:12.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.703+0000 7f4e837fe700 1 --2- 172.21.15.152:0/1222486776 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e840fcd00 0x7f4e8410c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:12.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.703+0000 7f4e83fff700 1 -- 172.21.15.152:0/1222486776 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e840fcd00 msgr2=0x7f4e8410c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:12.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.703+0000 7f4e83fff700 1 --2- 172.21.15.152:0/1222486776 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e840fcd00 0x7f4e8410c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:12.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.703+0000 7f4e83fff700 1 -- 172.21.15.152:0/1222486776 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e78005040 con 0x7f4e840fbaf0 2023-12-06T14:57:12.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.703+0000 7f4e83fff700 1 --2- 172.21.15.152:0/1222486776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e840fbaf0 0x7f4e8410c3d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4e7400eb70 tx=0x7f4e7400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:12.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.703+0000 7f4e80ff9700 1 -- 172.21.15.152:0/1222486776 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e74007cc0 con 0x7f4e840fbaf0 2023-12-06T14:57:12.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.703+0000 7f4e80ff9700 1 -- 172.21.15.152:0/1222486776 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4e7400f040 con 0x7f4e840fbaf0 2023-12-06T14:57:12.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.703+0000 7f4e8a451700 1 -- 172.21.15.152:0/1222486776 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e8410da30 con 0x7f4e840fbaf0 2023-12-06T14:57:12.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.703+0000 7f4e80ff9700 1 -- 172.21.15.152:0/1222486776 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e7400cad0 con 0x7f4e840fbaf0 2023-12-06T14:57:12.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.703+0000 7f4e8a451700 1 -- 172.21.15.152:0/1222486776 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e8410df70 con 0x7f4e840fbaf0 2023-12-06T14:57:12.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.704+0000 7f4e8a451700 1 -- 172.21.15.152:0/1222486776 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e8404bb80 con 0x7f4e840fbaf0 2023-12-06T14:57:12.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.705+0000 7f4e80ff9700 1 -- 172.21.15.152:0/1222486776 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f4e7400cc30 con 0x7f4e840fbaf0 2023-12-06T14:57:12.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.705+0000 7f4e80ff9700 1 --2- 172.21.15.152:0/1222486776 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f4e6c068f60 0x7f4e6c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:12.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.705+0000 7f4e80ff9700 1 -- 172.21.15.152:0/1222486776 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f4e74086540 con 0x7f4e840fbaf0 2023-12-06T14:57:12.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.705+0000 7f4e837fe700 1 --2- 172.21.15.152:0/1222486776 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f4e6c068f60 0x7f4e6c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:12.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.705+0000 7f4e837fe700 1 --2- 172.21.15.152:0/1222486776 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f4e6c068f60 0x7f4e6c06b410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4e7800b0d0 tx=0x7f4e78009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:12.709 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.709+0000 7f4e80ff9700 1 -- 172.21.15.152:0/1222486776 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f4e7404da00 con 0x7f4e840fbaf0 2023-12-06T14:57:12.893 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.893+0000 7f4e8a451700 1 -- 172.21.15.152:0/1222486776 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f4e8410e350 con 0x7f4e840fbaf0 2023-12-06T14:57:12.893 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.893+0000 7f4e80ff9700 1 -- 172.21.15.152:0/1222486776 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v38) v1 ==== 74+0+130 (secure 0 0 0) 0x7f4e74056810 con 0x7f4e840fbaf0 2023-12-06T14:57:12.893 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:57:12.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.895+0000 7f4e8a451700 1 -- 172.21.15.152:0/1222486776 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f4e6c068f60 msgr2=0x7f4e6c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:12.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.895+0000 7f4e8a451700 1 --2- 172.21.15.152:0/1222486776 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f4e6c068f60 0x7f4e6c06b410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4e7800b0d0 tx=0x7f4e78009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:12.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.895+0000 7f4e8a451700 1 -- 172.21.15.152:0/1222486776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e840fbaf0 msgr2=0x7f4e8410c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:12.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.895+0000 7f4e8a451700 1 --2- 172.21.15.152:0/1222486776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e840fbaf0 0x7f4e8410c3d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4e7400eb70 tx=0x7f4e7400b040 comp rx=0 tx=0).stop 2023-12-06T14:57:12.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.895+0000 7f4e8a451700 1 -- 172.21.15.152:0/1222486776 shutdown_connections 2023-12-06T14:57:12.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.895+0000 7f4e8a451700 1 --2- 172.21.15.152:0/1222486776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e840fbaf0 0x7f4e8410c3d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:12.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.895+0000 7f4e8a451700 1 --2- 172.21.15.152:0/1222486776 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f4e6c068f60 0x7f4e6c06b410 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:12.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.895+0000 7f4e8a451700 1 --2- 172.21.15.152:0/1222486776 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e840fcd00 0x7f4e8410c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:12.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.895+0000 7f4e8a451700 1 -- 172.21.15.152:0/1222486776 >> 172.21.15.152:0/1222486776 conn(0x7f4e840f7190 msgr2=0x7f4e840fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:12.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.895+0000 7f4e8a451700 1 -- 172.21.15.152:0/1222486776 shutdown_connections 2023-12-06T14:57:12.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:12.895+0000 7f4e8a451700 1 -- 172.21.15.152:0/1222486776 wait complete. 2023-12-06T14:57:13.222 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:13 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/1222486776' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-06T14:57:13.273 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":38,"num_osds":6,"num_up_osds":6,"osd_up_since":1701874630,"num_in_osds":6,"osd_in_since":1701874613,"num_remapped_pgs":0} 2023-12-06T14:57:13.274 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph osd dump --format=json 2023-12-06T14:57:13.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:13 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/1222486776' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-06T14:57:13.575 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:57:14.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:14 smithi152 ceph-mon[111954]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:14.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:14 smithi190 ceph-mon[121340]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:14.602 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.601+0000 7f7513554700 1 -- 172.21.15.152:0/3877008531 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f750c0fbb40 msgr2=0x7f750c0fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:14.602 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.601+0000 7f7513554700 1 --2- 172.21.15.152:0/3877008531 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f750c0fbb40 0x7f750c0fbfb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7508004940 tx=0x7f7508009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:14.602 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.601+0000 7f7513554700 1 -- 172.21.15.152:0/3877008531 shutdown_connections 2023-12-06T14:57:14.602 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.601+0000 7f7513554700 1 --2- 172.21.15.152:0/3877008531 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f750c0fbb40 0x7f750c0fbfb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:14.602 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.601+0000 7f7513554700 1 --2- 172.21.15.152:0/3877008531 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f750c101b00 0x7f750c101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:14.602 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.601+0000 7f7513554700 1 -- 172.21.15.152:0/3877008531 >> 172.21.15.152:0/3877008531 conn(0x7f750c0719b0 msgr2=0x7f750c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:14.602 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.602+0000 7f7513554700 1 -- 172.21.15.152:0/3877008531 shutdown_connections 2023-12-06T14:57:14.602 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.602+0000 7f7513554700 1 -- 172.21.15.152:0/3877008531 wait complete. 2023-12-06T14:57:14.604 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.602+0000 7f7513554700 1 Processor -- start 2023-12-06T14:57:14.604 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.602+0000 7f7513554700 1 -- start start 2023-12-06T14:57:14.604 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.602+0000 7f7513554700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f750c0fbb40 0x7f750c112640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:14.604 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.603+0000 7f7513554700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f750c101b00 0x7f750c112b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:14.604 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.603+0000 7f7513554700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750c1131d0 con 0x7f750c101b00 2023-12-06T14:57:14.604 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.603+0000 7f7513554700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750c10c4c0 con 0x7f750c0fbb40 2023-12-06T14:57:14.604 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.603+0000 7f7510aef700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f750c101b00 0x7f750c112b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:14.604 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.603+0000 7f7510aef700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f750c101b00 0x7f750c112b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52166/0 (socket says 172.21.15.152:52166) 2023-12-06T14:57:14.604 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.603+0000 7f7510aef700 1 -- 172.21.15.152:0/2045116340 learned_addr learned my addr 172.21.15.152:0/2045116340 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:57:14.604 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.603+0000 7f75112f0700 1 --2- 172.21.15.152:0/2045116340 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f750c0fbb40 0x7f750c112640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:14.604 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.603+0000 7f7510aef700 1 -- 172.21.15.152:0/2045116340 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f750c0fbb40 msgr2=0x7f750c112640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:14.604 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.603+0000 7f7510aef700 1 --2- 172.21.15.152:0/2045116340 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f750c0fbb40 0x7f750c112640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:14.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.603+0000 7f7510aef700 1 -- 172.21.15.152:0/2045116340 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7508005040 con 0x7f750c101b00 2023-12-06T14:57:14.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.603+0000 7f7510aef700 1 --2- 172.21.15.152:0/2045116340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f750c101b00 0x7f750c112b80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f750800b3b0 tx=0x7f7508009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:14.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.603+0000 7f7501ffb700 1 -- 172.21.15.152:0/2045116340 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f750800e040 con 0x7f750c101b00 2023-12-06T14:57:14.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.603+0000 7f7501ffb700 1 -- 172.21.15.152:0/2045116340 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f750801c430 con 0x7f750c101b00 2023-12-06T14:57:14.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.603+0000 7f7513554700 1 -- 172.21.15.152:0/2045116340 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f750c10c740 con 0x7f750c101b00 2023-12-06T14:57:14.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.603+0000 7f7501ffb700 1 -- 172.21.15.152:0/2045116340 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7508013640 con 0x7f750c101b00 2023-12-06T14:57:14.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.603+0000 7f7513554700 1 -- 172.21.15.152:0/2045116340 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f750c10cc80 con 0x7f750c101b00 2023-12-06T14:57:14.606 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.604+0000 7f7513554700 1 -- 172.21.15.152:0/2045116340 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f750c1122d0 con 0x7f750c101b00 2023-12-06T14:57:14.606 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.605+0000 7f7501ffb700 1 -- 172.21.15.152:0/2045116340 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f750801c5a0 con 0x7f750c101b00 2023-12-06T14:57:14.606 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.605+0000 7f7501ffb700 1 --2- 172.21.15.152:0/2045116340 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f74f8068f60 0x7f74f806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:14.606 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.605+0000 7f7501ffb700 1 -- 172.21.15.152:0/2045116340 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7508087490 con 0x7f750c101b00 2023-12-06T14:57:14.606 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.605+0000 7f75112f0700 1 --2- 172.21.15.152:0/2045116340 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f74f8068f60 0x7f74f806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:14.606 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.606+0000 7f75112f0700 1 --2- 172.21.15.152:0/2045116340 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f74f8068f60 0x7f74f806b410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f74fc004f40 tx=0x7f74fc00b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:14.609 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.610+0000 7f7501ffb700 1 -- 172.21.15.152:0/2045116340 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7508057880 con 0x7f750c101b00 2023-12-06T14:57:14.793 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.793+0000 7f7513554700 1 -- 172.21.15.152:0/2045116340 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f750c103fb0 con 0x7f750c101b00 2023-12-06T14:57:14.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.794+0000 7f7501ffb700 1 -- 172.21.15.152:0/2045116340 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11132 (secure 0 0 0) 0x7f7508057410 con 0x7f750c101b00 2023-12-06T14:57:14.794 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:57:14.794 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":38,"fsid":"062f0e3c-9447-11ee-95a2-87774f69a715","created":"2023-12-06T14:53:01.413534+0000","modified":"2023-12-06T14:57:11.134448+0000","last_up_change":"2023-12-06T14:57:10.129077+0000","last_in_change":"2023-12-06T14:56:53.456498+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-06T14:56:15.276535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"72a62158-6e7d-42af-8212-f6ae2b8df6e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3829936777},{"type":"v1","addr":"172.21.15.152:6803","nonce":3829936777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3829936777},{"type":"v1","addr":"172.21.15.152:6805","nonce":3829936777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3829936777},{"type":"v1","addr":"172.21.15.152:6809","nonce":3829936777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3829936777},{"type":"v1","addr":"172.21.15.152:6807","nonce":3829936777}]},"public_addr":"172.21.15.152:6803/3829936777","cluster_addr":"172.21.15.152:6805/3829936777","heartbeat_back_addr":"172.21.15.152:6809/3829936777","heartbeat_front_addr":"172.21.15.152:6807/3829936777","state":["exists","up"]},{"osd":1,"uuid":"50dee56b-c95b-4361-ad0d-4f71198f9105","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1158477634},{"type":"v1","addr":"172.21.15.152:6811","nonce":1158477634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1158477634},{"type":"v1","addr":"172.21.15.152:6813","nonce":1158477634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1158477634},{"type":"v1","addr":"172.21.15.152:6817","nonce":1158477634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1158477634},{"type":"v1","addr":"172.21.15.152:6815","nonce":1158477634}]},"public_addr":"172.21.15.152:6811/1158477634","cluster_addr":"172.21.15.152:6813/1158477634","heartbeat_back_addr":"172.21.15.152:6817/1158477634","heartbeat_front_addr":"172.21.15.152:6815/1158477634","state":["exists","up"]},{"osd":2,"uuid":"8dce6383-8296-4737-99d9-427bbd62f9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3416520485},{"type":"v1","addr":"172.21.15.152:6819","nonce":3416520485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3416520485},{"type":"v1","addr":"172.21.15.152:6821","nonce":3416520485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3416520485},{"type":"v1","addr":"172.21.15.152:6825","nonce":3416520485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3416520485},{"type":"v1","addr":"172.21.15.152:6823","nonce":3416520485}]},"public_addr":"172.21.15.152:6819/3416520485","cluster_addr":"172.21.15.152:6821/3416520485","heartbeat_back_addr":"172.21.15.152:6825/3416520485","heartbeat_front_addr":"172.21.15.152:6823/3416520485","state":["exists","up"]},{"osd":3,"uuid":"ea52387d-fb71-4ed5-bde5-85550b5cc117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":977527629},{"type":"v1","addr":"172.21.15.190:6801","nonce":977527629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":977527629},{"type":"v1","addr":"172.21.15.190:6803","nonce":977527629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":977527629},{"type":"v1","addr":"172.21.15.190:6807","nonce":977527629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":977527629},{"type":"v1","addr":"172.21.15.190:6805","nonce":977527629}]},"public_addr":"172.21.15.190:6801/977527629","cluster_addr":"172.21.15.190:6803/977527629","heartbeat_back_addr":"172.21.15.190:6807/977527629","heartbeat_front_addr":"172.21.15.190:6805/977527629","state":["exists","up"]},{"osd":4,"uuid":"23efef41-308e-467c-9f90-ae159a8d43a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2742121756},{"type":"v1","addr":"172.21.15.190:6809","nonce":2742121756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2742121756},{"type":"v1","addr":"172.21.15.190:6811","nonce":2742121756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2742121756},{"type":"v1","addr":"172.21.15.190:6815","nonce":2742121756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2742121756},{"type":"v1","addr":"172.21.15.190:6813","nonce":2742121756}]},"public_addr":"172.21.15.190:6809/2742121756","cluster_addr":"172.21.15.190:6811/2742121756","heartbeat_back_addr":"172.21.15.190:6815/2742121756","heartbeat_front_addr":"172.21.15.190:6813/2742121756","state":["exists","up"]},{"osd":5,"uuid":"fe0aeff2-a9e0-4cb5-9cd9-fd0e3db4807f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":3073656058},{"type":"v1","addr":"172.21.15.190:6817","nonce":3073656058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":3073656058},{"type":"v1","addr":"172.21.15.190:6819","nonce":3073656058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":3073656058},{"type":"v1","addr":"172.21.15.190:6823","nonce":3073656058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":3073656058},{"type":"v1","addr":"172.21.15.190:6821","nonce":3073656058}]},"public_addr":"172.21.15.190:6817/3073656058","cluster_addr":"172.21.15.190:6819/3073656058","heartbeat_back_addr":"172.21.15.190:6823/3073656058","heartbeat_front_addr":"172.21.15.190:6821/3073656058","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T14:55:32.948973+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T14:55:53.358269+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T14:56:12.783635+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T14:56:30.517271+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T14:56:49.401042+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T14:57:08.146152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.152:0/2095526930":"2023-12-07T14:54:40.970995+0000","172.21.15.152:0/2571521952":"2023-12-07T14:53:50.748958+0000","172.21.15.152:0/145030765":"2023-12-07T14:53:50.748958+0000","172.21.15.152:0/2581585771":"2023-12-07T14:53:50.748958+0000","172.21.15.152:6801/3517650686":"2023-12-07T14:54:40.970995+0000","172.21.15.152:6800/3517650686":"2023-12-07T14:54:40.970995+0000","172.21.15.152:6801/2466555973":"2023-12-07T14:53:50.748958+0000","172.21.15.152:0/959508847":"2023-12-07T14:54:40.970995+0000","172.21.15.152:0/181182783":"2023-12-07T14:53:24.414825+0000","172.21.15.152:0/251625153":"2023-12-07T14:54:40.970995+0000","172.21.15.152:0/4186839809":"2023-12-07T14:53:24.414825+0000","172.21.15.152:0/3538958834":"2023-12-07T14:53:24.414825+0000","172.21.15.152:6800/1793082857":"2023-12-07T14:53:24.414825+0000","172.21.15.152:6801/1793082857":"2023-12-07T14:53:24.414825+0000","172.21.15.152:6800/2466555973":"2023-12-07T14:53:50.748958+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-06T14:57:14.796 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.796+0000 7f7513554700 1 -- 172.21.15.152:0/2045116340 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f74f8068f60 msgr2=0x7f74f806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:14.796 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.796+0000 7f7513554700 1 --2- 172.21.15.152:0/2045116340 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f74f8068f60 0x7f74f806b410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f74fc004f40 tx=0x7f74fc00b040 comp rx=0 tx=0).stop 2023-12-06T14:57:14.796 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.796+0000 7f7513554700 1 -- 172.21.15.152:0/2045116340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f750c101b00 msgr2=0x7f750c112b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:14.796 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.796+0000 7f7513554700 1 --2- 172.21.15.152:0/2045116340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f750c101b00 0x7f750c112b80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f750800b3b0 tx=0x7f7508009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:14.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.796+0000 7f7513554700 1 -- 172.21.15.152:0/2045116340 shutdown_connections 2023-12-06T14:57:14.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.796+0000 7f7513554700 1 --2- 172.21.15.152:0/2045116340 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f74f8068f60 0x7f74f806b410 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:14.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.796+0000 7f7513554700 1 --2- 172.21.15.152:0/2045116340 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f750c0fbb40 0x7f750c112640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:14.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.796+0000 7f7513554700 1 --2- 172.21.15.152:0/2045116340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f750c101b00 0x7f750c112b80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:14.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.796+0000 7f7513554700 1 -- 172.21.15.152:0/2045116340 >> 172.21.15.152:0/2045116340 conn(0x7f750c0719b0 msgr2=0x7f750c0fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:14.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.796+0000 7f7513554700 1 -- 172.21.15.152:0/2045116340 shutdown_connections 2023-12-06T14:57:14.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:14.796+0000 7f7513554700 1 -- 172.21.15.152:0/2045116340 wait complete. 2023-12-06T14:57:15.208 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-06T14:56:15.276535+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-12-06T14:57:15.209 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph osd pool get .mgr pg_num 2023-12-06T14:57:15.469 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:57:15.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:15 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/2045116340' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-06T14:57:15.582 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:15 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/2045116340' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-06T14:57:16.269 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:16 smithi152 ceph-mon[111954]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:16.477 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.476+0000 7f3d98e0e700 1 -- 172.21.15.152:0/933439962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d940fbb40 msgr2=0x7f3d940fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:16.477 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.476+0000 7f3d98e0e700 1 --2- 172.21.15.152:0/933439962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d940fbb40 0x7f3d940fbfb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3d84004940 tx=0x7f3d84009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:16.478 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.476+0000 7f3d98e0e700 1 -- 172.21.15.152:0/933439962 shutdown_connections 2023-12-06T14:57:16.478 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.476+0000 7f3d98e0e700 1 --2- 172.21.15.152:0/933439962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d940fbb40 0x7f3d940fbfb0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:16.478 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.476+0000 7f3d98e0e700 1 --2- 172.21.15.152:0/933439962 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d94101b00 0x7f3d94101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:16.478 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.476+0000 7f3d98e0e700 1 -- 172.21.15.152:0/933439962 >> 172.21.15.152:0/933439962 conn(0x7f3d940719b0 msgr2=0x7f3d94071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:16.478 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.476+0000 7f3d98e0e700 1 -- 172.21.15.152:0/933439962 shutdown_connections 2023-12-06T14:57:16.478 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.476+0000 7f3d98e0e700 1 -- 172.21.15.152:0/933439962 wait complete. 2023-12-06T14:57:16.479 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.477+0000 7f3d98e0e700 1 Processor -- start 2023-12-06T14:57:16.479 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.477+0000 7f3d98e0e700 1 -- start start 2023-12-06T14:57:16.479 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.477+0000 7f3d98e0e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d940fbb40 0x7f3d94112560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:16.480 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.477+0000 7f3d98e0e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d94101b00 0x7f3d94112aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:16.480 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.477+0000 7f3d98e0e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d94113180 con 0x7f3d94101b00 2023-12-06T14:57:16.480 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.477+0000 7f3d98e0e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9410c420 con 0x7f3d940fbb40 2023-12-06T14:57:16.480 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.477+0000 7f3d91d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d94101b00 0x7f3d94112aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:16.480 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.477+0000 7f3d91d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d94101b00 0x7f3d94112aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52182/0 (socket says 172.21.15.152:52182) 2023-12-06T14:57:16.480 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.477+0000 7f3d91d9b700 1 -- 172.21.15.152:0/4182207914 learned_addr learned my addr 172.21.15.152:0/4182207914 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:57:16.480 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.478+0000 7f3d9259c700 1 --2- 172.21.15.152:0/4182207914 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d940fbb40 0x7f3d94112560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:16.480 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.478+0000 7f3d91d9b700 1 -- 172.21.15.152:0/4182207914 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d940fbb40 msgr2=0x7f3d94112560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:16.480 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.478+0000 7f3d91d9b700 1 --2- 172.21.15.152:0/4182207914 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d940fbb40 0x7f3d94112560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:16.480 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.478+0000 7f3d91d9b700 1 -- 172.21.15.152:0/4182207914 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d84005040 con 0x7f3d94101b00 2023-12-06T14:57:16.480 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.478+0000 7f3d91d9b700 1 --2- 172.21.15.152:0/4182207914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d94101b00 0x7f3d94112aa0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3d8400b3b0 tx=0x7f3d84009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:16.480 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.478+0000 7f3d82ffd700 1 -- 172.21.15.152:0/4182207914 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d8400e040 con 0x7f3d94101b00 2023-12-06T14:57:16.480 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.478+0000 7f3d82ffd700 1 -- 172.21.15.152:0/4182207914 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3d84009af0 con 0x7f3d94101b00 2023-12-06T14:57:16.481 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.478+0000 7f3d98e0e700 1 -- 172.21.15.152:0/4182207914 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d9410c6a0 con 0x7f3d94101b00 2023-12-06T14:57:16.481 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.478+0000 7f3d82ffd700 1 -- 172.21.15.152:0/4182207914 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d84013770 con 0x7f3d94101b00 2023-12-06T14:57:16.481 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.478+0000 7f3d98e0e700 1 -- 172.21.15.152:0/4182207914 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d9410cb80 con 0x7f3d94101b00 2023-12-06T14:57:16.481 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.479+0000 7f3d98e0e700 1 -- 172.21.15.152:0/4182207914 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d940734d0 con 0x7f3d94101b00 2023-12-06T14:57:16.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.479+0000 7f3d82ffd700 1 -- 172.21.15.152:0/4182207914 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f3d8401e420 con 0x7f3d94101b00 2023-12-06T14:57:16.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.480+0000 7f3d82ffd700 1 --2- 172.21.15.152:0/4182207914 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f3d7c068f60 0x7f3d7c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:16.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.480+0000 7f3d82ffd700 1 -- 172.21.15.152:0/4182207914 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3d8408aa70 con 0x7f3d94101b00 2023-12-06T14:57:16.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.480+0000 7f3d9259c700 1 --2- 172.21.15.152:0/4182207914 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f3d7c068f60 0x7f3d7c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:16.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.480+0000 7f3d9259c700 1 --2- 172.21.15.152:0/4182207914 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f3d7c068f60 0x7f3d7c06b410 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3d88006fd0 tx=0x7f3d88008040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:16.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.484+0000 7f3d82ffd700 1 -- 172.21.15.152:0/4182207914 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f3d8405ac90 con 0x7f3d94101b00 2023-12-06T14:57:16.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:16 smithi190 ceph-mon[121340]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:16.670 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.668+0000 7f3d98e0e700 1 -- 172.21.15.152:0/4182207914 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3d94108b30 con 0x7f3d94101b00 2023-12-06T14:57:16.670 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.669+0000 7f3d82ffd700 1 -- 172.21.15.152:0/4182207914 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3d8408ae60 con 0x7f3d94101b00 2023-12-06T14:57:16.670 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2023-12-06T14:57:16.672 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.671+0000 7f3d98e0e700 1 -- 172.21.15.152:0/4182207914 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f3d7c068f60 msgr2=0x7f3d7c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:16.672 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.671+0000 7f3d98e0e700 1 --2- 172.21.15.152:0/4182207914 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f3d7c068f60 0x7f3d7c06b410 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3d88006fd0 tx=0x7f3d88008040 comp rx=0 tx=0).stop 2023-12-06T14:57:16.672 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.671+0000 7f3d98e0e700 1 -- 172.21.15.152:0/4182207914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d94101b00 msgr2=0x7f3d94112aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:16.672 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.671+0000 7f3d98e0e700 1 --2- 172.21.15.152:0/4182207914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d94101b00 0x7f3d94112aa0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3d8400b3b0 tx=0x7f3d84009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:16.673 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.671+0000 7f3d98e0e700 1 -- 172.21.15.152:0/4182207914 shutdown_connections 2023-12-06T14:57:16.673 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.671+0000 7f3d98e0e700 1 --2- 172.21.15.152:0/4182207914 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f3d7c068f60 0x7f3d7c06b410 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:16.673 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.671+0000 7f3d98e0e700 1 --2- 172.21.15.152:0/4182207914 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d940fbb40 0x7f3d94112560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:16.673 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.671+0000 7f3d98e0e700 1 --2- 172.21.15.152:0/4182207914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d94101b00 0x7f3d94112aa0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:16.673 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.671+0000 7f3d98e0e700 1 -- 172.21.15.152:0/4182207914 >> 172.21.15.152:0/4182207914 conn(0x7f3d940719b0 msgr2=0x7f3d940faa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:16.673 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.671+0000 7f3d98e0e700 1 -- 172.21.15.152:0/4182207914 shutdown_connections 2023-12-06T14:57:16.673 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:16.671+0000 7f3d98e0e700 1 -- 172.21.15.152:0/4182207914 wait complete. 2023-12-06T14:57:17.040 INFO:tasks.cephadm:Setting up client nodes... 2023-12-06T14:57:17.040 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-12-06T14:57:17.305 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:57:17.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:17 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/4182207914' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-06T14:57:17.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:17 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/4182207914' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-06T14:57:18.313 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.312+0000 7fdd8afb5700 1 -- 172.21.15.152:0/2132259565 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd840fbaf0 msgr2=0x7fdd840fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:18.313 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.312+0000 7fdd8afb5700 1 --2- 172.21.15.152:0/2132259565 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd840fbaf0 0x7fdd840fbf00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdd78004940 tx=0x7fdd78009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:18.313 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.312+0000 7fdd8afb5700 1 -- 172.21.15.152:0/2132259565 shutdown_connections 2023-12-06T14:57:18.314 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.312+0000 7fdd8afb5700 1 --2- 172.21.15.152:0/2132259565 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd840fcd00 0x7fdd840fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:18.314 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.312+0000 7fdd8afb5700 1 --2- 172.21.15.152:0/2132259565 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd840fbaf0 0x7fdd840fbf00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:18.314 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.312+0000 7fdd8afb5700 1 -- 172.21.15.152:0/2132259565 >> 172.21.15.152:0/2132259565 conn(0x7fdd840f71b0 msgr2=0x7fdd840f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:18.314 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.312+0000 7fdd8afb5700 1 -- 172.21.15.152:0/2132259565 shutdown_connections 2023-12-06T14:57:18.314 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.312+0000 7fdd8afb5700 1 -- 172.21.15.152:0/2132259565 wait complete. 2023-12-06T14:57:18.314 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.312+0000 7fdd8afb5700 1 Processor -- start 2023-12-06T14:57:18.314 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.312+0000 7fdd8afb5700 1 -- start start 2023-12-06T14:57:18.316 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.313+0000 7fdd8afb5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd840fbaf0 0x7fdd8410c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:18.316 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.313+0000 7fdd8afb5700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd840fcd00 0x7fdd8410c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:18.316 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.313+0000 7fdd8afb5700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8410d040 con 0x7fdd840fbaf0 2023-12-06T14:57:18.316 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.313+0000 7fdd8afb5700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8410d880 con 0x7fdd840fcd00 2023-12-06T14:57:18.317 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.313+0000 7fdd88d51700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd840fbaf0 0x7fdd8410c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:18.317 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.313+0000 7fdd88d51700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd840fbaf0 0x7fdd8410c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52188/0 (socket says 172.21.15.152:52188) 2023-12-06T14:57:18.317 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.313+0000 7fdd88d51700 1 -- 172.21.15.152:0/2226493630 learned_addr learned my addr 172.21.15.152:0/2226493630 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:57:18.317 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.313+0000 7fdd88d51700 1 -- 172.21.15.152:0/2226493630 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd840fcd00 msgr2=0x7fdd8410c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:18.317 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.313+0000 7fdd83fff700 1 --2- 172.21.15.152:0/2226493630 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd840fcd00 0x7fdd8410c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:18.317 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.313+0000 7fdd88d51700 1 --2- 172.21.15.152:0/2226493630 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd840fcd00 0x7fdd8410c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:18.317 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.313+0000 7fdd88d51700 1 -- 172.21.15.152:0/2226493630 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd78005040 con 0x7fdd840fbaf0 2023-12-06T14:57:18.317 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.313+0000 7fdd83fff700 1 --2- 172.21.15.152:0/2226493630 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd840fcd00 0x7fdd8410c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-06T14:57:18.317 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.313+0000 7fdd88d51700 1 --2- 172.21.15.152:0/2226493630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd840fbaf0 0x7fdd8410c470 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdd78004f90 tx=0x7fdd78009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:18.317 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.313+0000 7fdd817fa700 1 -- 172.21.15.152:0/2226493630 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd7800e040 con 0x7fdd840fbaf0 2023-12-06T14:57:18.317 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.313+0000 7fdd817fa700 1 -- 172.21.15.152:0/2226493630 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdd7800bcd0 con 0x7fdd840fbaf0 2023-12-06T14:57:18.317 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.313+0000 7fdd8afb5700 1 -- 172.21.15.152:0/2226493630 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd8410db00 con 0x7fdd840fbaf0 2023-12-06T14:57:18.317 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.313+0000 7fdd817fa700 1 -- 172.21.15.152:0/2226493630 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd7801c630 con 0x7fdd840fbaf0 2023-12-06T14:57:18.317 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.313+0000 7fdd8afb5700 1 -- 172.21.15.152:0/2226493630 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd8410e040 con 0x7fdd840fbaf0 2023-12-06T14:57:18.317 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.314+0000 7fdd8afb5700 1 -- 172.21.15.152:0/2226493630 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd8404bb80 con 0x7fdd840fbaf0 2023-12-06T14:57:18.318 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.315+0000 7fdd817fa700 1 -- 172.21.15.152:0/2226493630 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fdd78013960 con 0x7fdd840fbaf0 2023-12-06T14:57:18.318 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.315+0000 7fdd817fa700 1 --2- 172.21.15.152:0/2226493630 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fdd74068f60 0x7fdd7406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:18.318 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.315+0000 7fdd817fa700 1 -- 172.21.15.152:0/2226493630 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fdd78087e30 con 0x7fdd840fbaf0 2023-12-06T14:57:18.318 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.315+0000 7fdd83fff700 1 --2- 172.21.15.152:0/2226493630 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fdd74068f60 0x7fdd7406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:18.318 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.315+0000 7fdd83fff700 1 --2- 172.21.15.152:0/2226493630 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fdd74068f60 0x7fdd7406b410 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdd70006fd0 tx=0x7fdd70008040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:18.320 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.319+0000 7fdd817fa700 1 -- 172.21.15.152:0/2226493630 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fdd78058170 con 0x7fdd840fbaf0 2023-12-06T14:57:18.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:18 smithi152 ceph-mon[111954]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:18.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:18 smithi190 ceph-mon[121340]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:18.576 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.575+0000 7fdd8afb5700 1 -- 172.21.15.152:0/2226493630 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fdd84104510 con 0x7fdd840fbaf0 2023-12-06T14:57:18.582 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.580+0000 7fdd817fa700 1 -- 172.21.15.152:0/2226493630 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7fdd78057d00 con 0x7fdd840fbaf0 2023-12-06T14:57:18.582 INFO:teuthology.orchestra.run.smithi152.stdout:[client.0] 2023-12-06T14:57:18.582 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQDOi3BlT6R0IhAA+5h4u4gn/yvfX3fxLztdFQ== 2023-12-06T14:57:18.583 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.582+0000 7fdd8afb5700 1 -- 172.21.15.152:0/2226493630 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fdd74068f60 msgr2=0x7fdd7406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:18.583 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.582+0000 7fdd8afb5700 1 --2- 172.21.15.152:0/2226493630 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fdd74068f60 0x7fdd7406b410 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdd70006fd0 tx=0x7fdd70008040 comp rx=0 tx=0).stop 2023-12-06T14:57:18.583 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.582+0000 7fdd8afb5700 1 -- 172.21.15.152:0/2226493630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd840fbaf0 msgr2=0x7fdd8410c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:18.583 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.582+0000 7fdd8afb5700 1 --2- 172.21.15.152:0/2226493630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd840fbaf0 0x7fdd8410c470 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdd78004f90 tx=0x7fdd78009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:18.583 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.582+0000 7fdd8afb5700 1 -- 172.21.15.152:0/2226493630 shutdown_connections 2023-12-06T14:57:18.583 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.582+0000 7fdd8afb5700 1 --2- 172.21.15.152:0/2226493630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd840fbaf0 0x7fdd8410c470 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:18.583 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.582+0000 7fdd8afb5700 1 --2- 172.21.15.152:0/2226493630 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fdd74068f60 0x7fdd7406b410 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:18.584 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.582+0000 7fdd8afb5700 1 --2- 172.21.15.152:0/2226493630 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd840fcd00 0x7fdd8410c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:18.584 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.582+0000 7fdd8afb5700 1 -- 172.21.15.152:0/2226493630 >> 172.21.15.152:0/2226493630 conn(0x7fdd840f71b0 msgr2=0x7fdd840fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:18.584 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.582+0000 7fdd8afb5700 1 -- 172.21.15.152:0/2226493630 shutdown_connections 2023-12-06T14:57:18.584 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:18.582+0000 7fdd8afb5700 1 -- 172.21.15.152:0/2226493630 wait complete. 2023-12-06T14:57:18.957 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-06T14:57:18.957 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-12-06T14:57:18.957 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-06T14:57:18.997 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-12-06T14:57:19.271 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi190/config 2023-12-06T14:57:19.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:19 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/2226493630' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-06T14:57:19.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:19 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/2226493630' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-06T14:57:19.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:19 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/2226493630' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-06T14:57:19.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:19 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/2226493630' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-06T14:57:20.296 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.295+0000 7fa981a1a700 1 -- 172.21.15.190:0/2332196131 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa97c0ffd70 msgr2=0x7fa97c1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:20.296 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.295+0000 7fa981a1a700 1 --2- 172.21.15.190:0/2332196131 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa97c0ffd70 0x7fa97c1021d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa96c004940 tx=0x7fa96c009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:20.296 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.296+0000 7fa981a1a700 1 -- 172.21.15.190:0/2332196131 shutdown_connections 2023-12-06T14:57:20.297 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.296+0000 7fa981a1a700 1 --2- 172.21.15.190:0/2332196131 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa97c0ffd70 0x7fa97c1021d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:20.297 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.296+0000 7fa981a1a700 1 --2- 172.21.15.190:0/2332196131 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa97c066920 0x7fa97c0ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:20.297 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.296+0000 7fa981a1a700 1 -- 172.21.15.190:0/2332196131 >> 172.21.15.190:0/2332196131 conn(0x7fa97c0f71d0 msgr2=0x7fa97c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:20.297 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.296+0000 7fa981a1a700 1 -- 172.21.15.190:0/2332196131 shutdown_connections 2023-12-06T14:57:20.297 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.296+0000 7fa981a1a700 1 -- 172.21.15.190:0/2332196131 wait complete. 2023-12-06T14:57:20.299 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.296+0000 7fa981a1a700 1 Processor -- start 2023-12-06T14:57:20.299 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.296+0000 7fa981a1a700 1 -- start start 2023-12-06T14:57:20.299 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.296+0000 7fa981a1a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa97c066920 0x7fa97c10d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:20.299 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.296+0000 7fa981a1a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa97c0ffd70 0x7fa97c10da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:20.299 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.296+0000 7fa981a1a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97c10e120 con 0x7fa97c066920 2023-12-06T14:57:20.299 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.296+0000 7fa981a1a700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97c10e960 con 0x7fa97c0ffd70 2023-12-06T14:57:20.300 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.297+0000 7fa97a7fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa97c0ffd70 0x7fa97c10da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:20.300 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.297+0000 7fa97a7fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa97c0ffd70 0x7fa97c10da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:39994/0 (socket says 172.21.15.190:39994) 2023-12-06T14:57:20.300 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.297+0000 7fa97a7fc700 1 -- 172.21.15.190:0/1448706174 learned_addr learned my addr 172.21.15.190:0/1448706174 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-12-06T14:57:20.300 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.297+0000 7fa97affd700 1 --2- 172.21.15.190:0/1448706174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa97c066920 0x7fa97c10d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:20.300 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.297+0000 7fa97a7fc700 1 -- 172.21.15.190:0/1448706174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa97c066920 msgr2=0x7fa97c10d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:20.300 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.297+0000 7fa97a7fc700 1 --2- 172.21.15.190:0/1448706174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa97c066920 0x7fa97c10d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:20.300 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.297+0000 7fa97a7fc700 1 -- 172.21.15.190:0/1448706174 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa96c005040 con 0x7fa97c0ffd70 2023-12-06T14:57:20.300 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.297+0000 7fa97a7fc700 1 --2- 172.21.15.190:0/1448706174 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa97c0ffd70 0x7fa97c10da90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa96c009360 tx=0x7fa96c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:20.300 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.297+0000 7fa9637fe700 1 -- 172.21.15.190:0/1448706174 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa96c00e040 con 0x7fa97c0ffd70 2023-12-06T14:57:20.300 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.297+0000 7fa981a1a700 1 -- 172.21.15.190:0/1448706174 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa97c10ebe0 con 0x7fa97c0ffd70 2023-12-06T14:57:20.300 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.297+0000 7fa9637fe700 1 -- 172.21.15.190:0/1448706174 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa96c004290 con 0x7fa97c0ffd70 2023-12-06T14:57:20.300 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.297+0000 7fa9637fe700 1 -- 172.21.15.190:0/1448706174 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa96c01c630 con 0x7fa97c0ffd70 2023-12-06T14:57:20.300 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.297+0000 7fa981a1a700 1 -- 172.21.15.190:0/1448706174 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa97c10f120 con 0x7fa97c0ffd70 2023-12-06T14:57:20.300 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.298+0000 7fa981a1a700 1 -- 172.21.15.190:0/1448706174 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa97c107640 con 0x7fa97c0ffd70 2023-12-06T14:57:20.301 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.299+0000 7fa9637fe700 1 -- 172.21.15.190:0/1448706174 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fa96c00bcd0 con 0x7fa97c0ffd70 2023-12-06T14:57:20.301 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.299+0000 7fa9637fe700 1 --2- 172.21.15.190:0/1448706174 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fa964068f70 0x7fa96406b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:20.301 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.299+0000 7fa9637fe700 1 -- 172.21.15.190:0/1448706174 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa96c087ea0 con 0x7fa97c0ffd70 2023-12-06T14:57:20.301 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.299+0000 7fa97affd700 1 --2- 172.21.15.190:0/1448706174 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fa964068f70 0x7fa96406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:20.301 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.300+0000 7fa97affd700 1 --2- 172.21.15.190:0/1448706174 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fa964068f70 0x7fa96406b420 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa970006fd0 tx=0x7fa970008040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:20.303 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.303+0000 7fa9637fe700 1 -- 172.21.15.190:0/1448706174 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa96c0581f0 con 0x7fa97c0ffd70 2023-12-06T14:57:20.559 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.558+0000 7fa981a1a700 1 -- 172.21.15.190:0/1448706174 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fa97c04bb80 con 0x7fa97c0ffd70 2023-12-06T14:57:20.563 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.563+0000 7fa9637fe700 1 -- 172.21.15.190:0/1448706174 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7fa96c057d80 con 0x7fa97c0ffd70 2023-12-06T14:57:20.564 INFO:teuthology.orchestra.run.smithi190.stdout:[client.1] 2023-12-06T14:57:20.564 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQDQi3BlTWJwIRAAOUe6CLACYoJO6IoUr2TQkA== 2023-12-06T14:57:20.566 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.565+0000 7fa981a1a700 1 -- 172.21.15.190:0/1448706174 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fa964068f70 msgr2=0x7fa96406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:20.566 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.565+0000 7fa981a1a700 1 --2- 172.21.15.190:0/1448706174 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fa964068f70 0x7fa96406b420 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa970006fd0 tx=0x7fa970008040 comp rx=0 tx=0).stop 2023-12-06T14:57:20.566 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.565+0000 7fa981a1a700 1 -- 172.21.15.190:0/1448706174 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa97c0ffd70 msgr2=0x7fa97c10da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:20.567 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.565+0000 7fa981a1a700 1 --2- 172.21.15.190:0/1448706174 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa97c0ffd70 0x7fa97c10da90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa96c009360 tx=0x7fa96c009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:20.567 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.565+0000 7fa981a1a700 1 -- 172.21.15.190:0/1448706174 shutdown_connections 2023-12-06T14:57:20.567 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.565+0000 7fa981a1a700 1 --2- 172.21.15.190:0/1448706174 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa97c066920 0x7fa97c10d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:20.567 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.565+0000 7fa981a1a700 1 --2- 172.21.15.190:0/1448706174 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fa964068f70 0x7fa96406b420 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:20.567 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.565+0000 7fa981a1a700 1 --2- 172.21.15.190:0/1448706174 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa97c0ffd70 0x7fa97c10da90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:20.567 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.565+0000 7fa981a1a700 1 -- 172.21.15.190:0/1448706174 >> 172.21.15.190:0/1448706174 conn(0x7fa97c0f71d0 msgr2=0x7fa97c0f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:20.567 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.565+0000 7fa981a1a700 1 -- 172.21.15.190:0/1448706174 shutdown_connections 2023-12-06T14:57:20.567 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-06T14:57:20.565+0000 7fa981a1a700 1 -- 172.21.15.190:0/1448706174 wait complete. 2023-12-06T14:57:20.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:20 smithi190 ceph-mon[121340]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:20.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:20 smithi152 ceph-mon[111954]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:20.942 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-06T14:57:20.943 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2023-12-06T14:57:20.943 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-06T14:57:20.984 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-06T14:57:20.984 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-12-06T14:57:20.984 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph mgr dump --format=json 2023-12-06T14:57:21.256 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:57:21.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:21 smithi190 ceph-mon[121340]: from='client.? 172.21.15.190:0/1448706174' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-06T14:57:21.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:21 smithi190 ceph-mon[121340]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-06T14:57:21.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:21 smithi190 ceph-mon[121340]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-06T14:57:21.366 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:21 smithi152 ceph-mon[111954]: from='client.? 172.21.15.190:0/1448706174' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-06T14:57:21.367 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:21 smithi152 ceph-mon[111954]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-06T14:57:21.367 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:21 smithi152 ceph-mon[111954]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-06T14:57:22.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.244+0000 7ff5dd7df700 1 -- 172.21.15.152:0/1365867623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5d8065390 msgr2=0x7ff5d8065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:22.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.244+0000 7ff5dd7df700 1 --2- 172.21.15.152:0/1365867623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5d8065390 0x7ff5d8065800 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff5c0004940 tx=0x7ff5c0009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:22.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.244+0000 7ff5dd7df700 1 -- 172.21.15.152:0/1365867623 shutdown_connections 2023-12-06T14:57:22.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.244+0000 7ff5dd7df700 1 --2- 172.21.15.152:0/1365867623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5d8065390 0x7ff5d8065800 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:22.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.244+0000 7ff5dd7df700 1 --2- 172.21.15.152:0/1365867623 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5d8102c20 0x7ff5d8102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:22.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.244+0000 7ff5dd7df700 1 -- 172.21.15.152:0/1365867623 >> 172.21.15.152:0/1365867623 conn(0x7ff5d80719b0 msgr2=0x7ff5d8071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:22.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.244+0000 7ff5dd7df700 1 -- 172.21.15.152:0/1365867623 shutdown_connections 2023-12-06T14:57:22.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.244+0000 7ff5dd7df700 1 -- 172.21.15.152:0/1365867623 wait complete. 2023-12-06T14:57:22.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.245+0000 7ff5dd7df700 1 Processor -- start 2023-12-06T14:57:22.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.245+0000 7ff5dd7df700 1 -- start start 2023-12-06T14:57:22.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.245+0000 7ff5dd7df700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5d8065390 0x7ff5d8113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:22.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.245+0000 7ff5dd7df700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5d8102c20 0x7ff5d8113c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:22.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.245+0000 7ff5dd7df700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d81142c0 con 0x7ff5d8065390 2023-12-06T14:57:22.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.245+0000 7ff5dd7df700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d810d5f0 con 0x7ff5d8102c20 2023-12-06T14:57:22.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.245+0000 7ff5d6ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5d8065390 0x7ff5d8113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:22.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.245+0000 7ff5d6ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5d8065390 0x7ff5d8113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60158/0 (socket says 172.21.15.152:60158) 2023-12-06T14:57:22.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.245+0000 7ff5d6ffd700 1 -- 172.21.15.152:0/1758890563 learned_addr learned my addr 172.21.15.152:0/1758890563 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:57:22.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.245+0000 7ff5d67fc700 1 --2- 172.21.15.152:0/1758890563 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5d8102c20 0x7ff5d8113c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:22.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.245+0000 7ff5d6ffd700 1 -- 172.21.15.152:0/1758890563 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5d8102c20 msgr2=0x7ff5d8113c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:22.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.245+0000 7ff5d6ffd700 1 --2- 172.21.15.152:0/1758890563 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5d8102c20 0x7ff5d8113c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:22.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.245+0000 7ff5d6ffd700 1 -- 172.21.15.152:0/1758890563 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c0005040 con 0x7ff5d8065390 2023-12-06T14:57:22.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.246+0000 7ff5d6ffd700 1 --2- 172.21.15.152:0/1758890563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5d8065390 0x7ff5d8113730 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8001d80 tx=0x7ff5c8009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:22.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.246+0000 7ff5cf7fe700 1 -- 172.21.15.152:0/1758890563 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5c8007d10 con 0x7ff5d8065390 2023-12-06T14:57:22.249 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.246+0000 7ff5dd7df700 1 -- 172.21.15.152:0/1758890563 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d810d8d0 con 0x7ff5d8065390 2023-12-06T14:57:22.250 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.246+0000 7ff5cf7fe700 1 -- 172.21.15.152:0/1758890563 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff5c8001e80 con 0x7ff5d8065390 2023-12-06T14:57:22.250 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.246+0000 7ff5cf7fe700 1 -- 172.21.15.152:0/1758890563 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5c8014400 con 0x7ff5d8065390 2023-12-06T14:57:22.250 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.246+0000 7ff5dd7df700 1 -- 172.21.15.152:0/1758890563 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d810dde0 con 0x7ff5d8065390 2023-12-06T14:57:22.250 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.247+0000 7ff5dd7df700 1 -- 172.21.15.152:0/1758890563 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d80fff40 con 0x7ff5d8065390 2023-12-06T14:57:22.250 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.247+0000 7ff5cf7fe700 1 -- 172.21.15.152:0/1758890563 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7ff5c800e960 con 0x7ff5d8065390 2023-12-06T14:57:22.250 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.248+0000 7ff5cf7fe700 1 --2- 172.21.15.152:0/1758890563 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7ff5c4068f60 0x7ff5c406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:22.250 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.248+0000 7ff5cf7fe700 1 -- 172.21.15.152:0/1758890563 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff5c80867e0 con 0x7ff5d8065390 2023-12-06T14:57:22.250 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.248+0000 7ff5d67fc700 1 --2- 172.21.15.152:0/1758890563 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7ff5c4068f60 0x7ff5c406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:22.250 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.248+0000 7ff5d67fc700 1 --2- 172.21.15.152:0/1758890563 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7ff5c4068f60 0x7ff5c406b410 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff5d810e920 tx=0x7ff5c0009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:22.253 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.252+0000 7ff5cf7fe700 1 -- 172.21.15.152:0/1758890563 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff5c804da00 con 0x7ff5d8065390 2023-12-06T14:57:22.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:22 smithi152 ceph-mon[111954]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:22.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.486+0000 7ff5dd7df700 1 -- 172.21.15.152:0/1758890563 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff5d804bbb0 con 0x7ff5d8065390 2023-12-06T14:57:22.490 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.489+0000 7ff5cf7fe700 1 -- 172.21.15.152:0/1758890563 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+166785 (secure 0 0 0) 0x7ff5c804bba0 con 0x7ff5d8065390 2023-12-06T14:57:22.493 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:57:22.495 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.492+0000 7ff5dd7df700 1 -- 172.21.15.152:0/1758890563 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7ff5c4068f60 msgr2=0x7ff5c406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:22.495 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.492+0000 7ff5dd7df700 1 --2- 172.21.15.152:0/1758890563 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7ff5c4068f60 0x7ff5c406b410 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff5d810e920 tx=0x7ff5c0009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:22.495 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.492+0000 7ff5dd7df700 1 -- 172.21.15.152:0/1758890563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5d8065390 msgr2=0x7ff5d8113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:22.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.492+0000 7ff5dd7df700 1 --2- 172.21.15.152:0/1758890563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5d8065390 0x7ff5d8113730 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8001d80 tx=0x7ff5c8009ec0 comp rx=0 tx=0).stop 2023-12-06T14:57:22.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.492+0000 7ff5dd7df700 1 -- 172.21.15.152:0/1758890563 shutdown_connections 2023-12-06T14:57:22.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.492+0000 7ff5dd7df700 1 --2- 172.21.15.152:0/1758890563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff5d8065390 0x7ff5d8113730 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:22.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.492+0000 7ff5dd7df700 1 --2- 172.21.15.152:0/1758890563 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7ff5c4068f60 0x7ff5c406b410 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:22.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.492+0000 7ff5dd7df700 1 --2- 172.21.15.152:0/1758890563 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5d8102c20 0x7ff5d8113c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:22.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.492+0000 7ff5dd7df700 1 -- 172.21.15.152:0/1758890563 >> 172.21.15.152:0/1758890563 conn(0x7ff5d80719b0 msgr2=0x7ff5d80fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:22.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.492+0000 7ff5dd7df700 1 -- 172.21.15.152:0/1758890563 shutdown_connections 2023-12-06T14:57:22.497 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:22.492+0000 7ff5dd7df700 1 -- 172.21.15.152:0/1758890563 wait complete. 2023-12-06T14:57:22.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:22 smithi190 ceph-mon[121340]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:22.863 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":19,"active_gid":14210,"active_name":"smithi152.meodco","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":3317409709},{"type":"v1","addr":"172.21.15.152:6801","nonce":3317409709}]},"active_addr":"172.21.15.152:6801/3317409709","active_change":"2023-12-06T14:54:40.971105+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14230,"name":"smithi190.ubusrr","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.152:8443/","prometheus":"http://172.21.15.152:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.152:0","nonce":1389268383}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.152:0","nonce":3550921367}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.152:0","nonce":2756816012}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.152:0","nonce":561475554}]}]} 2023-12-06T14:57:22.867 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-12-06T14:57:22.867 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-12-06T14:57:22.867 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph osd dump --format=json 2023-12-06T14:57:23.128 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:57:23.430 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:23 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/1758890563' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-06T14:57:23.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:23 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/1758890563' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-06T14:57:24.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.116+0000 7fb3e0bf7700 1 -- 172.21.15.152:0/2085135596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3dc101b00 msgr2=0x7fb3dc101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:24.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.116+0000 7fb3e0bf7700 1 --2- 172.21.15.152:0/2085135596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3dc101b00 0x7fb3dc101ed0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc004940 tx=0x7fb3cc009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:24.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.116+0000 7fb3e0bf7700 1 -- 172.21.15.152:0/2085135596 shutdown_connections 2023-12-06T14:57:24.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.116+0000 7fb3e0bf7700 1 --2- 172.21.15.152:0/2085135596 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3dc0fbb40 0x7fb3dc0fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:24.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.116+0000 7fb3e0bf7700 1 --2- 172.21.15.152:0/2085135596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3dc101b00 0x7fb3dc101ed0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:24.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.116+0000 7fb3e0bf7700 1 -- 172.21.15.152:0/2085135596 >> 172.21.15.152:0/2085135596 conn(0x7fb3dc0719b0 msgr2=0x7fb3dc071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:24.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.116+0000 7fb3e0bf7700 1 -- 172.21.15.152:0/2085135596 shutdown_connections 2023-12-06T14:57:24.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.116+0000 7fb3e0bf7700 1 -- 172.21.15.152:0/2085135596 wait complete. 2023-12-06T14:57:24.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.117+0000 7fb3e0bf7700 1 Processor -- start 2023-12-06T14:57:24.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.117+0000 7fb3e0bf7700 1 -- start start 2023-12-06T14:57:24.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.117+0000 7fb3e0bf7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3dc0fbb40 0x7fb3dc10e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:24.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.117+0000 7fb3e0bf7700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3dc101b00 0x7fb3dc10ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:24.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.117+0000 7fb3e0bf7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc10f260 con 0x7fb3dc0fbb40 2023-12-06T14:57:24.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.117+0000 7fb3e0bf7700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc10f3a0 con 0x7fb3dc101b00 2023-12-06T14:57:24.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.117+0000 7fb3da59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3dc0fbb40 0x7fb3dc10e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:24.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.117+0000 7fb3da59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3dc0fbb40 0x7fb3dc10e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60168/0 (socket says 172.21.15.152:60168) 2023-12-06T14:57:24.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.117+0000 7fb3da59c700 1 -- 172.21.15.152:0/600993527 learned_addr learned my addr 172.21.15.152:0/600993527 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:57:24.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.117+0000 7fb3d9d9b700 1 --2- 172.21.15.152:0/600993527 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3dc101b00 0x7fb3dc10ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:24.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.117+0000 7fb3da59c700 1 -- 172.21.15.152:0/600993527 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3dc101b00 msgr2=0x7fb3dc10ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:24.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.117+0000 7fb3da59c700 1 --2- 172.21.15.152:0/600993527 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3dc101b00 0x7fb3dc10ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:24.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.117+0000 7fb3da59c700 1 -- 172.21.15.152:0/600993527 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3cc005040 con 0x7fb3dc0fbb40 2023-12-06T14:57:24.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.118+0000 7fb3da59c700 1 --2- 172.21.15.152:0/600993527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3dc0fbb40 0x7fb3dc10e700 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc000c00 tx=0x7fb3cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:24.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.118+0000 7fb3d2ffd700 1 -- 172.21.15.152:0/600993527 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3cc00e040 con 0x7fb3dc0fbb40 2023-12-06T14:57:24.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.118+0000 7fb3d2ffd700 1 -- 172.21.15.152:0/600993527 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb3cc004290 con 0x7fb3dc0fbb40 2023-12-06T14:57:24.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.118+0000 7fb3d2ffd700 1 -- 172.21.15.152:0/600993527 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3cc01c3f0 con 0x7fb3dc0fbb40 2023-12-06T14:57:24.121 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.118+0000 7fb3e0bf7700 1 -- 172.21.15.152:0/600993527 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3dc117670 con 0x7fb3dc0fbb40 2023-12-06T14:57:24.121 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.118+0000 7fb3e0bf7700 1 -- 172.21.15.152:0/600993527 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3dc117bb0 con 0x7fb3dc0fbb40 2023-12-06T14:57:24.121 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.119+0000 7fb3e0bf7700 1 -- 172.21.15.152:0/600993527 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3dc103fb0 con 0x7fb3dc0fbb40 2023-12-06T14:57:24.121 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.119+0000 7fb3d2ffd700 1 -- 172.21.15.152:0/600993527 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fb3cc013790 con 0x7fb3dc0fbb40 2023-12-06T14:57:24.121 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.119+0000 7fb3d2ffd700 1 --2- 172.21.15.152:0/600993527 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fb3c8068f60 0x7fb3c806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:24.122 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.120+0000 7fb3d2ffd700 1 -- 172.21.15.152:0/600993527 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb3cc087d00 con 0x7fb3dc0fbb40 2023-12-06T14:57:24.122 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.120+0000 7fb3d9d9b700 1 --2- 172.21.15.152:0/600993527 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fb3c8068f60 0x7fb3c806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:24.122 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.120+0000 7fb3d9d9b700 1 --2- 172.21.15.152:0/600993527 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fb3c8068f60 0x7fb3c806b410 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc065e30 tx=0x7fb3c40091a0 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:24.125 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.124+0000 7fb3d2ffd700 1 -- 172.21.15.152:0/600993527 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb3cc08b030 con 0x7fb3dc0fbb40 2023-12-06T14:57:24.312 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.311+0000 7fb3e0bf7700 1 -- 172.21.15.152:0/600993527 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3dc065b70 con 0x7fb3dc0fbb40 2023-12-06T14:57:24.313 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.312+0000 7fb3d2ffd700 1 -- 172.21.15.152:0/600993527 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11132 (secure 0 0 0) 0x7fb3cc054510 con 0x7fb3dc0fbb40 2023-12-06T14:57:24.313 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:57:24.313 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":38,"fsid":"062f0e3c-9447-11ee-95a2-87774f69a715","created":"2023-12-06T14:53:01.413534+0000","modified":"2023-12-06T14:57:11.134448+0000","last_up_change":"2023-12-06T14:57:10.129077+0000","last_in_change":"2023-12-06T14:56:53.456498+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-06T14:56:15.276535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"72a62158-6e7d-42af-8212-f6ae2b8df6e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3829936777},{"type":"v1","addr":"172.21.15.152:6803","nonce":3829936777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3829936777},{"type":"v1","addr":"172.21.15.152:6805","nonce":3829936777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3829936777},{"type":"v1","addr":"172.21.15.152:6809","nonce":3829936777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3829936777},{"type":"v1","addr":"172.21.15.152:6807","nonce":3829936777}]},"public_addr":"172.21.15.152:6803/3829936777","cluster_addr":"172.21.15.152:6805/3829936777","heartbeat_back_addr":"172.21.15.152:6809/3829936777","heartbeat_front_addr":"172.21.15.152:6807/3829936777","state":["exists","up"]},{"osd":1,"uuid":"50dee56b-c95b-4361-ad0d-4f71198f9105","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1158477634},{"type":"v1","addr":"172.21.15.152:6811","nonce":1158477634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1158477634},{"type":"v1","addr":"172.21.15.152:6813","nonce":1158477634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1158477634},{"type":"v1","addr":"172.21.15.152:6817","nonce":1158477634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1158477634},{"type":"v1","addr":"172.21.15.152:6815","nonce":1158477634}]},"public_addr":"172.21.15.152:6811/1158477634","cluster_addr":"172.21.15.152:6813/1158477634","heartbeat_back_addr":"172.21.15.152:6817/1158477634","heartbeat_front_addr":"172.21.15.152:6815/1158477634","state":["exists","up"]},{"osd":2,"uuid":"8dce6383-8296-4737-99d9-427bbd62f9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3416520485},{"type":"v1","addr":"172.21.15.152:6819","nonce":3416520485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3416520485},{"type":"v1","addr":"172.21.15.152:6821","nonce":3416520485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3416520485},{"type":"v1","addr":"172.21.15.152:6825","nonce":3416520485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3416520485},{"type":"v1","addr":"172.21.15.152:6823","nonce":3416520485}]},"public_addr":"172.21.15.152:6819/3416520485","cluster_addr":"172.21.15.152:6821/3416520485","heartbeat_back_addr":"172.21.15.152:6825/3416520485","heartbeat_front_addr":"172.21.15.152:6823/3416520485","state":["exists","up"]},{"osd":3,"uuid":"ea52387d-fb71-4ed5-bde5-85550b5cc117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":977527629},{"type":"v1","addr":"172.21.15.190:6801","nonce":977527629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":977527629},{"type":"v1","addr":"172.21.15.190:6803","nonce":977527629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":977527629},{"type":"v1","addr":"172.21.15.190:6807","nonce":977527629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":977527629},{"type":"v1","addr":"172.21.15.190:6805","nonce":977527629}]},"public_addr":"172.21.15.190:6801/977527629","cluster_addr":"172.21.15.190:6803/977527629","heartbeat_back_addr":"172.21.15.190:6807/977527629","heartbeat_front_addr":"172.21.15.190:6805/977527629","state":["exists","up"]},{"osd":4,"uuid":"23efef41-308e-467c-9f90-ae159a8d43a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2742121756},{"type":"v1","addr":"172.21.15.190:6809","nonce":2742121756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2742121756},{"type":"v1","addr":"172.21.15.190:6811","nonce":2742121756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2742121756},{"type":"v1","addr":"172.21.15.190:6815","nonce":2742121756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2742121756},{"type":"v1","addr":"172.21.15.190:6813","nonce":2742121756}]},"public_addr":"172.21.15.190:6809/2742121756","cluster_addr":"172.21.15.190:6811/2742121756","heartbeat_back_addr":"172.21.15.190:6815/2742121756","heartbeat_front_addr":"172.21.15.190:6813/2742121756","state":["exists","up"]},{"osd":5,"uuid":"fe0aeff2-a9e0-4cb5-9cd9-fd0e3db4807f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":3073656058},{"type":"v1","addr":"172.21.15.190:6817","nonce":3073656058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":3073656058},{"type":"v1","addr":"172.21.15.190:6819","nonce":3073656058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":3073656058},{"type":"v1","addr":"172.21.15.190:6823","nonce":3073656058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":3073656058},{"type":"v1","addr":"172.21.15.190:6821","nonce":3073656058}]},"public_addr":"172.21.15.190:6817/3073656058","cluster_addr":"172.21.15.190:6819/3073656058","heartbeat_back_addr":"172.21.15.190:6823/3073656058","heartbeat_front_addr":"172.21.15.190:6821/3073656058","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T14:55:32.948973+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T14:55:53.358269+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T14:56:12.783635+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T14:56:30.517271+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T14:56:49.401042+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T14:57:08.146152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.152:0/2095526930":"2023-12-07T14:54:40.970995+0000","172.21.15.152:0/2571521952":"2023-12-07T14:53:50.748958+0000","172.21.15.152:0/145030765":"2023-12-07T14:53:50.748958+0000","172.21.15.152:0/2581585771":"2023-12-07T14:53:50.748958+0000","172.21.15.152:6801/3517650686":"2023-12-07T14:54:40.970995+0000","172.21.15.152:6800/3517650686":"2023-12-07T14:54:40.970995+0000","172.21.15.152:6801/2466555973":"2023-12-07T14:53:50.748958+0000","172.21.15.152:0/959508847":"2023-12-07T14:54:40.970995+0000","172.21.15.152:0/181182783":"2023-12-07T14:53:24.414825+0000","172.21.15.152:0/251625153":"2023-12-07T14:54:40.970995+0000","172.21.15.152:0/4186839809":"2023-12-07T14:53:24.414825+0000","172.21.15.152:0/3538958834":"2023-12-07T14:53:24.414825+0000","172.21.15.152:6800/1793082857":"2023-12-07T14:53:24.414825+0000","172.21.15.152:6801/1793082857":"2023-12-07T14:53:24.414825+0000","172.21.15.152:6800/2466555973":"2023-12-07T14:53:50.748958+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-06T14:57:24.315 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.314+0000 7fb3e0bf7700 1 -- 172.21.15.152:0/600993527 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fb3c8068f60 msgr2=0x7fb3c806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:24.315 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.314+0000 7fb3e0bf7700 1 --2- 172.21.15.152:0/600993527 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fb3c8068f60 0x7fb3c806b410 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc065e30 tx=0x7fb3c40091a0 comp rx=0 tx=0).stop 2023-12-06T14:57:24.315 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.314+0000 7fb3e0bf7700 1 -- 172.21.15.152:0/600993527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3dc0fbb40 msgr2=0x7fb3dc10e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:24.315 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.314+0000 7fb3e0bf7700 1 --2- 172.21.15.152:0/600993527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3dc0fbb40 0x7fb3dc10e700 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc000c00 tx=0x7fb3cc009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:24.315 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.314+0000 7fb3e0bf7700 1 -- 172.21.15.152:0/600993527 shutdown_connections 2023-12-06T14:57:24.315 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.314+0000 7fb3e0bf7700 1 --2- 172.21.15.152:0/600993527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3dc0fbb40 0x7fb3dc10e700 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:24.315 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.314+0000 7fb3e0bf7700 1 --2- 172.21.15.152:0/600993527 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fb3c8068f60 0x7fb3c806b410 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:24.315 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.314+0000 7fb3e0bf7700 1 --2- 172.21.15.152:0/600993527 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3dc101b00 0x7fb3dc10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:24.315 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.314+0000 7fb3e0bf7700 1 -- 172.21.15.152:0/600993527 >> 172.21.15.152:0/600993527 conn(0x7fb3dc0719b0 msgr2=0x7fb3dc0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:24.315 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.314+0000 7fb3e0bf7700 1 -- 172.21.15.152:0/600993527 shutdown_connections 2023-12-06T14:57:24.315 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:24.314+0000 7fb3e0bf7700 1 -- 172.21.15.152:0/600993527 wait complete. 2023-12-06T14:57:24.484 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:24 smithi152 ceph-mon[111954]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:24.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:24 smithi190 ceph-mon[121340]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:24.705 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-12-06T14:57:24.705 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph osd dump --format=json 2023-12-06T14:57:24.965 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:57:25.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:25 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/600993527' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-06T14:57:25.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:25 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/600993527' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-06T14:57:25.969 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:25.966+0000 7fb06f8c6700 1 -- 172.21.15.152:0/2587500282 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb068065390 msgr2=0x7fb068065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:25.969 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:25.966+0000 7fb06f8c6700 1 --2- 172.21.15.152:0/2587500282 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb068065390 0x7fb068065800 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb064004940 tx=0x7fb064009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:25.969 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:25.966+0000 7fb06f8c6700 1 -- 172.21.15.152:0/2587500282 shutdown_connections 2023-12-06T14:57:25.969 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:25.966+0000 7fb06f8c6700 1 --2- 172.21.15.152:0/2587500282 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb068065390 0x7fb068065800 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:25.969 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:25.966+0000 7fb06f8c6700 1 --2- 172.21.15.152:0/2587500282 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb068102c20 0x7fb068102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:25.969 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:25.966+0000 7fb06f8c6700 1 -- 172.21.15.152:0/2587500282 >> 172.21.15.152:0/2587500282 conn(0x7fb0680719b0 msgr2=0x7fb068071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:25.969 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:25.966+0000 7fb06f8c6700 1 -- 172.21.15.152:0/2587500282 shutdown_connections 2023-12-06T14:57:25.969 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:25.966+0000 7fb06f8c6700 1 -- 172.21.15.152:0/2587500282 wait complete. 2023-12-06T14:57:25.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:25.967+0000 7fb06f8c6700 1 Processor -- start 2023-12-06T14:57:25.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:25.967+0000 7fb06f8c6700 1 -- start start 2023-12-06T14:57:25.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:25.967+0000 7fb06f8c6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb068065390 0x7fb0681136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:25.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:25.967+0000 7fb06f8c6700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb068102c20 0x7fb068113c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:25.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:25.967+0000 7fb06f8c6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06810d570 con 0x7fb068065390 2023-12-06T14:57:25.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:25.967+0000 7fb06f8c6700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06810d6e0 con 0x7fb068102c20 2023-12-06T14:57:25.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:25.967+0000 7fb06d662700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb068065390 0x7fb0681136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:25.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:25.967+0000 7fb06d662700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb068065390 0x7fb0681136b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60188/0 (socket says 172.21.15.152:60188) 2023-12-06T14:57:25.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:25.967+0000 7fb06d662700 1 -- 172.21.15.152:0/957878854 learned_addr learned my addr 172.21.15.152:0/957878854 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:57:25.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:25.967+0000 7fb06ce61700 1 --2- 172.21.15.152:0/957878854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb068102c20 0x7fb068113c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:25.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:25.967+0000 7fb06d662700 1 -- 172.21.15.152:0/957878854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb068102c20 msgr2=0x7fb068113c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:25.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:25.967+0000 7fb06d662700 1 --2- 172.21.15.152:0/957878854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb068102c20 0x7fb068113c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:25.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:25.967+0000 7fb06d662700 1 -- 172.21.15.152:0/957878854 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb064005040 con 0x7fb068065390 2023-12-06T14:57:25.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:25.967+0000 7fb06d662700 1 --2- 172.21.15.152:0/957878854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb068065390 0x7fb0681136b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb05800b790 tx=0x7fb058009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:25.971 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:25.967+0000 7fb05dffb700 1 -- 172.21.15.152:0/957878854 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb05800f770 con 0x7fb068065390 2023-12-06T14:57:25.971 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:25.967+0000 7fb05dffb700 1 -- 172.21.15.152:0/957878854 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb05800fd80 con 0x7fb068065390 2023-12-06T14:57:25.971 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:25.967+0000 7fb06f8c6700 1 -- 172.21.15.152:0/957878854 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb06810d9c0 con 0x7fb068065390 2023-12-06T14:57:25.971 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:25.967+0000 7fb05dffb700 1 -- 172.21.15.152:0/957878854 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb05800d310 con 0x7fb068065390 2023-12-06T14:57:25.971 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:25.968+0000 7fb06f8c6700 1 -- 172.21.15.152:0/957878854 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb06810df00 con 0x7fb068065390 2023-12-06T14:57:25.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:25.969+0000 7fb06f8c6700 1 -- 172.21.15.152:0/957878854 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0680fff40 con 0x7fb068065390 2023-12-06T14:57:25.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:25.969+0000 7fb05dffb700 1 -- 172.21.15.152:0/957878854 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fb058010420 con 0x7fb068065390 2023-12-06T14:57:25.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:25.969+0000 7fb05dffb700 1 --2- 172.21.15.152:0/957878854 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fb054068f60 0x7fb05406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:25.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:25.969+0000 7fb05dffb700 1 -- 172.21.15.152:0/957878854 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb058086930 con 0x7fb068065390 2023-12-06T14:57:25.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:25.969+0000 7fb06ce61700 1 --2- 172.21.15.152:0/957878854 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fb054068f60 0x7fb05406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:25.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:25.970+0000 7fb06ce61700 1 --2- 172.21.15.152:0/957878854 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fb054068f60 0x7fb05406b410 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb064004f90 tx=0x7fb064009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:25.974 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:25.973+0000 7fb05dffb700 1 -- 172.21.15.152:0/957878854 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb058056c70 con 0x7fb068065390 2023-12-06T14:57:26.160 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:26.159+0000 7fb06f8c6700 1 -- 172.21.15.152:0/957878854 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb06804bb80 con 0x7fb068065390 2023-12-06T14:57:26.161 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:26.160+0000 7fb05dffb700 1 -- 172.21.15.152:0/957878854 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11132 (secure 0 0 0) 0x7fb058056800 con 0x7fb068065390 2023-12-06T14:57:26.161 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:57:26.161 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":38,"fsid":"062f0e3c-9447-11ee-95a2-87774f69a715","created":"2023-12-06T14:53:01.413534+0000","modified":"2023-12-06T14:57:11.134448+0000","last_up_change":"2023-12-06T14:57:10.129077+0000","last_in_change":"2023-12-06T14:56:53.456498+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-06T14:56:15.276535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"72a62158-6e7d-42af-8212-f6ae2b8df6e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3829936777},{"type":"v1","addr":"172.21.15.152:6803","nonce":3829936777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3829936777},{"type":"v1","addr":"172.21.15.152:6805","nonce":3829936777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3829936777},{"type":"v1","addr":"172.21.15.152:6809","nonce":3829936777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3829936777},{"type":"v1","addr":"172.21.15.152:6807","nonce":3829936777}]},"public_addr":"172.21.15.152:6803/3829936777","cluster_addr":"172.21.15.152:6805/3829936777","heartbeat_back_addr":"172.21.15.152:6809/3829936777","heartbeat_front_addr":"172.21.15.152:6807/3829936777","state":["exists","up"]},{"osd":1,"uuid":"50dee56b-c95b-4361-ad0d-4f71198f9105","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1158477634},{"type":"v1","addr":"172.21.15.152:6811","nonce":1158477634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1158477634},{"type":"v1","addr":"172.21.15.152:6813","nonce":1158477634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1158477634},{"type":"v1","addr":"172.21.15.152:6817","nonce":1158477634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1158477634},{"type":"v1","addr":"172.21.15.152:6815","nonce":1158477634}]},"public_addr":"172.21.15.152:6811/1158477634","cluster_addr":"172.21.15.152:6813/1158477634","heartbeat_back_addr":"172.21.15.152:6817/1158477634","heartbeat_front_addr":"172.21.15.152:6815/1158477634","state":["exists","up"]},{"osd":2,"uuid":"8dce6383-8296-4737-99d9-427bbd62f9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3416520485},{"type":"v1","addr":"172.21.15.152:6819","nonce":3416520485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3416520485},{"type":"v1","addr":"172.21.15.152:6821","nonce":3416520485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3416520485},{"type":"v1","addr":"172.21.15.152:6825","nonce":3416520485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3416520485},{"type":"v1","addr":"172.21.15.152:6823","nonce":3416520485}]},"public_addr":"172.21.15.152:6819/3416520485","cluster_addr":"172.21.15.152:6821/3416520485","heartbeat_back_addr":"172.21.15.152:6825/3416520485","heartbeat_front_addr":"172.21.15.152:6823/3416520485","state":["exists","up"]},{"osd":3,"uuid":"ea52387d-fb71-4ed5-bde5-85550b5cc117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":977527629},{"type":"v1","addr":"172.21.15.190:6801","nonce":977527629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":977527629},{"type":"v1","addr":"172.21.15.190:6803","nonce":977527629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":977527629},{"type":"v1","addr":"172.21.15.190:6807","nonce":977527629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":977527629},{"type":"v1","addr":"172.21.15.190:6805","nonce":977527629}]},"public_addr":"172.21.15.190:6801/977527629","cluster_addr":"172.21.15.190:6803/977527629","heartbeat_back_addr":"172.21.15.190:6807/977527629","heartbeat_front_addr":"172.21.15.190:6805/977527629","state":["exists","up"]},{"osd":4,"uuid":"23efef41-308e-467c-9f90-ae159a8d43a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2742121756},{"type":"v1","addr":"172.21.15.190:6809","nonce":2742121756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2742121756},{"type":"v1","addr":"172.21.15.190:6811","nonce":2742121756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2742121756},{"type":"v1","addr":"172.21.15.190:6815","nonce":2742121756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2742121756},{"type":"v1","addr":"172.21.15.190:6813","nonce":2742121756}]},"public_addr":"172.21.15.190:6809/2742121756","cluster_addr":"172.21.15.190:6811/2742121756","heartbeat_back_addr":"172.21.15.190:6815/2742121756","heartbeat_front_addr":"172.21.15.190:6813/2742121756","state":["exists","up"]},{"osd":5,"uuid":"fe0aeff2-a9e0-4cb5-9cd9-fd0e3db4807f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":3073656058},{"type":"v1","addr":"172.21.15.190:6817","nonce":3073656058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":3073656058},{"type":"v1","addr":"172.21.15.190:6819","nonce":3073656058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":3073656058},{"type":"v1","addr":"172.21.15.190:6823","nonce":3073656058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":3073656058},{"type":"v1","addr":"172.21.15.190:6821","nonce":3073656058}]},"public_addr":"172.21.15.190:6817/3073656058","cluster_addr":"172.21.15.190:6819/3073656058","heartbeat_back_addr":"172.21.15.190:6823/3073656058","heartbeat_front_addr":"172.21.15.190:6821/3073656058","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T14:55:32.948973+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T14:55:53.358269+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T14:56:12.783635+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T14:56:30.517271+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T14:56:49.401042+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T14:57:08.146152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.152:0/2095526930":"2023-12-07T14:54:40.970995+0000","172.21.15.152:0/2571521952":"2023-12-07T14:53:50.748958+0000","172.21.15.152:0/145030765":"2023-12-07T14:53:50.748958+0000","172.21.15.152:0/2581585771":"2023-12-07T14:53:50.748958+0000","172.21.15.152:6801/3517650686":"2023-12-07T14:54:40.970995+0000","172.21.15.152:6800/3517650686":"2023-12-07T14:54:40.970995+0000","172.21.15.152:6801/2466555973":"2023-12-07T14:53:50.748958+0000","172.21.15.152:0/959508847":"2023-12-07T14:54:40.970995+0000","172.21.15.152:0/181182783":"2023-12-07T14:53:24.414825+0000","172.21.15.152:0/251625153":"2023-12-07T14:54:40.970995+0000","172.21.15.152:0/4186839809":"2023-12-07T14:53:24.414825+0000","172.21.15.152:0/3538958834":"2023-12-07T14:53:24.414825+0000","172.21.15.152:6800/1793082857":"2023-12-07T14:53:24.414825+0000","172.21.15.152:6801/1793082857":"2023-12-07T14:53:24.414825+0000","172.21.15.152:6800/2466555973":"2023-12-07T14:53:50.748958+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-06T14:57:26.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:26.163+0000 7fb06f8c6700 1 -- 172.21.15.152:0/957878854 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fb054068f60 msgr2=0x7fb05406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:26.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:26.163+0000 7fb06f8c6700 1 --2- 172.21.15.152:0/957878854 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fb054068f60 0x7fb05406b410 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb064004f90 tx=0x7fb064009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:26.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:26.163+0000 7fb06f8c6700 1 -- 172.21.15.152:0/957878854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb068065390 msgr2=0x7fb0681136b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:26.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:26.163+0000 7fb06f8c6700 1 --2- 172.21.15.152:0/957878854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb068065390 0x7fb0681136b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb05800b790 tx=0x7fb058009250 comp rx=0 tx=0).stop 2023-12-06T14:57:26.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:26.163+0000 7fb06f8c6700 1 -- 172.21.15.152:0/957878854 shutdown_connections 2023-12-06T14:57:26.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:26.163+0000 7fb06f8c6700 1 --2- 172.21.15.152:0/957878854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb068065390 0x7fb0681136b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:26.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:26.163+0000 7fb06f8c6700 1 --2- 172.21.15.152:0/957878854 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fb054068f60 0x7fb05406b410 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:26.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:26.163+0000 7fb06f8c6700 1 --2- 172.21.15.152:0/957878854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb068102c20 0x7fb068113c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:26.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:26.163+0000 7fb06f8c6700 1 -- 172.21.15.152:0/957878854 >> 172.21.15.152:0/957878854 conn(0x7fb0680719b0 msgr2=0x7fb0680fab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:26.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:26.163+0000 7fb06f8c6700 1 -- 172.21.15.152:0/957878854 shutdown_connections 2023-12-06T14:57:26.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:26.163+0000 7fb06f8c6700 1 -- 172.21.15.152:0/957878854 wait complete. 2023-12-06T14:57:26.495 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:26 smithi152 ceph-mon[111954]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:26.496 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:26 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:57:26.496 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:26 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/957878854' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-06T14:57:26.522 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2023-12-06T14:57:26.522 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2023-12-06T14:57:26.523 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2023-12-06T14:57:26.523 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2023-12-06T14:57:26.523 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2023-12-06T14:57:26.524 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2023-12-06T14:57:26.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:26 smithi190 ceph-mon[121340]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:26.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:26 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:57:26.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:26 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/957878854' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-06T14:57:26.862 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:57:27.185 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:57:27.186 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:57:27.886 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:57:28.439 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:28 smithi152 ceph-mon[111954]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:28.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:28 smithi190 ceph-mon[121340]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:28.623 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:57:29.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.133+0000 7fc9de122700 1 -- 172.21.15.152:0/864290084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9d8101b00 msgr2=0x7fc9d8101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:29.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.133+0000 7fc9de122700 1 --2- 172.21.15.152:0/864290084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9d8101b00 0x7fc9d8101ed0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8004940 tx=0x7fc9c8009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:29.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.133+0000 7fc9de122700 1 -- 172.21.15.152:0/864290084 shutdown_connections 2023-12-06T14:57:29.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.133+0000 7fc9de122700 1 --2- 172.21.15.152:0/864290084 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9d80fbb40 0x7fc9d80fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:29.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.133+0000 7fc9de122700 1 --2- 172.21.15.152:0/864290084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9d8101b00 0x7fc9d8101ed0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:29.134 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.133+0000 7fc9de122700 1 -- 172.21.15.152:0/864290084 >> 172.21.15.152:0/864290084 conn(0x7fc9d80f76c0 msgr2=0x7fc9d80f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:29.134 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.133+0000 7fc9de122700 1 -- 172.21.15.152:0/864290084 shutdown_connections 2023-12-06T14:57:29.134 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.133+0000 7fc9de122700 1 -- 172.21.15.152:0/864290084 wait complete. 2023-12-06T14:57:29.134 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.133+0000 7fc9de122700 1 Processor -- start 2023-12-06T14:57:29.135 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.134+0000 7fc9de122700 1 -- start start 2023-12-06T14:57:29.135 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.134+0000 7fc9de122700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9d80fbb40 0x7fc9d8112570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:29.135 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.134+0000 7fc9de122700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9d8101b00 0x7fc9d8112ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:29.135 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.134+0000 7fc9de122700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d8113190 con 0x7fc9d80fbb40 2023-12-06T14:57:29.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.134+0000 7fc9de122700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d810c430 con 0x7fc9d8101b00 2023-12-06T14:57:29.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.134+0000 7fc9d77fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9d80fbb40 0x7fc9d8112570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:29.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.134+0000 7fc9d77fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9d80fbb40 0x7fc9d8112570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60216/0 (socket says 172.21.15.152:60216) 2023-12-06T14:57:29.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.134+0000 7fc9d77fe700 1 -- 172.21.15.152:0/1888887293 learned_addr learned my addr 172.21.15.152:0/1888887293 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:57:29.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.134+0000 7fc9d6ffd700 1 --2- 172.21.15.152:0/1888887293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9d8101b00 0x7fc9d8112ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:29.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.134+0000 7fc9d77fe700 1 -- 172.21.15.152:0/1888887293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9d8101b00 msgr2=0x7fc9d8112ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:29.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.134+0000 7fc9d77fe700 1 --2- 172.21.15.152:0/1888887293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9d8101b00 0x7fc9d8112ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:29.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.134+0000 7fc9d77fe700 1 -- 172.21.15.152:0/1888887293 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c8005040 con 0x7fc9d80fbb40 2023-12-06T14:57:29.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.134+0000 7fc9d6ffd700 1 --2- 172.21.15.152:0/1888887293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9d8101b00 0x7fc9d8112ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-06T14:57:29.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.134+0000 7fc9d77fe700 1 --2- 172.21.15.152:0/1888887293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9d80fbb40 0x7fc9d8112570 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc9c800b3b0 tx=0x7fc9c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:29.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.134+0000 7fc9bffff700 1 -- 172.21.15.152:0/1888887293 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9c800e040 con 0x7fc9d80fbb40 2023-12-06T14:57:29.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.134+0000 7fc9de122700 1 -- 172.21.15.152:0/1888887293 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d810c6b0 con 0x7fc9d80fbb40 2023-12-06T14:57:29.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.134+0000 7fc9bffff700 1 -- 172.21.15.152:0/1888887293 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc9c8009af0 con 0x7fc9d80fbb40 2023-12-06T14:57:29.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.134+0000 7fc9bffff700 1 -- 172.21.15.152:0/1888887293 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9c8013770 con 0x7fc9d80fbb40 2023-12-06T14:57:29.137 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.135+0000 7fc9de122700 1 -- 172.21.15.152:0/1888887293 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d810cb90 con 0x7fc9d80fbb40 2023-12-06T14:57:29.137 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.135+0000 7fc9de122700 1 -- 172.21.15.152:0/1888887293 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc9d810d0b0 con 0x7fc9d80fbb40 2023-12-06T14:57:29.137 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.136+0000 7fc9bffff700 1 -- 172.21.15.152:0/1888887293 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fc9c801e420 con 0x7fc9d80fbb40 2023-12-06T14:57:29.138 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.136+0000 7fc9bffff700 1 --2- 172.21.15.152:0/1888887293 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fc9c0068f60 0x7fc9c006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:29.138 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.136+0000 7fc9bffff700 1 -- 172.21.15.152:0/1888887293 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc9c808b490 con 0x7fc9d80fbb40 2023-12-06T14:57:29.138 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.136+0000 7fc9d6ffd700 1 --2- 172.21.15.152:0/1888887293 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fc9c0068f60 0x7fc9c006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:29.138 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.136+0000 7fc9bffff700 1 --2- 172.21.15.152:0/1888887293 >> [v2:172.21.15.190:6800/977527629,v1:172.21.15.190:6801/977527629] conn(0x7fc9c006ec30 0x7fc9c0071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:29.138 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.136+0000 7fc9bffff700 1 -- 172.21.15.152:0/1888887293 --> [v2:172.21.15.190:6800/977527629,v1:172.21.15.190:6801/977527629] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc9c00716f0 con 0x7fc9c006ec30 2023-12-06T14:57:29.138 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.137+0000 7fc9bffff700 1 -- 172.21.15.152:0/1888887293 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9c808b870 con 0x7fc9d80fbb40 2023-12-06T14:57:29.138 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.137+0000 7fc9d6ffd700 1 --2- 172.21.15.152:0/1888887293 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fc9c0068f60 0x7fc9c006b410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc006fd0 tx=0x7fc9cc008040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:29.138 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.137+0000 7fc9d7fff700 1 --2- 172.21.15.152:0/1888887293 >> [v2:172.21.15.190:6800/977527629,v1:172.21.15.190:6801/977527629] conn(0x7fc9c006ec30 0x7fc9c0071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:29.138 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.137+0000 7fc9d7fff700 1 --2- 172.21.15.152:0/1888887293 >> [v2:172.21.15.190:6800/977527629,v1:172.21.15.190:6801/977527629] conn(0x7fc9c006ec30 0x7fc9c0071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:29.138 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.138+0000 7fc9bffff700 1 -- 172.21.15.152:0/1888887293 <== osd.3 v2:172.21.15.190:6800/977527629 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fc9c00716f0 con 0x7fc9c006ec30 2023-12-06T14:57:29.153 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.153+0000 7fc9de122700 1 -- 172.21.15.152:0/1888887293 --> [v2:172.21.15.190:6800/977527629,v1:172.21.15.190:6801/977527629] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc9d80f9b30 con 0x7fc9c006ec30 2023-12-06T14:57:29.153 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.153+0000 7fc9bffff700 1 -- 172.21.15.152:0/1888887293 <== osd.3 v2:172.21.15.190:6800/977527629 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fc9d80f9b30 con 0x7fc9c006ec30 2023-12-06T14:57:29.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.154+0000 7fc9de122700 1 -- 172.21.15.152:0/1888887293 >> [v2:172.21.15.190:6800/977527629,v1:172.21.15.190:6801/977527629] conn(0x7fc9c006ec30 msgr2=0x7fc9c0071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:29.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.154+0000 7fc9de122700 1 --2- 172.21.15.152:0/1888887293 >> [v2:172.21.15.190:6800/977527629,v1:172.21.15.190:6801/977527629] conn(0x7fc9c006ec30 0x7fc9c0071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:29.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.154+0000 7fc9de122700 1 -- 172.21.15.152:0/1888887293 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fc9c0068f60 msgr2=0x7fc9c006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:29.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.154+0000 7fc9de122700 1 --2- 172.21.15.152:0/1888887293 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fc9c0068f60 0x7fc9c006b410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc006fd0 tx=0x7fc9cc008040 comp rx=0 tx=0).stop 2023-12-06T14:57:29.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.154+0000 7fc9de122700 1 -- 172.21.15.152:0/1888887293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9d80fbb40 msgr2=0x7fc9d8112570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:29.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.154+0000 7fc9de122700 1 --2- 172.21.15.152:0/1888887293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9d80fbb40 0x7fc9d8112570 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc9c800b3b0 tx=0x7fc9c8009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:29.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.154+0000 7fc9de122700 1 -- 172.21.15.152:0/1888887293 shutdown_connections 2023-12-06T14:57:29.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.154+0000 7fc9de122700 1 --2- 172.21.15.152:0/1888887293 >> [v2:172.21.15.190:6800/977527629,v1:172.21.15.190:6801/977527629] conn(0x7fc9c006ec30 0x7fc9c0071040 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:29.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.154+0000 7fc9de122700 1 --2- 172.21.15.152:0/1888887293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9d80fbb40 0x7fc9d8112570 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:29.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.154+0000 7fc9de122700 1 --2- 172.21.15.152:0/1888887293 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fc9c0068f60 0x7fc9c006b410 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:29.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.154+0000 7fc9de122700 1 --2- 172.21.15.152:0/1888887293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9d8101b00 0x7fc9d8112ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:29.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.154+0000 7fc9de122700 1 -- 172.21.15.152:0/1888887293 >> 172.21.15.152:0/1888887293 conn(0x7fc9d80f76c0 msgr2=0x7fc9d80f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:29.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.154+0000 7fc9de122700 1 -- 172.21.15.152:0/1888887293 shutdown_connections 2023-12-06T14:57:29.155 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.154+0000 7fc9de122700 1 -- 172.21.15.152:0/1888887293 wait complete. 2023-12-06T14:57:29.616 INFO:teuthology.orchestra.run.smithi152.stdout:107374182415 2023-12-06T14:57:29.616 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.3 2023-12-06T14:57:29.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.843+0000 7fce841a4700 1 -- 172.21.15.152:0/2499948340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce7c101b00 msgr2=0x7fce7c101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:29.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.843+0000 7fce841a4700 1 --2- 172.21.15.152:0/2499948340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce7c101b00 0x7fce7c101ed0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fce74009ce0 tx=0x7fce74004d10 comp rx=0 tx=0).stop 2023-12-06T14:57:29.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.843+0000 7fce841a4700 1 -- 172.21.15.152:0/2499948340 shutdown_connections 2023-12-06T14:57:29.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.843+0000 7fce841a4700 1 --2- 172.21.15.152:0/2499948340 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce7c0fbb40 0x7fce7c0fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:29.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.843+0000 7fce841a4700 1 --2- 172.21.15.152:0/2499948340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce7c101b00 0x7fce7c101ed0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:29.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.843+0000 7fce841a4700 1 -- 172.21.15.152:0/2499948340 >> 172.21.15.152:0/2499948340 conn(0x7fce7c0719b0 msgr2=0x7fce7c071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:29.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.843+0000 7fce841a4700 1 -- 172.21.15.152:0/2499948340 shutdown_connections 2023-12-06T14:57:29.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.843+0000 7fce841a4700 1 -- 172.21.15.152:0/2499948340 wait complete. 2023-12-06T14:57:29.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.844+0000 7fce841a4700 1 Processor -- start 2023-12-06T14:57:29.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.844+0000 7fce841a4700 1 -- start start 2023-12-06T14:57:29.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.845+0000 7fce841a4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce7c0fbb40 0x7fce7c06cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:29.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.845+0000 7fce841a4700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce7c101b00 0x7fce7c06d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:29.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.845+0000 7fce841a4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c06d5b0 con 0x7fce7c0fbb40 2023-12-06T14:57:29.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.845+0000 7fce841a4700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7c06d6f0 con 0x7fce7c101b00 2023-12-06T14:57:29.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.845+0000 7fce8173f700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce7c101b00 0x7fce7c06d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:29.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.845+0000 7fce8173f700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce7c101b00 0x7fce7c06d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.152:41838/0 (socket says 172.21.15.152:41838) 2023-12-06T14:57:29.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.845+0000 7fce8173f700 1 -- 172.21.15.152:0/960496355 learned_addr learned my addr 172.21.15.152:0/960496355 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:57:29.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.845+0000 7fce81f40700 1 --2- 172.21.15.152:0/960496355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce7c0fbb40 0x7fce7c06cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:29.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.845+0000 7fce8173f700 1 -- 172.21.15.152:0/960496355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce7c0fbb40 msgr2=0x7fce7c06cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:29.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.845+0000 7fce8173f700 1 --2- 172.21.15.152:0/960496355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce7c0fbb40 0x7fce7c06cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:29.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.845+0000 7fce8173f700 1 -- 172.21.15.152:0/960496355 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce74009940 con 0x7fce7c101b00 2023-12-06T14:57:29.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.846+0000 7fce8173f700 1 --2- 172.21.15.152:0/960496355 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce7c101b00 0x7fce7c06d070 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fce6c002a50 tx=0x7fce6c0046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:29.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.846+0000 7fce727fc700 1 -- 172.21.15.152:0/960496355 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce6c007cc0 con 0x7fce7c101b00 2023-12-06T14:57:29.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.846+0000 7fce727fc700 1 -- 172.21.15.152:0/960496355 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fce6c00f040 con 0x7fce7c101b00 2023-12-06T14:57:29.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.846+0000 7fce841a4700 1 -- 172.21.15.152:0/960496355 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce7c1202d0 con 0x7fce7c101b00 2023-12-06T14:57:29.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.846+0000 7fce727fc700 1 -- 172.21.15.152:0/960496355 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce6c009540 con 0x7fce7c101b00 2023-12-06T14:57:29.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.846+0000 7fce841a4700 1 -- 172.21.15.152:0/960496355 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce7c120620 con 0x7fce7c101b00 2023-12-06T14:57:29.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.847+0000 7fce841a4700 1 -- 172.21.15.152:0/960496355 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fce7c05e380 con 0x7fce7c101b00 2023-12-06T14:57:29.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.848+0000 7fce727fc700 1 -- 172.21.15.152:0/960496355 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fce6c0096a0 con 0x7fce7c101b00 2023-12-06T14:57:29.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.849+0000 7fce727fc700 1 --2- 172.21.15.152:0/960496355 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fce68068f70 0x7fce6806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:29.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.849+0000 7fce727fc700 1 -- 172.21.15.152:0/960496355 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fce6c086930 con 0x7fce7c101b00 2023-12-06T14:57:29.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.849+0000 7fce727fc700 1 --2- 172.21.15.152:0/960496355 >> [v2:172.21.15.152:6810/1158477634,v1:172.21.15.152:6811/1158477634] conn(0x7fce6806ec40 0x7fce68071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:29.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.849+0000 7fce727fc700 1 -- 172.21.15.152:0/960496355 --> [v2:172.21.15.152:6810/1158477634,v1:172.21.15.152:6811/1158477634] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fce68071700 con 0x7fce6806ec40 2023-12-06T14:57:29.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.849+0000 7fce727fc700 1 -- 172.21.15.152:0/960496355 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce6c086c70 con 0x7fce7c101b00 2023-12-06T14:57:29.854 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.854+0000 7fce82741700 1 --2- 172.21.15.152:0/960496355 >> [v2:172.21.15.152:6810/1158477634,v1:172.21.15.152:6811/1158477634] conn(0x7fce6806ec40 0x7fce68071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:29.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.854+0000 7fce82741700 1 --2- 172.21.15.152:0/960496355 >> [v2:172.21.15.152:6810/1158477634,v1:172.21.15.152:6811/1158477634] conn(0x7fce6806ec40 0x7fce68071050 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:29.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.854+0000 7fce81f40700 1 --2- 172.21.15.152:0/960496355 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fce68068f70 0x7fce6806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:29.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.855+0000 7fce81f40700 1 --2- 172.21.15.152:0/960496355 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fce68068f70 0x7fce6806b420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fce7400b740 tx=0x7fce74004d10 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:29.855 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.856+0000 7fce727fc700 1 -- 172.21.15.152:0/960496355 <== osd.1 v2:172.21.15.152:6810/1158477634 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fce68071700 con 0x7fce6806ec40 2023-12-06T14:57:29.877 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.876+0000 7fce841a4700 1 -- 172.21.15.152:0/960496355 --> [v2:172.21.15.152:6810/1158477634,v1:172.21.15.152:6811/1158477634] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fce7c0734d0 con 0x7fce6806ec40 2023-12-06T14:57:29.877 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.877+0000 7fce727fc700 1 -- 172.21.15.152:0/960496355 <== osd.1 v2:172.21.15.152:6810/1158477634 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fce7c0734d0 con 0x7fce6806ec40 2023-12-06T14:57:29.877 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.877+0000 7fce841a4700 1 -- 172.21.15.152:0/960496355 >> [v2:172.21.15.152:6810/1158477634,v1:172.21.15.152:6811/1158477634] conn(0x7fce6806ec40 msgr2=0x7fce68071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:29.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.877+0000 7fce841a4700 1 --2- 172.21.15.152:0/960496355 >> [v2:172.21.15.152:6810/1158477634,v1:172.21.15.152:6811/1158477634] conn(0x7fce6806ec40 0x7fce68071050 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:29.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.877+0000 7fce841a4700 1 -- 172.21.15.152:0/960496355 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fce68068f70 msgr2=0x7fce6806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:29.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.877+0000 7fce841a4700 1 --2- 172.21.15.152:0/960496355 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fce68068f70 0x7fce6806b420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fce7400b740 tx=0x7fce74004d10 comp rx=0 tx=0).stop 2023-12-06T14:57:29.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.877+0000 7fce841a4700 1 -- 172.21.15.152:0/960496355 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce7c101b00 msgr2=0x7fce7c06d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:29.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.877+0000 7fce841a4700 1 --2- 172.21.15.152:0/960496355 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce7c101b00 0x7fce7c06d070 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fce6c002a50 tx=0x7fce6c0046b0 comp rx=0 tx=0).stop 2023-12-06T14:57:29.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.877+0000 7fce841a4700 1 -- 172.21.15.152:0/960496355 shutdown_connections 2023-12-06T14:57:29.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.877+0000 7fce841a4700 1 --2- 172.21.15.152:0/960496355 >> [v2:172.21.15.152:6810/1158477634,v1:172.21.15.152:6811/1158477634] conn(0x7fce6806ec40 0x7fce68071050 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:29.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.877+0000 7fce841a4700 1 --2- 172.21.15.152:0/960496355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fce7c0fbb40 0x7fce7c06cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:29.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.877+0000 7fce841a4700 1 --2- 172.21.15.152:0/960496355 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fce68068f70 0x7fce6806b420 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:29.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.877+0000 7fce841a4700 1 --2- 172.21.15.152:0/960496355 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce7c101b00 0x7fce7c06d070 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:29.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.877+0000 7fce841a4700 1 -- 172.21.15.152:0/960496355 >> 172.21.15.152:0/960496355 conn(0x7fce7c0719b0 msgr2=0x7fce7c0faca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:29.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.878+0000 7fce841a4700 1 -- 172.21.15.152:0/960496355 shutdown_connections 2023-12-06T14:57:29.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:29.878+0000 7fce841a4700 1 -- 172.21.15.152:0/960496355 wait complete. 2023-12-06T14:57:30.013 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.013+0000 7f7c1d219700 1 -- 172.21.15.152:0/24591724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c18103590 msgr2=0x7f7c180fcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:30.014 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.013+0000 7f7c1d219700 1 --2- 172.21.15.152:0/24591724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c18103590 0x7f7c180fcc00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c004940 tx=0x7f7c0c009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:30.014 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.013+0000 7f7c1d219700 1 -- 172.21.15.152:0/24591724 shutdown_connections 2023-12-06T14:57:30.014 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.013+0000 7f7c1d219700 1 --2- 172.21.15.152:0/24591724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c18103590 0x7f7c180fcc00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:30.014 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.013+0000 7f7c1d219700 1 --2- 172.21.15.152:0/24591724 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c18102bf0 0x7f7c18102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:30.014 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.013+0000 7f7c1d219700 1 -- 172.21.15.152:0/24591724 >> 172.21.15.152:0/24591724 conn(0x7f7c180f87a0 msgr2=0x7f7c180fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:30.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.013+0000 7f7c1d219700 1 -- 172.21.15.152:0/24591724 shutdown_connections 2023-12-06T14:57:30.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.013+0000 7f7c1d219700 1 -- 172.21.15.152:0/24591724 wait complete. 2023-12-06T14:57:30.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.014+0000 7f7c1d219700 1 Processor -- start 2023-12-06T14:57:30.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.014+0000 7f7c1d219700 1 -- start start 2023-12-06T14:57:30.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.014+0000 7f7c1d219700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c18102bf0 0x7f7c18113620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:30.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.014+0000 7f7c1d219700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c18103590 0x7f7c18113ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:30.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.014+0000 7f7c1d219700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c181141f0 con 0x7f7c18103590 2023-12-06T14:57:30.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.014+0000 7f7c1d219700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1810d4e0 con 0x7f7c18102bf0 2023-12-06T14:57:30.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.014+0000 7f7c1659c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c18103590 0x7f7c18113ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:30.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.014+0000 7f7c1659c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c18103590 0x7f7c18113ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36210/0 (socket says 172.21.15.152:36210) 2023-12-06T14:57:30.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.014+0000 7f7c1659c700 1 -- 172.21.15.152:0/53989219 learned_addr learned my addr 172.21.15.152:0/53989219 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:57:30.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.015+0000 7f7c16d9d700 1 --2- 172.21.15.152:0/53989219 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c18102bf0 0x7f7c18113620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:30.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.015+0000 7f7c1659c700 1 -- 172.21.15.152:0/53989219 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c18102bf0 msgr2=0x7f7c18113620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:30.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.015+0000 7f7c1659c700 1 --2- 172.21.15.152:0/53989219 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c18102bf0 0x7f7c18113620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:30.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.015+0000 7f7c1659c700 1 -- 172.21.15.152:0/53989219 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0c005040 con 0x7f7c18103590 2023-12-06T14:57:30.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.015+0000 7f7c16d9d700 1 --2- 172.21.15.152:0/53989219 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c18102bf0 0x7f7c18113620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-06T14:57:30.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.015+0000 7f7c1659c700 1 --2- 172.21.15.152:0/53989219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c18103590 0x7f7c18113ba0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c009fd0 tx=0x7f7c0c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:30.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.015+0000 7f7bff7fe700 1 -- 172.21.15.152:0/53989219 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c0c00e040 con 0x7f7c18103590 2023-12-06T14:57:30.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.015+0000 7f7bff7fe700 1 -- 172.21.15.152:0/53989219 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7c0c00bc50 con 0x7f7c18103590 2023-12-06T14:57:30.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.015+0000 7f7c1d219700 1 -- 172.21.15.152:0/53989219 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c1810d710 con 0x7f7c18103590 2023-12-06T14:57:30.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.015+0000 7f7bff7fe700 1 -- 172.21.15.152:0/53989219 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c0c01c3f0 con 0x7f7c18103590 2023-12-06T14:57:30.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.015+0000 7f7c1d219700 1 -- 172.21.15.152:0/53989219 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c1810dc50 con 0x7f7c18103590 2023-12-06T14:57:30.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.016+0000 7f7c1d219700 1 -- 172.21.15.152:0/53989219 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7c1810e140 con 0x7f7c18103590 2023-12-06T14:57:30.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.017+0000 7f7bff7fe700 1 -- 172.21.15.152:0/53989219 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f7c0c013420 con 0x7f7c18103590 2023-12-06T14:57:30.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.017+0000 7f7bff7fe700 1 --2- 172.21.15.152:0/53989219 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f7c00068f60 0x7f7c0006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:30.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.017+0000 7f7bff7fe700 1 -- 172.21.15.152:0/53989219 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7c0c087e40 con 0x7f7c18103590 2023-12-06T14:57:30.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.017+0000 7f7c16d9d700 1 --2- 172.21.15.152:0/53989219 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f7c00068f60 0x7f7c0006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:30.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.017+0000 7f7bff7fe700 1 --2- 172.21.15.152:0/53989219 >> [v2:172.21.15.190:6808/2742121756,v1:172.21.15.190:6809/2742121756] conn(0x7f7c0006ec30 0x7f7c00071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:30.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.017+0000 7f7bff7fe700 1 -- 172.21.15.152:0/53989219 --> [v2:172.21.15.190:6808/2742121756,v1:172.21.15.190:6809/2742121756] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7c000716f0 con 0x7f7c0006ec30 2023-12-06T14:57:30.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.017+0000 7f7bff7fe700 1 -- 172.21.15.152:0/53989219 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c0c08d410 con 0x7f7c18103590 2023-12-06T14:57:30.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.017+0000 7f7c16d9d700 1 --2- 172.21.15.152:0/53989219 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f7c00068f60 0x7f7c0006b410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7c080041d0 tx=0x7f7c08009040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:30.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.018+0000 7f7c1759e700 1 --2- 172.21.15.152:0/53989219 >> [v2:172.21.15.190:6808/2742121756,v1:172.21.15.190:6809/2742121756] conn(0x7f7c0006ec30 0x7f7c00071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:30.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.018+0000 7f7c1759e700 1 --2- 172.21.15.152:0/53989219 >> [v2:172.21.15.190:6808/2742121756,v1:172.21.15.190:6809/2742121756] conn(0x7f7c0006ec30 0x7f7c00071040 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:30.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.019+0000 7f7bff7fe700 1 -- 172.21.15.152:0/53989219 <== osd.4 v2:172.21.15.190:6808/2742121756 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f7c000716f0 con 0x7f7c0006ec30 2023-12-06T14:57:30.029 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:57:30.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.034+0000 7f7c1d219700 1 -- 172.21.15.152:0/53989219 --> [v2:172.21.15.190:6808/2742121756,v1:172.21.15.190:6809/2742121756] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7c180fc3a0 con 0x7f7c0006ec30 2023-12-06T14:57:30.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.034+0000 7f7bff7fe700 1 -- 172.21.15.152:0/53989219 <== osd.4 v2:172.21.15.190:6808/2742121756 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f7c180fc3a0 con 0x7f7c0006ec30 2023-12-06T14:57:30.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.035+0000 7f7c1d219700 1 -- 172.21.15.152:0/53989219 >> [v2:172.21.15.190:6808/2742121756,v1:172.21.15.190:6809/2742121756] conn(0x7f7c0006ec30 msgr2=0x7f7c00071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:30.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.035+0000 7f7c1d219700 1 --2- 172.21.15.152:0/53989219 >> [v2:172.21.15.190:6808/2742121756,v1:172.21.15.190:6809/2742121756] conn(0x7f7c0006ec30 0x7f7c00071040 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:30.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.035+0000 7f7c1d219700 1 -- 172.21.15.152:0/53989219 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f7c00068f60 msgr2=0x7f7c0006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:30.035 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.035+0000 7f7c1d219700 1 --2- 172.21.15.152:0/53989219 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f7c00068f60 0x7f7c0006b410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7c080041d0 tx=0x7f7c08009040 comp rx=0 tx=0).stop 2023-12-06T14:57:30.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.035+0000 7f7c1d219700 1 -- 172.21.15.152:0/53989219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c18103590 msgr2=0x7f7c18113ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:30.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.035+0000 7f7c1d219700 1 --2- 172.21.15.152:0/53989219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c18103590 0x7f7c18113ba0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c009fd0 tx=0x7f7c0c009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:30.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.035+0000 7f7c1d219700 1 -- 172.21.15.152:0/53989219 shutdown_connections 2023-12-06T14:57:30.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.035+0000 7f7c1d219700 1 --2- 172.21.15.152:0/53989219 >> [v2:172.21.15.190:6808/2742121756,v1:172.21.15.190:6809/2742121756] conn(0x7f7c0006ec30 0x7f7c00071040 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:30.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.035+0000 7f7c1d219700 1 --2- 172.21.15.152:0/53989219 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f7c00068f60 0x7f7c0006b410 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:30.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.035+0000 7f7c1d219700 1 --2- 172.21.15.152:0/53989219 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c18102bf0 0x7f7c18113620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:30.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.035+0000 7f7c1d219700 1 --2- 172.21.15.152:0/53989219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c18103590 0x7f7c18113ba0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:30.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.035+0000 7f7c1d219700 1 -- 172.21.15.152:0/53989219 >> 172.21.15.152:0/53989219 conn(0x7f7c180f87a0 msgr2=0x7f7c180fa300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:30.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.035+0000 7f7c1d219700 1 -- 172.21.15.152:0/53989219 shutdown_connections 2023-12-06T14:57:30.036 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:30.035+0000 7f7c1d219700 1 -- 172.21.15.152:0/53989219 wait complete. 2023-12-06T14:57:30.430 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:30 smithi152 ceph-mon[111954]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:30.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:30 smithi190 ceph-mon[121340]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:30.811 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:57:31.273 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.180+0000 7f13f98e1700 1 -- 172.21.15.152:0/3707056648 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13f4103590 msgr2=0x7f13f40fcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:31.273 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.180+0000 7f13f98e1700 1 --2- 172.21.15.152:0/3707056648 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13f4103590 0x7f13f40fcc00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f13dc004940 tx=0x7f13dc009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:31.274 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.180+0000 7f13f98e1700 1 -- 172.21.15.152:0/3707056648 shutdown_connections 2023-12-06T14:57:31.274 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.180+0000 7f13f98e1700 1 --2- 172.21.15.152:0/3707056648 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13f4103590 0x7f13f40fcc00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:31.274 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.180+0000 7f13f98e1700 1 --2- 172.21.15.152:0/3707056648 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13f4102bf0 0x7f13f4102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:31.274 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.180+0000 7f13f98e1700 1 -- 172.21.15.152:0/3707056648 >> 172.21.15.152:0/3707056648 conn(0x7f13f40f87a0 msgr2=0x7f13f40fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:31.274 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.180+0000 7f13f98e1700 1 -- 172.21.15.152:0/3707056648 shutdown_connections 2023-12-06T14:57:31.274 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.180+0000 7f13f98e1700 1 -- 172.21.15.152:0/3707056648 wait complete. 2023-12-06T14:57:31.274 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.180+0000 7f13f98e1700 1 Processor -- start 2023-12-06T14:57:31.274 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.180+0000 7f13f98e1700 1 -- start start 2023-12-06T14:57:31.274 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.181+0000 7f13f98e1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13f4102bf0 0x7f13f4113660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:31.274 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.181+0000 7f13f98e1700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13f4103590 0x7f13f4113be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:31.274 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.181+0000 7f13f98e1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f410d520 con 0x7f13f4102bf0 2023-12-06T14:57:31.274 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.181+0000 7f13f98e1700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f410d690 con 0x7f13f4103590 2023-12-06T14:57:31.274 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.181+0000 7f13f2ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13f4102bf0 0x7f13f4113660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:31.275 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.181+0000 7f13f2ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13f4102bf0 0x7f13f4113660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36238/0 (socket says 172.21.15.152:36238) 2023-12-06T14:57:31.275 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.181+0000 7f13f2ffd700 1 -- 172.21.15.152:0/4047703008 learned_addr learned my addr 172.21.15.152:0/4047703008 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:57:31.275 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.181+0000 7f13f2ffd700 1 -- 172.21.15.152:0/4047703008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13f4103590 msgr2=0x7f13f4113be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:31.275 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.181+0000 7f13f27fc700 1 --2- 172.21.15.152:0/4047703008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13f4103590 0x7f13f4113be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:31.275 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.181+0000 7f13f2ffd700 1 --2- 172.21.15.152:0/4047703008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13f4103590 0x7f13f4113be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:31.275 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.181+0000 7f13f2ffd700 1 -- 172.21.15.152:0/4047703008 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13dc005040 con 0x7f13f4102bf0 2023-12-06T14:57:31.276 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.181+0000 7f13f27fc700 1 --2- 172.21.15.152:0/4047703008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13f4103590 0x7f13f4113be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-06T14:57:31.276 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.181+0000 7f13f2ffd700 1 --2- 172.21.15.152:0/4047703008 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13f4102bf0 0x7f13f4113660 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f13e400b790 tx=0x7f13e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:31.276 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.181+0000 7f13eb7fe700 1 -- 172.21.15.152:0/4047703008 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13e400f770 con 0x7f13f4102bf0 2023-12-06T14:57:31.276 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.181+0000 7f13eb7fe700 1 -- 172.21.15.152:0/4047703008 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f13e400fd80 con 0x7f13f4102bf0 2023-12-06T14:57:31.276 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.181+0000 7f13f98e1700 1 -- 172.21.15.152:0/4047703008 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13f410d970 con 0x7f13f4102bf0 2023-12-06T14:57:31.276 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.181+0000 7f13eb7fe700 1 -- 172.21.15.152:0/4047703008 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13e400d310 con 0x7f13f4102bf0 2023-12-06T14:57:31.276 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.181+0000 7f13f98e1700 1 -- 172.21.15.152:0/4047703008 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13f410deb0 con 0x7f13f4102bf0 2023-12-06T14:57:31.276 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.182+0000 7f13f98e1700 1 -- 172.21.15.152:0/4047703008 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f13f410e3b0 con 0x7f13f4102bf0 2023-12-06T14:57:31.276 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.183+0000 7f13eb7fe700 1 -- 172.21.15.152:0/4047703008 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f13e4010420 con 0x7f13f4102bf0 2023-12-06T14:57:31.276 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.183+0000 7f13eb7fe700 1 --2- 172.21.15.152:0/4047703008 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f13e0068f60 0x7f13e006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:31.277 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.183+0000 7f13eb7fe700 1 -- 172.21.15.152:0/4047703008 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f13e4087510 con 0x7f13f4102bf0 2023-12-06T14:57:31.277 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.183+0000 7f13f27fc700 1 --2- 172.21.15.152:0/4047703008 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f13e0068f60 0x7f13e006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:31.277 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.184+0000 7f13eb7fe700 1 --2- 172.21.15.152:0/4047703008 >> [v2:172.21.15.152:6802/3829936777,v1:172.21.15.152:6803/3829936777] conn(0x7f13e006ec30 0x7f13e0071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:31.277 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.184+0000 7f13eb7fe700 1 -- 172.21.15.152:0/4047703008 --> [v2:172.21.15.152:6802/3829936777,v1:172.21.15.152:6803/3829936777] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f13e00716f0 con 0x7f13e006ec30 2023-12-06T14:57:31.277 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.184+0000 7f13eb7fe700 1 -- 172.21.15.152:0/4047703008 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13e40878f0 con 0x7f13f4102bf0 2023-12-06T14:57:31.277 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.184+0000 7f13f37fe700 1 --2- 172.21.15.152:0/4047703008 >> [v2:172.21.15.152:6802/3829936777,v1:172.21.15.152:6803/3829936777] conn(0x7f13e006ec30 0x7f13e0071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:31.277 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.184+0000 7f13f27fc700 1 --2- 172.21.15.152:0/4047703008 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f13e0068f60 0x7f13e006b410 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f13dc000c00 tx=0x7f13dc009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:31.277 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.184+0000 7f13f37fe700 1 --2- 172.21.15.152:0/4047703008 >> [v2:172.21.15.152:6802/3829936777,v1:172.21.15.152:6803/3829936777] conn(0x7f13e006ec30 0x7f13e0071040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:31.277 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.185+0000 7f13eb7fe700 1 -- 172.21.15.152:0/4047703008 <== osd.0 v2:172.21.15.152:6802/3829936777 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f13e00716f0 con 0x7f13e006ec30 2023-12-06T14:57:31.277 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.199+0000 7f13f98e1700 1 -- 172.21.15.152:0/4047703008 --> [v2:172.21.15.152:6802/3829936777,v1:172.21.15.152:6803/3829936777] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f13f405e340 con 0x7f13e006ec30 2023-12-06T14:57:31.277 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.200+0000 7f13eb7fe700 1 -- 172.21.15.152:0/4047703008 <== osd.0 v2:172.21.15.152:6802/3829936777 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f13f405e340 con 0x7f13e006ec30 2023-12-06T14:57:31.277 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.200+0000 7f13f98e1700 1 -- 172.21.15.152:0/4047703008 >> [v2:172.21.15.152:6802/3829936777,v1:172.21.15.152:6803/3829936777] conn(0x7f13e006ec30 msgr2=0x7f13e0071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:31.277 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.200+0000 7f13f98e1700 1 --2- 172.21.15.152:0/4047703008 >> [v2:172.21.15.152:6802/3829936777,v1:172.21.15.152:6803/3829936777] conn(0x7f13e006ec30 0x7f13e0071040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:31.278 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.200+0000 7f13f98e1700 1 -- 172.21.15.152:0/4047703008 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f13e0068f60 msgr2=0x7f13e006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:31.278 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.200+0000 7f13f98e1700 1 --2- 172.21.15.152:0/4047703008 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f13e0068f60 0x7f13e006b410 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f13dc000c00 tx=0x7f13dc009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:31.278 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.200+0000 7f13f98e1700 1 -- 172.21.15.152:0/4047703008 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13f4102bf0 msgr2=0x7f13f4113660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:31.278 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.200+0000 7f13f98e1700 1 --2- 172.21.15.152:0/4047703008 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13f4102bf0 0x7f13f4113660 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f13e400b790 tx=0x7f13e4009250 comp rx=0 tx=0).stop 2023-12-06T14:57:31.278 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.200+0000 7f13f98e1700 1 -- 172.21.15.152:0/4047703008 shutdown_connections 2023-12-06T14:57:31.278 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.200+0000 7f13f98e1700 1 --2- 172.21.15.152:0/4047703008 >> [v2:172.21.15.152:6802/3829936777,v1:172.21.15.152:6803/3829936777] conn(0x7f13e006ec30 0x7f13e0071040 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:31.278 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.200+0000 7f13f98e1700 1 --2- 172.21.15.152:0/4047703008 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13f4102bf0 0x7f13f4113660 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:31.278 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.200+0000 7f13f98e1700 1 --2- 172.21.15.152:0/4047703008 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f13e0068f60 0x7f13e006b410 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:31.278 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.200+0000 7f13f98e1700 1 --2- 172.21.15.152:0/4047703008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13f4103590 0x7f13f4113be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:31.278 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.200+0000 7f13f98e1700 1 -- 172.21.15.152:0/4047703008 >> 172.21.15.152:0/4047703008 conn(0x7f13f40f87a0 msgr2=0x7f13f40fa290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:31.278 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.200+0000 7f13f98e1700 1 -- 172.21.15.152:0/4047703008 shutdown_connections 2023-12-06T14:57:31.278 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:31.200+0000 7f13f98e1700 1 -- 172.21.15.152:0/4047703008 wait complete. 2023-12-06T14:57:31.529 INFO:teuthology.orchestra.run.smithi152.stdout:137438953482 2023-12-06T14:57:31.530 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.4 2023-12-06T14:57:31.830 INFO:teuthology.orchestra.run.smithi152.stdout:38654705691 2023-12-06T14:57:31.830 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.0 2023-12-06T14:57:31.980 INFO:teuthology.orchestra.run.smithi152.stdout:60129542165 2023-12-06T14:57:31.980 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.1 2023-12-06T14:57:32.185 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.185+0000 7ffadfa83700 1 -- 172.21.15.152:0/1521331312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffad8065390 msgr2=0x7ffad8065800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:32.186 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.185+0000 7ffadfa83700 1 --2- 172.21.15.152:0/1521331312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffad8065390 0x7ffad8065800 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ffac8004940 tx=0x7ffac8009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:32.186 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.185+0000 7ffadfa83700 1 -- 172.21.15.152:0/1521331312 shutdown_connections 2023-12-06T14:57:32.186 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.185+0000 7ffadfa83700 1 --2- 172.21.15.152:0/1521331312 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffad8065390 0x7ffad8065800 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:32.186 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.185+0000 7ffadfa83700 1 --2- 172.21.15.152:0/1521331312 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffad8102c20 0x7ffad8102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:32.186 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.185+0000 7ffadfa83700 1 -- 172.21.15.152:0/1521331312 >> 172.21.15.152:0/1521331312 conn(0x7ffad80719b0 msgr2=0x7ffad8071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:32.186 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.185+0000 7ffadfa83700 1 -- 172.21.15.152:0/1521331312 shutdown_connections 2023-12-06T14:57:32.186 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.185+0000 7ffadfa83700 1 -- 172.21.15.152:0/1521331312 wait complete. 2023-12-06T14:57:32.188 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.186+0000 7ffadfa83700 1 Processor -- start 2023-12-06T14:57:32.188 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.186+0000 7ffadfa83700 1 -- start start 2023-12-06T14:57:32.188 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.186+0000 7ffadfa83700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffad8065390 0x7ffad8113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:32.188 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.186+0000 7ffadfa83700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffad8102c20 0x7ffad8113c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:32.188 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.186+0000 7ffadfa83700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad81142c0 con 0x7ffad8065390 2023-12-06T14:57:32.188 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.186+0000 7ffadfa83700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad810d5f0 con 0x7ffad8102c20 2023-12-06T14:57:32.188 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.186+0000 7ffadd81f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffad8065390 0x7ffad8113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:32.188 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.186+0000 7ffadd81f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffad8065390 0x7ffad8113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36262/0 (socket says 172.21.15.152:36262) 2023-12-06T14:57:32.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.187+0000 7ffadd81f700 1 -- 172.21.15.152:0/2913913693 learned_addr learned my addr 172.21.15.152:0/2913913693 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:57:32.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.187+0000 7ffadd01e700 1 --2- 172.21.15.152:0/2913913693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffad8102c20 0x7ffad8113c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:32.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.187+0000 7ffadd81f700 1 -- 172.21.15.152:0/2913913693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffad8102c20 msgr2=0x7ffad8113c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:32.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.187+0000 7ffadd81f700 1 --2- 172.21.15.152:0/2913913693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffad8102c20 0x7ffad8113c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:32.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.187+0000 7ffadd81f700 1 -- 172.21.15.152:0/2913913693 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac8005040 con 0x7ffad8065390 2023-12-06T14:57:32.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.187+0000 7ffadd01e700 1 --2- 172.21.15.152:0/2913913693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffad8102c20 0x7ffad8113c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-06T14:57:32.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.187+0000 7ffadd81f700 1 --2- 172.21.15.152:0/2913913693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffad8065390 0x7ffad8113730 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ffad4002a50 tx=0x7ffad40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:32.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.187+0000 7fface7fc700 1 -- 172.21.15.152:0/2913913693 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffad4007cc0 con 0x7ffad8065390 2023-12-06T14:57:32.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.187+0000 7fface7fc700 1 -- 172.21.15.152:0/2913913693 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffad400f040 con 0x7ffad8065390 2023-12-06T14:57:32.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.187+0000 7ffadfa83700 1 -- 172.21.15.152:0/2913913693 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffad810d8d0 con 0x7ffad8065390 2023-12-06T14:57:32.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.187+0000 7fface7fc700 1 -- 172.21.15.152:0/2913913693 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffad4009540 con 0x7ffad8065390 2023-12-06T14:57:32.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.187+0000 7ffadfa83700 1 -- 172.21.15.152:0/2913913693 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad810de10 con 0x7ffad8065390 2023-12-06T14:57:32.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.188+0000 7ffadfa83700 1 -- 172.21.15.152:0/2913913693 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffad810e2b0 con 0x7ffad8065390 2023-12-06T14:57:32.190 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.189+0000 7fface7fc700 1 -- 172.21.15.152:0/2913913693 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7ffad40096a0 con 0x7ffad8065390 2023-12-06T14:57:32.191 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.189+0000 7fface7fc700 1 --2- 172.21.15.152:0/2913913693 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7ffac4068f60 0x7ffac406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:32.191 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.190+0000 7fface7fc700 1 -- 172.21.15.152:0/2913913693 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ffad4087270 con 0x7ffad8065390 2023-12-06T14:57:32.191 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.190+0000 7ffadd01e700 1 --2- 172.21.15.152:0/2913913693 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7ffac4068f60 0x7ffac406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:32.191 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.190+0000 7fface7fc700 1 --2- 172.21.15.152:0/2913913693 >> [v2:172.21.15.190:6816/3073656058,v1:172.21.15.190:6817/3073656058] conn(0x7ffac406ec30 0x7ffac4071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:32.191 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.190+0000 7fface7fc700 1 -- 172.21.15.152:0/2913913693 --> [v2:172.21.15.190:6816/3073656058,v1:172.21.15.190:6817/3073656058] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffac40716f0 con 0x7ffac406ec30 2023-12-06T14:57:32.191 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.190+0000 7fface7fc700 1 -- 172.21.15.152:0/2913913693 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffad4087650 con 0x7ffad8065390 2023-12-06T14:57:32.191 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.190+0000 7ffadd01e700 1 --2- 172.21.15.152:0/2913913693 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7ffac4068f60 0x7ffac406b410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffac800b3b0 tx=0x7ffac8009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:32.191 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.190+0000 7ffade020700 1 --2- 172.21.15.152:0/2913913693 >> [v2:172.21.15.190:6816/3073656058,v1:172.21.15.190:6817/3073656058] conn(0x7ffac406ec30 0x7ffac4071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:32.191 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.190+0000 7ffade020700 1 --2- 172.21.15.152:0/2913913693 >> [v2:172.21.15.190:6816/3073656058,v1:172.21.15.190:6817/3073656058] conn(0x7ffac406ec30 0x7ffac4071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:32.191 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.191+0000 7fface7fc700 1 -- 172.21.15.152:0/2913913693 <== osd.5 v2:172.21.15.190:6816/3073656058 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7ffac40716f0 con 0x7ffac406ec30 2023-12-06T14:57:32.208 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.208+0000 7ffadfa83700 1 -- 172.21.15.152:0/2913913693 --> [v2:172.21.15.190:6816/3073656058,v1:172.21.15.190:6817/3073656058] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ffad805e340 con 0x7ffac406ec30 2023-12-06T14:57:32.208 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.208+0000 7fface7fc700 1 -- 172.21.15.152:0/2913913693 <== osd.5 v2:172.21.15.190:6816/3073656058 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7ffad805e340 con 0x7ffac406ec30 2023-12-06T14:57:32.209 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.208+0000 7ffadfa83700 1 -- 172.21.15.152:0/2913913693 >> [v2:172.21.15.190:6816/3073656058,v1:172.21.15.190:6817/3073656058] conn(0x7ffac406ec30 msgr2=0x7ffac4071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:32.209 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.208+0000 7ffadfa83700 1 --2- 172.21.15.152:0/2913913693 >> [v2:172.21.15.190:6816/3073656058,v1:172.21.15.190:6817/3073656058] conn(0x7ffac406ec30 0x7ffac4071040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:32.209 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.209+0000 7ffadfa83700 1 -- 172.21.15.152:0/2913913693 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7ffac4068f60 msgr2=0x7ffac406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:32.210 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.209+0000 7ffadfa83700 1 --2- 172.21.15.152:0/2913913693 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7ffac4068f60 0x7ffac406b410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffac800b3b0 tx=0x7ffac8009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:32.210 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.209+0000 7ffadfa83700 1 -- 172.21.15.152:0/2913913693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffad8065390 msgr2=0x7ffad8113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:32.210 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.209+0000 7ffadfa83700 1 --2- 172.21.15.152:0/2913913693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffad8065390 0x7ffad8113730 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ffad4002a50 tx=0x7ffad40046b0 comp rx=0 tx=0).stop 2023-12-06T14:57:32.210 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.209+0000 7ffadfa83700 1 -- 172.21.15.152:0/2913913693 shutdown_connections 2023-12-06T14:57:32.210 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.209+0000 7ffadfa83700 1 --2- 172.21.15.152:0/2913913693 >> [v2:172.21.15.190:6816/3073656058,v1:172.21.15.190:6817/3073656058] conn(0x7ffac406ec30 0x7ffac4071040 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:32.210 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.209+0000 7ffadfa83700 1 --2- 172.21.15.152:0/2913913693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffad8065390 0x7ffad8113730 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:32.210 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.209+0000 7ffadfa83700 1 --2- 172.21.15.152:0/2913913693 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7ffac4068f60 0x7ffac406b410 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:32.210 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.209+0000 7ffadfa83700 1 --2- 172.21.15.152:0/2913913693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffad8102c20 0x7ffad8113c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:32.210 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.209+0000 7ffadfa83700 1 -- 172.21.15.152:0/2913913693 >> 172.21.15.152:0/2913913693 conn(0x7ffad80719b0 msgr2=0x7ffad80fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:32.210 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.209+0000 7ffadfa83700 1 -- 172.21.15.152:0/2913913693 shutdown_connections 2023-12-06T14:57:32.210 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.209+0000 7ffadfa83700 1 -- 172.21.15.152:0/2913913693 wait complete. 2023-12-06T14:57:32.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.459+0000 7fd937ef2700 1 -- 172.21.15.152:0/3578272780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd930102c20 msgr2=0x7fd930102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:32.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.459+0000 7fd937ef2700 1 --2- 172.21.15.152:0/3578272780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd930102c20 0x7fd930102ff0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd928009ce0 tx=0x7fd928004d10 comp rx=0 tx=0).stop 2023-12-06T14:57:32.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.459+0000 7fd937ef2700 1 -- 172.21.15.152:0/3578272780 shutdown_connections 2023-12-06T14:57:32.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.459+0000 7fd937ef2700 1 --2- 172.21.15.152:0/3578272780 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd930065390 0x7fd930065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:32.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.459+0000 7fd937ef2700 1 --2- 172.21.15.152:0/3578272780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd930102c20 0x7fd930102ff0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:32.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.459+0000 7fd937ef2700 1 -- 172.21.15.152:0/3578272780 >> 172.21.15.152:0/3578272780 conn(0x7fd9300719b0 msgr2=0x7fd930071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:32.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.459+0000 7fd937ef2700 1 -- 172.21.15.152:0/3578272780 shutdown_connections 2023-12-06T14:57:32.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.459+0000 7fd937ef2700 1 -- 172.21.15.152:0/3578272780 wait complete. 2023-12-06T14:57:32.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.459+0000 7fd937ef2700 1 Processor -- start 2023-12-06T14:57:32.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.459+0000 7fd937ef2700 1 -- start start 2023-12-06T14:57:32.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.460+0000 7fd937ef2700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd930065390 0x7fd9300fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:32.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.460+0000 7fd937ef2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd930102c20 0x7fd9300fc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:32.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.460+0000 7fd937ef2700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9300fc6c0 con 0x7fd930102c20 2023-12-06T14:57:32.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.460+0000 7fd937ef2700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9300fc830 con 0x7fd930065390 2023-12-06T14:57:32.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.460+0000 7fd93548d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd930102c20 0x7fd9300fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:32.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.460+0000 7fd93548d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd930102c20 0x7fd9300fc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36274/0 (socket says 172.21.15.152:36274) 2023-12-06T14:57:32.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.460+0000 7fd93548d700 1 -- 172.21.15.152:0/1645731362 learned_addr learned my addr 172.21.15.152:0/1645731362 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:57:32.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.460+0000 7fd935c8e700 1 --2- 172.21.15.152:0/1645731362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd930065390 0x7fd9300fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:32.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.460+0000 7fd93548d700 1 -- 172.21.15.152:0/1645731362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd930065390 msgr2=0x7fd9300fbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:32.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.460+0000 7fd93548d700 1 --2- 172.21.15.152:0/1645731362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd930065390 0x7fd9300fbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:32.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.460+0000 7fd93548d700 1 -- 172.21.15.152:0/1645731362 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd928009940 con 0x7fd930102c20 2023-12-06T14:57:32.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.460+0000 7fd93548d700 1 --2- 172.21.15.152:0/1645731362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd930102c20 0x7fd9300fc130 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd92400c830 tx=0x7fd924004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:32.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.460+0000 7fd92e7fc700 1 -- 172.21.15.152:0/1645731362 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd92400a760 con 0x7fd930102c20 2023-12-06T14:57:32.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.460+0000 7fd92e7fc700 1 -- 172.21.15.152:0/1645731362 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd92400ad70 con 0x7fd930102c20 2023-12-06T14:57:32.463 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.460+0000 7fd937ef2700 1 -- 172.21.15.152:0/1645731362 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd930119a70 con 0x7fd930102c20 2023-12-06T14:57:32.463 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.460+0000 7fd92e7fc700 1 -- 172.21.15.152:0/1645731362 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9240113a0 con 0x7fd930102c20 2023-12-06T14:57:32.463 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.460+0000 7fd937ef2700 1 -- 172.21.15.152:0/1645731362 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd930119ed0 con 0x7fd930102c20 2023-12-06T14:57:32.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.461+0000 7fd937ef2700 1 -- 172.21.15.152:0/1645731362 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd93005e300 con 0x7fd930102c20 2023-12-06T14:57:32.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.462+0000 7fd92e7fc700 1 -- 172.21.15.152:0/1645731362 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fd924012400 con 0x7fd930102c20 2023-12-06T14:57:32.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.462+0000 7fd92e7fc700 1 --2- 172.21.15.152:0/1645731362 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fd918068f60 0x7fd91806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:32.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.462+0000 7fd92e7fc700 1 -- 172.21.15.152:0/1645731362 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd924087520 con 0x7fd930102c20 2023-12-06T14:57:32.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.462+0000 7fd935c8e700 1 --2- 172.21.15.152:0/1645731362 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fd918068f60 0x7fd91806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:32.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.462+0000 7fd92e7fc700 1 --2- 172.21.15.152:0/1645731362 >> [v2:172.21.15.152:6818/3416520485,v1:172.21.15.152:6819/3416520485] conn(0x7fd91806ec30 0x7fd918071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:32.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.462+0000 7fd92e7fc700 1 -- 172.21.15.152:0/1645731362 --> [v2:172.21.15.152:6818/3416520485,v1:172.21.15.152:6819/3416520485] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd9180716f0 con 0x7fd91806ec30 2023-12-06T14:57:32.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.462+0000 7fd92e7fc700 1 -- 172.21.15.152:0/1645731362 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9240877e0 con 0x7fd930102c20 2023-12-06T14:57:32.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.463+0000 7fd93648f700 1 --2- 172.21.15.152:0/1645731362 >> [v2:172.21.15.152:6818/3416520485,v1:172.21.15.152:6819/3416520485] conn(0x7fd91806ec30 0x7fd918071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:32.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.463+0000 7fd935c8e700 1 --2- 172.21.15.152:0/1645731362 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fd918068f60 0x7fd91806b410 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd92800b740 tx=0x7fd928004d10 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:32.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.463+0000 7fd93648f700 1 --2- 172.21.15.152:0/1645731362 >> [v2:172.21.15.152:6818/3416520485,v1:172.21.15.152:6819/3416520485] conn(0x7fd91806ec30 0x7fd918071040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:32.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.463+0000 7fd92e7fc700 1 -- 172.21.15.152:0/1645731362 <== osd.2 v2:172.21.15.152:6818/3416520485 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fd9180716f0 con 0x7fd91806ec30 2023-12-06T14:57:32.478 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.478+0000 7fd937ef2700 1 -- 172.21.15.152:0/1645731362 --> [v2:172.21.15.152:6818/3416520485,v1:172.21.15.152:6819/3416520485] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd93005e780 con 0x7fd91806ec30 2023-12-06T14:57:32.478 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.479+0000 7fd92e7fc700 1 -- 172.21.15.152:0/1645731362 <== osd.2 v2:172.21.15.152:6818/3416520485 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd93005e780 con 0x7fd91806ec30 2023-12-06T14:57:32.479 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.479+0000 7fd937ef2700 1 -- 172.21.15.152:0/1645731362 >> [v2:172.21.15.152:6818/3416520485,v1:172.21.15.152:6819/3416520485] conn(0x7fd91806ec30 msgr2=0x7fd918071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:32.479 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.479+0000 7fd937ef2700 1 --2- 172.21.15.152:0/1645731362 >> [v2:172.21.15.152:6818/3416520485,v1:172.21.15.152:6819/3416520485] conn(0x7fd91806ec30 0x7fd918071040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:32.479 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.479+0000 7fd937ef2700 1 -- 172.21.15.152:0/1645731362 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fd918068f60 msgr2=0x7fd91806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:32.479 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.479+0000 7fd937ef2700 1 --2- 172.21.15.152:0/1645731362 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fd918068f60 0x7fd91806b410 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd92800b740 tx=0x7fd928004d10 comp rx=0 tx=0).stop 2023-12-06T14:57:32.480 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.479+0000 7fd937ef2700 1 -- 172.21.15.152:0/1645731362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd930102c20 msgr2=0x7fd9300fc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:32.480 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.479+0000 7fd937ef2700 1 --2- 172.21.15.152:0/1645731362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd930102c20 0x7fd9300fc130 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd92400c830 tx=0x7fd924004470 comp rx=0 tx=0).stop 2023-12-06T14:57:32.480 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.479+0000 7fd937ef2700 1 -- 172.21.15.152:0/1645731362 shutdown_connections 2023-12-06T14:57:32.480 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.479+0000 7fd937ef2700 1 --2- 172.21.15.152:0/1645731362 >> [v2:172.21.15.152:6818/3416520485,v1:172.21.15.152:6819/3416520485] conn(0x7fd91806ec30 0x7fd918071040 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:32.480 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.479+0000 7fd937ef2700 1 --2- 172.21.15.152:0/1645731362 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fd918068f60 0x7fd91806b410 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:32.480 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.479+0000 7fd937ef2700 1 --2- 172.21.15.152:0/1645731362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd930065390 0x7fd9300fbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:32.480 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.479+0000 7fd937ef2700 1 --2- 172.21.15.152:0/1645731362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd930102c20 0x7fd9300fc130 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:32.480 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.479+0000 7fd937ef2700 1 -- 172.21.15.152:0/1645731362 >> 172.21.15.152:0/1645731362 conn(0x7fd9300719b0 msgr2=0x7fd9300fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:32.480 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.479+0000 7fd937ef2700 1 -- 172.21.15.152:0/1645731362 shutdown_connections 2023-12-06T14:57:32.480 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:32.479+0000 7fd937ef2700 1 -- 172.21.15.152:0/1645731362 wait complete. 2023-12-06T14:57:32.503 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:32 smithi152 ceph-mon[111954]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:32.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:32 smithi190 ceph-mon[121340]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:33.022 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:57:33.032 INFO:teuthology.orchestra.run.smithi152.stdout:158913789959 2023-12-06T14:57:33.033 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.5 2023-12-06T14:57:33.037 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:57:33.240 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:57:33.355 INFO:teuthology.orchestra.run.smithi152.stdout:81604378642 2023-12-06T14:57:33.357 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.2 2023-12-06T14:57:34.107 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.076+0000 7f241ed3e700 1 -- 172.21.15.152:0/1811577560 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24180fe5b0 msgr2=0x7f2418106bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:34.107 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.076+0000 7f241ed3e700 1 --2- 172.21.15.152:0/1811577560 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24180fe5b0 0x7f2418106bf0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2404004940 tx=0x7f2404009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:34.107 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.076+0000 7f241ed3e700 1 -- 172.21.15.152:0/1811577560 shutdown_connections 2023-12-06T14:57:34.107 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.076+0000 7f241ed3e700 1 --2- 172.21.15.152:0/1811577560 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24180fe5b0 0x7f2418106bf0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:34.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.076+0000 7f241ed3e700 1 --2- 172.21.15.152:0/1811577560 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24180fdc10 0x7f24180fdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:34.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.076+0000 7f241ed3e700 1 -- 172.21.15.152:0/1811577560 >> 172.21.15.152:0/1811577560 conn(0x7f24180f76c0 msgr2=0x7f24180f9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:34.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.076+0000 7f241ed3e700 1 -- 172.21.15.152:0/1811577560 shutdown_connections 2023-12-06T14:57:34.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.076+0000 7f241ed3e700 1 -- 172.21.15.152:0/1811577560 wait complete. 2023-12-06T14:57:34.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.077+0000 7f241ed3e700 1 Processor -- start 2023-12-06T14:57:34.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.077+0000 7f241ed3e700 1 -- start start 2023-12-06T14:57:34.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.077+0000 7f241ed3e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24180fdc10 0x7f24181136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:34.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.077+0000 7f241ed3e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24180fe5b0 0x7f2418113bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:34.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.077+0000 7f241ed3e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2418114240 con 0x7f24180fe5b0 2023-12-06T14:57:34.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.077+0000 7f241ed3e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241810d590 con 0x7f24180fdc10 2023-12-06T14:57:34.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.078+0000 7f2417fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24180fe5b0 0x7f2418113bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:34.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.078+0000 7f2417fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24180fe5b0 0x7f2418113bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36294/0 (socket says 172.21.15.152:36294) 2023-12-06T14:57:34.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.078+0000 7f2417fff700 1 -- 172.21.15.152:0/701406016 learned_addr learned my addr 172.21.15.152:0/701406016 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:57:34.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.078+0000 7f241cada700 1 --2- 172.21.15.152:0/701406016 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24180fdc10 0x7f24181136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:34.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.078+0000 7f2417fff700 1 -- 172.21.15.152:0/701406016 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24180fdc10 msgr2=0x7f24181136b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:34.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.078+0000 7f2417fff700 1 --2- 172.21.15.152:0/701406016 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24180fdc10 0x7f24181136b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:34.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.078+0000 7f2417fff700 1 -- 172.21.15.152:0/701406016 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2404005040 con 0x7f24180fe5b0 2023-12-06T14:57:34.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.078+0000 7f2417fff700 1 --2- 172.21.15.152:0/701406016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24180fe5b0 0x7f2418113bf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f240400b3b0 tx=0x7f2404009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:34.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.078+0000 7f24157fa700 1 -- 172.21.15.152:0/701406016 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f240400e040 con 0x7f24180fe5b0 2023-12-06T14:57:34.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.078+0000 7f241ed3e700 1 -- 172.21.15.152:0/701406016 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f241810d810 con 0x7f24180fe5b0 2023-12-06T14:57:34.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.078+0000 7f241ed3e700 1 -- 172.21.15.152:0/701406016 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f241810dd50 con 0x7f24180fe5b0 2023-12-06T14:57:34.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.078+0000 7f24157fa700 1 -- 172.21.15.152:0/701406016 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2404009af0 con 0x7f24180fe5b0 2023-12-06T14:57:34.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.078+0000 7f24157fa700 1 -- 172.21.15.152:0/701406016 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2404025640 con 0x7f24180fe5b0 2023-12-06T14:57:34.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.079+0000 7f241ed3e700 1 -- 172.21.15.152:0/701406016 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23fc0052e0 con 0x7f24180fe5b0 2023-12-06T14:57:34.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.080+0000 7f24157fa700 1 -- 172.21.15.152:0/701406016 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f240400bc50 con 0x7f24180fe5b0 2023-12-06T14:57:34.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.080+0000 7f24157fa700 1 --2- 172.21.15.152:0/701406016 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f2408068f60 0x7f240806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:34.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.080+0000 7f24157fa700 1 -- 172.21.15.152:0/701406016 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2404087da0 con 0x7f24180fe5b0 2023-12-06T14:57:34.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.081+0000 7f241cada700 1 --2- 172.21.15.152:0/701406016 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f2408068f60 0x7f240806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:34.110 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.081+0000 7f241cada700 1 --2- 172.21.15.152:0/701406016 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f2408068f60 0x7f240806b410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f240c004c40 tx=0x7f240c009040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:34.110 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.085+0000 7f24157fa700 1 -- 172.21.15.152:0/701406016 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2404058040 con 0x7f24180fe5b0 2023-12-06T14:57:34.280 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.280+0000 7f241ed3e700 1 -- 172.21.15.152:0/701406016 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f23fc005590 con 0x7f24180fe5b0 2023-12-06T14:57:34.280 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.280+0000 7f24157fa700 1 -- 172.21.15.152:0/701406016 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2404057bd0 con 0x7f24180fe5b0 2023-12-06T14:57:34.281 INFO:teuthology.orchestra.run.smithi152.stdout:107374182416 2023-12-06T14:57:34.282 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.282+0000 7f241ed3e700 1 -- 172.21.15.152:0/701406016 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f2408068f60 msgr2=0x7f240806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:34.282 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.282+0000 7f241ed3e700 1 --2- 172.21.15.152:0/701406016 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f2408068f60 0x7f240806b410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f240c004c40 tx=0x7f240c009040 comp rx=0 tx=0).stop 2023-12-06T14:57:34.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.282+0000 7f241ed3e700 1 -- 172.21.15.152:0/701406016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24180fe5b0 msgr2=0x7f2418113bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:34.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.282+0000 7f241ed3e700 1 --2- 172.21.15.152:0/701406016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24180fe5b0 0x7f2418113bf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f240400b3b0 tx=0x7f2404009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:34.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.282+0000 7f241ed3e700 1 -- 172.21.15.152:0/701406016 shutdown_connections 2023-12-06T14:57:34.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.282+0000 7f241ed3e700 1 --2- 172.21.15.152:0/701406016 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f2408068f60 0x7f240806b410 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:34.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.282+0000 7f241ed3e700 1 --2- 172.21.15.152:0/701406016 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24180fdc10 0x7f24181136b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:34.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.282+0000 7f241ed3e700 1 --2- 172.21.15.152:0/701406016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24180fe5b0 0x7f2418113bf0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:34.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.282+0000 7f241ed3e700 1 -- 172.21.15.152:0/701406016 >> 172.21.15.152:0/701406016 conn(0x7f24180f76c0 msgr2=0x7f2418101380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:34.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.282+0000 7f241ed3e700 1 -- 172.21.15.152:0/701406016 shutdown_connections 2023-12-06T14:57:34.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:34.282+0000 7f241ed3e700 1 -- 172.21.15.152:0/701406016 wait complete. 2023-12-06T14:57:34.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:34 smithi152 ceph-mon[111954]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:34.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:34 smithi190 ceph-mon[121340]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:35.418 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:35 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/701406016' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-06T14:57:35.419 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182415 got 107374182416 for osd.3 2023-12-06T14:57:35.419 DEBUG:teuthology.parallel:result is None 2023-12-06T14:57:35.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:35 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/701406016' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-06T14:57:35.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.678+0000 7fd0d0787700 1 -- 172.21.15.152:0/4202220272 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0c80fbb40 msgr2=0x7fd0c80fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:35.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.678+0000 7fd0d0787700 1 --2- 172.21.15.152:0/4202220272 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0c80fbb40 0x7fd0c80fbfb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4004940 tx=0x7fd0c4009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:35.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.678+0000 7fd0d0787700 1 -- 172.21.15.152:0/4202220272 shutdown_connections 2023-12-06T14:57:35.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.678+0000 7fd0d0787700 1 --2- 172.21.15.152:0/4202220272 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0c80fbb40 0x7fd0c80fbfb0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:35.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.678+0000 7fd0d0787700 1 --2- 172.21.15.152:0/4202220272 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0c8101b00 0x7fd0c8101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:35.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.678+0000 7fd0d0787700 1 -- 172.21.15.152:0/4202220272 >> 172.21.15.152:0/4202220272 conn(0x7fd0c80719b0 msgr2=0x7fd0c8071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:35.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.678+0000 7fd0d0787700 1 -- 172.21.15.152:0/4202220272 shutdown_connections 2023-12-06T14:57:35.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.678+0000 7fd0d0787700 1 -- 172.21.15.152:0/4202220272 wait complete. 2023-12-06T14:57:35.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.678+0000 7fd0d0787700 1 Processor -- start 2023-12-06T14:57:35.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.679+0000 7fd0d0787700 1 -- start start 2023-12-06T14:57:35.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.679+0000 7fd0d0787700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0c80fbb40 0x7fd0c810e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:35.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.679+0000 7fd0d0787700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0c8101b00 0x7fd0c810ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:35.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.679+0000 7fd0d0787700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c810f260 con 0x7fd0c8101b00 2023-12-06T14:57:35.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.679+0000 7fd0d0787700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c810f3a0 con 0x7fd0c80fbb40 2023-12-06T14:57:35.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.679+0000 7fd0cdd22700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0c8101b00 0x7fd0c810ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:35.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.679+0000 7fd0cdd22700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0c8101b00 0x7fd0c810ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36312/0 (socket says 172.21.15.152:36312) 2023-12-06T14:57:35.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.679+0000 7fd0cdd22700 1 -- 172.21.15.152:0/2630625235 learned_addr learned my addr 172.21.15.152:0/2630625235 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:57:35.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.679+0000 7fd0ce523700 1 --2- 172.21.15.152:0/2630625235 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0c80fbb40 0x7fd0c810e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:35.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.679+0000 7fd0cdd22700 1 -- 172.21.15.152:0/2630625235 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0c80fbb40 msgr2=0x7fd0c810e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:35.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.679+0000 7fd0cdd22700 1 --2- 172.21.15.152:0/2630625235 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0c80fbb40 0x7fd0c810e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:35.682 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.679+0000 7fd0cdd22700 1 -- 172.21.15.152:0/2630625235 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c4005040 con 0x7fd0c8101b00 2023-12-06T14:57:35.682 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.679+0000 7fd0cdd22700 1 --2- 172.21.15.152:0/2630625235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0c8101b00 0x7fd0c810ec40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4009380 tx=0x7fd0c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:35.682 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.679+0000 7fd0beffd700 1 -- 172.21.15.152:0/2630625235 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0c400e040 con 0x7fd0c8101b00 2023-12-06T14:57:35.682 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.679+0000 7fd0d0787700 1 -- 172.21.15.152:0/2630625235 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c8117670 con 0x7fd0c8101b00 2023-12-06T14:57:35.682 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.679+0000 7fd0beffd700 1 -- 172.21.15.152:0/2630625235 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd0c400bc50 con 0x7fd0c8101b00 2023-12-06T14:57:35.682 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.679+0000 7fd0beffd700 1 -- 172.21.15.152:0/2630625235 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0c4013660 con 0x7fd0c8101b00 2023-12-06T14:57:35.682 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.679+0000 7fd0d0787700 1 -- 172.21.15.152:0/2630625235 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c8117bb0 con 0x7fd0c8101b00 2023-12-06T14:57:35.683 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.680+0000 7fd0d0787700 1 -- 172.21.15.152:0/2630625235 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0c8103fb0 con 0x7fd0c8101b00 2023-12-06T14:57:35.683 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.681+0000 7fd0beffd700 1 -- 172.21.15.152:0/2630625235 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fd0c40138d0 con 0x7fd0c8101b00 2023-12-06T14:57:35.683 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.681+0000 7fd0beffd700 1 --2- 172.21.15.152:0/2630625235 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fd0b4068f60 0x7fd0b406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:35.683 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.681+0000 7fd0ce523700 1 --2- 172.21.15.152:0/2630625235 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fd0b4068f60 0x7fd0b406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:35.683 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.681+0000 7fd0beffd700 1 -- 172.21.15.152:0/2630625235 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd0c4087800 con 0x7fd0c8101b00 2023-12-06T14:57:35.683 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.682+0000 7fd0ce523700 1 --2- 172.21.15.152:0/2630625235 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fd0b4068f60 0x7fd0b406b410 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8006fd0 tx=0x7fd0b8008040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:35.686 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.686+0000 7fd0beffd700 1 -- 172.21.15.152:0/2630625235 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fd0c40540c0 con 0x7fd0c8101b00 2023-12-06T14:57:35.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.820+0000 7f4754c41700 1 -- 172.21.15.152:0/31724296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4750102410 msgr2=0x7f47500fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:35.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.820+0000 7f4754c41700 1 --2- 172.21.15.152:0/31724296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4750102410 0x7f47500fc2f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4744004940 tx=0x7f4744009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:35.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.821+0000 7f4754c41700 1 -- 172.21.15.152:0/31724296 shutdown_connections 2023-12-06T14:57:35.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.821+0000 7f4754c41700 1 --2- 172.21.15.152:0/31724296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4750102410 0x7f47500fc2f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:35.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.821+0000 7f4754c41700 1 --2- 172.21.15.152:0/31724296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4750101b00 0x7f4750101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:35.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.821+0000 7f4754c41700 1 -- 172.21.15.152:0/31724296 >> 172.21.15.152:0/31724296 conn(0x7f47500711a0 msgr2=0x7f47500715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:35.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.821+0000 7f4754c41700 1 -- 172.21.15.152:0/31724296 shutdown_connections 2023-12-06T14:57:35.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.821+0000 7f4754c41700 1 -- 172.21.15.152:0/31724296 wait complete. 2023-12-06T14:57:35.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.821+0000 7f4754c41700 1 Processor -- start 2023-12-06T14:57:35.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.821+0000 7f4754c41700 1 -- start start 2023-12-06T14:57:35.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.821+0000 7f4754c41700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4750101b00 0x7f4750112570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:35.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.821+0000 7f4754c41700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4750102410 0x7f4750112ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:35.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.821+0000 7f4754c41700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4750113100 con 0x7f4750102410 2023-12-06T14:57:35.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.821+0000 7f4754c41700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475010c430 con 0x7f4750101b00 2023-12-06T14:57:35.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.822+0000 7f474dd9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4750102410 0x7f4750112ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:35.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.822+0000 7f474dd9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4750102410 0x7f4750112ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36336/0 (socket says 172.21.15.152:36336) 2023-12-06T14:57:35.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.822+0000 7f474dd9b700 1 -- 172.21.15.152:0/2160365757 learned_addr learned my addr 172.21.15.152:0/2160365757 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:57:35.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.822+0000 7f474e59c700 1 --2- 172.21.15.152:0/2160365757 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4750101b00 0x7f4750112570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:35.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.822+0000 7f474dd9b700 1 -- 172.21.15.152:0/2160365757 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4750101b00 msgr2=0x7f4750112570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:35.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.822+0000 7f474dd9b700 1 --2- 172.21.15.152:0/2160365757 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4750101b00 0x7f4750112570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:35.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.822+0000 7f474dd9b700 1 -- 172.21.15.152:0/2160365757 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4744005040 con 0x7f4750102410 2023-12-06T14:57:35.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.822+0000 7f474e59c700 1 --2- 172.21.15.152:0/2160365757 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4750101b00 0x7f4750112570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-06T14:57:35.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.822+0000 7f474dd9b700 1 --2- 172.21.15.152:0/2160365757 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4750102410 0x7f4750112ab0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4744009fd0 tx=0x7f4744009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:35.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.822+0000 7f473effd700 1 -- 172.21.15.152:0/2160365757 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f474400e040 con 0x7f4750102410 2023-12-06T14:57:35.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.822+0000 7f473effd700 1 -- 172.21.15.152:0/2160365757 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f474400bd20 con 0x7f4750102410 2023-12-06T14:57:35.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.822+0000 7f473effd700 1 -- 172.21.15.152:0/2160365757 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f474401c630 con 0x7f4750102410 2023-12-06T14:57:35.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.822+0000 7f4754c41700 1 -- 172.21.15.152:0/2160365757 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f475010c6b0 con 0x7f4750102410 2023-12-06T14:57:35.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.822+0000 7f4754c41700 1 -- 172.21.15.152:0/2160365757 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f475010cbf0 con 0x7f4750102410 2023-12-06T14:57:35.825 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.823+0000 7f4754c41700 1 -- 172.21.15.152:0/2160365757 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47500fee60 con 0x7f4750102410 2023-12-06T14:57:35.825 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.824+0000 7f473effd700 1 -- 172.21.15.152:0/2160365757 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f4744013420 con 0x7f4750102410 2023-12-06T14:57:35.825 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.824+0000 7f473effd700 1 --2- 172.21.15.152:0/2160365757 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f4738068f60 0x7f473806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:35.825 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.824+0000 7f473effd700 1 -- 172.21.15.152:0/2160365757 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f4744087e30 con 0x7f4750102410 2023-12-06T14:57:35.826 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.824+0000 7f474e59c700 1 --2- 172.21.15.152:0/2160365757 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f4738068f60 0x7f473806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:35.826 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.825+0000 7f474e59c700 1 --2- 172.21.15.152:0/2160365757 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f4738068f60 0x7f473806b410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4740007fd0 tx=0x7f4740009040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:35.828 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.829+0000 7f473effd700 1 -- 172.21.15.152:0/2160365757 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f47440580d0 con 0x7f4750102410 2023-12-06T14:57:35.886 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.886+0000 7fd0d0787700 1 -- 172.21.15.152:0/2630625235 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd0c80734d0 con 0x7fd0c8101b00 2023-12-06T14:57:35.887 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.886+0000 7fd0beffd700 1 -- 172.21.15.152:0/2630625235 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd0c40576e0 con 0x7fd0c8101b00 2023-12-06T14:57:35.887 INFO:teuthology.orchestra.run.smithi152.stdout:137438953483 2023-12-06T14:57:35.889 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.888+0000 7fd0d0787700 1 -- 172.21.15.152:0/2630625235 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fd0b4068f60 msgr2=0x7fd0b406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:35.889 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.888+0000 7fd0d0787700 1 --2- 172.21.15.152:0/2630625235 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fd0b4068f60 0x7fd0b406b410 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8006fd0 tx=0x7fd0b8008040 comp rx=0 tx=0).stop 2023-12-06T14:57:35.889 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.888+0000 7fd0d0787700 1 -- 172.21.15.152:0/2630625235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0c8101b00 msgr2=0x7fd0c810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:35.889 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.888+0000 7fd0d0787700 1 --2- 172.21.15.152:0/2630625235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0c8101b00 0x7fd0c810ec40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4009380 tx=0x7fd0c4009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:35.889 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.888+0000 7fd0d0787700 1 -- 172.21.15.152:0/2630625235 shutdown_connections 2023-12-06T14:57:35.889 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.888+0000 7fd0d0787700 1 --2- 172.21.15.152:0/2630625235 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fd0b4068f60 0x7fd0b406b410 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:35.889 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.888+0000 7fd0d0787700 1 --2- 172.21.15.152:0/2630625235 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0c80fbb40 0x7fd0c810e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:35.889 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.888+0000 7fd0d0787700 1 --2- 172.21.15.152:0/2630625235 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0c8101b00 0x7fd0c810ec40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:35.890 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.889+0000 7fd0d0787700 1 -- 172.21.15.152:0/2630625235 >> 172.21.15.152:0/2630625235 conn(0x7fd0c80719b0 msgr2=0x7fd0c80faa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:35.890 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.889+0000 7fd0d0787700 1 -- 172.21.15.152:0/2630625235 shutdown_connections 2023-12-06T14:57:35.890 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:35.889+0000 7fd0d0787700 1 -- 172.21.15.152:0/2630625235 wait complete. 2023-12-06T14:57:36.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.030+0000 7f4754c41700 1 -- 172.21.15.152:0/2160365757 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f475004bb80 con 0x7f4750102410 2023-12-06T14:57:36.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.030+0000 7f473effd700 1 -- 172.21.15.152:0/2160365757 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4744057c60 con 0x7f4750102410 2023-12-06T14:57:36.031 INFO:teuthology.orchestra.run.smithi152.stdout:38654705691 2023-12-06T14:57:36.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.032+0000 7f4754c41700 1 -- 172.21.15.152:0/2160365757 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f4738068f60 msgr2=0x7f473806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:36.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.032+0000 7f4754c41700 1 --2- 172.21.15.152:0/2160365757 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f4738068f60 0x7f473806b410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4740007fd0 tx=0x7f4740009040 comp rx=0 tx=0).stop 2023-12-06T14:57:36.032 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.032+0000 7f4754c41700 1 -- 172.21.15.152:0/2160365757 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4750102410 msgr2=0x7f4750112ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:36.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.032+0000 7f4754c41700 1 --2- 172.21.15.152:0/2160365757 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4750102410 0x7f4750112ab0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4744009fd0 tx=0x7f4744009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:36.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.032+0000 7f4754c41700 1 -- 172.21.15.152:0/2160365757 shutdown_connections 2023-12-06T14:57:36.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.032+0000 7f4754c41700 1 --2- 172.21.15.152:0/2160365757 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f4738068f60 0x7f473806b410 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:36.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.032+0000 7f4754c41700 1 --2- 172.21.15.152:0/2160365757 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4750101b00 0x7f4750112570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:36.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.032+0000 7f4754c41700 1 --2- 172.21.15.152:0/2160365757 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4750102410 0x7f4750112ab0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:36.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.032+0000 7f4754c41700 1 -- 172.21.15.152:0/2160365757 >> 172.21.15.152:0/2160365757 conn(0x7f47500711a0 msgr2=0x7f47500fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:36.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.032+0000 7f4754c41700 1 -- 172.21.15.152:0/2160365757 shutdown_connections 2023-12-06T14:57:36.033 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.032+0000 7f4754c41700 1 -- 172.21.15.152:0/2160365757 wait complete. 2023-12-06T14:57:36.060 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:57:36.070 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.070+0000 7f2ecd83d700 1 -- 172.21.15.152:0/3579464611 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ec806ff60 msgr2=0x7f2ec8070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:36.070 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.070+0000 7f2ecd83d700 1 --2- 172.21.15.152:0/3579464611 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ec806ff60 0x7f2ec8070330 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8004940 tx=0x7f2eb8009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:36.071 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.070+0000 7f2ecd83d700 1 -- 172.21.15.152:0/3579464611 shutdown_connections 2023-12-06T14:57:36.071 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.070+0000 7f2ecd83d700 1 --2- 172.21.15.152:0/3579464611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ec8070870 0x7f2ec8108f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:36.071 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.070+0000 7f2ecd83d700 1 --2- 172.21.15.152:0/3579464611 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ec806ff60 0x7f2ec8070330 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:36.071 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.070+0000 7f2ecd83d700 1 -- 172.21.15.152:0/3579464611 >> 172.21.15.152:0/3579464611 conn(0x7f2ec80f8790 msgr2=0x7f2ec80faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:36.071 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.070+0000 7f2ecd83d700 1 -- 172.21.15.152:0/3579464611 shutdown_connections 2023-12-06T14:57:36.071 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.070+0000 7f2ecd83d700 1 -- 172.21.15.152:0/3579464611 wait complete. 2023-12-06T14:57:36.072 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.071+0000 7f2ecd83d700 1 Processor -- start 2023-12-06T14:57:36.072 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.071+0000 7f2ecd83d700 1 -- start start 2023-12-06T14:57:36.072 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.071+0000 7f2ecd83d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ec806ff60 0x7f2ec8118b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:36.072 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.071+0000 7f2ecd83d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ec8070870 0x7f2ec8119090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:36.072 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.071+0000 7f2ecd83d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec81196e0 con 0x7f2ec8070870 2023-12-06T14:57:36.072 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.071+0000 7f2ecd83d700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec8108280 con 0x7f2ec806ff60 2023-12-06T14:57:36.073 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.072+0000 7f2ec67fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ec8070870 0x7f2ec8119090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:36.073 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.072+0000 7f2ec67fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ec8070870 0x7f2ec8119090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36352/0 (socket says 172.21.15.152:36352) 2023-12-06T14:57:36.073 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.072+0000 7f2ec67fc700 1 -- 172.21.15.152:0/2939294655 learned_addr learned my addr 172.21.15.152:0/2939294655 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:57:36.073 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.072+0000 7f2ec6ffd700 1 --2- 172.21.15.152:0/2939294655 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ec806ff60 0x7f2ec8118b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:36.073 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.072+0000 7f2ec67fc700 1 -- 172.21.15.152:0/2939294655 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ec806ff60 msgr2=0x7f2ec8118b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:36.073 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.072+0000 7f2ec67fc700 1 --2- 172.21.15.152:0/2939294655 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ec806ff60 0x7f2ec8118b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:36.073 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.072+0000 7f2ec67fc700 1 -- 172.21.15.152:0/2939294655 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb8005040 con 0x7f2ec8070870 2023-12-06T14:57:36.073 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.072+0000 7f2ec67fc700 1 --2- 172.21.15.152:0/2939294655 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ec8070870 0x7f2ec8119090 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc00c8c0 tx=0x7f2ebc0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:36.073 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.072+0000 7f2eaf7fe700 1 -- 172.21.15.152:0/2939294655 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ebc00a760 con 0x7f2ec8070870 2023-12-06T14:57:36.074 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.072+0000 7f2ecd83d700 1 -- 172.21.15.152:0/2939294655 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec8108560 con 0x7f2ec8070870 2023-12-06T14:57:36.074 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.072+0000 7f2eaf7fe700 1 -- 172.21.15.152:0/2939294655 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2ebc00ad70 con 0x7f2ec8070870 2023-12-06T14:57:36.074 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.072+0000 7f2eaf7fe700 1 -- 172.21.15.152:0/2939294655 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ebc0113a0 con 0x7f2ec8070870 2023-12-06T14:57:36.074 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.072+0000 7f2ecd83d700 1 -- 172.21.15.152:0/2939294655 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec8108aa0 con 0x7f2ec8070870 2023-12-06T14:57:36.074 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.073+0000 7f2ecd83d700 1 -- 172.21.15.152:0/2939294655 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ec80fc390 con 0x7f2ec8070870 2023-12-06T14:57:36.074 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.074+0000 7f2eaf7fe700 1 -- 172.21.15.152:0/2939294655 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f2ebc00a8c0 con 0x7f2ec8070870 2023-12-06T14:57:36.075 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.074+0000 7f2eaf7fe700 1 --2- 172.21.15.152:0/2939294655 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f2eb0068fb0 0x7f2eb006b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:36.075 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.074+0000 7f2eaf7fe700 1 -- 172.21.15.152:0/2939294655 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2ebc086bd0 con 0x7f2ec8070870 2023-12-06T14:57:36.075 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.074+0000 7f2ec6ffd700 1 --2- 172.21.15.152:0/2939294655 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f2eb0068fb0 0x7f2eb006b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:36.075 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.075+0000 7f2ec6ffd700 1 --2- 172.21.15.152:0/2939294655 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f2eb0068fb0 0x7f2eb006b460 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8004f90 tx=0x7f2eb8009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:36.079 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.079+0000 7f2eaf7fe700 1 -- 172.21.15.152:0/2939294655 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2ebc056dd0 con 0x7f2ec8070870 2023-12-06T14:57:36.278 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.278+0000 7f2ecd83d700 1 -- 172.21.15.152:0/2939294655 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2ec810bda0 con 0x7f2ec8070870 2023-12-06T14:57:36.279 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.278+0000 7f2eaf7fe700 1 -- 172.21.15.152:0/2939294655 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2ebc056960 con 0x7f2ec8070870 2023-12-06T14:57:36.279 INFO:teuthology.orchestra.run.smithi152.stdout:60129542166 2023-12-06T14:57:36.280 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.280+0000 7f2ecd83d700 1 -- 172.21.15.152:0/2939294655 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f2eb0068fb0 msgr2=0x7f2eb006b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:36.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.280+0000 7f2ecd83d700 1 --2- 172.21.15.152:0/2939294655 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f2eb0068fb0 0x7f2eb006b460 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8004f90 tx=0x7f2eb8009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:36.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.280+0000 7f2ecd83d700 1 -- 172.21.15.152:0/2939294655 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ec8070870 msgr2=0x7f2ec8119090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:36.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.280+0000 7f2ecd83d700 1 --2- 172.21.15.152:0/2939294655 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ec8070870 0x7f2ec8119090 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc00c8c0 tx=0x7f2ebc0044c0 comp rx=0 tx=0).stop 2023-12-06T14:57:36.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.280+0000 7f2ecd83d700 1 -- 172.21.15.152:0/2939294655 shutdown_connections 2023-12-06T14:57:36.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.280+0000 7f2ecd83d700 1 --2- 172.21.15.152:0/2939294655 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f2eb0068fb0 0x7f2eb006b460 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:36.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.280+0000 7f2ecd83d700 1 --2- 172.21.15.152:0/2939294655 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ec806ff60 0x7f2ec8118b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:36.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.280+0000 7f2ecd83d700 1 --2- 172.21.15.152:0/2939294655 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2ec8070870 0x7f2ec8119090 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:36.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.280+0000 7f2ecd83d700 1 -- 172.21.15.152:0/2939294655 >> 172.21.15.152:0/2939294655 conn(0x7f2ec80f8790 msgr2=0x7f2ec80feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:36.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.281+0000 7f2ecd83d700 1 -- 172.21.15.152:0/2939294655 shutdown_connections 2023-12-06T14:57:36.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:36.281+0000 7f2ecd83d700 1 -- 172.21.15.152:0/2939294655 wait complete. 2023-12-06T14:57:36.415 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705691 got 38654705691 for osd.0 2023-12-06T14:57:36.415 DEBUG:teuthology.parallel:result is None 2023-12-06T14:57:36.463 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:36 smithi152 ceph-mon[111954]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:36.463 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:36 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/2630625235' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-06T14:57:36.463 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:36 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/2160365757' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-06T14:57:36.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:36 smithi190 ceph-mon[121340]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:36.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:36 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/2630625235' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-06T14:57:36.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:36 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/2160365757' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-06T14:57:36.745 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953482 got 137438953483 for osd.4 2023-12-06T14:57:36.745 DEBUG:teuthology.parallel:result is None 2023-12-06T14:57:37.237 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:57:37.262 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542165 got 60129542166 for osd.1 2023-12-06T14:57:37.262 DEBUG:teuthology.parallel:result is None 2023-12-06T14:57:37.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:37 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/2939294655' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-06T14:57:37.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:37 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/2939294655' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-06T14:57:37.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.783+0000 7f14b6357700 1 -- 172.21.15.152:0/87292205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14b0102c20 msgr2=0x7f14b0102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:37.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.783+0000 7f14b6357700 1 --2- 172.21.15.152:0/87292205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14b0102c20 0x7f14b0102ff0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f14a0004940 tx=0x7f14a0009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:37.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.783+0000 7f14b6357700 1 -- 172.21.15.152:0/87292205 shutdown_connections 2023-12-06T14:57:37.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.783+0000 7f14b6357700 1 --2- 172.21.15.152:0/87292205 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14b0065390 0x7f14b0065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:37.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.783+0000 7f14b6357700 1 --2- 172.21.15.152:0/87292205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14b0102c20 0x7f14b0102ff0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:37.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.783+0000 7f14b6357700 1 -- 172.21.15.152:0/87292205 >> 172.21.15.152:0/87292205 conn(0x7f14b00719b0 msgr2=0x7f14b0071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:37.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.783+0000 7f14b6357700 1 -- 172.21.15.152:0/87292205 shutdown_connections 2023-12-06T14:57:37.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.783+0000 7f14b6357700 1 -- 172.21.15.152:0/87292205 wait complete. 2023-12-06T14:57:37.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.784+0000 7f14b6357700 1 Processor -- start 2023-12-06T14:57:37.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.784+0000 7f14b6357700 1 -- start start 2023-12-06T14:57:37.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.784+0000 7f14b6357700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14b0065390 0x7f14b01136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:37.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.784+0000 7f14b6357700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14b0102c20 0x7f14b0113bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:37.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.784+0000 7f14b6357700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b0114240 con 0x7f14b0102c20 2023-12-06T14:57:37.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.784+0000 7f14b6357700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b010d590 con 0x7f14b0065390 2023-12-06T14:57:37.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.784+0000 7f14af7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14b0102c20 0x7f14b0113bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:37.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.784+0000 7f14af7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14b0102c20 0x7f14b0113bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36376/0 (socket says 172.21.15.152:36376) 2023-12-06T14:57:37.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.784+0000 7f14af7fe700 1 -- 172.21.15.152:0/2374398329 learned_addr learned my addr 172.21.15.152:0/2374398329 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:57:37.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.784+0000 7f14affff700 1 --2- 172.21.15.152:0/2374398329 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14b0065390 0x7f14b01136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:37.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.784+0000 7f14af7fe700 1 -- 172.21.15.152:0/2374398329 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14b0065390 msgr2=0x7f14b01136b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:37.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.784+0000 7f14af7fe700 1 --2- 172.21.15.152:0/2374398329 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14b0065390 0x7f14b01136b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:37.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.784+0000 7f14af7fe700 1 -- 172.21.15.152:0/2374398329 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a0005040 con 0x7f14b0102c20 2023-12-06T14:57:37.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.784+0000 7f14af7fe700 1 --2- 172.21.15.152:0/2374398329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14b0102c20 0x7f14b0113bf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f14a400c810 tx=0x7f14a4004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:37.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.785+0000 7f14acff9700 1 -- 172.21.15.152:0/2374398329 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14a4012810 con 0x7f14b0102c20 2023-12-06T14:57:37.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.785+0000 7f14b6357700 1 -- 172.21.15.152:0/2374398329 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b010d870 con 0x7f14b0102c20 2023-12-06T14:57:37.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.785+0000 7f14acff9700 1 -- 172.21.15.152:0/2374398329 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f14a4012e20 con 0x7f14b0102c20 2023-12-06T14:57:37.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.785+0000 7f14acff9700 1 -- 172.21.15.152:0/2374398329 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14a40102e0 con 0x7f14b0102c20 2023-12-06T14:57:37.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.785+0000 7f14b6357700 1 -- 172.21.15.152:0/2374398329 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b010ddb0 con 0x7f14b0102c20 2023-12-06T14:57:37.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.786+0000 7f14b6357700 1 -- 172.21.15.152:0/2374398329 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b00fff40 con 0x7f14b0102c20 2023-12-06T14:57:37.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.786+0000 7f14acff9700 1 -- 172.21.15.152:0/2374398329 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f14a4011380 con 0x7f14b0102c20 2023-12-06T14:57:37.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.786+0000 7f14acff9700 1 --2- 172.21.15.152:0/2374398329 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f1498068f60 0x7f149806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:37.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.787+0000 7f14acff9700 1 -- 172.21.15.152:0/2374398329 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f14a4086ed0 con 0x7f14b0102c20 2023-12-06T14:57:37.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.787+0000 7f14affff700 1 --2- 172.21.15.152:0/2374398329 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f1498068f60 0x7f149806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:37.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.787+0000 7f14affff700 1 --2- 172.21.15.152:0/2374398329 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f1498068f60 0x7f149806b410 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f14a0004f90 tx=0x7f14a0009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:37.791 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.791+0000 7f14acff9700 1 -- 172.21.15.152:0/2374398329 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f14a4057050 con 0x7f14b0102c20 2023-12-06T14:57:37.984 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.983+0000 7f14b6357700 1 -- 172.21.15.152:0/2374398329 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f14b004bb80 con 0x7f14b0102c20 2023-12-06T14:57:37.984 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.984+0000 7f14acff9700 1 -- 172.21.15.152:0/2374398329 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f14a4016020 con 0x7f14b0102c20 2023-12-06T14:57:37.984 INFO:teuthology.orchestra.run.smithi152.stdout:158913789960 2023-12-06T14:57:37.986 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.986+0000 7f14b6357700 1 -- 172.21.15.152:0/2374398329 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f1498068f60 msgr2=0x7f149806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:37.986 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.986+0000 7f14b6357700 1 --2- 172.21.15.152:0/2374398329 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f1498068f60 0x7f149806b410 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f14a0004f90 tx=0x7f14a0009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:37.986 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.986+0000 7f14b6357700 1 -- 172.21.15.152:0/2374398329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14b0102c20 msgr2=0x7f14b0113bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:37.986 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.986+0000 7f14b6357700 1 --2- 172.21.15.152:0/2374398329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14b0102c20 0x7f14b0113bf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f14a400c810 tx=0x7f14a4004470 comp rx=0 tx=0).stop 2023-12-06T14:57:37.987 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.986+0000 7f14b6357700 1 -- 172.21.15.152:0/2374398329 shutdown_connections 2023-12-06T14:57:37.987 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.986+0000 7f14b6357700 1 --2- 172.21.15.152:0/2374398329 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f1498068f60 0x7f149806b410 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:37.987 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.986+0000 7f14b6357700 1 --2- 172.21.15.152:0/2374398329 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14b0065390 0x7f14b01136b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:37.987 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.986+0000 7f14b6357700 1 --2- 172.21.15.152:0/2374398329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14b0102c20 0x7f14b0113bf0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:37.987 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.986+0000 7f14b6357700 1 -- 172.21.15.152:0/2374398329 >> 172.21.15.152:0/2374398329 conn(0x7f14b00719b0 msgr2=0x7f14b00fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:37.987 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.986+0000 7f14b6357700 1 -- 172.21.15.152:0/2374398329 shutdown_connections 2023-12-06T14:57:37.987 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:37.986+0000 7f14b6357700 1 -- 172.21.15.152:0/2374398329 wait complete. 2023-12-06T14:57:38.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:38 smithi152 ceph-mon[111954]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:38.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:38 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/2374398329' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-06T14:57:38.472 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789959 got 158913789960 for osd.5 2023-12-06T14:57:38.472 DEBUG:teuthology.parallel:result is None 2023-12-06T14:57:38.493 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.493+0000 7f7ce315d700 1 -- 172.21.15.152:0/4252968996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7cdc101af0 msgr2=0x7f7cdc101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:38.493 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.493+0000 7f7ce315d700 1 --2- 172.21.15.152:0/4252968996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7cdc101af0 0x7f7cdc101ec0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0004880 tx=0x7f7cd0009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:38.493 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.493+0000 7f7ce315d700 1 -- 172.21.15.152:0/4252968996 shutdown_connections 2023-12-06T14:57:38.493 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.493+0000 7f7ce315d700 1 --2- 172.21.15.152:0/4252968996 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7cdc0fbb30 0x7f7cdc0fbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:38.493 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.493+0000 7f7ce315d700 1 --2- 172.21.15.152:0/4252968996 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7cdc101af0 0x7f7cdc101ec0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:38.493 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.493+0000 7f7ce315d700 1 -- 172.21.15.152:0/4252968996 >> 172.21.15.152:0/4252968996 conn(0x7f7cdc0f7690 msgr2=0x7f7cdc0f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:38.494 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.493+0000 7f7ce315d700 1 -- 172.21.15.152:0/4252968996 shutdown_connections 2023-12-06T14:57:38.494 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.493+0000 7f7ce315d700 1 -- 172.21.15.152:0/4252968996 wait complete. 2023-12-06T14:57:38.495 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.494+0000 7f7ce315d700 1 Processor -- start 2023-12-06T14:57:38.495 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.494+0000 7f7ce315d700 1 -- start start 2023-12-06T14:57:38.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.494+0000 7f7ce315d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7cdc0fbb30 0x7f7cdc10e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:38.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.494+0000 7f7ce315d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7cdc10ed60 0x7f7cdc1176d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:38.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.494+0000 7f7ce315d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cdc10f1d0 con 0x7f7cdc10ed60 2023-12-06T14:57:38.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.494+0000 7f7ce315d700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cdc10f340 con 0x7f7cdc0fbb30 2023-12-06T14:57:38.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.494+0000 7f7cdbfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7cdc10ed60 0x7f7cdc1176d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:38.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.494+0000 7f7cdbfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7cdc10ed60 0x7f7cdc1176d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36402/0 (socket says 172.21.15.152:36402) 2023-12-06T14:57:38.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.494+0000 7f7cdbfff700 1 -- 172.21.15.152:0/2665566270 learned_addr learned my addr 172.21.15.152:0/2665566270 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:57:38.497 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.494+0000 7f7ce0ef9700 1 --2- 172.21.15.152:0/2665566270 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7cdc0fbb30 0x7f7cdc10e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:38.497 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.494+0000 7f7cdbfff700 1 -- 172.21.15.152:0/2665566270 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7cdc0fbb30 msgr2=0x7f7cdc10e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:38.497 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.494+0000 7f7cdbfff700 1 --2- 172.21.15.152:0/2665566270 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7cdc0fbb30 0x7f7cdc10e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:38.497 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.494+0000 7f7cdbfff700 1 -- 172.21.15.152:0/2665566270 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd0005040 con 0x7f7cdc10ed60 2023-12-06T14:57:38.497 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.494+0000 7f7cdbfff700 1 --2- 172.21.15.152:0/2665566270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7cdc10ed60 0x7f7cdc1176d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7cc80041d0 tx=0x7f7cc800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:38.497 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.495+0000 7f7cd97fa700 1 -- 172.21.15.152:0/2665566270 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cc8007cc0 con 0x7f7cdc10ed60 2023-12-06T14:57:38.497 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.495+0000 7f7cd97fa700 1 -- 172.21.15.152:0/2665566270 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7cc800f040 con 0x7f7cdc10ed60 2023-12-06T14:57:38.497 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.495+0000 7f7ce315d700 1 -- 172.21.15.152:0/2665566270 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cdc117c10 con 0x7f7cdc10ed60 2023-12-06T14:57:38.497 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.495+0000 7f7cd97fa700 1 -- 172.21.15.152:0/2665566270 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cc800c990 con 0x7f7cdc10ed60 2023-12-06T14:57:38.497 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.495+0000 7f7ce315d700 1 -- 172.21.15.152:0/2665566270 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cdc118070 con 0x7f7cdc10ed60 2023-12-06T14:57:38.497 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.496+0000 7f7ce315d700 1 -- 172.21.15.152:0/2665566270 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cdc103fa0 con 0x7f7cdc10ed60 2023-12-06T14:57:38.498 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.496+0000 7f7cd97fa700 1 -- 172.21.15.152:0/2665566270 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f7cc800cc00 con 0x7f7cdc10ed60 2023-12-06T14:57:38.498 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.496+0000 7f7cd97fa700 1 --2- 172.21.15.152:0/2665566270 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f7ccc068f60 0x7f7ccc06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:38.498 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.496+0000 7f7cd97fa700 1 -- 172.21.15.152:0/2665566270 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7cc80864a0 con 0x7f7cdc10ed60 2023-12-06T14:57:38.498 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.496+0000 7f7ce0ef9700 1 --2- 172.21.15.152:0/2665566270 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f7ccc068f60 0x7f7ccc06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:38.498 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.497+0000 7f7ce0ef9700 1 --2- 172.21.15.152:0/2665566270 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f7ccc068f60 0x7f7ccc06b410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0009fd0 tx=0x7f7cd0009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:38.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.500+0000 7f7cd97fa700 1 -- 172.21.15.152:0/2665566270 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f7cc804da00 con 0x7f7cdc10ed60 2023-12-06T14:57:38.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:38 smithi190 ceph-mon[121340]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:38.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:38 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/2374398329' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-06T14:57:38.683 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.683+0000 7f7ce315d700 1 -- 172.21.15.152:0/2665566270 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7cdc0fb290 con 0x7f7cdc10ed60 2023-12-06T14:57:38.683 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.683+0000 7f7cd97fa700 1 -- 172.21.15.152:0/2665566270 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7cc8052ce0 con 0x7f7cdc10ed60 2023-12-06T14:57:38.683 INFO:teuthology.orchestra.run.smithi152.stdout:81604378643 2023-12-06T14:57:38.685 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.685+0000 7f7ce315d700 1 -- 172.21.15.152:0/2665566270 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f7ccc068f60 msgr2=0x7f7ccc06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:38.685 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.685+0000 7f7ce315d700 1 --2- 172.21.15.152:0/2665566270 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f7ccc068f60 0x7f7ccc06b410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0009fd0 tx=0x7f7cd0009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:38.685 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.685+0000 7f7ce315d700 1 -- 172.21.15.152:0/2665566270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7cdc10ed60 msgr2=0x7f7cdc1176d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:38.685 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.685+0000 7f7ce315d700 1 --2- 172.21.15.152:0/2665566270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7cdc10ed60 0x7f7cdc1176d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7cc80041d0 tx=0x7f7cc800b040 comp rx=0 tx=0).stop 2023-12-06T14:57:38.686 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.685+0000 7f7ce315d700 1 -- 172.21.15.152:0/2665566270 shutdown_connections 2023-12-06T14:57:38.686 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.685+0000 7f7ce315d700 1 --2- 172.21.15.152:0/2665566270 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f7ccc068f60 0x7f7ccc06b410 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:38.686 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.685+0000 7f7ce315d700 1 --2- 172.21.15.152:0/2665566270 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7cdc0fbb30 0x7f7cdc10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:38.686 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.685+0000 7f7ce315d700 1 --2- 172.21.15.152:0/2665566270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7cdc10ed60 0x7f7cdc1176d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:38.686 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.685+0000 7f7ce315d700 1 -- 172.21.15.152:0/2665566270 >> 172.21.15.152:0/2665566270 conn(0x7f7cdc0f7690 msgr2=0x7f7cdc0f93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:38.686 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.685+0000 7f7ce315d700 1 -- 172.21.15.152:0/2665566270 shutdown_connections 2023-12-06T14:57:38.686 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:38.685+0000 7f7ce315d700 1 -- 172.21.15.152:0/2665566270 wait complete. 2023-12-06T14:57:39.061 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378642 got 81604378643 for osd.2 2023-12-06T14:57:39.061 DEBUG:teuthology.parallel:result is None 2023-12-06T14:57:39.061 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-12-06T14:57:39.062 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph pg dump --format=json 2023-12-06T14:57:39.363 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:57:39.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:39 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/2665566270' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-06T14:57:39.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:39 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/2665566270' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-06T14:57:40.324 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:40 smithi152 ceph-mon[111954]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:40.499 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.499+0000 7f8c0b006700 1 -- 172.21.15.152:0/4155109840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c04102c20 msgr2=0x7f8c04102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:40.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.499+0000 7f8c0b006700 1 --2- 172.21.15.152:0/4155109840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c04102c20 0x7f8c04102ff0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8004940 tx=0x7f8bf8009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:40.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.499+0000 7f8c0b006700 1 -- 172.21.15.152:0/4155109840 shutdown_connections 2023-12-06T14:57:40.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.499+0000 7f8c0b006700 1 --2- 172.21.15.152:0/4155109840 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c04065390 0x7f8c04065800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:40.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.499+0000 7f8c0b006700 1 --2- 172.21.15.152:0/4155109840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c04102c20 0x7f8c04102ff0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:40.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.499+0000 7f8c0b006700 1 -- 172.21.15.152:0/4155109840 >> 172.21.15.152:0/4155109840 conn(0x7f8c040719b0 msgr2=0x7f8c04071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:40.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.499+0000 7f8c0b006700 1 -- 172.21.15.152:0/4155109840 shutdown_connections 2023-12-06T14:57:40.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.499+0000 7f8c0b006700 1 -- 172.21.15.152:0/4155109840 wait complete. 2023-12-06T14:57:40.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.500+0000 7f8c0b006700 1 Processor -- start 2023-12-06T14:57:40.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.500+0000 7f8c0b006700 1 -- start start 2023-12-06T14:57:40.501 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.500+0000 7f8c0b006700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c04065390 0x7f8c040fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:40.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.500+0000 7f8c0b006700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c04102c20 0x7f8c040fc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:40.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.500+0000 7f8c0b006700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c040fc7c0 con 0x7f8c04065390 2023-12-06T14:57:40.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.500+0000 7f8c0b006700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c040fc930 con 0x7f8c04102c20 2023-12-06T14:57:40.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.500+0000 7f8c08da2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c04065390 0x7f8c040fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:40.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.500+0000 7f8c08da2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c04065390 0x7f8c040fbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:55620/0 (socket says 172.21.15.152:55620) 2023-12-06T14:57:40.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.500+0000 7f8c08da2700 1 -- 172.21.15.152:0/4019122611 learned_addr learned my addr 172.21.15.152:0/4019122611 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:57:40.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.500+0000 7f8c03fff700 1 --2- 172.21.15.152:0/4019122611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c04102c20 0x7f8c040fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:40.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.500+0000 7f8c08da2700 1 -- 172.21.15.152:0/4019122611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c04102c20 msgr2=0x7f8c040fc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:40.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.500+0000 7f8c08da2700 1 --2- 172.21.15.152:0/4019122611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c04102c20 0x7f8c040fc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:40.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.500+0000 7f8c08da2700 1 -- 172.21.15.152:0/4019122611 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf8005040 con 0x7f8c04065390 2023-12-06T14:57:40.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.500+0000 7f8c03fff700 1 --2- 172.21.15.152:0/4019122611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c04102c20 0x7f8c040fc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-06T14:57:40.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.500+0000 7f8c08da2700 1 --2- 172.21.15.152:0/4019122611 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c04065390 0x7f8c040fbbf0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8bf800b3b0 tx=0x7f8bf8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:40.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.501+0000 7f8c017fa700 1 -- 172.21.15.152:0/4019122611 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bf800e040 con 0x7f8c04065390 2023-12-06T14:57:40.503 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.501+0000 7f8c017fa700 1 -- 172.21.15.152:0/4019122611 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8bf800bc50 con 0x7f8c04065390 2023-12-06T14:57:40.503 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.501+0000 7f8c0b006700 1 -- 172.21.15.152:0/4019122611 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c041198c0 con 0x7f8c04065390 2023-12-06T14:57:40.503 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.501+0000 7f8c017fa700 1 -- 172.21.15.152:0/4019122611 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bf8013420 con 0x7f8c04065390 2023-12-06T14:57:40.503 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.501+0000 7f8c0b006700 1 -- 172.21.15.152:0/4019122611 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c04119db0 con 0x7f8c04065390 2023-12-06T14:57:40.503 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.502+0000 7f8c0b006700 1 -- 172.21.15.152:0/4019122611 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c040fff40 con 0x7f8c04065390 2023-12-06T14:57:40.504 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.502+0000 7f8c017fa700 1 -- 172.21.15.152:0/4019122611 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f8bf801c430 con 0x7f8c04065390 2023-12-06T14:57:40.504 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.502+0000 7f8c017fa700 1 --2- 172.21.15.152:0/4019122611 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f8bf4068f60 0x7f8bf406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:40.504 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.502+0000 7f8c017fa700 1 -- 172.21.15.152:0/4019122611 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8bf8087860 con 0x7f8c04065390 2023-12-06T14:57:40.504 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.503+0000 7f8c03fff700 1 --2- 172.21.15.152:0/4019122611 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f8bf4068f60 0x7f8bf406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:40.504 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.503+0000 7f8c03fff700 1 --2- 172.21.15.152:0/4019122611 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f8bf4068f60 0x7f8bf406b410 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0006fd0 tx=0x7f8bf0008040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:40.507 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.507+0000 7f8c017fa700 1 -- 172.21.15.152:0/4019122611 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8bf8054120 con 0x7f8c04065390 2023-12-06T14:57:40.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:40 smithi190 ceph-mon[121340]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:40.683 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.683+0000 7f8c0b006700 1 -- 172.21.15.152:0/4019122611 --> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8c040fd330 con 0x7f8bf4068f60 2023-12-06T14:57:40.684 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.684+0000 7f8c017fa700 1 -- 172.21.15.152:0/4019122611 <== mgr.14210 v2:172.21.15.152:6800/3317409709 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+24651 (secure 0 0 0) 0x7f8c040fd330 con 0x7f8bf4068f60 2023-12-06T14:57:40.685 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:57:40.687 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.687+0000 7f8c0b006700 1 -- 172.21.15.152:0/4019122611 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f8bf4068f60 msgr2=0x7f8bf406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:40.687 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.687+0000 7f8c0b006700 1 --2- 172.21.15.152:0/4019122611 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f8bf4068f60 0x7f8bf406b410 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0006fd0 tx=0x7f8bf0008040 comp rx=0 tx=0).stop 2023-12-06T14:57:40.687 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.687+0000 7f8c0b006700 1 -- 172.21.15.152:0/4019122611 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c04065390 msgr2=0x7f8c040fbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:40.687 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.687+0000 7f8c0b006700 1 --2- 172.21.15.152:0/4019122611 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c04065390 0x7f8c040fbbf0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8bf800b3b0 tx=0x7f8bf8009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:40.687 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.687+0000 7f8c0b006700 1 -- 172.21.15.152:0/4019122611 shutdown_connections 2023-12-06T14:57:40.687 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.687+0000 7f8c0b006700 1 --2- 172.21.15.152:0/4019122611 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8c04065390 0x7f8c040fbbf0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:40.687 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.687+0000 7f8c0b006700 1 --2- 172.21.15.152:0/4019122611 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f8bf4068f60 0x7f8bf406b410 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:40.687 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.687+0000 7f8c0b006700 1 --2- 172.21.15.152:0/4019122611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c04102c20 0x7f8c040fc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:40.688 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.687+0000 7f8c0b006700 1 -- 172.21.15.152:0/4019122611 >> 172.21.15.152:0/4019122611 conn(0x7f8c040719b0 msgr2=0x7f8c040faaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:40.688 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.687+0000 7f8c0b006700 1 -- 172.21.15.152:0/4019122611 shutdown_connections 2023-12-06T14:57:40.688 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:40.687+0000 7f8c0b006700 1 -- 172.21.15.152:0/4019122611 wait complete. 2023-12-06T14:57:40.688 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2023-12-06T14:57:41.055 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2023-12-06T14:57:39.005005+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787504,"kb_used_data":3776,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683408,"statfs":{"total":575970213888,"available":574139809792,"internally_reserved":0,"allocated":3866624,"data_stored":2562689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001823"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":188,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-06T14:57:09.308510+0000","last_change":"2023-12-06T14:56:51.017555+0000","last_active":"2023-12-06T14:57:09.308510+0000","last_peered":"2023-12-06T14:57:09.308510+0000","last_clean":"2023-12-06T14:57:09.308510+0000","last_became_active":"2023-12-06T14:56:51.017276+0000","last_became_peered":"2023-12-06T14:56:51.017276+0000","last_unstale":"2023-12-06T14:57:09.308510+0000","last_undegraded":"2023-12-06T14:57:09.308510+0000","last_fullsized":"2023-12-06T14:57:09.308510+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T14:56:15.688017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T14:56:15.688017+0000","last_clean_scrub_stamp":"2023-12-06T14:56:15.688017+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-07T23:54:59.257527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447524,"statfs":{"total":95995035648,"available":95690264576,"internally_reserved":0,"allocated":348160,"data_stored":132041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]}]},{"osd":4,"up_from":32,"seq":137438953484,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447524,"statfs":{"total":95995035648,"available":95690264576,"internally_reserved":0,"allocated":348160,"data_stored":132041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]}]},{"osd":3,"up_from":25,"seq":107374182417,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446944,"statfs":{"total":95995035648,"available":95689670656,"internally_reserved":0,"allocated":942080,"data_stored":722409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 14:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.45200000000000001}]},{"osd":1,"last update":"Wed Dec 6 14:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.40600000000000003}]},{"osd":2,"last update":"Wed Dec 6 14:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.378},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]}]},{"osd":2,"up_from":19,"seq":81604378643,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297624,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447528,"statfs":{"total":95995035648,"available":95690268672,"internally_reserved":0,"allocated":344064,"data_stored":131380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 14:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.37},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.39700000000000002}]},{"osd":1,"last update":"Wed Dec 6 14:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.33900000000000002}]},{"osd":3,"last update":"Wed Dec 6 14:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.64600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705692,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446944,"statfs":{"total":95995035648,"available":95689670656,"internally_reserved":0,"allocated":942080,"data_stored":722409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 14:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.29999999999999999}]},{"osd":2,"last update":"Wed Dec 6 14:57:18 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.36899999999999999}]},{"osd":3,"last update":"Wed Dec 6 14:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.39500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542167,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446944,"statfs":{"total":95995035648,"available":95689670656,"internally_reserved":0,"allocated":942080,"data_stored":722409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 14:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.28199999999999997}]},{"osd":2,"last update":"Wed Dec 6 14:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.312}]},{"osd":3,"last update":"Wed Dec 6 14:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T14:57:41.056 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph pg dump --format=json 2023-12-06T14:57:41.316 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:57:41.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:41 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:57:41.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:41 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:57:42.350 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.349+0000 7f0edb2b6700 1 -- 172.21.15.152:0/458631671 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ed40fbb40 msgr2=0x7f0ed40fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:42.350 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.349+0000 7f0edb2b6700 1 --2- 172.21.15.152:0/458631671 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ed40fbb40 0x7f0ed40fbfb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4004940 tx=0x7f0ec4009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:42.350 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.350+0000 7f0edb2b6700 1 -- 172.21.15.152:0/458631671 shutdown_connections 2023-12-06T14:57:42.350 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.350+0000 7f0edb2b6700 1 --2- 172.21.15.152:0/458631671 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ed40fbb40 0x7f0ed40fbfb0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:42.350 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.350+0000 7f0edb2b6700 1 --2- 172.21.15.152:0/458631671 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ed4101b00 0x7f0ed4101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:42.350 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.350+0000 7f0edb2b6700 1 -- 172.21.15.152:0/458631671 >> 172.21.15.152:0/458631671 conn(0x7f0ed40719b0 msgr2=0x7f0ed4071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:42.350 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.350+0000 7f0edb2b6700 1 -- 172.21.15.152:0/458631671 shutdown_connections 2023-12-06T14:57:42.350 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.350+0000 7f0edb2b6700 1 -- 172.21.15.152:0/458631671 wait complete. 2023-12-06T14:57:42.352 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.350+0000 7f0edb2b6700 1 Processor -- start 2023-12-06T14:57:42.352 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.350+0000 7f0edb2b6700 1 -- start start 2023-12-06T14:57:42.352 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.350+0000 7f0edb2b6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ed40fbb40 0x7f0ed410e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:42.352 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.350+0000 7f0edb2b6700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ed4101b00 0x7f0ed410ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:42.352 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.350+0000 7f0edb2b6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed410f290 con 0x7f0ed40fbb40 2023-12-06T14:57:42.352 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.350+0000 7f0edb2b6700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed410f400 con 0x7f0ed4101b00 2023-12-06T14:57:42.352 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.350+0000 7f0ed9052700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ed40fbb40 0x7f0ed410e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:42.352 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.350+0000 7f0ed9052700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ed40fbb40 0x7f0ed410e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:55644/0 (socket says 172.21.15.152:55644) 2023-12-06T14:57:42.352 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.351+0000 7f0ed9052700 1 -- 172.21.15.152:0/2626679461 learned_addr learned my addr 172.21.15.152:0/2626679461 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:57:42.353 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.351+0000 7f0ed8851700 1 --2- 172.21.15.152:0/2626679461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ed4101b00 0x7f0ed410ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:42.353 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.351+0000 7f0ed9052700 1 -- 172.21.15.152:0/2626679461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ed4101b00 msgr2=0x7f0ed410ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:42.353 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.351+0000 7f0ed9052700 1 --2- 172.21.15.152:0/2626679461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ed4101b00 0x7f0ed410ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:42.353 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.351+0000 7f0ed9052700 1 -- 172.21.15.152:0/2626679461 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec4005040 con 0x7f0ed40fbb40 2023-12-06T14:57:42.353 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.351+0000 7f0ed8851700 1 --2- 172.21.15.152:0/2626679461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ed4101b00 0x7f0ed410ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-06T14:57:42.353 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.351+0000 7f0ed9052700 1 --2- 172.21.15.152:0/2626679461 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ed40fbb40 0x7f0ed410e7a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0ed000c830 tx=0x7f0ed0004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:42.353 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.351+0000 7f0ec9ffb700 1 -- 172.21.15.152:0/2626679461 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ed000a760 con 0x7f0ed40fbb40 2023-12-06T14:57:42.353 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.351+0000 7f0edb2b6700 1 -- 172.21.15.152:0/2626679461 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed4117770 con 0x7f0ed40fbb40 2023-12-06T14:57:42.353 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.351+0000 7f0ec9ffb700 1 -- 172.21.15.152:0/2626679461 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0ed000ad70 con 0x7f0ed40fbb40 2023-12-06T14:57:42.353 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.351+0000 7f0ec9ffb700 1 -- 172.21.15.152:0/2626679461 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ed00113a0 con 0x7f0ed40fbb40 2023-12-06T14:57:42.353 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.351+0000 7f0edb2b6700 1 -- 172.21.15.152:0/2626679461 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed4117c80 con 0x7f0ed40fbb40 2023-12-06T14:57:42.353 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.352+0000 7f0edb2b6700 1 -- 172.21.15.152:0/2626679461 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed4103fb0 con 0x7f0ed40fbb40 2023-12-06T14:57:42.354 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.352+0000 7f0ec9ffb700 1 -- 172.21.15.152:0/2626679461 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f0ed0012400 con 0x7f0ed40fbb40 2023-12-06T14:57:42.354 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.353+0000 7f0ec9ffb700 1 --2- 172.21.15.152:0/2626679461 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f0ec0068f60 0x7f0ec006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:42.354 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.353+0000 7f0ed8851700 1 --2- 172.21.15.152:0/2626679461 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f0ec0068f60 0x7f0ec006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:42.354 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.353+0000 7f0ec9ffb700 1 -- 172.21.15.152:0/2626679461 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0ed0086ae0 con 0x7f0ed40fbb40 2023-12-06T14:57:42.354 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.353+0000 7f0ed8851700 1 --2- 172.21.15.152:0/2626679461 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f0ec0068f60 0x7f0ec006b410 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4009fd0 tx=0x7f0ec4009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:42.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.357+0000 7f0ec9ffb700 1 -- 172.21.15.152:0/2626679461 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0ed00532f0 con 0x7f0ed40fbb40 2023-12-06T14:57:42.536 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.536+0000 7f0edb2b6700 1 -- 172.21.15.152:0/2626679461 --> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0ed4065b70 con 0x7f0ec0068f60 2023-12-06T14:57:42.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.537+0000 7f0ec9ffb700 1 -- 172.21.15.152:0/2626679461 <== mgr.14210 v2:172.21.15.152:6800/3317409709 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+24682 (secure 0 0 0) 0x7f0ed4065b70 con 0x7f0ec0068f60 2023-12-06T14:57:42.537 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:57:42.539 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.539+0000 7f0edb2b6700 1 -- 172.21.15.152:0/2626679461 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f0ec0068f60 msgr2=0x7f0ec006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:42.539 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.539+0000 7f0edb2b6700 1 --2- 172.21.15.152:0/2626679461 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f0ec0068f60 0x7f0ec006b410 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4009fd0 tx=0x7f0ec4009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:42.539 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.539+0000 7f0edb2b6700 1 -- 172.21.15.152:0/2626679461 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ed40fbb40 msgr2=0x7f0ed410e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:42.540 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.539+0000 7f0edb2b6700 1 --2- 172.21.15.152:0/2626679461 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ed40fbb40 0x7f0ed410e7a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0ed000c830 tx=0x7f0ed0004470 comp rx=0 tx=0).stop 2023-12-06T14:57:42.540 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.539+0000 7f0edb2b6700 1 -- 172.21.15.152:0/2626679461 shutdown_connections 2023-12-06T14:57:42.540 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.539+0000 7f0edb2b6700 1 --2- 172.21.15.152:0/2626679461 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ed40fbb40 0x7f0ed410e7a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:42.540 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.539+0000 7f0edb2b6700 1 --2- 172.21.15.152:0/2626679461 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f0ec0068f60 0x7f0ec006b410 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:42.540 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.539+0000 7f0edb2b6700 1 --2- 172.21.15.152:0/2626679461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ed4101b00 0x7f0ed410ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:42.540 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.539+0000 7f0edb2b6700 1 -- 172.21.15.152:0/2626679461 >> 172.21.15.152:0/2626679461 conn(0x7f0ed40719b0 msgr2=0x7f0ed40fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:42.540 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.539+0000 7f0edb2b6700 1 -- 172.21.15.152:0/2626679461 shutdown_connections 2023-12-06T14:57:42.540 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:42.539+0000 7f0edb2b6700 1 -- 172.21.15.152:0/2626679461 wait complete. 2023-12-06T14:57:42.541 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2023-12-06T14:57:42.559 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:42 smithi152 ceph-mon[111954]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-06T14:57:42.559 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:42 smithi152 ceph-mon[111954]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:42.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:42 smithi190 ceph-mon[121340]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-06T14:57:42.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:42 smithi190 ceph-mon[121340]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:42.919 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":116,"stamp":"2023-12-06T14:57:41.005294+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787504,"kb_used_data":3776,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683408,"statfs":{"total":575970213888,"available":574139809792,"internally_reserved":0,"allocated":3866624,"data_stored":2562689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001736"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":188,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-06T14:57:09.308510+0000","last_change":"2023-12-06T14:56:51.017555+0000","last_active":"2023-12-06T14:57:09.308510+0000","last_peered":"2023-12-06T14:57:09.308510+0000","last_clean":"2023-12-06T14:57:09.308510+0000","last_became_active":"2023-12-06T14:56:51.017276+0000","last_became_peered":"2023-12-06T14:56:51.017276+0000","last_unstale":"2023-12-06T14:57:09.308510+0000","last_undegraded":"2023-12-06T14:57:09.308510+0000","last_fullsized":"2023-12-06T14:57:09.308510+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T14:56:15.688017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T14:56:15.688017+0000","last_clean_scrub_stamp":"2023-12-06T14:56:15.688017+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-07T23:54:59.257527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447524,"statfs":{"total":95995035648,"available":95690264576,"internally_reserved":0,"allocated":348160,"data_stored":132041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]}]},{"osd":4,"up_from":32,"seq":137438953484,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447524,"statfs":{"total":95995035648,"available":95690264576,"internally_reserved":0,"allocated":348160,"data_stored":132041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]}]},{"osd":3,"up_from":25,"seq":107374182417,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446944,"statfs":{"total":95995035648,"available":95689670656,"internally_reserved":0,"allocated":942080,"data_stored":722409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 14:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.45200000000000001}]},{"osd":1,"last update":"Wed Dec 6 14:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.40600000000000003}]},{"osd":2,"last update":"Wed Dec 6 14:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.378},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]}]},{"osd":2,"up_from":19,"seq":81604378644,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297624,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447528,"statfs":{"total":95995035648,"available":95690268672,"internally_reserved":0,"allocated":344064,"data_stored":131380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 14:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.27100000000000002}]},{"osd":1,"last update":"Wed Dec 6 14:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.316},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.33700000000000002}]},{"osd":3,"last update":"Wed Dec 6 14:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.49399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705693,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446944,"statfs":{"total":95995035648,"available":95689670656,"internally_reserved":0,"allocated":942080,"data_stored":722409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 14:56:56 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.28799999999999998}]},{"osd":2,"last update":"Wed Dec 6 14:57:18 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.30199999999999999}]},{"osd":3,"last update":"Wed Dec 6 14:57:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.66300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]}]},{"osd":1,"up_from":14,"seq":60129542168,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446944,"statfs":{"total":95995035648,"available":95689670656,"internally_reserved":0,"allocated":942080,"data_stored":722409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 14:56:58 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.29199999999999998}]},{"osd":2,"last update":"Wed Dec 6 14:57:17 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.32000000000000001}]},{"osd":3,"last update":"Wed Dec 6 14:57:34 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T14:57:42.920 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-12-06T14:57:42.920 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-06T14:57:42.920 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-12-06T14:57:42.920 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph health --format=json 2023-12-06T14:57:43.186 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:57:43.471 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:43 smithi152 ceph-mon[111954]: from='client.14428 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-06T14:57:43.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:43 smithi190 ceph-mon[121340]: from='client.14428 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-06T14:57:44.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.162+0000 7eff6c9fa700 1 -- 172.21.15.152:0/2209764908 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7eff68102bf0 msgr2=0x7eff68102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:44.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.162+0000 7eff6c9fa700 1 --2- 172.21.15.152:0/2209764908 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7eff68102bf0 0x7eff68102fc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7eff5c004940 tx=0x7eff5c009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:44.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.162+0000 7eff6c9fa700 1 -- 172.21.15.152:0/2209764908 shutdown_connections 2023-12-06T14:57:44.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.162+0000 7eff6c9fa700 1 --2- 172.21.15.152:0/2209764908 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff68103590 0x7eff680fcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:44.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.162+0000 7eff6c9fa700 1 --2- 172.21.15.152:0/2209764908 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7eff68102bf0 0x7eff68102fc0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:44.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.162+0000 7eff6c9fa700 1 -- 172.21.15.152:0/2209764908 >> 172.21.15.152:0/2209764908 conn(0x7eff680f87a0 msgr2=0x7eff680fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:44.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.162+0000 7eff6c9fa700 1 -- 172.21.15.152:0/2209764908 shutdown_connections 2023-12-06T14:57:44.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.162+0000 7eff6c9fa700 1 -- 172.21.15.152:0/2209764908 wait complete. 2023-12-06T14:57:44.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.163+0000 7eff6c9fa700 1 Processor -- start 2023-12-06T14:57:44.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.163+0000 7eff6c9fa700 1 -- start start 2023-12-06T14:57:44.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.163+0000 7eff6c9fa700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff68102bf0 0x7eff6806ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:44.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.163+0000 7eff6c9fa700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7eff68103590 0x7eff68070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:44.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.163+0000 7eff6c9fa700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff68070a80 con 0x7eff68103590 2023-12-06T14:57:44.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.163+0000 7eff6c9fa700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff68070bf0 con 0x7eff68102bf0 2023-12-06T14:57:44.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.163+0000 7eff65d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7eff68103590 0x7eff68070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:44.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.163+0000 7eff65d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7eff68103590 0x7eff68070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:55668/0 (socket says 172.21.15.152:55668) 2023-12-06T14:57:44.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.163+0000 7eff65d9b700 1 -- 172.21.15.152:0/644206022 learned_addr learned my addr 172.21.15.152:0/644206022 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:57:44.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.163+0000 7eff6659c700 1 --2- 172.21.15.152:0/644206022 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff68102bf0 0x7eff6806ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:44.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.163+0000 7eff65d9b700 1 -- 172.21.15.152:0/644206022 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff68102bf0 msgr2=0x7eff6806ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:44.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.163+0000 7eff65d9b700 1 --2- 172.21.15.152:0/644206022 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff68102bf0 0x7eff6806ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:44.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.163+0000 7eff65d9b700 1 -- 172.21.15.152:0/644206022 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5c005040 con 0x7eff68103590 2023-12-06T14:57:44.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.163+0000 7eff65d9b700 1 --2- 172.21.15.152:0/644206022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7eff68103590 0x7eff68070480 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7eff58002a50 tx=0x7eff58004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:44.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.164+0000 7eff56ffd700 1 -- 172.21.15.152:0/644206022 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff58007cc0 con 0x7eff68103590 2023-12-06T14:57:44.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.164+0000 7eff56ffd700 1 -- 172.21.15.152:0/644206022 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7eff5800f040 con 0x7eff68103590 2023-12-06T14:57:44.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.164+0000 7eff6c9fa700 1 -- 172.21.15.152:0/644206022 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff68119890 con 0x7eff68103590 2023-12-06T14:57:44.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.164+0000 7eff56ffd700 1 -- 172.21.15.152:0/644206022 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff5800d920 con 0x7eff68103590 2023-12-06T14:57:44.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.164+0000 7eff6c9fa700 1 -- 172.21.15.152:0/644206022 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff68119d70 con 0x7eff68103590 2023-12-06T14:57:44.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.164+0000 7eff6c9fa700 1 -- 172.21.15.152:0/644206022 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff680fff00 con 0x7eff68103590 2023-12-06T14:57:44.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.165+0000 7eff56ffd700 1 -- 172.21.15.152:0/644206022 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7eff58009680 con 0x7eff68103590 2023-12-06T14:57:44.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.165+0000 7eff56ffd700 1 --2- 172.21.15.152:0/644206022 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7eff50068f60 0x7eff5006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:44.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.165+0000 7eff56ffd700 1 -- 172.21.15.152:0/644206022 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7eff58086800 con 0x7eff68103590 2023-12-06T14:57:44.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.165+0000 7eff6659c700 1 --2- 172.21.15.152:0/644206022 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7eff50068f60 0x7eff5006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:44.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.166+0000 7eff6659c700 1 --2- 172.21.15.152:0/644206022 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7eff50068f60 0x7eff5006b410 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7eff5c004f90 tx=0x7eff5c009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:44.169 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.170+0000 7eff56ffd700 1 -- 172.21.15.152:0/644206022 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7eff58052f90 con 0x7eff68103590 2023-12-06T14:57:44.395 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.395+0000 7eff6c9fa700 1 -- 172.21.15.152:0/644206022 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7eff680fc3a0 con 0x7eff68103590 2023-12-06T14:57:44.395 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.395+0000 7eff56ffd700 1 -- 172.21.15.152:0/644206022 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7eff580565b0 con 0x7eff68103590 2023-12-06T14:57:44.395 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:57:44.395 INFO:teuthology.orchestra.run.smithi152.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-06T14:57:44.397 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.397+0000 7eff6c9fa700 1 -- 172.21.15.152:0/644206022 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7eff50068f60 msgr2=0x7eff5006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:44.397 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.397+0000 7eff6c9fa700 1 --2- 172.21.15.152:0/644206022 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7eff50068f60 0x7eff5006b410 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7eff5c004f90 tx=0x7eff5c009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:44.397 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.397+0000 7eff6c9fa700 1 -- 172.21.15.152:0/644206022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7eff68103590 msgr2=0x7eff68070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:44.397 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.397+0000 7eff6c9fa700 1 --2- 172.21.15.152:0/644206022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7eff68103590 0x7eff68070480 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7eff58002a50 tx=0x7eff58004600 comp rx=0 tx=0).stop 2023-12-06T14:57:44.397 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.397+0000 7eff6c9fa700 1 -- 172.21.15.152:0/644206022 shutdown_connections 2023-12-06T14:57:44.397 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.397+0000 7eff6c9fa700 1 --2- 172.21.15.152:0/644206022 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7eff50068f60 0x7eff5006b410 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:44.397 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.397+0000 7eff6c9fa700 1 --2- 172.21.15.152:0/644206022 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff68102bf0 0x7eff6806ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:44.397 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.397+0000 7eff6c9fa700 1 --2- 172.21.15.152:0/644206022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7eff68103590 0x7eff68070480 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:44.397 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.397+0000 7eff6c9fa700 1 -- 172.21.15.152:0/644206022 >> 172.21.15.152:0/644206022 conn(0x7eff680f87a0 msgr2=0x7eff680fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:44.397 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.397+0000 7eff6c9fa700 1 -- 172.21.15.152:0/644206022 shutdown_connections 2023-12-06T14:57:44.398 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:44.397+0000 7eff6c9fa700 1 -- 172.21.15.152:0/644206022 wait complete. 2023-12-06T14:57:44.548 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:44 smithi152 ceph-mon[111954]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:44.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:44 smithi190 ceph-mon[121340]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:44.760 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-12-06T14:57:44.760 INFO:tasks.cephadm:Setup complete, yielding 2023-12-06T14:57:44.760 INFO:teuthology.run_tasks:Running task print... 2023-12-06T14:57:44.770 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2023-12-06T14:57:44.771 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-06T14:57:44.783 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi152.front.sepia.ceph.com 2023-12-06T14:57:44.783 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2023-12-06T14:57:45.046 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:57:45.556 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:45 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/644206022' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-06T14:57:45.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:45 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/644206022' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-06T14:57:46.080 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.079+0000 7fe276aae700 1 -- 172.21.15.152:0/1449630303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe270066090 msgr2=0x7fe2700ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:46.080 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.079+0000 7fe276aae700 1 --2- 172.21.15.152:0/1449630303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe270066090 0x7fe2700ff7a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe264004940 tx=0x7fe264009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:46.080 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.079+0000 7fe276aae700 1 -- 172.21.15.152:0/1449630303 shutdown_connections 2023-12-06T14:57:46.080 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.079+0000 7fe276aae700 1 --2- 172.21.15.152:0/1449630303 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2700ffd70 0x7fe2701021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:46.080 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.079+0000 7fe276aae700 1 --2- 172.21.15.152:0/1449630303 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe270066090 0x7fe2700ff7a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:46.080 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.079+0000 7fe276aae700 1 -- 172.21.15.152:0/1449630303 >> 172.21.15.152:0/1449630303 conn(0x7fe2700f7190 msgr2=0x7fe2700f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:46.080 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.079+0000 7fe276aae700 1 -- 172.21.15.152:0/1449630303 shutdown_connections 2023-12-06T14:57:46.080 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.079+0000 7fe276aae700 1 -- 172.21.15.152:0/1449630303 wait complete. 2023-12-06T14:57:46.080 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.080+0000 7fe276aae700 1 Processor -- start 2023-12-06T14:57:46.081 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.080+0000 7fe276aae700 1 -- start start 2023-12-06T14:57:46.082 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.080+0000 7fe276aae700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe270066090 0x7fe27010d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:46.082 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.080+0000 7fe276aae700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2700ffd70 0x7fe27010dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:46.082 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.080+0000 7fe276aae700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27010e0c0 con 0x7fe270066090 2023-12-06T14:57:46.082 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.080+0000 7fe276aae700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27010e960 con 0x7fe2700ffd70 2023-12-06T14:57:46.083 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.080+0000 7fe27484a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe270066090 0x7fe27010d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:46.083 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.080+0000 7fe27484a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe270066090 0x7fe27010d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:55692/0 (socket says 172.21.15.152:55692) 2023-12-06T14:57:46.083 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.080+0000 7fe27484a700 1 -- 172.21.15.152:0/3020206672 learned_addr learned my addr 172.21.15.152:0/3020206672 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:57:46.083 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.080+0000 7fe26ffff700 1 --2- 172.21.15.152:0/3020206672 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2700ffd70 0x7fe27010dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:46.083 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.080+0000 7fe27484a700 1 -- 172.21.15.152:0/3020206672 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2700ffd70 msgr2=0x7fe27010dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:46.083 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.080+0000 7fe27484a700 1 --2- 172.21.15.152:0/3020206672 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2700ffd70 0x7fe27010dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:46.083 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.080+0000 7fe27484a700 1 -- 172.21.15.152:0/3020206672 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe264005040 con 0x7fe270066090 2023-12-06T14:57:46.083 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.080+0000 7fe26ffff700 1 --2- 172.21.15.152:0/3020206672 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2700ffd70 0x7fe27010dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-06T14:57:46.083 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.080+0000 7fe27484a700 1 --2- 172.21.15.152:0/3020206672 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe270066090 0x7fe27010d580 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe264009360 tx=0x7fe264009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:46.083 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.081+0000 7fe26d7fa700 1 -- 172.21.15.152:0/3020206672 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe26400e040 con 0x7fe270066090 2023-12-06T14:57:46.083 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.081+0000 7fe26d7fa700 1 -- 172.21.15.152:0/3020206672 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe26400bcd0 con 0x7fe270066090 2023-12-06T14:57:46.083 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.081+0000 7fe276aae700 1 -- 172.21.15.152:0/3020206672 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe27010ebe0 con 0x7fe270066090 2023-12-06T14:57:46.083 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.081+0000 7fe26d7fa700 1 -- 172.21.15.152:0/3020206672 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe26401c630 con 0x7fe270066090 2023-12-06T14:57:46.083 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.081+0000 7fe276aae700 1 -- 172.21.15.152:0/3020206672 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe27010f120 con 0x7fe270066090 2023-12-06T14:57:46.083 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.082+0000 7fe276aae700 1 -- 172.21.15.152:0/3020206672 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2701075e0 con 0x7fe270066090 2023-12-06T14:57:46.083 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.082+0000 7fe26d7fa700 1 -- 172.21.15.152:0/3020206672 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fe264013960 con 0x7fe270066090 2023-12-06T14:57:46.084 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.082+0000 7fe26d7fa700 1 --2- 172.21.15.152:0/3020206672 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fe260068f60 0x7fe26006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:46.084 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.082+0000 7fe26d7fa700 1 -- 172.21.15.152:0/3020206672 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe264087f30 con 0x7fe270066090 2023-12-06T14:57:46.084 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.082+0000 7fe26ffff700 1 --2- 172.21.15.152:0/3020206672 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fe260068f60 0x7fe26006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:46.084 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.083+0000 7fe26ffff700 1 --2- 172.21.15.152:0/3020206672 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fe260068f60 0x7fe26006b410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe25c0041d0 tx=0x7fe25c009040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:46.086 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.087+0000 7fe26d7fa700 1 -- 172.21.15.152:0/3020206672 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe2640b9a00 con 0x7fe270066090 2023-12-06T14:57:46.275 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.274+0000 7fe276aae700 1 -- 172.21.15.152:0/3020206672 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7fe27004bb80 con 0x7fe270066090 2023-12-06T14:57:46.278 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.279+0000 7fe26d7fa700 1 -- 172.21.15.152:0/3020206672 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7fe2640581d0 con 0x7fe270066090 2023-12-06T14:57:46.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.281+0000 7fe276aae700 1 -- 172.21.15.152:0/3020206672 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fe260068f60 msgr2=0x7fe26006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:46.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.281+0000 7fe276aae700 1 --2- 172.21.15.152:0/3020206672 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fe260068f60 0x7fe26006b410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe25c0041d0 tx=0x7fe25c009040 comp rx=0 tx=0).stop 2023-12-06T14:57:46.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.281+0000 7fe276aae700 1 -- 172.21.15.152:0/3020206672 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe270066090 msgr2=0x7fe27010d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:46.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.281+0000 7fe276aae700 1 --2- 172.21.15.152:0/3020206672 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe270066090 0x7fe27010d580 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe264009360 tx=0x7fe264009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:46.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.281+0000 7fe276aae700 1 -- 172.21.15.152:0/3020206672 shutdown_connections 2023-12-06T14:57:46.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.281+0000 7fe276aae700 1 --2- 172.21.15.152:0/3020206672 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe270066090 0x7fe27010d580 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:46.282 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.281+0000 7fe276aae700 1 --2- 172.21.15.152:0/3020206672 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fe260068f60 0x7fe26006b410 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:46.282 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.281+0000 7fe276aae700 1 --2- 172.21.15.152:0/3020206672 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2700ffd70 0x7fe27010dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:46.282 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.281+0000 7fe276aae700 1 -- 172.21.15.152:0/3020206672 >> 172.21.15.152:0/3020206672 conn(0x7fe2700f7190 msgr2=0x7fe2700f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:46.282 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.281+0000 7fe276aae700 1 -- 172.21.15.152:0/3020206672 shutdown_connections 2023-12-06T14:57:46.282 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:46.281+0000 7fe276aae700 1 -- 172.21.15.152:0/3020206672 wait complete. 2023-12-06T14:57:46.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:46 smithi190 ceph-mon[121340]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:46.604 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:46 smithi152 ceph-mon[111954]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:46.643 INFO:teuthology.run_tasks:Running task print... 2023-12-06T14:57:46.652 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2023-12-06T14:57:46.652 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-06T14:57:46.676 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi152.front.sepia.ceph.com 2023-12-06T14:57:46.677 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- bash -c 'ceph orch status' 2023-12-06T14:57:46.937 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:57:47.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:47 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/3020206672' entity='client.admin' 2023-12-06T14:57:47.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:47 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:57:47.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:47 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:57:47.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:47 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:57:47.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:47 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:57:47.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:47 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/3020206672' entity='client.admin' 2023-12-06T14:57:47.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:47 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:57:47.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:47 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:57:47.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:47 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:57:47.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:47 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:57:47.968 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:47.966+0000 7ff666508700 1 -- 172.21.15.152:0/2916055103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6600fbaf0 msgr2=0x7ff6600fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:47.968 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:47.966+0000 7ff666508700 1 --2- 172.21.15.152:0/2916055103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6600fbaf0 0x7ff6600fbf00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff650004940 tx=0x7ff650009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:47.969 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:47.966+0000 7ff666508700 1 -- 172.21.15.152:0/2916055103 shutdown_connections 2023-12-06T14:57:47.969 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:47.966+0000 7ff666508700 1 --2- 172.21.15.152:0/2916055103 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6600fcd00 0x7ff6600fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:47.969 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:47.966+0000 7ff666508700 1 --2- 172.21.15.152:0/2916055103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6600fbaf0 0x7ff6600fbf00 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:47.969 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:47.966+0000 7ff666508700 1 -- 172.21.15.152:0/2916055103 >> 172.21.15.152:0/2916055103 conn(0x7ff6600f71b0 msgr2=0x7ff6600f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:47.969 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:47.966+0000 7ff666508700 1 -- 172.21.15.152:0/2916055103 shutdown_connections 2023-12-06T14:57:47.969 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:47.967+0000 7ff666508700 1 -- 172.21.15.152:0/2916055103 wait complete. 2023-12-06T14:57:47.969 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:47.967+0000 7ff666508700 1 Processor -- start 2023-12-06T14:57:47.969 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:47.967+0000 7ff666508700 1 -- start start 2023-12-06T14:57:47.969 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:47.967+0000 7ff666508700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6600fbaf0 0x7ff660110280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:47.969 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:47.967+0000 7ff666508700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6600fcd00 0x7ff6601127d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:47.969 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:47.967+0000 7ff666508700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6600669a0 con 0x7ff6600fbaf0 2023-12-06T14:57:47.969 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:47.967+0000 7ff666508700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff660066ae0 con 0x7ff6600fcd00 2023-12-06T14:57:47.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:47.968+0000 7ff65ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6600fbaf0 0x7ff660110280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:47.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:47.968+0000 7ff65ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6600fbaf0 0x7ff660110280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:55702/0 (socket says 172.21.15.152:55702) 2023-12-06T14:57:47.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:47.968+0000 7ff65ffff700 1 -- 172.21.15.152:0/754944768 learned_addr learned my addr 172.21.15.152:0/754944768 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:57:47.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:47.968+0000 7ff65f7fe700 1 --2- 172.21.15.152:0/754944768 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6600fcd00 0x7ff6601127d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:47.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:47.968+0000 7ff65ffff700 1 -- 172.21.15.152:0/754944768 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6600fcd00 msgr2=0x7ff6601127d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:47.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:47.968+0000 7ff65ffff700 1 --2- 172.21.15.152:0/754944768 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6600fcd00 0x7ff6601127d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:47.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:47.968+0000 7ff65ffff700 1 -- 172.21.15.152:0/754944768 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff650005040 con 0x7ff6600fbaf0 2023-12-06T14:57:47.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:47.968+0000 7ff65f7fe700 1 --2- 172.21.15.152:0/754944768 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6600fcd00 0x7ff6601127d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-06T14:57:47.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:47.968+0000 7ff65ffff700 1 --2- 172.21.15.152:0/754944768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6600fbaf0 0x7ff660110280 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff650004f90 tx=0x7ff650009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:47.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:47.968+0000 7ff65cff9700 1 -- 172.21.15.152:0/754944768 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff65000e040 con 0x7ff6600fbaf0 2023-12-06T14:57:47.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:47.968+0000 7ff65cff9700 1 -- 172.21.15.152:0/754944768 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff65000bcd0 con 0x7ff6600fbaf0 2023-12-06T14:57:47.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:47.968+0000 7ff666508700 1 -- 172.21.15.152:0/754944768 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff660112dd0 con 0x7ff6600fbaf0 2023-12-06T14:57:47.971 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:47.968+0000 7ff65cff9700 1 -- 172.21.15.152:0/754944768 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff65001c630 con 0x7ff6600fbaf0 2023-12-06T14:57:47.971 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:47.968+0000 7ff666508700 1 -- 172.21.15.152:0/754944768 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff660113230 con 0x7ff6600fbaf0 2023-12-06T14:57:47.971 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:47.969+0000 7ff666508700 1 -- 172.21.15.152:0/754944768 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6601064d0 con 0x7ff6600fbaf0 2023-12-06T14:57:47.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:47.969+0000 7ff65cff9700 1 -- 172.21.15.152:0/754944768 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7ff650013960 con 0x7ff6600fbaf0 2023-12-06T14:57:47.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:47.970+0000 7ff65cff9700 1 --2- 172.21.15.152:0/754944768 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7ff648068f60 0x7ff64806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:47.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:47.970+0000 7ff65f7fe700 1 --2- 172.21.15.152:0/754944768 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7ff648068f60 0x7ff64806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:47.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:47.970+0000 7ff65cff9700 1 -- 172.21.15.152:0/754944768 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff650087eb0 con 0x7ff6600fbaf0 2023-12-06T14:57:47.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:47.970+0000 7ff65f7fe700 1 --2- 172.21.15.152:0/754944768 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7ff648068f60 0x7ff64806b410 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff654009fd0 tx=0x7ff65400b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:47.974 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:47.974+0000 7ff65cff9700 1 -- 172.21.15.152:0/754944768 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff6500546e0 con 0x7ff6600fbaf0 2023-12-06T14:57:48.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:48.174+0000 7ff666508700 1 -- 172.21.15.152:0/754944768 --> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff66002b310 con 0x7ff648068f60 2023-12-06T14:57:48.175 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:48.175+0000 7ff65cff9700 1 -- 172.21.15.152:0/754944768 <== mgr.14210 v2:172.21.15.152:6800/3317409709 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7ff66002b310 con 0x7ff648068f60 2023-12-06T14:57:48.175 INFO:teuthology.orchestra.run.smithi152.stdout:Backend: cephadm 2023-12-06T14:57:48.175 INFO:teuthology.orchestra.run.smithi152.stdout:Available: Yes 2023-12-06T14:57:48.175 INFO:teuthology.orchestra.run.smithi152.stdout:Paused: No 2023-12-06T14:57:48.177 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:48.177+0000 7ff666508700 1 -- 172.21.15.152:0/754944768 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7ff648068f60 msgr2=0x7ff64806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:48.177 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:48.177+0000 7ff666508700 1 --2- 172.21.15.152:0/754944768 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7ff648068f60 0x7ff64806b410 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff654009fd0 tx=0x7ff65400b040 comp rx=0 tx=0).stop 2023-12-06T14:57:48.178 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:48.177+0000 7ff666508700 1 -- 172.21.15.152:0/754944768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6600fbaf0 msgr2=0x7ff660110280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:48.178 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:48.177+0000 7ff666508700 1 --2- 172.21.15.152:0/754944768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6600fbaf0 0x7ff660110280 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff650004f90 tx=0x7ff650009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:48.178 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:48.177+0000 7ff666508700 1 -- 172.21.15.152:0/754944768 shutdown_connections 2023-12-06T14:57:48.178 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:48.177+0000 7ff666508700 1 --2- 172.21.15.152:0/754944768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6600fbaf0 0x7ff660110280 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:48.178 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:48.177+0000 7ff666508700 1 --2- 172.21.15.152:0/754944768 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7ff648068f60 0x7ff64806b410 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:48.178 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:48.177+0000 7ff666508700 1 --2- 172.21.15.152:0/754944768 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6600fcd00 0x7ff6601127d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:48.178 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:48.177+0000 7ff666508700 1 -- 172.21.15.152:0/754944768 >> 172.21.15.152:0/754944768 conn(0x7ff6600f71b0 msgr2=0x7ff6600f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:48.178 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:48.177+0000 7ff666508700 1 -- 172.21.15.152:0/754944768 shutdown_connections 2023-12-06T14:57:48.178 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:48.177+0000 7ff666508700 1 -- 172.21.15.152:0/754944768 wait complete. 2023-12-06T14:57:48.422 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:48 smithi152 ceph-mon[111954]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:48.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:48 smithi190 ceph-mon[121340]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:48.584 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- bash -c 'ceph orch ps' 2023-12-06T14:57:48.845 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:57:49.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:49 smithi190 ceph-mon[121340]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:57:49.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:49 smithi152 ceph-mon[111954]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:57:49.806 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:49.804+0000 7f0b638d9700 1 -- 172.21.15.152:0/251462890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b5c0fafb0 msgr2=0x7f0b5c0fb3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:49.806 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:49.804+0000 7f0b638d9700 1 --2- 172.21.15.152:0/251462890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b5c0fafb0 0x7f0b5c0fb3c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c004940 tx=0x7f0b4c009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:49.806 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:49.804+0000 7f0b638d9700 1 -- 172.21.15.152:0/251462890 shutdown_connections 2023-12-06T14:57:49.806 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:49.804+0000 7f0b638d9700 1 --2- 172.21.15.152:0/251462890 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b5c0fb990 0x7f0b5c102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:49.806 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:49.804+0000 7f0b638d9700 1 --2- 172.21.15.152:0/251462890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b5c0fafb0 0x7f0b5c0fb3c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:49.806 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:49.804+0000 7f0b638d9700 1 -- 172.21.15.152:0/251462890 >> 172.21.15.152:0/251462890 conn(0x7f0b5c0f6950 msgr2=0x7f0b5c0f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:49.806 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:49.804+0000 7f0b638d9700 1 -- 172.21.15.152:0/251462890 shutdown_connections 2023-12-06T14:57:49.806 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:49.804+0000 7f0b638d9700 1 -- 172.21.15.152:0/251462890 wait complete. 2023-12-06T14:57:49.806 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:49.805+0000 7f0b638d9700 1 Processor -- start 2023-12-06T14:57:49.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:49.805+0000 7f0b638d9700 1 -- start start 2023-12-06T14:57:49.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:49.805+0000 7f0b638d9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b5c0fafb0 0x7f0b5c10f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:49.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:49.805+0000 7f0b638d9700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b5c10fd60 0x7f0b5c110c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:49.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:49.805+0000 7f0b638d9700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c110220 con 0x7f0b5c0fafb0 2023-12-06T14:57:49.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:49.805+0000 7f0b638d9700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c110360 con 0x7f0b5c10fd60 2023-12-06T14:57:49.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:49.805+0000 7f0b61675700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b5c0fafb0 0x7f0b5c10f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:49.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:49.805+0000 7f0b61675700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b5c0fafb0 0x7f0b5c10f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41560/0 (socket says 172.21.15.152:41560) 2023-12-06T14:57:49.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:49.805+0000 7f0b61675700 1 -- 172.21.15.152:0/3140675460 learned_addr learned my addr 172.21.15.152:0/3140675460 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:57:49.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:49.805+0000 7f0b61675700 1 -- 172.21.15.152:0/3140675460 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b5c10fd60 msgr2=0x7f0b5c110c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:49.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:49.805+0000 7f0b60e74700 1 --2- 172.21.15.152:0/3140675460 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b5c10fd60 0x7f0b5c110c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:49.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:49.805+0000 7f0b61675700 1 --2- 172.21.15.152:0/3140675460 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b5c10fd60 0x7f0b5c110c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:49.807 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:49.805+0000 7f0b61675700 1 -- 172.21.15.152:0/3140675460 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b4c005040 con 0x7f0b5c0fafb0 2023-12-06T14:57:49.808 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:49.805+0000 7f0b61675700 1 --2- 172.21.15.152:0/3140675460 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b5c0fafb0 0x7f0b5c10f820 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c009360 tx=0x7f0b4c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:49.808 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:49.806+0000 7f0b51ffb700 1 -- 172.21.15.152:0/3140675460 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b4c00e040 con 0x7f0b5c0fafb0 2023-12-06T14:57:49.808 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:49.806+0000 7f0b51ffb700 1 -- 172.21.15.152:0/3140675460 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0b4c00bc50 con 0x7f0b5c0fafb0 2023-12-06T14:57:49.808 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:49.806+0000 7f0b638d9700 1 -- 172.21.15.152:0/3140675460 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b5c111200 con 0x7f0b5c0fafb0 2023-12-06T14:57:49.808 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:49.806+0000 7f0b51ffb700 1 -- 172.21.15.152:0/3140675460 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b4c01c630 con 0x7f0b5c0fafb0 2023-12-06T14:57:49.808 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:49.806+0000 7f0b638d9700 1 -- 172.21.15.152:0/3140675460 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b5c111710 con 0x7f0b5c0fafb0 2023-12-06T14:57:49.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:49.807+0000 7f0b638d9700 1 -- 172.21.15.152:0/3140675460 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b5c04bb80 con 0x7f0b5c0fafb0 2023-12-06T14:57:49.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:49.807+0000 7f0b51ffb700 1 -- 172.21.15.152:0/3140675460 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f0b4c013420 con 0x7f0b5c0fafb0 2023-12-06T14:57:49.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:49.807+0000 7f0b51ffb700 1 --2- 172.21.15.152:0/3140675460 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f0b48068f70 0x7f0b4806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:49.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:49.808+0000 7f0b51ffb700 1 -- 172.21.15.152:0/3140675460 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0b4c087e60 con 0x7f0b5c0fafb0 2023-12-06T14:57:49.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:49.808+0000 7f0b60e74700 1 --2- 172.21.15.152:0/3140675460 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f0b48068f70 0x7f0b4806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:49.809 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:49.808+0000 7f0b60e74700 1 --2- 172.21.15.152:0/3140675460 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f0b48068f70 0x7f0b4806b420 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0b580041d0 tx=0x7f0b58009040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:49.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:49.812+0000 7f0b51ffb700 1 -- 172.21.15.152:0/3140675460 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0b4c0580e0 con 0x7f0b5c0fafb0 2023-12-06T14:57:50.002 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:50.002+0000 7f0b638d9700 1 -- 172.21.15.152:0/3140675460 --> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0b5c0fba80 con 0x7f0b48068f70 2023-12-06T14:57:50.010 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:50.010+0000 7f0b51ffb700 1 -- 172.21.15.152:0/3140675460 <== mgr.14210 v2:172.21.15.152:6800/3317409709 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2718 (secure 0 0 0) 0x7f0b5c0fba80 con 0x7f0b48068f70 2023-12-06T14:57:50.010 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-06T14:57:50.010 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 running (2m) 98s ago 3m 26.3M - 0.25.0 c8568f914cd2 a93c38b08b75 2023-12-06T14:57:50.010 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (3m) 98s ago 3m 7436k - 17.2.7-113-gece0d607 a5c6421f1c5f 40d5cebbdb93 2023-12-06T14:57:50.011 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi190 smithi190 running (3m) 44s ago 3m 7457k - 17.2.7-113-gece0d607 a5c6421f1c5f 3a387cddf7e6 2023-12-06T14:57:50.011 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (2m) 98s ago 3m 83.5M - 9.4.7 954c08fa6188 22085689650a 2023-12-06T14:57:50.011 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.meodco smithi152 *:9283 running (4m) 98s ago 4m 483M - 17.2.7-113-gece0d607 a5c6421f1c5f 9d7a3190a8fa 2023-12-06T14:57:50.011 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi190.ubusrr smithi190 *:8443,9283 running (2m) 44s ago 2m 442M - 17.2.7-113-gece0d607 a5c6421f1c5f acaea6cae1cb 2023-12-06T14:57:50.011 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (4m) 98s ago 4m 56.8M 2048M 17.2.7-113-gece0d607 a5c6421f1c5f 2b9f6058715d 2023-12-06T14:57:50.011 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi190 smithi190 running (2m) 44s ago 2m 51.4M 2048M 17.2.7-113-gece0d607 a5c6421f1c5f 3a81d140940b 2023-12-06T14:57:50.011 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 running (3m) 98s ago 3m 14.4M - 1.5.0 0da6a335fe13 870624b5876a 2023-12-06T14:57:50.011 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi190 smithi190 *:9100 running (2m) 44s ago 2m 17.4M - 1.5.0 0da6a335fe13 39b96c91b1ce 2023-12-06T14:57:50.011 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (2m) 98s ago 2m 39.3M 4299M 17.2.7-113-gece0d607 a5c6421f1c5f 499f740f966e 2023-12-06T14:57:50.011 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (2m) 98s ago 2m 39.3M 4299M 17.2.7-113-gece0d607 a5c6421f1c5f 3942f134581a 2023-12-06T14:57:50.011 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (102s) 98s ago 102s 14.2M 4299M 17.2.7-113-gece0d607 a5c6421f1c5f 80bcc4927bb2 2023-12-06T14:57:50.011 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi190 running (84s) 44s ago 84s 43.8M 5323M 17.2.7-113-gece0d607 a5c6421f1c5f f0281d01fec4 2023-12-06T14:57:50.011 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi190 running (65s) 44s ago 65s 40.3M 5323M 17.2.7-113-gece0d607 a5c6421f1c5f a415b29ad9c7 2023-12-06T14:57:50.011 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi190 running (47s) 44s ago 46s 11.3M 5323M 17.2.7-113-gece0d607 a5c6421f1c5f b0f2767055a5 2023-12-06T14:57:50.012 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi152 smithi152 *:9095 running (2m) 98s ago 3m 36.5M - 2.43.0 a07b618ecd1d fabe795a329c 2023-12-06T14:57:50.012 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:50.012+0000 7f0b638d9700 1 -- 172.21.15.152:0/3140675460 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f0b48068f70 msgr2=0x7f0b4806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:50.012 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:50.012+0000 7f0b638d9700 1 --2- 172.21.15.152:0/3140675460 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f0b48068f70 0x7f0b4806b420 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0b580041d0 tx=0x7f0b58009040 comp rx=0 tx=0).stop 2023-12-06T14:57:50.012 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:50.012+0000 7f0b638d9700 1 -- 172.21.15.152:0/3140675460 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b5c0fafb0 msgr2=0x7f0b5c10f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:50.013 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:50.012+0000 7f0b638d9700 1 --2- 172.21.15.152:0/3140675460 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b5c0fafb0 0x7f0b5c10f820 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c009360 tx=0x7f0b4c009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:50.013 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:50.012+0000 7f0b638d9700 1 -- 172.21.15.152:0/3140675460 shutdown_connections 2023-12-06T14:57:50.013 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:50.012+0000 7f0b638d9700 1 --2- 172.21.15.152:0/3140675460 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0b5c0fafb0 0x7f0b5c10f820 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:50.013 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:50.012+0000 7f0b638d9700 1 --2- 172.21.15.152:0/3140675460 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f0b48068f70 0x7f0b4806b420 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:50.013 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:50.012+0000 7f0b638d9700 1 --2- 172.21.15.152:0/3140675460 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b5c10fd60 0x7f0b5c110c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:50.013 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:50.012+0000 7f0b638d9700 1 -- 172.21.15.152:0/3140675460 >> 172.21.15.152:0/3140675460 conn(0x7f0b5c0f6950 msgr2=0x7f0b5c0fbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:50.013 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:50.012+0000 7f0b638d9700 1 -- 172.21.15.152:0/3140675460 shutdown_connections 2023-12-06T14:57:50.013 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:50.012+0000 7f0b638d9700 1 -- 172.21.15.152:0/3140675460 wait complete. 2023-12-06T14:57:50.402 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- bash -c 'ceph orch ls' 2023-12-06T14:57:50.574 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:50 smithi190 ceph-mon[121340]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:50.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:50 smithi152 ceph-mon[111954]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:50.664 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:57:51.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:51 smithi152 ceph-mon[111954]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:57:51.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:51 smithi190 ceph-mon[121340]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:57:51.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.658+0000 7f81a0243700 1 -- 172.21.15.152:0/815679963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81980fbaf0 msgr2=0x7f81980fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:51.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.658+0000 7f81a0243700 1 --2- 172.21.15.152:0/815679963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81980fbaf0 0x7f81980fbf00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8194004940 tx=0x7f8194009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:51.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.658+0000 7f81a0243700 1 -- 172.21.15.152:0/815679963 shutdown_connections 2023-12-06T14:57:51.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.658+0000 7f81a0243700 1 --2- 172.21.15.152:0/815679963 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81980fcd00 0x7f81980fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:51.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.658+0000 7f81a0243700 1 --2- 172.21.15.152:0/815679963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81980fbaf0 0x7f81980fbf00 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:51.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.658+0000 7f81a0243700 1 -- 172.21.15.152:0/815679963 >> 172.21.15.152:0/815679963 conn(0x7f81980f7190 msgr2=0x7f81980f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:51.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.658+0000 7f81a0243700 1 -- 172.21.15.152:0/815679963 shutdown_connections 2023-12-06T14:57:51.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.658+0000 7f81a0243700 1 -- 172.21.15.152:0/815679963 wait complete. 2023-12-06T14:57:51.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.659+0000 7f81a0243700 1 Processor -- start 2023-12-06T14:57:51.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.659+0000 7f81a0243700 1 -- start start 2023-12-06T14:57:51.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.659+0000 7f81a0243700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81980fbaf0 0x7f819810d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:51.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.659+0000 7f81a0243700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81980fcd00 0x7f819810dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:51.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.659+0000 7f81a0243700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819810e140 con 0x7f81980fcd00 2023-12-06T14:57:51.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.659+0000 7f81a0243700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819810e980 con 0x7f81980fbaf0 2023-12-06T14:57:51.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.659+0000 7f819d7de700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81980fcd00 0x7f819810dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:51.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.659+0000 7f819d7de700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81980fcd00 0x7f819810dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41574/0 (socket says 172.21.15.152:41574) 2023-12-06T14:57:51.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.659+0000 7f819d7de700 1 -- 172.21.15.152:0/1063095595 learned_addr learned my addr 172.21.15.152:0/1063095595 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:57:51.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.659+0000 7f819dfdf700 1 --2- 172.21.15.152:0/1063095595 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81980fbaf0 0x7f819810d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:51.661 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.659+0000 7f819d7de700 1 -- 172.21.15.152:0/1063095595 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81980fbaf0 msgr2=0x7f819810d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:51.662 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.659+0000 7f819d7de700 1 --2- 172.21.15.152:0/1063095595 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81980fbaf0 0x7f819810d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:51.662 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.659+0000 7f819d7de700 1 -- 172.21.15.152:0/1063095595 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8194005040 con 0x7f81980fcd00 2023-12-06T14:57:51.662 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.659+0000 7f819d7de700 1 --2- 172.21.15.152:0/1063095595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81980fcd00 0x7f819810dab0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f818800b790 tx=0x7f8188009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:51.662 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.659+0000 7f818e7fc700 1 -- 172.21.15.152:0/1063095595 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f818800f770 con 0x7f81980fcd00 2023-12-06T14:57:51.662 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.660+0000 7f818e7fc700 1 -- 172.21.15.152:0/1063095595 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f818800fd80 con 0x7f81980fcd00 2023-12-06T14:57:51.662 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.660+0000 7f818e7fc700 1 -- 172.21.15.152:0/1063095595 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f818800d310 con 0x7f81980fcd00 2023-12-06T14:57:51.662 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.660+0000 7f81a0243700 1 -- 172.21.15.152:0/1063095595 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f819810ec60 con 0x7f81980fcd00 2023-12-06T14:57:51.662 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.660+0000 7f81a0243700 1 -- 172.21.15.152:0/1063095595 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f819810f150 con 0x7f81980fcd00 2023-12-06T14:57:51.663 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.661+0000 7f81a0243700 1 -- 172.21.15.152:0/1063095595 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f819804bb80 con 0x7f81980fcd00 2023-12-06T14:57:51.663 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.661+0000 7f818e7fc700 1 -- 172.21.15.152:0/1063095595 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f8188010420 con 0x7f81980fcd00 2023-12-06T14:57:51.663 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.662+0000 7f818e7fc700 1 --2- 172.21.15.152:0/1063095595 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f8184068f60 0x7f818406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:51.663 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.662+0000 7f819dfdf700 1 --2- 172.21.15.152:0/1063095595 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f8184068f60 0x7f818406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:51.663 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.662+0000 7f818e7fc700 1 -- 172.21.15.152:0/1063095595 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8188086a50 con 0x7f81980fcd00 2023-12-06T14:57:51.663 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.662+0000 7f819dfdf700 1 --2- 172.21.15.152:0/1063095595 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f8184068f60 0x7f818406b410 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f819400b3b0 tx=0x7f8194009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:51.666 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.666+0000 7f818e7fc700 1 -- 172.21.15.152:0/1063095595 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8188056cf0 con 0x7f81980fcd00 2023-12-06T14:57:51.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.856+0000 7f81a0243700 1 -- 172.21.15.152:0/1063095595 --> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f819810f650 con 0x7f8184068f60 2023-12-06T14:57:51.860 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.860+0000 7f818e7fc700 1 -- 172.21.15.152:0/1063095595 <== mgr.14210 v2:172.21.15.152:6800/3317409709 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1179 (secure 0 0 0) 0x7f819810f650 con 0x7f8184068f60 2023-12-06T14:57:51.861 INFO:teuthology.orchestra.run.smithi152.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-12-06T14:57:51.861 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager ?:9093,9094 1/1 100s ago 4m count:1 2023-12-06T14:57:51.861 INFO:teuthology.orchestra.run.smithi152.stdout:crash 2/2 100s ago 4m * 2023-12-06T14:57:51.861 INFO:teuthology.orchestra.run.smithi152.stdout:grafana ?:3000 1/1 100s ago 4m count:1 2023-12-06T14:57:51.861 INFO:teuthology.orchestra.run.smithi152.stdout:mgr 2/2 100s ago 4m count:2 2023-12-06T14:57:51.861 INFO:teuthology.orchestra.run.smithi152.stdout:mon 2/2 100s ago 3m smithi152:172.21.15.152=smithi152;smithi190:172.21.15.190=smithi190;count:2 2023-12-06T14:57:51.861 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter ?:9100 2/2 100s ago 4m * 2023-12-06T14:57:51.861 INFO:teuthology.orchestra.run.smithi152.stdout:osd 6 100s ago - 2023-12-06T14:57:51.861 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus ?:9095 1/1 100s ago 4m count:1 2023-12-06T14:57:51.862 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.862+0000 7f81a0243700 1 -- 172.21.15.152:0/1063095595 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f8184068f60 msgr2=0x7f818406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:51.863 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.862+0000 7f81a0243700 1 --2- 172.21.15.152:0/1063095595 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f8184068f60 0x7f818406b410 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f819400b3b0 tx=0x7f8194009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:51.863 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.862+0000 7f81a0243700 1 -- 172.21.15.152:0/1063095595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81980fcd00 msgr2=0x7f819810dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:51.863 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.862+0000 7f81a0243700 1 --2- 172.21.15.152:0/1063095595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81980fcd00 0x7f819810dab0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f818800b790 tx=0x7f8188009250 comp rx=0 tx=0).stop 2023-12-06T14:57:51.863 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.862+0000 7f81a0243700 1 -- 172.21.15.152:0/1063095595 shutdown_connections 2023-12-06T14:57:51.863 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.862+0000 7f81a0243700 1 --2- 172.21.15.152:0/1063095595 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f8184068f60 0x7f818406b410 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:51.863 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.862+0000 7f81a0243700 1 --2- 172.21.15.152:0/1063095595 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81980fbaf0 0x7f819810d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:51.863 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.862+0000 7f81a0243700 1 --2- 172.21.15.152:0/1063095595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f81980fcd00 0x7f819810dab0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:51.863 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.862+0000 7f81a0243700 1 -- 172.21.15.152:0/1063095595 >> 172.21.15.152:0/1063095595 conn(0x7f81980f7190 msgr2=0x7f8198065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:51.863 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.862+0000 7f81a0243700 1 -- 172.21.15.152:0/1063095595 shutdown_connections 2023-12-06T14:57:51.863 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:51.862+0000 7f81a0243700 1 -- 172.21.15.152:0/1063095595 wait complete. 2023-12-06T14:57:52.234 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- bash -c 'ceph orch host ls' 2023-12-06T14:57:52.497 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:57:52.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:52 smithi190 ceph-mon[121340]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:52.610 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:52 smithi152 ceph-mon[111954]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:53.540 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.538+0000 7f931f81e700 1 -- 172.21.15.152:0/204094441 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93180fcd90 msgr2=0x7f93180fd200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:53.540 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.538+0000 7f931f81e700 1 --2- 172.21.15.152:0/204094441 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93180fcd90 0x7f93180fd200 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9314004940 tx=0x7f9314009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:53.540 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.538+0000 7f931f81e700 1 -- 172.21.15.152:0/204094441 shutdown_connections 2023-12-06T14:57:53.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.538+0000 7f931f81e700 1 --2- 172.21.15.152:0/204094441 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93180fcd90 0x7f93180fd200 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:53.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.538+0000 7f931f81e700 1 --2- 172.21.15.152:0/204094441 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93180fbae0 0x7f93180fbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:53.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.538+0000 7f931f81e700 1 -- 172.21.15.152:0/204094441 >> 172.21.15.152:0/204094441 conn(0x7f93180f7240 msgr2=0x7f93180f9670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:53.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.538+0000 7f931f81e700 1 -- 172.21.15.152:0/204094441 shutdown_connections 2023-12-06T14:57:53.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.538+0000 7f931f81e700 1 -- 172.21.15.152:0/204094441 wait complete. 2023-12-06T14:57:53.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.539+0000 7f931f81e700 1 Processor -- start 2023-12-06T14:57:53.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.539+0000 7f931f81e700 1 -- start start 2023-12-06T14:57:53.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.539+0000 7f931f81e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93180fbae0 0x7f931810c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:53.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.539+0000 7f931f81e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93180fcd90 0x7f931810c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:53.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.539+0000 7f931f81e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931810cff0 con 0x7f93180fbae0 2023-12-06T14:57:53.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.539+0000 7f931f81e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931810d830 con 0x7f93180fcd90 2023-12-06T14:57:53.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.539+0000 7f931d5ba700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93180fbae0 0x7f931810c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:53.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.539+0000 7f931d5ba700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93180fbae0 0x7f931810c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41596/0 (socket says 172.21.15.152:41596) 2023-12-06T14:57:53.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.539+0000 7f931d5ba700 1 -- 172.21.15.152:0/2875071628 learned_addr learned my addr 172.21.15.152:0/2875071628 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:57:53.542 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.539+0000 7f931cdb9700 1 --2- 172.21.15.152:0/2875071628 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93180fcd90 0x7f931810c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:53.542 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.539+0000 7f931d5ba700 1 -- 172.21.15.152:0/2875071628 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93180fcd90 msgr2=0x7f931810c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:53.542 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.539+0000 7f931d5ba700 1 --2- 172.21.15.152:0/2875071628 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93180fcd90 0x7f931810c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:53.542 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.540+0000 7f931d5ba700 1 -- 172.21.15.152:0/2875071628 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9314005040 con 0x7f93180fbae0 2023-12-06T14:57:53.542 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.540+0000 7f931cdb9700 1 --2- 172.21.15.152:0/2875071628 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93180fcd90 0x7f931810c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-06T14:57:53.542 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.540+0000 7f931d5ba700 1 --2- 172.21.15.152:0/2875071628 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93180fbae0 0x7f931810c420 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f930800b790 tx=0x7f9308009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:53.542 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.540+0000 7f930dffb700 1 -- 172.21.15.152:0/2875071628 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f930800f770 con 0x7f93180fbae0 2023-12-06T14:57:53.542 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.540+0000 7f930dffb700 1 -- 172.21.15.152:0/2875071628 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f930800fd80 con 0x7f93180fbae0 2023-12-06T14:57:53.542 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.540+0000 7f931f81e700 1 -- 172.21.15.152:0/2875071628 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f931810db10 con 0x7f93180fbae0 2023-12-06T14:57:53.542 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.540+0000 7f930dffb700 1 -- 172.21.15.152:0/2875071628 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f930800d310 con 0x7f93180fbae0 2023-12-06T14:57:53.542 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.540+0000 7f931f81e700 1 -- 172.21.15.152:0/2875071628 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f931810e050 con 0x7f93180fbae0 2023-12-06T14:57:53.543 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.541+0000 7f931f81e700 1 -- 172.21.15.152:0/2875071628 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f931804bb80 con 0x7f93180fbae0 2023-12-06T14:57:53.543 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.541+0000 7f930dffb700 1 -- 172.21.15.152:0/2875071628 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f9308010420 con 0x7f93180fbae0 2023-12-06T14:57:53.543 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.542+0000 7f930dffb700 1 --2- 172.21.15.152:0/2875071628 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f9304068f60 0x7f930406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:53.543 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.542+0000 7f930dffb700 1 -- 172.21.15.152:0/2875071628 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9308086930 con 0x7f93180fbae0 2023-12-06T14:57:53.543 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.542+0000 7f931cdb9700 1 --2- 172.21.15.152:0/2875071628 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f9304068f60 0x7f930406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:53.543 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.542+0000 7f931cdb9700 1 --2- 172.21.15.152:0/2875071628 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f9304068f60 0x7f930406b410 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9314004560 tx=0x7f9314009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:53.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.546+0000 7f930dffb700 1 -- 172.21.15.152:0/2875071628 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9308056c70 con 0x7f93180fbae0 2023-12-06T14:57:53.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:53 smithi190 ceph-mon[121340]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:57:53.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:53 smithi152 ceph-mon[111954]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:57:53.740 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.740+0000 7f931f81e700 1 -- 172.21.15.152:0/2875071628 --> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f931810e550 con 0x7f9304068f60 2023-12-06T14:57:53.741 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.741+0000 7f930dffb700 1 -- 172.21.15.152:0/2875071628 <== mgr.14210 v2:172.21.15.152:6800/3317409709 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f931810e550 con 0x7f9304068f60 2023-12-06T14:57:53.742 INFO:teuthology.orchestra.run.smithi152.stdout:HOST ADDR LABELS STATUS 2023-12-06T14:57:53.742 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152 172.21.15.152 2023-12-06T14:57:53.742 INFO:teuthology.orchestra.run.smithi152.stdout:smithi190 172.21.15.190 2023-12-06T14:57:53.742 INFO:teuthology.orchestra.run.smithi152.stdout:2 hosts in cluster 2023-12-06T14:57:53.743 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.743+0000 7f931f81e700 1 -- 172.21.15.152:0/2875071628 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f9304068f60 msgr2=0x7f930406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:53.744 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.743+0000 7f931f81e700 1 --2- 172.21.15.152:0/2875071628 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f9304068f60 0x7f930406b410 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9314004560 tx=0x7f9314009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:53.744 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.743+0000 7f931f81e700 1 -- 172.21.15.152:0/2875071628 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93180fbae0 msgr2=0x7f931810c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:53.744 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.743+0000 7f931f81e700 1 --2- 172.21.15.152:0/2875071628 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93180fbae0 0x7f931810c420 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f930800b790 tx=0x7f9308009250 comp rx=0 tx=0).stop 2023-12-06T14:57:53.744 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.743+0000 7f931f81e700 1 -- 172.21.15.152:0/2875071628 shutdown_connections 2023-12-06T14:57:53.744 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.743+0000 7f931f81e700 1 --2- 172.21.15.152:0/2875071628 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93180fbae0 0x7f931810c420 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:53.744 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.743+0000 7f931f81e700 1 --2- 172.21.15.152:0/2875071628 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f9304068f60 0x7f930406b410 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:53.744 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.743+0000 7f931f81e700 1 --2- 172.21.15.152:0/2875071628 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93180fcd90 0x7f931810c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:53.744 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.743+0000 7f931f81e700 1 -- 172.21.15.152:0/2875071628 >> 172.21.15.152:0/2875071628 conn(0x7f93180f7240 msgr2=0x7f93180fffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:53.745 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.744+0000 7f931f81e700 1 -- 172.21.15.152:0/2875071628 shutdown_connections 2023-12-06T14:57:53.745 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:53.744+0000 7f931f81e700 1 -- 172.21.15.152:0/2875071628 wait complete. 2023-12-06T14:57:54.118 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- bash -c 'ceph orch device ls' 2023-12-06T14:57:54.379 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:57:54.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:54 smithi190 ceph-mon[121340]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:54.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:54 smithi152 ceph-mon[111954]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:55.382 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.381+0000 7f26da344700 1 -- 172.21.15.152:0/695894313 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26d40fcd00 msgr2=0x7f26d40fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:55.382 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.381+0000 7f26da344700 1 --2- 172.21.15.152:0/695894313 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26d40fcd00 0x7f26d40fd150 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f26c8004940 tx=0x7f26c8009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:55.382 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.381+0000 7f26da344700 1 -- 172.21.15.152:0/695894313 shutdown_connections 2023-12-06T14:57:55.382 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.381+0000 7f26da344700 1 --2- 172.21.15.152:0/695894313 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26d40fcd00 0x7f26d40fd150 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:55.382 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.381+0000 7f26da344700 1 --2- 172.21.15.152:0/695894313 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26d40fbaf0 0x7f26d40fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:55.382 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.381+0000 7f26da344700 1 -- 172.21.15.152:0/695894313 >> 172.21.15.152:0/695894313 conn(0x7f26d40f7190 msgr2=0x7f26d40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:55.382 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.381+0000 7f26da344700 1 -- 172.21.15.152:0/695894313 shutdown_connections 2023-12-06T14:57:55.382 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.381+0000 7f26da344700 1 -- 172.21.15.152:0/695894313 wait complete. 2023-12-06T14:57:55.382 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.382+0000 7f26da344700 1 Processor -- start 2023-12-06T14:57:55.382 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.382+0000 7f26da344700 1 -- start start 2023-12-06T14:57:55.384 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.382+0000 7f26da344700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26d40fbaf0 0x7f26d4110290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:55.384 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.382+0000 7f26da344700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26d40fcd00 0x7f26d41127e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:55.384 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.382+0000 7f26da344700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d4066110 con 0x7f26d40fcd00 2023-12-06T14:57:55.384 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.382+0000 7f26da344700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d4066250 con 0x7f26d40fbaf0 2023-12-06T14:57:55.384 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.382+0000 7f26d37fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26d40fcd00 0x7f26d41127e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:55.384 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.382+0000 7f26d37fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26d40fcd00 0x7f26d41127e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41608/0 (socket says 172.21.15.152:41608) 2023-12-06T14:57:55.384 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.382+0000 7f26d37fe700 1 -- 172.21.15.152:0/2596539818 learned_addr learned my addr 172.21.15.152:0/2596539818 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:57:55.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.382+0000 7f26d3fff700 1 --2- 172.21.15.152:0/2596539818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26d40fbaf0 0x7f26d4110290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:55.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.382+0000 7f26d37fe700 1 -- 172.21.15.152:0/2596539818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26d40fbaf0 msgr2=0x7f26d4110290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:55.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.382+0000 7f26d37fe700 1 --2- 172.21.15.152:0/2596539818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26d40fbaf0 0x7f26d4110290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:55.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.382+0000 7f26d37fe700 1 -- 172.21.15.152:0/2596539818 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c8005040 con 0x7f26d40fcd00 2023-12-06T14:57:55.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.383+0000 7f26d37fe700 1 --2- 172.21.15.152:0/2596539818 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26d40fcd00 0x7f26d41127e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f26c8009360 tx=0x7f26c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:55.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.383+0000 7f26d0ff9700 1 -- 172.21.15.152:0/2596539818 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26c800e040 con 0x7f26d40fcd00 2023-12-06T14:57:55.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.383+0000 7f26da344700 1 -- 172.21.15.152:0/2596539818 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26d4112de0 con 0x7f26d40fcd00 2023-12-06T14:57:55.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.383+0000 7f26d0ff9700 1 -- 172.21.15.152:0/2596539818 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f26c800bc50 con 0x7f26d40fcd00 2023-12-06T14:57:55.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.383+0000 7f26d0ff9700 1 -- 172.21.15.152:0/2596539818 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26c801c3f0 con 0x7f26d40fcd00 2023-12-06T14:57:55.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.383+0000 7f26da344700 1 -- 172.21.15.152:0/2596539818 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26d41132a0 con 0x7f26d40fcd00 2023-12-06T14:57:55.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.384+0000 7f26da344700 1 -- 172.21.15.152:0/2596539818 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26d404bb80 con 0x7f26d40fcd00 2023-12-06T14:57:55.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.384+0000 7f26d0ff9700 1 -- 172.21.15.152:0/2596539818 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f26c8013420 con 0x7f26d40fcd00 2023-12-06T14:57:55.386 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.384+0000 7f26d0ff9700 1 --2- 172.21.15.152:0/2596539818 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f26bc068f60 0x7f26bc06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:55.386 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.385+0000 7f26d0ff9700 1 -- 172.21.15.152:0/2596539818 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f26c8087de0 con 0x7f26d40fcd00 2023-12-06T14:57:55.386 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.385+0000 7f26d3fff700 1 --2- 172.21.15.152:0/2596539818 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f26bc068f60 0x7f26bc06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:55.386 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.385+0000 7f26d3fff700 1 --2- 172.21.15.152:0/2596539818 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f26bc068f60 0x7f26bc06b410 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f26d4065d90 tx=0x7f26c4009040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:55.389 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.389+0000 7f26d0ff9700 1 -- 172.21.15.152:0/2596539818 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f26c8054570 con 0x7f26d40fcd00 2023-12-06T14:57:55.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:55 smithi190 ceph-mon[121340]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:57:55.577 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.577+0000 7f26da344700 1 -- 172.21.15.152:0/2596539818 --> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f26d41134c0 con 0x7f26bc068f60 2023-12-06T14:57:55.579 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.579+0000 7f26d0ff9700 1 -- 172.21.15.152:0/2596539818 <== mgr.14210 v2:172.21.15.152:6800/3317409709 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f26d41134c0 con 0x7f26bc068f60 2023-12-06T14:57:55.579 INFO:teuthology.orchestra.run.smithi152.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-12-06T14:57:55.579 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300JT400BGN 372G No 101s ago Has a FileSystem, LVM detected 2023-12-06T14:57:55.579 INFO:teuthology.orchestra.run.smithi152.stdout:smithi190 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT63210012400BGN 372G No 47s ago Has a FileSystem, LVM detected 2023-12-06T14:57:55.582 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.581+0000 7f26da344700 1 -- 172.21.15.152:0/2596539818 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f26bc068f60 msgr2=0x7f26bc06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:55.582 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.581+0000 7f26da344700 1 --2- 172.21.15.152:0/2596539818 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f26bc068f60 0x7f26bc06b410 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f26d4065d90 tx=0x7f26c4009040 comp rx=0 tx=0).stop 2023-12-06T14:57:55.582 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.581+0000 7f26da344700 1 -- 172.21.15.152:0/2596539818 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26d40fcd00 msgr2=0x7f26d41127e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:55.582 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.581+0000 7f26da344700 1 --2- 172.21.15.152:0/2596539818 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26d40fcd00 0x7f26d41127e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f26c8009360 tx=0x7f26c8009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:55.582 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.581+0000 7f26da344700 1 -- 172.21.15.152:0/2596539818 shutdown_connections 2023-12-06T14:57:55.582 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.581+0000 7f26da344700 1 --2- 172.21.15.152:0/2596539818 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f26bc068f60 0x7f26bc06b410 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:55.582 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.581+0000 7f26da344700 1 --2- 172.21.15.152:0/2596539818 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26d40fbaf0 0x7f26d4110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:55.582 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.581+0000 7f26da344700 1 --2- 172.21.15.152:0/2596539818 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26d40fcd00 0x7f26d41127e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:55.582 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.581+0000 7f26da344700 1 -- 172.21.15.152:0/2596539818 >> 172.21.15.152:0/2596539818 conn(0x7f26d40f7190 msgr2=0x7f26d40fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:55.582 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.582+0000 7f26da344700 1 -- 172.21.15.152:0/2596539818 shutdown_connections 2023-12-06T14:57:55.582 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:55.582+0000 7f26da344700 1 -- 172.21.15.152:0/2596539818 wait complete. 2023-12-06T14:57:55.605 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:55 smithi152 ceph-mon[111954]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:57:55.958 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-06T14:57:55.969 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi152.front.sepia.ceph.com 2023-12-06T14:57:55.970 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- bash -c 'ceph fs volume create cephfs --placement=4' 2023-12-06T14:57:56.235 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:57:56.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:56 smithi190 ceph-mon[121340]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:56.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:56 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:57:56.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:56 smithi152 ceph-mon[111954]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:56.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:56 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:57:57.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:57.223+0000 7febd9b94700 1 -- 172.21.15.152:0/3205438722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7febd40fcbf0 msgr2=0x7febd40fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:57.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:57.223+0000 7febd9b94700 1 --2- 172.21.15.152:0/3205438722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7febd40fcbf0 0x7febd40fd000 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7febc8004940 tx=0x7febc8009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:57.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:57.223+0000 7febd9b94700 1 -- 172.21.15.152:0/3205438722 shutdown_connections 2023-12-06T14:57:57.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:57.223+0000 7febd9b94700 1 --2- 172.21.15.152:0/3205438722 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7febd40fde00 0x7febd40fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:57.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:57.223+0000 7febd9b94700 1 --2- 172.21.15.152:0/3205438722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7febd40fcbf0 0x7febd40fd000 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:57.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:57.223+0000 7febd9b94700 1 -- 172.21.15.152:0/3205438722 >> 172.21.15.152:0/3205438722 conn(0x7febd40f82d0 msgr2=0x7febd40fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:57.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:57.223+0000 7febd9b94700 1 -- 172.21.15.152:0/3205438722 shutdown_connections 2023-12-06T14:57:57.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:57.223+0000 7febd9b94700 1 -- 172.21.15.152:0/3205438722 wait complete. 2023-12-06T14:57:57.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:57.224+0000 7febd9b94700 1 Processor -- start 2023-12-06T14:57:57.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:57.224+0000 7febd9b94700 1 -- start start 2023-12-06T14:57:57.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:57.224+0000 7febd9b94700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7febd40fcbf0 0x7febd410d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:57.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:57.224+0000 7febd9b94700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7febd40fde00 0x7febd410daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:57.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:57.224+0000 7febd9b94700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd410e0a0 con 0x7febd40fde00 2023-12-06T14:57:57.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:57.224+0000 7febd9b94700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd410e940 con 0x7febd40fcbf0 2023-12-06T14:57:57.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:57.224+0000 7febd2ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7febd40fde00 0x7febd410daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:57.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:57.224+0000 7febd2ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7febd40fde00 0x7febd410daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:41636/0 (socket says 172.21.15.152:41636) 2023-12-06T14:57:57.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:57.224+0000 7febd2ffd700 1 -- 172.21.15.152:0/3821691131 learned_addr learned my addr 172.21.15.152:0/3821691131 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:57:57.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:57.224+0000 7febd37fe700 1 --2- 172.21.15.152:0/3821691131 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7febd40fcbf0 0x7febd410d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:57.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:57.225+0000 7febd2ffd700 1 -- 172.21.15.152:0/3821691131 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7febd40fcbf0 msgr2=0x7febd410d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:57.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:57.225+0000 7febd2ffd700 1 --2- 172.21.15.152:0/3821691131 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7febd40fcbf0 0x7febd410d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:57.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:57.225+0000 7febd2ffd700 1 -- 172.21.15.152:0/3821691131 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc8005040 con 0x7febd40fde00 2023-12-06T14:57:57.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:57.225+0000 7febd2ffd700 1 --2- 172.21.15.152:0/3821691131 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7febd40fde00 0x7febd410daa0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7febc400c8c0 tx=0x7febc40044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:57.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:57.225+0000 7febbbfff700 1 -- 172.21.15.152:0/3821691131 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febc400a760 con 0x7febd40fde00 2023-12-06T14:57:57.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:57.225+0000 7febd9b94700 1 -- 172.21.15.152:0/3821691131 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd410ec20 con 0x7febd40fde00 2023-12-06T14:57:57.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:57.225+0000 7febbbfff700 1 -- 172.21.15.152:0/3821691131 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7febc400ad70 con 0x7febd40fde00 2023-12-06T14:57:57.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:57.225+0000 7febbbfff700 1 -- 172.21.15.152:0/3821691131 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febc40113a0 con 0x7febd40fde00 2023-12-06T14:57:57.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:57.225+0000 7febd9b94700 1 -- 172.21.15.152:0/3821691131 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd410f160 con 0x7febd40fde00 2023-12-06T14:57:57.228 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:57.226+0000 7febd9b94700 1 -- 172.21.15.152:0/3821691131 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd404bb80 con 0x7febd40fde00 2023-12-06T14:57:57.228 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:57.226+0000 7febbbfff700 1 -- 172.21.15.152:0/3821691131 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7febc4012400 con 0x7febd40fde00 2023-12-06T14:57:57.228 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:57.227+0000 7febbbfff700 1 --2- 172.21.15.152:0/3821691131 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7febbc068f60 0x7febbc06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:57:57.228 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:57.227+0000 7febbbfff700 1 -- 172.21.15.152:0/3821691131 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7febc4086b00 con 0x7febd40fde00 2023-12-06T14:57:57.228 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:57.227+0000 7febd37fe700 1 --2- 172.21.15.152:0/3821691131 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7febbc068f60 0x7febbc06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:57:57.228 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:57.227+0000 7febd37fe700 1 --2- 172.21.15.152:0/3821691131 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7febbc068f60 0x7febbc06b410 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7febc8004890 tx=0x7febc8009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:57:57.231 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:57.231+0000 7febbbfff700 1 -- 172.21.15.152:0/3821691131 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7febc4056da0 con 0x7febd40fde00 2023-12-06T14:57:57.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:57.443+0000 7febd9b94700 1 -- 172.21.15.152:0/3821691131 --> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7febd410f560 con 0x7febbc068f60 2023-12-06T14:57:57.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:57 smithi152 ceph-mon[111954]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:57:57.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:57 smithi190 ceph-mon[121340]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:57:58.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:58 smithi152 ceph-mon[111954]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:58.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:58 smithi152 ceph-mon[111954]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:57:58.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:58 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2023-12-06T14:57:58.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:58 smithi190 ceph-mon[121340]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:57:58.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:58 smithi190 ceph-mon[121340]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:57:58.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:58 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2023-12-06T14:57:59.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:59.375+0000 7febbbfff700 1 -- 172.21.15.152:0/3821691131 <== mgr.14210 v2:172.21.15.152:6800/3317409709 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7febd410f560 con 0x7febbc068f60 2023-12-06T14:57:59.378 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:59.378+0000 7febd9b94700 1 -- 172.21.15.152:0/3821691131 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7febbc068f60 msgr2=0x7febbc06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:59.378 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:59.378+0000 7febd9b94700 1 --2- 172.21.15.152:0/3821691131 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7febbc068f60 0x7febbc06b410 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7febc8004890 tx=0x7febc8009e30 comp rx=0 tx=0).stop 2023-12-06T14:57:59.378 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:59.378+0000 7febd9b94700 1 -- 172.21.15.152:0/3821691131 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7febd40fde00 msgr2=0x7febd410daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:57:59.378 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:59.378+0000 7febd9b94700 1 --2- 172.21.15.152:0/3821691131 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7febd40fde00 0x7febd410daa0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7febc400c8c0 tx=0x7febc40044c0 comp rx=0 tx=0).stop 2023-12-06T14:57:59.378 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:59.378+0000 7febd9b94700 1 -- 172.21.15.152:0/3821691131 shutdown_connections 2023-12-06T14:57:59.378 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:59.378+0000 7febd9b94700 1 --2- 172.21.15.152:0/3821691131 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7febbc068f60 0x7febbc06b410 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:59.378 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:59.378+0000 7febd9b94700 1 --2- 172.21.15.152:0/3821691131 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7febd40fcbf0 0x7febd410d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:59.378 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:59.378+0000 7febd9b94700 1 --2- 172.21.15.152:0/3821691131 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7febd40fde00 0x7febd410daa0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:57:59.378 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:59.378+0000 7febd9b94700 1 -- 172.21.15.152:0/3821691131 >> 172.21.15.152:0/3821691131 conn(0x7febd40f82d0 msgr2=0x7febd4101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:57:59.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:59.378+0000 7febd9b94700 1 -- 172.21.15.152:0/3821691131 shutdown_connections 2023-12-06T14:57:59.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:57:59.378+0000 7febd9b94700 1 -- 172.21.15.152:0/3821691131 wait complete. 2023-12-06T14:57:59.627 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:59 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2023-12-06T14:57:59.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:59 smithi152 ceph-mon[111954]: osdmap e39: 6 total, 6 up, 6 in 2023-12-06T14:57:59.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:59 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2023-12-06T14:57:59.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:57:59 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-mon-smithi152[111931]: 2023-12-06T14:57:59.351+0000 7f67c6975700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-06T14:57:59.768 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- bash -c 'ceph fs dump' 2023-12-06T14:57:59.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:59 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2023-12-06T14:57:59.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:59 smithi190 ceph-mon[121340]: osdmap e39: 6 total, 6 up, 6 in 2023-12-06T14:57:59.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:57:59 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2023-12-06T14:58:00.495 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:58:00.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:00 smithi152 ceph-mon[111954]: pgmap v126: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:58:00.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:00 smithi152 ceph-mon[111954]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-12-06T14:58:00.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:00 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2023-12-06T14:58:00.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:00 smithi152 ceph-mon[111954]: osdmap e40: 6 total, 6 up, 6 in 2023-12-06T14:58:00.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:00 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2023-12-06T14:58:00.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:00 smithi152 ceph-mon[111954]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-06T14:58:00.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:00 smithi152 ceph-mon[111954]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-06T14:58:00.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:00 smithi152 ceph-mon[111954]: osdmap e41: 6 total, 6 up, 6 in 2023-12-06T14:58:00.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:00 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2023-12-06T14:58:00.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:00 smithi152 ceph-mon[111954]: fsmap cephfs:0 2023-12-06T14:58:00.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:00 smithi152 ceph-mon[111954]: Saving service mds.cephfs spec with placement count:4 2023-12-06T14:58:00.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:00 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:00.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:00 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:58:00.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:00 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:58:00.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:00 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:58:00.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:00 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:00.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:00 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.acqswy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-06T14:58:00.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:00 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.acqswy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-06T14:58:00.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:00 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:58:00.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:00 smithi152 ceph-mon[111954]: Deploying daemon mds.cephfs.smithi152.acqswy on smithi152 2023-12-06T14:58:00.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:00 smithi190 ceph-mon[121340]: pgmap v126: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:58:00.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:00 smithi190 ceph-mon[121340]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-12-06T14:58:00.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:00 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2023-12-06T14:58:00.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:00 smithi190 ceph-mon[121340]: osdmap e40: 6 total, 6 up, 6 in 2023-12-06T14:58:00.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:00 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2023-12-06T14:58:00.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:00 smithi190 ceph-mon[121340]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-06T14:58:00.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:00 smithi190 ceph-mon[121340]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-06T14:58:00.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:00 smithi190 ceph-mon[121340]: osdmap e41: 6 total, 6 up, 6 in 2023-12-06T14:58:00.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:00 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2023-12-06T14:58:00.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:00 smithi190 ceph-mon[121340]: fsmap cephfs:0 2023-12-06T14:58:00.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:00 smithi190 ceph-mon[121340]: Saving service mds.cephfs spec with placement count:4 2023-12-06T14:58:00.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:00 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:00.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:00 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:58:00.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:00 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:58:00.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:00 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:58:00.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:00 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:00.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:00 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.acqswy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-06T14:58:00.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:00 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.acqswy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-06T14:58:00.824 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:00 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:58:00.824 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:00 smithi190 ceph-mon[121340]: Deploying daemon mds.cephfs.smithi152.acqswy on smithi152 2023-12-06T14:58:01.622 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:01 smithi152 ceph-mon[111954]: osdmap e42: 6 total, 6 up, 6 in 2023-12-06T14:58:01.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:01.809+0000 7fedf2ee8700 1 -- 172.21.15.152:0/318169456 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fedec0ffdb0 msgr2=0x7fedec1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:01.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:01.809+0000 7fedf2ee8700 1 --2- 172.21.15.152:0/318169456 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fedec0ffdb0 0x7fedec1021d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fedd8004940 tx=0x7fedd8009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:01.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:01.809+0000 7fedf2ee8700 1 -- 172.21.15.152:0/318169456 shutdown_connections 2023-12-06T14:58:01.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:01.809+0000 7fedf2ee8700 1 --2- 172.21.15.152:0/318169456 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fedec0ffdb0 0x7fedec1021d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:01.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:01.809+0000 7fedf2ee8700 1 --2- 172.21.15.152:0/318169456 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedec0668e0 0x7fedec0ff7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:01.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:01.809+0000 7fedf2ee8700 1 -- 172.21.15.152:0/318169456 >> 172.21.15.152:0/318169456 conn(0x7fedec0f71b0 msgr2=0x7fedec0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:01.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:01.809+0000 7fedf2ee8700 1 -- 172.21.15.152:0/318169456 shutdown_connections 2023-12-06T14:58:01.811 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:01.809+0000 7fedf2ee8700 1 -- 172.21.15.152:0/318169456 wait complete. 2023-12-06T14:58:01.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:01.809+0000 7fedf2ee8700 1 Processor -- start 2023-12-06T14:58:01.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:01.809+0000 7fedf2ee8700 1 -- start start 2023-12-06T14:58:01.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:01.810+0000 7fedf2ee8700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedec0668e0 0x7fedec10d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:01.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:01.810+0000 7fedf2ee8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fedec0ffdb0 0x7fedec10da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:01.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:01.810+0000 7fedf2ee8700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedec10e000 con 0x7fedec0ffdb0 2023-12-06T14:58:01.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:01.810+0000 7fedf2ee8700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedec10e8a0 con 0x7fedec0668e0 2023-12-06T14:58:01.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:01.810+0000 7fedebfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fedec0ffdb0 0x7fedec10da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:01.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:01.810+0000 7fedf0c84700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedec0668e0 0x7fedec10d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:01.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:01.810+0000 7fedf0c84700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedec0668e0 0x7fedec10d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.152:40114/0 (socket says 172.21.15.152:40114) 2023-12-06T14:58:01.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:01.810+0000 7fedebfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fedec0ffdb0 0x7fedec10da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47874/0 (socket says 172.21.15.152:47874) 2023-12-06T14:58:01.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:01.810+0000 7fedf0c84700 1 -- 172.21.15.152:0/3249251320 learned_addr learned my addr 172.21.15.152:0/3249251320 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:58:01.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:01.810+0000 7fedf0c84700 1 -- 172.21.15.152:0/3249251320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fedec0ffdb0 msgr2=0x7fedec10da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:01.812 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:01.810+0000 7fedf0c84700 1 --2- 172.21.15.152:0/3249251320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fedec0ffdb0 0x7fedec10da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:01.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:01.810+0000 7fedf0c84700 1 -- 172.21.15.152:0/3249251320 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd8005040 con 0x7fedec0668e0 2023-12-06T14:58:01.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:01.810+0000 7fedebfff700 1 --2- 172.21.15.152:0/3249251320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fedec0ffdb0 0x7fedec10da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-06T14:58:01.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:01.810+0000 7fedf0c84700 1 --2- 172.21.15.152:0/3249251320 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedec0668e0 0x7fedec10d4c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fede000eb40 tx=0x7fede000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:01.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:01.810+0000 7fede97fa700 1 -- 172.21.15.152:0/3249251320 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fede0007cc0 con 0x7fedec0668e0 2023-12-06T14:58:01.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:01.810+0000 7fedf2ee8700 1 -- 172.21.15.152:0/3249251320 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedec10eb20 con 0x7fedec0668e0 2023-12-06T14:58:01.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:01.810+0000 7fede97fa700 1 -- 172.21.15.152:0/3249251320 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fede000f040 con 0x7fedec0668e0 2023-12-06T14:58:01.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:01.810+0000 7fede97fa700 1 -- 172.21.15.152:0/3249251320 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fede000c990 con 0x7fedec0668e0 2023-12-06T14:58:01.813 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:01.810+0000 7fedf2ee8700 1 -- 172.21.15.152:0/3249251320 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedec10f060 con 0x7fedec0668e0 2023-12-06T14:58:01.814 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:01.811+0000 7fedf2ee8700 1 -- 172.21.15.152:0/3249251320 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedec04bb80 con 0x7fedec0668e0 2023-12-06T14:58:01.814 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:01.812+0000 7fede97fa700 1 -- 172.21.15.152:0/3249251320 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fede000cc00 con 0x7fedec0668e0 2023-12-06T14:58:01.814 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:01.812+0000 7fede97fa700 1 --2- 172.21.15.152:0/3249251320 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7feddc068f60 0x7feddc06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:01.814 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:01.812+0000 7fede97fa700 1 -- 172.21.15.152:0/3249251320 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fede00869a0 con 0x7fedec0668e0 2023-12-06T14:58:01.814 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:01.812+0000 7fedebfff700 1 --2- 172.21.15.152:0/3249251320 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7feddc068f60 0x7feddc06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:01.814 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:01.813+0000 7fedebfff700 1 --2- 172.21.15.152:0/3249251320 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7feddc068f60 0x7feddc06b410 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fedd800b0d0 tx=0x7fedd8009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:01.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:01.817+0000 7fede97fa700 1 -- 172.21.15.152:0/3249251320 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fede004da00 con 0x7fedec0668e0 2023-12-06T14:58:01.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:01 smithi190 ceph-mon[121340]: osdmap e42: 6 total, 6 up, 6 in 2023-12-06T14:58:02.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:02.040+0000 7fedf2ee8700 1 -- 172.21.15.152:0/3249251320 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fedec10f410 con 0x7fedec0668e0 2023-12-06T14:58:02.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:02.041+0000 7fede97fa700 1 -- 172.21.15.152:0/3249251320 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7fede0019450 con 0x7fedec0668e0 2023-12-06T14:58:02.041 INFO:teuthology.orchestra.run.smithi152.stdout:e2 2023-12-06T14:58:02.041 INFO:teuthology.orchestra.run.smithi152.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-06T14:58:02.041 INFO:teuthology.orchestra.run.smithi152.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-06T14:58:02.041 INFO:teuthology.orchestra.run.smithi152.stdout:legacy client fscid: 1 2023-12-06T14:58:02.041 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:58:02.041 INFO:teuthology.orchestra.run.smithi152.stdout:Filesystem 'cephfs' (1) 2023-12-06T14:58:02.041 INFO:teuthology.orchestra.run.smithi152.stdout:fs_name cephfs 2023-12-06T14:58:02.042 INFO:teuthology.orchestra.run.smithi152.stdout:epoch 2 2023-12-06T14:58:02.042 INFO:teuthology.orchestra.run.smithi152.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2023-12-06T14:58:02.042 INFO:teuthology.orchestra.run.smithi152.stdout:created 2023-12-06T14:57:59.352201+0000 2023-12-06T14:58:02.042 INFO:teuthology.orchestra.run.smithi152.stdout:modified 2023-12-06T14:57:59.352269+0000 2023-12-06T14:58:02.042 INFO:teuthology.orchestra.run.smithi152.stdout:tableserver 0 2023-12-06T14:58:02.042 INFO:teuthology.orchestra.run.smithi152.stdout:root 0 2023-12-06T14:58:02.042 INFO:teuthology.orchestra.run.smithi152.stdout:session_timeout 60 2023-12-06T14:58:02.042 INFO:teuthology.orchestra.run.smithi152.stdout:session_autoclose 300 2023-12-06T14:58:02.042 INFO:teuthology.orchestra.run.smithi152.stdout:max_file_size 1099511627776 2023-12-06T14:58:02.042 INFO:teuthology.orchestra.run.smithi152.stdout:required_client_features {} 2023-12-06T14:58:02.042 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure 0 2023-12-06T14:58:02.042 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure_osd_epoch 0 2023-12-06T14:58:02.042 INFO:teuthology.orchestra.run.smithi152.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-06T14:58:02.042 INFO:teuthology.orchestra.run.smithi152.stdout:max_mds 1 2023-12-06T14:58:02.043 INFO:teuthology.orchestra.run.smithi152.stdout:in 2023-12-06T14:58:02.043 INFO:teuthology.orchestra.run.smithi152.stdout:up {} 2023-12-06T14:58:02.043 INFO:teuthology.orchestra.run.smithi152.stdout:failed 2023-12-06T14:58:02.043 INFO:teuthology.orchestra.run.smithi152.stdout:damaged 2023-12-06T14:58:02.043 INFO:teuthology.orchestra.run.smithi152.stdout:stopped 2023-12-06T14:58:02.043 INFO:teuthology.orchestra.run.smithi152.stdout:data_pools [3] 2023-12-06T14:58:02.043 INFO:teuthology.orchestra.run.smithi152.stdout:metadata_pool 2 2023-12-06T14:58:02.043 INFO:teuthology.orchestra.run.smithi152.stdout:inline_data disabled 2023-12-06T14:58:02.043 INFO:teuthology.orchestra.run.smithi152.stdout:balancer 2023-12-06T14:58:02.043 INFO:teuthology.orchestra.run.smithi152.stdout:standby_count_wanted 0 2023-12-06T14:58:02.043 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:58:02.043 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:58:02.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:02.043+0000 7fedf2ee8700 1 -- 172.21.15.152:0/3249251320 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7feddc068f60 msgr2=0x7feddc06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:02.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:02.043+0000 7fedf2ee8700 1 --2- 172.21.15.152:0/3249251320 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7feddc068f60 0x7feddc06b410 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fedd800b0d0 tx=0x7fedd8009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:02.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:02.043+0000 7fedf2ee8700 1 -- 172.21.15.152:0/3249251320 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedec0668e0 msgr2=0x7fedec10d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:02.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:02.043+0000 7fedf2ee8700 1 --2- 172.21.15.152:0/3249251320 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedec0668e0 0x7fedec10d4c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fede000eb40 tx=0x7fede000b040 comp rx=0 tx=0).stop 2023-12-06T14:58:02.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:02.043+0000 7fedf2ee8700 1 -- 172.21.15.152:0/3249251320 shutdown_connections 2023-12-06T14:58:02.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:02.043+0000 7fedf2ee8700 1 --2- 172.21.15.152:0/3249251320 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7feddc068f60 0x7feddc06b410 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:02.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:02.043+0000 7fedf2ee8700 1 --2- 172.21.15.152:0/3249251320 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedec0668e0 0x7fedec10d4c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:02.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:02.043+0000 7fedf2ee8700 1 --2- 172.21.15.152:0/3249251320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fedec0ffdb0 0x7fedec10da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:02.045 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:02.043+0000 7fedf2ee8700 1 -- 172.21.15.152:0/3249251320 >> 172.21.15.152:0/3249251320 conn(0x7fedec0f71b0 msgr2=0x7fedec0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:02.045 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:02.043+0000 7fedf2ee8700 1 -- 172.21.15.152:0/3249251320 shutdown_connections 2023-12-06T14:58:02.045 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:02.043+0000 7fedf2ee8700 1 -- 172.21.15.152:0/3249251320 wait complete. 2023-12-06T14:58:02.045 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 2 2023-12-06T14:58:02.441 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-06T14:58:02.452 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi152.front.sepia.ceph.com 2023-12-06T14:58:02.452 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- bash -c 'ceph fs set cephfs max_mds 2' 2023-12-06T14:58:02.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:02 smithi152 ceph-mon[111954]: pgmap v130: 65 pgs: 34 unknown, 31 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:58:02.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:02 smithi152 ceph-mon[111954]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-12-06T14:58:02.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:02 smithi152 ceph-mon[111954]: osdmap e43: 6 total, 6 up, 6 in 2023-12-06T14:58:02.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:02 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:02.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:02 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:02.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:02 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:02.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:02 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi190.uucxzu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-06T14:58:02.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:02 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi190.uucxzu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-06T14:58:02.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:02 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:58:02.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:02 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/3249251320' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-06T14:58:02.703 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:02 smithi190 ceph-mon[121340]: pgmap v130: 65 pgs: 34 unknown, 31 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:58:02.703 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:02 smithi190 ceph-mon[121340]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-12-06T14:58:02.703 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:02 smithi190 ceph-mon[121340]: osdmap e43: 6 total, 6 up, 6 in 2023-12-06T14:58:02.703 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:02 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:02.704 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:02 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:02.704 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:02 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:02.704 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:02 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi190.uucxzu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-06T14:58:02.704 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:02 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi190.uucxzu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-06T14:58:02.704 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:02 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:58:02.704 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:02 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/3249251320' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-06T14:58:02.720 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:58:03.554 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:03 smithi152 ceph-mon[111954]: Deploying daemon mds.cephfs.smithi190.uucxzu on smithi190 2023-12-06T14:58:03.554 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:03 smithi152 ceph-mon[111954]: mds.? [v2:172.21.15.152:6826/2467413186,v1:172.21.15.152:6827/2467413186] up:boot 2023-12-06T14:58:03.554 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:03 smithi152 ceph-mon[111954]: daemon mds.cephfs.smithi152.acqswy assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2023-12-06T14:58:03.554 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:03 smithi152 ceph-mon[111954]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-06T14:58:03.554 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:03 smithi152 ceph-mon[111954]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-06T14:58:03.554 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:03 smithi152 ceph-mon[111954]: Cluster is now healthy 2023-12-06T14:58:03.554 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:03 smithi152 ceph-mon[111954]: fsmap cephfs:0 1 up:standby 2023-12-06T14:58:03.554 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:03 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.acqswy"}]: dispatch 2023-12-06T14:58:03.554 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:03 smithi152 ceph-mon[111954]: fsmap cephfs:1 {0=cephfs.smithi152.acqswy=up:creating} 2023-12-06T14:58:03.554 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:03 smithi152 ceph-mon[111954]: daemon mds.cephfs.smithi152.acqswy is now active in filesystem cephfs as rank 0 2023-12-06T14:58:03.554 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:03 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:03.554 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:03 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:03.555 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:03 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:03.555 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:03 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.ypivwc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-06T14:58:03.555 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:03 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.ypivwc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-06T14:58:03.555 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:03 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:58:03.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:03 smithi190 ceph-mon[121340]: Deploying daemon mds.cephfs.smithi190.uucxzu on smithi190 2023-12-06T14:58:03.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:03 smithi190 ceph-mon[121340]: mds.? [v2:172.21.15.152:6826/2467413186,v1:172.21.15.152:6827/2467413186] up:boot 2023-12-06T14:58:03.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:03 smithi190 ceph-mon[121340]: daemon mds.cephfs.smithi152.acqswy assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2023-12-06T14:58:03.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:03 smithi190 ceph-mon[121340]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-06T14:58:03.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:03 smithi190 ceph-mon[121340]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-06T14:58:03.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:03 smithi190 ceph-mon[121340]: Cluster is now healthy 2023-12-06T14:58:03.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:03 smithi190 ceph-mon[121340]: fsmap cephfs:0 1 up:standby 2023-12-06T14:58:03.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:03 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.acqswy"}]: dispatch 2023-12-06T14:58:03.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:03 smithi190 ceph-mon[121340]: fsmap cephfs:1 {0=cephfs.smithi152.acqswy=up:creating} 2023-12-06T14:58:03.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:03 smithi190 ceph-mon[121340]: daemon mds.cephfs.smithi152.acqswy is now active in filesystem cephfs as rank 0 2023-12-06T14:58:03.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:03 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:03.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:03 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:03.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:03 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:03.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:03 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.ypivwc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-06T14:58:03.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:03 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.ypivwc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-06T14:58:03.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:03 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:58:03.731 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:03.730+0000 7f8843de6700 1 -- 172.21.15.152:0/383026481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f883c0fbe10 msgr2=0x7f883c0fc280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:03.731 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:03.730+0000 7f8843de6700 1 --2- 172.21.15.152:0/383026481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f883c0fbe10 0x7f883c0fc280 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f882c004940 tx=0x7f882c009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:03.731 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:03.730+0000 7f8843de6700 1 -- 172.21.15.152:0/383026481 shutdown_connections 2023-12-06T14:58:03.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:03.730+0000 7f8843de6700 1 --2- 172.21.15.152:0/383026481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f883c0fbe10 0x7f883c0fc280 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:03.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:03.730+0000 7f8843de6700 1 --2- 172.21.15.152:0/383026481 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f883c0fd190 0x7f883c0fd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:03.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:03.730+0000 7f8843de6700 1 -- 172.21.15.152:0/383026481 >> 172.21.15.152:0/383026481 conn(0x7f883c0f6950 msgr2=0x7f883c0f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:03.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:03.731+0000 7f8843de6700 1 -- 172.21.15.152:0/383026481 shutdown_connections 2023-12-06T14:58:03.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:03.731+0000 7f8843de6700 1 -- 172.21.15.152:0/383026481 wait complete. 2023-12-06T14:58:03.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:03.731+0000 7f8843de6700 1 Processor -- start 2023-12-06T14:58:03.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:03.731+0000 7f8843de6700 1 -- start start 2023-12-06T14:58:03.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:03.731+0000 7f8843de6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f883c0fbe10 0x7f883c10d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:03.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:03.731+0000 7f8843de6700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f883c0fd190 0x7f883c10da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:03.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:03.731+0000 7f8843de6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883c10e060 con 0x7f883c0fbe10 2023-12-06T14:58:03.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:03.731+0000 7f8843de6700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883c10e900 con 0x7f883c0fd190 2023-12-06T14:58:03.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:03.731+0000 7f8841b82700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f883c0fbe10 0x7f883c10d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:03.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:03.731+0000 7f8841b82700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f883c0fbe10 0x7f883c10d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47884/0 (socket says 172.21.15.152:47884) 2023-12-06T14:58:03.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:03.731+0000 7f8841b82700 1 -- 172.21.15.152:0/1685316986 learned_addr learned my addr 172.21.15.152:0/1685316986 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:58:03.733 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:03.731+0000 7f8841381700 1 --2- 172.21.15.152:0/1685316986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f883c0fd190 0x7f883c10da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:03.734 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:03.732+0000 7f8841b82700 1 -- 172.21.15.152:0/1685316986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f883c0fd190 msgr2=0x7f883c10da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:03.734 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:03.732+0000 7f8841b82700 1 --2- 172.21.15.152:0/1685316986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f883c0fd190 0x7f883c10da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:03.734 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:03.732+0000 7f8841b82700 1 -- 172.21.15.152:0/1685316986 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f882c005040 con 0x7f883c0fbe10 2023-12-06T14:58:03.734 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:03.732+0000 7f8841b82700 1 --2- 172.21.15.152:0/1685316986 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f883c0fbe10 0x7f883c10d520 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8838002a80 tx=0x7f88380046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:03.734 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:03.732+0000 7f88327fc700 1 -- 172.21.15.152:0/1685316986 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8838007cc0 con 0x7f883c0fbe10 2023-12-06T14:58:03.734 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:03.732+0000 7f8843de6700 1 -- 172.21.15.152:0/1685316986 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f883c10ebe0 con 0x7f883c0fbe10 2023-12-06T14:58:03.734 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:03.732+0000 7f88327fc700 1 -- 172.21.15.152:0/1685316986 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f883800f040 con 0x7f883c0fbe10 2023-12-06T14:58:03.734 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:03.732+0000 7f88327fc700 1 -- 172.21.15.152:0/1685316986 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f883800da60 con 0x7f883c0fbe10 2023-12-06T14:58:03.734 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:03.733+0000 7f8843de6700 1 -- 172.21.15.152:0/1685316986 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f883c10f120 con 0x7f883c0fbe10 2023-12-06T14:58:03.734 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:03.733+0000 7f88327fc700 1 -- 172.21.15.152:0/1685316986 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f883800dbc0 con 0x7f883c0fbe10 2023-12-06T14:58:03.734 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:03.734+0000 7f8843de6700 1 -- 172.21.15.152:0/1685316986 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f883c04bb80 con 0x7f883c0fbe10 2023-12-06T14:58:03.735 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:03.734+0000 7f88327fc700 1 --2- 172.21.15.152:0/1685316986 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f8828068f70 0x7f882806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:03.735 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:03.734+0000 7f88327fc700 1 -- 172.21.15.152:0/1685316986 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f8838086770 con 0x7f883c0fbe10 2023-12-06T14:58:03.735 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:03.734+0000 7f8841381700 1 --2- 172.21.15.152:0/1685316986 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f8828068f70 0x7f882806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:03.735 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:03.734+0000 7f8841381700 1 --2- 172.21.15.152:0/1685316986 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f8828068f70 0x7f882806b420 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f882c004560 tx=0x7f882c009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:03.738 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:03.739+0000 7f88327fc700 1 -- 172.21.15.152:0/1685316986 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f88380566d0 con 0x7f883c0fbe10 2023-12-06T14:58:03.981 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:03.981+0000 7f8843de6700 1 -- 172.21.15.152:0/1685316986 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f883c10f540 con 0x7f883c0fbe10 2023-12-06T14:58:04.394 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:04.393+0000 7f88327fc700 1 -- 172.21.15.152:0/1685316986 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v7) v1 ==== 105+0+0 (secure 0 0 0) 0x7f8838056260 con 0x7f883c0fbe10 2023-12-06T14:58:04.396 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:04.395+0000 7f8843de6700 1 -- 172.21.15.152:0/1685316986 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f8828068f70 msgr2=0x7f882806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:04.396 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:04.395+0000 7f8843de6700 1 --2- 172.21.15.152:0/1685316986 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f8828068f70 0x7f882806b420 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f882c004560 tx=0x7f882c009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:04.396 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:04.396+0000 7f8843de6700 1 -- 172.21.15.152:0/1685316986 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f883c0fbe10 msgr2=0x7f883c10d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:04.396 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:04.396+0000 7f8843de6700 1 --2- 172.21.15.152:0/1685316986 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f883c0fbe10 0x7f883c10d520 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8838002a80 tx=0x7f88380046b0 comp rx=0 tx=0).stop 2023-12-06T14:58:04.396 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:04.396+0000 7f8843de6700 1 -- 172.21.15.152:0/1685316986 shutdown_connections 2023-12-06T14:58:04.396 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:04.396+0000 7f8843de6700 1 --2- 172.21.15.152:0/1685316986 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f883c0fbe10 0x7f883c10d520 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:04.396 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:04.396+0000 7f8843de6700 1 --2- 172.21.15.152:0/1685316986 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f8828068f70 0x7f882806b420 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:04.396 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:04.396+0000 7f8843de6700 1 --2- 172.21.15.152:0/1685316986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f883c0fd190 0x7f883c10da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:04.396 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:04.396+0000 7f8843de6700 1 -- 172.21.15.152:0/1685316986 >> 172.21.15.152:0/1685316986 conn(0x7f883c0f6950 msgr2=0x7f883c0fad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:04.396 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:04.396+0000 7f8843de6700 1 -- 172.21.15.152:0/1685316986 shutdown_connections 2023-12-06T14:58:04.396 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:04.396+0000 7f8843de6700 1 -- 172.21.15.152:0/1685316986 wait complete. 2023-12-06T14:58:04.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:04 smithi190 ceph-mon[121340]: pgmap v132: 65 pgs: 65 active+clean; 578 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 3 op/s 2023-12-06T14:58:04.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:04 smithi190 ceph-mon[121340]: Deploying daemon mds.cephfs.smithi152.ypivwc on smithi152 2023-12-06T14:58:04.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:04 smithi190 ceph-mon[121340]: mds.? [v2:172.21.15.152:6826/2467413186,v1:172.21.15.152:6827/2467413186] up:active 2023-12-06T14:58:04.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:04 smithi190 ceph-mon[121340]: mds.? [v2:172.21.15.190:6824/3250692478,v1:172.21.15.190:6825/3250692478] up:boot 2023-12-06T14:58:04.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:04 smithi190 ceph-mon[121340]: fsmap cephfs:1 {0=cephfs.smithi152.acqswy=up:active} 1 up:standby 2023-12-06T14:58:04.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:04 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi190.uucxzu"}]: dispatch 2023-12-06T14:58:04.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:04 smithi190 ceph-mon[121340]: fsmap cephfs:1 {0=cephfs.smithi152.acqswy=up:active} 1 up:standby 2023-12-06T14:58:04.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:04 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/1685316986' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2023-12-06T14:58:04.646 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:04 smithi152 ceph-mon[111954]: pgmap v132: 65 pgs: 65 active+clean; 578 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 3 op/s 2023-12-06T14:58:04.646 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:04 smithi152 ceph-mon[111954]: Deploying daemon mds.cephfs.smithi152.ypivwc on smithi152 2023-12-06T14:58:04.646 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:04 smithi152 ceph-mon[111954]: mds.? [v2:172.21.15.152:6826/2467413186,v1:172.21.15.152:6827/2467413186] up:active 2023-12-06T14:58:04.646 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:04 smithi152 ceph-mon[111954]: mds.? [v2:172.21.15.190:6824/3250692478,v1:172.21.15.190:6825/3250692478] up:boot 2023-12-06T14:58:04.646 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:04 smithi152 ceph-mon[111954]: fsmap cephfs:1 {0=cephfs.smithi152.acqswy=up:active} 1 up:standby 2023-12-06T14:58:04.646 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:04 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi190.uucxzu"}]: dispatch 2023-12-06T14:58:04.646 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:04 smithi152 ceph-mon[111954]: fsmap cephfs:1 {0=cephfs.smithi152.acqswy=up:active} 1 up:standby 2023-12-06T14:58:04.647 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:04 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/1685316986' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2023-12-06T14:58:04.808 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-06T14:58:04.818 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi152.front.sepia.ceph.com 2023-12-06T14:58:04.818 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2023-12-06T14:58:05.245 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:58:05.653 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:05 smithi152 ceph-mon[111954]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-06T14:58:05.653 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:05 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/1685316986' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2023-12-06T14:58:05.653 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:05 smithi152 ceph-mon[111954]: daemon mds.cephfs.smithi190.uucxzu assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-12-06T14:58:05.654 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:05 smithi152 ceph-mon[111954]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2023-12-06T14:58:05.654 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:05 smithi152 ceph-mon[111954]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-06T14:58:05.654 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:05 smithi152 ceph-mon[111954]: fsmap cephfs:1 {0=cephfs.smithi152.acqswy=up:active} 1 up:standby 2023-12-06T14:58:05.654 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:05 smithi152 ceph-mon[111954]: fsmap cephfs:2 {0=cephfs.smithi152.acqswy=up:active,1=cephfs.smithi190.uucxzu=up:creating} 2023-12-06T14:58:05.654 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:05 smithi152 ceph-mon[111954]: daemon mds.cephfs.smithi190.uucxzu is now active in filesystem cephfs as rank 1 2023-12-06T14:58:05.654 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:05 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:05.654 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:05 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:05.654 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:05 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:05.654 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:05 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi190.edwtqj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-06T14:58:05.654 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:05 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi190.edwtqj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-06T14:58:05.654 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:05 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:58:05.738 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:05 smithi190 ceph-mon[121340]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-06T14:58:05.738 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:05 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/1685316986' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2023-12-06T14:58:05.738 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:05 smithi190 ceph-mon[121340]: daemon mds.cephfs.smithi190.uucxzu assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-12-06T14:58:05.738 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:05 smithi190 ceph-mon[121340]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2023-12-06T14:58:05.738 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:05 smithi190 ceph-mon[121340]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-06T14:58:05.738 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:05 smithi190 ceph-mon[121340]: fsmap cephfs:1 {0=cephfs.smithi152.acqswy=up:active} 1 up:standby 2023-12-06T14:58:05.738 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:05 smithi190 ceph-mon[121340]: fsmap cephfs:2 {0=cephfs.smithi152.acqswy=up:active,1=cephfs.smithi190.uucxzu=up:creating} 2023-12-06T14:58:05.738 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:05 smithi190 ceph-mon[121340]: daemon mds.cephfs.smithi190.uucxzu is now active in filesystem cephfs as rank 1 2023-12-06T14:58:05.739 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:05 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:05.739 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:05 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:05.739 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:05 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:05.739 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:05 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi190.edwtqj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-06T14:58:05.739 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:05 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi190.edwtqj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-06T14:58:05.739 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:05 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:58:06.416 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:06.415+0000 7f065e437700 1 -- 172.21.15.152:0/3035623355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06580fcd00 msgr2=0x7f06580fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:06.416 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:06.415+0000 7f065e437700 1 --2- 172.21.15.152:0/3035623355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06580fcd00 0x7f06580fd150 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0648004940 tx=0x7f0648009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:06.416 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:06.415+0000 7f065e437700 1 -- 172.21.15.152:0/3035623355 shutdown_connections 2023-12-06T14:58:06.416 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:06.415+0000 7f065e437700 1 --2- 172.21.15.152:0/3035623355 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06580fcd00 0x7f06580fd150 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:06.416 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:06.415+0000 7f065e437700 1 --2- 172.21.15.152:0/3035623355 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06580fbaf0 0x7f06580fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:06.416 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:06.415+0000 7f065e437700 1 -- 172.21.15.152:0/3035623355 >> 172.21.15.152:0/3035623355 conn(0x7f06580f7190 msgr2=0x7f06580f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:06.416 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:06.415+0000 7f065e437700 1 -- 172.21.15.152:0/3035623355 shutdown_connections 2023-12-06T14:58:06.416 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:06.415+0000 7f065e437700 1 -- 172.21.15.152:0/3035623355 wait complete. 2023-12-06T14:58:06.417 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:06.416+0000 7f065e437700 1 Processor -- start 2023-12-06T14:58:06.417 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:06.416+0000 7f065e437700 1 -- start start 2023-12-06T14:58:06.418 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:06.416+0000 7f065e437700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06580fbaf0 0x7f065810c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:06.418 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:06.416+0000 7f065e437700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06580fcd00 0x7f065810c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:06.419 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:06.416+0000 7f065e437700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065810cfb0 con 0x7f06580fbaf0 2023-12-06T14:58:06.419 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:06.416+0000 7f065e437700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065810d850 con 0x7f06580fcd00 2023-12-06T14:58:06.419 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:06.416+0000 7f0657fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06580fbaf0 0x7f065810c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:06.419 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:06.416+0000 7f0657fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06580fbaf0 0x7f065810c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47914/0 (socket says 172.21.15.152:47914) 2023-12-06T14:58:06.419 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:06.416+0000 7f0657fff700 1 -- 172.21.15.152:0/4044705782 learned_addr learned my addr 172.21.15.152:0/4044705782 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:58:06.419 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:06.416+0000 7f06577fe700 1 --2- 172.21.15.152:0/4044705782 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06580fcd00 0x7f065810c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:06.419 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:06.416+0000 7f0657fff700 1 -- 172.21.15.152:0/4044705782 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06580fcd00 msgr2=0x7f065810c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:06.419 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:06.416+0000 7f0657fff700 1 --2- 172.21.15.152:0/4044705782 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06580fcd00 0x7f065810c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:06.419 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:06.416+0000 7f0657fff700 1 -- 172.21.15.152:0/4044705782 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0648005040 con 0x7f06580fbaf0 2023-12-06T14:58:06.419 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:06.417+0000 7f0657fff700 1 --2- 172.21.15.152:0/4044705782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06580fbaf0 0x7f065810c470 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f064c002a80 tx=0x7f064c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:06.419 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:06.417+0000 7f0654ff9700 1 -- 172.21.15.152:0/4044705782 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f064c007cc0 con 0x7f06580fbaf0 2023-12-06T14:58:06.419 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:06.417+0000 7f0654ff9700 1 -- 172.21.15.152:0/4044705782 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f064c00f040 con 0x7f06580fbaf0 2023-12-06T14:58:06.419 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:06.417+0000 7f065e437700 1 -- 172.21.15.152:0/4044705782 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f065810db30 con 0x7f06580fbaf0 2023-12-06T14:58:06.419 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:06.417+0000 7f0654ff9700 1 -- 172.21.15.152:0/4044705782 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f064c00d9c0 con 0x7f06580fbaf0 2023-12-06T14:58:06.419 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:06.417+0000 7f065e437700 1 -- 172.21.15.152:0/4044705782 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f065810e070 con 0x7f06580fbaf0 2023-12-06T14:58:06.420 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:06.418+0000 7f065e437700 1 -- 172.21.15.152:0/4044705782 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f065804bb80 con 0x7f06580fbaf0 2023-12-06T14:58:06.420 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:06.418+0000 7f0654ff9700 1 -- 172.21.15.152:0/4044705782 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f064c00db20 con 0x7f06580fbaf0 2023-12-06T14:58:06.420 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:06.418+0000 7f0654ff9700 1 --2- 172.21.15.152:0/4044705782 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f0640068f60 0x7f064006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:06.420 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:06.419+0000 7f0654ff9700 1 -- 172.21.15.152:0/4044705782 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f064c086ad0 con 0x7f06580fbaf0 2023-12-06T14:58:06.420 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:06.419+0000 7f06577fe700 1 --2- 172.21.15.152:0/4044705782 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f0640068f60 0x7f064006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:06.420 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:06.419+0000 7f06577fe700 1 --2- 172.21.15.152:0/4044705782 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f0640068f60 0x7f064006b410 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f064800b3b0 tx=0x7f0648009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:06.423 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:06.423+0000 7f0654ff9700 1 -- 172.21.15.152:0/4044705782 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f064c0569b0 con 0x7f06580fbaf0 2023-12-06T14:58:06.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:06 smithi152 ceph-mon[111954]: pgmap v133: 65 pgs: 65 active+clean; 578 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 542 B/s wr, 2 op/s 2023-12-06T14:58:06.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:06 smithi152 ceph-mon[111954]: Deploying daemon mds.cephfs.smithi190.edwtqj on smithi190 2023-12-06T14:58:06.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:06 smithi152 ceph-mon[111954]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2023-12-06T14:58:06.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:06 smithi152 ceph-mon[111954]: Cluster is now healthy 2023-12-06T14:58:06.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:06 smithi152 ceph-mon[111954]: mds.? [v2:172.21.15.190:6824/3250692478,v1:172.21.15.190:6825/3250692478] up:active 2023-12-06T14:58:06.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:06 smithi152 ceph-mon[111954]: mds.? [v2:172.21.15.152:6828/697313573,v1:172.21.15.152:6829/697313573] up:boot 2023-12-06T14:58:06.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:06 smithi152 ceph-mon[111954]: fsmap cephfs:2 {0=cephfs.smithi152.acqswy=up:active,1=cephfs.smithi190.uucxzu=up:active} 1 up:standby 2023-12-06T14:58:06.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:06 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.ypivwc"}]: dispatch 2023-12-06T14:58:06.648 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:06.648+0000 7f065e437700 1 -- 172.21.15.152:0/4044705782 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f0658104490 con 0x7f06580fbaf0 2023-12-06T14:58:06.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:06 smithi190 ceph-mon[121340]: pgmap v133: 65 pgs: 65 active+clean; 578 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 542 B/s wr, 2 op/s 2023-12-06T14:58:06.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:06 smithi190 ceph-mon[121340]: Deploying daemon mds.cephfs.smithi190.edwtqj on smithi190 2023-12-06T14:58:06.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:06 smithi190 ceph-mon[121340]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2023-12-06T14:58:06.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:06 smithi190 ceph-mon[121340]: Cluster is now healthy 2023-12-06T14:58:06.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:06 smithi190 ceph-mon[121340]: mds.? [v2:172.21.15.190:6824/3250692478,v1:172.21.15.190:6825/3250692478] up:active 2023-12-06T14:58:06.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:06 smithi190 ceph-mon[121340]: mds.? [v2:172.21.15.152:6828/697313573,v1:172.21.15.152:6829/697313573] up:boot 2023-12-06T14:58:06.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:06 smithi190 ceph-mon[121340]: fsmap cephfs:2 {0=cephfs.smithi152.acqswy=up:active,1=cephfs.smithi190.uucxzu=up:active} 1 up:standby 2023-12-06T14:58:06.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:06 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.ypivwc"}]: dispatch 2023-12-06T14:58:07.392 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:07.392+0000 7f0654ff9700 1 -- 172.21.15.152:0/4044705782 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v10) v1 ==== 121+0+0 (secure 0 0 0) 0x7f064c056540 con 0x7f06580fbaf0 2023-12-06T14:58:07.395 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:07.395+0000 7f065e437700 1 -- 172.21.15.152:0/4044705782 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f0640068f60 msgr2=0x7f064006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:07.395 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:07.395+0000 7f065e437700 1 --2- 172.21.15.152:0/4044705782 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f0640068f60 0x7f064006b410 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f064800b3b0 tx=0x7f0648009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:07.395 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:07.395+0000 7f065e437700 1 -- 172.21.15.152:0/4044705782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06580fbaf0 msgr2=0x7f065810c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:07.395 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:07.395+0000 7f065e437700 1 --2- 172.21.15.152:0/4044705782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06580fbaf0 0x7f065810c470 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f064c002a80 tx=0x7f064c004600 comp rx=0 tx=0).stop 2023-12-06T14:58:07.395 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:07.395+0000 7f065e437700 1 -- 172.21.15.152:0/4044705782 shutdown_connections 2023-12-06T14:58:07.395 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:07.395+0000 7f065e437700 1 --2- 172.21.15.152:0/4044705782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06580fbaf0 0x7f065810c470 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:07.395 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:07.395+0000 7f065e437700 1 --2- 172.21.15.152:0/4044705782 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f0640068f60 0x7f064006b410 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:07.395 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:07.395+0000 7f065e437700 1 --2- 172.21.15.152:0/4044705782 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06580fcd00 0x7f065810c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:07.395 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:07.395+0000 7f065e437700 1 -- 172.21.15.152:0/4044705782 >> 172.21.15.152:0/4044705782 conn(0x7f06580f7190 msgr2=0x7f06580fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:07.395 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:07.395+0000 7f065e437700 1 -- 172.21.15.152:0/4044705782 shutdown_connections 2023-12-06T14:58:07.396 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:07.395+0000 7f065e437700 1 -- 172.21.15.152:0/4044705782 wait complete. 2023-12-06T14:58:07.781 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:07 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/4044705782' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-12-06T14:58:07.781 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:07 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:07.781 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:07 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:07.781 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:07 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:07.781 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:07 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:07.781 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:07 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:07.781 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:07 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:58:07.806 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-06T14:58:07.816 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi152.front.sepia.ceph.com 2023-12-06T14:58:07.816 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- bash -c 'ceph fs set cephfs inline_data false' 2023-12-06T14:58:07.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:07 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/4044705782' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-12-06T14:58:07.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:07 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:07.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:07 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:07.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:07 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:07.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:07 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:07.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:07 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:07.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:07 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:58:08.210 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:58:08.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:08 smithi190 ceph-mon[121340]: pgmap v134: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s wr, 8 op/s 2023-12-06T14:58:08.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:08 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/4044705782' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-12-06T14:58:08.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:08 smithi190 ceph-mon[121340]: mds.? [v2:172.21.15.190:6826/2256465065,v1:172.21.15.190:6827/2256465065] up:boot 2023-12-06T14:58:08.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:08 smithi190 ceph-mon[121340]: fsmap cephfs:2 {0=cephfs.smithi152.acqswy=up:active,1=cephfs.smithi190.uucxzu=up:active} 2 up:standby 2023-12-06T14:58:08.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:08 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi190.edwtqj"}]: dispatch 2023-12-06T14:58:08.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:08 smithi190 ceph-mon[121340]: fsmap cephfs:2 {0=cephfs.smithi152.acqswy=up:active,1=cephfs.smithi190.uucxzu=up:active} 2 up:standby-replay 2023-12-06T14:58:08.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:08 smithi152 ceph-mon[111954]: pgmap v134: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s wr, 8 op/s 2023-12-06T14:58:08.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:08 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/4044705782' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-12-06T14:58:08.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:08 smithi152 ceph-mon[111954]: mds.? [v2:172.21.15.190:6826/2256465065,v1:172.21.15.190:6827/2256465065] up:boot 2023-12-06T14:58:08.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:08 smithi152 ceph-mon[111954]: fsmap cephfs:2 {0=cephfs.smithi152.acqswy=up:active,1=cephfs.smithi190.uucxzu=up:active} 2 up:standby 2023-12-06T14:58:08.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:08 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi190.edwtqj"}]: dispatch 2023-12-06T14:58:08.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:08 smithi152 ceph-mon[111954]: fsmap cephfs:2 {0=cephfs.smithi152.acqswy=up:active,1=cephfs.smithi190.uucxzu=up:active} 2 up:standby-replay 2023-12-06T14:58:09.894 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:09.894+0000 7f647af75700 1 -- 172.21.15.152:0/1624788044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6474066050 msgr2=0x7f64740ff7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:09.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:09.894+0000 7f647af75700 1 --2- 172.21.15.152:0/1624788044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6474066050 0x7f64740ff7e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6468004940 tx=0x7f6468009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:09.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:09.894+0000 7f647af75700 1 -- 172.21.15.152:0/1624788044 shutdown_connections 2023-12-06T14:58:09.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:09.894+0000 7f647af75700 1 --2- 172.21.15.152:0/1624788044 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64740ffdb0 0x7f64741021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:09.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:09.894+0000 7f647af75700 1 --2- 172.21.15.152:0/1624788044 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6474066050 0x7f64740ff7e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:09.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:09.894+0000 7f647af75700 1 -- 172.21.15.152:0/1624788044 >> 172.21.15.152:0/1624788044 conn(0x7f64740f7190 msgr2=0x7f64740f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:09.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:09.894+0000 7f647af75700 1 -- 172.21.15.152:0/1624788044 shutdown_connections 2023-12-06T14:58:09.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:09.894+0000 7f647af75700 1 -- 172.21.15.152:0/1624788044 wait complete. 2023-12-06T14:58:09.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:09.895+0000 7f647af75700 1 Processor -- start 2023-12-06T14:58:09.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:09.895+0000 7f647af75700 1 -- start start 2023-12-06T14:58:09.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:09.895+0000 7f647af75700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6474066050 0x7f647410d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:09.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:09.895+0000 7f647af75700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64740ffdb0 0x7f647410db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:09.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:09.895+0000 7f647af75700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647410e110 con 0x7f64740ffdb0 2023-12-06T14:58:09.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:09.895+0000 7f647af75700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647410e960 con 0x7f6474066050 2023-12-06T14:58:09.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:09.895+0000 7f6473fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64740ffdb0 0x7f647410db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:09.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:09.895+0000 7f6478d11700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6474066050 0x7f647410d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:09.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:09.895+0000 7f6473fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64740ffdb0 0x7f647410db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52694/0 (socket says 172.21.15.152:52694) 2023-12-06T14:58:09.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:09.895+0000 7f6473fff700 1 -- 172.21.15.152:0/2472135921 learned_addr learned my addr 172.21.15.152:0/2472135921 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:58:09.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:09.896+0000 7f6478d11700 1 -- 172.21.15.152:0/2472135921 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64740ffdb0 msgr2=0x7f647410db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:09.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:09.896+0000 7f6478d11700 1 --2- 172.21.15.152:0/2472135921 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64740ffdb0 0x7f647410db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:09.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:09.896+0000 7f6478d11700 1 -- 172.21.15.152:0/2472135921 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6468005040 con 0x7f6474066050 2023-12-06T14:58:09.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:09.896+0000 7f6478d11700 1 --2- 172.21.15.152:0/2472135921 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6474066050 0x7f647410d5d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6468000c00 tx=0x7f6468009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:09.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:09.896+0000 7f64717fa700 1 -- 172.21.15.152:0/2472135921 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f646800e040 con 0x7f6474066050 2023-12-06T14:58:09.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:09.896+0000 7f64717fa700 1 -- 172.21.15.152:0/2472135921 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f646800bc50 con 0x7f6474066050 2023-12-06T14:58:09.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:09.896+0000 7f64717fa700 1 -- 172.21.15.152:0/2472135921 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6468013420 con 0x7f6474066050 2023-12-06T14:58:09.898 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:09.896+0000 7f647af75700 1 -- 172.21.15.152:0/2472135921 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f647410ebe0 con 0x7f6474066050 2023-12-06T14:58:09.898 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:09.896+0000 7f647af75700 1 -- 172.21.15.152:0/2472135921 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f647410f120 con 0x7f6474066050 2023-12-06T14:58:09.898 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:09.897+0000 7f647af75700 1 -- 172.21.15.152:0/2472135921 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64741075e0 con 0x7f6474066050 2023-12-06T14:58:09.899 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:09.899+0000 7f64717fa700 1 -- 172.21.15.152:0/2472135921 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f646801c430 con 0x7f6474066050 2023-12-06T14:58:09.899 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:09.899+0000 7f64717fa700 1 --2- 172.21.15.152:0/2472135921 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f6464068f60 0x7f646406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:09.899 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:09.899+0000 7f64717fa700 1 -- 172.21.15.152:0/2472135921 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f6468088150 con 0x7f6474066050 2023-12-06T14:58:09.899 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:09.899+0000 7f6473fff700 1 --2- 172.21.15.152:0/2472135921 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f6464068f60 0x7f646406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:09.900 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:09.900+0000 7f6473fff700 1 --2- 172.21.15.152:0/2472135921 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f6464068f60 0x7f646406b410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f64600041d0 tx=0x7f6460004470 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:09.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:09.903+0000 7f64717fa700 1 -- 172.21.15.152:0/2472135921 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f6468058150 con 0x7f6474066050 2023-12-06T14:58:09.913 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:09 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:09.914 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:09 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:09.914 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:09 smithi152 ceph-mon[111954]: pgmap v135: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 710 B/s rd, 2.8 KiB/s wr, 10 op/s 2023-12-06T14:58:09.914 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:09 smithi152 ceph-mon[111954]: mds.? [v2:172.21.15.190:6824/3250692478,v1:172.21.15.190:6825/3250692478] up:active 2023-12-06T14:58:09.914 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:09 smithi152 ceph-mon[111954]: mds.? [v2:172.21.15.152:6828/697313573,v1:172.21.15.152:6829/697313573] up:standby-replay 2023-12-06T14:58:09.914 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:09 smithi152 ceph-mon[111954]: fsmap cephfs:2 {0=cephfs.smithi152.acqswy=up:active,1=cephfs.smithi190.uucxzu=up:active} 2 up:standby-replay 2023-12-06T14:58:10.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:09 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:10.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:09 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:10.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:09 smithi190 ceph-mon[121340]: pgmap v135: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 710 B/s rd, 2.8 KiB/s wr, 10 op/s 2023-12-06T14:58:10.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:09 smithi190 ceph-mon[121340]: mds.? [v2:172.21.15.190:6824/3250692478,v1:172.21.15.190:6825/3250692478] up:active 2023-12-06T14:58:10.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:09 smithi190 ceph-mon[121340]: mds.? [v2:172.21.15.152:6828/697313573,v1:172.21.15.152:6829/697313573] up:standby-replay 2023-12-06T14:58:10.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:09 smithi190 ceph-mon[121340]: fsmap cephfs:2 {0=cephfs.smithi152.acqswy=up:active,1=cephfs.smithi190.uucxzu=up:active} 2 up:standby-replay 2023-12-06T14:58:10.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:10.168+0000 7f647af75700 1 -- 172.21.15.152:0/2472135921 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7f647410ed70 con 0x7f6474066050 2023-12-06T14:58:10.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:10.970+0000 7f64717fa700 1 -- 172.21.15.152:0/2472135921 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v13) v1 ==== 133+0+0 (secure 0 0 0) 0x7f647410ed70 con 0x7f6474066050 2023-12-06T14:58:10.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:10.972+0000 7f647af75700 1 -- 172.21.15.152:0/2472135921 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f6464068f60 msgr2=0x7f646406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:10.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:10.972+0000 7f647af75700 1 --2- 172.21.15.152:0/2472135921 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f6464068f60 0x7f646406b410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f64600041d0 tx=0x7f6460004470 comp rx=0 tx=0).stop 2023-12-06T14:58:10.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:10.972+0000 7f647af75700 1 -- 172.21.15.152:0/2472135921 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6474066050 msgr2=0x7f647410d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:10.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:10.972+0000 7f647af75700 1 --2- 172.21.15.152:0/2472135921 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6474066050 0x7f647410d5d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6468000c00 tx=0x7f6468009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:10.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:10.972+0000 7f647af75700 1 -- 172.21.15.152:0/2472135921 shutdown_connections 2023-12-06T14:58:10.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:10.972+0000 7f647af75700 1 --2- 172.21.15.152:0/2472135921 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f6464068f60 0x7f646406b410 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:10.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:10.972+0000 7f647af75700 1 --2- 172.21.15.152:0/2472135921 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6474066050 0x7f647410d5d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:10.973 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:10.972+0000 7f647af75700 1 --2- 172.21.15.152:0/2472135921 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64740ffdb0 0x7f647410db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:10.973 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:10.972+0000 7f647af75700 1 -- 172.21.15.152:0/2472135921 >> 172.21.15.152:0/2472135921 conn(0x7f64740f7190 msgr2=0x7f64740f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:10.973 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:10.972+0000 7f647af75700 1 -- 172.21.15.152:0/2472135921 shutdown_connections 2023-12-06T14:58:10.973 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:10.972+0000 7f647af75700 1 -- 172.21.15.152:0/2472135921 wait complete. 2023-12-06T14:58:10.973 INFO:teuthology.orchestra.run.smithi152.stderr:inline data disabled 2023-12-06T14:58:11.289 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:10 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/2472135921' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2023-12-06T14:58:11.289 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:10 smithi152 ceph-mon[111954]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2023-12-06T14:58:11.289 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:10 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:11.289 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:10 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:11.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:10 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/2472135921' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2023-12-06T14:58:11.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:10 smithi190 ceph-mon[121340]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2023-12-06T14:58:11.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:10 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:11.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:10 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:11.341 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-06T14:58:11.351 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi152.front.sepia.ceph.com 2023-12-06T14:58:11.352 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- bash -c 'ceph fs dump' 2023-12-06T14:58:11.782 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:58:12.035 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:11 smithi152 ceph-mon[111954]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2023-12-06T14:58:12.035 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:11 smithi152 ceph-mon[111954]: mds.? [v2:172.21.15.152:6826/2467413186,v1:172.21.15.152:6827/2467413186] up:active 2023-12-06T14:58:12.035 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:11 smithi152 ceph-mon[111954]: fsmap cephfs:2 {0=cephfs.smithi152.acqswy=up:active,1=cephfs.smithi190.uucxzu=up:active} 2 up:standby-replay 2023-12-06T14:58:12.035 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:11 smithi152 ceph-mon[111954]: pgmap v136: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2.4 KiB/s wr, 10 op/s 2023-12-06T14:58:12.036 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:11 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:58:12.036 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:11 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:58:12.036 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:11 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:12.036 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:11 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:58:12.036 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:11 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:12.036 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:11 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:58:12.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:11 smithi190 ceph-mon[121340]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2023-12-06T14:58:12.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:11 smithi190 ceph-mon[121340]: mds.? [v2:172.21.15.152:6826/2467413186,v1:172.21.15.152:6827/2467413186] up:active 2023-12-06T14:58:12.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:11 smithi190 ceph-mon[121340]: fsmap cephfs:2 {0=cephfs.smithi152.acqswy=up:active,1=cephfs.smithi190.uucxzu=up:active} 2 up:standby-replay 2023-12-06T14:58:12.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:11 smithi190 ceph-mon[121340]: pgmap v136: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2.4 KiB/s wr, 10 op/s 2023-12-06T14:58:12.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:11 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:58:12.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:11 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:58:12.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:11 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:12.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:11 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:58:12.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:11 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:12.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:11 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:58:13.048 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.047+0000 7f38466e7700 1 -- 172.21.15.152:0/1728999165 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38400fcd00 msgr2=0x7f38400fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:13.048 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.047+0000 7f38466e7700 1 --2- 172.21.15.152:0/1728999165 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38400fcd00 0x7f38400fd150 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3834004940 tx=0x7f3834009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:13.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.047+0000 7f38466e7700 1 -- 172.21.15.152:0/1728999165 shutdown_connections 2023-12-06T14:58:13.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.047+0000 7f38466e7700 1 --2- 172.21.15.152:0/1728999165 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38400fcd00 0x7f38400fd150 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:13.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.047+0000 7f38466e7700 1 --2- 172.21.15.152:0/1728999165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f38400fbaf0 0x7f38400fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:13.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.047+0000 7f38466e7700 1 -- 172.21.15.152:0/1728999165 >> 172.21.15.152:0/1728999165 conn(0x7f38400f71d0 msgr2=0x7f38400f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:13.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.047+0000 7f38466e7700 1 -- 172.21.15.152:0/1728999165 shutdown_connections 2023-12-06T14:58:13.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.047+0000 7f38466e7700 1 -- 172.21.15.152:0/1728999165 wait complete. 2023-12-06T14:58:13.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.048+0000 7f38466e7700 1 Processor -- start 2023-12-06T14:58:13.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.048+0000 7f38466e7700 1 -- start start 2023-12-06T14:58:13.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.048+0000 7f38466e7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38400fbaf0 0x7f384010b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:13.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.048+0000 7f38466e7700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f38400fcd00 0x7f384010b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:13.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.048+0000 7f38466e7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384010bdf0 con 0x7f38400fbaf0 2023-12-06T14:58:13.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.048+0000 7f38466e7700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384010c690 con 0x7f38400fcd00 2023-12-06T14:58:13.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.048+0000 7f383ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38400fbaf0 0x7f384010b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:13.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.048+0000 7f383ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38400fbaf0 0x7f384010b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52716/0 (socket says 172.21.15.152:52716) 2023-12-06T14:58:13.050 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.048+0000 7f383ffff700 1 -- 172.21.15.152:0/1923343654 learned_addr learned my addr 172.21.15.152:0/1923343654 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:58:13.050 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.048+0000 7f383f7fe700 1 --2- 172.21.15.152:0/1923343654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f38400fcd00 0x7f384010b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:13.050 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.048+0000 7f383ffff700 1 -- 172.21.15.152:0/1923343654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f38400fcd00 msgr2=0x7f384010b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:13.050 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.048+0000 7f383ffff700 1 --2- 172.21.15.152:0/1923343654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f38400fcd00 0x7f384010b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:13.050 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.048+0000 7f383ffff700 1 -- 172.21.15.152:0/1923343654 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3834005040 con 0x7f38400fbaf0 2023-12-06T14:58:13.050 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.048+0000 7f383f7fe700 1 --2- 172.21.15.152:0/1923343654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f38400fcd00 0x7f384010b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-06T14:58:13.051 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.049+0000 7f383ffff700 1 --2- 172.21.15.152:0/1923343654 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38400fbaf0 0x7f384010b260 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3830002a80 tx=0x7f38300046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:13.051 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.049+0000 7f383cff9700 1 -- 172.21.15.152:0/1923343654 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3830007cc0 con 0x7f38400fbaf0 2023-12-06T14:58:13.051 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.049+0000 7f383cff9700 1 -- 172.21.15.152:0/1923343654 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f383000f040 con 0x7f38400fbaf0 2023-12-06T14:58:13.051 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.049+0000 7f38466e7700 1 -- 172.21.15.152:0/1923343654 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f384010c970 con 0x7f38400fbaf0 2023-12-06T14:58:13.051 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.049+0000 7f383cff9700 1 -- 172.21.15.152:0/1923343654 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38300095d0 con 0x7f38400fbaf0 2023-12-06T14:58:13.051 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.049+0000 7f38466e7700 1 -- 172.21.15.152:0/1923343654 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f384010ceb0 con 0x7f38400fbaf0 2023-12-06T14:58:13.051 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.050+0000 7f38466e7700 1 -- 172.21.15.152:0/1923343654 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f384004bb80 con 0x7f38400fbaf0 2023-12-06T14:58:13.051 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.051+0000 7f383cff9700 1 -- 172.21.15.152:0/1923343654 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f3830009730 con 0x7f38400fbaf0 2023-12-06T14:58:13.052 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.051+0000 7f383cff9700 1 --2- 172.21.15.152:0/1923343654 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f3828068f60 0x7f382806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:13.052 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.051+0000 7f383cff9700 1 -- 172.21.15.152:0/1923343654 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f3830086620 con 0x7f38400fbaf0 2023-12-06T14:58:13.052 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.051+0000 7f383f7fe700 1 --2- 172.21.15.152:0/1923343654 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f3828068f60 0x7f382806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:13.052 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.052+0000 7f383f7fe700 1 --2- 172.21.15.152:0/1923343654 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f3828068f60 0x7f382806b410 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f383400b3b0 tx=0x7f3834009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:13.055 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.056+0000 7f383cff9700 1 -- 172.21.15.152:0/1923343654 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f383004ca00 con 0x7f38400fbaf0 2023-12-06T14:58:13.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:12 smithi152 ceph-mon[111954]: mds.? [v2:172.21.15.190:6826/2256465065,v1:172.21.15.190:6827/2256465065] up:standby-replay 2023-12-06T14:58:13.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:12 smithi152 ceph-mon[111954]: fsmap cephfs:2 {0=cephfs.smithi152.acqswy=up:active,1=cephfs.smithi190.uucxzu=up:active} 2 up:standby-replay 2023-12-06T14:58:13.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:12 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:13.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:12 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:13.297 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.296+0000 7f38466e7700 1 -- 172.21.15.152:0/1923343654 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f38401027d0 con 0x7f38400fbaf0 2023-12-06T14:58:13.297 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.297+0000 7f383cff9700 1 -- 172.21.15.152:0/1923343654 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1835 (secure 0 0 0) 0x7f3830052a70 con 0x7f38400fbaf0 2023-12-06T14:58:13.297 INFO:teuthology.orchestra.run.smithi152.stdout:e14 2023-12-06T14:58:13.297 INFO:teuthology.orchestra.run.smithi152.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-06T14:58:13.297 INFO:teuthology.orchestra.run.smithi152.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-06T14:58:13.297 INFO:teuthology.orchestra.run.smithi152.stdout:legacy client fscid: 1 2023-12-06T14:58:13.297 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:58:13.297 INFO:teuthology.orchestra.run.smithi152.stdout:Filesystem 'cephfs' (1) 2023-12-06T14:58:13.298 INFO:teuthology.orchestra.run.smithi152.stdout:fs_name cephfs 2023-12-06T14:58:13.298 INFO:teuthology.orchestra.run.smithi152.stdout:epoch 14 2023-12-06T14:58:13.298 INFO:teuthology.orchestra.run.smithi152.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-06T14:58:13.298 INFO:teuthology.orchestra.run.smithi152.stdout:created 2023-12-06T14:57:59.352201+0000 2023-12-06T14:58:13.298 INFO:teuthology.orchestra.run.smithi152.stdout:modified 2023-12-06T14:58:11.969272+0000 2023-12-06T14:58:13.298 INFO:teuthology.orchestra.run.smithi152.stdout:tableserver 0 2023-12-06T14:58:13.298 INFO:teuthology.orchestra.run.smithi152.stdout:root 0 2023-12-06T14:58:13.298 INFO:teuthology.orchestra.run.smithi152.stdout:session_timeout 60 2023-12-06T14:58:13.298 INFO:teuthology.orchestra.run.smithi152.stdout:session_autoclose 300 2023-12-06T14:58:13.298 INFO:teuthology.orchestra.run.smithi152.stdout:max_file_size 1099511627776 2023-12-06T14:58:13.298 INFO:teuthology.orchestra.run.smithi152.stdout:required_client_features {} 2023-12-06T14:58:13.298 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure 0 2023-12-06T14:58:13.299 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure_osd_epoch 0 2023-12-06T14:58:13.299 INFO:teuthology.orchestra.run.smithi152.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-06T14:58:13.299 INFO:teuthology.orchestra.run.smithi152.stdout:max_mds 2 2023-12-06T14:58:13.299 INFO:teuthology.orchestra.run.smithi152.stdout:in 0,1 2023-12-06T14:58:13.299 INFO:teuthology.orchestra.run.smithi152.stdout:up {0=14464,1=24255} 2023-12-06T14:58:13.299 INFO:teuthology.orchestra.run.smithi152.stdout:failed 2023-12-06T14:58:13.299 INFO:teuthology.orchestra.run.smithi152.stdout:damaged 2023-12-06T14:58:13.299 INFO:teuthology.orchestra.run.smithi152.stdout:stopped 2023-12-06T14:58:13.299 INFO:teuthology.orchestra.run.smithi152.stdout:data_pools [3] 2023-12-06T14:58:13.299 INFO:teuthology.orchestra.run.smithi152.stdout:metadata_pool 2 2023-12-06T14:58:13.299 INFO:teuthology.orchestra.run.smithi152.stdout:inline_data disabled 2023-12-06T14:58:13.299 INFO:teuthology.orchestra.run.smithi152.stdout:balancer 2023-12-06T14:58:13.300 INFO:teuthology.orchestra.run.smithi152.stdout:standby_count_wanted 1 2023-12-06T14:58:13.300 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.acqswy{0:14464} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.152:6826/2467413186,v1:172.21.15.152:6827/2467413186] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T14:58:13.300 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi190.edwtqj{0:24271} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.190:6826/2256465065,v1:172.21.15.190:6827/2256465065] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T14:58:13.300 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi190.uucxzu{1:24255} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.190:6824/3250692478,v1:172.21.15.190:6825/3250692478] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T14:58:13.300 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.ypivwc{1:14480} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.152:6828/697313573,v1:172.21.15.152:6829/697313573] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T14:58:13.300 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:58:13.300 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:58:13.301 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.299+0000 7f38466e7700 1 -- 172.21.15.152:0/1923343654 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f3828068f60 msgr2=0x7f382806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:13.301 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.299+0000 7f38466e7700 1 --2- 172.21.15.152:0/1923343654 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f3828068f60 0x7f382806b410 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f383400b3b0 tx=0x7f3834009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:13.301 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.299+0000 7f38466e7700 1 -- 172.21.15.152:0/1923343654 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38400fbaf0 msgr2=0x7f384010b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:13.301 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.299+0000 7f38466e7700 1 --2- 172.21.15.152:0/1923343654 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38400fbaf0 0x7f384010b260 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3830002a80 tx=0x7f38300046b0 comp rx=0 tx=0).stop 2023-12-06T14:58:13.301 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.299+0000 7f38466e7700 1 -- 172.21.15.152:0/1923343654 shutdown_connections 2023-12-06T14:58:13.301 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.299+0000 7f38466e7700 1 --2- 172.21.15.152:0/1923343654 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38400fbaf0 0x7f384010b260 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:13.301 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.299+0000 7f38466e7700 1 --2- 172.21.15.152:0/1923343654 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f3828068f60 0x7f382806b410 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:13.301 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.299+0000 7f38466e7700 1 --2- 172.21.15.152:0/1923343654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f38400fcd00 0x7f384010b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:13.301 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.299+0000 7f38466e7700 1 -- 172.21.15.152:0/1923343654 >> 172.21.15.152:0/1923343654 conn(0x7f38400f71d0 msgr2=0x7f38400fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:13.301 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.299+0000 7f38466e7700 1 -- 172.21.15.152:0/1923343654 shutdown_connections 2023-12-06T14:58:13.301 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:13.299+0000 7f38466e7700 1 -- 172.21.15.152:0/1923343654 wait complete. 2023-12-06T14:58:13.301 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 14 2023-12-06T14:58:13.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:12 smithi190 ceph-mon[121340]: mds.? [v2:172.21.15.190:6826/2256465065,v1:172.21.15.190:6827/2256465065] up:standby-replay 2023-12-06T14:58:13.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:12 smithi190 ceph-mon[121340]: fsmap cephfs:2 {0=cephfs.smithi152.acqswy=up:active,1=cephfs.smithi190.uucxzu=up:active} 2 up:standby-replay 2023-12-06T14:58:13.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:12 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:13.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:12 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:13.769 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2023-12-06T14:58:14.052 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:58:14.072 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:13 smithi152 ceph-mon[111954]: pgmap v137: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2023-12-06T14:58:14.072 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:13 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/1923343654' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-06T14:58:14.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:13 smithi190 ceph-mon[121340]: pgmap v137: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2023-12-06T14:58:14.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:13 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/1923343654' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-06T14:58:15.499 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.499+0000 7f27673b0700 1 -- 172.21.15.152:0/1950014782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27600ffd70 msgr2=0x7f27601021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:15.499 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.499+0000 7f27673b0700 1 --2- 172.21.15.152:0/1950014782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27600ffd70 0x7f27601021d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f275c004940 tx=0x7f275c009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:15.499 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.499+0000 7f27673b0700 1 -- 172.21.15.152:0/1950014782 shutdown_connections 2023-12-06T14:58:15.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.499+0000 7f27673b0700 1 --2- 172.21.15.152:0/1950014782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27600ffd70 0x7f27601021d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:15.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.499+0000 7f27673b0700 1 --2- 172.21.15.152:0/1950014782 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2760066090 0x7f27600ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:15.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.499+0000 7f27673b0700 1 -- 172.21.15.152:0/1950014782 >> 172.21.15.152:0/1950014782 conn(0x7f27600f7190 msgr2=0x7f27600f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:15.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.499+0000 7f27673b0700 1 -- 172.21.15.152:0/1950014782 shutdown_connections 2023-12-06T14:58:15.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.499+0000 7f27673b0700 1 -- 172.21.15.152:0/1950014782 wait complete. 2023-12-06T14:58:15.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.500+0000 7f27673b0700 1 Processor -- start 2023-12-06T14:58:15.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.500+0000 7f27673b0700 1 -- start start 2023-12-06T14:58:15.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.500+0000 7f27673b0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2760066090 0x7f276010d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:15.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.500+0000 7f27673b0700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27600ffd70 0x7f276010daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:15.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.500+0000 7f27673b0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276010e130 con 0x7f2760066090 2023-12-06T14:58:15.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.500+0000 7f27673b0700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276010e970 con 0x7f27600ffd70 2023-12-06T14:58:15.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.500+0000 7f276514c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2760066090 0x7f276010d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:15.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.500+0000 7f276514c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2760066090 0x7f276010d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52734/0 (socket says 172.21.15.152:52734) 2023-12-06T14:58:15.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.500+0000 7f276514c700 1 -- 172.21.15.152:0/176381982 learned_addr learned my addr 172.21.15.152:0/176381982 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:58:15.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.500+0000 7f276494b700 1 --2- 172.21.15.152:0/176381982 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27600ffd70 0x7f276010daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:15.503 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.500+0000 7f276514c700 1 -- 172.21.15.152:0/176381982 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27600ffd70 msgr2=0x7f276010daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:15.503 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.500+0000 7f276514c700 1 --2- 172.21.15.152:0/176381982 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27600ffd70 0x7f276010daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:15.503 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.500+0000 7f276514c700 1 -- 172.21.15.152:0/176381982 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f275c005040 con 0x7f2760066090 2023-12-06T14:58:15.503 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.500+0000 7f276494b700 1 --2- 172.21.15.152:0/176381982 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27600ffd70 0x7f276010daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-06T14:58:15.503 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.500+0000 7f276514c700 1 --2- 172.21.15.152:0/176381982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2760066090 0x7f276010d560 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f275400b790 tx=0x7f2754009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:15.503 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.501+0000 7f2751ffb700 1 -- 172.21.15.152:0/176381982 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f275400f770 con 0x7f2760066090 2023-12-06T14:58:15.503 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.501+0000 7f2751ffb700 1 -- 172.21.15.152:0/176381982 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f275400fd80 con 0x7f2760066090 2023-12-06T14:58:15.503 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.501+0000 7f27673b0700 1 -- 172.21.15.152:0/176381982 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f276010ec50 con 0x7f2760066090 2023-12-06T14:58:15.503 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.501+0000 7f2751ffb700 1 -- 172.21.15.152:0/176381982 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f275400d310 con 0x7f2760066090 2023-12-06T14:58:15.503 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.501+0000 7f27673b0700 1 -- 172.21.15.152:0/176381982 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f276010f190 con 0x7f2760066090 2023-12-06T14:58:15.504 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.502+0000 7f27673b0700 1 -- 172.21.15.152:0/176381982 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f276004bb80 con 0x7f2760066090 2023-12-06T14:58:15.504 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.503+0000 7f2751ffb700 1 -- 172.21.15.152:0/176381982 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f2754010420 con 0x7f2760066090 2023-12-06T14:58:15.504 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.503+0000 7f2751ffb700 1 --2- 172.21.15.152:0/176381982 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f274c068f70 0x7f274c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:15.504 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.503+0000 7f2751ffb700 1 -- 172.21.15.152:0/176381982 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f2754086c70 con 0x7f2760066090 2023-12-06T14:58:15.505 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.503+0000 7f276494b700 1 --2- 172.21.15.152:0/176381982 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f274c068f70 0x7f274c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:15.505 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.504+0000 7f276494b700 1 --2- 172.21.15.152:0/176381982 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f274c068f70 0x7f274c06b420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f275c00b3b0 tx=0x7f275c009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:15.507 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.508+0000 7f2751ffb700 1 -- 172.21.15.152:0/176381982 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2754056c70 con 0x7f2760066090 2023-12-06T14:58:15.755 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.755+0000 7f27673b0700 1 -- 172.21.15.152:0/176381982 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2760105600 con 0x7f2760066090 2023-12-06T14:58:15.756 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.756+0000 7f2751ffb700 1 -- 172.21.15.152:0/176381982 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4726 (secure 0 0 0) 0x7f2760105600 con 0x7f2760066090 2023-12-06T14:58:15.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.758+0000 7f27673b0700 1 -- 172.21.15.152:0/176381982 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f274c068f70 msgr2=0x7f274c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:15.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.758+0000 7f27673b0700 1 --2- 172.21.15.152:0/176381982 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f274c068f70 0x7f274c06b420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f275c00b3b0 tx=0x7f275c009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:15.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.758+0000 7f27673b0700 1 -- 172.21.15.152:0/176381982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2760066090 msgr2=0x7f276010d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:15.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.758+0000 7f27673b0700 1 --2- 172.21.15.152:0/176381982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2760066090 0x7f276010d560 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f275400b790 tx=0x7f2754009250 comp rx=0 tx=0).stop 2023-12-06T14:58:15.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.758+0000 7f27673b0700 1 -- 172.21.15.152:0/176381982 shutdown_connections 2023-12-06T14:58:15.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.758+0000 7f27673b0700 1 --2- 172.21.15.152:0/176381982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2760066090 0x7f276010d560 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:15.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.758+0000 7f27673b0700 1 --2- 172.21.15.152:0/176381982 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f274c068f70 0x7f274c06b420 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:15.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.758+0000 7f27673b0700 1 --2- 172.21.15.152:0/176381982 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27600ffd70 0x7f276010daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:15.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.758+0000 7f27673b0700 1 -- 172.21.15.152:0/176381982 >> 172.21.15.152:0/176381982 conn(0x7f27600f7190 msgr2=0x7f27600f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:15.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.758+0000 7f27673b0700 1 -- 172.21.15.152:0/176381982 shutdown_connections 2023-12-06T14:58:15.759 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:15.758+0000 7f27673b0700 1 -- 172.21.15.152:0/176381982 wait complete. 2023-12-06T14:58:15.759 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 14 2023-12-06T14:58:15.768 INFO:teuthology.orchestra.run.smithi152.stdout:true 2023-12-06T14:58:16.140 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2023-12-06T14:58:16.406 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:58:16.756 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:16 smithi152 ceph-mon[111954]: pgmap v138: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2023-12-06T14:58:16.756 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:16 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:16.756 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:16 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:16.756 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:16 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:58:16.757 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:16 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:58:16.757 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:16 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:16.757 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:16 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/176381982' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-06T14:58:16.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:16 smithi190 ceph-mon[121340]: pgmap v138: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2023-12-06T14:58:16.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:16 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:16.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:16 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:16.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:16 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:58:16.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:16 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:58:16.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:16 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:16.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:16 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/176381982' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-06T14:58:17.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.445+0000 7fad11d15700 1 -- 172.21.15.152:0/3600142575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad0c100050 msgr2=0x7fad0c102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:17.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.445+0000 7fad11d15700 1 --2- 172.21.15.152:0/3600142575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad0c100050 0x7fad0c102430 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fad00004940 tx=0x7fad00009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:17.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.445+0000 7fad11d15700 1 -- 172.21.15.152:0/3600142575 shutdown_connections 2023-12-06T14:58:17.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.445+0000 7fad11d15700 1 --2- 172.21.15.152:0/3600142575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad0c100050 0x7fad0c102430 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:17.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.445+0000 7fad11d15700 1 --2- 172.21.15.152:0/3600142575 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad0c0fd730 0x7fad0c0ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:17.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.445+0000 7fad11d15700 1 -- 172.21.15.152:0/3600142575 >> 172.21.15.152:0/3600142575 conn(0x7fad0c0f7190 msgr2=0x7fad0c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:17.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.445+0000 7fad11d15700 1 -- 172.21.15.152:0/3600142575 shutdown_connections 2023-12-06T14:58:17.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.445+0000 7fad11d15700 1 -- 172.21.15.152:0/3600142575 wait complete. 2023-12-06T14:58:17.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.446+0000 7fad11d15700 1 Processor -- start 2023-12-06T14:58:17.448 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.446+0000 7fad11d15700 1 -- start start 2023-12-06T14:58:17.448 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.446+0000 7fad11d15700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad0c0fd730 0x7fad0c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:17.448 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.446+0000 7fad11d15700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad0c100050 0x7fad0c0fb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:17.448 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.446+0000 7fad11d15700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c0fbc40 con 0x7fad0c0fd730 2023-12-06T14:58:17.448 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.446+0000 7fad11d15700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c0fbdb0 con 0x7fad0c100050 2023-12-06T14:58:17.448 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.446+0000 7fad0b7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad0c0fd730 0x7fad0c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:17.448 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.446+0000 7fad0b7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad0c0fd730 0x7fad0c0fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52752/0 (socket says 172.21.15.152:52752) 2023-12-06T14:58:17.448 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.446+0000 7fad0b7fe700 1 -- 172.21.15.152:0/662520797 learned_addr learned my addr 172.21.15.152:0/662520797 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:58:17.448 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.446+0000 7fad0affd700 1 --2- 172.21.15.152:0/662520797 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad0c100050 0x7fad0c0fb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:17.448 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.447+0000 7fad0b7fe700 1 -- 172.21.15.152:0/662520797 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad0c100050 msgr2=0x7fad0c0fb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:17.448 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.447+0000 7fad0b7fe700 1 --2- 172.21.15.152:0/662520797 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad0c100050 0x7fad0c0fb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:17.448 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.447+0000 7fad0b7fe700 1 -- 172.21.15.152:0/662520797 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad00005040 con 0x7fad0c0fd730 2023-12-06T14:58:17.448 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.447+0000 7fad0affd700 1 --2- 172.21.15.152:0/662520797 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad0c100050 0x7fad0c0fb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-06T14:58:17.448 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.447+0000 7fad0b7fe700 1 --2- 172.21.15.152:0/662520797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad0c0fd730 0x7fad0c0fd1c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7facfc002a80 tx=0x7facfc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:17.449 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.447+0000 7facf3fff700 1 -- 172.21.15.152:0/662520797 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facfc007cc0 con 0x7fad0c0fd730 2023-12-06T14:58:17.449 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.447+0000 7facf3fff700 1 -- 172.21.15.152:0/662520797 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7facfc00f040 con 0x7fad0c0fd730 2023-12-06T14:58:17.449 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.447+0000 7fad11d15700 1 -- 172.21.15.152:0/662520797 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad0c0fc090 con 0x7fad0c0fd730 2023-12-06T14:58:17.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.447+0000 7facf3fff700 1 -- 172.21.15.152:0/662520797 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facfc009640 con 0x7fad0c0fd730 2023-12-06T14:58:17.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.447+0000 7fad11d15700 1 -- 172.21.15.152:0/662520797 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad0c1154d0 con 0x7fad0c0fd730 2023-12-06T14:58:17.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.448+0000 7fad11d15700 1 -- 172.21.15.152:0/662520797 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad0c04bb80 con 0x7fad0c0fd730 2023-12-06T14:58:17.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.448+0000 7facf3fff700 1 -- 172.21.15.152:0/662520797 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7facfc0097a0 con 0x7fad0c0fd730 2023-12-06T14:58:17.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.449+0000 7facf3fff700 1 --2- 172.21.15.152:0/662520797 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7facf4068f60 0x7facf406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:17.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.449+0000 7facf3fff700 1 -- 172.21.15.152:0/662520797 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7facfc0865d0 con 0x7fad0c0fd730 2023-12-06T14:58:17.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.449+0000 7fad0affd700 1 --2- 172.21.15.152:0/662520797 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7facf4068f60 0x7facf406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:17.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.449+0000 7fad0affd700 1 --2- 172.21.15.152:0/662520797 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7facf4068f60 0x7facf406b410 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fad00009fd0 tx=0x7fad00009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:17.453 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.453+0000 7facf3fff700 1 -- 172.21.15.152:0/662520797 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7facfc04ca00 con 0x7fad0c0fd730 2023-12-06T14:58:17.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.712+0000 7fad11d15700 1 -- 172.21.15.152:0/662520797 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7fad0c115910 con 0x7fad0c0fd730 2023-12-06T14:58:17.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.712+0000 7facf3fff700 1 -- 172.21.15.152:0/662520797 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v14) v1 ==== 78+0+99 (secure 0 0 0) 0x7facfc056520 con 0x7fad0c0fd730 2023-12-06T14:58:17.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.714+0000 7fad11d15700 1 -- 172.21.15.152:0/662520797 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7facf4068f60 msgr2=0x7facf406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:17.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.714+0000 7fad11d15700 1 --2- 172.21.15.152:0/662520797 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7facf4068f60 0x7facf406b410 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fad00009fd0 tx=0x7fad00009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:17.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.714+0000 7fad11d15700 1 -- 172.21.15.152:0/662520797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad0c0fd730 msgr2=0x7fad0c0fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:17.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.714+0000 7fad11d15700 1 --2- 172.21.15.152:0/662520797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad0c0fd730 0x7fad0c0fd1c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7facfc002a80 tx=0x7facfc0046b0 comp rx=0 tx=0).stop 2023-12-06T14:58:17.715 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.714+0000 7fad11d15700 1 -- 172.21.15.152:0/662520797 shutdown_connections 2023-12-06T14:58:17.715 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.714+0000 7fad11d15700 1 --2- 172.21.15.152:0/662520797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad0c0fd730 0x7fad0c0fd1c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:17.715 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.714+0000 7fad11d15700 1 --2- 172.21.15.152:0/662520797 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7facf4068f60 0x7facf406b410 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:17.715 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.714+0000 7fad11d15700 1 --2- 172.21.15.152:0/662520797 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad0c100050 0x7fad0c0fb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:17.715 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.714+0000 7fad11d15700 1 -- 172.21.15.152:0/662520797 >> 172.21.15.152:0/662520797 conn(0x7fad0c0f7190 msgr2=0x7fad0c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:17.715 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.714+0000 7fad11d15700 1 -- 172.21.15.152:0/662520797 shutdown_connections 2023-12-06T14:58:17.715 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:17.714+0000 7fad11d15700 1 -- 172.21.15.152:0/662520797 wait complete. 2023-12-06T14:58:17.724 INFO:teuthology.orchestra.run.smithi152.stdout:true 2023-12-06T14:58:18.097 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2023-12-06T14:58:18.116 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-06T14:58:18.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.246+0000 7fe338abe700 1 -- 172.21.15.152:0/1369935971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3340fcc00 msgr2=0x7fe3340fd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:18.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.246+0000 7fe338abe700 1 --2- 172.21.15.152:0/1369935971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3340fcc00 0x7fe3340fd050 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe31c004940 tx=0x7fe31c009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:18.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.246+0000 7fe338abe700 1 -- 172.21.15.152:0/1369935971 shutdown_connections 2023-12-06T14:58:18.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.246+0000 7fe338abe700 1 --2- 172.21.15.152:0/1369935971 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3340fcc00 0x7fe3340fd050 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:18.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.246+0000 7fe338abe700 1 --2- 172.21.15.152:0/1369935971 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3340fb9f0 0x7fe3340fbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:18.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.246+0000 7fe338abe700 1 -- 172.21.15.152:0/1369935971 >> 172.21.15.152:0/1369935971 conn(0x7fe3340f7070 msgr2=0x7fe3340f94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:18.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.246+0000 7fe338abe700 1 -- 172.21.15.152:0/1369935971 shutdown_connections 2023-12-06T14:58:18.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.246+0000 7fe338abe700 1 -- 172.21.15.152:0/1369935971 wait complete. 2023-12-06T14:58:18.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.247+0000 7fe338abe700 1 Processor -- start 2023-12-06T14:58:18.249 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.247+0000 7fe338abe700 1 -- start start 2023-12-06T14:58:18.249 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.247+0000 7fe338abe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3340fb9f0 0x7fe334065690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:18.249 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.247+0000 7fe338abe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3340fcc00 0x7fe334112080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:18.249 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.247+0000 7fe338abe700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3341125c0 con 0x7fe3340fb9f0 2023-12-06T14:58:18.249 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.247+0000 7fe338abe700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe334112730 con 0x7fe3340fcc00 2023-12-06T14:58:18.249 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.247+0000 7fe33259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3340fb9f0 0x7fe334065690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:18.249 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.247+0000 7fe33259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3340fb9f0 0x7fe334065690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52778/0 (socket says 172.21.15.152:52778) 2023-12-06T14:58:18.249 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.247+0000 7fe33259c700 1 -- 172.21.15.152:0/1999632640 learned_addr learned my addr 172.21.15.152:0/1999632640 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:58:18.249 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.247+0000 7fe33259c700 1 -- 172.21.15.152:0/1999632640 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3340fcc00 msgr2=0x7fe334112080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:18.249 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.247+0000 7fe33259c700 1 --2- 172.21.15.152:0/1999632640 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3340fcc00 0x7fe334112080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:18.249 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.247+0000 7fe33259c700 1 -- 172.21.15.152:0/1999632640 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31c005040 con 0x7fe3340fb9f0 2023-12-06T14:58:18.249 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.248+0000 7fe33259c700 1 --2- 172.21.15.152:0/1999632640 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3340fb9f0 0x7fe334065690 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe32400c8b0 tx=0x7fe324004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:18.249 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.248+0000 7fe32affd700 1 -- 172.21.15.152:0/1999632640 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe32400a760 con 0x7fe3340fb9f0 2023-12-06T14:58:18.249 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.248+0000 7fe32affd700 1 -- 172.21.15.152:0/1999632640 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe32400ad70 con 0x7fe3340fb9f0 2023-12-06T14:58:18.249 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.248+0000 7fe338abe700 1 -- 172.21.15.152:0/1999632640 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe334112a10 con 0x7fe3340fb9f0 2023-12-06T14:58:18.250 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.248+0000 7fe32affd700 1 -- 172.21.15.152:0/1999632640 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3240113a0 con 0x7fe3340fb9f0 2023-12-06T14:58:18.250 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.248+0000 7fe338abe700 1 -- 172.21.15.152:0/1999632640 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe334112fd0 con 0x7fe3340fb9f0 2023-12-06T14:58:18.253 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.249+0000 7fe338abe700 1 -- 172.21.15.152:0/1999632640 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe334106300 con 0x7fe3340fb9f0 2023-12-06T14:58:18.253 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.249+0000 7fe32affd700 1 -- 172.21.15.152:0/1999632640 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fe324012400 con 0x7fe3340fb9f0 2023-12-06T14:58:18.253 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.249+0000 7fe32affd700 1 --2- 172.21.15.152:0/1999632640 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fe320068f70 0x7fe32006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:18.253 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.250+0000 7fe32affd700 1 -- 172.21.15.152:0/1999632640 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fe324086dc0 con 0x7fe3340fb9f0 2023-12-06T14:58:18.253 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.250+0000 7fe331d9b700 1 --2- 172.21.15.152:0/1999632640 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fe320068f70 0x7fe32006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:18.253 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.250+0000 7fe331d9b700 1 --2- 172.21.15.152:0/1999632640 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fe320068f70 0x7fe32006b420 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe31c000c00 tx=0x7fe31c009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:18.254 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.254+0000 7fe32affd700 1 -- 172.21.15.152:0/1999632640 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fe32408a030 con 0x7fe3340fb9f0 2023-12-06T14:58:18.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.440+0000 7fe338abe700 1 -- 172.21.15.152:0/1999632640 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe334104390 con 0x7fe3340fb9f0 2023-12-06T14:58:18.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.440+0000 7fe32affd700 1 -- 172.21.15.152:0/1999632640 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+14317 (secure 0 0 0) 0x7fe324056d00 con 0x7fe3340fb9f0 2023-12-06T14:58:18.441 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:58:18.441 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":43,"fsid":"062f0e3c-9447-11ee-95a2-87774f69a715","created":"2023-12-06T14:53:01.413534+0000","modified":"2023-12-06T14:58:01.360152+0000","last_up_change":"2023-12-06T14:57:10.129077+0000","last_in_change":"2023-12-06T14:56:53.456498+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-06T14:56:15.276535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-06T14:57:57.673767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-06T14:57:58.572251+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"72a62158-6e7d-42af-8212-f6ae2b8df6e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3829936777},{"type":"v1","addr":"172.21.15.152:6803","nonce":3829936777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3829936777},{"type":"v1","addr":"172.21.15.152:6805","nonce":3829936777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3829936777},{"type":"v1","addr":"172.21.15.152:6809","nonce":3829936777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3829936777},{"type":"v1","addr":"172.21.15.152:6807","nonce":3829936777}]},"public_addr":"172.21.15.152:6803/3829936777","cluster_addr":"172.21.15.152:6805/3829936777","heartbeat_back_addr":"172.21.15.152:6809/3829936777","heartbeat_front_addr":"172.21.15.152:6807/3829936777","state":["exists","up"]},{"osd":1,"uuid":"50dee56b-c95b-4361-ad0d-4f71198f9105","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1158477634},{"type":"v1","addr":"172.21.15.152:6811","nonce":1158477634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1158477634},{"type":"v1","addr":"172.21.15.152:6813","nonce":1158477634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1158477634},{"type":"v1","addr":"172.21.15.152:6817","nonce":1158477634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1158477634},{"type":"v1","addr":"172.21.15.152:6815","nonce":1158477634}]},"public_addr":"172.21.15.152:6811/1158477634","cluster_addr":"172.21.15.152:6813/1158477634","heartbeat_back_addr":"172.21.15.152:6817/1158477634","heartbeat_front_addr":"172.21.15.152:6815/1158477634","state":["exists","up"]},{"osd":2,"uuid":"8dce6383-8296-4737-99d9-427bbd62f9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":3416520485},{"type":"v1","addr":"172.21.15.152:6819","nonce":3416520485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":3416520485},{"type":"v1","addr":"172.21.15.152:6821","nonce":3416520485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":3416520485},{"type":"v1","addr":"172.21.15.152:6825","nonce":3416520485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":3416520485},{"type":"v1","addr":"172.21.15.152:6823","nonce":3416520485}]},"public_addr":"172.21.15.152:6819/3416520485","cluster_addr":"172.21.15.152:6821/3416520485","heartbeat_back_addr":"172.21.15.152:6825/3416520485","heartbeat_front_addr":"172.21.15.152:6823/3416520485","state":["exists","up"]},{"osd":3,"uuid":"ea52387d-fb71-4ed5-bde5-85550b5cc117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":977527629},{"type":"v1","addr":"172.21.15.190:6801","nonce":977527629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":977527629},{"type":"v1","addr":"172.21.15.190:6803","nonce":977527629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":977527629},{"type":"v1","addr":"172.21.15.190:6807","nonce":977527629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":977527629},{"type":"v1","addr":"172.21.15.190:6805","nonce":977527629}]},"public_addr":"172.21.15.190:6801/977527629","cluster_addr":"172.21.15.190:6803/977527629","heartbeat_back_addr":"172.21.15.190:6807/977527629","heartbeat_front_addr":"172.21.15.190:6805/977527629","state":["exists","up"]},{"osd":4,"uuid":"23efef41-308e-467c-9f90-ae159a8d43a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2742121756},{"type":"v1","addr":"172.21.15.190:6809","nonce":2742121756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2742121756},{"type":"v1","addr":"172.21.15.190:6811","nonce":2742121756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2742121756},{"type":"v1","addr":"172.21.15.190:6815","nonce":2742121756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2742121756},{"type":"v1","addr":"172.21.15.190:6813","nonce":2742121756}]},"public_addr":"172.21.15.190:6809/2742121756","cluster_addr":"172.21.15.190:6811/2742121756","heartbeat_back_addr":"172.21.15.190:6815/2742121756","heartbeat_front_addr":"172.21.15.190:6813/2742121756","state":["exists","up"]},{"osd":5,"uuid":"fe0aeff2-a9e0-4cb5-9cd9-fd0e3db4807f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":3073656058},{"type":"v1","addr":"172.21.15.190:6817","nonce":3073656058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":3073656058},{"type":"v1","addr":"172.21.15.190:6819","nonce":3073656058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":3073656058},{"type":"v1","addr":"172.21.15.190:6823","nonce":3073656058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":3073656058},{"type":"v1","addr":"172.21.15.190:6821","nonce":3073656058}]},"public_addr":"172.21.15.190:6817/3073656058","cluster_addr":"172.21.15.190:6819/3073656058","heartbeat_back_addr":"172.21.15.190:6823/3073656058","heartbeat_front_addr":"172.21.15.190:6821/3073656058","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T14:55:32.948973+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T14:55:53.358269+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T14:56:12.783635+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T14:56:30.517271+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T14:56:49.401042+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T14:57:08.146152+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.152:0/2095526930":"2023-12-07T14:54:40.970995+0000","172.21.15.152:0/2571521952":"2023-12-07T14:53:50.748958+0000","172.21.15.152:0/145030765":"2023-12-07T14:53:50.748958+0000","172.21.15.152:0/2581585771":"2023-12-07T14:53:50.748958+0000","172.21.15.152:6801/3517650686":"2023-12-07T14:54:40.970995+0000","172.21.15.152:6800/3517650686":"2023-12-07T14:54:40.970995+0000","172.21.15.152:6801/2466555973":"2023-12-07T14:53:50.748958+0000","172.21.15.152:0/959508847":"2023-12-07T14:54:40.970995+0000","172.21.15.152:0/181182783":"2023-12-07T14:53:24.414825+0000","172.21.15.152:0/251625153":"2023-12-07T14:54:40.970995+0000","172.21.15.152:0/4186839809":"2023-12-07T14:53:24.414825+0000","172.21.15.152:0/3538958834":"2023-12-07T14:53:24.414825+0000","172.21.15.152:6800/1793082857":"2023-12-07T14:53:24.414825+0000","172.21.15.152:6801/1793082857":"2023-12-07T14:53:24.414825+0000","172.21.15.152:6800/2466555973":"2023-12-07T14:53:50.748958+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-06T14:58:18.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.442+0000 7fe338abe700 1 -- 172.21.15.152:0/1999632640 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fe320068f70 msgr2=0x7fe32006b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:18.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.442+0000 7fe338abe700 1 --2- 172.21.15.152:0/1999632640 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fe320068f70 0x7fe32006b420 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe31c000c00 tx=0x7fe31c009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:18.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.442+0000 7fe338abe700 1 -- 172.21.15.152:0/1999632640 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3340fb9f0 msgr2=0x7fe334065690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:18.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.442+0000 7fe338abe700 1 --2- 172.21.15.152:0/1999632640 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3340fb9f0 0x7fe334065690 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe32400c8b0 tx=0x7fe324004470 comp rx=0 tx=0).stop 2023-12-06T14:58:18.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.443+0000 7fe338abe700 1 -- 172.21.15.152:0/1999632640 shutdown_connections 2023-12-06T14:58:18.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.443+0000 7fe338abe700 1 --2- 172.21.15.152:0/1999632640 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3340fb9f0 0x7fe334065690 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:18.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.443+0000 7fe338abe700 1 --2- 172.21.15.152:0/1999632640 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fe320068f70 0x7fe32006b420 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:18.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.443+0000 7fe338abe700 1 --2- 172.21.15.152:0/1999632640 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3340fcc00 0x7fe334112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:18.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.443+0000 7fe338abe700 1 -- 172.21.15.152:0/1999632640 >> 172.21.15.152:0/1999632640 conn(0x7fe3340f7070 msgr2=0x7fe3340f9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:18.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.443+0000 7fe338abe700 1 -- 172.21.15.152:0/1999632640 shutdown_connections 2023-12-06T14:58:18.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.443+0000 7fe338abe700 1 -- 172.21.15.152:0/1999632640 wait complete. 2023-12-06T14:58:18.455 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-06T14:56:15.276535+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-06T14:57:57.673767+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-06T14:57:58.572251+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-06T14:58:18.456 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-06T14:58:18.578 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.577+0000 7f0665a19700 1 -- 172.21.15.152:0/3099280017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06600fc290 msgr2=0x7f06600fcc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:18.579 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.577+0000 7f0665a19700 1 --2- 172.21.15.152:0/3099280017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06600fc290 0x7f06600fcc90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0650004940 tx=0x7f0650009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:18.579 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.577+0000 7f0665a19700 1 -- 172.21.15.152:0/3099280017 shutdown_connections 2023-12-06T14:58:18.579 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.577+0000 7f0665a19700 1 --2- 172.21.15.152:0/3099280017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06600fc290 0x7f06600fcc90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:18.579 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.577+0000 7f0665a19700 1 --2- 172.21.15.152:0/3099280017 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06600fb940 0x7f06600fbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:18.579 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.577+0000 7f0665a19700 1 -- 172.21.15.152:0/3099280017 >> 172.21.15.152:0/3099280017 conn(0x7f06600f7100 msgr2=0x7f06600f9510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:18.579 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.577+0000 7f0665a19700 1 -- 172.21.15.152:0/3099280017 shutdown_connections 2023-12-06T14:58:18.579 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.577+0000 7f0665a19700 1 -- 172.21.15.152:0/3099280017 wait complete. 2023-12-06T14:58:18.579 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.577+0000 7f0665a19700 1 Processor -- start 2023-12-06T14:58:18.579 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.578+0000 7f0665a19700 1 -- start start 2023-12-06T14:58:18.579 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.578+0000 7f0665a19700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06600fb940 0x7f066010c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:18.579 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.578+0000 7f0665a19700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06600fc290 0x7f066010c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:18.579 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.578+0000 7f0665a19700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066010cc50 con 0x7f06600fb940 2023-12-06T14:58:18.579 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.578+0000 7f0665a19700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066010cdc0 con 0x7f06600fc290 2023-12-06T14:58:18.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.578+0000 7f065effd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06600fb940 0x7f066010c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:18.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.578+0000 7f065effd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06600fb940 0x7f066010c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52784/0 (socket says 172.21.15.152:52784) 2023-12-06T14:58:18.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.578+0000 7f065effd700 1 -- 172.21.15.152:0/1039023947 learned_addr learned my addr 172.21.15.152:0/1039023947 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:58:18.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.578+0000 7f065effd700 1 -- 172.21.15.152:0/1039023947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06600fc290 msgr2=0x7f066010c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:18.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.578+0000 7f065effd700 1 --2- 172.21.15.152:0/1039023947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06600fc290 0x7f066010c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:18.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.578+0000 7f065effd700 1 -- 172.21.15.152:0/1039023947 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0650005040 con 0x7f06600fb940 2023-12-06T14:58:18.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.578+0000 7f065effd700 1 --2- 172.21.15.152:0/1039023947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06600fb940 0x7f066010c110 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f065400eb70 tx=0x7f065400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:18.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.578+0000 7f06477fe700 1 -- 172.21.15.152:0/1039023947 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0654007cc0 con 0x7f06600fb940 2023-12-06T14:58:18.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.578+0000 7f06477fe700 1 -- 172.21.15.152:0/1039023947 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f065400f040 con 0x7f06600fb940 2023-12-06T14:58:18.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.578+0000 7f0665a19700 1 -- 172.21.15.152:0/1039023947 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0660111810 con 0x7f06600fb940 2023-12-06T14:58:18.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.578+0000 7f06477fe700 1 -- 172.21.15.152:0/1039023947 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f065400cad0 con 0x7f06600fb940 2023-12-06T14:58:18.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.578+0000 7f0665a19700 1 -- 172.21.15.152:0/1039023947 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0660111dd0 con 0x7f06600fb940 2023-12-06T14:58:18.581 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.579+0000 7f0665a19700 1 -- 172.21.15.152:0/1039023947 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0660104310 con 0x7f06600fb940 2023-12-06T14:58:18.581 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.580+0000 7f06477fe700 1 -- 172.21.15.152:0/1039023947 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f065400cc30 con 0x7f06600fb940 2023-12-06T14:58:18.581 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.580+0000 7f06477fe700 1 --2- 172.21.15.152:0/1039023947 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f0648068f70 0x7f064806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:18.581 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.581+0000 7f06477fe700 1 -- 172.21.15.152:0/1039023947 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f06540868b0 con 0x7f06600fb940 2023-12-06T14:58:18.581 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.581+0000 7f065e7fc700 1 --2- 172.21.15.152:0/1039023947 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f0648068f70 0x7f064806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:18.581 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.581+0000 7f065e7fc700 1 --2- 172.21.15.152:0/1039023947 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f0648068f70 0x7f064806b420 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f065000b0d0 tx=0x7f0650009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:18.584 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.584+0000 7f06477fe700 1 -- 172.21.15.152:0/1039023947 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f065404da00 con 0x7f06600fb940 2023-12-06T14:58:18.768 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.768+0000 7f0665a19700 1 -- 172.21.15.152:0/1039023947 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0660112040 con 0x7f06600fb940 2023-12-06T14:58:18.768 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.768+0000 7f06477fe700 1 -- 172.21.15.152:0/1039023947 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f06540190a0 con 0x7f06600fb940 2023-12-06T14:58:18.769 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2023-12-06T14:58:18.771 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.770+0000 7f0665a19700 1 -- 172.21.15.152:0/1039023947 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f0648068f70 msgr2=0x7f064806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:18.771 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.770+0000 7f0665a19700 1 --2- 172.21.15.152:0/1039023947 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f0648068f70 0x7f064806b420 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f065000b0d0 tx=0x7f0650009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:18.771 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.770+0000 7f0665a19700 1 -- 172.21.15.152:0/1039023947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06600fb940 msgr2=0x7f066010c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:18.771 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.770+0000 7f0665a19700 1 --2- 172.21.15.152:0/1039023947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06600fb940 0x7f066010c110 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f065400eb70 tx=0x7f065400b040 comp rx=0 tx=0).stop 2023-12-06T14:58:18.771 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.771+0000 7f0665a19700 1 -- 172.21.15.152:0/1039023947 shutdown_connections 2023-12-06T14:58:18.771 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.771+0000 7f0665a19700 1 --2- 172.21.15.152:0/1039023947 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06600fb940 0x7f066010c110 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:18.771 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.771+0000 7f0665a19700 1 --2- 172.21.15.152:0/1039023947 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f0648068f70 0x7f064806b420 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:18.771 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.771+0000 7f0665a19700 1 --2- 172.21.15.152:0/1039023947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06600fc290 0x7f066010c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:18.771 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.771+0000 7f0665a19700 1 -- 172.21.15.152:0/1039023947 >> 172.21.15.152:0/1039023947 conn(0x7f06600f7100 msgr2=0x7f06600ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:18.771 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.771+0000 7f0665a19700 1 -- 172.21.15.152:0/1039023947 shutdown_connections 2023-12-06T14:58:18.771 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.771+0000 7f0665a19700 1 -- 172.21.15.152:0/1039023947 wait complete. 2023-12-06T14:58:18.782 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:18 smithi152 ceph-mon[111954]: pgmap v139: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2023-12-06T14:58:18.782 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:18 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/662520797' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2023-12-06T14:58:18.782 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:18 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/1999632640' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-06T14:58:18.783 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-06T14:58:18.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:18 smithi190 ceph-mon[121340]: pgmap v139: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2023-12-06T14:58:18.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:18 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/662520797' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2023-12-06T14:58:18.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:18 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/1999632640' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-06T14:58:18.908 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.903+0000 7ff392c1d700 1 -- 172.21.15.152:0/2422408812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff38c0fb0f0 msgr2=0x7ff38c0fb500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:18.908 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.903+0000 7ff392c1d700 1 --2- 172.21.15.152:0/2422408812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff38c0fb0f0 0x7ff38c0fb500 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff380004940 tx=0x7ff380009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:18.908 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.903+0000 7ff392c1d700 1 -- 172.21.15.152:0/2422408812 shutdown_connections 2023-12-06T14:58:18.908 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.903+0000 7ff392c1d700 1 --2- 172.21.15.152:0/2422408812 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff38c0fc300 0x7ff38c0fc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:18.908 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.903+0000 7ff392c1d700 1 --2- 172.21.15.152:0/2422408812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff38c0fb0f0 0x7ff38c0fb500 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:18.909 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.903+0000 7ff392c1d700 1 -- 172.21.15.152:0/2422408812 >> 172.21.15.152:0/2422408812 conn(0x7ff38c0f67b0 msgr2=0x7ff38c0f8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:18.909 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.903+0000 7ff392c1d700 1 -- 172.21.15.152:0/2422408812 shutdown_connections 2023-12-06T14:58:18.909 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.903+0000 7ff392c1d700 1 -- 172.21.15.152:0/2422408812 wait complete. 2023-12-06T14:58:18.909 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.903+0000 7ff392c1d700 1 Processor -- start 2023-12-06T14:58:18.909 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.903+0000 7ff392c1d700 1 -- start start 2023-12-06T14:58:18.909 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.904+0000 7ff392c1d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff38c0fb0f0 0x7ff38c10c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:18.909 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.904+0000 7ff392c1d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff38c0fc300 0x7ff38c10cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:18.909 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.904+0000 7ff392c1d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c10d3f0 con 0x7ff38c0fb0f0 2023-12-06T14:58:18.910 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.904+0000 7ff392c1d700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c1116e0 con 0x7ff38c0fc300 2023-12-06T14:58:18.910 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.904+0000 7ff3909b9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff38c0fb0f0 0x7ff38c10c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:18.910 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.904+0000 7ff3909b9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff38c0fb0f0 0x7ff38c10c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52804/0 (socket says 172.21.15.152:52804) 2023-12-06T14:58:18.910 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.904+0000 7ff3909b9700 1 -- 172.21.15.152:0/1418684051 learned_addr learned my addr 172.21.15.152:0/1418684051 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:58:18.910 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.904+0000 7ff38bfff700 1 --2- 172.21.15.152:0/1418684051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff38c0fc300 0x7ff38c10cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:18.910 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.904+0000 7ff3909b9700 1 -- 172.21.15.152:0/1418684051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff38c0fc300 msgr2=0x7ff38c10cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:18.910 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.904+0000 7ff3909b9700 1 --2- 172.21.15.152:0/1418684051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff38c0fc300 0x7ff38c10cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:18.911 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.904+0000 7ff3909b9700 1 -- 172.21.15.152:0/1418684051 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff380005040 con 0x7ff38c0fb0f0 2023-12-06T14:58:18.911 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.904+0000 7ff3909b9700 1 --2- 172.21.15.152:0/1418684051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff38c0fb0f0 0x7ff38c10c820 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff380004f90 tx=0x7ff380009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:18.911 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.904+0000 7ff3897fa700 1 -- 172.21.15.152:0/1418684051 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff38000e040 con 0x7ff38c0fb0f0 2023-12-06T14:58:18.911 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.904+0000 7ff392c1d700 1 -- 172.21.15.152:0/1418684051 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff38c10b510 con 0x7ff38c0fb0f0 2023-12-06T14:58:18.911 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.904+0000 7ff3897fa700 1 -- 172.21.15.152:0/1418684051 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff38000be60 con 0x7ff38c0fb0f0 2023-12-06T14:58:18.911 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.904+0000 7ff3897fa700 1 -- 172.21.15.152:0/1418684051 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff380013730 con 0x7ff38c0fb0f0 2023-12-06T14:58:18.912 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.904+0000 7ff392c1d700 1 -- 172.21.15.152:0/1418684051 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff38c10ba70 con 0x7ff38c0fb0f0 2023-12-06T14:58:18.912 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.905+0000 7ff392c1d700 1 -- 172.21.15.152:0/1418684051 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff38c063ea0 con 0x7ff38c0fb0f0 2023-12-06T14:58:18.912 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.906+0000 7ff3897fa700 1 -- 172.21.15.152:0/1418684051 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7ff38001ead0 con 0x7ff38c0fb0f0 2023-12-06T14:58:18.912 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.906+0000 7ff3897fa700 1 --2- 172.21.15.152:0/1418684051 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7ff37c068f60 0x7ff37c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:18.912 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.906+0000 7ff3897fa700 1 -- 172.21.15.152:0/1418684051 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7ff38008ad70 con 0x7ff38c0fb0f0 2023-12-06T14:58:18.912 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.906+0000 7ff38bfff700 1 --2- 172.21.15.152:0/1418684051 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7ff37c068f60 0x7ff37c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:18.913 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.907+0000 7ff38bfff700 1 --2- 172.21.15.152:0/1418684051 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7ff37c068f60 0x7ff37c06b410 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff378009fd0 tx=0x7ff37800b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:18.913 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:18.911+0000 7ff3897fa700 1 -- 172.21.15.152:0/1418684051 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff3800571c0 con 0x7ff38c0fb0f0 2023-12-06T14:58:19.091 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.091+0000 7ff392c1d700 1 -- 172.21.15.152:0/1418684051 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7ff38c10bea0 con 0x7ff38c0fb0f0 2023-12-06T14:58:19.091 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.091+0000 7ff3897fa700 1 -- 172.21.15.152:0/1418684051 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v43) v1 ==== 107+0+11 (secure 0 0 0) 0x7ff38005a7e0 con 0x7ff38c0fb0f0 2023-12-06T14:58:19.092 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2023-12-06T14:58:19.094 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.094+0000 7ff392c1d700 1 -- 172.21.15.152:0/1418684051 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7ff37c068f60 msgr2=0x7ff37c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:19.094 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.094+0000 7ff392c1d700 1 --2- 172.21.15.152:0/1418684051 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7ff37c068f60 0x7ff37c06b410 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff378009fd0 tx=0x7ff37800b040 comp rx=0 tx=0).stop 2023-12-06T14:58:19.094 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.094+0000 7ff392c1d700 1 -- 172.21.15.152:0/1418684051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff38c0fb0f0 msgr2=0x7ff38c10c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:19.094 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.094+0000 7ff392c1d700 1 --2- 172.21.15.152:0/1418684051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff38c0fb0f0 0x7ff38c10c820 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff380004f90 tx=0x7ff380009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:19.094 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.094+0000 7ff392c1d700 1 -- 172.21.15.152:0/1418684051 shutdown_connections 2023-12-06T14:58:19.094 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.094+0000 7ff392c1d700 1 --2- 172.21.15.152:0/1418684051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff38c0fb0f0 0x7ff38c10c820 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:19.095 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.094+0000 7ff392c1d700 1 --2- 172.21.15.152:0/1418684051 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7ff37c068f60 0x7ff37c06b410 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:19.095 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.094+0000 7ff392c1d700 1 --2- 172.21.15.152:0/1418684051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff38c0fc300 0x7ff38c10cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:19.095 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.094+0000 7ff392c1d700 1 -- 172.21.15.152:0/1418684051 >> 172.21.15.152:0/1418684051 conn(0x7ff38c0f67b0 msgr2=0x7ff38c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:19.095 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.094+0000 7ff392c1d700 1 -- 172.21.15.152:0/1418684051 shutdown_connections 2023-12-06T14:58:19.095 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.094+0000 7ff392c1d700 1 -- 172.21.15.152:0/1418684051 wait complete. 2023-12-06T14:58:19.106 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-06T14:58:19.230 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.226+0000 7f6028dee700 1 -- 172.21.15.152:0/3174305031 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6024065880 msgr2=0x7f6024101a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:19.230 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.226+0000 7f6028dee700 1 --2- 172.21.15.152:0/3174305031 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6024065880 0x7f6024101a40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6018004940 tx=0x7f6018009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:19.230 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.226+0000 7f6028dee700 1 -- 172.21.15.152:0/3174305031 shutdown_connections 2023-12-06T14:58:19.230 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.226+0000 7f6028dee700 1 --2- 172.21.15.152:0/3174305031 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6024101f80 0x7f6024104360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:19.230 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.226+0000 7f6028dee700 1 --2- 172.21.15.152:0/3174305031 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6024065880 0x7f6024101a40 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:19.230 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.226+0000 7f6028dee700 1 -- 172.21.15.152:0/3174305031 >> 172.21.15.152:0/3174305031 conn(0x7f60240f7010 msgr2=0x7f60240f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:19.231 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.226+0000 7f6028dee700 1 -- 172.21.15.152:0/3174305031 shutdown_connections 2023-12-06T14:58:19.231 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.226+0000 7f6028dee700 1 -- 172.21.15.152:0/3174305031 wait complete. 2023-12-06T14:58:19.231 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.227+0000 7f6028dee700 1 Processor -- start 2023-12-06T14:58:19.231 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.227+0000 7f6028dee700 1 -- start start 2023-12-06T14:58:19.231 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.227+0000 7f6028dee700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6024065880 0x7f602410f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:19.231 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.227+0000 7f6028dee700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6024101f80 0x7f602410f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:19.231 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.227+0000 7f6028dee700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602410ff70 con 0x7f6024065880 2023-12-06T14:58:19.231 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.227+0000 7f6028dee700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60241100e0 con 0x7f6024101f80 2023-12-06T14:58:19.232 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.227+0000 7f602259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6024065880 0x7f602410f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:19.232 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.227+0000 7f602259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6024065880 0x7f602410f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52818/0 (socket says 172.21.15.152:52818) 2023-12-06T14:58:19.232 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.227+0000 7f602259c700 1 -- 172.21.15.152:0/3599640714 learned_addr learned my addr 172.21.15.152:0/3599640714 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:58:19.232 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.227+0000 7f6021d9b700 1 --2- 172.21.15.152:0/3599640714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6024101f80 0x7f602410f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:19.232 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.227+0000 7f602259c700 1 -- 172.21.15.152:0/3599640714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6024101f80 msgr2=0x7f602410f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:19.232 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.227+0000 7f602259c700 1 --2- 172.21.15.152:0/3599640714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6024101f80 0x7f602410f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:19.232 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.227+0000 7f602259c700 1 -- 172.21.15.152:0/3599640714 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6018005040 con 0x7f6024065880 2023-12-06T14:58:19.232 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.227+0000 7f602259c700 1 --2- 172.21.15.152:0/3599640714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6024065880 0x7f602410f430 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6018000c00 tx=0x7f6018009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:19.232 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.227+0000 7f6012ffd700 1 -- 172.21.15.152:0/3599640714 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6018021070 con 0x7f6024065880 2023-12-06T14:58:19.233 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.227+0000 7f6012ffd700 1 -- 172.21.15.152:0/3599640714 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f60180093f0 con 0x7f6024065880 2023-12-06T14:58:19.233 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.228+0000 7f6028dee700 1 -- 172.21.15.152:0/3599640714 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6024114b30 con 0x7f6024065880 2023-12-06T14:58:19.233 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.228+0000 7f6012ffd700 1 -- 172.21.15.152:0/3599640714 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f601800e070 con 0x7f6024065880 2023-12-06T14:58:19.233 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.228+0000 7f6028dee700 1 -- 172.21.15.152:0/3599640714 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6024115010 con 0x7f6024065880 2023-12-06T14:58:19.233 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.228+0000 7f6010ff9700 1 -- 172.21.15.152:0/3599640714 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60080052b0 con 0x7f6024065880 2023-12-06T14:58:19.233 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.229+0000 7f6012ffd700 1 -- 172.21.15.152:0/3599640714 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f6018013c40 con 0x7f6024065880 2023-12-06T14:58:19.233 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.229+0000 7f6012ffd700 1 --2- 172.21.15.152:0/3599640714 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f600c068f60 0x7f600c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:19.233 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.229+0000 7f6012ffd700 1 -- 172.21.15.152:0/3599640714 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f6018088190 con 0x7f6024065880 2023-12-06T14:58:19.233 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.229+0000 7f6021d9b700 1 --2- 172.21.15.152:0/3599640714 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f600c068f60 0x7f600c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:19.234 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.230+0000 7f6021d9b700 1 --2- 172.21.15.152:0/3599640714 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f600c068f60 0x7f600c06b410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6014004600 tx=0x7f601400b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:19.234 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.234+0000 7f6012ffd700 1 -- 172.21.15.152:0/3599640714 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f60180580f0 con 0x7f6024065880 2023-12-06T14:58:19.419 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.418+0000 7f6010ff9700 1 -- 172.21.15.152:0/3599640714 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f6008005ae0 con 0x7f6024065880 2023-12-06T14:58:19.419 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.419+0000 7f6012ffd700 1 -- 172.21.15.152:0/3599640714 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v43) v1 ==== 107+0+11 (secure 0 0 0) 0x7f6018057c80 con 0x7f6024065880 2023-12-06T14:58:19.419 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2023-12-06T14:58:19.422 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.421+0000 7f6010ff9700 1 -- 172.21.15.152:0/3599640714 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f600c068f60 msgr2=0x7f600c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:19.422 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.421+0000 7f6010ff9700 1 --2- 172.21.15.152:0/3599640714 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f600c068f60 0x7f600c06b410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6014004600 tx=0x7f601400b040 comp rx=0 tx=0).stop 2023-12-06T14:58:19.422 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.421+0000 7f6010ff9700 1 -- 172.21.15.152:0/3599640714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6024065880 msgr2=0x7f602410f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:19.422 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.421+0000 7f6010ff9700 1 --2- 172.21.15.152:0/3599640714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6024065880 0x7f602410f430 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6018000c00 tx=0x7f6018009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:19.422 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.421+0000 7f6010ff9700 1 -- 172.21.15.152:0/3599640714 shutdown_connections 2023-12-06T14:58:19.422 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.421+0000 7f6010ff9700 1 --2- 172.21.15.152:0/3599640714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6024065880 0x7f602410f430 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:19.423 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.421+0000 7f6010ff9700 1 --2- 172.21.15.152:0/3599640714 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f600c068f60 0x7f600c06b410 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:19.423 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.421+0000 7f6010ff9700 1 --2- 172.21.15.152:0/3599640714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6024101f80 0x7f602410f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:19.423 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.421+0000 7f6010ff9700 1 -- 172.21.15.152:0/3599640714 >> 172.21.15.152:0/3599640714 conn(0x7f60240f7010 msgr2=0x7f60240f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:19.423 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.421+0000 7f6010ff9700 1 -- 172.21.15.152:0/3599640714 shutdown_connections 2023-12-06T14:58:19.423 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.421+0000 7f6010ff9700 1 -- 172.21.15.152:0/3599640714 wait complete. 2023-12-06T14:58:19.434 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-06T14:58:19.554 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.552+0000 7f79057cd700 1 -- 172.21.15.152:0/1272356749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79000fcbd0 msgr2=0x7f79000fd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:19.554 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.552+0000 7f79057cd700 1 --2- 172.21.15.152:0/1272356749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79000fcbd0 0x7f79000fd020 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f78e8004940 tx=0x7f78e8009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:19.554 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.552+0000 7f79057cd700 1 -- 172.21.15.152:0/1272356749 shutdown_connections 2023-12-06T14:58:19.554 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.552+0000 7f79057cd700 1 --2- 172.21.15.152:0/1272356749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79000fcbd0 0x7f79000fd020 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:19.554 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.552+0000 7f79057cd700 1 --2- 172.21.15.152:0/1272356749 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79000fb9c0 0x7f79000fbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:19.554 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.552+0000 7f79057cd700 1 -- 172.21.15.152:0/1272356749 >> 172.21.15.152:0/1272356749 conn(0x7f79000f7060 msgr2=0x7f79000f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:19.554 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.552+0000 7f79057cd700 1 -- 172.21.15.152:0/1272356749 shutdown_connections 2023-12-06T14:58:19.554 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.552+0000 7f79057cd700 1 -- 172.21.15.152:0/1272356749 wait complete. 2023-12-06T14:58:19.554 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.553+0000 7f79057cd700 1 Processor -- start 2023-12-06T14:58:19.554 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.553+0000 7f79057cd700 1 -- start start 2023-12-06T14:58:19.554 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.553+0000 7f79057cd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79000fb9c0 0x7f7900066340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:19.555 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.553+0000 7f79057cd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79000fcbd0 0x7f7900112030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:19.555 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.553+0000 7f79057cd700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7900112570 con 0x7f79000fcbd0 2023-12-06T14:58:19.555 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.553+0000 7f79057cd700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79001126b0 con 0x7f79000fb9c0 2023-12-06T14:58:19.555 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.553+0000 7f78fe7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79000fcbd0 0x7f7900112030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:19.555 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.553+0000 7f78fe7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79000fcbd0 0x7f7900112030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54922/0 (socket says 172.21.15.152:54922) 2023-12-06T14:58:19.555 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.553+0000 7f78fe7fc700 1 -- 172.21.15.152:0/1067607349 learned_addr learned my addr 172.21.15.152:0/1067607349 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:58:19.555 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.553+0000 7f78feffd700 1 --2- 172.21.15.152:0/1067607349 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79000fb9c0 0x7f7900066340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:19.555 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.553+0000 7f78fe7fc700 1 -- 172.21.15.152:0/1067607349 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79000fb9c0 msgr2=0x7f7900066340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:19.555 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.553+0000 7f78fe7fc700 1 --2- 172.21.15.152:0/1067607349 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79000fb9c0 0x7f7900066340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:19.555 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.553+0000 7f78fe7fc700 1 -- 172.21.15.152:0/1067607349 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e8005040 con 0x7f79000fcbd0 2023-12-06T14:58:19.555 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.553+0000 7f78fe7fc700 1 --2- 172.21.15.152:0/1067607349 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79000fcbd0 0x7f7900112030 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f78e8000c00 tx=0x7f78e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:19.555 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.553+0000 7f78f77fe700 1 -- 172.21.15.152:0/1067607349 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78e8021070 con 0x7f79000fcbd0 2023-12-06T14:58:19.555 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.554+0000 7f78f77fe700 1 -- 172.21.15.152:0/1067607349 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f78e801c400 con 0x7f79000fcbd0 2023-12-06T14:58:19.555 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.554+0000 7f79057cd700 1 -- 172.21.15.152:0/1067607349 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7900112930 con 0x7f79000fcbd0 2023-12-06T14:58:19.555 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.554+0000 7f78f77fe700 1 -- 172.21.15.152:0/1067607349 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78e800e070 con 0x7f79000fcbd0 2023-12-06T14:58:19.556 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.554+0000 7f79057cd700 1 -- 172.21.15.152:0/1067607349 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7900112e90 con 0x7f79000fcbd0 2023-12-06T14:58:19.556 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.555+0000 7f79057cd700 1 -- 172.21.15.152:0/1067607349 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7900104360 con 0x7f79000fcbd0 2023-12-06T14:58:19.557 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.555+0000 7f78f77fe700 1 -- 172.21.15.152:0/1067607349 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f78e801c9c0 con 0x7f79000fcbd0 2023-12-06T14:58:19.557 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.555+0000 7f78f77fe700 1 --2- 172.21.15.152:0/1067607349 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f78ec068f60 0x7f78ec06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:19.557 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.555+0000 7f78f77fe700 1 -- 172.21.15.152:0/1067607349 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f78e8088000 con 0x7f79000fcbd0 2023-12-06T14:58:19.557 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.555+0000 7f78feffd700 1 --2- 172.21.15.152:0/1067607349 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f78ec068f60 0x7f78ec06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:19.557 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.556+0000 7f78feffd700 1 --2- 172.21.15.152:0/1067607349 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f78ec068f60 0x7f78ec06b410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f79000fca30 tx=0x7f78f000b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:19.560 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.560+0000 7f78f77fe700 1 -- 172.21.15.152:0/1067607349 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f78e8057f60 con 0x7f79000fcbd0 2023-12-06T14:58:19.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.784+0000 7f79057cd700 1 -- 172.21.15.152:0/1067607349 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7900113560 con 0x7f79000fcbd0 2023-12-06T14:58:19.785 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.784+0000 7f78f77fe700 1 -- 172.21.15.152:0/1067607349 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4726 (secure 0 0 0) 0x7f78e8057af0 con 0x7f79000fcbd0 2023-12-06T14:58:19.785 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:58:19.785 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":14,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-06T14:57:59.352201+0000","modified":"2023-12-06T14:58:11.969272+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14464,"mds_1":24255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14464":{"gid":14464,"name":"cephfs.smithi152.acqswy","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.152:6827/2467413186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":2467413186},{"type":"v1","addr":"172.21.15.152:6827","nonce":2467413186}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14480":{"gid":14480,"name":"cephfs.smithi152.ypivwc","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.152:6829/697313573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":697313573},{"type":"v1","addr":"172.21.15.152:6829","nonce":697313573}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24255":{"gid":24255,"name":"cephfs.smithi190.uucxzu","rank":1,"incarnation":8,"state":"up:active","state_seq":3,"addr":"172.21.15.190:6825/3250692478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":3250692478},{"type":"v1","addr":"172.21.15.190:6825","nonce":3250692478}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24271":{"gid":24271,"name":"cephfs.smithi190.edwtqj","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.190:6827/2256465065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2256465065},{"type":"v1","addr":"172.21.15.190:6827","nonce":2256465065}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-12-06T14:58:19.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.786+0000 7f79057cd700 1 -- 172.21.15.152:0/1067607349 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f78ec068f60 msgr2=0x7f78ec06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:19.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.786+0000 7f79057cd700 1 --2- 172.21.15.152:0/1067607349 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f78ec068f60 0x7f78ec06b410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f79000fca30 tx=0x7f78f000b040 comp rx=0 tx=0).stop 2023-12-06T14:58:19.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.786+0000 7f79057cd700 1 -- 172.21.15.152:0/1067607349 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79000fcbd0 msgr2=0x7f7900112030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:19.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.786+0000 7f79057cd700 1 --2- 172.21.15.152:0/1067607349 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79000fcbd0 0x7f7900112030 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f78e8000c00 tx=0x7f78e8009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:19.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.787+0000 7f79057cd700 1 -- 172.21.15.152:0/1067607349 shutdown_connections 2023-12-06T14:58:19.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.787+0000 7f79057cd700 1 --2- 172.21.15.152:0/1067607349 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f78ec068f60 0x7f78ec06b410 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:19.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.787+0000 7f79057cd700 1 --2- 172.21.15.152:0/1067607349 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79000fb9c0 0x7f7900066340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:19.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.787+0000 7f79057cd700 1 --2- 172.21.15.152:0/1067607349 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79000fcbd0 0x7f7900112030 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:19.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.787+0000 7f79057cd700 1 -- 172.21.15.152:0/1067607349 >> 172.21.15.152:0/1067607349 conn(0x7f79000f7060 msgr2=0x7f79000ffe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:19.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.787+0000 7f79057cd700 1 -- 172.21.15.152:0/1067607349 shutdown_connections 2023-12-06T14:58:19.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:19.787+0000 7f79057cd700 1 -- 172.21.15.152:0/1067607349 wait complete. 2023-12-06T14:58:19.788 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 14 2023-12-06T14:58:19.797 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:19 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/1039023947' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-06T14:58:19.797 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:19 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/1418684051' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-06T14:58:19.798 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:19 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/3599640714' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-06T14:58:19.799 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 14, 'max_mds': 2, 'flags': 50} 2023-12-06T14:58:19.799 INFO:teuthology.run_tasks:Running task kclient... 2023-12-06T14:58:19.835 INFO:tasks.kclient:Mounting kernel clients... 2023-12-06T14:58:19.835 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2023-12-06T14:58:19.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T14:58:19.835 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2023-12-06T14:58:19.836 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:19 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/1039023947' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-06T14:58:19.836 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:19 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/1418684051' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-06T14:58:19.836 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:19 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/3599640714' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-06T14:58:19.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T14:58:19.855 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link delete ceph-brx 2023-12-06T14:58:19.927 INFO:teuthology.orchestra.run.smithi152.stderr:Cannot find device "ceph-brx" 2023-12-06T14:58:19.928 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-06T14:58:19.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T14:58:19.929 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list 2023-12-06T14:58:19.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T14:58:19.952 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link delete ceph-brx 2023-12-06T14:58:20.033 INFO:teuthology.orchestra.run.smithi190.stderr:Cannot find device "ceph-brx" 2023-12-06T14:58:20.033 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-06T14:58:20.034 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-12-06T14:58:20.034 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-06T14:58:20.034 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-06T14:58:20.035 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph fs ls 2023-12-06T14:58:20.295 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:58:20.775 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:20 smithi152 ceph-mon[111954]: pgmap v140: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 85 B/s wr, 5 op/s 2023-12-06T14:58:20.776 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:20 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/1067607349' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-06T14:58:20.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:20 smithi190 ceph-mon[121340]: pgmap v140: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 85 B/s wr, 5 op/s 2023-12-06T14:58:20.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:20 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/1067607349' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-06T14:58:21.361 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.360+0000 7faafb588700 1 -- 172.21.15.152:0/3722641179 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faaf4102c70 msgr2=0x7faaf4103040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:21.361 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.360+0000 7faafb588700 1 --2- 172.21.15.152:0/3722641179 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faaf4102c70 0x7faaf4103040 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7faaf0004940 tx=0x7faaf0009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:21.361 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.361+0000 7faafb588700 1 -- 172.21.15.152:0/3722641179 shutdown_connections 2023-12-06T14:58:21.361 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.361+0000 7faafb588700 1 --2- 172.21.15.152:0/3722641179 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faaf40fb1e0 0x7faaf40fb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:21.361 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.361+0000 7faafb588700 1 --2- 172.21.15.152:0/3722641179 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faaf4102c70 0x7faaf4103040 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:21.361 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.361+0000 7faafb588700 1 -- 172.21.15.152:0/3722641179 >> 172.21.15.152:0/3722641179 conn(0x7faaf40711a0 msgr2=0x7faaf40715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:21.361 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.361+0000 7faafb588700 1 -- 172.21.15.152:0/3722641179 shutdown_connections 2023-12-06T14:58:21.361 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.361+0000 7faafb588700 1 -- 172.21.15.152:0/3722641179 wait complete. 2023-12-06T14:58:21.363 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.361+0000 7faafb588700 1 Processor -- start 2023-12-06T14:58:21.363 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.361+0000 7faafb588700 1 -- start start 2023-12-06T14:58:21.364 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.361+0000 7faafb588700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faaf40fb1e0 0x7faaf40fc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:21.364 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.361+0000 7faafb588700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faaf4102c70 0x7faaf40fc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:21.364 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.361+0000 7faafb588700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf40fcf00 con 0x7faaf4102c70 2023-12-06T14:58:21.364 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.361+0000 7faafb588700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf40fd070 con 0x7faaf40fb1e0 2023-12-06T14:58:21.364 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.361+0000 7faaf8b23700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faaf4102c70 0x7faaf40fc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:21.364 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.362+0000 7faaf8b23700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faaf4102c70 0x7faaf40fc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54936/0 (socket says 172.21.15.152:54936) 2023-12-06T14:58:21.364 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.362+0000 7faaf8b23700 1 -- 172.21.15.152:0/4072313732 learned_addr learned my addr 172.21.15.152:0/4072313732 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:58:21.364 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.362+0000 7faaf9324700 1 --2- 172.21.15.152:0/4072313732 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faaf40fb1e0 0x7faaf40fc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:21.364 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.362+0000 7faaf8b23700 1 -- 172.21.15.152:0/4072313732 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faaf40fb1e0 msgr2=0x7faaf40fc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:21.364 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.362+0000 7faaf8b23700 1 --2- 172.21.15.152:0/4072313732 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faaf40fb1e0 0x7faaf40fc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:21.364 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.362+0000 7faaf8b23700 1 -- 172.21.15.152:0/4072313732 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf0005040 con 0x7faaf4102c70 2023-12-06T14:58:21.364 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.362+0000 7faaf9324700 1 --2- 172.21.15.152:0/4072313732 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faaf40fb1e0 0x7faaf40fc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-06T14:58:21.364 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.362+0000 7faaf8b23700 1 --2- 172.21.15.152:0/4072313732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faaf4102c70 0x7faaf40fc900 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7faae4002a50 tx=0x7faae40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:21.365 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.362+0000 7faae9ffb700 1 -- 172.21.15.152:0/4072313732 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faae4007cc0 con 0x7faaf4102c70 2023-12-06T14:58:21.365 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.362+0000 7faae9ffb700 1 -- 172.21.15.152:0/4072313732 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faae400f040 con 0x7faaf4102c70 2023-12-06T14:58:21.365 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.362+0000 7faafb588700 1 -- 172.21.15.152:0/4072313732 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaf4119810 con 0x7faaf4102c70 2023-12-06T14:58:21.365 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.362+0000 7faae9ffb700 1 -- 172.21.15.152:0/4072313732 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faae400da70 con 0x7faaf4102c70 2023-12-06T14:58:21.365 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.362+0000 7faafb588700 1 -- 172.21.15.152:0/4072313732 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf4119cf0 con 0x7faaf4102c70 2023-12-06T14:58:21.365 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.363+0000 7faafb588700 1 -- 172.21.15.152:0/4072313732 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaf4072cc0 con 0x7faaf4102c70 2023-12-06T14:58:21.365 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.363+0000 7faae9ffb700 1 -- 172.21.15.152:0/4072313732 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7faae400dc10 con 0x7faaf4102c70 2023-12-06T14:58:21.366 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.364+0000 7faae9ffb700 1 --2- 172.21.15.152:0/4072313732 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7faae0068f60 0x7faae006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:21.366 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.364+0000 7faaf9324700 1 --2- 172.21.15.152:0/4072313732 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7faae0068f60 0x7faae006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:21.366 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.364+0000 7faae9ffb700 1 -- 172.21.15.152:0/4072313732 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7faae4086500 con 0x7faaf4102c70 2023-12-06T14:58:21.366 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.364+0000 7faaf9324700 1 --2- 172.21.15.152:0/4072313732 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7faae0068f60 0x7faae006b410 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faaf0004f90 tx=0x7faaf0009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:21.369 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.369+0000 7faae9ffb700 1 -- 172.21.15.152:0/4072313732 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7faae4052950 con 0x7faaf4102c70 2023-12-06T14:58:21.596 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.596+0000 7faafb588700 1 -- 172.21.15.152:0/4072313732 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7faaf40fdba0 con 0x7faaf4102c70 2023-12-06T14:58:21.596 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.596+0000 7faae9ffb700 1 -- 172.21.15.152:0/4072313732 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+83 (secure 0 0 0) 0x7faae4055f70 con 0x7faaf4102c70 2023-12-06T14:58:21.596 INFO:teuthology.orchestra.run.smithi152.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2023-12-06T14:58:21.598 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.598+0000 7faafb588700 1 -- 172.21.15.152:0/4072313732 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7faae0068f60 msgr2=0x7faae006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:21.598 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.598+0000 7faafb588700 1 --2- 172.21.15.152:0/4072313732 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7faae0068f60 0x7faae006b410 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faaf0004f90 tx=0x7faaf0009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:21.598 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.598+0000 7faafb588700 1 -- 172.21.15.152:0/4072313732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faaf4102c70 msgr2=0x7faaf40fc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:21.598 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.598+0000 7faafb588700 1 --2- 172.21.15.152:0/4072313732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faaf4102c70 0x7faaf40fc900 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7faae4002a50 tx=0x7faae40046b0 comp rx=0 tx=0).stop 2023-12-06T14:58:21.598 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.598+0000 7faafb588700 1 -- 172.21.15.152:0/4072313732 shutdown_connections 2023-12-06T14:58:21.598 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.598+0000 7faafb588700 1 --2- 172.21.15.152:0/4072313732 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7faae0068f60 0x7faae006b410 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:21.599 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.598+0000 7faafb588700 1 --2- 172.21.15.152:0/4072313732 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faaf40fb1e0 0x7faaf40fc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:21.599 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.598+0000 7faafb588700 1 --2- 172.21.15.152:0/4072313732 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faaf4102c70 0x7faaf40fc900 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:21.599 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.598+0000 7faafb588700 1 -- 172.21.15.152:0/4072313732 >> 172.21.15.152:0/4072313732 conn(0x7faaf40711a0 msgr2=0x7faaf40fa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:21.599 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.598+0000 7faafb588700 1 -- 172.21.15.152:0/4072313732 shutdown_connections 2023-12-06T14:58:21.599 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:21.598+0000 7faafb588700 1 -- 172.21.15.152:0/4072313732 wait complete. 2023-12-06T14:58:22.022 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-06T14:58:22.022 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-06T14:58:22.022 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi152.front.sepia.ceph.com 2023-12-06T14:58:22.022 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-06T14:58:22.022 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-06T14:58:22.022 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-06T14:58:22.022 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-06T14:58:22.022 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-06T14:58:22.022 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-06T14:58:22.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T14:58:22.022 DEBUG:teuthology.orchestra.run.smithi152:> ip addr 2023-12-06T14:58:22.041 INFO:teuthology.orchestra.run.smithi152.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-06T14:58:22.042 INFO:teuthology.orchestra.run.smithi152.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-06T14:58:22.042 INFO:teuthology.orchestra.run.smithi152.stdout: inet 127.0.0.1/8 scope host lo 2023-12-06T14:58:22.042 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-12-06T14:58:22.042 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 ::1/128 scope host 2023-12-06T14:58:22.042 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-12-06T14:58:22.042 INFO:teuthology.orchestra.run.smithi152.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-06T14:58:22.042 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:44 brd ff:ff:ff:ff:ff:ff 2023-12-06T14:58:22.042 INFO:teuthology.orchestra.run.smithi152.stdout: altname enp7s0f0 2023-12-06T14:58:22.042 INFO:teuthology.orchestra.run.smithi152.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-06T14:58:22.042 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:45 brd ff:ff:ff:ff:ff:ff 2023-12-06T14:58:22.042 INFO:teuthology.orchestra.run.smithi152.stdout: altname enp7s0f1 2023-12-06T14:58:22.042 INFO:teuthology.orchestra.run.smithi152.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-06T14:58:22.042 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e2 brd ff:ff:ff:ff:ff:ff 2023-12-06T14:58:22.042 INFO:teuthology.orchestra.run.smithi152.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-06T14:58:22.043 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e3 brd ff:ff:ff:ff:ff:ff 2023-12-06T14:58:22.043 INFO:teuthology.orchestra.run.smithi152.stdout: inet 172.21.15.152/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-06T14:58:22.043 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft 42083sec preferred_lft 42083sec 2023-12-06T14:58:22.043 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::ec4:7aff:fe88:6de3/64 scope link 2023-12-06T14:58:22.043 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-12-06T14:58:22.043 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-06T14:58:22.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T14:58:22.043 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2023-12-06T14:58:22.044 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2023-12-06T14:58:22.044 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link add name ceph-brx type bridge 2023-12-06T14:58:22.044 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip addr flush dev ceph-brx 2023-12-06T14:58:22.044 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set ceph-brx up 2023-12-06T14:58:22.044 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-06T14:58:22.044 DEBUG:teuthology.orchestra.run.smithi152:> ') 2023-12-06T14:58:22.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T14:58:22.221 DEBUG:teuthology.orchestra.run.smithi152:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-06T14:58:22.248 INFO:teuthology.orchestra.run.smithi152.stdout:1 2023-12-06T14:58:22.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T14:58:22.250 DEBUG:teuthology.orchestra.run.smithi152:> route 2023-12-06T14:58:22.326 INFO:teuthology.orchestra.run.smithi152.stdout:Kernel IP routing table 2023-12-06T14:58:22.326 INFO:teuthology.orchestra.run.smithi152.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-06T14:58:22.326 INFO:teuthology.orchestra.run.smithi152.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-06T14:58:22.326 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-06T14:58:22.326 INFO:teuthology.orchestra.run.smithi152.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-06T14:58:22.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T14:58:22.327 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2023-12-06T14:58:22.327 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2023-12-06T14:58:22.327 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-06T14:58:22.327 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-06T14:58:22.327 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-06T14:58:22.327 DEBUG:teuthology.orchestra.run.smithi152:> ') 2023-12-06T14:58:22.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T14:58:22.601 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2023-12-06T14:58:22.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T14:58:22.620 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list-id 2023-12-06T14:58:22.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T14:58:22.677 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2023-12-06T14:58:22.677 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2023-12-06T14:58:22.678 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-06T14:58:22.678 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-06T14:58:22.678 DEBUG:teuthology.orchestra.run.smithi152:> ') 2023-12-06T14:58:22.756 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:22 smithi152 ceph-mon[111954]: pgmap v141: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 0 B/s wr, 4 op/s 2023-12-06T14:58:22.756 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:22 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/4072313732' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-06T14:58:22.772 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-06T14:58:22.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T14:58:22.773 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2023-12-06T14:58:22.773 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2023-12-06T14:58:22.774 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-06T14:58:22.774 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-06T14:58:22.774 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-06T14:58:22.774 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-06T14:58:22.774 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-06T14:58:22.775 DEBUG:teuthology.orchestra.run.smithi152:> ') 2023-12-06T14:58:22.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:22 smithi190 ceph-mon[121340]: pgmap v141: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 0 B/s wr, 4 op/s 2023-12-06T14:58:22.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:22 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/4072313732' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-06T14:58:23.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T14:58:23.049 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2023-12-06T14:58:23.050 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2023-12-06T14:58:23.050 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set brx.0 up 2023-12-06T14:58:23.050 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set dev brx.0 master ceph-brx 2023-12-06T14:58:23.050 DEBUG:teuthology.orchestra.run.smithi152:> ') 2023-12-06T14:58:23.147 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-06T14:58:23.148 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-06T14:58:23.165 INFO:teuthology.orchestra.run.smithi152.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-06T14:58:23.166 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-06T14:58:23.166 DEBUG:teuthology.orchestra.run.smithi152:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-06T14:58:23.223 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-06T14:58:23.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T14:58:23.223 DEBUG:teuthology.orchestra.run.smithi152:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-06T14:58:23.330 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-06T14:58:23.330 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-06T14:58:23.331 INFO:teuthology.orchestra.run.smithi152.stdout:invalid new device string format 2023-12-06T14:58:23.413 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-06T14:58:23.413 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-06T14:58:23.413 INFO:teuthology.orchestra.run.smithi152.stdout:invalid new device string format 2023-12-06T14:58:23.413 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: resolved to: "172.21.15.152:3300,172.21.15.190:3300" 2023-12-06T14:58:23.413 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-06T14:58:23.431 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-06T14:58:23.432 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-06T14:58:23.432 INFO:teuthology.orchestra.run.smithi152.stdout:invalid new device string format 2023-12-06T14:58:23.432 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: resolved to: "172.21.15.152:3300,172.21.15.190:3300" 2023-12-06T14:58:23.432 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-06T14:58:23.432 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: resolved to: "172.21.15.152:6789,172.21.15.190:6789" 2023-12-06T14:58:23.432 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.152:6789,172.21.15.190:6789:/ 2023-12-06T14:58:23.432 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=062f0e3c-9447-11ee-95a2-87774f69a715" will pass to kernel 2023-12-06T14:58:23.434 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-06T14:58:23.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T14:58:23.434 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-06T14:58:23.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T14:58:23.465 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-06T14:58:23.549 INFO:teuthology.orchestra.run.smithi152.stdout:client24299 2023-12-06T14:58:23.550 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-06T14:58:23.550 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-06T14:58:23.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T14:58:23.612 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-06T14:58:23.696 INFO:teuthology.orchestra.run.smithi152.stdout:client24299 2023-12-06T14:58:23.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T14:58:23.696 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-06T14:58:23.779 INFO:teuthology.orchestra.run.smithi152.stdout:client24299 2023-12-06T14:58:23.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T14:58:23.779 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/062f0e3c-9447-11ee-95a2-87774f69a715.client24299/status') 2023-12-06T14:58:23.870 INFO:teuthology.orchestra.run.smithi152.stdout:instance: client.24299 (3)172.21.15.152:0/2172379782 2023-12-06T14:58:23.870 INFO:teuthology.orchestra.run.smithi152.stdout:blocklisted: false 2023-12-06T14:58:23.870 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records in 2023-12-06T14:58:23.871 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records out 2023-12-06T14:58:23.871 INFO:teuthology.orchestra.run.smithi152.stderr:72 bytes copied, 1.9929e-05 s, 3.6 MB/s 2023-12-06T14:58:23.872 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-12-06T14:58:23.872 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-06T14:58:23.872 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-06T14:58:23.872 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -- ceph fs ls 2023-12-06T14:58:24.135 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:58:24.605 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:24 smithi152 ceph-mon[111954]: pgmap v142: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 4 op/s 2023-12-06T14:58:24.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:24 smithi190 ceph-mon[121340]: pgmap v142: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 4 op/s 2023-12-06T14:58:25.096 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.094+0000 7fcb93e68700 1 -- 172.21.15.152:0/2636381431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb8c102bf0 msgr2=0x7fcb8c102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:25.096 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.094+0000 7fcb93e68700 1 --2- 172.21.15.152:0/2636381431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb8c102bf0 0x7fcb8c102fc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcb88004940 tx=0x7fcb88009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:25.096 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.094+0000 7fcb93e68700 1 -- 172.21.15.152:0/2636381431 shutdown_connections 2023-12-06T14:58:25.096 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.094+0000 7fcb93e68700 1 --2- 172.21.15.152:0/2636381431 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb8c103590 0x7fcb8c0fcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:25.096 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.094+0000 7fcb93e68700 1 --2- 172.21.15.152:0/2636381431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb8c102bf0 0x7fcb8c102fc0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:25.096 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.094+0000 7fcb93e68700 1 -- 172.21.15.152:0/2636381431 >> 172.21.15.152:0/2636381431 conn(0x7fcb8c0f87a0 msgr2=0x7fcb8c0fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:25.096 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.094+0000 7fcb93e68700 1 -- 172.21.15.152:0/2636381431 shutdown_connections 2023-12-06T14:58:25.096 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.094+0000 7fcb93e68700 1 -- 172.21.15.152:0/2636381431 wait complete. 2023-12-06T14:58:25.096 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.094+0000 7fcb93e68700 1 Processor -- start 2023-12-06T14:58:25.096 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.094+0000 7fcb93e68700 1 -- start start 2023-12-06T14:58:25.096 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.095+0000 7fcb93e68700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb8c102bf0 0x7fcb8c06ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:25.096 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.095+0000 7fcb93e68700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb8c103590 0x7fcb8c070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:25.097 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.095+0000 7fcb93e68700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c070a80 con 0x7fcb8c102bf0 2023-12-06T14:58:25.097 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.095+0000 7fcb93e68700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c070bf0 con 0x7fcb8c103590 2023-12-06T14:58:25.097 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.095+0000 7fcb91c04700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb8c102bf0 0x7fcb8c06ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:25.097 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.095+0000 7fcb91c04700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb8c102bf0 0x7fcb8c06ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54952/0 (socket says 172.21.15.152:54952) 2023-12-06T14:58:25.097 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.095+0000 7fcb91c04700 1 -- 172.21.15.152:0/45705432 learned_addr learned my addr 172.21.15.152:0/45705432 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:58:25.097 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.095+0000 7fcb91403700 1 --2- 172.21.15.152:0/45705432 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb8c103590 0x7fcb8c070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:25.097 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.095+0000 7fcb91c04700 1 -- 172.21.15.152:0/45705432 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb8c103590 msgr2=0x7fcb8c070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:25.097 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.095+0000 7fcb91c04700 1 --2- 172.21.15.152:0/45705432 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb8c103590 0x7fcb8c070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:25.097 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.095+0000 7fcb91c04700 1 -- 172.21.15.152:0/45705432 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb88005040 con 0x7fcb8c102bf0 2023-12-06T14:58:25.097 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.095+0000 7fcb91c04700 1 --2- 172.21.15.152:0/45705432 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb8c102bf0 0x7fcb8c06ff40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcb88009180 tx=0x7fcb88009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:25.097 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.095+0000 7fcb827fc700 1 -- 172.21.15.152:0/45705432 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb8800e040 con 0x7fcb8c102bf0 2023-12-06T14:58:25.097 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.095+0000 7fcb827fc700 1 -- 172.21.15.152:0/45705432 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcb88013420 con 0x7fcb8c102bf0 2023-12-06T14:58:25.097 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.095+0000 7fcb827fc700 1 -- 172.21.15.152:0/45705432 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb8801c630 con 0x7fcb8c102bf0 2023-12-06T14:58:25.097 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.095+0000 7fcb93e68700 1 -- 172.21.15.152:0/45705432 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb8c119900 con 0x7fcb8c102bf0 2023-12-06T14:58:25.098 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.095+0000 7fcb93e68700 1 -- 172.21.15.152:0/45705432 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb8c119d60 con 0x7fcb8c102bf0 2023-12-06T14:58:25.098 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.097+0000 7fcb827fc700 1 -- 172.21.15.152:0/45705432 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fcb880139e0 con 0x7fcb8c102bf0 2023-12-06T14:58:25.098 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.097+0000 7fcb93e68700 1 -- 172.21.15.152:0/45705432 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb8c0fc3a0 con 0x7fcb8c102bf0 2023-12-06T14:58:25.098 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.097+0000 7fcb827fc700 1 --2- 172.21.15.152:0/45705432 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fcb78068f60 0x7fcb7806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:25.099 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.097+0000 7fcb827fc700 1 -- 172.21.15.152:0/45705432 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fcb880880c0 con 0x7fcb8c102bf0 2023-12-06T14:58:25.099 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.097+0000 7fcb91403700 1 --2- 172.21.15.152:0/45705432 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fcb78068f60 0x7fcb7806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:25.099 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.097+0000 7fcb91403700 1 --2- 172.21.15.152:0/45705432 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fcb78068f60 0x7fcb7806b410 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c009b80 tx=0x7fcb7c00b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:25.101 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.101+0000 7fcb827fc700 1 -- 172.21.15.152:0/45705432 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fcb88054570 con 0x7fcb8c102bf0 2023-12-06T14:58:25.330 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.330+0000 7fcb93e68700 1 -- 172.21.15.152:0/45705432 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcb8c071720 con 0x7fcb8c102bf0 2023-12-06T14:58:25.331 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.330+0000 7fcb827fc700 1 -- 172.21.15.152:0/45705432 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+83 (secure 0 0 0) 0x7fcb88057b90 con 0x7fcb8c102bf0 2023-12-06T14:58:25.331 INFO:teuthology.orchestra.run.smithi152.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2023-12-06T14:58:25.332 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.332+0000 7fcb93e68700 1 -- 172.21.15.152:0/45705432 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fcb78068f60 msgr2=0x7fcb7806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:25.332 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.332+0000 7fcb93e68700 1 --2- 172.21.15.152:0/45705432 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fcb78068f60 0x7fcb7806b410 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c009b80 tx=0x7fcb7c00b040 comp rx=0 tx=0).stop 2023-12-06T14:58:25.332 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.332+0000 7fcb93e68700 1 -- 172.21.15.152:0/45705432 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb8c102bf0 msgr2=0x7fcb8c06ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:25.333 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.332+0000 7fcb93e68700 1 --2- 172.21.15.152:0/45705432 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb8c102bf0 0x7fcb8c06ff40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcb88009180 tx=0x7fcb88009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:25.333 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.332+0000 7fcb93e68700 1 -- 172.21.15.152:0/45705432 shutdown_connections 2023-12-06T14:58:25.333 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.332+0000 7fcb93e68700 1 --2- 172.21.15.152:0/45705432 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb8c102bf0 0x7fcb8c06ff40 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:25.333 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.332+0000 7fcb93e68700 1 --2- 172.21.15.152:0/45705432 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fcb78068f60 0x7fcb7806b410 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:25.333 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.332+0000 7fcb93e68700 1 --2- 172.21.15.152:0/45705432 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb8c103590 0x7fcb8c070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:25.333 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.332+0000 7fcb93e68700 1 -- 172.21.15.152:0/45705432 >> 172.21.15.152:0/45705432 conn(0x7fcb8c0f87a0 msgr2=0x7fcb8c0fa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:25.333 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.332+0000 7fcb93e68700 1 -- 172.21.15.152:0/45705432 shutdown_connections 2023-12-06T14:58:25.333 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:25.332+0000 7fcb93e68700 1 -- 172.21.15.152:0/45705432 wait complete. 2023-12-06T14:58:25.695 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-06T14:58:25.696 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-06T14:58:25.696 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi190.front.sepia.ceph.com 2023-12-06T14:58:25.696 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-06T14:58:25.696 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-06T14:58:25.696 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-06T14:58:25.696 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-06T14:58:25.696 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-06T14:58:25.696 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-06T14:58:25.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T14:58:25.696 DEBUG:teuthology.orchestra.run.smithi190:> ip addr 2023-12-06T14:58:25.719 INFO:teuthology.orchestra.run.smithi190.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-06T14:58:25.719 INFO:teuthology.orchestra.run.smithi190.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-06T14:58:25.719 INFO:teuthology.orchestra.run.smithi190.stdout: inet 127.0.0.1/8 scope host lo 2023-12-06T14:58:25.720 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-12-06T14:58:25.720 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 ::1/128 scope host 2023-12-06T14:58:25.720 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-12-06T14:58:25.720 INFO:teuthology.orchestra.run.smithi190.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-06T14:58:25.720 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:d9:36:d0 brd ff:ff:ff:ff:ff:ff 2023-12-06T14:58:25.720 INFO:teuthology.orchestra.run.smithi190.stdout: altname enp7s0f0 2023-12-06T14:58:25.720 INFO:teuthology.orchestra.run.smithi190.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-06T14:58:25.720 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:d9:36:d1 brd ff:ff:ff:ff:ff:ff 2023-12-06T14:58:25.720 INFO:teuthology.orchestra.run.smithi190.stdout: altname enp7s0f1 2023-12-06T14:58:25.720 INFO:teuthology.orchestra.run.smithi190.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-06T14:58:25.720 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:88:77:62 brd ff:ff:ff:ff:ff:ff 2023-12-06T14:58:25.720 INFO:teuthology.orchestra.run.smithi190.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-06T14:58:25.720 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:88:77:63 brd ff:ff:ff:ff:ff:ff 2023-12-06T14:58:25.721 INFO:teuthology.orchestra.run.smithi190.stdout: inet 172.21.15.190/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-06T14:58:25.721 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft 42078sec preferred_lft 42078sec 2023-12-06T14:58:25.721 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 fe80::ec4:7aff:fe88:7763/64 scope link 2023-12-06T14:58:25.721 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-12-06T14:58:25.721 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-06T14:58:25.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T14:58:25.721 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec bash -c ' 2023-12-06T14:58:25.721 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2023-12-06T14:58:25.721 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link add name ceph-brx type bridge 2023-12-06T14:58:25.721 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip addr flush dev ceph-brx 2023-12-06T14:58:25.722 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link set ceph-brx up 2023-12-06T14:58:25.722 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-06T14:58:25.722 DEBUG:teuthology.orchestra.run.smithi190:> ') 2023-12-06T14:58:25.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T14:58:25.884 DEBUG:teuthology.orchestra.run.smithi190:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-06T14:58:25.913 INFO:teuthology.orchestra.run.smithi190.stdout:1 2023-12-06T14:58:25.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T14:58:25.915 DEBUG:teuthology.orchestra.run.smithi190:> route 2023-12-06T14:58:25.990 INFO:teuthology.orchestra.run.smithi190.stdout:Kernel IP routing table 2023-12-06T14:58:25.990 INFO:teuthology.orchestra.run.smithi190.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-06T14:58:25.990 INFO:teuthology.orchestra.run.smithi190.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-06T14:58:25.991 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-06T14:58:25.991 INFO:teuthology.orchestra.run.smithi190.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-06T14:58:25.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T14:58:25.991 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec bash -c ' 2023-12-06T14:58:25.991 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2023-12-06T14:58:25.991 DEBUG:teuthology.orchestra.run.smithi190:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-06T14:58:25.991 DEBUG:teuthology.orchestra.run.smithi190:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-06T14:58:25.991 DEBUG:teuthology.orchestra.run.smithi190:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-06T14:58:25.991 DEBUG:teuthology.orchestra.run.smithi190:> ') 2023-12-06T14:58:26.070 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:25 smithi190 ceph-mon[121340]: pgmap v143: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T14:58:26.071 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:25 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/45705432' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-06T14:58:26.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T14:58:26.263 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list 2023-12-06T14:58:26.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T14:58:26.322 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list-id 2023-12-06T14:58:26.377 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:25 smithi152 ceph-mon[111954]: pgmap v143: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T14:58:26.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:25 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/45705432' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-06T14:58:26.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T14:58:26.379 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec bash -c ' 2023-12-06T14:58:26.379 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2023-12-06T14:58:26.380 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-06T14:58:26.380 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-06T14:58:26.380 DEBUG:teuthology.orchestra.run.smithi190:> ') 2023-12-06T14:58:26.474 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-06T14:58:26.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T14:58:26.474 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec bash -c ' 2023-12-06T14:58:26.475 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2023-12-06T14:58:26.475 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-06T14:58:26.475 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-06T14:58:26.475 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-06T14:58:26.475 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-06T14:58:26.475 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-06T14:58:26.475 DEBUG:teuthology.orchestra.run.smithi190:> ') 2023-12-06T14:58:26.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T14:58:26.698 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec bash -c ' 2023-12-06T14:58:26.698 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2023-12-06T14:58:26.698 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link set brx.0 up 2023-12-06T14:58:26.698 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link set dev brx.0 master ceph-brx 2023-12-06T14:58:26.698 DEBUG:teuthology.orchestra.run.smithi190:> ') 2023-12-06T14:58:26.795 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-06T14:58:26.795 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-06T14:58:26.812 INFO:teuthology.orchestra.run.smithi190.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-06T14:58:26.813 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-06T14:58:26.813 DEBUG:teuthology.orchestra.run.smithi190:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-06T14:58:26.870 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-06T14:58:26.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T14:58:26.871 DEBUG:teuthology.orchestra.run.smithi190:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-06T14:58:26.963 INFO:teuthology.orchestra.run.smithi190.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-06T14:58:26.963 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-06T14:58:26.963 INFO:teuthology.orchestra.run.smithi190.stdout:invalid new device string format 2023-12-06T14:58:26.997 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:26 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:58:27.055 INFO:teuthology.orchestra.run.smithi190.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-06T14:58:27.055 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-06T14:58:27.055 INFO:teuthology.orchestra.run.smithi190.stdout:invalid new device string format 2023-12-06T14:58:27.055 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: resolved to: "172.21.15.152:3300,172.21.15.190:3300" 2023-12-06T14:58:27.055 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-06T14:58:27.073 INFO:teuthology.orchestra.run.smithi190.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-06T14:58:27.074 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-06T14:58:27.074 INFO:teuthology.orchestra.run.smithi190.stdout:invalid new device string format 2023-12-06T14:58:27.074 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: resolved to: "172.21.15.152:3300,172.21.15.190:3300" 2023-12-06T14:58:27.074 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-06T14:58:27.074 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: resolved to: "172.21.15.152:6789,172.21.15.190:6789" 2023-12-06T14:58:27.074 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.152:6789,172.21.15.190:6789:/ 2023-12-06T14:58:27.074 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=062f0e3c-9447-11ee-95a2-87774f69a715" will pass to kernel 2023-12-06T14:58:27.076 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-06T14:58:27.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T14:58:27.077 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-06T14:58:27.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T14:58:27.104 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-06T14:58:27.178 INFO:teuthology.orchestra.run.smithi190.stdout:client14532 2023-12-06T14:58:27.178 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-06T14:58:27.179 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-06T14:58:27.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T14:58:27.238 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-06T14:58:27.312 INFO:teuthology.orchestra.run.smithi190.stdout:client14532 2023-12-06T14:58:27.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T14:58:27.313 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-06T14:58:27.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:26 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:58:27.387 INFO:teuthology.orchestra.run.smithi190.stdout:client14532 2023-12-06T14:58:27.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T14:58:27.387 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/062f0e3c-9447-11ee-95a2-87774f69a715.client14532/status') 2023-12-06T14:58:27.469 INFO:teuthology.orchestra.run.smithi190.stdout:instance: client.14532 (3)172.21.15.190:0/2585467870 2023-12-06T14:58:27.469 INFO:teuthology.orchestra.run.smithi190.stdout:blocklisted: false 2023-12-06T14:58:27.469 INFO:teuthology.orchestra.run.smithi190.stderr:0+1 records in 2023-12-06T14:58:27.469 INFO:teuthology.orchestra.run.smithi190.stderr:0+1 records out 2023-12-06T14:58:27.469 INFO:teuthology.orchestra.run.smithi190.stderr:72 bytes copied, 1.9925e-05 s, 3.6 MB/s 2023-12-06T14:58:27.470 INFO:teuthology.run_tasks:Running task print... 2023-12-06T14:58:27.481 INFO:teuthology.task.print:**** done client 2023-12-06T14:58:27.481 INFO:teuthology.run_tasks:Running task parallel... 2023-12-06T14:58:27.504 INFO:teuthology.task.parallel:starting parallel... 2023-12-06T14:58:27.505 INFO:teuthology.task.parallel:In parallel, running task sequential... 2023-12-06T14:58:27.505 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-06T14:58:27.505 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi152.front.sepia.ceph.com 2023-12-06T14:58:27.506 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -e sha1=0482646fcf78576d871bc87843257d82edb79541 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2023-12-06T14:58:27.506 INFO:teuthology.task.parallel:In parallel, running task sequential... 2023-12-06T14:58:27.506 INFO:teuthology.task.sequential:In sequential, running task workunit... 2023-12-06T14:58:27.509 INFO:tasks.workunit:Pulling workunits from ref 0482646fcf78576d871bc87843257d82edb79541 2023-12-06T14:58:27.510 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-06T14:58:27.510 INFO:tasks.workunit:timeout=3h 2023-12-06T14:58:27.510 INFO:tasks.workunit:cleanup=True 2023-12-06T14:58:27.510 DEBUG:teuthology.orchestra.run.smithi152:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-06T14:58:27.535 INFO:teuthology.orchestra.run.smithi152.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-12-06T14:58:27.535 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-12-06T14:58:27.536 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 99h/153d Inode: 1 Links: 2 2023-12-06T14:58:27.536 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-06T14:58:27.536 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:cephfs_t:s0 2023-12-06T14:58:27.536 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-12-06T14:58:27.536 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2023-12-06 14:58:02.372452650 +0000 2023-12-06T14:58:27.537 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2023-12-06 14:58:23.460211777 +0000 2023-12-06T14:58:27.537 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2023-12-06 14:58:02.372452650 +0000 2023-12-06T14:58:27.537 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-12-06T14:58:27.537 DEBUG:teuthology.orchestra.run.smithi152:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-12-06T14:58:27.609 DEBUG:teuthology.orchestra.run.smithi190:> stat -- /home/ubuntu/cephtest/mnt.1 2023-12-06T14:58:27.628 INFO:teuthology.orchestra.run.smithi190.stdout: File: /home/ubuntu/cephtest/mnt.1 2023-12-06T14:58:27.628 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2023-12-06T14:58:27.628 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 78h/120d Inode: 1 Links: 3 2023-12-06T14:58:27.628 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-06T14:58:27.628 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:cephfs_t:s0 2023-12-06T14:58:27.628 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-12-06T14:58:27.628 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2023-12-06 14:58:27.603164478 +0000 2023-12-06T14:58:27.629 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2023-12-06 14:58:27.603164478 +0000 2023-12-06T14:58:27.629 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: 2023-12-06 14:58:02.372452650 +0000 2023-12-06T14:58:27.629 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2023-12-06T14:58:27.629 DEBUG:teuthology.orchestra.run.smithi190:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2023-12-06T14:58:27.700 DEBUG:teuthology.orchestra.run.smithi152:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 0482646fcf78576d871bc87843257d82edb79541 2023-12-06T14:58:27.700 DEBUG:teuthology.orchestra.run.smithi190:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 0482646fcf78576d871bc87843257d82edb79541 2023-12-06T14:58:27.718 INFO:tasks.workunit.client.0.smithi152.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-06T14:58:27.758 INFO:tasks.workunit.client.1.smithi190.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2023-12-06T14:58:27.795 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:58:28.249 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:27 smithi152 ceph-mon[111954]: pgmap v144: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 170 B/s wr, 4 op/s 2023-12-06T14:58:28.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:27 smithi190 ceph-mon[121340]: pgmap v144: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 170 B/s wr, 4 op/s 2023-12-06T14:58:28.835 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:28.835+0000 7facf579d700 1 -- 172.21.15.152:0/2133206185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7facf00faed0 msgr2=0x7facf00fb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:28.835 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:28.835+0000 7facf579d700 1 --2- 172.21.15.152:0/2133206185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7facf00faed0 0x7facf00fb2e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7face0004940 tx=0x7face0009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:28.835 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:28.835+0000 7facf579d700 1 -- 172.21.15.152:0/2133206185 shutdown_connections 2023-12-06T14:58:28.835 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:28.835+0000 7facf579d700 1 --2- 172.21.15.152:0/2133206185 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7facf00fdf60 0x7facf00fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:28.835 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:28.835+0000 7facf579d700 1 --2- 172.21.15.152:0/2133206185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7facf00faed0 0x7facf00fb2e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:28.835 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:28.835+0000 7facf579d700 1 -- 172.21.15.152:0/2133206185 >> 172.21.15.152:0/2133206185 conn(0x7facf00f6950 msgr2=0x7facf00f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:28.835 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:28.835+0000 7facf579d700 1 -- 172.21.15.152:0/2133206185 shutdown_connections 2023-12-06T14:58:28.836 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:28.835+0000 7facf579d700 1 -- 172.21.15.152:0/2133206185 wait complete. 2023-12-06T14:58:28.837 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:28.835+0000 7facf579d700 1 Processor -- start 2023-12-06T14:58:28.837 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:28.836+0000 7facf579d700 1 -- start start 2023-12-06T14:58:28.837 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:28.836+0000 7facf579d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7facf00faed0 0x7facf010d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:28.838 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:28.836+0000 7facf579d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7facf00fdf60 0x7facf010db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:28.838 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:28.836+0000 7facf579d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf010e140 con 0x7facf00faed0 2023-12-06T14:58:28.838 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:28.836+0000 7facf579d700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf010e9e0 con 0x7facf00fdf60 2023-12-06T14:58:28.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:28.836+0000 7faceeffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7facf00faed0 0x7facf010d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:28.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:28.836+0000 7faceeffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7facf00faed0 0x7facf010d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54964/0 (socket says 172.21.15.152:54964) 2023-12-06T14:58:28.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:28.836+0000 7faceeffd700 1 -- 172.21.15.152:0/2559222243 learned_addr learned my addr 172.21.15.152:0/2559222243 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:58:28.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:28.836+0000 7faceeffd700 1 -- 172.21.15.152:0/2559222243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7facf00fdf60 msgr2=0x7facf010db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:28.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:28.836+0000 7facee7fc700 1 --2- 172.21.15.152:0/2559222243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7facf00fdf60 0x7facf010db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:28.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:28.836+0000 7faceeffd700 1 --2- 172.21.15.152:0/2559222243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7facf00fdf60 0x7facf010db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:28.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:28.836+0000 7faceeffd700 1 -- 172.21.15.152:0/2559222243 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face0005040 con 0x7facf00faed0 2023-12-06T14:58:28.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:28.836+0000 7faceeffd700 1 --2- 172.21.15.152:0/2559222243 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7facf00faed0 0x7facf010d600 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7face0009180 tx=0x7face0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:28.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:28.836+0000 7facd77fe700 1 -- 172.21.15.152:0/2559222243 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7face000e040 con 0x7facf00faed0 2023-12-06T14:58:28.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:28.836+0000 7facd77fe700 1 -- 172.21.15.152:0/2559222243 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7face0004290 con 0x7facf00faed0 2023-12-06T14:58:28.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:28.836+0000 7facf579d700 1 -- 172.21.15.152:0/2559222243 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf010ec60 con 0x7facf00faed0 2023-12-06T14:58:28.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:28.836+0000 7facd77fe700 1 -- 172.21.15.152:0/2559222243 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7face001c630 con 0x7facf00faed0 2023-12-06T14:58:28.839 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:28.837+0000 7facf579d700 1 -- 172.21.15.152:0/2559222243 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf010f1a0 con 0x7facf00faed0 2023-12-06T14:58:28.840 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:28.837+0000 7facf579d700 1 -- 172.21.15.152:0/2559222243 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf01075f0 con 0x7facf00faed0 2023-12-06T14:58:28.840 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:28.838+0000 7facd77fe700 1 -- 172.21.15.152:0/2559222243 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7face000bc50 con 0x7facf00faed0 2023-12-06T14:58:28.840 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:28.838+0000 7facd77fe700 1 --2- 172.21.15.152:0/2559222243 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7facd8068f70 0x7facd806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:28.841 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:28.838+0000 7facd77fe700 1 -- 172.21.15.152:0/2559222243 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7face0088070 con 0x7facf00faed0 2023-12-06T14:58:28.841 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:28.838+0000 7facee7fc700 1 --2- 172.21.15.152:0/2559222243 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7facd8068f70 0x7facd806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:28.841 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:28.839+0000 7facee7fc700 1 --2- 172.21.15.152:0/2559222243 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7facd8068f70 0x7facd806b420 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7face40041d0 tx=0x7face4009040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:28.843 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:28.843+0000 7facd77fe700 1 -- 172.21.15.152:0/2559222243 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7face0058070 con 0x7facf00faed0 2023-12-06T14:58:29.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:29.026+0000 7facf579d700 1 -- 172.21.15.152:0/2559222243 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7facf004bb80 con 0x7facf00faed0 2023-12-06T14:58:29.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:29.026+0000 7facd77fe700 1 -- 172.21.15.152:0/2559222243 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21)=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21) v1 ==== 179+0+0 (secure 0 0 0) 0x7face0057c00 con 0x7facf00faed0 2023-12-06T14:58:29.028 INFO:teuthology.orchestra.run.smithi152.stderr:Error EINVAL: unrecognized config option 'mgr/orchestrator/fail_fs' 2023-12-06T14:58:29.404 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-06T14:58:29.404 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi152.front.sepia.ceph.com 2023-12-06T14:58:29.404 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -e sha1=0482646fcf78576d871bc87843257d82edb79541 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2023-12-06T14:58:29.707 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:58:30.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:30 smithi152 ceph-mon[111954]: pgmap v145: 65 pgs: 65 active+clean; 582 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2023-12-06T14:58:30.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:30 smithi190 ceph-mon[121340]: pgmap v145: 65 pgs: 65 active+clean; 582 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2023-12-06T14:58:30.728 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.726+0000 7f2cb8325700 1 -- 172.21.15.152:0/1425852339 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2cb00fcd00 msgr2=0x7f2cb00fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:30.728 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.726+0000 7f2cb8325700 1 --2- 172.21.15.152:0/1425852339 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2cb00fcd00 0x7f2cb00fd150 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2cac004940 tx=0x7f2cac009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:30.729 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.726+0000 7f2cb8325700 1 -- 172.21.15.152:0/1425852339 shutdown_connections 2023-12-06T14:58:30.729 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.726+0000 7f2cb8325700 1 --2- 172.21.15.152:0/1425852339 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2cb00fcd00 0x7f2cb00fd150 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:30.729 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.726+0000 7f2cb8325700 1 --2- 172.21.15.152:0/1425852339 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2cb00fbaf0 0x7f2cb00fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:30.729 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.726+0000 7f2cb8325700 1 -- 172.21.15.152:0/1425852339 >> 172.21.15.152:0/1425852339 conn(0x7f2cb00f71b0 msgr2=0x7f2cb00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:30.729 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.726+0000 7f2cb8325700 1 -- 172.21.15.152:0/1425852339 shutdown_connections 2023-12-06T14:58:30.729 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.726+0000 7f2cb8325700 1 -- 172.21.15.152:0/1425852339 wait complete. 2023-12-06T14:58:30.729 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.727+0000 7f2cb8325700 1 Processor -- start 2023-12-06T14:58:30.729 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.727+0000 7f2cb8325700 1 -- start start 2023-12-06T14:58:30.729 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.727+0000 7f2cb8325700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2cb00fbaf0 0x7f2cb0112680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:30.729 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.727+0000 7f2cb8325700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2cb00fcd00 0x7f2cb0114bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:30.729 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.727+0000 7f2cb8325700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb0066890 con 0x7f2cb00fbaf0 2023-12-06T14:58:30.730 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.727+0000 7f2cb8325700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb00669d0 con 0x7f2cb00fcd00 2023-12-06T14:58:30.730 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.727+0000 7f2cb60c1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2cb00fbaf0 0x7f2cb0112680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:30.730 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.727+0000 7f2cb60c1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2cb00fbaf0 0x7f2cb0112680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58854/0 (socket says 172.21.15.152:58854) 2023-12-06T14:58:30.730 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.727+0000 7f2cb60c1700 1 -- 172.21.15.152:0/3700972215 learned_addr learned my addr 172.21.15.152:0/3700972215 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:58:30.730 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.727+0000 7f2cb58c0700 1 --2- 172.21.15.152:0/3700972215 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2cb00fcd00 0x7f2cb0114bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:30.730 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.727+0000 7f2cb60c1700 1 -- 172.21.15.152:0/3700972215 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2cb00fcd00 msgr2=0x7f2cb0114bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:30.730 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.727+0000 7f2cb60c1700 1 --2- 172.21.15.152:0/3700972215 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2cb00fcd00 0x7f2cb0114bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:30.730 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.728+0000 7f2cb60c1700 1 -- 172.21.15.152:0/3700972215 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cac005040 con 0x7f2cb00fbaf0 2023-12-06T14:58:30.730 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.728+0000 7f2cb58c0700 1 --2- 172.21.15.152:0/3700972215 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2cb00fcd00 0x7f2cb0114bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-06T14:58:30.730 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.728+0000 7f2cb60c1700 1 --2- 172.21.15.152:0/3700972215 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2cb00fbaf0 0x7f2cb0112680 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2ca400b790 tx=0x7f2ca4009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:30.730 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.728+0000 7f2ca2ffd700 1 -- 172.21.15.152:0/3700972215 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ca400f6f0 con 0x7f2cb00fbaf0 2023-12-06T14:58:30.730 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.728+0000 7f2cb8325700 1 -- 172.21.15.152:0/3700972215 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb0115110 con 0x7f2cb00fbaf0 2023-12-06T14:58:30.731 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.728+0000 7f2ca2ffd700 1 -- 172.21.15.152:0/3700972215 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2ca400fd00 con 0x7f2cb00fbaf0 2023-12-06T14:58:30.731 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.728+0000 7f2ca2ffd700 1 -- 172.21.15.152:0/3700972215 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ca40103a0 con 0x7f2cb00fbaf0 2023-12-06T14:58:30.731 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.728+0000 7f2cb8325700 1 -- 172.21.15.152:0/3700972215 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb01155a0 con 0x7f2cb00fbaf0 2023-12-06T14:58:30.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.729+0000 7f2cb8325700 1 -- 172.21.15.152:0/3700972215 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb004bb80 con 0x7f2cb00fbaf0 2023-12-06T14:58:30.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.729+0000 7f2ca2ffd700 1 -- 172.21.15.152:0/3700972215 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f2ca400f850 con 0x7f2cb00fbaf0 2023-12-06T14:58:30.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.730+0000 7f2ca2ffd700 1 --2- 172.21.15.152:0/3700972215 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f2c9c068f60 0x7f2c9c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:30.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.730+0000 7f2ca2ffd700 1 -- 172.21.15.152:0/3700972215 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f2ca4086be0 con 0x7f2cb00fbaf0 2023-12-06T14:58:30.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.730+0000 7f2cb58c0700 1 --2- 172.21.15.152:0/3700972215 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f2c9c068f60 0x7f2c9c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:30.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.730+0000 7f2cb58c0700 1 --2- 172.21.15.152:0/3700972215 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f2c9c068f60 0x7f2c9c06b410 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00b3b0 tx=0x7f2cac009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:30.734 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.734+0000 7f2ca2ffd700 1 -- 172.21.15.152:0/3700972215 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f2ca4053030 con 0x7f2cb00fbaf0 2023-12-06T14:58:30.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.918+0000 7f2cb8325700 1 -- 172.21.15.152:0/3700972215 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f2cb0104530 con 0x7f2cb00fbaf0 2023-12-06T14:58:30.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.918+0000 7f2ca2ffd700 1 -- 172.21.15.152:0/3700972215 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f2ca4056650 con 0x7f2cb00fbaf0 2023-12-06T14:58:30.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.920+0000 7f2cb8325700 1 -- 172.21.15.152:0/3700972215 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f2c9c068f60 msgr2=0x7f2c9c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:30.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.920+0000 7f2cb8325700 1 --2- 172.21.15.152:0/3700972215 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f2c9c068f60 0x7f2c9c06b410 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00b3b0 tx=0x7f2cac009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:30.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.920+0000 7f2cb8325700 1 -- 172.21.15.152:0/3700972215 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2cb00fbaf0 msgr2=0x7f2cb0112680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:30.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.920+0000 7f2cb8325700 1 --2- 172.21.15.152:0/3700972215 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2cb00fbaf0 0x7f2cb0112680 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2ca400b790 tx=0x7f2ca4009220 comp rx=0 tx=0).stop 2023-12-06T14:58:30.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.920+0000 7f2cb8325700 1 -- 172.21.15.152:0/3700972215 shutdown_connections 2023-12-06T14:58:30.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.920+0000 7f2cb8325700 1 --2- 172.21.15.152:0/3700972215 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2cb00fbaf0 0x7f2cb0112680 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:30.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.920+0000 7f2cb8325700 1 --2- 172.21.15.152:0/3700972215 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f2c9c068f60 0x7f2c9c06b410 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:30.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.920+0000 7f2cb8325700 1 --2- 172.21.15.152:0/3700972215 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2cb00fcd00 0x7f2cb0114bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:30.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.920+0000 7f2cb8325700 1 -- 172.21.15.152:0/3700972215 >> 172.21.15.152:0/3700972215 conn(0x7f2cb00f71b0 msgr2=0x7f2cb00fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:30.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.921+0000 7f2cb8325700 1 -- 172.21.15.152:0/3700972215 shutdown_connections 2023-12-06T14:58:30.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:30.921+0000 7f2cb8325700 1 -- 172.21.15.152:0/3700972215 wait complete. 2023-12-06T14:58:31.303 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -e sha1=0482646fcf78576d871bc87843257d82edb79541 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2023-12-06T14:58:31.569 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:58:32.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:32 smithi190 ceph-mon[121340]: pgmap v146: 65 pgs: 65 active+clean; 582 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2023-12-06T14:58:32.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:32 smithi152 ceph-mon[111954]: pgmap v146: 65 pgs: 65 active+clean; 582 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2023-12-06T14:58:32.631 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.629+0000 7f1464b54700 1 -- 172.21.15.152:0/2871740794 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14600fcd00 msgr2=0x7f14600fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:32.631 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.629+0000 7f1464b54700 1 --2- 172.21.15.152:0/2871740794 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14600fcd00 0x7f14600fd150 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1450004940 tx=0x7f1450009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:32.631 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.629+0000 7f1464b54700 1 -- 172.21.15.152:0/2871740794 shutdown_connections 2023-12-06T14:58:32.631 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.629+0000 7f1464b54700 1 --2- 172.21.15.152:0/2871740794 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14600fcd00 0x7f14600fd150 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:32.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.629+0000 7f1464b54700 1 --2- 172.21.15.152:0/2871740794 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14600fbaf0 0x7f14600fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:32.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.629+0000 7f1464b54700 1 -- 172.21.15.152:0/2871740794 >> 172.21.15.152:0/2871740794 conn(0x7f14600f7190 msgr2=0x7f14600f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:32.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.629+0000 7f1464b54700 1 -- 172.21.15.152:0/2871740794 shutdown_connections 2023-12-06T14:58:32.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.629+0000 7f1464b54700 1 -- 172.21.15.152:0/2871740794 wait complete. 2023-12-06T14:58:32.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.630+0000 7f1464b54700 1 Processor -- start 2023-12-06T14:58:32.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.630+0000 7f1464b54700 1 -- start start 2023-12-06T14:58:32.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.630+0000 7f1464b54700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14600fbaf0 0x7f146010c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:32.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.630+0000 7f1464b54700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14600fcd00 0x7f146010c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:32.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.630+0000 7f1464b54700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146010cfb0 con 0x7f14600fbaf0 2023-12-06T14:58:32.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.630+0000 7f1464b54700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146010d850 con 0x7f14600fcd00 2023-12-06T14:58:32.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.630+0000 7f145e59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14600fbaf0 0x7f146010c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:32.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.630+0000 7f145e59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14600fbaf0 0x7f146010c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58866/0 (socket says 172.21.15.152:58866) 2023-12-06T14:58:32.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.630+0000 7f145e59c700 1 -- 172.21.15.152:0/3530838029 learned_addr learned my addr 172.21.15.152:0/3530838029 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:58:32.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.630+0000 7f145dd9b700 1 --2- 172.21.15.152:0/3530838029 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14600fcd00 0x7f146010c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:32.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.631+0000 7f145e59c700 1 -- 172.21.15.152:0/3530838029 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14600fcd00 msgr2=0x7f146010c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:32.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.631+0000 7f145e59c700 1 --2- 172.21.15.152:0/3530838029 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14600fcd00 0x7f146010c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:32.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.631+0000 7f145e59c700 1 -- 172.21.15.152:0/3530838029 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1450005040 con 0x7f14600fbaf0 2023-12-06T14:58:32.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.631+0000 7f145e59c700 1 --2- 172.21.15.152:0/3530838029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14600fbaf0 0x7f146010c470 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1454002a80 tx=0x7f1454004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:32.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.631+0000 7f144effd700 1 -- 172.21.15.152:0/3530838029 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1454007cc0 con 0x7f14600fbaf0 2023-12-06T14:58:32.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.631+0000 7f144effd700 1 -- 172.21.15.152:0/3530838029 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f145400f040 con 0x7f14600fbaf0 2023-12-06T14:58:32.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.631+0000 7f1464b54700 1 -- 172.21.15.152:0/3530838029 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f146010db30 con 0x7f14600fbaf0 2023-12-06T14:58:32.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.631+0000 7f144effd700 1 -- 172.21.15.152:0/3530838029 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f145400d9c0 con 0x7f14600fbaf0 2023-12-06T14:58:32.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.631+0000 7f1464b54700 1 -- 172.21.15.152:0/3530838029 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f146010e070 con 0x7f14600fbaf0 2023-12-06T14:58:32.634 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.632+0000 7f1464b54700 1 -- 172.21.15.152:0/3530838029 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f146004bb80 con 0x7f14600fbaf0 2023-12-06T14:58:32.634 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.632+0000 7f144effd700 1 -- 172.21.15.152:0/3530838029 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f145400db20 con 0x7f14600fbaf0 2023-12-06T14:58:32.634 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.633+0000 7f144effd700 1 --2- 172.21.15.152:0/3530838029 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f1448068f60 0x7f144806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:32.634 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.633+0000 7f145dd9b700 1 --2- 172.21.15.152:0/3530838029 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f1448068f60 0x7f144806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:32.634 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.633+0000 7f144effd700 1 -- 172.21.15.152:0/3530838029 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f1454086ad0 con 0x7f14600fbaf0 2023-12-06T14:58:32.634 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.633+0000 7f145dd9b700 1 --2- 172.21.15.152:0/3530838029 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f1448068f60 0x7f144806b410 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f145000b3b0 tx=0x7f1450009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:32.637 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.637+0000 7f144effd700 1 -- 172.21.15.152:0/3530838029 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f14540569b0 con 0x7f14600fbaf0 2023-12-06T14:58:32.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.819+0000 7f1464b54700 1 -- 172.21.15.152:0/3530838029 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f1460104490 con 0x7f14600fbaf0 2023-12-06T14:58:32.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.820+0000 7f144effd700 1 -- 172.21.15.152:0/3530838029 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7f1454056540 con 0x7f14600fbaf0 2023-12-06T14:58:32.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.822+0000 7f1464b54700 1 -- 172.21.15.152:0/3530838029 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f1448068f60 msgr2=0x7f144806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:32.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.822+0000 7f1464b54700 1 --2- 172.21.15.152:0/3530838029 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f1448068f60 0x7f144806b410 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f145000b3b0 tx=0x7f1450009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:32.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.822+0000 7f1464b54700 1 -- 172.21.15.152:0/3530838029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14600fbaf0 msgr2=0x7f146010c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:32.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.822+0000 7f1464b54700 1 --2- 172.21.15.152:0/3530838029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14600fbaf0 0x7f146010c470 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1454002a80 tx=0x7f1454004600 comp rx=0 tx=0).stop 2023-12-06T14:58:32.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.822+0000 7f1464b54700 1 -- 172.21.15.152:0/3530838029 shutdown_connections 2023-12-06T14:58:32.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.822+0000 7f1464b54700 1 --2- 172.21.15.152:0/3530838029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14600fbaf0 0x7f146010c470 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:32.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.822+0000 7f1464b54700 1 --2- 172.21.15.152:0/3530838029 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f1448068f60 0x7f144806b410 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:32.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.822+0000 7f1464b54700 1 --2- 172.21.15.152:0/3530838029 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14600fcd00 0x7f146010c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:32.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.822+0000 7f1464b54700 1 -- 172.21.15.152:0/3530838029 >> 172.21.15.152:0/3530838029 conn(0x7f14600f7190 msgr2=0x7f14600fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:32.822 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.822+0000 7f1464b54700 1 -- 172.21.15.152:0/3530838029 shutdown_connections 2023-12-06T14:58:32.823 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:32.822+0000 7f1464b54700 1 -- 172.21.15.152:0/3530838029 wait complete. 2023-12-06T14:58:33.222 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -e sha1=0482646fcf78576d871bc87843257d82edb79541 -- bash -c 'ceph config set global log_to_journald false --force' 2023-12-06T14:58:33.486 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:58:34.324 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:34 smithi152 ceph-mon[111954]: pgmap v147: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 938 B/s wr, 5 op/s 2023-12-06T14:58:34.511 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.510+0000 7f28634f8700 1 -- 172.21.15.152:0/1748274791 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f285c0fbaf0 msgr2=0x7f285c0fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:34.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.510+0000 7f28634f8700 1 --2- 172.21.15.152:0/1748274791 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f285c0fbaf0 0x7f285c0fbf00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f284c004940 tx=0x7f284c009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:34.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.510+0000 7f28634f8700 1 -- 172.21.15.152:0/1748274791 shutdown_connections 2023-12-06T14:58:34.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.510+0000 7f28634f8700 1 --2- 172.21.15.152:0/1748274791 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f285c0fcd00 0x7f285c0fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:34.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.510+0000 7f28634f8700 1 --2- 172.21.15.152:0/1748274791 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f285c0fbaf0 0x7f285c0fbf00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:34.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.510+0000 7f28634f8700 1 -- 172.21.15.152:0/1748274791 >> 172.21.15.152:0/1748274791 conn(0x7f285c0f71b0 msgr2=0x7f285c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:34.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.510+0000 7f28634f8700 1 -- 172.21.15.152:0/1748274791 shutdown_connections 2023-12-06T14:58:34.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.510+0000 7f28634f8700 1 -- 172.21.15.152:0/1748274791 wait complete. 2023-12-06T14:58:34.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.510+0000 7f28634f8700 1 Processor -- start 2023-12-06T14:58:34.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.510+0000 7f28634f8700 1 -- start start 2023-12-06T14:58:34.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.511+0000 7f28634f8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f285c0fbaf0 0x7f285c10d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:34.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.511+0000 7f28634f8700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f285c0fcd00 0x7f285c10dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:34.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.511+0000 7f28634f8700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285c10e140 con 0x7f285c0fbaf0 2023-12-06T14:58:34.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.511+0000 7f28634f8700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285c10e980 con 0x7f285c0fcd00 2023-12-06T14:58:34.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.511+0000 7f2861294700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f285c0fbaf0 0x7f285c10d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:34.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.511+0000 7f2861294700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f285c0fbaf0 0x7f285c10d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58886/0 (socket says 172.21.15.152:58886) 2023-12-06T14:58:34.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.511+0000 7f2861294700 1 -- 172.21.15.152:0/917728937 learned_addr learned my addr 172.21.15.152:0/917728937 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:58:34.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.511+0000 7f2860a93700 1 --2- 172.21.15.152:0/917728937 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f285c0fcd00 0x7f285c10dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:34.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.511+0000 7f2861294700 1 -- 172.21.15.152:0/917728937 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f285c0fcd00 msgr2=0x7f285c10dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:34.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.511+0000 7f2861294700 1 --2- 172.21.15.152:0/917728937 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f285c0fcd00 0x7f285c10dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:34.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.511+0000 7f2861294700 1 -- 172.21.15.152:0/917728937 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284c005040 con 0x7f285c0fbaf0 2023-12-06T14:58:34.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.511+0000 7f2861294700 1 --2- 172.21.15.152:0/917728937 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f285c0fbaf0 0x7f285c10d570 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f284c004f90 tx=0x7f284c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:34.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.511+0000 7f2851ffb700 1 -- 172.21.15.152:0/917728937 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f284c00e040 con 0x7f285c0fbaf0 2023-12-06T14:58:34.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.511+0000 7f2851ffb700 1 -- 172.21.15.152:0/917728937 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f284c00bc50 con 0x7f285c0fbaf0 2023-12-06T14:58:34.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.511+0000 7f28634f8700 1 -- 172.21.15.152:0/917728937 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f285c10ec00 con 0x7f285c0fbaf0 2023-12-06T14:58:34.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.511+0000 7f2851ffb700 1 -- 172.21.15.152:0/917728937 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f284c01c630 con 0x7f285c0fbaf0 2023-12-06T14:58:34.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.512+0000 7f28634f8700 1 -- 172.21.15.152:0/917728937 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f285c10f140 con 0x7f285c0fbaf0 2023-12-06T14:58:34.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.512+0000 7f28634f8700 1 -- 172.21.15.152:0/917728937 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f285c04bb80 con 0x7f285c0fbaf0 2023-12-06T14:58:34.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.513+0000 7f2851ffb700 1 -- 172.21.15.152:0/917728937 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f284c013420 con 0x7f285c0fbaf0 2023-12-06T14:58:34.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.513+0000 7f2851ffb700 1 --2- 172.21.15.152:0/917728937 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f2848068f60 0x7f284806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:34.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.513+0000 7f2851ffb700 1 -- 172.21.15.152:0/917728937 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f284c088130 con 0x7f285c0fbaf0 2023-12-06T14:58:34.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.513+0000 7f2860a93700 1 --2- 172.21.15.152:0/917728937 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f2848068f60 0x7f284806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:34.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.514+0000 7f2860a93700 1 --2- 172.21.15.152:0/917728937 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f2848068f60 0x7f284806b410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2858009bf0 tx=0x7f28580091a0 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:34.517 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.518+0000 7f2851ffb700 1 -- 172.21.15.152:0/917728937 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f284c058070 con 0x7f285c0fbaf0 2023-12-06T14:58:34.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:34 smithi190 ceph-mon[121340]: pgmap v147: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 938 B/s wr, 5 op/s 2023-12-06T14:58:34.701 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.701+0000 7f28634f8700 1 -- 172.21.15.152:0/917728937 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f285c10f720 con 0x7f285c0fbaf0 2023-12-06T14:58:34.701 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.701+0000 7f2851ffb700 1 -- 172.21.15.152:0/917728937 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f284c057c00 con 0x7f285c0fbaf0 2023-12-06T14:58:34.703 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.703+0000 7f28634f8700 1 -- 172.21.15.152:0/917728937 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f2848068f60 msgr2=0x7f284806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:34.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.703+0000 7f28634f8700 1 --2- 172.21.15.152:0/917728937 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f2848068f60 0x7f284806b410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2858009bf0 tx=0x7f28580091a0 comp rx=0 tx=0).stop 2023-12-06T14:58:34.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.703+0000 7f28634f8700 1 -- 172.21.15.152:0/917728937 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f285c0fbaf0 msgr2=0x7f285c10d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:34.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.703+0000 7f28634f8700 1 --2- 172.21.15.152:0/917728937 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f285c0fbaf0 0x7f285c10d570 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f284c004f90 tx=0x7f284c009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:34.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.703+0000 7f28634f8700 1 -- 172.21.15.152:0/917728937 shutdown_connections 2023-12-06T14:58:34.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.703+0000 7f28634f8700 1 --2- 172.21.15.152:0/917728937 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f285c0fbaf0 0x7f285c10d570 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:34.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.703+0000 7f28634f8700 1 --2- 172.21.15.152:0/917728937 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f2848068f60 0x7f284806b410 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:34.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.703+0000 7f28634f8700 1 --2- 172.21.15.152:0/917728937 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f285c0fcd00 0x7f285c10dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:34.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.703+0000 7f28634f8700 1 -- 172.21.15.152:0/917728937 >> 172.21.15.152:0/917728937 conn(0x7f285c0f71b0 msgr2=0x7f285c065be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:34.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.703+0000 7f28634f8700 1 -- 172.21.15.152:0/917728937 shutdown_connections 2023-12-06T14:58:34.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:34.703+0000 7f28634f8700 1 -- 172.21.15.152:0/917728937 wait complete. 2023-12-06T14:58:35.089 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -e sha1=0482646fcf78576d871bc87843257d82edb79541 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2023-12-06T14:58:35.350 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:58:36.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:35 smithi152 ceph-mon[111954]: pgmap v148: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 938 B/s wr, 4 op/s 2023-12-06T14:58:36.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:35 smithi190 ceph-mon[121340]: pgmap v148: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 938 B/s wr, 4 op/s 2023-12-06T14:58:36.437 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.435+0000 7fa125594700 1 -- 172.21.15.152:0/2362494739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1200fcd00 msgr2=0x7fa1200fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:36.437 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.435+0000 7fa125594700 1 --2- 172.21.15.152:0/2362494739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1200fcd00 0x7fa1200fd150 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa110004940 tx=0x7fa110009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:36.437 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.435+0000 7fa125594700 1 -- 172.21.15.152:0/2362494739 shutdown_connections 2023-12-06T14:58:36.437 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.435+0000 7fa125594700 1 --2- 172.21.15.152:0/2362494739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1200fcd00 0x7fa1200fd150 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:36.437 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.435+0000 7fa125594700 1 --2- 172.21.15.152:0/2362494739 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1200fbaf0 0x7fa1200fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:36.437 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.435+0000 7fa125594700 1 -- 172.21.15.152:0/2362494739 >> 172.21.15.152:0/2362494739 conn(0x7fa1200f7190 msgr2=0x7fa1200f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:36.437 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.435+0000 7fa125594700 1 -- 172.21.15.152:0/2362494739 shutdown_connections 2023-12-06T14:58:36.437 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.435+0000 7fa125594700 1 -- 172.21.15.152:0/2362494739 wait complete. 2023-12-06T14:58:36.437 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.436+0000 7fa125594700 1 Processor -- start 2023-12-06T14:58:36.438 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.436+0000 7fa125594700 1 -- start start 2023-12-06T14:58:36.438 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.436+0000 7fa125594700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1200fbaf0 0x7fa1201125f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:36.438 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.436+0000 7fa125594700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1200fcd00 0x7fa120114b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:36.438 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.436+0000 7fa125594700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa120066000 con 0x7fa1200fcd00 2023-12-06T14:58:36.438 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.436+0000 7fa125594700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa120066140 con 0x7fa1200fbaf0 2023-12-06T14:58:36.438 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.436+0000 7fa11e7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1200fcd00 0x7fa120114b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:36.438 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.436+0000 7fa11e7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1200fcd00 0x7fa120114b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58912/0 (socket says 172.21.15.152:58912) 2023-12-06T14:58:36.438 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.436+0000 7fa11e7fc700 1 -- 172.21.15.152:0/4058986142 learned_addr learned my addr 172.21.15.152:0/4058986142 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:58:36.438 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.436+0000 7fa11effd700 1 --2- 172.21.15.152:0/4058986142 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1200fbaf0 0x7fa1201125f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:36.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.436+0000 7fa11e7fc700 1 -- 172.21.15.152:0/4058986142 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1200fbaf0 msgr2=0x7fa1201125f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:36.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.436+0000 7fa11e7fc700 1 --2- 172.21.15.152:0/4058986142 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1200fbaf0 0x7fa1201125f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:36.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.436+0000 7fa11e7fc700 1 -- 172.21.15.152:0/4058986142 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa110005040 con 0x7fa1200fcd00 2023-12-06T14:58:36.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.436+0000 7fa11e7fc700 1 --2- 172.21.15.152:0/4058986142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1200fcd00 0x7fa120114b40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa110000c00 tx=0x7fa110009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:36.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.437+0000 7fa1077fe700 1 -- 172.21.15.152:0/4058986142 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa110021070 con 0x7fa1200fcd00 2023-12-06T14:58:36.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.437+0000 7fa1077fe700 1 -- 172.21.15.152:0/4058986142 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa11001c400 con 0x7fa1200fcd00 2023-12-06T14:58:36.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.437+0000 7fa125594700 1 -- 172.21.15.152:0/4058986142 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa120115080 con 0x7fa1200fcd00 2023-12-06T14:58:36.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.437+0000 7fa1077fe700 1 -- 172.21.15.152:0/4058986142 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa11000e070 con 0x7fa1200fcd00 2023-12-06T14:58:36.439 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.437+0000 7fa125594700 1 -- 172.21.15.152:0/4058986142 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa120115420 con 0x7fa1200fcd00 2023-12-06T14:58:36.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.438+0000 7fa125594700 1 -- 172.21.15.152:0/4058986142 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa12004bb80 con 0x7fa1200fcd00 2023-12-06T14:58:36.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.438+0000 7fa1077fe700 1 -- 172.21.15.152:0/4058986142 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fa11001c9c0 con 0x7fa1200fcd00 2023-12-06T14:58:36.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.438+0000 7fa1077fe700 1 --2- 172.21.15.152:0/4058986142 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fa108068f60 0x7fa10806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:36.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.438+0000 7fa1077fe700 1 -- 172.21.15.152:0/4058986142 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fa110088000 con 0x7fa1200fcd00 2023-12-06T14:58:36.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.439+0000 7fa11effd700 1 --2- 172.21.15.152:0/4058986142 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fa108068f60 0x7fa10806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:36.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.439+0000 7fa11effd700 1 --2- 172.21.15.152:0/4058986142 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fa108068f60 0x7fa10806b410 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa120065d90 tx=0x7fa11400b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:36.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.443+0000 7fa1077fe700 1 -- 172.21.15.152:0/4058986142 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fa1100544d0 con 0x7fa1200fcd00 2023-12-06T14:58:36.647 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.647+0000 7fa125594700 1 -- 172.21.15.152:0/4058986142 --> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:0482646fcf78576d871bc87843257d82edb79541", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1201016f0 con 0x7fa108068f60 2023-12-06T14:58:36.652 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.652+0000 7fa1077fe700 1 -- 172.21.15.152:0/4058986142 <== mgr.14210 v2:172.21.15.152:6800/3317409709 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7fa1201016f0 con 0x7fa108068f60 2023-12-06T14:58:36.653 INFO:teuthology.orchestra.run.smithi152.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:0482646fcf78576d871bc87843257d82edb79541 2023-12-06T14:58:36.655 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.654+0000 7fa125594700 1 -- 172.21.15.152:0/4058986142 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fa108068f60 msgr2=0x7fa10806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:36.655 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.654+0000 7fa125594700 1 --2- 172.21.15.152:0/4058986142 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fa108068f60 0x7fa10806b410 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa120065d90 tx=0x7fa11400b040 comp rx=0 tx=0).stop 2023-12-06T14:58:36.655 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.655+0000 7fa125594700 1 -- 172.21.15.152:0/4058986142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1200fcd00 msgr2=0x7fa120114b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:36.655 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.655+0000 7fa125594700 1 --2- 172.21.15.152:0/4058986142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1200fcd00 0x7fa120114b40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa110000c00 tx=0x7fa110009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:36.655 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.655+0000 7fa125594700 1 -- 172.21.15.152:0/4058986142 shutdown_connections 2023-12-06T14:58:36.655 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.655+0000 7fa125594700 1 --2- 172.21.15.152:0/4058986142 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fa108068f60 0x7fa10806b410 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:36.655 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.655+0000 7fa125594700 1 --2- 172.21.15.152:0/4058986142 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1200fbaf0 0x7fa1201125f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:36.655 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.655+0000 7fa125594700 1 --2- 172.21.15.152:0/4058986142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa1200fcd00 0x7fa120114b40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:36.655 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.655+0000 7fa125594700 1 -- 172.21.15.152:0/4058986142 >> 172.21.15.152:0/4058986142 conn(0x7fa1200f7190 msgr2=0x7fa1200fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:36.655 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.655+0000 7fa125594700 1 -- 172.21.15.152:0/4058986142 shutdown_connections 2023-12-06T14:58:36.656 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:36.655+0000 7fa125594700 1 -- 172.21.15.152:0/4058986142 wait complete. 2023-12-06T14:58:37.063 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2023-12-06T14:58:37.064 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi152.front.sepia.ceph.com 2023-12-06T14:58:37.064 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -e sha1=0482646fcf78576d871bc87843257d82edb79541 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2023-12-06T14:58:37.357 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T14:58:37.798 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:37 smithi152 ceph-mon[111954]: from='client.14552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:0482646fcf78576d871bc87843257d82edb79541", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:58:37.798 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:37 smithi152 ceph-mon[111954]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:0482646fcf78576d871bc87843257d82edb79541 2023-12-06T14:58:37.798 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:37 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:37.798 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:37 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:58:37.798 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:37 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:58:37.799 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:37 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:58:37.799 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:37 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:37.799 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:37 smithi152 ceph-mon[111954]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:0482646fcf78576d871bc87843257d82edb79541 2023-12-06T14:58:37.799 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:37 smithi152 ceph-mon[111954]: pgmap v149: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 1023 B/s wr, 5 op/s 2023-12-06T14:58:38.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:37 smithi190 ceph-mon[121340]: from='client.14552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:0482646fcf78576d871bc87843257d82edb79541", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:58:38.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:37 smithi190 ceph-mon[121340]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:0482646fcf78576d871bc87843257d82edb79541 2023-12-06T14:58:38.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:37 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:38.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:37 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:58:38.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:37 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:58:38.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:37 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:58:38.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:37 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:58:38.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:37 smithi190 ceph-mon[121340]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:0482646fcf78576d871bc87843257d82edb79541 2023-12-06T14:58:38.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:37 smithi190 ceph-mon[121340]: pgmap v149: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 1023 B/s wr, 5 op/s 2023-12-06T14:58:38.338 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.336+0000 7f02d0673700 1 -- 172.21.15.152:0/2440918663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02c80ffd70 msgr2=0x7f02c81021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:38.338 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.336+0000 7f02d0673700 1 --2- 172.21.15.152:0/2440918663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02c80ffd70 0x7f02c81021d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f02b8004940 tx=0x7f02b8009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:38.338 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.337+0000 7f02d0673700 1 -- 172.21.15.152:0/2440918663 shutdown_connections 2023-12-06T14:58:38.338 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.337+0000 7f02d0673700 1 --2- 172.21.15.152:0/2440918663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02c80ffd70 0x7f02c81021d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:38.338 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.337+0000 7f02d0673700 1 --2- 172.21.15.152:0/2440918663 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02c8066090 0x7f02c80ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:38.338 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.337+0000 7f02d0673700 1 -- 172.21.15.152:0/2440918663 >> 172.21.15.152:0/2440918663 conn(0x7f02c80f7190 msgr2=0x7f02c80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:38.339 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.337+0000 7f02d0673700 1 -- 172.21.15.152:0/2440918663 shutdown_connections 2023-12-06T14:58:38.339 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.337+0000 7f02d0673700 1 -- 172.21.15.152:0/2440918663 wait complete. 2023-12-06T14:58:38.339 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.337+0000 7f02d0673700 1 Processor -- start 2023-12-06T14:58:38.339 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.337+0000 7f02d0673700 1 -- start start 2023-12-06T14:58:38.339 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.337+0000 7f02d0673700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02c8066090 0x7f02c80fd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:38.339 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.337+0000 7f02d0673700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02c80ffd70 0x7f02c80fb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:38.339 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.337+0000 7f02d0673700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c80fbca0 con 0x7f02c8066090 2023-12-06T14:58:38.339 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.337+0000 7f02d0673700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c80fbe10 con 0x7f02c80ffd70 2023-12-06T14:58:38.339 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.337+0000 7f02ce40f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02c8066090 0x7f02c80fd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:38.339 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.337+0000 7f02ce40f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02c8066090 0x7f02c80fd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58934/0 (socket says 172.21.15.152:58934) 2023-12-06T14:58:38.339 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.337+0000 7f02ce40f700 1 -- 172.21.15.152:0/2640353097 learned_addr learned my addr 172.21.15.152:0/2640353097 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:58:38.339 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.338+0000 7f02cdc0e700 1 --2- 172.21.15.152:0/2640353097 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02c80ffd70 0x7f02c80fb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:38.339 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.338+0000 7f02ce40f700 1 -- 172.21.15.152:0/2640353097 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02c80ffd70 msgr2=0x7f02c80fb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:38.340 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.338+0000 7f02ce40f700 1 --2- 172.21.15.152:0/2640353097 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02c80ffd70 0x7f02c80fb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:38.340 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.338+0000 7f02ce40f700 1 -- 172.21.15.152:0/2640353097 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b8005040 con 0x7f02c8066090 2023-12-06T14:58:38.340 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.338+0000 7f02cdc0e700 1 --2- 172.21.15.152:0/2640353097 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02c80ffd70 0x7f02c80fb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-06T14:58:38.340 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.338+0000 7f02ce40f700 1 --2- 172.21.15.152:0/2640353097 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02c8066090 0x7f02c80fd220 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f02c400c8c0 tx=0x7f02c40044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:38.340 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.338+0000 7f02beffd700 1 -- 172.21.15.152:0/2640353097 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02c400a980 con 0x7f02c8066090 2023-12-06T14:58:38.340 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.338+0000 7f02d0673700 1 -- 172.21.15.152:0/2640353097 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02c80fc0f0 con 0x7f02c8066090 2023-12-06T14:58:38.340 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.338+0000 7f02beffd700 1 -- 172.21.15.152:0/2640353097 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f02c400ce60 con 0x7f02c8066090 2023-12-06T14:58:38.340 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.338+0000 7f02beffd700 1 -- 172.21.15.152:0/2640353097 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02c40113a0 con 0x7f02c8066090 2023-12-06T14:58:38.340 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.338+0000 7f02d0673700 1 -- 172.21.15.152:0/2640353097 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02c8115560 con 0x7f02c8066090 2023-12-06T14:58:38.341 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.339+0000 7f02d0673700 1 -- 172.21.15.152:0/2640353097 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02c81075c0 con 0x7f02c8066090 2023-12-06T14:58:38.341 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.340+0000 7f02beffd700 1 -- 172.21.15.152:0/2640353097 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f02c4012400 con 0x7f02c8066090 2023-12-06T14:58:38.341 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.340+0000 7f02beffd700 1 --2- 172.21.15.152:0/2640353097 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f02b4068f60 0x7f02b406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:38.341 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.340+0000 7f02beffd700 1 -- 172.21.15.152:0/2640353097 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f02c4086ef0 con 0x7f02c8066090 2023-12-06T14:58:38.341 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.340+0000 7f02cdc0e700 1 --2- 172.21.15.152:0/2640353097 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f02b4068f60 0x7f02b406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:38.341 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.341+0000 7f02cdc0e700 1 --2- 172.21.15.152:0/2640353097 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f02b4068f60 0x7f02b406b410 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f02b8009fd0 tx=0x7f02b8009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:38.344 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.345+0000 7f02beffd700 1 -- 172.21.15.152:0/2640353097 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f02c4056e50 con 0x7f02c8066090 2023-12-06T14:58:38.577 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.577+0000 7f02d0673700 1 -- 172.21.15.152:0/2640353097 --> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f02c802b150 con 0x7f02b4068f60 2023-12-06T14:58:38.578 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.578+0000 7f02beffd700 1 -- 172.21.15.152:0/2640353097 <== mgr.14210 v2:172.21.15.152:6800/3317409709 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f02c802b150 con 0x7f02b4068f60 2023-12-06T14:58:38.581 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.580+0000 7f02d0673700 1 -- 172.21.15.152:0/2640353097 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f02b4068f60 msgr2=0x7f02b406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:38.581 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.580+0000 7f02d0673700 1 --2- 172.21.15.152:0/2640353097 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f02b4068f60 0x7f02b406b410 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f02b8009fd0 tx=0x7f02b8009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:38.581 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.580+0000 7f02d0673700 1 -- 172.21.15.152:0/2640353097 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02c8066090 msgr2=0x7f02c80fd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:38.581 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.580+0000 7f02d0673700 1 --2- 172.21.15.152:0/2640353097 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02c8066090 0x7f02c80fd220 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f02c400c8c0 tx=0x7f02c40044c0 comp rx=0 tx=0).stop 2023-12-06T14:58:38.581 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.581+0000 7f02d0673700 1 -- 172.21.15.152:0/2640353097 shutdown_connections 2023-12-06T14:58:38.581 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.581+0000 7f02d0673700 1 --2- 172.21.15.152:0/2640353097 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f02c8066090 0x7f02c80fd220 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:38.581 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.581+0000 7f02d0673700 1 --2- 172.21.15.152:0/2640353097 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f02b4068f60 0x7f02b406b410 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:38.581 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.581+0000 7f02d0673700 1 --2- 172.21.15.152:0/2640353097 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02c80ffd70 0x7f02c80fb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:38.581 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.581+0000 7f02d0673700 1 -- 172.21.15.152:0/2640353097 >> 172.21.15.152:0/2640353097 conn(0x7f02c80f7190 msgr2=0x7f02c80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:38.581 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.581+0000 7f02d0673700 1 -- 172.21.15.152:0/2640353097 shutdown_connections 2023-12-06T14:58:38.581 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.581+0000 7f02d0673700 1 -- 172.21.15.152:0/2640353097 wait complete. 2023-12-06T14:58:38.591 INFO:teuthology.orchestra.run.smithi152.stdout:true 2023-12-06T14:58:38.690 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.690+0000 7f860699d700 1 -- 172.21.15.152:0/103267255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86000fcd00 msgr2=0x7f86000fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:38.690 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.690+0000 7f860699d700 1 --2- 172.21.15.152:0/103267255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86000fcd00 0x7f86000fd150 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f85f4004940 tx=0x7f85f4009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:38.690 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.690+0000 7f860699d700 1 -- 172.21.15.152:0/103267255 shutdown_connections 2023-12-06T14:58:38.690 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.690+0000 7f860699d700 1 --2- 172.21.15.152:0/103267255 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86000fcd00 0x7f86000fd150 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:38.690 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.690+0000 7f860699d700 1 --2- 172.21.15.152:0/103267255 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86000fbaf0 0x7f86000fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:38.690 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.690+0000 7f860699d700 1 -- 172.21.15.152:0/103267255 >> 172.21.15.152:0/103267255 conn(0x7f86000f7190 msgr2=0x7f86000f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:38.690 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.690+0000 7f860699d700 1 -- 172.21.15.152:0/103267255 shutdown_connections 2023-12-06T14:58:38.690 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.690+0000 7f860699d700 1 -- 172.21.15.152:0/103267255 wait complete. 2023-12-06T14:58:38.692 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.690+0000 7f860699d700 1 Processor -- start 2023-12-06T14:58:38.692 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.691+0000 7f860699d700 1 -- start start 2023-12-06T14:58:38.692 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.691+0000 7f860699d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86000fbaf0 0x7f86001101d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:38.692 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.691+0000 7f860699d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86000fcd00 0x7f8600112720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:38.692 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.691+0000 7f860699d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8600066130 con 0x7f86000fbaf0 2023-12-06T14:58:38.692 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.691+0000 7f860699d700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8600066270 con 0x7f86000fcd00 2023-12-06T14:58:38.692 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.691+0000 7f85fffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86000fbaf0 0x7f86001101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:38.692 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.691+0000 7f85fffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86000fbaf0 0x7f86001101d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58940/0 (socket says 172.21.15.152:58940) 2023-12-06T14:58:38.693 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.691+0000 7f85fffff700 1 -- 172.21.15.152:0/1473224805 learned_addr learned my addr 172.21.15.152:0/1473224805 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:58:38.693 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.691+0000 7f85ff7fe700 1 --2- 172.21.15.152:0/1473224805 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86000fcd00 0x7f8600112720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:38.693 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.691+0000 7f85fffff700 1 -- 172.21.15.152:0/1473224805 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86000fcd00 msgr2=0x7f8600112720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:38.693 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.691+0000 7f85fffff700 1 --2- 172.21.15.152:0/1473224805 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86000fcd00 0x7f8600112720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:38.693 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.691+0000 7f85fffff700 1 -- 172.21.15.152:0/1473224805 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f4005040 con 0x7f86000fbaf0 2023-12-06T14:58:38.693 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.691+0000 7f85fffff700 1 --2- 172.21.15.152:0/1473224805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86000fbaf0 0x7f86001101d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f85f000eb70 tx=0x7f85f000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:38.693 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.692+0000 7f85fcff9700 1 -- 172.21.15.152:0/1473224805 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85f0007cc0 con 0x7f86000fbaf0 2023-12-06T14:58:38.693 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.692+0000 7f85fcff9700 1 -- 172.21.15.152:0/1473224805 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f85f000f040 con 0x7f86000fbaf0 2023-12-06T14:58:38.693 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.692+0000 7f860699d700 1 -- 172.21.15.152:0/1473224805 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8600112d20 con 0x7f86000fbaf0 2023-12-06T14:58:38.693 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.692+0000 7f85fcff9700 1 -- 172.21.15.152:0/1473224805 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85f000c9d0 con 0x7f86000fbaf0 2023-12-06T14:58:38.693 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.692+0000 7f860699d700 1 -- 172.21.15.152:0/1473224805 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86001131b0 con 0x7f86000fbaf0 2023-12-06T14:58:38.694 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.693+0000 7f860699d700 1 -- 172.21.15.152:0/1473224805 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f860004bb80 con 0x7f86000fbaf0 2023-12-06T14:58:38.694 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.693+0000 7f85fcff9700 1 -- 172.21.15.152:0/1473224805 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f85f000cc40 con 0x7f86000fbaf0 2023-12-06T14:58:38.694 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.694+0000 7f85fcff9700 1 --2- 172.21.15.152:0/1473224805 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f85e8068f60 0x7f85e806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:38.694 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.694+0000 7f85fcff9700 1 -- 172.21.15.152:0/1473224805 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f85f0086840 con 0x7f86000fbaf0 2023-12-06T14:58:38.694 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.694+0000 7f85ff7fe700 1 --2- 172.21.15.152:0/1473224805 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f85e8068f60 0x7f85e806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:38.695 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.695+0000 7f85ff7fe700 1 --2- 172.21.15.152:0/1473224805 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f85e8068f60 0x7f85e806b410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f85f4000c00 tx=0x7f85f4009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:38.699 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.699+0000 7f85fcff9700 1 -- 172.21.15.152:0/1473224805 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f85f004da00 con 0x7f86000fbaf0 2023-12-06T14:58:38.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.916+0000 7f860699d700 1 -- 172.21.15.152:0/1473224805 --> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8600101650 con 0x7f85e8068f60 2023-12-06T14:58:38.916 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.917+0000 7f85fcff9700 1 -- 172.21.15.152:0/1473224805 <== mgr.14210 v2:172.21.15.152:6800/3317409709 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f8600101650 con 0x7f85e8068f60 2023-12-06T14:58:38.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.919+0000 7f860699d700 1 -- 172.21.15.152:0/1473224805 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f85e8068f60 msgr2=0x7f85e806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:38.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.919+0000 7f860699d700 1 --2- 172.21.15.152:0/1473224805 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f85e8068f60 0x7f85e806b410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f85f4000c00 tx=0x7f85f4009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:38.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.919+0000 7f860699d700 1 -- 172.21.15.152:0/1473224805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86000fbaf0 msgr2=0x7f86001101d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:38.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.919+0000 7f860699d700 1 --2- 172.21.15.152:0/1473224805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86000fbaf0 0x7f86001101d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f85f000eb70 tx=0x7f85f000b040 comp rx=0 tx=0).stop 2023-12-06T14:58:38.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.919+0000 7f860699d700 1 -- 172.21.15.152:0/1473224805 shutdown_connections 2023-12-06T14:58:38.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.919+0000 7f860699d700 1 --2- 172.21.15.152:0/1473224805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86000fbaf0 0x7f86001101d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:38.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.919+0000 7f860699d700 1 --2- 172.21.15.152:0/1473224805 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f85e8068f60 0x7f85e806b410 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:38.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.919+0000 7f860699d700 1 --2- 172.21.15.152:0/1473224805 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86000fcd00 0x7f8600112720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:38.920 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.919+0000 7f860699d700 1 -- 172.21.15.152:0/1473224805 >> 172.21.15.152:0/1473224805 conn(0x7f86000f7190 msgr2=0x7f86000fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:38.920 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.919+0000 7f860699d700 1 -- 172.21.15.152:0/1473224805 shutdown_connections 2023-12-06T14:58:38.920 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:38.919+0000 7f860699d700 1 -- 172.21.15.152:0/1473224805 wait complete. 2023-12-06T14:58:39.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.025+0000 7f1e287ea700 1 -- 172.21.15.152:0/3714043310 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1e200fcbf0 msgr2=0x7f1e200fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:39.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.025+0000 7f1e287ea700 1 --2- 172.21.15.152:0/3714043310 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1e200fcbf0 0x7f1e200fd000 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c004940 tx=0x7f1e1c009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:39.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.025+0000 7f1e287ea700 1 -- 172.21.15.152:0/3714043310 shutdown_connections 2023-12-06T14:58:39.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.025+0000 7f1e287ea700 1 --2- 172.21.15.152:0/3714043310 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1e200fde00 0x7f1e200fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:39.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.025+0000 7f1e287ea700 1 --2- 172.21.15.152:0/3714043310 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1e200fcbf0 0x7f1e200fd000 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:39.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.025+0000 7f1e287ea700 1 -- 172.21.15.152:0/3714043310 >> 172.21.15.152:0/3714043310 conn(0x7f1e200f82d0 msgr2=0x7f1e200fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:39.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.025+0000 7f1e287ea700 1 -- 172.21.15.152:0/3714043310 shutdown_connections 2023-12-06T14:58:39.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.025+0000 7f1e287ea700 1 -- 172.21.15.152:0/3714043310 wait complete. 2023-12-06T14:58:39.027 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.026+0000 7f1e287ea700 1 Processor -- start 2023-12-06T14:58:39.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.026+0000 7f1e287ea700 1 -- start start 2023-12-06T14:58:39.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.026+0000 7f1e287ea700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1e200fcbf0 0x7f1e2010d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:39.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.026+0000 7f1e287ea700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1e200fde00 0x7f1e2010daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:39.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.026+0000 7f1e287ea700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2010e0a0 con 0x7f1e200fde00 2023-12-06T14:58:39.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.026+0000 7f1e287ea700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2010e940 con 0x7f1e200fcbf0 2023-12-06T14:58:39.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.026+0000 7f1e25d85700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1e200fde00 0x7f1e2010daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:39.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.026+0000 7f1e25d85700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1e200fde00 0x7f1e2010daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58962/0 (socket says 172.21.15.152:58962) 2023-12-06T14:58:39.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.026+0000 7f1e25d85700 1 -- 172.21.15.152:0/2790756147 learned_addr learned my addr 172.21.15.152:0/2790756147 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:58:39.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.026+0000 7f1e26586700 1 --2- 172.21.15.152:0/2790756147 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1e200fcbf0 0x7f1e2010d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:39.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.026+0000 7f1e25d85700 1 -- 172.21.15.152:0/2790756147 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1e200fcbf0 msgr2=0x7f1e2010d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:39.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.026+0000 7f1e25d85700 1 --2- 172.21.15.152:0/2790756147 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1e200fcbf0 0x7f1e2010d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:39.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.026+0000 7f1e25d85700 1 -- 172.21.15.152:0/2790756147 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c005040 con 0x7f1e200fde00 2023-12-06T14:58:39.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.026+0000 7f1e25d85700 1 --2- 172.21.15.152:0/2790756147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1e200fde00 0x7f1e2010daa0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1e10002a50 tx=0x7f1e100046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:39.028 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.027+0000 7f1e16ffd700 1 -- 172.21.15.152:0/2790756147 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e10007cc0 con 0x7f1e200fde00 2023-12-06T14:58:39.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.027+0000 7f1e287ea700 1 -- 172.21.15.152:0/2790756147 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e2010ec20 con 0x7f1e200fde00 2023-12-06T14:58:39.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.027+0000 7f1e16ffd700 1 -- 172.21.15.152:0/2790756147 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1e1000f040 con 0x7f1e200fde00 2023-12-06T14:58:39.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.027+0000 7f1e16ffd700 1 -- 172.21.15.152:0/2790756147 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e1000d9c0 con 0x7f1e200fde00 2023-12-06T14:58:39.029 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.027+0000 7f1e287ea700 1 -- 172.21.15.152:0/2790756147 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e2010f160 con 0x7f1e200fde00 2023-12-06T14:58:39.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.028+0000 7f1e287ea700 1 -- 172.21.15.152:0/2790756147 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e201075d0 con 0x7f1e200fde00 2023-12-06T14:58:39.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.028+0000 7f1e16ffd700 1 -- 172.21.15.152:0/2790756147 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f1e1000db20 con 0x7f1e200fde00 2023-12-06T14:58:39.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.029+0000 7f1e16ffd700 1 --2- 172.21.15.152:0/2790756147 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f1e0c068f60 0x7f1e0c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:39.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.029+0000 7f1e16ffd700 1 -- 172.21.15.152:0/2790756147 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f1e10086ae0 con 0x7f1e200fde00 2023-12-06T14:58:39.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.029+0000 7f1e26586700 1 --2- 172.21.15.152:0/2790756147 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f1e0c068f60 0x7f1e0c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:39.030 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.029+0000 7f1e26586700 1 --2- 172.21.15.152:0/2790756147 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f1e0c068f60 0x7f1e0c06b410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c004890 tx=0x7f1e1c009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:39.034 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.034+0000 7f1e16ffd700 1 -- 172.21.15.152:0/2790756147 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f1e100569c0 con 0x7f1e200fde00 2023-12-06T14:58:39.239 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.239+0000 7f1e287ea700 1 -- 172.21.15.152:0/2790756147 --> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e2010f380 con 0x7f1e0c068f60 2023-12-06T14:58:39.248 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.248+0000 7f1e16ffd700 1 -- 172.21.15.152:0/2790756147 <== mgr.14210 v2:172.21.15.152:6800/3317409709 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f1e2010f380 con 0x7f1e0c068f60 2023-12-06T14:58:39.248 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-06T14:58:39.249 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 running (3m) 23s ago 4m 26.3M - 0.25.0 c8568f914cd2 a93c38b08b75 2023-12-06T14:58:39.249 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (4m) 23s ago 4m 7436k - 17.2.7-113-gece0d607 a5c6421f1c5f 40d5cebbdb93 2023-12-06T14:58:39.249 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi190 smithi190 running (3m) 26s ago 3m 7461k - 17.2.7-113-gece0d607 a5c6421f1c5f 3a387cddf7e6 2023-12-06T14:58:39.249 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (3m) 23s ago 4m 94.5M - 9.4.7 954c08fa6188 22085689650a 2023-12-06T14:58:39.249 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.acqswy smithi152 running (38s) 23s ago 37s 16.1M - 17.2.7-113-gece0d607 a5c6421f1c5f ff9375cec192 2023-12-06T14:58:39.249 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.ypivwc smithi152 running (34s) 23s ago 34s 14.2M - 17.2.7-113-gece0d607 a5c6421f1c5f d809a681491b 2023-12-06T14:58:39.249 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi190.edwtqj smithi190 running (32s) 26s ago 32s 15.9M - 17.2.7-113-gece0d607 a5c6421f1c5f f3b7ebd93b04 2023-12-06T14:58:39.249 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi190.uucxzu smithi190 running (36s) 26s ago 36s 17.3M - 17.2.7-113-gece0d607 a5c6421f1c5f c01be1409c5f 2023-12-06T14:58:39.249 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.meodco smithi152 *:9283 running (5m) 23s ago 5m 495M - 17.2.7-113-gece0d607 a5c6421f1c5f 9d7a3190a8fa 2023-12-06T14:58:39.249 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi190.ubusrr smithi190 *:8443,9283 running (3m) 26s ago 3m 443M - 17.2.7-113-gece0d607 a5c6421f1c5f acaea6cae1cb 2023-12-06T14:58:39.249 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (5m) 23s ago 5m 74.9M 2048M 17.2.7-113-gece0d607 a5c6421f1c5f 2b9f6058715d 2023-12-06T14:58:39.249 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi190 smithi190 running (3m) 26s ago 3m 59.1M 2048M 17.2.7-113-gece0d607 a5c6421f1c5f 3a81d140940b 2023-12-06T14:58:39.249 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 running (4m) 23s ago 4m 14.4M - 1.5.0 0da6a335fe13 870624b5876a 2023-12-06T14:58:39.249 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi190 smithi190 *:9100 running (3m) 26s ago 3m 18.3M - 1.5.0 0da6a335fe13 39b96c91b1ce 2023-12-06T14:58:39.250 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (3m) 23s ago 3m 55.1M 4299M 17.2.7-113-gece0d607 a5c6421f1c5f 499f740f966e 2023-12-06T14:58:39.250 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (2m) 23s ago 2m 59.5M 4299M 17.2.7-113-gece0d607 a5c6421f1c5f 3942f134581a 2023-12-06T14:58:39.250 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (2m) 23s ago 2m 56.8M 4299M 17.2.7-113-gece0d607 a5c6421f1c5f 80bcc4927bb2 2023-12-06T14:58:39.250 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi190 running (2m) 26s ago 2m 54.5M 5323M 17.2.7-113-gece0d607 a5c6421f1c5f f0281d01fec4 2023-12-06T14:58:39.250 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi190 running (115s) 26s ago 114s 49.1M 5323M 17.2.7-113-gece0d607 a5c6421f1c5f a415b29ad9c7 2023-12-06T14:58:39.250 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi190 running (96s) 26s ago 96s 50.9M 5323M 17.2.7-113-gece0d607 a5c6421f1c5f b0f2767055a5 2023-12-06T14:58:39.250 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi152 smithi152 *:9095 running (3m) 23s ago 4m 46.5M - 2.43.0 a07b618ecd1d fabe795a329c 2023-12-06T14:58:39.251 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.250+0000 7f1e287ea700 1 -- 172.21.15.152:0/2790756147 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f1e0c068f60 msgr2=0x7f1e0c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:39.251 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.251+0000 7f1e287ea700 1 --2- 172.21.15.152:0/2790756147 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f1e0c068f60 0x7f1e0c06b410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c004890 tx=0x7f1e1c009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:39.251 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.251+0000 7f1e287ea700 1 -- 172.21.15.152:0/2790756147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1e200fde00 msgr2=0x7f1e2010daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:39.251 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.251+0000 7f1e287ea700 1 --2- 172.21.15.152:0/2790756147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1e200fde00 0x7f1e2010daa0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1e10002a50 tx=0x7f1e100046b0 comp rx=0 tx=0).stop 2023-12-06T14:58:39.251 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.251+0000 7f1e287ea700 1 -- 172.21.15.152:0/2790756147 shutdown_connections 2023-12-06T14:58:39.251 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.251+0000 7f1e287ea700 1 --2- 172.21.15.152:0/2790756147 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f1e0c068f60 0x7f1e0c06b410 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:39.251 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.251+0000 7f1e287ea700 1 --2- 172.21.15.152:0/2790756147 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1e200fcbf0 0x7f1e2010d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:39.251 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.251+0000 7f1e287ea700 1 --2- 172.21.15.152:0/2790756147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1e200fde00 0x7f1e2010daa0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:39.251 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.251+0000 7f1e287ea700 1 -- 172.21.15.152:0/2790756147 >> 172.21.15.152:0/2790756147 conn(0x7f1e200f82d0 msgr2=0x7f1e200fa590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:39.251 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.251+0000 7f1e287ea700 1 -- 172.21.15.152:0/2790756147 shutdown_connections 2023-12-06T14:58:39.251 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.251+0000 7f1e287ea700 1 -- 172.21.15.152:0/2790756147 wait complete. 2023-12-06T14:58:39.356 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.355+0000 7f807b9c3700 1 -- 172.21.15.152:0/790410342 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80740fbaf0 msgr2=0x7f80740fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:39.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.355+0000 7f807b9c3700 1 --2- 172.21.15.152:0/790410342 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80740fbaf0 0x7f80740fbf00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8070004940 tx=0x7f8070009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:39.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.355+0000 7f807b9c3700 1 -- 172.21.15.152:0/790410342 shutdown_connections 2023-12-06T14:58:39.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.355+0000 7f807b9c3700 1 --2- 172.21.15.152:0/790410342 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80740fcd00 0x7f80740fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:39.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.355+0000 7f807b9c3700 1 --2- 172.21.15.152:0/790410342 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80740fbaf0 0x7f80740fbf00 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:39.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.355+0000 7f807b9c3700 1 -- 172.21.15.152:0/790410342 >> 172.21.15.152:0/790410342 conn(0x7f80740f7190 msgr2=0x7f80740f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:39.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.355+0000 7f807b9c3700 1 -- 172.21.15.152:0/790410342 shutdown_connections 2023-12-06T14:58:39.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.355+0000 7f807b9c3700 1 -- 172.21.15.152:0/790410342 wait complete. 2023-12-06T14:58:39.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.356+0000 7f807b9c3700 1 Processor -- start 2023-12-06T14:58:39.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.356+0000 7f807b9c3700 1 -- start start 2023-12-06T14:58:39.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.356+0000 7f807b9c3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80740fbaf0 0x7f807410d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:39.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.356+0000 7f807b9c3700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80740fcd00 0x7f807410dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:39.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.356+0000 7f807b9c3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807410e0d0 con 0x7f80740fbaf0 2023-12-06T14:58:39.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.356+0000 7f807b9c3700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807410e970 con 0x7f80740fcd00 2023-12-06T14:58:39.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.356+0000 7f807975f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80740fbaf0 0x7f807410d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:39.358 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.356+0000 7f807975f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80740fbaf0 0x7f807410d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51184/0 (socket says 172.21.15.152:51184) 2023-12-06T14:58:39.358 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.356+0000 7f807975f700 1 -- 172.21.15.152:0/3695614421 learned_addr learned my addr 172.21.15.152:0/3695614421 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:58:39.358 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.356+0000 7f8078f5e700 1 --2- 172.21.15.152:0/3695614421 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80740fcd00 0x7f807410dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:39.358 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.356+0000 7f807975f700 1 -- 172.21.15.152:0/3695614421 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80740fcd00 msgr2=0x7f807410dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:39.358 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.356+0000 7f807975f700 1 --2- 172.21.15.152:0/3695614421 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80740fcd00 0x7f807410dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:39.358 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.356+0000 7f807975f700 1 -- 172.21.15.152:0/3695614421 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8070005040 con 0x7f80740fbaf0 2023-12-06T14:58:39.358 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.356+0000 7f807975f700 1 --2- 172.21.15.152:0/3695614421 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80740fbaf0 0x7f807410d590 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8070004f90 tx=0x7f8070009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:39.358 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.356+0000 7f8069ffb700 1 -- 172.21.15.152:0/3695614421 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f807000e040 con 0x7f80740fbaf0 2023-12-06T14:58:39.358 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.356+0000 7f8069ffb700 1 -- 172.21.15.152:0/3695614421 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f807000bc50 con 0x7f80740fbaf0 2023-12-06T14:58:39.358 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.356+0000 7f8069ffb700 1 -- 172.21.15.152:0/3695614421 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f807001c630 con 0x7f80740fbaf0 2023-12-06T14:58:39.358 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.357+0000 7f807b9c3700 1 -- 172.21.15.152:0/3695614421 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f807410ebf0 con 0x7f80740fbaf0 2023-12-06T14:58:39.359 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.357+0000 7f807b9c3700 1 -- 172.21.15.152:0/3695614421 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f807410f130 con 0x7f80740fbaf0 2023-12-06T14:58:39.359 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.358+0000 7f807b9c3700 1 -- 172.21.15.152:0/3695614421 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f807404bb80 con 0x7f80740fbaf0 2023-12-06T14:58:39.359 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.358+0000 7f8069ffb700 1 -- 172.21.15.152:0/3695614421 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f8070013420 con 0x7f80740fbaf0 2023-12-06T14:58:39.359 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.359+0000 7f8069ffb700 1 --2- 172.21.15.152:0/3695614421 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f8060068f60 0x7f806006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:39.360 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.359+0000 7f8069ffb700 1 -- 172.21.15.152:0/3695614421 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f8070088070 con 0x7f80740fbaf0 2023-12-06T14:58:39.360 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.359+0000 7f8078f5e700 1 --2- 172.21.15.152:0/3695614421 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f8060068f60 0x7f806006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:39.360 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.359+0000 7f8078f5e700 1 --2- 172.21.15.152:0/3695614421 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f8060068f60 0x7f806006b410 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8064004f40 tx=0x7f806400b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:39.364 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.364+0000 7f8069ffb700 1 -- 172.21.15.152:0/3695614421 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f8070058070 con 0x7f80740fbaf0 2023-12-06T14:58:39.640 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.640+0000 7f807b9c3700 1 -- 172.21.15.152:0/3695614421 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f807410f530 con 0x7f80740fbaf0 2023-12-06T14:58:39.640 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.640+0000 7f8069ffb700 1 -- 172.21.15.152:0/3695614421 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f8070057c00 con 0x7f80740fbaf0 2023-12-06T14:58:39.641 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-12-06T14:58:39.641 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": { 2023-12-06T14:58:39.641 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 2 2023-12-06T14:58:39.641 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T14:58:39.641 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": { 2023-12-06T14:58:39.641 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 2 2023-12-06T14:58:39.641 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T14:58:39.641 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": { 2023-12-06T14:58:39.641 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 6 2023-12-06T14:58:39.641 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T14:58:39.641 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2023-12-06T14:58:39.641 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 4 2023-12-06T14:58:39.642 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T14:58:39.642 INFO:teuthology.orchestra.run.smithi152.stdout: "overall": { 2023-12-06T14:58:39.642 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 14 2023-12-06T14:58:39.642 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-12-06T14:58:39.642 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-12-06T14:58:39.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.642+0000 7f807b9c3700 1 -- 172.21.15.152:0/3695614421 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f8060068f60 msgr2=0x7f806006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:39.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.643+0000 7f807b9c3700 1 --2- 172.21.15.152:0/3695614421 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f8060068f60 0x7f806006b410 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8064004f40 tx=0x7f806400b040 comp rx=0 tx=0).stop 2023-12-06T14:58:39.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.643+0000 7f807b9c3700 1 -- 172.21.15.152:0/3695614421 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80740fbaf0 msgr2=0x7f807410d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:39.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.643+0000 7f807b9c3700 1 --2- 172.21.15.152:0/3695614421 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80740fbaf0 0x7f807410d590 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8070004f90 tx=0x7f8070009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:39.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.643+0000 7f807b9c3700 1 -- 172.21.15.152:0/3695614421 shutdown_connections 2023-12-06T14:58:39.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.643+0000 7f807b9c3700 1 --2- 172.21.15.152:0/3695614421 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80740fbaf0 0x7f807410d590 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:39.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.643+0000 7f807b9c3700 1 --2- 172.21.15.152:0/3695614421 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f8060068f60 0x7f806006b410 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:39.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.643+0000 7f807b9c3700 1 --2- 172.21.15.152:0/3695614421 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80740fcd00 0x7f807410dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:39.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.643+0000 7f807b9c3700 1 -- 172.21.15.152:0/3695614421 >> 172.21.15.152:0/3695614421 conn(0x7f80740f7190 msgr2=0x7f8074065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:39.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.643+0000 7f807b9c3700 1 -- 172.21.15.152:0/3695614421 shutdown_connections 2023-12-06T14:58:39.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.643+0000 7f807b9c3700 1 -- 172.21.15.152:0/3695614421 wait complete. 2023-12-06T14:58:39.755 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.755+0000 7fab96b98700 1 -- 172.21.15.152:0/4121250944 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab90100060 msgr2=0x7fab90102440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:39.755 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.755+0000 7fab96b98700 1 --2- 172.21.15.152:0/4121250944 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab90100060 0x7fab90102440 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fab7c004940 tx=0x7fab7c009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:39.755 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.755+0000 7fab96b98700 1 -- 172.21.15.152:0/4121250944 shutdown_connections 2023-12-06T14:58:39.756 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.755+0000 7fab96b98700 1 --2- 172.21.15.152:0/4121250944 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab90100060 0x7fab90102440 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:39.756 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.755+0000 7fab96b98700 1 --2- 172.21.15.152:0/4121250944 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab900fd740 0x7fab900ffb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:39.756 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.755+0000 7fab96b98700 1 -- 172.21.15.152:0/4121250944 >> 172.21.15.152:0/4121250944 conn(0x7fab900f71c0 msgr2=0x7fab900f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:39.756 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.755+0000 7fab96b98700 1 -- 172.21.15.152:0/4121250944 shutdown_connections 2023-12-06T14:58:39.756 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.755+0000 7fab96b98700 1 -- 172.21.15.152:0/4121250944 wait complete. 2023-12-06T14:58:39.756 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.755+0000 7fab96b98700 1 Processor -- start 2023-12-06T14:58:39.756 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.755+0000 7fab96b98700 1 -- start start 2023-12-06T14:58:39.757 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.756+0000 7fab96b98700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab900fd740 0x7fab9010d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:39.757 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.756+0000 7fab96b98700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab90100060 0x7fab9010da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:39.757 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.756+0000 7fab96b98700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9010e0f0 con 0x7fab900fd740 2023-12-06T14:58:39.757 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.756+0000 7fab96b98700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9010e930 con 0x7fab90100060 2023-12-06T14:58:39.757 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.756+0000 7fab94934700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab900fd740 0x7fab9010d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:39.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.756+0000 7fab94934700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab900fd740 0x7fab9010d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51202/0 (socket says 172.21.15.152:51202) 2023-12-06T14:58:39.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.756+0000 7fab94934700 1 -- 172.21.15.152:0/163308177 learned_addr learned my addr 172.21.15.152:0/163308177 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:58:39.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.756+0000 7fab8ffff700 1 --2- 172.21.15.152:0/163308177 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab90100060 0x7fab9010da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:39.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.756+0000 7fab94934700 1 -- 172.21.15.152:0/163308177 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab90100060 msgr2=0x7fab9010da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:39.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.756+0000 7fab94934700 1 --2- 172.21.15.152:0/163308177 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab90100060 0x7fab9010da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:39.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.756+0000 7fab94934700 1 -- 172.21.15.152:0/163308177 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab7c005040 con 0x7fab900fd740 2023-12-06T14:58:39.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.756+0000 7fab94934700 1 --2- 172.21.15.152:0/163308177 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab900fd740 0x7fab9010d520 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fab8400b790 tx=0x7fab84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:39.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.756+0000 7fab8d7fa700 1 -- 172.21.15.152:0/163308177 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab8400f6f0 con 0x7fab900fd740 2023-12-06T14:58:39.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.757+0000 7fab8d7fa700 1 -- 172.21.15.152:0/163308177 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fab8400fd00 con 0x7fab900fd740 2023-12-06T14:58:39.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.757+0000 7fab96b98700 1 -- 172.21.15.152:0/163308177 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab9010ec10 con 0x7fab900fd740 2023-12-06T14:58:39.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.757+0000 7fab8d7fa700 1 -- 172.21.15.152:0/163308177 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab840103a0 con 0x7fab900fd740 2023-12-06T14:58:39.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.757+0000 7fab96b98700 1 -- 172.21.15.152:0/163308177 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab9010f150 con 0x7fab900fd740 2023-12-06T14:58:39.759 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.758+0000 7fab96b98700 1 -- 172.21.15.152:0/163308177 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab9004bb80 con 0x7fab900fd740 2023-12-06T14:58:39.759 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.758+0000 7fab8d7fa700 1 -- 172.21.15.152:0/163308177 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fab8400f850 con 0x7fab900fd740 2023-12-06T14:58:39.759 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.758+0000 7fab8d7fa700 1 --2- 172.21.15.152:0/163308177 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fab80068f60 0x7fab8006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:39.759 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.759+0000 7fab8d7fa700 1 -- 172.21.15.152:0/163308177 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fab84086ad0 con 0x7fab900fd740 2023-12-06T14:58:39.759 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.759+0000 7fab8ffff700 1 --2- 172.21.15.152:0/163308177 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fab80068f60 0x7fab8006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:39.760 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.759+0000 7fab8ffff700 1 --2- 172.21.15.152:0/163308177 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fab80068f60 0x7fab8006b410 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00b3b0 tx=0x7fab7c009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:39.763 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:39.763+0000 7fab8d7fa700 1 -- 172.21.15.152:0/163308177 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fab84056ad0 con 0x7fab900fd740 2023-12-06T14:58:40.014 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.012+0000 7fab96b98700 1 -- 172.21.15.152:0/163308177 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fab90113b40 con 0x7fab900fd740 2023-12-06T14:58:40.014 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.013+0000 7fab8d7fa700 1 -- 172.21.15.152:0/163308177 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1835 (secure 0 0 0) 0x7fab84056660 con 0x7fab900fd740 2023-12-06T14:58:40.014 INFO:teuthology.orchestra.run.smithi152.stdout:e14 2023-12-06T14:58:40.014 INFO:teuthology.orchestra.run.smithi152.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-06T14:58:40.014 INFO:teuthology.orchestra.run.smithi152.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-06T14:58:40.014 INFO:teuthology.orchestra.run.smithi152.stdout:legacy client fscid: 1 2023-12-06T14:58:40.014 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:58:40.015 INFO:teuthology.orchestra.run.smithi152.stdout:Filesystem 'cephfs' (1) 2023-12-06T14:58:40.015 INFO:teuthology.orchestra.run.smithi152.stdout:fs_name cephfs 2023-12-06T14:58:40.015 INFO:teuthology.orchestra.run.smithi152.stdout:epoch 14 2023-12-06T14:58:40.015 INFO:teuthology.orchestra.run.smithi152.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-06T14:58:40.015 INFO:teuthology.orchestra.run.smithi152.stdout:created 2023-12-06T14:57:59.352201+0000 2023-12-06T14:58:40.015 INFO:teuthology.orchestra.run.smithi152.stdout:modified 2023-12-06T14:58:11.969272+0000 2023-12-06T14:58:40.015 INFO:teuthology.orchestra.run.smithi152.stdout:tableserver 0 2023-12-06T14:58:40.015 INFO:teuthology.orchestra.run.smithi152.stdout:root 0 2023-12-06T14:58:40.015 INFO:teuthology.orchestra.run.smithi152.stdout:session_timeout 60 2023-12-06T14:58:40.015 INFO:teuthology.orchestra.run.smithi152.stdout:session_autoclose 300 2023-12-06T14:58:40.015 INFO:teuthology.orchestra.run.smithi152.stdout:max_file_size 1099511627776 2023-12-06T14:58:40.015 INFO:teuthology.orchestra.run.smithi152.stdout:required_client_features {} 2023-12-06T14:58:40.015 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure 0 2023-12-06T14:58:40.015 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure_osd_epoch 0 2023-12-06T14:58:40.015 INFO:teuthology.orchestra.run.smithi152.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-06T14:58:40.016 INFO:teuthology.orchestra.run.smithi152.stdout:max_mds 2 2023-12-06T14:58:40.016 INFO:teuthology.orchestra.run.smithi152.stdout:in 0,1 2023-12-06T14:58:40.016 INFO:teuthology.orchestra.run.smithi152.stdout:up {0=14464,1=24255} 2023-12-06T14:58:40.016 INFO:teuthology.orchestra.run.smithi152.stdout:failed 2023-12-06T14:58:40.016 INFO:teuthology.orchestra.run.smithi152.stdout:damaged 2023-12-06T14:58:40.016 INFO:teuthology.orchestra.run.smithi152.stdout:stopped 2023-12-06T14:58:40.016 INFO:teuthology.orchestra.run.smithi152.stdout:data_pools [3] 2023-12-06T14:58:40.016 INFO:teuthology.orchestra.run.smithi152.stdout:metadata_pool 2 2023-12-06T14:58:40.016 INFO:teuthology.orchestra.run.smithi152.stdout:inline_data disabled 2023-12-06T14:58:40.016 INFO:teuthology.orchestra.run.smithi152.stdout:balancer 2023-12-06T14:58:40.016 INFO:teuthology.orchestra.run.smithi152.stdout:standby_count_wanted 1 2023-12-06T14:58:40.016 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.acqswy{0:14464} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.152:6826/2467413186,v1:172.21.15.152:6827/2467413186] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T14:58:40.016 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi190.edwtqj{0:24271} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.190:6826/2256465065,v1:172.21.15.190:6827/2256465065] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T14:58:40.016 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi190.uucxzu{1:24255} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.190:6824/3250692478,v1:172.21.15.190:6825/3250692478] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T14:58:40.016 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.ypivwc{1:14480} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.152:6828/697313573,v1:172.21.15.152:6829/697313573] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T14:58:40.017 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:58:40.017 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:58:40.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.015+0000 7fab96b98700 1 -- 172.21.15.152:0/163308177 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fab80068f60 msgr2=0x7fab8006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:40.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.015+0000 7fab96b98700 1 --2- 172.21.15.152:0/163308177 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fab80068f60 0x7fab8006b410 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00b3b0 tx=0x7fab7c009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:40.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.015+0000 7fab96b98700 1 -- 172.21.15.152:0/163308177 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab900fd740 msgr2=0x7fab9010d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:40.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.015+0000 7fab96b98700 1 --2- 172.21.15.152:0/163308177 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab900fd740 0x7fab9010d520 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fab8400b790 tx=0x7fab84009250 comp rx=0 tx=0).stop 2023-12-06T14:58:40.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.015+0000 7fab96b98700 1 -- 172.21.15.152:0/163308177 shutdown_connections 2023-12-06T14:58:40.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.015+0000 7fab96b98700 1 --2- 172.21.15.152:0/163308177 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab900fd740 0x7fab9010d520 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:40.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.015+0000 7fab96b98700 1 --2- 172.21.15.152:0/163308177 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fab80068f60 0x7fab8006b410 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:40.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.015+0000 7fab96b98700 1 --2- 172.21.15.152:0/163308177 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab90100060 0x7fab9010da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:40.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.015+0000 7fab96b98700 1 -- 172.21.15.152:0/163308177 >> 172.21.15.152:0/163308177 conn(0x7fab900f71c0 msgr2=0x7fab900f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:40.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.015+0000 7fab96b98700 1 -- 172.21.15.152:0/163308177 shutdown_connections 2023-12-06T14:58:40.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.015+0000 7fab96b98700 1 -- 172.21.15.152:0/163308177 wait complete. 2023-12-06T14:58:40.018 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 14 2023-12-06T14:58:40.128 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.127+0000 7f3205fbf700 1 -- 172.21.15.152:0/303544278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32000fcd00 msgr2=0x7f32000fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:40.128 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.127+0000 7f3205fbf700 1 --2- 172.21.15.152:0/303544278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32000fcd00 0x7f32000fd150 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f31f4004940 tx=0x7f31f4009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:40.128 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.127+0000 7f3205fbf700 1 -- 172.21.15.152:0/303544278 shutdown_connections 2023-12-06T14:58:40.128 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.127+0000 7f3205fbf700 1 --2- 172.21.15.152:0/303544278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32000fcd00 0x7f32000fd150 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:40.128 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.127+0000 7f3205fbf700 1 --2- 172.21.15.152:0/303544278 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32000fbaf0 0x7f32000fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:40.128 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.127+0000 7f3205fbf700 1 -- 172.21.15.152:0/303544278 >> 172.21.15.152:0/303544278 conn(0x7f32000f71d0 msgr2=0x7f32000f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:40.128 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.127+0000 7f3205fbf700 1 -- 172.21.15.152:0/303544278 shutdown_connections 2023-12-06T14:58:40.128 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.127+0000 7f3205fbf700 1 -- 172.21.15.152:0/303544278 wait complete. 2023-12-06T14:58:40.128 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.128+0000 7f3205fbf700 1 Processor -- start 2023-12-06T14:58:40.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.128+0000 7f3205fbf700 1 -- start start 2023-12-06T14:58:40.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.128+0000 7f3205fbf700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32000fbaf0 0x7f320010c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:40.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.128+0000 7f3205fbf700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32000fcd00 0x7f320010c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:40.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.128+0000 7f3205fbf700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320010cfa0 con 0x7f32000fcd00 2023-12-06T14:58:40.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.128+0000 7f3205fbf700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320010d840 con 0x7f32000fbaf0 2023-12-06T14:58:40.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.128+0000 7f31feffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32000fcd00 0x7f320010c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:40.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.128+0000 7f31feffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32000fcd00 0x7f320010c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51216/0 (socket says 172.21.15.152:51216) 2023-12-06T14:58:40.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.128+0000 7f31feffd700 1 -- 172.21.15.152:0/3151299316 learned_addr learned my addr 172.21.15.152:0/3151299316 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:58:40.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.129+0000 7f31ff7fe700 1 --2- 172.21.15.152:0/3151299316 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32000fbaf0 0x7f320010c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:40.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.129+0000 7f31feffd700 1 -- 172.21.15.152:0/3151299316 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32000fbaf0 msgr2=0x7f320010c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:40.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.129+0000 7f31feffd700 1 --2- 172.21.15.152:0/3151299316 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32000fbaf0 0x7f320010c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:40.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.129+0000 7f31feffd700 1 -- 172.21.15.152:0/3151299316 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f4005040 con 0x7f32000fcd00 2023-12-06T14:58:40.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.129+0000 7f31ff7fe700 1 --2- 172.21.15.152:0/3151299316 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32000fbaf0 0x7f320010c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-06T14:58:40.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.129+0000 7f31feffd700 1 --2- 172.21.15.152:0/3151299316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32000fcd00 0x7f320010c9a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f31f4004f90 tx=0x7f31f4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:40.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.129+0000 7f31e7fff700 1 -- 172.21.15.152:0/3151299316 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31f400e040 con 0x7f32000fcd00 2023-12-06T14:58:40.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.129+0000 7f31e7fff700 1 -- 172.21.15.152:0/3151299316 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f31f401e8d0 con 0x7f32000fcd00 2023-12-06T14:58:40.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.129+0000 7f3205fbf700 1 -- 172.21.15.152:0/3151299316 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f320010dac0 con 0x7f32000fcd00 2023-12-06T14:58:40.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.129+0000 7f31e7fff700 1 -- 172.21.15.152:0/3151299316 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31f4013800 con 0x7f32000fcd00 2023-12-06T14:58:40.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.129+0000 7f3205fbf700 1 -- 172.21.15.152:0/3151299316 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f320010dfa0 con 0x7f32000fcd00 2023-12-06T14:58:40.132 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.130+0000 7f3205fbf700 1 -- 172.21.15.152:0/3151299316 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f320004bb80 con 0x7f32000fcd00 2023-12-06T14:58:40.132 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.131+0000 7f31e7fff700 1 -- 172.21.15.152:0/3151299316 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f31f401ea40 con 0x7f32000fcd00 2023-12-06T14:58:40.132 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.131+0000 7f31e7fff700 1 --2- 172.21.15.152:0/3151299316 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f31e8068f60 0x7f31e806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:40.132 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.131+0000 7f31e7fff700 1 -- 172.21.15.152:0/3151299316 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f31f408aeb0 con 0x7f32000fcd00 2023-12-06T14:58:40.132 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.131+0000 7f31ff7fe700 1 --2- 172.21.15.152:0/3151299316 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f31e8068f60 0x7f31e806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:40.132 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.132+0000 7f31ff7fe700 1 --2- 172.21.15.152:0/3151299316 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f31e8068f60 0x7f31e806b410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f31f0009fd0 tx=0x7f31f0009f00 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:40.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.136+0000 7f31e7fff700 1 -- 172.21.15.152:0/3151299316 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f31f405ae10 con 0x7f32000fcd00 2023-12-06T14:58:40.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:40 smithi190 ceph-mon[121340]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:58:40.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:40 smithi190 ceph-mon[121340]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:58:40.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:40 smithi190 ceph-mon[121340]: pgmap v150: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 853 B/s wr, 5 op/s 2023-12-06T14:58:40.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:40 smithi190 ceph-mon[121340]: from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:58:40.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:40 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/3695614421' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T14:58:40.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:40 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/163308177' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-06T14:58:40.367 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.367+0000 7f3205fbf700 1 -- 172.21.15.152:0/3151299316 --> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f320010e440 con 0x7f31e8068f60 2023-12-06T14:58:40.368 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.368+0000 7f31e7fff700 1 -- 172.21.15.152:0/3151299316 <== mgr.14210 v2:172.21.15.152:6800/3317409709 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f320010e440 con 0x7f31e8068f60 2023-12-06T14:58:40.369 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-12-06T14:58:40.369 INFO:teuthology.orchestra.run.smithi152.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:0482646fcf78576d871bc87843257d82edb79541", 2023-12-06T14:58:40.369 INFO:teuthology.orchestra.run.smithi152.stdout: "in_progress": true, 2023-12-06T14:58:40.369 INFO:teuthology.orchestra.run.smithi152.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-06T14:58:40.369 INFO:teuthology.orchestra.run.smithi152.stdout: "services_complete": [], 2023-12-06T14:58:40.369 INFO:teuthology.orchestra.run.smithi152.stdout: "progress": "", 2023-12-06T14:58:40.369 INFO:teuthology.orchestra.run.smithi152.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:0482646fcf78576d871bc87843257d82edb79541 image", 2023-12-06T14:58:40.369 INFO:teuthology.orchestra.run.smithi152.stdout: "is_paused": false 2023-12-06T14:58:40.369 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-12-06T14:58:40.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.371+0000 7f3205fbf700 1 -- 172.21.15.152:0/3151299316 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f31e8068f60 msgr2=0x7f31e806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:40.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.371+0000 7f3205fbf700 1 --2- 172.21.15.152:0/3151299316 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f31e8068f60 0x7f31e806b410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f31f0009fd0 tx=0x7f31f0009f00 comp rx=0 tx=0).stop 2023-12-06T14:58:40.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.371+0000 7f3205fbf700 1 -- 172.21.15.152:0/3151299316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32000fcd00 msgr2=0x7f320010c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:40.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.371+0000 7f3205fbf700 1 --2- 172.21.15.152:0/3151299316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32000fcd00 0x7f320010c9a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f31f4004f90 tx=0x7f31f4009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:40.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.371+0000 7f3205fbf700 1 -- 172.21.15.152:0/3151299316 shutdown_connections 2023-12-06T14:58:40.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.371+0000 7f3205fbf700 1 --2- 172.21.15.152:0/3151299316 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f31e8068f60 0x7f31e806b410 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:40.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.371+0000 7f3205fbf700 1 --2- 172.21.15.152:0/3151299316 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32000fbaf0 0x7f320010c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:40.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.371+0000 7f3205fbf700 1 --2- 172.21.15.152:0/3151299316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32000fcd00 0x7f320010c9a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:40.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.371+0000 7f3205fbf700 1 -- 172.21.15.152:0/3151299316 >> 172.21.15.152:0/3151299316 conn(0x7f32000f71d0 msgr2=0x7f32000fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:40.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.371+0000 7f3205fbf700 1 -- 172.21.15.152:0/3151299316 shutdown_connections 2023-12-06T14:58:40.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.371+0000 7f3205fbf700 1 -- 172.21.15.152:0/3151299316 wait complete. 2023-12-06T14:58:40.377 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:40 smithi152 ceph-mon[111954]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:58:40.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:40 smithi152 ceph-mon[111954]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:58:40.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:40 smithi152 ceph-mon[111954]: pgmap v150: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 853 B/s wr, 5 op/s 2023-12-06T14:58:40.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:40 smithi152 ceph-mon[111954]: from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:58:40.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:40 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/3695614421' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T14:58:40.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:40 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/163308177' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-06T14:58:40.481 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.480+0000 7f9d474a8700 1 -- 172.21.15.152:0/2723758582 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d400ffcb0 msgr2=0x7f9d401020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:40.481 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.480+0000 7f9d474a8700 1 --2- 172.21.15.152:0/2723758582 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d400ffcb0 0x7f9d401020d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9d30004940 tx=0x7f9d30009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:40.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.480+0000 7f9d474a8700 1 -- 172.21.15.152:0/2723758582 shutdown_connections 2023-12-06T14:58:40.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.480+0000 7f9d474a8700 1 --2- 172.21.15.152:0/2723758582 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d400ffcb0 0x7f9d401020d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:40.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.480+0000 7f9d474a8700 1 --2- 172.21.15.152:0/2723758582 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d40066050 0x7f9d400ff770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:40.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.480+0000 7f9d474a8700 1 -- 172.21.15.152:0/2723758582 >> 172.21.15.152:0/2723758582 conn(0x7f9d400f71e0 msgr2=0x7f9d400f9610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:40.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.480+0000 7f9d474a8700 1 -- 172.21.15.152:0/2723758582 shutdown_connections 2023-12-06T14:58:40.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.480+0000 7f9d474a8700 1 -- 172.21.15.152:0/2723758582 wait complete. 2023-12-06T14:58:40.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.481+0000 7f9d474a8700 1 Processor -- start 2023-12-06T14:58:40.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.481+0000 7f9d474a8700 1 -- start start 2023-12-06T14:58:40.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.481+0000 7f9d474a8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d40066050 0x7f9d4010d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:40.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.481+0000 7f9d474a8700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d400ffcb0 0x7f9d4010d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:40.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.481+0000 7f9d474a8700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4010df90 con 0x7f9d40066050 2023-12-06T14:58:40.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.481+0000 7f9d474a8700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4010e830 con 0x7f9d400ffcb0 2023-12-06T14:58:40.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.481+0000 7f9d45244700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d40066050 0x7f9d4010d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:40.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.481+0000 7f9d45244700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d40066050 0x7f9d4010d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51230/0 (socket says 172.21.15.152:51230) 2023-12-06T14:58:40.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.481+0000 7f9d45244700 1 -- 172.21.15.152:0/1812286532 learned_addr learned my addr 172.21.15.152:0/1812286532 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:58:40.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.481+0000 7f9d44a43700 1 --2- 172.21.15.152:0/1812286532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d400ffcb0 0x7f9d4010d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:40.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.481+0000 7f9d45244700 1 -- 172.21.15.152:0/1812286532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d400ffcb0 msgr2=0x7f9d4010d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:40.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.481+0000 7f9d45244700 1 --2- 172.21.15.152:0/1812286532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d400ffcb0 0x7f9d4010d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:40.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.481+0000 7f9d45244700 1 -- 172.21.15.152:0/1812286532 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d30005040 con 0x7f9d40066050 2023-12-06T14:58:40.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.482+0000 7f9d45244700 1 --2- 172.21.15.152:0/1812286532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d40066050 0x7f9d4010d450 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c00c800 tx=0x7f9d3c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:40.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.482+0000 7f9d35ffb700 1 -- 172.21.15.152:0/1812286532 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d3c0106f0 con 0x7f9d40066050 2023-12-06T14:58:40.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.482+0000 7f9d474a8700 1 -- 172.21.15.152:0/1812286532 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d4010eb10 con 0x7f9d40066050 2023-12-06T14:58:40.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.482+0000 7f9d35ffb700 1 -- 172.21.15.152:0/1812286532 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9d3c010d00 con 0x7f9d40066050 2023-12-06T14:58:40.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.482+0000 7f9d35ffb700 1 -- 172.21.15.152:0/1812286532 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d3c0113a0 con 0x7f9d40066050 2023-12-06T14:58:40.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.482+0000 7f9d474a8700 1 -- 172.21.15.152:0/1812286532 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d4010f050 con 0x7f9d40066050 2023-12-06T14:58:40.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.483+0000 7f9d474a8700 1 -- 172.21.15.152:0/1812286532 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d4004bb80 con 0x7f9d40066050 2023-12-06T14:58:40.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.484+0000 7f9d35ffb700 1 -- 172.21.15.152:0/1812286532 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f9d3c012400 con 0x7f9d40066050 2023-12-06T14:58:40.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.484+0000 7f9d35ffb700 1 --2- 172.21.15.152:0/1812286532 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f9d2c068f60 0x7f9d2c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:58:40.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.484+0000 7f9d35ffb700 1 -- 172.21.15.152:0/1812286532 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f9d3c0878a0 con 0x7f9d40066050 2023-12-06T14:58:40.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.484+0000 7f9d44a43700 1 --2- 172.21.15.152:0/1812286532 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f9d2c068f60 0x7f9d2c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:58:40.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.485+0000 7f9d44a43700 1 --2- 172.21.15.152:0/1812286532 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f9d2c068f60 0x7f9d2c06b410 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9d3000b3b0 tx=0x7f9d30009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:58:40.489 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.490+0000 7f9d35ffb700 1 -- 172.21.15.152:0/1812286532 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f9d3c0578a0 con 0x7f9d40066050 2023-12-06T14:58:40.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.782+0000 7f9d474a8700 1 -- 172.21.15.152:0/1812286532 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9d4010f6b0 con 0x7f9d40066050 2023-12-06T14:58:40.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.783+0000 7f9d35ffb700 1 -- 172.21.15.152:0/1812286532 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f9d3c057430 con 0x7f9d40066050 2023-12-06T14:58:40.783 INFO:teuthology.orchestra.run.smithi152.stdout:HEALTH_OK 2023-12-06T14:58:40.785 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.785+0000 7f9d474a8700 1 -- 172.21.15.152:0/1812286532 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f9d2c068f60 msgr2=0x7f9d2c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:40.785 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.785+0000 7f9d474a8700 1 --2- 172.21.15.152:0/1812286532 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f9d2c068f60 0x7f9d2c06b410 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9d3000b3b0 tx=0x7f9d30009e30 comp rx=0 tx=0).stop 2023-12-06T14:58:40.785 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.785+0000 7f9d474a8700 1 -- 172.21.15.152:0/1812286532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d40066050 msgr2=0x7f9d4010d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:58:40.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.785+0000 7f9d474a8700 1 --2- 172.21.15.152:0/1812286532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d40066050 0x7f9d4010d450 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c00c800 tx=0x7f9d3c004470 comp rx=0 tx=0).stop 2023-12-06T14:58:40.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.785+0000 7f9d474a8700 1 -- 172.21.15.152:0/1812286532 shutdown_connections 2023-12-06T14:58:40.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.785+0000 7f9d474a8700 1 --2- 172.21.15.152:0/1812286532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d40066050 0x7f9d4010d450 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:40.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.785+0000 7f9d474a8700 1 --2- 172.21.15.152:0/1812286532 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f9d2c068f60 0x7f9d2c06b410 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:40.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.785+0000 7f9d474a8700 1 --2- 172.21.15.152:0/1812286532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d400ffcb0 0x7f9d4010d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:58:40.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.785+0000 7f9d474a8700 1 -- 172.21.15.152:0/1812286532 >> 172.21.15.152:0/1812286532 conn(0x7f9d400f71e0 msgr2=0x7f9d400f9610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:58:40.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.785+0000 7f9d474a8700 1 -- 172.21.15.152:0/1812286532 shutdown_connections 2023-12-06T14:58:40.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:58:40.785+0000 7f9d474a8700 1 -- 172.21.15.152:0/1812286532 wait complete. 2023-12-06T14:58:41.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:41 smithi152 ceph-mon[111954]: from='client.14576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:58:41.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:41 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/1812286532' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-06T14:58:41.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:41 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:58:41.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:41 smithi190 ceph-mon[121340]: from='client.14576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:58:41.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:41 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/1812286532' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-06T14:58:41.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:41 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:58:42.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:42 smithi152 ceph-mon[111954]: pgmap v151: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 4 op/s 2023-12-06T14:58:42.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:42 smithi190 ceph-mon[121340]: pgmap v151: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 4 op/s 2023-12-06T14:58:44.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:44 smithi152 ceph-mon[111954]: pgmap v152: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 426 B/s wr, 4 op/s 2023-12-06T14:58:44.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:44 smithi190 ceph-mon[121340]: pgmap v152: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 426 B/s wr, 4 op/s 2023-12-06T14:58:46.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:45 smithi190 ceph-mon[121340]: pgmap v153: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2023-12-06T14:58:46.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:45 smithi152 ceph-mon[111954]: pgmap v153: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2023-12-06T14:58:48.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:48 smithi190 ceph-mon[121340]: pgmap v154: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 4 op/s 2023-12-06T14:58:48.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:48 smithi152 ceph-mon[111954]: pgmap v154: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 4 op/s 2023-12-06T14:58:50.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:50 smithi152 ceph-mon[111954]: pgmap v155: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-06T14:58:50.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:50 smithi190 ceph-mon[121340]: pgmap v155: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-06T14:58:52.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:52 smithi152 ceph-mon[111954]: pgmap v156: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T14:58:52.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:52 smithi190 ceph-mon[121340]: pgmap v156: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T14:58:54.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:54 smithi152 ceph-mon[111954]: pgmap v157: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T14:58:54.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:54 smithi190 ceph-mon[121340]: pgmap v157: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T14:58:56.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:55 smithi190 ceph-mon[121340]: pgmap v158: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T14:58:56.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:55 smithi152 ceph-mon[111954]: pgmap v158: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T14:58:57.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:56 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:58:57.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:56 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:58:58.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:58:57 smithi190 ceph-mon[121340]: pgmap v159: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-06T14:58:58.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:58:57 smithi152 ceph-mon[111954]: pgmap v159: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-06T14:59:00.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:00 smithi152 ceph-mon[111954]: pgmap v160: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-06T14:59:00.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:00 smithi190 ceph-mon[121340]: pgmap v160: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-06T14:59:02.326 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:02 smithi152 ceph-mon[111954]: pgmap v161: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T14:59:02.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:02 smithi190 ceph-mon[121340]: pgmap v161: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T14:59:04.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:03 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:59:04.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:03 smithi190 ceph-mon[121340]: Upgrade: Target is version 19.0.0-26-g0482646f (unknown) 2023-12-06T14:59:04.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:03 smithi190 ceph-mon[121340]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:e331a81036b9c4be9167bdaf54e458c7294ca3446212b9c6126786d23318b1cf, digests ['quay.ceph.io/ceph-ci/ceph@sha256:e331a81036b9c4be9167bdaf54e458c7294ca3446212b9c6126786d23318b1cf'] 2023-12-06T14:59:04.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:03 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:59:04.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:03 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:59:04.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:03 smithi190 ceph-mon[121340]: Upgrade: Need to upgrade myself (mgr.smithi152.meodco) 2023-12-06T14:59:04.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:03 smithi190 ceph-mon[121340]: pgmap v162: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 426 B/s wr, 4 op/s 2023-12-06T14:59:04.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:03 smithi190 ceph-mon[121340]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:e331a81036b9c4be9167bdaf54e458c7294ca3446212b9c6126786d23318b1cf on smithi190 2023-12-06T14:59:04.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:03 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:59:04.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:03 smithi152 ceph-mon[111954]: Upgrade: Target is version 19.0.0-26-g0482646f (unknown) 2023-12-06T14:59:04.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:03 smithi152 ceph-mon[111954]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:e331a81036b9c4be9167bdaf54e458c7294ca3446212b9c6126786d23318b1cf, digests ['quay.ceph.io/ceph-ci/ceph@sha256:e331a81036b9c4be9167bdaf54e458c7294ca3446212b9c6126786d23318b1cf'] 2023-12-06T14:59:04.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:03 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:59:04.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:03 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:59:04.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:03 smithi152 ceph-mon[111954]: Upgrade: Need to upgrade myself (mgr.smithi152.meodco) 2023-12-06T14:59:04.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:03 smithi152 ceph-mon[111954]: pgmap v162: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 426 B/s wr, 4 op/s 2023-12-06T14:59:04.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:03 smithi152 ceph-mon[111954]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:e331a81036b9c4be9167bdaf54e458c7294ca3446212b9c6126786d23318b1cf on smithi190 2023-12-06T14:59:06.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:05 smithi190 ceph-mon[121340]: pgmap v163: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 426 B/s wr, 3 op/s 2023-12-06T14:59:06.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:05 smithi152 ceph-mon[111954]: pgmap v163: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 426 B/s wr, 3 op/s 2023-12-06T14:59:08.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:08 smithi152 ceph-mon[111954]: pgmap v164: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2023-12-06T14:59:08.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:08 smithi190 ceph-mon[121340]: pgmap v164: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2023-12-06T14:59:10.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:10 smithi152 ceph-mon[111954]: pgmap v165: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2023-12-06T14:59:10.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:10 smithi190 ceph-mon[121340]: pgmap v165: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2023-12-06T14:59:10.937 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:10.937+0000 7fc5d183c700 1 -- 172.21.15.152:0/137074573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc5cc0fde00 msgr2=0x7fc5cc0fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:10.938 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:10.937+0000 7fc5d183c700 1 --2- 172.21.15.152:0/137074573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc5cc0fde00 0x7fc5cc0fe250 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0004940 tx=0x7fc5c0009e30 comp rx=0 tx=0).stop 2023-12-06T14:59:10.938 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:10.937+0000 7fc5d183c700 1 -- 172.21.15.152:0/137074573 shutdown_connections 2023-12-06T14:59:10.938 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:10.937+0000 7fc5d183c700 1 --2- 172.21.15.152:0/137074573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc5cc0fde00 0x7fc5cc0fe250 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:10.938 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:10.937+0000 7fc5d183c700 1 --2- 172.21.15.152:0/137074573 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5cc0fcbf0 0x7fc5cc0fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:10.938 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:10.937+0000 7fc5d183c700 1 -- 172.21.15.152:0/137074573 >> 172.21.15.152:0/137074573 conn(0x7fc5cc0f82d0 msgr2=0x7fc5cc0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:59:10.938 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:10.937+0000 7fc5d183c700 1 -- 172.21.15.152:0/137074573 shutdown_connections 2023-12-06T14:59:10.938 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:10.937+0000 7fc5d183c700 1 -- 172.21.15.152:0/137074573 wait complete. 2023-12-06T14:59:10.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:10.938+0000 7fc5d183c700 1 Processor -- start 2023-12-06T14:59:10.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:10.938+0000 7fc5d183c700 1 -- start start 2023-12-06T14:59:10.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:10.938+0000 7fc5d183c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc5cc0fcbf0 0x7fc5cc06ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:10.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:10.938+0000 7fc5d183c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5cc0fde00 0x7fc5cc06f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:10.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:10.938+0000 7fc5d183c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc117060 con 0x7fc5cc0fcbf0 2023-12-06T14:59:10.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:10.938+0000 7fc5d183c700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc1171d0 con 0x7fc5cc0fde00 2023-12-06T14:59:10.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:10.938+0000 7fc5caffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc5cc0fcbf0 0x7fc5cc06ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:10.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:10.938+0000 7fc5caffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc5cc0fcbf0 0x7fc5cc06ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51062/0 (socket says 172.21.15.152:51062) 2023-12-06T14:59:10.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:10.938+0000 7fc5ca7fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5cc0fde00 0x7fc5cc06f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:10.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:10.938+0000 7fc5caffd700 1 -- 172.21.15.152:0/2400717934 learned_addr learned my addr 172.21.15.152:0/2400717934 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:59:10.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:10.939+0000 7fc5caffd700 1 -- 172.21.15.152:0/2400717934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5cc0fde00 msgr2=0x7fc5cc06f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:10.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:10.939+0000 7fc5caffd700 1 --2- 172.21.15.152:0/2400717934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5cc0fde00 0x7fc5cc06f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:10.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:10.939+0000 7fc5caffd700 1 -- 172.21.15.152:0/2400717934 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c0005040 con 0x7fc5cc0fcbf0 2023-12-06T14:59:10.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:10.939+0000 7fc5ca7fc700 1 --2- 172.21.15.152:0/2400717934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5cc0fde00 0x7fc5cc06f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-06T14:59:10.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:10.939+0000 7fc5caffd700 1 --2- 172.21.15.152:0/2400717934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc5cc0fcbf0 0x7fc5cc06ed90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc00eb70 tx=0x7fc5bc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:59:10.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:10.939+0000 7fc5b37fe700 1 -- 172.21.15.152:0/2400717934 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5bc007cc0 con 0x7fc5cc0fcbf0 2023-12-06T14:59:10.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:10.939+0000 7fc5d183c700 1 -- 172.21.15.152:0/2400717934 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5cc117390 con 0x7fc5cc0fcbf0 2023-12-06T14:59:10.941 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:10.939+0000 7fc5d183c700 1 -- 172.21.15.152:0/2400717934 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5cc1178d0 con 0x7fc5cc0fcbf0 2023-12-06T14:59:10.941 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:10.939+0000 7fc5b37fe700 1 -- 172.21.15.152:0/2400717934 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc5bc00f040 con 0x7fc5cc0fcbf0 2023-12-06T14:59:10.941 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:10.939+0000 7fc5b37fe700 1 -- 172.21.15.152:0/2400717934 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5bc00c9d0 con 0x7fc5cc0fcbf0 2023-12-06T14:59:10.941 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:10.941+0000 7fc5d183c700 1 -- 172.21.15.152:0/2400717934 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b80052e0 con 0x7fc5cc0fcbf0 2023-12-06T14:59:10.941 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:10.941+0000 7fc5b37fe700 1 -- 172.21.15.152:0/2400717934 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fc5bc00cb30 con 0x7fc5cc0fcbf0 2023-12-06T14:59:10.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:10.941+0000 7fc5b37fe700 1 --2- 172.21.15.152:0/2400717934 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fc5b406d370 0x7fc5b406f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:10.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:10.941+0000 7fc5b37fe700 1 -- 172.21.15.152:0/2400717934 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fc5bc0867b0 con 0x7fc5cc0fcbf0 2023-12-06T14:59:10.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:10.942+0000 7fc5ca7fc700 1 --2- 172.21.15.152:0/2400717934 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fc5b406d370 0x7fc5b406f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:10.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:10.942+0000 7fc5ca7fc700 1 --2- 172.21.15.152:0/2400717934 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fc5b406d370 0x7fc5b406f820 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0013600 tx=0x7fc5c0009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:59:10.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:10.948+0000 7fc5b37fe700 1 -- 172.21.15.152:0/2400717934 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fc5bc04da00 con 0x7fc5cc0fcbf0 2023-12-06T14:59:11.241 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.241+0000 7fc5d183c700 1 -- 172.21.15.152:0/2400717934 --> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5b8000bf0 con 0x7fc5b406d370 2023-12-06T14:59:11.243 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.243+0000 7fc5b37fe700 1 -- 172.21.15.152:0/2400717934 <== mgr.14210 v2:172.21.15.152:6800/3317409709 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7fc5b8000bf0 con 0x7fc5b406d370 2023-12-06T14:59:11.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.246+0000 7fc5d183c700 1 -- 172.21.15.152:0/2400717934 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fc5b406d370 msgr2=0x7fc5b406f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:11.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.246+0000 7fc5d183c700 1 --2- 172.21.15.152:0/2400717934 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fc5b406d370 0x7fc5b406f820 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0013600 tx=0x7fc5c0009e30 comp rx=0 tx=0).stop 2023-12-06T14:59:11.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.246+0000 7fc5d183c700 1 -- 172.21.15.152:0/2400717934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc5cc0fcbf0 msgr2=0x7fc5cc06ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:11.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.246+0000 7fc5d183c700 1 --2- 172.21.15.152:0/2400717934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc5cc0fcbf0 0x7fc5cc06ed90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc00eb70 tx=0x7fc5bc00b040 comp rx=0 tx=0).stop 2023-12-06T14:59:11.246 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.246+0000 7fc5d183c700 1 -- 172.21.15.152:0/2400717934 shutdown_connections 2023-12-06T14:59:11.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.246+0000 7fc5d183c700 1 --2- 172.21.15.152:0/2400717934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc5cc0fcbf0 0x7fc5cc06ed90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:11.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.246+0000 7fc5d183c700 1 --2- 172.21.15.152:0/2400717934 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fc5b406d370 0x7fc5b406f820 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:11.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.246+0000 7fc5d183c700 1 --2- 172.21.15.152:0/2400717934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5cc0fde00 0x7fc5cc06f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:11.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.246+0000 7fc5d183c700 1 -- 172.21.15.152:0/2400717934 >> 172.21.15.152:0/2400717934 conn(0x7fc5cc0f82d0 msgr2=0x7fc5cc101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:59:11.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.246+0000 7fc5d183c700 1 -- 172.21.15.152:0/2400717934 shutdown_connections 2023-12-06T14:59:11.247 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.246+0000 7fc5d183c700 1 -- 172.21.15.152:0/2400717934 wait complete. 2023-12-06T14:59:11.256 INFO:teuthology.orchestra.run.smithi152.stdout:true 2023-12-06T14:59:11.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.371+0000 7f80d691e700 1 -- 172.21.15.152:0/138399352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80d006e210 msgr2=0x7f80d006e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:11.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.371+0000 7f80d691e700 1 --2- 172.21.15.152:0/138399352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80d006e210 0x7f80d006e620 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f80c0004940 tx=0x7f80c0009e30 comp rx=0 tx=0).stop 2023-12-06T14:59:11.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.371+0000 7f80d691e700 1 -- 172.21.15.152:0/138399352 shutdown_connections 2023-12-06T14:59:11.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.371+0000 7f80d691e700 1 --2- 172.21.15.152:0/138399352 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80d006eb60 0x7f80d010ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:11.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.371+0000 7f80d691e700 1 --2- 172.21.15.152:0/138399352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80d006e210 0x7f80d006e620 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:11.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.371+0000 7f80d691e700 1 -- 172.21.15.152:0/138399352 >> 172.21.15.152:0/138399352 conn(0x7f80d0069b20 msgr2=0x7f80d006bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:59:11.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.371+0000 7f80d691e700 1 -- 172.21.15.152:0/138399352 shutdown_connections 2023-12-06T14:59:11.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.371+0000 7f80d691e700 1 -- 172.21.15.152:0/138399352 wait complete. 2023-12-06T14:59:11.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.372+0000 7f80d691e700 1 Processor -- start 2023-12-06T14:59:11.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.372+0000 7f80d691e700 1 -- start start 2023-12-06T14:59:11.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.372+0000 7f80d691e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80d006e210 0x7f80d0113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:11.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.372+0000 7f80d691e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80d006eb60 0x7f80d01140c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:11.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.372+0000 7f80d691e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d01146c0 con 0x7f80d006eb60 2023-12-06T14:59:11.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.372+0000 7f80d691e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d0114f60 con 0x7f80d006e210 2023-12-06T14:59:11.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.372+0000 7f80cffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80d006e210 0x7f80d0113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:11.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.372+0000 7f80cffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80d006e210 0x7f80d0113b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.152:38318/0 (socket says 172.21.15.152:38318) 2023-12-06T14:59:11.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.372+0000 7f80cffff700 1 -- 172.21.15.152:0/3110271813 learned_addr learned my addr 172.21.15.152:0/3110271813 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:59:11.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.372+0000 7f80cf7fe700 1 --2- 172.21.15.152:0/3110271813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80d006eb60 0x7f80d01140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:11.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.373+0000 7f80cffff700 1 -- 172.21.15.152:0/3110271813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80d006eb60 msgr2=0x7f80d01140c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:11.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.373+0000 7f80cffff700 1 --2- 172.21.15.152:0/3110271813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80d006eb60 0x7f80d01140c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:11.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.373+0000 7f80cffff700 1 -- 172.21.15.152:0/3110271813 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c0005040 con 0x7f80d006e210 2023-12-06T14:59:11.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.373+0000 7f80cffff700 1 --2- 172.21.15.152:0/3110271813 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80d006e210 0x7f80d0113b80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f80c0009fd0 tx=0x7f80c0009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:59:11.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.373+0000 7f80ccff9700 1 -- 172.21.15.152:0/3110271813 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80c001e070 con 0x7f80d006e210 2023-12-06T14:59:11.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.373+0000 7f80d691e700 1 -- 172.21.15.152:0/3110271813 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80d01151e0 con 0x7f80d006e210 2023-12-06T14:59:11.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.373+0000 7f80d691e700 1 -- 172.21.15.152:0/3110271813 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80d01156c0 con 0x7f80d006e210 2023-12-06T14:59:11.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.373+0000 7f80ccff9700 1 -- 172.21.15.152:0/3110271813 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f80c0024470 con 0x7f80d006e210 2023-12-06T14:59:11.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.373+0000 7f80ccff9700 1 -- 172.21.15.152:0/3110271813 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80c0019660 con 0x7f80d006e210 2023-12-06T14:59:11.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.374+0000 7f80d691e700 1 -- 172.21.15.152:0/3110271813 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80bc0052e0 con 0x7f80d006e210 2023-12-06T14:59:11.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.375+0000 7f80ccff9700 1 -- 172.21.15.152:0/3110271813 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f80c0016020 con 0x7f80d006e210 2023-12-06T14:59:11.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.376+0000 7f80ccff9700 1 --2- 172.21.15.152:0/3110271813 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f80b8068f60 0x7f80b806b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:11.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.376+0000 7f80ccff9700 1 -- 172.21.15.152:0/3110271813 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f80c008be80 con 0x7f80d006e210 2023-12-06T14:59:11.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.376+0000 7f80cf7fe700 1 --2- 172.21.15.152:0/3110271813 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f80b8068f60 0x7f80b806b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:11.377 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.377+0000 7f80cf7fe700 1 --2- 172.21.15.152:0/3110271813 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f80b8068f60 0x7f80b806b410 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f80c4009b80 tx=0x7f80c400b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:59:11.377 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:11 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:59:11.386 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.384+0000 7f80ccff9700 1 -- 172.21.15.152:0/3110271813 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f80c005bd60 con 0x7f80d006e210 2023-12-06T14:59:11.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:11 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:59:11.708 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.708+0000 7f80d691e700 1 -- 172.21.15.152:0/3110271813 --> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f80bc000bf0 con 0x7f80b8068f60 2023-12-06T14:59:11.709 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.709+0000 7f80ccff9700 1 -- 172.21.15.152:0/3110271813 <== mgr.14210 v2:172.21.15.152:6800/3317409709 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f80bc000bf0 con 0x7f80b8068f60 2023-12-06T14:59:11.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.712+0000 7f80d691e700 1 -- 172.21.15.152:0/3110271813 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f80b8068f60 msgr2=0x7f80b806b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:11.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.712+0000 7f80d691e700 1 --2- 172.21.15.152:0/3110271813 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f80b8068f60 0x7f80b806b410 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f80c4009b80 tx=0x7f80c400b040 comp rx=0 tx=0).stop 2023-12-06T14:59:11.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.713+0000 7f80d691e700 1 -- 172.21.15.152:0/3110271813 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80d006e210 msgr2=0x7f80d0113b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:11.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.713+0000 7f80d691e700 1 --2- 172.21.15.152:0/3110271813 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80d006e210 0x7f80d0113b80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f80c0009fd0 tx=0x7f80c0009e30 comp rx=0 tx=0).stop 2023-12-06T14:59:11.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.713+0000 7f80d691e700 1 -- 172.21.15.152:0/3110271813 shutdown_connections 2023-12-06T14:59:11.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.713+0000 7f80d691e700 1 --2- 172.21.15.152:0/3110271813 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f80b8068f60 0x7f80b806b410 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:11.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.713+0000 7f80d691e700 1 --2- 172.21.15.152:0/3110271813 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80d006e210 0x7f80d0113b80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:11.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.713+0000 7f80d691e700 1 --2- 172.21.15.152:0/3110271813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80d006eb60 0x7f80d01140c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:11.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.713+0000 7f80d691e700 1 -- 172.21.15.152:0/3110271813 >> 172.21.15.152:0/3110271813 conn(0x7f80d0069b20 msgr2=0x7f80d01096f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:59:11.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.713+0000 7f80d691e700 1 -- 172.21.15.152:0/3110271813 shutdown_connections 2023-12-06T14:59:11.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.713+0000 7f80d691e700 1 -- 172.21.15.152:0/3110271813 wait complete. 2023-12-06T14:59:11.815 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.815+0000 7fb4dcdb6700 1 -- 172.21.15.152:0/1160635761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4d80ffd70 msgr2=0x7fb4d81021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:11.815 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.815+0000 7fb4dcdb6700 1 --2- 172.21.15.152:0/1160635761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4d80ffd70 0x7fb4d81021d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc004940 tx=0x7fb4cc009e30 comp rx=0 tx=0).stop 2023-12-06T14:59:11.815 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.815+0000 7fb4dcdb6700 1 -- 172.21.15.152:0/1160635761 shutdown_connections 2023-12-06T14:59:11.815 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.815+0000 7fb4dcdb6700 1 --2- 172.21.15.152:0/1160635761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4d80ffd70 0x7fb4d81021d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:11.815 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.815+0000 7fb4dcdb6700 1 --2- 172.21.15.152:0/1160635761 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb4d8066090 0x7fb4d80ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:11.815 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.815+0000 7fb4dcdb6700 1 -- 172.21.15.152:0/1160635761 >> 172.21.15.152:0/1160635761 conn(0x7fb4d80f7190 msgr2=0x7fb4d80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:59:11.815 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.815+0000 7fb4dcdb6700 1 -- 172.21.15.152:0/1160635761 shutdown_connections 2023-12-06T14:59:11.816 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.815+0000 7fb4dcdb6700 1 -- 172.21.15.152:0/1160635761 wait complete. 2023-12-06T14:59:11.816 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.816+0000 7fb4dcdb6700 1 Processor -- start 2023-12-06T14:59:11.816 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.816+0000 7fb4dcdb6700 1 -- start start 2023-12-06T14:59:11.816 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.816+0000 7fb4dcdb6700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb4d8066090 0x7fb4d80fd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:11.816 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.816+0000 7fb4dcdb6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4d80ffd70 0x7fb4d80fb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:11.816 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.816+0000 7fb4dcdb6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d80fbca0 con 0x7fb4d80ffd70 2023-12-06T14:59:11.816 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.816+0000 7fb4dcdb6700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d80fbe10 con 0x7fb4d8066090 2023-12-06T14:59:11.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.816+0000 7fb4d659c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb4d8066090 0x7fb4d80fd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:11.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.816+0000 7fb4d659c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb4d8066090 0x7fb4d80fd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.152:38328/0 (socket says 172.21.15.152:38328) 2023-12-06T14:59:11.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.816+0000 7fb4d659c700 1 -- 172.21.15.152:0/828665103 learned_addr learned my addr 172.21.15.152:0/828665103 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:59:11.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.816+0000 7fb4d5d9b700 1 --2- 172.21.15.152:0/828665103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4d80ffd70 0x7fb4d80fb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:11.817 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.816+0000 7fb4d659c700 1 -- 172.21.15.152:0/828665103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4d80ffd70 msgr2=0x7fb4d80fb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:11.818 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.816+0000 7fb4d659c700 1 --2- 172.21.15.152:0/828665103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4d80ffd70 0x7fb4d80fb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:11.818 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.816+0000 7fb4d659c700 1 -- 172.21.15.152:0/828665103 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4cc005040 con 0x7fb4d8066090 2023-12-06T14:59:11.818 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.817+0000 7fb4d659c700 1 --2- 172.21.15.152:0/828665103 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb4d8066090 0x7fb4d80fd220 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb4c800eb70 tx=0x7fb4c800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:59:11.818 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.817+0000 7fb4c6ffd700 1 -- 172.21.15.152:0/828665103 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4c8007cc0 con 0x7fb4d8066090 2023-12-06T14:59:11.818 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.817+0000 7fb4dcdb6700 1 -- 172.21.15.152:0/828665103 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4d80fc090 con 0x7fb4d8066090 2023-12-06T14:59:11.818 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.817+0000 7fb4dcdb6700 1 -- 172.21.15.152:0/828665103 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4d8115530 con 0x7fb4d8066090 2023-12-06T14:59:11.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.818+0000 7fb4c6ffd700 1 -- 172.21.15.152:0/828665103 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb4c800f040 con 0x7fb4d8066090 2023-12-06T14:59:11.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.818+0000 7fb4c6ffd700 1 -- 172.21.15.152:0/828665103 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4c800c9f0 con 0x7fb4d8066090 2023-12-06T14:59:11.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.818+0000 7fb4dcdb6700 1 -- 172.21.15.152:0/828665103 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4b80052e0 con 0x7fb4d8066090 2023-12-06T14:59:11.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.819+0000 7fb4c6ffd700 1 -- 172.21.15.152:0/828665103 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fb4c800cb50 con 0x7fb4d8066090 2023-12-06T14:59:11.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.819+0000 7fb4c6ffd700 1 --2- 172.21.15.152:0/828665103 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fb4c0068f60 0x7fb4c006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:11.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.819+0000 7fb4c6ffd700 1 -- 172.21.15.152:0/828665103 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fb4c80866e0 con 0x7fb4d8066090 2023-12-06T14:59:11.819 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.819+0000 7fb4d5d9b700 1 --2- 172.21.15.152:0/828665103 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fb4c0068f60 0x7fb4c006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:11.820 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.820+0000 7fb4d5d9b700 1 --2- 172.21.15.152:0/828665103 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fb4c0068f60 0x7fb4c006b410 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc013680 tx=0x7fb4cc009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:59:11.826 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:11.826+0000 7fb4c6ffd700 1 -- 172.21.15.152:0/828665103 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fb4c8057550 con 0x7fb4d8066090 2023-12-06T14:59:12.037 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.037+0000 7fb4dcdb6700 1 -- 172.21.15.152:0/828665103 --> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb4b8000bf0 con 0x7fb4c0068f60 2023-12-06T14:59:12.053 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.053+0000 7fb4c6ffd700 1 -- 172.21.15.152:0/828665103 <== mgr.14210 v2:172.21.15.152:6800/3317409709 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7fb4b8000bf0 con 0x7fb4c0068f60 2023-12-06T14:59:12.054 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-06T14:59:12.054 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 running (4m) 56s ago 4m 26.3M - 0.25.0 c8568f914cd2 a93c38b08b75 2023-12-06T14:59:12.054 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (5m) 56s ago 5m 7436k - 17.2.7-113-gece0d607 a5c6421f1c5f 40d5cebbdb93 2023-12-06T14:59:12.054 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi190 smithi190 running (4m) 59s ago 4m 7461k - 17.2.7-113-gece0d607 a5c6421f1c5f 3a387cddf7e6 2023-12-06T14:59:12.054 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (3m) 56s ago 4m 94.5M - 9.4.7 954c08fa6188 22085689650a 2023-12-06T14:59:12.054 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.acqswy smithi152 running (71s) 56s ago 70s 16.1M - 17.2.7-113-gece0d607 a5c6421f1c5f ff9375cec192 2023-12-06T14:59:12.054 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.ypivwc smithi152 running (67s) 56s ago 66s 14.2M - 17.2.7-113-gece0d607 a5c6421f1c5f d809a681491b 2023-12-06T14:59:12.054 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi190.edwtqj smithi190 running (65s) 59s ago 65s 15.9M - 17.2.7-113-gece0d607 a5c6421f1c5f f3b7ebd93b04 2023-12-06T14:59:12.054 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi190.uucxzu smithi190 running (69s) 59s ago 68s 17.3M - 17.2.7-113-gece0d607 a5c6421f1c5f c01be1409c5f 2023-12-06T14:59:12.054 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.meodco smithi152 *:9283 running (6m) 56s ago 6m 495M - 17.2.7-113-gece0d607 a5c6421f1c5f 9d7a3190a8fa 2023-12-06T14:59:12.054 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi190.ubusrr smithi190 *:8443,9283 running (4m) 59s ago 4m 443M - 17.2.7-113-gece0d607 a5c6421f1c5f acaea6cae1cb 2023-12-06T14:59:12.054 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (6m) 56s ago 6m 74.9M 2048M 17.2.7-113-gece0d607 a5c6421f1c5f 2b9f6058715d 2023-12-06T14:59:12.055 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi190 smithi190 running (4m) 59s ago 4m 59.1M 2048M 17.2.7-113-gece0d607 a5c6421f1c5f 3a81d140940b 2023-12-06T14:59:12.055 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 running (5m) 56s ago 5m 14.4M - 1.5.0 0da6a335fe13 870624b5876a 2023-12-06T14:59:12.055 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi190 smithi190 *:9100 running (4m) 59s ago 4m 18.3M - 1.5.0 0da6a335fe13 39b96c91b1ce 2023-12-06T14:59:12.055 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (3m) 56s ago 3m 55.1M 4299M 17.2.7-113-gece0d607 a5c6421f1c5f 499f740f966e 2023-12-06T14:59:12.055 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (3m) 56s ago 3m 59.5M 4299M 17.2.7-113-gece0d607 a5c6421f1c5f 3942f134581a 2023-12-06T14:59:12.055 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (3m) 56s ago 3m 56.8M 4299M 17.2.7-113-gece0d607 a5c6421f1c5f 80bcc4927bb2 2023-12-06T14:59:12.055 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi190 running (2m) 59s ago 2m 54.5M 5323M 17.2.7-113-gece0d607 a5c6421f1c5f f0281d01fec4 2023-12-06T14:59:12.055 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi190 running (2m) 59s ago 2m 49.1M 5323M 17.2.7-113-gece0d607 a5c6421f1c5f a415b29ad9c7 2023-12-06T14:59:12.055 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi190 running (2m) 59s ago 2m 50.9M 5323M 17.2.7-113-gece0d607 a5c6421f1c5f b0f2767055a5 2023-12-06T14:59:12.055 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi152 smithi152 *:9095 running (3m) 56s ago 4m 46.5M - 2.43.0 a07b618ecd1d fabe795a329c 2023-12-06T14:59:12.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.055+0000 7fb4dcdb6700 1 -- 172.21.15.152:0/828665103 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fb4c0068f60 msgr2=0x7fb4c006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:12.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.055+0000 7fb4dcdb6700 1 --2- 172.21.15.152:0/828665103 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fb4c0068f60 0x7fb4c006b410 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc013680 tx=0x7fb4cc009e30 comp rx=0 tx=0).stop 2023-12-06T14:59:12.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.055+0000 7fb4dcdb6700 1 -- 172.21.15.152:0/828665103 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb4d8066090 msgr2=0x7fb4d80fd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:12.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.055+0000 7fb4dcdb6700 1 --2- 172.21.15.152:0/828665103 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb4d8066090 0x7fb4d80fd220 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb4c800eb70 tx=0x7fb4c800b040 comp rx=0 tx=0).stop 2023-12-06T14:59:12.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.056+0000 7fb4dcdb6700 1 -- 172.21.15.152:0/828665103 shutdown_connections 2023-12-06T14:59:12.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.056+0000 7fb4dcdb6700 1 --2- 172.21.15.152:0/828665103 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fb4c0068f60 0x7fb4c006b410 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:12.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.056+0000 7fb4dcdb6700 1 --2- 172.21.15.152:0/828665103 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb4d8066090 0x7fb4d80fd220 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:12.057 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.056+0000 7fb4dcdb6700 1 --2- 172.21.15.152:0/828665103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4d80ffd70 0x7fb4d80fb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:12.057 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.056+0000 7fb4dcdb6700 1 -- 172.21.15.152:0/828665103 >> 172.21.15.152:0/828665103 conn(0x7fb4d80f7190 msgr2=0x7fb4d80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:59:12.057 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.056+0000 7fb4dcdb6700 1 -- 172.21.15.152:0/828665103 shutdown_connections 2023-12-06T14:59:12.057 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.056+0000 7fb4dcdb6700 1 -- 172.21.15.152:0/828665103 wait complete. 2023-12-06T14:59:12.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.161+0000 7f5bee8c8700 1 -- 172.21.15.152:0/3274045061 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5be80fcb80 msgr2=0x7f5be80fcf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:12.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.161+0000 7f5bee8c8700 1 --2- 172.21.15.152:0/3274045061 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5be80fcb80 0x7f5be80fcf90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8004940 tx=0x7f5bd8009e30 comp rx=0 tx=0).stop 2023-12-06T14:59:12.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.162+0000 7f5bee8c8700 1 -- 172.21.15.152:0/3274045061 shutdown_connections 2023-12-06T14:59:12.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.162+0000 7f5bee8c8700 1 --2- 172.21.15.152:0/3274045061 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5be80fdd90 0x7f5be80fe1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:12.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.162+0000 7f5bee8c8700 1 --2- 172.21.15.152:0/3274045061 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5be80fcb80 0x7f5be80fcf90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:12.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.162+0000 7f5bee8c8700 1 -- 172.21.15.152:0/3274045061 >> 172.21.15.152:0/3274045061 conn(0x7f5be80f8260 msgr2=0x7f5be80fa670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:59:12.162 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.162+0000 7f5bee8c8700 1 -- 172.21.15.152:0/3274045061 shutdown_connections 2023-12-06T14:59:12.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.162+0000 7f5bee8c8700 1 -- 172.21.15.152:0/3274045061 wait complete. 2023-12-06T14:59:12.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.162+0000 7f5bee8c8700 1 Processor -- start 2023-12-06T14:59:12.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.162+0000 7f5bee8c8700 1 -- start start 2023-12-06T14:59:12.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.163+0000 7f5bee8c8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5be80fcb80 0x7f5be8071510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:12.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.163+0000 7f5bee8c8700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5be80fdd90 0x7f5be8071a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:12.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.163+0000 7f5bee8c8700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be811aea0 con 0x7f5be80fcb80 2023-12-06T14:59:12.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.163+0000 7f5bee8c8700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be811afe0 con 0x7f5be80fdd90 2023-12-06T14:59:12.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.163+0000 7f5be7fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5be80fcb80 0x7f5be8071510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:12.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.163+0000 7f5be7fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5be80fcb80 0x7f5be8071510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51122/0 (socket says 172.21.15.152:51122) 2023-12-06T14:59:12.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.163+0000 7f5be7fff700 1 -- 172.21.15.152:0/4120420284 learned_addr learned my addr 172.21.15.152:0/4120420284 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:59:12.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.163+0000 7f5be77fe700 1 --2- 172.21.15.152:0/4120420284 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5be80fdd90 0x7f5be8071a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:12.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.163+0000 7f5be7fff700 1 -- 172.21.15.152:0/4120420284 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5be80fdd90 msgr2=0x7f5be8071a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:12.164 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.163+0000 7f5be7fff700 1 --2- 172.21.15.152:0/4120420284 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5be80fdd90 0x7f5be8071a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:12.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.163+0000 7f5be7fff700 1 -- 172.21.15.152:0/4120420284 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd8005040 con 0x7f5be80fcb80 2023-12-06T14:59:12.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.163+0000 7f5be7fff700 1 --2- 172.21.15.152:0/4120420284 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5be80fcb80 0x7f5be8071510 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8000c00 tx=0x7f5bd8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:59:12.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.163+0000 7f5be4ff9700 1 -- 172.21.15.152:0/4120420284 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bd8021070 con 0x7f5be80fcb80 2023-12-06T14:59:12.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.164+0000 7f5be4ff9700 1 -- 172.21.15.152:0/4120420284 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5bd801c400 con 0x7f5be80fcb80 2023-12-06T14:59:12.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.164+0000 7f5bee8c8700 1 -- 172.21.15.152:0/4120420284 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be806e980 con 0x7f5be80fcb80 2023-12-06T14:59:12.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.164+0000 7f5be4ff9700 1 -- 172.21.15.152:0/4120420284 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bd800e070 con 0x7f5be80fcb80 2023-12-06T14:59:12.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.164+0000 7f5bee8c8700 1 -- 172.21.15.152:0/4120420284 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be806ef40 con 0x7f5be80fcb80 2023-12-06T14:59:12.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.165+0000 7f5bee8c8700 1 -- 172.21.15.152:0/4120420284 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be804bb80 con 0x7f5be80fcb80 2023-12-06T14:59:12.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.165+0000 7f5be4ff9700 1 -- 172.21.15.152:0/4120420284 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f5bd800b760 con 0x7f5be80fcb80 2023-12-06T14:59:12.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.166+0000 7f5be4ff9700 1 --2- 172.21.15.152:0/4120420284 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f5bd0068f60 0x7f5bd006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:12.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.166+0000 7f5be4ff9700 1 -- 172.21.15.152:0/4120420284 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f5bd8087f90 con 0x7f5be80fcb80 2023-12-06T14:59:12.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.174+0000 7f5be77fe700 1 --2- 172.21.15.152:0/4120420284 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f5bd0068f60 0x7f5bd006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:12.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.174+0000 7f5be4ff9700 1 -- 172.21.15.152:0/4120420284 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f5bd8054460 con 0x7f5be80fcb80 2023-12-06T14:59:12.175 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.175+0000 7f5be77fe700 1 --2- 172.21.15.152:0/4120420284 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f5bd0068f60 0x7f5bd006b410 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc009b80 tx=0x7f5bdc00b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:59:12.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:12 smithi152 ceph-mon[111954]: pgmap v166: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 4 op/s 2023-12-06T14:59:12.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:12 smithi152 ceph-mon[111954]: from='client.14584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:59:12.456 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.456+0000 7f5bee8c8700 1 -- 172.21.15.152:0/4120420284 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5be8105540 con 0x7f5be80fcb80 2023-12-06T14:59:12.456 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.456+0000 7f5be4ff9700 1 -- 172.21.15.152:0/4120420284 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f5bd8057a80 con 0x7f5be80fcb80 2023-12-06T14:59:12.456 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-12-06T14:59:12.457 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": { 2023-12-06T14:59:12.457 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 2 2023-12-06T14:59:12.457 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T14:59:12.457 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": { 2023-12-06T14:59:12.457 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 2 2023-12-06T14:59:12.457 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T14:59:12.457 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": { 2023-12-06T14:59:12.457 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 6 2023-12-06T14:59:12.457 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T14:59:12.457 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2023-12-06T14:59:12.457 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 4 2023-12-06T14:59:12.457 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T14:59:12.457 INFO:teuthology.orchestra.run.smithi152.stdout: "overall": { 2023-12-06T14:59:12.458 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 14 2023-12-06T14:59:12.458 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-12-06T14:59:12.458 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-12-06T14:59:12.459 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.458+0000 7f5bee8c8700 1 -- 172.21.15.152:0/4120420284 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f5bd0068f60 msgr2=0x7f5bd006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:12.459 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.458+0000 7f5bee8c8700 1 --2- 172.21.15.152:0/4120420284 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f5bd0068f60 0x7f5bd006b410 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc009b80 tx=0x7f5bdc00b040 comp rx=0 tx=0).stop 2023-12-06T14:59:12.459 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.458+0000 7f5bee8c8700 1 -- 172.21.15.152:0/4120420284 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5be80fcb80 msgr2=0x7f5be8071510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:12.459 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.458+0000 7f5bee8c8700 1 --2- 172.21.15.152:0/4120420284 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5be80fcb80 0x7f5be8071510 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8000c00 tx=0x7f5bd8009e30 comp rx=0 tx=0).stop 2023-12-06T14:59:12.459 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.459+0000 7f5bee8c8700 1 -- 172.21.15.152:0/4120420284 shutdown_connections 2023-12-06T14:59:12.459 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.459+0000 7f5bee8c8700 1 --2- 172.21.15.152:0/4120420284 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5be80fcb80 0x7f5be8071510 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:12.459 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.459+0000 7f5bee8c8700 1 --2- 172.21.15.152:0/4120420284 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f5bd0068f60 0x7f5bd006b410 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:12.459 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.459+0000 7f5bee8c8700 1 --2- 172.21.15.152:0/4120420284 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5be80fdd90 0x7f5be8071a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:12.459 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.459+0000 7f5bee8c8700 1 -- 172.21.15.152:0/4120420284 >> 172.21.15.152:0/4120420284 conn(0x7f5be80f8260 msgr2=0x7f5be8100fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:59:12.459 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.459+0000 7f5bee8c8700 1 -- 172.21.15.152:0/4120420284 shutdown_connections 2023-12-06T14:59:12.460 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.459+0000 7f5bee8c8700 1 -- 172.21.15.152:0/4120420284 wait complete. 2023-12-06T14:59:12.567 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.567+0000 7f0062e4e700 1 -- 172.21.15.152:0/3930809720 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f005c0fcd00 msgr2=0x7f005c0fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:12.567 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.567+0000 7f0062e4e700 1 --2- 172.21.15.152:0/3930809720 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f005c0fcd00 0x7f005c0fd150 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0048004940 tx=0x7f0048009e30 comp rx=0 tx=0).stop 2023-12-06T14:59:12.567 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.567+0000 7f0062e4e700 1 -- 172.21.15.152:0/3930809720 shutdown_connections 2023-12-06T14:59:12.567 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.567+0000 7f0062e4e700 1 --2- 172.21.15.152:0/3930809720 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f005c0fcd00 0x7f005c0fd150 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:12.567 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.567+0000 7f0062e4e700 1 --2- 172.21.15.152:0/3930809720 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f005c0fbaf0 0x7f005c0fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:12.567 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.567+0000 7f0062e4e700 1 -- 172.21.15.152:0/3930809720 >> 172.21.15.152:0/3930809720 conn(0x7f005c0f7190 msgr2=0x7f005c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:59:12.567 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.567+0000 7f0062e4e700 1 -- 172.21.15.152:0/3930809720 shutdown_connections 2023-12-06T14:59:12.568 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.567+0000 7f0062e4e700 1 -- 172.21.15.152:0/3930809720 wait complete. 2023-12-06T14:59:12.568 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.567+0000 7f0062e4e700 1 Processor -- start 2023-12-06T14:59:12.568 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.568+0000 7f0062e4e700 1 -- start start 2023-12-06T14:59:12.568 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.568+0000 7f0062e4e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f005c0fbaf0 0x7f005c10d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:12.568 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.568+0000 7f0062e4e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f005c0fcd00 0x7f005c10dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:12.568 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.568+0000 7f0062e4e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005c10e0b0 con 0x7f005c0fcd00 2023-12-06T14:59:12.568 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.568+0000 7f0062e4e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005c10e950 con 0x7f005c0fbaf0 2023-12-06T14:59:12.569 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.568+0000 7f005bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f005c0fcd00 0x7f005c10dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:12.569 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.568+0000 7f0060bea700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f005c0fbaf0 0x7f005c10d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:12.569 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.568+0000 7f0060bea700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f005c0fbaf0 0x7f005c10d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.152:38352/0 (socket says 172.21.15.152:38352) 2023-12-06T14:59:12.569 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.568+0000 7f0060bea700 1 -- 172.21.15.152:0/4129881140 learned_addr learned my addr 172.21.15.152:0/4129881140 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:59:12.569 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.568+0000 7f005bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f005c0fcd00 0x7f005c10dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51134/0 (socket says 172.21.15.152:51134) 2023-12-06T14:59:12.569 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.569+0000 7f005bfff700 1 -- 172.21.15.152:0/4129881140 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f005c0fbaf0 msgr2=0x7f005c10d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:12.570 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.569+0000 7f005bfff700 1 --2- 172.21.15.152:0/4129881140 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f005c0fbaf0 0x7f005c10d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:12.570 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.569+0000 7f005bfff700 1 -- 172.21.15.152:0/4129881140 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0048005040 con 0x7f005c0fcd00 2023-12-06T14:59:12.570 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.569+0000 7f0060bea700 1 --2- 172.21.15.152:0/4129881140 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f005c0fbaf0 0x7f005c10d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-06T14:59:12.570 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.569+0000 7f005bfff700 1 --2- 172.21.15.152:0/4129881140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f005c0fcd00 0x7f005c10dab0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0048009fd0 tx=0x7f0048009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:59:12.570 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.569+0000 7f00597fa700 1 -- 172.21.15.152:0/4129881140 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f004800e040 con 0x7f005c0fcd00 2023-12-06T14:59:12.570 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.569+0000 7f0062e4e700 1 -- 172.21.15.152:0/4129881140 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f005c10eb50 con 0x7f005c0fcd00 2023-12-06T14:59:12.570 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.569+0000 7f0062e4e700 1 -- 172.21.15.152:0/4129881140 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f005c10f090 con 0x7f005c0fcd00 2023-12-06T14:59:12.570 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.569+0000 7f00597fa700 1 -- 172.21.15.152:0/4129881140 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f004800bc50 con 0x7f005c0fcd00 2023-12-06T14:59:12.570 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.569+0000 7f00597fa700 1 -- 172.21.15.152:0/4129881140 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f004801c3f0 con 0x7f005c0fcd00 2023-12-06T14:59:12.570 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.570+0000 7f0062e4e700 1 -- 172.21.15.152:0/4129881140 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00400052e0 con 0x7f005c0fcd00 2023-12-06T14:59:12.571 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.571+0000 7f00597fa700 1 -- 172.21.15.152:0/4129881140 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7f004801c550 con 0x7f005c0fcd00 2023-12-06T14:59:12.571 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.572+0000 7f00597fa700 1 --2- 172.21.15.152:0/4129881140 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f004c068f60 0x7f004c06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:12.572 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.572+0000 7f00597fa700 1 -- 172.21.15.152:0/4129881140 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f0048087f10 con 0x7f005c0fcd00 2023-12-06T14:59:12.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:12 smithi190 ceph-mon[121340]: pgmap v166: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 4 op/s 2023-12-06T14:59:12.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:12 smithi190 ceph-mon[121340]: from='client.14584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:59:12.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.580+0000 7f00597fa700 1 -- 172.21.15.152:0/4129881140 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7f0048057f10 con 0x7f005c0fcd00 2023-12-06T14:59:12.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.580+0000 7f0060bea700 1 --2- 172.21.15.152:0/4129881140 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f004c068f60 0x7f004c06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:12.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.581+0000 7f0060bea700 1 --2- 172.21.15.152:0/4129881140 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f004c068f60 0x7f004c06b410 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f005000f880 tx=0x7f0050011040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:59:12.857 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.857+0000 7f0062e4e700 1 -- 172.21.15.152:0/4129881140 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0040005da0 con 0x7f005c0fcd00 2023-12-06T14:59:12.857 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.857+0000 7f00597fa700 1 -- 172.21.15.152:0/4129881140 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1835 (secure 0 0 0) 0x7f0048057aa0 con 0x7f005c0fcd00 2023-12-06T14:59:12.858 INFO:teuthology.orchestra.run.smithi152.stdout:e14 2023-12-06T14:59:12.858 INFO:teuthology.orchestra.run.smithi152.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-06T14:59:12.858 INFO:teuthology.orchestra.run.smithi152.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-06T14:59:12.858 INFO:teuthology.orchestra.run.smithi152.stdout:legacy client fscid: 1 2023-12-06T14:59:12.858 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:59:12.858 INFO:teuthology.orchestra.run.smithi152.stdout:Filesystem 'cephfs' (1) 2023-12-06T14:59:12.858 INFO:teuthology.orchestra.run.smithi152.stdout:fs_name cephfs 2023-12-06T14:59:12.858 INFO:teuthology.orchestra.run.smithi152.stdout:epoch 14 2023-12-06T14:59:12.858 INFO:teuthology.orchestra.run.smithi152.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-06T14:59:12.858 INFO:teuthology.orchestra.run.smithi152.stdout:created 2023-12-06T14:57:59.352201+0000 2023-12-06T14:59:12.858 INFO:teuthology.orchestra.run.smithi152.stdout:modified 2023-12-06T14:58:11.969272+0000 2023-12-06T14:59:12.858 INFO:teuthology.orchestra.run.smithi152.stdout:tableserver 0 2023-12-06T14:59:12.859 INFO:teuthology.orchestra.run.smithi152.stdout:root 0 2023-12-06T14:59:12.859 INFO:teuthology.orchestra.run.smithi152.stdout:session_timeout 60 2023-12-06T14:59:12.859 INFO:teuthology.orchestra.run.smithi152.stdout:session_autoclose 300 2023-12-06T14:59:12.859 INFO:teuthology.orchestra.run.smithi152.stdout:max_file_size 1099511627776 2023-12-06T14:59:12.859 INFO:teuthology.orchestra.run.smithi152.stdout:required_client_features {} 2023-12-06T14:59:12.859 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure 0 2023-12-06T14:59:12.859 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure_osd_epoch 0 2023-12-06T14:59:12.859 INFO:teuthology.orchestra.run.smithi152.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-06T14:59:12.859 INFO:teuthology.orchestra.run.smithi152.stdout:max_mds 2 2023-12-06T14:59:12.859 INFO:teuthology.orchestra.run.smithi152.stdout:in 0,1 2023-12-06T14:59:12.859 INFO:teuthology.orchestra.run.smithi152.stdout:up {0=14464,1=24255} 2023-12-06T14:59:12.859 INFO:teuthology.orchestra.run.smithi152.stdout:failed 2023-12-06T14:59:12.859 INFO:teuthology.orchestra.run.smithi152.stdout:damaged 2023-12-06T14:59:12.859 INFO:teuthology.orchestra.run.smithi152.stdout:stopped 2023-12-06T14:59:12.859 INFO:teuthology.orchestra.run.smithi152.stdout:data_pools [3] 2023-12-06T14:59:12.860 INFO:teuthology.orchestra.run.smithi152.stdout:metadata_pool 2 2023-12-06T14:59:12.860 INFO:teuthology.orchestra.run.smithi152.stdout:inline_data disabled 2023-12-06T14:59:12.860 INFO:teuthology.orchestra.run.smithi152.stdout:balancer 2023-12-06T14:59:12.860 INFO:teuthology.orchestra.run.smithi152.stdout:standby_count_wanted 1 2023-12-06T14:59:12.860 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.acqswy{0:14464} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.152:6826/2467413186,v1:172.21.15.152:6827/2467413186] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T14:59:12.860 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi190.edwtqj{0:24271} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.190:6826/2256465065,v1:172.21.15.190:6827/2256465065] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T14:59:12.860 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi190.uucxzu{1:24255} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.190:6824/3250692478,v1:172.21.15.190:6825/3250692478] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T14:59:12.860 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.ypivwc{1:14480} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.152:6828/697313573,v1:172.21.15.152:6829/697313573] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T14:59:12.860 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:59:12.860 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:59:12.861 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.859+0000 7f0062e4e700 1 -- 172.21.15.152:0/4129881140 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f004c068f60 msgr2=0x7f004c06b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:12.861 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.860+0000 7f0062e4e700 1 --2- 172.21.15.152:0/4129881140 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f004c068f60 0x7f004c06b410 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f005000f880 tx=0x7f0050011040 comp rx=0 tx=0).stop 2023-12-06T14:59:12.861 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.860+0000 7f0062e4e700 1 -- 172.21.15.152:0/4129881140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f005c0fcd00 msgr2=0x7f005c10dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:12.861 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.860+0000 7f0062e4e700 1 --2- 172.21.15.152:0/4129881140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f005c0fcd00 0x7f005c10dab0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0048009fd0 tx=0x7f0048009e30 comp rx=0 tx=0).stop 2023-12-06T14:59:12.861 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.860+0000 7f0062e4e700 1 -- 172.21.15.152:0/4129881140 shutdown_connections 2023-12-06T14:59:12.861 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.860+0000 7f0062e4e700 1 --2- 172.21.15.152:0/4129881140 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7f004c068f60 0x7f004c06b410 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:12.861 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.860+0000 7f0062e4e700 1 --2- 172.21.15.152:0/4129881140 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f005c0fbaf0 0x7f005c10d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:12.861 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.860+0000 7f0062e4e700 1 --2- 172.21.15.152:0/4129881140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f005c0fcd00 0x7f005c10dab0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:12.861 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.860+0000 7f0062e4e700 1 -- 172.21.15.152:0/4129881140 >> 172.21.15.152:0/4129881140 conn(0x7f005c0f7190 msgr2=0x7f005c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:59:12.861 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.860+0000 7f0062e4e700 1 -- 172.21.15.152:0/4129881140 shutdown_connections 2023-12-06T14:59:12.862 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.860+0000 7f0062e4e700 1 -- 172.21.15.152:0/4129881140 wait complete. 2023-12-06T14:59:12.862 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 14 2023-12-06T14:59:12.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.970+0000 7fbb5bef9700 1 -- 172.21.15.152:0/981186591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb540fcd00 msgr2=0x7fbb540fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:12.970 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.970+0000 7fbb5bef9700 1 --2- 172.21.15.152:0/981186591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb540fcd00 0x7fbb540fd150 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbb44004940 tx=0x7fbb44009e30 comp rx=0 tx=0).stop 2023-12-06T14:59:12.971 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.970+0000 7fbb5bef9700 1 -- 172.21.15.152:0/981186591 shutdown_connections 2023-12-06T14:59:12.971 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.970+0000 7fbb5bef9700 1 --2- 172.21.15.152:0/981186591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb540fcd00 0x7fbb540fd150 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:12.971 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.970+0000 7fbb5bef9700 1 --2- 172.21.15.152:0/981186591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb540fbaf0 0x7fbb540fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:12.971 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.970+0000 7fbb5bef9700 1 -- 172.21.15.152:0/981186591 >> 172.21.15.152:0/981186591 conn(0x7fbb540f7190 msgr2=0x7fbb540f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:59:12.971 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.970+0000 7fbb5bef9700 1 -- 172.21.15.152:0/981186591 shutdown_connections 2023-12-06T14:59:12.971 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.970+0000 7fbb5bef9700 1 -- 172.21.15.152:0/981186591 wait complete. 2023-12-06T14:59:12.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.971+0000 7fbb5bef9700 1 Processor -- start 2023-12-06T14:59:12.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.971+0000 7fbb5bef9700 1 -- start start 2023-12-06T14:59:12.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.971+0000 7fbb5bef9700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb540fbaf0 0x7fbb54116070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:12.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.971+0000 7fbb5bef9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb540fcd00 0x7fbb541165b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:12.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.971+0000 7fbb5bef9700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb54116c00 con 0x7fbb540fcd00 2023-12-06T14:59:12.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.971+0000 7fbb5bef9700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb54117030 con 0x7fbb540fbaf0 2023-12-06T14:59:12.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.971+0000 7fbb59494700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb540fcd00 0x7fbb541165b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:12.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.971+0000 7fbb59494700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb540fcd00 0x7fbb541165b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51162/0 (socket says 172.21.15.152:51162) 2023-12-06T14:59:12.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.971+0000 7fbb59494700 1 -- 172.21.15.152:0/1535001226 learned_addr learned my addr 172.21.15.152:0/1535001226 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:59:12.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.971+0000 7fbb59c95700 1 --2- 172.21.15.152:0/1535001226 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb540fbaf0 0x7fbb54116070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:12.972 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.971+0000 7fbb59494700 1 -- 172.21.15.152:0/1535001226 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb540fbaf0 msgr2=0x7fbb54116070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:12.973 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.971+0000 7fbb59494700 1 --2- 172.21.15.152:0/1535001226 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb540fbaf0 0x7fbb54116070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:12.973 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.971+0000 7fbb59494700 1 -- 172.21.15.152:0/1535001226 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb44005040 con 0x7fbb540fcd00 2023-12-06T14:59:12.973 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.971+0000 7fbb59494700 1 --2- 172.21.15.152:0/1535001226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb540fcd00 0x7fbb541165b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbb44008f90 tx=0x7fbb44009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:59:12.973 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.972+0000 7fbb4a7fc700 1 -- 172.21.15.152:0/1535001226 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb44021070 con 0x7fbb540fcd00 2023-12-06T14:59:12.973 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.972+0000 7fbb4a7fc700 1 -- 172.21.15.152:0/1535001226 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbb4401c400 con 0x7fbb540fcd00 2023-12-06T14:59:12.973 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.972+0000 7fbb5bef9700 1 -- 172.21.15.152:0/1535001226 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb541172b0 con 0x7fbb540fcd00 2023-12-06T14:59:12.973 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.972+0000 7fbb5bef9700 1 -- 172.21.15.152:0/1535001226 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb541177f0 con 0x7fbb540fcd00 2023-12-06T14:59:12.974 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.973+0000 7fbb4a7fc700 1 -- 172.21.15.152:0/1535001226 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb4400e030 con 0x7fbb540fcd00 2023-12-06T14:59:12.974 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.974+0000 7fbb4a7fc700 1 -- 172.21.15.152:0/1535001226 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7fbb4400b760 con 0x7fbb540fcd00 2023-12-06T14:59:12.974 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.974+0000 7fbb5bef9700 1 -- 172.21.15.152:0/1535001226 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb54069dd0 con 0x7fbb540fcd00 2023-12-06T14:59:12.974 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.974+0000 7fbb4a7fc700 1 --2- 172.21.15.152:0/1535001226 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fbb40069040 0x7fbb4006b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:12.975 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.974+0000 7fbb4a7fc700 1 -- 172.21.15.152:0/1535001226 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fbb44089040 con 0x7fbb540fcd00 2023-12-06T14:59:12.975 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.974+0000 7fbb59c95700 1 --2- 172.21.15.152:0/1535001226 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fbb40069040 0x7fbb4006b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:12.975 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.975+0000 7fbb59c95700 1 --2- 172.21.15.152:0/1535001226 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fbb40069040 0x7fbb4006b4f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbb54115e40 tx=0x7fbb5000b040 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:59:12.979 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:12.979+0000 7fbb4a7fc700 1 -- 172.21.15.152:0/1535001226 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7fbb440554f0 con 0x7fbb540fcd00 2023-12-06T14:59:13.190 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.190+0000 7fbb5bef9700 1 -- 172.21.15.152:0/1535001226 --> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb5402b1f0 con 0x7fbb40069040 2023-12-06T14:59:13.191 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.191+0000 7fbb4a7fc700 1 -- 172.21.15.152:0/1535001226 <== mgr.14210 v2:172.21.15.152:6800/3317409709 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7fbb5402b1f0 con 0x7fbb40069040 2023-12-06T14:59:13.192 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-12-06T14:59:13.192 INFO:teuthology.orchestra.run.smithi152.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e331a81036b9c4be9167bdaf54e458c7294ca3446212b9c6126786d23318b1cf", 2023-12-06T14:59:13.192 INFO:teuthology.orchestra.run.smithi152.stdout: "in_progress": true, 2023-12-06T14:59:13.192 INFO:teuthology.orchestra.run.smithi152.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-06T14:59:13.192 INFO:teuthology.orchestra.run.smithi152.stdout: "services_complete": [], 2023-12-06T14:59:13.192 INFO:teuthology.orchestra.run.smithi152.stdout: "progress": "0/21 daemons upgraded", 2023-12-06T14:59:13.192 INFO:teuthology.orchestra.run.smithi152.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:e331a81036b9c4be9167bdaf54e458c7294ca3446212b9c6126786d23318b1cf image on host smithi190", 2023-12-06T14:59:13.192 INFO:teuthology.orchestra.run.smithi152.stdout: "is_paused": false 2023-12-06T14:59:13.192 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-12-06T14:59:13.194 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.193+0000 7fbb5bef9700 1 -- 172.21.15.152:0/1535001226 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fbb40069040 msgr2=0x7fbb4006b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:13.194 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.193+0000 7fbb5bef9700 1 --2- 172.21.15.152:0/1535001226 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fbb40069040 0x7fbb4006b4f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbb54115e40 tx=0x7fbb5000b040 comp rx=0 tx=0).stop 2023-12-06T14:59:13.194 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.193+0000 7fbb5bef9700 1 -- 172.21.15.152:0/1535001226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb540fcd00 msgr2=0x7fbb541165b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:13.194 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.193+0000 7fbb5bef9700 1 --2- 172.21.15.152:0/1535001226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb540fcd00 0x7fbb541165b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbb44008f90 tx=0x7fbb44009e30 comp rx=0 tx=0).stop 2023-12-06T14:59:13.194 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.194+0000 7fbb5bef9700 1 -- 172.21.15.152:0/1535001226 shutdown_connections 2023-12-06T14:59:13.194 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.194+0000 7fbb5bef9700 1 --2- 172.21.15.152:0/1535001226 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7fbb40069040 0x7fbb4006b4f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:13.194 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.194+0000 7fbb5bef9700 1 --2- 172.21.15.152:0/1535001226 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb540fbaf0 0x7fbb54116070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:13.194 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.194+0000 7fbb5bef9700 1 --2- 172.21.15.152:0/1535001226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbb540fcd00 0x7fbb541165b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:13.194 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.194+0000 7fbb5bef9700 1 -- 172.21.15.152:0/1535001226 >> 172.21.15.152:0/1535001226 conn(0x7fbb540f7190 msgr2=0x7fbb540f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:59:13.194 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.194+0000 7fbb5bef9700 1 -- 172.21.15.152:0/1535001226 shutdown_connections 2023-12-06T14:59:13.194 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.194+0000 7fbb5bef9700 1 -- 172.21.15.152:0/1535001226 wait complete. 2023-12-06T14:59:13.344 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.344+0000 7ff40d585700 1 -- 172.21.15.152:0/3113593784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4080fbaf0 msgr2=0x7ff4080fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:13.345 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.344+0000 7ff40d585700 1 --2- 172.21.15.152:0/3113593784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4080fbaf0 0x7ff4080fbf00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8004940 tx=0x7ff3f8009e30 comp rx=0 tx=0).stop 2023-12-06T14:59:13.345 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.344+0000 7ff40d585700 1 -- 172.21.15.152:0/3113593784 shutdown_connections 2023-12-06T14:59:13.345 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.344+0000 7ff40d585700 1 --2- 172.21.15.152:0/3113593784 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4080fcd00 0x7ff4080fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:13.345 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.344+0000 7ff40d585700 1 --2- 172.21.15.152:0/3113593784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4080fbaf0 0x7ff4080fbf00 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:13.345 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.344+0000 7ff40d585700 1 -- 172.21.15.152:0/3113593784 >> 172.21.15.152:0/3113593784 conn(0x7ff4080f7190 msgr2=0x7ff4080f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:59:13.345 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.344+0000 7ff40d585700 1 -- 172.21.15.152:0/3113593784 shutdown_connections 2023-12-06T14:59:13.345 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.344+0000 7ff40d585700 1 -- 172.21.15.152:0/3113593784 wait complete. 2023-12-06T14:59:13.347 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.345+0000 7ff40d585700 1 Processor -- start 2023-12-06T14:59:13.347 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.345+0000 7ff40d585700 1 -- start start 2023-12-06T14:59:13.347 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.345+0000 7ff40d585700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4080fbaf0 0x7ff40810d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:13.347 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.345+0000 7ff40d585700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4080fcd00 0x7ff40810da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:13.347 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.345+0000 7ff40d585700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40810e090 con 0x7ff4080fbaf0 2023-12-06T14:59:13.347 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.345+0000 7ff40d585700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40810e930 con 0x7ff4080fcd00 2023-12-06T14:59:13.347 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.346+0000 7ff4067fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4080fcd00 0x7ff40810da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:13.347 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.346+0000 7ff4067fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4080fcd00 0x7ff40810da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.152:38380/0 (socket says 172.21.15.152:38380) 2023-12-06T14:59:13.347 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.346+0000 7ff4067fc700 1 -- 172.21.15.152:0/3839098338 learned_addr learned my addr 172.21.15.152:0/3839098338 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:59:13.347 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.346+0000 7ff406ffd700 1 --2- 172.21.15.152:0/3839098338 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4080fbaf0 0x7ff40810d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:13.347 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.346+0000 7ff4067fc700 1 -- 172.21.15.152:0/3839098338 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4080fbaf0 msgr2=0x7ff40810d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:13.347 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.346+0000 7ff4067fc700 1 --2- 172.21.15.152:0/3839098338 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4080fbaf0 0x7ff40810d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:13.348 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.346+0000 7ff4067fc700 1 -- 172.21.15.152:0/3839098338 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f8005040 con 0x7ff4080fcd00 2023-12-06T14:59:13.348 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.346+0000 7ff4067fc700 1 --2- 172.21.15.152:0/3839098338 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4080fcd00 0x7ff40810da90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc00eb40 tx=0x7ff3fc00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:59:13.348 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.346+0000 7ff3ef7fe700 1 -- 172.21.15.152:0/3839098338 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3fc007cc0 con 0x7ff4080fcd00 2023-12-06T14:59:13.348 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.346+0000 7ff40d585700 1 -- 172.21.15.152:0/3839098338 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff40810ebb0 con 0x7ff4080fcd00 2023-12-06T14:59:13.349 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.346+0000 7ff40d585700 1 -- 172.21.15.152:0/3839098338 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff40810f0f0 con 0x7ff4080fcd00 2023-12-06T14:59:13.349 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.346+0000 7ff3ef7fe700 1 -- 172.21.15.152:0/3839098338 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff3fc00f040 con 0x7ff4080fcd00 2023-12-06T14:59:13.349 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.346+0000 7ff3ef7fe700 1 -- 172.21.15.152:0/3839098338 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3fc00c990 con 0x7ff4080fcd00 2023-12-06T14:59:13.349 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.348+0000 7ff3ef7fe700 1 -- 172.21.15.152:0/3839098338 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 19) v1 ==== 86449+0+0 (secure 0 0 0) 0x7ff3fc00caf0 con 0x7ff4080fcd00 2023-12-06T14:59:13.349 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.348+0000 7ff40d585700 1 -- 172.21.15.152:0/3839098338 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3f40052e0 con 0x7ff4080fcd00 2023-12-06T14:59:13.349 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.348+0000 7ff3ef7fe700 1 --2- 172.21.15.152:0/3839098338 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7ff3f0068f60 0x7ff3f006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:13.349 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.349+0000 7ff3ef7fe700 1 -- 172.21.15.152:0/3839098338 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7ff3fc0868a0 con 0x7ff4080fcd00 2023-12-06T14:59:13.349 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.349+0000 7ff406ffd700 1 --2- 172.21.15.152:0/3839098338 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7ff3f0068f60 0x7ff3f006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:13.350 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.349+0000 7ff406ffd700 1 --2- 172.21.15.152:0/3839098338 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7ff3f0068f60 0x7ff3f006b410 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff3f80045a0 tx=0x7ff3f8009e30 comp rx=0 tx=0).ready entity=mgr.14210 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:59:13.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.357+0000 7ff3ef7fe700 1 -- 172.21.15.152:0/3839098338 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174570 (secure 0 0 0) 0x7ff3fc04da00 con 0x7ff4080fcd00 2023-12-06T14:59:13.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:13 smithi152 ceph-mon[111954]: from='client.24341 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:59:13.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:13 smithi152 ceph-mon[111954]: from='client.24345 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:59:13.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:13 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/4120420284' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T14:59:13.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:13 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/4129881140' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-06T14:59:13.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:13 smithi190 ceph-mon[121340]: from='client.24341 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:59:13.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:13 smithi190 ceph-mon[121340]: from='client.24345 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:59:13.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:13 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/4120420284' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T14:59:13.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:13 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/4129881140' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-06T14:59:13.630 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.629+0000 7ff40d585700 1 -- 172.21.15.152:0/3839098338 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff3f4005590 con 0x7ff4080fcd00 2023-12-06T14:59:13.630 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.630+0000 7ff3ef7fe700 1 -- 172.21.15.152:0/3839098338 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7ff3fc056850 con 0x7ff4080fcd00 2023-12-06T14:59:13.630 INFO:teuthology.orchestra.run.smithi152.stdout:HEALTH_OK 2023-12-06T14:59:13.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.632+0000 7ff40d585700 1 -- 172.21.15.152:0/3839098338 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7ff3f0068f60 msgr2=0x7ff3f006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:13.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.632+0000 7ff40d585700 1 --2- 172.21.15.152:0/3839098338 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7ff3f0068f60 0x7ff3f006b410 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff3f80045a0 tx=0x7ff3f8009e30 comp rx=0 tx=0).stop 2023-12-06T14:59:13.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.632+0000 7ff40d585700 1 -- 172.21.15.152:0/3839098338 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4080fcd00 msgr2=0x7ff40810da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:13.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.632+0000 7ff40d585700 1 --2- 172.21.15.152:0/3839098338 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4080fcd00 0x7ff40810da90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc00eb40 tx=0x7ff3fc00b040 comp rx=0 tx=0).stop 2023-12-06T14:59:13.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.632+0000 7ff40d585700 1 -- 172.21.15.152:0/3839098338 shutdown_connections 2023-12-06T14:59:13.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.632+0000 7ff40d585700 1 --2- 172.21.15.152:0/3839098338 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff4080fbaf0 0x7ff40810d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:13.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.632+0000 7ff40d585700 1 --2- 172.21.15.152:0/3839098338 >> [v2:172.21.15.152:6800/3317409709,v1:172.21.15.152:6801/3317409709] conn(0x7ff3f0068f60 0x7ff3f006b410 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:13.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.632+0000 7ff40d585700 1 --2- 172.21.15.152:0/3839098338 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4080fcd00 0x7ff40810da90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:13.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.632+0000 7ff40d585700 1 -- 172.21.15.152:0/3839098338 >> 172.21.15.152:0/3839098338 conn(0x7ff4080f7190 msgr2=0x7ff4080fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:59:13.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.632+0000 7ff40d585700 1 -- 172.21.15.152:0/3839098338 shutdown_connections 2023-12-06T14:59:13.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:13.632+0000 7ff40d585700 1 -- 172.21.15.152:0/3839098338 wait complete. 2023-12-06T14:59:14.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:14 smithi152 ceph-mon[111954]: pgmap v167: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2023-12-06T14:59:14.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:14 smithi152 ceph-mon[111954]: from='client.14604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:59:14.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:14 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/3839098338' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-06T14:59:14.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:14 smithi190 ceph-mon[121340]: pgmap v167: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2023-12-06T14:59:14.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:14 smithi190 ceph-mon[121340]: from='client.14604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:59:14.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:14 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/3839098338' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-06T14:59:16.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:15 smithi190 ceph-mon[121340]: pgmap v168: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2023-12-06T14:59:16.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:15 smithi152 ceph-mon[111954]: pgmap v168: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2023-12-06T14:59:18.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:18 smithi152 ceph-mon[111954]: pgmap v169: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 170 B/s wr, 4 op/s 2023-12-06T14:59:18.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:18 smithi190 ceph-mon[121340]: pgmap v169: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 170 B/s wr, 4 op/s 2023-12-06T14:59:20.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:20 smithi152 ceph-mon[111954]: pgmap v170: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 4 op/s 2023-12-06T14:59:20.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:20 smithi190 ceph-mon[121340]: pgmap v170: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 4 op/s 2023-12-06T14:59:22.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:22 smithi152 ceph-mon[111954]: pgmap v171: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 4 op/s 2023-12-06T14:59:22.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:22 smithi190 ceph-mon[121340]: pgmap v171: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 4 op/s 2023-12-06T14:59:24.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:24 smithi152 ceph-mon[111954]: pgmap v172: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 85 B/s wr, 4 op/s 2023-12-06T14:59:24.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:24 smithi190 ceph-mon[121340]: pgmap v172: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 85 B/s wr, 4 op/s 2023-12-06T14:59:26.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:25 smithi190 ceph-mon[121340]: pgmap v173: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2023-12-06T14:59:26.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:25 smithi152 ceph-mon[111954]: pgmap v173: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2023-12-06T14:59:27.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:26 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:59:27.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:26 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:59:28.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:27 smithi190 ceph-mon[121340]: pgmap v174: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 4 op/s 2023-12-06T14:59:28.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:27 smithi152 ceph-mon[111954]: pgmap v174: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 4 op/s 2023-12-06T14:59:30.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:30 smithi152 ceph-mon[111954]: pgmap v175: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-06T14:59:30.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:30 smithi190 ceph-mon[121340]: pgmap v175: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-06T14:59:32.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:32 smithi152 ceph-mon[111954]: pgmap v176: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T14:59:32.536 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:32 smithi190 ceph-mon[121340]: pgmap v176: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T14:59:33.121 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:33 smithi190 ceph-mon[121340]: Upgrade: Updating mgr.smithi190.ubusrr 2023-12-06T14:59:33.121 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:33 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:59:33.122 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:33 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi190.ubusrr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-06T14:59:33.122 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:33 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-06T14:59:33.122 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:33 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:59:33.122 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:33 smithi190 ceph-mon[121340]: Deploying daemon mgr.smithi190.ubusrr on smithi190 2023-12-06T14:59:33.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:33 smithi152 ceph-mon[111954]: Upgrade: Updating mgr.smithi190.ubusrr 2023-12-06T14:59:33.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:33 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:59:33.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:33 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi190.ubusrr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-06T14:59:33.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:33 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-06T14:59:33.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:33 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:59:33.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:33 smithi152 ceph-mon[111954]: Deploying daemon mgr.smithi190.ubusrr on smithi190 2023-12-06T14:59:34.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:34 smithi190 ceph-mon[121340]: pgmap v177: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T14:59:34.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:34 smithi152 ceph-mon[111954]: pgmap v177: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T14:59:35.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:35 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:59:35.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:35 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:59:35.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:35 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:59:35.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:35 smithi190 ceph-mon[121340]: pgmap v178: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T14:59:36.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:35 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:59:36.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:35 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:59:36.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:35 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:59:36.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:35 smithi152 ceph-mon[111954]: pgmap v178: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T14:59:38.258 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:38 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:59:38.259 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:38 smithi190 ceph-mon[121340]: pgmap v179: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-06T14:59:38.259 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:38 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:59:38.259 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:38 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:59:38.259 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:38 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:59:38.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:38 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:59:38.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:38 smithi152 ceph-mon[111954]: pgmap v179: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-06T14:59:38.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:38 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:59:38.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:38 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:59:38.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:38 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:59:39.588 INFO:tasks.workunit.client.0.smithi152.stderr:Updating files: 94% (11429/12123) Updating files: 95% (11517/12123) Updating files: 96% (11639/12123) Updating files: 97% (11760/12123) Updating files: 98% (11881/12123) Updating files: 99% (12002/12123) Updating files: 100% (12123/12123) Updating files: 100% (12123/12123), done. 2023-12-06T14:59:39.856 INFO:tasks.workunit.client.1.smithi190.stderr:Updating files: 98% (11906/12123) Updating files: 99% (12002/12123) Updating files: 100% (12123/12123) Updating files: 100% (12123/12123), done. 2023-12-06T14:59:40.076 INFO:tasks.workunit.client.0.smithi152.stderr:Note: switching to '0482646fcf78576d871bc87843257d82edb79541'. 2023-12-06T14:59:40.076 INFO:tasks.workunit.client.0.smithi152.stderr: 2023-12-06T14:59:40.076 INFO:tasks.workunit.client.0.smithi152.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-06T14:59:40.076 INFO:tasks.workunit.client.0.smithi152.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-06T14:59:40.076 INFO:tasks.workunit.client.0.smithi152.stderr:state without impacting any branches by switching back to a branch. 2023-12-06T14:59:40.076 INFO:tasks.workunit.client.0.smithi152.stderr: 2023-12-06T14:59:40.076 INFO:tasks.workunit.client.0.smithi152.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-06T14:59:40.076 INFO:tasks.workunit.client.0.smithi152.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-06T14:59:40.076 INFO:tasks.workunit.client.0.smithi152.stderr: 2023-12-06T14:59:40.076 INFO:tasks.workunit.client.0.smithi152.stderr: git switch -c 2023-12-06T14:59:40.076 INFO:tasks.workunit.client.0.smithi152.stderr: 2023-12-06T14:59:40.076 INFO:tasks.workunit.client.0.smithi152.stderr:Or undo this operation with: 2023-12-06T14:59:40.077 INFO:tasks.workunit.client.0.smithi152.stderr: 2023-12-06T14:59:40.077 INFO:tasks.workunit.client.0.smithi152.stderr: git switch - 2023-12-06T14:59:40.077 INFO:tasks.workunit.client.0.smithi152.stderr: 2023-12-06T14:59:40.077 INFO:tasks.workunit.client.0.smithi152.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-06T14:59:40.077 INFO:tasks.workunit.client.0.smithi152.stderr: 2023-12-06T14:59:40.077 INFO:tasks.workunit.client.0.smithi152.stderr:HEAD is now at 0482646fcf7 Merge branch 'jjm-cephadm-zipapp-templating-again' of https://github.com/phlogistonjohn/ceph into wip-adk-testing-2023-12-05-1905 2023-12-06T14:59:40.079 DEBUG:teuthology.orchestra.run.smithi152:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-06T14:59:40.106 INFO:tasks.workunit.client.0.smithi152.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-06T14:59:40.108 INFO:tasks.workunit.client.0.smithi152.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-06T14:59:40.108 INFO:tasks.workunit.client.0.smithi152.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-06T14:59:40.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:40 smithi190 ceph-mon[121340]: pgmap v180: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-06T14:59:40.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:40 smithi152 ceph-mon[111954]: pgmap v180: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2023-12-06T14:59:40.495 INFO:tasks.workunit.client.1.smithi190.stderr:Note: switching to '0482646fcf78576d871bc87843257d82edb79541'. 2023-12-06T14:59:40.495 INFO:tasks.workunit.client.1.smithi190.stderr: 2023-12-06T14:59:40.495 INFO:tasks.workunit.client.1.smithi190.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-06T14:59:40.495 INFO:tasks.workunit.client.1.smithi190.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-06T14:59:40.495 INFO:tasks.workunit.client.1.smithi190.stderr:state without impacting any branches by switching back to a branch. 2023-12-06T14:59:40.495 INFO:tasks.workunit.client.1.smithi190.stderr: 2023-12-06T14:59:40.495 INFO:tasks.workunit.client.1.smithi190.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-06T14:59:40.495 INFO:tasks.workunit.client.1.smithi190.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-06T14:59:40.495 INFO:tasks.workunit.client.1.smithi190.stderr: 2023-12-06T14:59:40.495 INFO:tasks.workunit.client.1.smithi190.stderr: git switch -c 2023-12-06T14:59:40.495 INFO:tasks.workunit.client.1.smithi190.stderr: 2023-12-06T14:59:40.495 INFO:tasks.workunit.client.1.smithi190.stderr:Or undo this operation with: 2023-12-06T14:59:40.496 INFO:tasks.workunit.client.1.smithi190.stderr: 2023-12-06T14:59:40.496 INFO:tasks.workunit.client.1.smithi190.stderr: git switch - 2023-12-06T14:59:40.496 INFO:tasks.workunit.client.1.smithi190.stderr: 2023-12-06T14:59:40.496 INFO:tasks.workunit.client.1.smithi190.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-06T14:59:40.496 INFO:tasks.workunit.client.1.smithi190.stderr: 2023-12-06T14:59:40.496 INFO:tasks.workunit.client.1.smithi190.stderr:HEAD is now at 0482646fcf7 Merge branch 'jjm-cephadm-zipapp-templating-again' of https://github.com/phlogistonjohn/ceph into wip-adk-testing-2023-12-05-1905 2023-12-06T14:59:40.499 DEBUG:teuthology.orchestra.run.smithi190:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2023-12-06T14:59:40.589 INFO:tasks.workunit.client.1.smithi190.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-06T14:59:40.591 INFO:tasks.workunit.client.1.smithi190.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-12-06T14:59:40.591 INFO:tasks.workunit.client.1.smithi190.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-06T14:59:40.719 INFO:tasks.workunit.client.0.smithi152.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-06T14:59:40.776 INFO:tasks.workunit.client.0.smithi152.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-06T14:59:40.814 INFO:tasks.workunit.client.0.smithi152.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-06T14:59:40.815 INFO:tasks.workunit.client.0.smithi152.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-06T14:59:40.815 INFO:tasks.workunit.client.0.smithi152.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-06T14:59:40.852 INFO:tasks.workunit.client.0.smithi152.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-06T14:59:40.855 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-06T14:59:40.855 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-06T14:59:40.916 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2023-12-06T14:59:40.917 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2023-12-06T14:59:40.917 DEBUG:teuthology.orchestra.run.smithi152:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0482646fcf78576d871bc87843257d82edb79541 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2023-12-06T14:59:40.979 INFO:tasks.workunit.client.0.smithi152.stderr:+ mkdir -p fsstress 2023-12-06T14:59:40.980 INFO:tasks.workunit.client.0.smithi152.stderr:+ pushd fsstress 2023-12-06T14:59:40.981 INFO:tasks.workunit.client.0.smithi152.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-06T14:59:40.981 INFO:tasks.workunit.client.0.smithi152.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2023-12-06T14:59:41.250 INFO:tasks.workunit.client.1.smithi190.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-06T14:59:41.308 INFO:tasks.workunit.client.1.smithi190.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-06T14:59:41.345 INFO:tasks.workunit.client.1.smithi190.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-12-06T14:59:41.346 INFO:tasks.workunit.client.1.smithi190.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-12-06T14:59:41.346 INFO:tasks.workunit.client.1.smithi190.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-06T14:59:41.383 INFO:tasks.workunit.client.1.smithi190.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-12-06T14:59:41.387 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-06T14:59:41.387 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2023-12-06T14:59:41.407 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2023-12-06T14:59:41.408 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2023-12-06T14:59:41.409 DEBUG:teuthology.orchestra.run.smithi190:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0482646fcf78576d871bc87843257d82edb79541 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2023-12-06T14:59:41.472 INFO:tasks.workunit.client.1.smithi190.stderr:+ mkdir -p fsstress 2023-12-06T14:59:41.473 INFO:tasks.workunit.client.1.smithi190.stderr:+ pushd fsstress 2023-12-06T14:59:41.474 INFO:tasks.workunit.client.1.smithi190.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-06T14:59:41.474 INFO:tasks.workunit.client.1.smithi190.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2023-12-06T14:59:41.684 INFO:tasks.workunit.client.0.smithi152.stderr:+ tar xzf ltp-full.tgz 2023-12-06T14:59:41.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:41 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:59:41.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:41 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:59:41.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:41 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:59:41.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:41 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:59:41.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:41 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:59:41.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:41 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:59:41.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:41 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mgr fail", "who": "smithi152.meodco"}]: dispatch 2023-12-06T14:59:41.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:41 smithi152 ceph-mon[111954]: osdmap e44: 6 total, 6 up, 6 in 2023-12-06T14:59:41.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:41 smithi152 ceph-mon[111954]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd='[{"prefix": "mgr fail", "who": "smithi152.meodco"}]': finished 2023-12-06T14:59:41.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:41 smithi152 ceph-mon[111954]: mgrmap e20: smithi190.ubusrr(active, starting, since 0.0110078s) 2023-12-06T14:59:41.977 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:41 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:59:41.977 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:41 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:59:41.977 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:41 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:59:41.977 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:41 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:59:41.977 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:41 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' 2023-12-06T14:59:41.977 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:41 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:59:41.977 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:41 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mgr fail", "who": "smithi152.meodco"}]: dispatch 2023-12-06T14:59:41.977 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:41 smithi190 ceph-mon[121340]: osdmap e44: 6 total, 6 up, 6 in 2023-12-06T14:59:41.977 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:41 smithi190 ceph-mon[121340]: from='mgr.14210 172.21.15.152:0/54159227' entity='mgr.smithi152.meodco' cmd='[{"prefix": "mgr fail", "who": "smithi152.meodco"}]': finished 2023-12-06T14:59:41.978 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:41 smithi190 ceph-mon[121340]: mgrmap e20: smithi190.ubusrr(active, starting, since 0.0110078s) 2023-12-06T14:59:42.234 INFO:tasks.workunit.client.1.smithi190.stderr:+ tar xzf ltp-full.tgz 2023-12-06T14:59:43.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:42 smithi190 ceph-mon[121340]: Active manager daemon smithi190.ubusrr restarted 2023-12-06T14:59:43.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:42 smithi190 ceph-mon[121340]: Activating manager daemon smithi190.ubusrr 2023-12-06T14:59:43.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:42 smithi190 ceph-mon[121340]: osdmap e45: 6 total, 6 up, 6 in 2023-12-06T14:59:43.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:42 smithi190 ceph-mon[121340]: mgrmap e21: smithi190.ubusrr(active, starting, since 0.00583119s) 2023-12-06T14:59:43.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:42 smithi190 ceph-mon[121340]: from='mgr.? 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi190.ubusrr/crt"}]: dispatch 2023-12-06T14:59:43.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:42 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi190.ubusrr/crt"}]: dispatch 2023-12-06T14:59:43.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:42 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-06T14:59:43.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:42 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "mon metadata", "id": "smithi190"}]: dispatch 2023-12-06T14:59:43.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:42 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.acqswy"}]: dispatch 2023-12-06T14:59:43.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:42 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.ypivwc"}]: dispatch 2023-12-06T14:59:43.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:42 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi190.uucxzu"}]: dispatch 2023-12-06T14:59:43.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:42 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi190.edwtqj"}]: dispatch 2023-12-06T14:59:43.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:42 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "mgr metadata", "who": "smithi190.ubusrr", "id": "smithi190.ubusrr"}]: dispatch 2023-12-06T14:59:43.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:42 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-06T14:59:43.074 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:42 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-06T14:59:43.074 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:42 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-06T14:59:43.074 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:42 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-06T14:59:43.074 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:42 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-06T14:59:43.074 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:42 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-06T14:59:43.074 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:42 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-06T14:59:43.074 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:42 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-06T14:59:43.074 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:42 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-06T14:59:43.074 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:42 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-06T14:59:43.074 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:42 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi190.ubusrr/key"}]: dispatch 2023-12-06T14:59:43.074 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:42 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-06T14:59:43.074 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:42 smithi190 ceph-mon[121340]: Manager daemon smithi190.ubusrr is now available 2023-12-06T14:59:43.074 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:42 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:43.074 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:42 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:59:43.075 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:42 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:59:43.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:42 smithi152 ceph-mon[111954]: Active manager daemon smithi190.ubusrr restarted 2023-12-06T14:59:43.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:42 smithi152 ceph-mon[111954]: Activating manager daemon smithi190.ubusrr 2023-12-06T14:59:43.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:42 smithi152 ceph-mon[111954]: osdmap e45: 6 total, 6 up, 6 in 2023-12-06T14:59:43.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:42 smithi152 ceph-mon[111954]: mgrmap e21: smithi190.ubusrr(active, starting, since 0.00583119s) 2023-12-06T14:59:43.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:42 smithi152 ceph-mon[111954]: from='mgr.? 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi190.ubusrr/crt"}]: dispatch 2023-12-06T14:59:43.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:42 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi190.ubusrr/crt"}]: dispatch 2023-12-06T14:59:43.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:42 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-06T14:59:43.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:42 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "mon metadata", "id": "smithi190"}]: dispatch 2023-12-06T14:59:43.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:42 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.acqswy"}]: dispatch 2023-12-06T14:59:43.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:42 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.ypivwc"}]: dispatch 2023-12-06T14:59:43.130 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:42 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi190.uucxzu"}]: dispatch 2023-12-06T14:59:43.130 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:42 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi190.edwtqj"}]: dispatch 2023-12-06T14:59:43.130 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:42 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "mgr metadata", "who": "smithi190.ubusrr", "id": "smithi190.ubusrr"}]: dispatch 2023-12-06T14:59:43.130 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:42 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-06T14:59:43.130 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:42 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-06T14:59:43.130 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:42 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-06T14:59:43.130 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:42 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-06T14:59:43.130 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:42 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-06T14:59:43.130 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:42 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-06T14:59:43.130 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:42 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-06T14:59:43.130 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:42 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-06T14:59:43.130 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:42 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-06T14:59:43.131 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:42 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-06T14:59:43.131 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:42 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi190.ubusrr/key"}]: dispatch 2023-12-06T14:59:43.131 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:42 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-06T14:59:43.131 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:42 smithi152 ceph-mon[111954]: Manager daemon smithi190.ubusrr is now available 2023-12-06T14:59:43.131 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:42 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:43.131 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:42 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:59:43.131 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:42 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T14:59:43.765 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:43.764+0000 7f6624232700 1 -- 172.21.15.152:0/1089128160 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f661c0fff70 msgr2=0x7f661c1003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:43.765 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:43.764+0000 7f6624232700 1 --2- 172.21.15.152:0/1089128160 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f661c0fff70 0x7f661c1003e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f660c004880 tx=0x7f660c009e30 comp rx=0 tx=0).stop 2023-12-06T14:59:43.766 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:43.764+0000 7f6624232700 1 -- 172.21.15.152:0/1089128160 shutdown_connections 2023-12-06T14:59:43.766 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:43.764+0000 7f6624232700 1 --2- 172.21.15.152:0/1089128160 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f661c0fff70 0x7f661c1003e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:43.766 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:43.764+0000 7f6624232700 1 --2- 172.21.15.152:0/1089128160 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f661c0fee00 0x7f661c0ff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:43.766 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:43.764+0000 7f6624232700 1 -- 172.21.15.152:0/1089128160 >> 172.21.15.152:0/1089128160 conn(0x7f661c0fa5d0 msgr2=0x7f661c0fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:59:43.766 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:43.765+0000 7f6624232700 1 -- 172.21.15.152:0/1089128160 shutdown_connections 2023-12-06T14:59:43.766 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:43.765+0000 7f6624232700 1 -- 172.21.15.152:0/1089128160 wait complete. 2023-12-06T14:59:43.767 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:43.765+0000 7f6624232700 1 Processor -- start 2023-12-06T14:59:43.767 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:43.765+0000 7f6624232700 1 -- start start 2023-12-06T14:59:43.767 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:43.766+0000 7f6624232700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f661c0fee00 0x7f661c06ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:43.767 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:43.766+0000 7f6624232700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f661c0fff70 0x7f661c06f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:43.767 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:43.766+0000 7f6624232700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661c06f7e0 con 0x7f661c0fff70 2023-12-06T14:59:43.767 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:43.766+0000 7f6624232700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661c1192f0 con 0x7f661c0fee00 2023-12-06T14:59:43.767 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:43.766+0000 7f66217cd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f661c0fff70 0x7f661c06f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:43.767 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:43.766+0000 7f66217cd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f661c0fff70 0x7f661c06f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42588/0 (socket says 172.21.15.152:42588) 2023-12-06T14:59:43.767 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:43.766+0000 7f66217cd700 1 -- 172.21.15.152:0/2059966067 learned_addr learned my addr 172.21.15.152:0/2059966067 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:59:43.767 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:43.766+0000 7f6621fce700 1 --2- 172.21.15.152:0/2059966067 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f661c0fee00 0x7f661c06ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:43.768 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:43.766+0000 7f66217cd700 1 -- 172.21.15.152:0/2059966067 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f661c0fee00 msgr2=0x7f661c06ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:43.768 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:43.766+0000 7f66217cd700 1 --2- 172.21.15.152:0/2059966067 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f661c0fee00 0x7f661c06ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:43.768 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:43.766+0000 7f66217cd700 1 -- 172.21.15.152:0/2059966067 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6618005040 con 0x7f661c0fff70 2023-12-06T14:59:43.768 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:43.766+0000 7f66217cd700 1 --2- 172.21.15.152:0/2059966067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f661c0fff70 0x7f661c06f190 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f660c0040d0 tx=0x7f660c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:59:43.768 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:43.767+0000 7f66127fc700 1 -- 172.21.15.152:0/2059966067 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f660c00e030 con 0x7f661c0fff70 2023-12-06T14:59:43.768 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:43.767+0000 7f6624232700 1 -- 172.21.15.152:0/2059966067 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f660c005040 con 0x7f661c0fff70 2023-12-06T14:59:43.768 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:43.767+0000 7f66127fc700 1 -- 172.21.15.152:0/2059966067 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f660c01c400 con 0x7f661c0fff70 2023-12-06T14:59:43.768 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:43.767+0000 7f66127fc700 1 -- 172.21.15.152:0/2059966067 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f660c012600 con 0x7f661c0fff70 2023-12-06T14:59:43.768 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:43.767+0000 7f6624232700 1 -- 172.21.15.152:0/2059966067 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f661c119920 con 0x7f661c0fff70 2023-12-06T14:59:43.769 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:43.768+0000 7f6624232700 1 -- 172.21.15.152:0/2059966067 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f661c04bb80 con 0x7f661c0fff70 2023-12-06T14:59:43.769 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:43.768+0000 7f66127fc700 1 -- 172.21.15.152:0/2059966067 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 22) v1 ==== 45377+0+0 (secure 0 0 0) 0x7f660c01c570 con 0x7f661c0fff70 2023-12-06T14:59:43.769 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:43.768+0000 7f66127fc700 1 --2- 172.21.15.152:0/2059966067 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f6608038350 0x7f660803a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:43.769 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:43.768+0000 7f66127fc700 1 -- 172.21.15.152:0/2059966067 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f660c04d910 con 0x7f661c0fff70 2023-12-06T14:59:43.769 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:43.769+0000 7f6621fce700 1 --2- 172.21.15.152:0/2059966067 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f6608038350 0x7f660803a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:43.769 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:43.769+0000 7f6621fce700 1 --2- 172.21.15.152:0/2059966067 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f6608038350 0x7f660803a800 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f661c06ea00 tx=0x7f661800b040 comp rx=0 tx=0).ready entity=mgr.14612 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:59:43.773 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:43.773+0000 7f66127fc700 1 -- 172.21.15.152:0/2059966067 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f660c011780 con 0x7f661c0fff70 2023-12-06T14:59:43.826 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:43 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:59:43.826 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:43 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi190.ubusrr/mirror_snapshot_schedule"}]: dispatch 2023-12-06T14:59:43.826 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:43 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi190.ubusrr/mirror_snapshot_schedule"}]: dispatch 2023-12-06T14:59:43.826 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:43 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi190.ubusrr/trash_purge_schedule"}]: dispatch 2023-12-06T14:59:43.826 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:43 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi190.ubusrr/trash_purge_schedule"}]: dispatch 2023-12-06T14:59:43.826 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:43 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:43.826 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:43 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:43.826 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:43 smithi152 ceph-mon[111954]: Deploying cephadm binary to smithi190 2023-12-06T14:59:43.826 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:43 smithi152 ceph-mon[111954]: Deploying cephadm binary to smithi152 2023-12-06T14:59:43.827 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:43 smithi152 ceph-mon[111954]: mgrmap e22: smithi190.ubusrr(active, since 1.00788s) 2023-12-06T14:59:43.827 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:43 smithi152 ceph-mon[111954]: pgmap v3: 65 pgs: 65 active+clean; 4.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:59:44.006 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.006+0000 7f6624232700 1 -- 172.21.15.152:0/2059966067 --> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f661c119de0 con 0x7f6608038350 2023-12-06T14:59:44.016 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.016+0000 7f66127fc700 1 -- 172.21.15.152:0/2059966067 <== mgr.14612 v2:172.21.15.190:6828/3047155534 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f661c119de0 con 0x7f6608038350 2023-12-06T14:59:44.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.018+0000 7f6624232700 1 -- 172.21.15.152:0/2059966067 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f6608038350 msgr2=0x7f660803a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:44.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.018+0000 7f6624232700 1 --2- 172.21.15.152:0/2059966067 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f6608038350 0x7f660803a800 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f661c06ea00 tx=0x7f661800b040 comp rx=0 tx=0).stop 2023-12-06T14:59:44.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.019+0000 7f6624232700 1 -- 172.21.15.152:0/2059966067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f661c0fff70 msgr2=0x7f661c06f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:44.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.019+0000 7f6624232700 1 --2- 172.21.15.152:0/2059966067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f661c0fff70 0x7f661c06f190 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f660c0040d0 tx=0x7f660c009e30 comp rx=0 tx=0).stop 2023-12-06T14:59:44.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.019+0000 7f6624232700 1 -- 172.21.15.152:0/2059966067 shutdown_connections 2023-12-06T14:59:44.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.019+0000 7f6624232700 1 --2- 172.21.15.152:0/2059966067 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f6608038350 0x7f660803a800 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:44.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.019+0000 7f6624232700 1 --2- 172.21.15.152:0/2059966067 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f661c0fee00 0x7f661c06ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:44.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.019+0000 7f6624232700 1 --2- 172.21.15.152:0/2059966067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f661c0fff70 0x7f661c06f190 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:44.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.019+0000 7f6624232700 1 -- 172.21.15.152:0/2059966067 >> 172.21.15.152:0/2059966067 conn(0x7f661c0fa5d0 msgr2=0x7f661c103230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:59:44.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.019+0000 7f6624232700 1 -- 172.21.15.152:0/2059966067 shutdown_connections 2023-12-06T14:59:44.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.019+0000 7f6624232700 1 -- 172.21.15.152:0/2059966067 wait complete. 2023-12-06T14:59:44.030 INFO:teuthology.orchestra.run.smithi152.stdout:true 2023-12-06T14:59:44.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:43 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:59:44.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:43 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi190.ubusrr/mirror_snapshot_schedule"}]: dispatch 2023-12-06T14:59:44.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:43 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi190.ubusrr/mirror_snapshot_schedule"}]: dispatch 2023-12-06T14:59:44.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:43 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi190.ubusrr/trash_purge_schedule"}]: dispatch 2023-12-06T14:59:44.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:43 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi190.ubusrr/trash_purge_schedule"}]: dispatch 2023-12-06T14:59:44.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:43 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:44.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:43 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:44.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:43 smithi190 ceph-mon[121340]: Deploying cephadm binary to smithi190 2023-12-06T14:59:44.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:43 smithi190 ceph-mon[121340]: Deploying cephadm binary to smithi152 2023-12-06T14:59:44.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:43 smithi190 ceph-mon[121340]: mgrmap e22: smithi190.ubusrr(active, since 1.00788s) 2023-12-06T14:59:44.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:43 smithi190 ceph-mon[121340]: pgmap v3: 65 pgs: 65 active+clean; 4.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:59:44.134 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.133+0000 7f69600e1700 1 -- 172.21.15.152:0/1766048970 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69580fcd00 msgr2=0x7f69580fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:44.134 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.133+0000 7f69600e1700 1 --2- 172.21.15.152:0/1766048970 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69580fcd00 0x7f69580fd150 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6948004940 tx=0x7f6948009e30 comp rx=0 tx=0).stop 2023-12-06T14:59:44.134 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.133+0000 7f69600e1700 1 -- 172.21.15.152:0/1766048970 shutdown_connections 2023-12-06T14:59:44.134 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.133+0000 7f69600e1700 1 --2- 172.21.15.152:0/1766048970 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69580fcd00 0x7f69580fd150 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:44.134 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.133+0000 7f69600e1700 1 --2- 172.21.15.152:0/1766048970 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69580fbaf0 0x7f69580fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:44.134 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.133+0000 7f69600e1700 1 -- 172.21.15.152:0/1766048970 >> 172.21.15.152:0/1766048970 conn(0x7f69580f7190 msgr2=0x7f69580f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:59:44.134 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.134+0000 7f69600e1700 1 -- 172.21.15.152:0/1766048970 shutdown_connections 2023-12-06T14:59:44.134 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.134+0000 7f69600e1700 1 -- 172.21.15.152:0/1766048970 wait complete. 2023-12-06T14:59:44.135 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.134+0000 7f69600e1700 1 Processor -- start 2023-12-06T14:59:44.135 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.134+0000 7f69600e1700 1 -- start start 2023-12-06T14:59:44.135 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.134+0000 7f69600e1700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69580fbaf0 0x7f695810d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:44.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.134+0000 7f69600e1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69580fcd00 0x7f695810da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:44.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.134+0000 7f69600e1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695810e010 con 0x7f69580fcd00 2023-12-06T14:59:44.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.134+0000 7f69600e1700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695810e8b0 con 0x7f69580fbaf0 2023-12-06T14:59:44.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.134+0000 7f695d67c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69580fcd00 0x7f695810da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:44.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.134+0000 7f695de7d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69580fbaf0 0x7f695810d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:44.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.135+0000 7f695d67c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69580fcd00 0x7f695810da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42608/0 (socket says 172.21.15.152:42608) 2023-12-06T14:59:44.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.135+0000 7f695de7d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69580fbaf0 0x7f695810d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.152:41124/0 (socket says 172.21.15.152:41124) 2023-12-06T14:59:44.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.135+0000 7f695d67c700 1 -- 172.21.15.152:0/1911256918 learned_addr learned my addr 172.21.15.152:0/1911256918 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:59:44.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.135+0000 7f695de7d700 1 -- 172.21.15.152:0/1911256918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69580fcd00 msgr2=0x7f695810da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:44.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.135+0000 7f695de7d700 1 --2- 172.21.15.152:0/1911256918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69580fcd00 0x7f695810da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:44.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.135+0000 7f695de7d700 1 -- 172.21.15.152:0/1911256918 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6948005040 con 0x7f69580fbaf0 2023-12-06T14:59:44.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.135+0000 7f695d67c700 1 --2- 172.21.15.152:0/1911256918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69580fcd00 0x7f695810da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-06T14:59:44.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.135+0000 7f695de7d700 1 --2- 172.21.15.152:0/1911256918 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69580fbaf0 0x7f695810d4d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f69580fcb60 tx=0x7f695400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:59:44.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.135+0000 7f694e7fc700 1 -- 172.21.15.152:0/1911256918 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6954004e90 con 0x7f69580fbaf0 2023-12-06T14:59:44.137 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.135+0000 7f694e7fc700 1 -- 172.21.15.152:0/1911256918 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f695400f040 con 0x7f69580fbaf0 2023-12-06T14:59:44.137 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.135+0000 7f69600e1700 1 -- 172.21.15.152:0/1911256918 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f695810eb30 con 0x7f69580fbaf0 2023-12-06T14:59:44.137 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.135+0000 7f694e7fc700 1 -- 172.21.15.152:0/1911256918 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f695400c890 con 0x7f69580fbaf0 2023-12-06T14:59:44.137 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.135+0000 7f69600e1700 1 -- 172.21.15.152:0/1911256918 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f695810f070 con 0x7f69580fbaf0 2023-12-06T14:59:44.137 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.136+0000 7f694e7fc700 1 -- 172.21.15.152:0/1911256918 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 22) v1 ==== 45377+0+0 (secure 0 0 0) 0x7f695400cb00 con 0x7f69580fbaf0 2023-12-06T14:59:44.137 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.136+0000 7f694e7fc700 1 --2- 172.21.15.152:0/1911256918 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f6944038350 0x7f694403a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:44.137 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.136+0000 7f694e7fc700 1 -- 172.21.15.152:0/1911256918 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f695404b490 con 0x7f69580fbaf0 2023-12-06T14:59:44.137 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.137+0000 7f695d67c700 1 --2- 172.21.15.152:0/1911256918 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f6944038350 0x7f694403a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:44.138 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.137+0000 7f69600e1700 1 -- 172.21.15.152:0/1911256918 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f695804bb80 con 0x7f69580fbaf0 2023-12-06T14:59:44.138 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.137+0000 7f695d67c700 1 --2- 172.21.15.152:0/1911256918 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f6944038350 0x7f694403a800 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6948013600 tx=0x7f6948009e30 comp rx=0 tx=0).ready entity=mgr.14612 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:59:44.142 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.142+0000 7f694e7fc700 1 -- 172.21.15.152:0/1911256918 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f695401b2c0 con 0x7f69580fbaf0 2023-12-06T14:59:44.459 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.459+0000 7f69600e1700 1 -- 172.21.15.152:0/1911256918 --> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f695810f480 con 0x7f6944038350 2023-12-06T14:59:44.466 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.467+0000 7f694e7fc700 1 -- 172.21.15.152:0/1911256918 <== mgr.14612 v2:172.21.15.190:6828/3047155534 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f695810f480 con 0x7f6944038350 2023-12-06T14:59:44.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.470+0000 7f69600e1700 1 -- 172.21.15.152:0/1911256918 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f6944038350 msgr2=0x7f694403a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:44.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.470+0000 7f69600e1700 1 --2- 172.21.15.152:0/1911256918 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f6944038350 0x7f694403a800 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6948013600 tx=0x7f6948009e30 comp rx=0 tx=0).stop 2023-12-06T14:59:44.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.470+0000 7f69600e1700 1 -- 172.21.15.152:0/1911256918 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69580fbaf0 msgr2=0x7f695810d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:44.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.470+0000 7f69600e1700 1 --2- 172.21.15.152:0/1911256918 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69580fbaf0 0x7f695810d4d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f69580fcb60 tx=0x7f695400b040 comp rx=0 tx=0).stop 2023-12-06T14:59:44.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.470+0000 7f69600e1700 1 -- 172.21.15.152:0/1911256918 shutdown_connections 2023-12-06T14:59:44.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.470+0000 7f69600e1700 1 --2- 172.21.15.152:0/1911256918 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f6944038350 0x7f694403a800 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:44.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.470+0000 7f69600e1700 1 --2- 172.21.15.152:0/1911256918 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69580fbaf0 0x7f695810d4d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:44.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.470+0000 7f69600e1700 1 --2- 172.21.15.152:0/1911256918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69580fcd00 0x7f695810da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:44.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.470+0000 7f69600e1700 1 -- 172.21.15.152:0/1911256918 >> 172.21.15.152:0/1911256918 conn(0x7f69580f7190 msgr2=0x7f6958065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:59:44.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.470+0000 7f69600e1700 1 -- 172.21.15.152:0/1911256918 shutdown_connections 2023-12-06T14:59:44.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.470+0000 7f69600e1700 1 -- 172.21.15.152:0/1911256918 wait complete. 2023-12-06T14:59:44.586 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.586+0000 7f4be725c700 1 -- 172.21.15.152:0/185646088 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4be00fcbf0 msgr2=0x7f4be00fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:44.587 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.586+0000 7f4be725c700 1 --2- 172.21.15.152:0/185646088 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4be00fcbf0 0x7f4be00fd000 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4004940 tx=0x7f4bd4009e30 comp rx=0 tx=0).stop 2023-12-06T14:59:44.587 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.586+0000 7f4be725c700 1 -- 172.21.15.152:0/185646088 shutdown_connections 2023-12-06T14:59:44.587 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.586+0000 7f4be725c700 1 --2- 172.21.15.152:0/185646088 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4be00fde00 0x7f4be00fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:44.587 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.586+0000 7f4be725c700 1 --2- 172.21.15.152:0/185646088 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4be00fcbf0 0x7f4be00fd000 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:44.587 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.586+0000 7f4be725c700 1 -- 172.21.15.152:0/185646088 >> 172.21.15.152:0/185646088 conn(0x7f4be00f82d0 msgr2=0x7f4be00fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:59:44.587 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.586+0000 7f4be725c700 1 -- 172.21.15.152:0/185646088 shutdown_connections 2023-12-06T14:59:44.587 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.586+0000 7f4be725c700 1 -- 172.21.15.152:0/185646088 wait complete. 2023-12-06T14:59:44.588 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.587+0000 7f4be725c700 1 Processor -- start 2023-12-06T14:59:44.588 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.587+0000 7f4be725c700 1 -- start start 2023-12-06T14:59:44.588 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.587+0000 7f4be725c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4be00fcbf0 0x7f4be0071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:44.588 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.587+0000 7f4be725c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4be00fde00 0x7f4be006ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:44.588 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.587+0000 7f4be725c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be01111b0 con 0x7f4be00fcbf0 2023-12-06T14:59:44.588 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.587+0000 7f4be725c700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be0111320 con 0x7f4be00fde00 2023-12-06T14:59:44.588 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.587+0000 7f4be4ff8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4be00fcbf0 0x7f4be0071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:44.588 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.587+0000 7f4be4ff8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4be00fcbf0 0x7f4be0071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42620/0 (socket says 172.21.15.152:42620) 2023-12-06T14:59:44.588 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.587+0000 7f4be4ff8700 1 -- 172.21.15.152:0/771936372 learned_addr learned my addr 172.21.15.152:0/771936372 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:59:44.588 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.588+0000 7f4bdffff700 1 --2- 172.21.15.152:0/771936372 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4be00fde00 0x7f4be006ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:44.588 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.588+0000 7f4be4ff8700 1 -- 172.21.15.152:0/771936372 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4be00fde00 msgr2=0x7f4be006ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:44.588 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.588+0000 7f4be4ff8700 1 --2- 172.21.15.152:0/771936372 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4be00fde00 0x7f4be006ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:44.589 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.588+0000 7f4be4ff8700 1 -- 172.21.15.152:0/771936372 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd4005040 con 0x7f4be00fcbf0 2023-12-06T14:59:44.589 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.588+0000 7f4bdffff700 1 --2- 172.21.15.152:0/771936372 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4be00fde00 0x7f4be006ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-06T14:59:44.589 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.588+0000 7f4be4ff8700 1 --2- 172.21.15.152:0/771936372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4be00fcbf0 0x7f4be0071b10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4009fd0 tx=0x7f4bd4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:59:44.589 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.588+0000 7f4bdd7fa700 1 -- 172.21.15.152:0/771936372 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bd4021070 con 0x7f4be00fcbf0 2023-12-06T14:59:44.589 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.588+0000 7f4bdd7fa700 1 -- 172.21.15.152:0/771936372 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4bd401c400 con 0x7f4be00fcbf0 2023-12-06T14:59:44.589 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.588+0000 7f4be725c700 1 -- 172.21.15.152:0/771936372 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4be01115a0 con 0x7f4be00fcbf0 2023-12-06T14:59:44.589 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.588+0000 7f4bdd7fa700 1 -- 172.21.15.152:0/771936372 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bd400e070 con 0x7f4be00fcbf0 2023-12-06T14:59:44.590 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.588+0000 7f4be725c700 1 -- 172.21.15.152:0/771936372 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4be0111a80 con 0x7f4be00fcbf0 2023-12-06T14:59:44.590 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.590+0000 7f4bdd7fa700 1 -- 172.21.15.152:0/771936372 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 22) v1 ==== 45377+0+0 (secure 0 0 0) 0x7f4bd400b720 con 0x7f4be00fcbf0 2023-12-06T14:59:44.590 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.590+0000 7f4bdd7fa700 1 --2- 172.21.15.152:0/771936372 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f4bd0038350 0x7f4bd003a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:44.590 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.590+0000 7f4bdd7fa700 1 -- 172.21.15.152:0/771936372 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f4bd404ce30 con 0x7f4be00fcbf0 2023-12-06T14:59:44.590 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.590+0000 7f4be725c700 1 -- 172.21.15.152:0/771936372 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4be004bb80 con 0x7f4be00fcbf0 2023-12-06T14:59:44.590 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.590+0000 7f4bdffff700 1 --2- 172.21.15.152:0/771936372 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f4bd0038350 0x7f4bd003a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:44.591 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.590+0000 7f4bdffff700 1 --2- 172.21.15.152:0/771936372 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f4bd0038350 0x7f4bd003a800 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc009b80 tx=0x7f4bcc00b040 comp rx=0 tx=0).ready entity=mgr.14612 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:59:44.595 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.595+0000 7f4bdd7fa700 1 -- 172.21.15.152:0/771936372 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f4bd400bac0 con 0x7f4be00fcbf0 2023-12-06T14:59:44.882 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.882+0000 7f4be725c700 1 -- 172.21.15.152:0/771936372 --> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4be0070880 con 0x7f4bd0038350 2023-12-06T14:59:44.893 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.893+0000 7f4bdd7fa700 1 -- 172.21.15.152:0/771936372 <== mgr.14612 v2:172.21.15.190:6828/3047155534 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f4be0070880 con 0x7f4bd0038350 2023-12-06T14:59:44.894 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-06T14:59:44.894 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 running (4m) 89s ago 5m 26.3M - 0.25.0 c8568f914cd2 a93c38b08b75 2023-12-06T14:59:44.894 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (5m) 89s ago 5m 7436k - 17.2.7-113-gece0d607 a5c6421f1c5f 40d5cebbdb93 2023-12-06T14:59:44.894 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi190 smithi190 running (4m) 7s ago 4m 7461k - 17.2.7-113-gece0d607 a5c6421f1c5f 3a387cddf7e6 2023-12-06T14:59:44.894 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (4m) 89s ago 5m 94.5M - 9.4.7 954c08fa6188 22085689650a 2023-12-06T14:59:44.894 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.acqswy smithi152 running (103s) 89s ago 103s 16.1M - 17.2.7-113-gece0d607 a5c6421f1c5f ff9375cec192 2023-12-06T14:59:44.894 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.ypivwc smithi152 running (99s) 89s ago 99s 14.2M - 17.2.7-113-gece0d607 a5c6421f1c5f d809a681491b 2023-12-06T14:59:44.894 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi190.edwtqj smithi190 running (98s) 7s ago 97s 19.7M - 17.2.7-113-gece0d607 a5c6421f1c5f f3b7ebd93b04 2023-12-06T14:59:44.894 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi190.uucxzu smithi190 running (101s) 7s ago 101s 19.8M - 17.2.7-113-gece0d607 a5c6421f1c5f c01be1409c5f 2023-12-06T14:59:44.895 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.meodco smithi152 *:9283 running (6m) 89s ago 6m 495M - 17.2.7-113-gece0d607 a5c6421f1c5f 9d7a3190a8fa 2023-12-06T14:59:44.895 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi190.ubusrr smithi190 *:8443,9283 running (10s) 7s ago 4m 53.0M - 19.0.0-26-g0482646f 26bb7d89db2e 80c6d3654b71 2023-12-06T14:59:44.895 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (6m) 89s ago 6m 74.9M 2048M 17.2.7-113-gece0d607 a5c6421f1c5f 2b9f6058715d 2023-12-06T14:59:44.895 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi190 smithi190 running (4m) 7s ago 4m 49.2M 2048M 17.2.7-113-gece0d607 a5c6421f1c5f 3a81d140940b 2023-12-06T14:59:44.895 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 running (5m) 89s ago 5m 14.4M - 1.5.0 0da6a335fe13 870624b5876a 2023-12-06T14:59:44.895 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi190 smithi190 *:9100 running (4m) 7s ago 4m 19.4M - 1.5.0 0da6a335fe13 39b96c91b1ce 2023-12-06T14:59:44.895 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (4m) 89s ago 4m 55.1M 4299M 17.2.7-113-gece0d607 a5c6421f1c5f 499f740f966e 2023-12-06T14:59:44.895 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (3m) 89s ago 3m 59.5M 4299M 17.2.7-113-gece0d607 a5c6421f1c5f 3942f134581a 2023-12-06T14:59:44.895 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (3m) 89s ago 3m 56.8M 4299M 17.2.7-113-gece0d607 a5c6421f1c5f 80bcc4927bb2 2023-12-06T14:59:44.895 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi190 running (3m) 7s ago 3m 60.4M 5323M 17.2.7-113-gece0d607 a5c6421f1c5f f0281d01fec4 2023-12-06T14:59:44.895 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi190 running (3m) 7s ago 3m 52.8M 5323M 17.2.7-113-gece0d607 a5c6421f1c5f a415b29ad9c7 2023-12-06T14:59:44.895 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi190 running (2m) 7s ago 2m 55.5M 5323M 17.2.7-113-gece0d607 a5c6421f1c5f b0f2767055a5 2023-12-06T14:59:44.895 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi152 smithi152 *:9095 running (4m) 89s ago 5m 46.5M - 2.43.0 a07b618ecd1d fabe795a329c 2023-12-06T14:59:44.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.896+0000 7f4be725c700 1 -- 172.21.15.152:0/771936372 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f4bd0038350 msgr2=0x7f4bd003a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:44.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.896+0000 7f4be725c700 1 --2- 172.21.15.152:0/771936372 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f4bd0038350 0x7f4bd003a800 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc009b80 tx=0x7f4bcc00b040 comp rx=0 tx=0).stop 2023-12-06T14:59:44.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.896+0000 7f4be725c700 1 -- 172.21.15.152:0/771936372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4be00fcbf0 msgr2=0x7f4be0071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:44.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.896+0000 7f4be725c700 1 --2- 172.21.15.152:0/771936372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4be00fcbf0 0x7f4be0071b10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4009fd0 tx=0x7f4bd4009e30 comp rx=0 tx=0).stop 2023-12-06T14:59:44.902 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.902+0000 7f4be725c700 1 -- 172.21.15.152:0/771936372 shutdown_connections 2023-12-06T14:59:44.902 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.902+0000 7f4be725c700 1 --2- 172.21.15.152:0/771936372 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f4bd0038350 0x7f4bd003a800 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:44.902 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.902+0000 7f4be725c700 1 --2- 172.21.15.152:0/771936372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4be00fcbf0 0x7f4be0071b10 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:44.902 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.902+0000 7f4be725c700 1 --2- 172.21.15.152:0/771936372 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4be00fde00 0x7f4be006ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:44.902 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.902+0000 7f4be725c700 1 -- 172.21.15.152:0/771936372 >> 172.21.15.152:0/771936372 conn(0x7f4be00f82d0 msgr2=0x7f4be0101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:59:44.902 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.902+0000 7f4be725c700 1 -- 172.21.15.152:0/771936372 shutdown_connections 2023-12-06T14:59:44.902 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:44.902+0000 7f4be725c700 1 -- 172.21.15.152:0/771936372 wait complete. 2023-12-06T14:59:45.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.017+0000 7f705af87700 1 -- 172.21.15.152:0/4006177202 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70540fcd00 msgr2=0x7f70540fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:45.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.017+0000 7f705af87700 1 --2- 172.21.15.152:0/4006177202 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70540fcd00 0x7f70540fd150 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7040004880 tx=0x7f7040009e30 comp rx=0 tx=0).stop 2023-12-06T14:59:45.017 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.017+0000 7f705af87700 1 -- 172.21.15.152:0/4006177202 shutdown_connections 2023-12-06T14:59:45.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.017+0000 7f705af87700 1 --2- 172.21.15.152:0/4006177202 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70540fcd00 0x7f70540fd150 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:45.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.017+0000 7f705af87700 1 --2- 172.21.15.152:0/4006177202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f70540fbaf0 0x7f70540fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:45.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.017+0000 7f705af87700 1 -- 172.21.15.152:0/4006177202 >> 172.21.15.152:0/4006177202 conn(0x7f70540f7190 msgr2=0x7f70540f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:59:45.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.017+0000 7f705af87700 1 -- 172.21.15.152:0/4006177202 shutdown_connections 2023-12-06T14:59:45.021 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.017+0000 7f705af87700 1 -- 172.21.15.152:0/4006177202 wait complete. 2023-12-06T14:59:45.021 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.017+0000 7f705af87700 1 Processor -- start 2023-12-06T14:59:45.021 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.017+0000 7f705af87700 1 -- start start 2023-12-06T14:59:45.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.018+0000 7f705af87700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f70540fbaf0 0x7f705410f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:45.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.018+0000 7f705af87700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70540fcd00 0x7f705410fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:45.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.018+0000 7f705af87700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7054110210 con 0x7f70540fbaf0 2023-12-06T14:59:45.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.018+0000 7f705af87700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7054110ab0 con 0x7f70540fcd00 2023-12-06T14:59:45.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.018+0000 7f7053fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70540fcd00 0x7f705410fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:45.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.018+0000 7f7058d23700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f70540fbaf0 0x7f705410f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:45.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.018+0000 7f7053fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70540fcd00 0x7f705410fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.152:41180/0 (socket says 172.21.15.152:41180) 2023-12-06T14:59:45.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.018+0000 7f7053fff700 1 -- 172.21.15.152:0/4244278251 learned_addr learned my addr 172.21.15.152:0/4244278251 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:59:45.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.018+0000 7f7053fff700 1 -- 172.21.15.152:0/4244278251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f70540fbaf0 msgr2=0x7f705410f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:45.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.018+0000 7f7053fff700 1 --2- 172.21.15.152:0/4244278251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f70540fbaf0 0x7f705410f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:45.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.018+0000 7f7053fff700 1 -- 172.21.15.152:0/4244278251 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7048005040 con 0x7f70540fcd00 2023-12-06T14:59:45.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.018+0000 7f7053fff700 1 --2- 172.21.15.152:0/4244278251 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70540fcd00 0x7f705410fc10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f70400134a0 tx=0x7f7040009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:59:45.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.019+0000 7f70517fa700 1 -- 172.21.15.152:0/4244278251 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f704000e030 con 0x7f70540fcd00 2023-12-06T14:59:45.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.019+0000 7f70517fa700 1 -- 172.21.15.152:0/4244278251 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f704001c400 con 0x7f70540fcd00 2023-12-06T14:59:45.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.019+0000 7f70517fa700 1 -- 172.21.15.152:0/4244278251 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7040012600 con 0x7f70540fcd00 2023-12-06T14:59:45.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.019+0000 7f705af87700 1 -- 172.21.15.152:0/4244278251 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7040005040 con 0x7f70540fcd00 2023-12-06T14:59:45.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.019+0000 7f705af87700 1 -- 172.21.15.152:0/4244278251 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70541110e0 con 0x7f70540fcd00 2023-12-06T14:59:45.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.020+0000 7f70517fa700 1 -- 172.21.15.152:0/4244278251 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 22) v1 ==== 45377+0+0 (secure 0 0 0) 0x7f7040012820 con 0x7f70540fcd00 2023-12-06T14:59:45.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.020+0000 7f70517fa700 1 --2- 172.21.15.152:0/4244278251 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f7044038350 0x7f704403a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:45.024 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.020+0000 7f705af87700 1 -- 172.21.15.152:0/4244278251 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70540fae50 con 0x7f70540fcd00 2023-12-06T14:59:45.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.020+0000 7f70517fa700 1 -- 172.21.15.152:0/4244278251 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f704004d530 con 0x7f70540fcd00 2023-12-06T14:59:45.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.020+0000 7f7058d23700 1 --2- 172.21.15.152:0/4244278251 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f7044038350 0x7f704403a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:45.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.021+0000 7f7058d23700 1 --2- 172.21.15.152:0/4244278251 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f7044038350 0x7f704403a800 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f70540fcb60 tx=0x7f704800b040 comp rx=0 tx=0).ready entity=mgr.14612 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:59:45.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.025+0000 7f70517fa700 1 -- 172.21.15.152:0/4244278251 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f70400239a0 con 0x7f70540fcd00 2023-12-06T14:59:45.386 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.385+0000 7f705af87700 1 -- 172.21.15.152:0/4244278251 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f705404bb80 con 0x7f70540fcd00 2023-12-06T14:59:45.386 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.386+0000 7f70517fa700 1 -- 172.21.15.152:0/4244278251 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f704000c0c0 con 0x7f70540fcd00 2023-12-06T14:59:45.386 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-12-06T14:59:45.386 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": { 2023-12-06T14:59:45.386 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 2 2023-12-06T14:59:45.387 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T14:59:45.387 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": { 2023-12-06T14:59:45.387 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 1 2023-12-06T14:59:45.387 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T14:59:45.387 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": { 2023-12-06T14:59:45.387 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 6 2023-12-06T14:59:45.387 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T14:59:45.387 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2023-12-06T14:59:45.387 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 4 2023-12-06T14:59:45.387 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T14:59:45.387 INFO:teuthology.orchestra.run.smithi152.stdout: "overall": { 2023-12-06T14:59:45.387 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 12, 2023-12-06T14:59:45.387 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 1 2023-12-06T14:59:45.387 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-12-06T14:59:45.388 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-12-06T14:59:45.389 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.389+0000 7f705af87700 1 -- 172.21.15.152:0/4244278251 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f7044038350 msgr2=0x7f704403a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:45.389 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.389+0000 7f705af87700 1 --2- 172.21.15.152:0/4244278251 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f7044038350 0x7f704403a800 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f70540fcb60 tx=0x7f704800b040 comp rx=0 tx=0).stop 2023-12-06T14:59:45.390 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.389+0000 7f705af87700 1 -- 172.21.15.152:0/4244278251 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70540fcd00 msgr2=0x7f705410fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:45.390 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.389+0000 7f705af87700 1 --2- 172.21.15.152:0/4244278251 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70540fcd00 0x7f705410fc10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f70400134a0 tx=0x7f7040009e30 comp rx=0 tx=0).stop 2023-12-06T14:59:45.390 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.389+0000 7f705af87700 1 -- 172.21.15.152:0/4244278251 shutdown_connections 2023-12-06T14:59:45.390 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.389+0000 7f705af87700 1 --2- 172.21.15.152:0/4244278251 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f7044038350 0x7f704403a800 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:45.390 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.389+0000 7f705af87700 1 --2- 172.21.15.152:0/4244278251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f70540fbaf0 0x7f705410f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:45.390 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.389+0000 7f705af87700 1 --2- 172.21.15.152:0/4244278251 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70540fcd00 0x7f705410fc10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:45.390 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.389+0000 7f705af87700 1 -- 172.21.15.152:0/4244278251 >> 172.21.15.152:0/4244278251 conn(0x7f70540f7190 msgr2=0x7f7054065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:59:45.390 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.389+0000 7f705af87700 1 -- 172.21.15.152:0/4244278251 shutdown_connections 2023-12-06T14:59:45.390 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.389+0000 7f705af87700 1 -- 172.21.15.152:0/4244278251 wait complete. 2023-12-06T14:59:45.504 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.504+0000 7f06d826c700 1 -- 172.21.15.152:0/755726558 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06d00fd730 msgr2=0x7f06d00ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:45.505 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.504+0000 7f06d826c700 1 --2- 172.21.15.152:0/755726558 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06d00fd730 0x7f06d00ffb10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f06cc004940 tx=0x7f06cc009e30 comp rx=0 tx=0).stop 2023-12-06T14:59:45.505 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.504+0000 7f06d826c700 1 -- 172.21.15.152:0/755726558 shutdown_connections 2023-12-06T14:59:45.505 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.504+0000 7f06d826c700 1 --2- 172.21.15.152:0/755726558 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06d0100050 0x7f06d0102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:45.505 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.504+0000 7f06d826c700 1 --2- 172.21.15.152:0/755726558 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06d00fd730 0x7f06d00ffb10 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:45.505 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.504+0000 7f06d826c700 1 -- 172.21.15.152:0/755726558 >> 172.21.15.152:0/755726558 conn(0x7f06d00f7190 msgr2=0x7f06d00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:59:45.505 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.504+0000 7f06d826c700 1 -- 172.21.15.152:0/755726558 shutdown_connections 2023-12-06T14:59:45.505 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.504+0000 7f06d826c700 1 -- 172.21.15.152:0/755726558 wait complete. 2023-12-06T14:59:45.506 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.505+0000 7f06d826c700 1 Processor -- start 2023-12-06T14:59:45.506 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.505+0000 7f06d826c700 1 -- start start 2023-12-06T14:59:45.506 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.505+0000 7f06d826c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06d00fd730 0x7f06d00fd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:45.506 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.505+0000 7f06d826c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06d0100050 0x7f06d00fb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:45.506 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.505+0000 7f06d826c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d0111170 con 0x7f06d00fd730 2023-12-06T14:59:45.506 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.505+0000 7f06d826c700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d01112e0 con 0x7f06d0100050 2023-12-06T14:59:45.506 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.506+0000 7f06d5807700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06d0100050 0x7f06d00fb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:45.506 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.506+0000 7f06d5807700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06d0100050 0x7f06d00fb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.152:41200/0 (socket says 172.21.15.152:41200) 2023-12-06T14:59:45.506 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.506+0000 7f06d5807700 1 -- 172.21.15.152:0/3898330371 learned_addr learned my addr 172.21.15.152:0/3898330371 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:59:45.507 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.506+0000 7f06d5807700 1 -- 172.21.15.152:0/3898330371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06d00fd730 msgr2=0x7f06d00fd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:45.507 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.506+0000 7f06d5807700 1 --2- 172.21.15.152:0/3898330371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06d00fd730 0x7f06d00fd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:45.507 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.506+0000 7f06d5807700 1 -- 172.21.15.152:0/3898330371 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06cc005040 con 0x7f06d0100050 2023-12-06T14:59:45.507 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.507+0000 7f06d5807700 1 --2- 172.21.15.152:0/3898330371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06d0100050 0x7f06d00fb640 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f06c000eb40 tx=0x7f06c000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:59:45.510 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.509+0000 7f06c6ffd700 1 -- 172.21.15.152:0/3898330371 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06c0007cc0 con 0x7f06d0100050 2023-12-06T14:59:45.510 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.509+0000 7f06c6ffd700 1 -- 172.21.15.152:0/3898330371 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f06c000f040 con 0x7f06d0100050 2023-12-06T14:59:45.510 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.509+0000 7f06d826c700 1 -- 172.21.15.152:0/3898330371 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d00fbc40 con 0x7f06d0100050 2023-12-06T14:59:45.510 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.509+0000 7f06c6ffd700 1 -- 172.21.15.152:0/3898330371 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06c0009570 con 0x7f06d0100050 2023-12-06T14:59:45.510 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.509+0000 7f06d826c700 1 -- 172.21.15.152:0/3898330371 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d00fc180 con 0x7f06d0100050 2023-12-06T14:59:45.511 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.510+0000 7f06c6ffd700 1 -- 172.21.15.152:0/3898330371 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 23) v1 ==== 45673+0+0 (secure 0 0 0) 0x7f06c00096d0 con 0x7f06d0100050 2023-12-06T14:59:45.511 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.510+0000 7f06d826c700 1 -- 172.21.15.152:0/3898330371 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06d004bb80 con 0x7f06d0100050 2023-12-06T14:59:45.511 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.511+0000 7f06c6ffd700 1 --2- 172.21.15.152:0/3898330371 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f06bc038710 0x7f06bc03abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:45.511 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.511+0000 7f06c6ffd700 1 -- 172.21.15.152:0/3898330371 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f06c004bce0 con 0x7f06d0100050 2023-12-06T14:59:45.511 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.511+0000 7f06d6008700 1 --2- 172.21.15.152:0/3898330371 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f06bc038710 0x7f06bc03abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:45.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.511+0000 7f06d6008700 1 --2- 172.21.15.152:0/3898330371 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f06bc038710 0x7f06bc03abc0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f06cc004890 tx=0x7f06cc009e30 comp rx=0 tx=0).ready entity=mgr.14612 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:59:45.519 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.519+0000 7f06c6ffd700 1 -- 172.21.15.152:0/3898330371 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f06c001b2c0 con 0x7f06d0100050 2023-12-06T14:59:45.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.788+0000 7f06d826c700 1 -- 172.21.15.152:0/3898330371 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f06d00fc460 con 0x7f06d0100050 2023-12-06T14:59:45.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.789+0000 7f06c6ffd700 1 -- 172.21.15.152:0/3898330371 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1835 (secure 0 0 0) 0x7f06c0017120 con 0x7f06d0100050 2023-12-06T14:59:45.789 INFO:teuthology.orchestra.run.smithi152.stdout:e14 2023-12-06T14:59:45.789 INFO:teuthology.orchestra.run.smithi152.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-06T14:59:45.789 INFO:teuthology.orchestra.run.smithi152.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-06T14:59:45.789 INFO:teuthology.orchestra.run.smithi152.stdout:legacy client fscid: 1 2023-12-06T14:59:45.789 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:59:45.789 INFO:teuthology.orchestra.run.smithi152.stdout:Filesystem 'cephfs' (1) 2023-12-06T14:59:45.789 INFO:teuthology.orchestra.run.smithi152.stdout:fs_name cephfs 2023-12-06T14:59:45.789 INFO:teuthology.orchestra.run.smithi152.stdout:epoch 14 2023-12-06T14:59:45.790 INFO:teuthology.orchestra.run.smithi152.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-06T14:59:45.790 INFO:teuthology.orchestra.run.smithi152.stdout:created 2023-12-06T14:57:59.352201+0000 2023-12-06T14:59:45.790 INFO:teuthology.orchestra.run.smithi152.stdout:modified 2023-12-06T14:58:11.969272+0000 2023-12-06T14:59:45.790 INFO:teuthology.orchestra.run.smithi152.stdout:tableserver 0 2023-12-06T14:59:45.790 INFO:teuthology.orchestra.run.smithi152.stdout:root 0 2023-12-06T14:59:45.790 INFO:teuthology.orchestra.run.smithi152.stdout:session_timeout 60 2023-12-06T14:59:45.790 INFO:teuthology.orchestra.run.smithi152.stdout:session_autoclose 300 2023-12-06T14:59:45.790 INFO:teuthology.orchestra.run.smithi152.stdout:max_file_size 1099511627776 2023-12-06T14:59:45.790 INFO:teuthology.orchestra.run.smithi152.stdout:required_client_features {} 2023-12-06T14:59:45.790 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure 0 2023-12-06T14:59:45.790 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure_osd_epoch 0 2023-12-06T14:59:45.790 INFO:teuthology.orchestra.run.smithi152.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-06T14:59:45.791 INFO:teuthology.orchestra.run.smithi152.stdout:max_mds 2 2023-12-06T14:59:45.791 INFO:teuthology.orchestra.run.smithi152.stdout:in 0,1 2023-12-06T14:59:45.791 INFO:teuthology.orchestra.run.smithi152.stdout:up {0=14464,1=24255} 2023-12-06T14:59:45.791 INFO:teuthology.orchestra.run.smithi152.stdout:failed 2023-12-06T14:59:45.791 INFO:teuthology.orchestra.run.smithi152.stdout:damaged 2023-12-06T14:59:45.791 INFO:teuthology.orchestra.run.smithi152.stdout:stopped 2023-12-06T14:59:45.791 INFO:teuthology.orchestra.run.smithi152.stdout:data_pools [3] 2023-12-06T14:59:45.791 INFO:teuthology.orchestra.run.smithi152.stdout:metadata_pool 2 2023-12-06T14:59:45.791 INFO:teuthology.orchestra.run.smithi152.stdout:inline_data disabled 2023-12-06T14:59:45.791 INFO:teuthology.orchestra.run.smithi152.stdout:balancer 2023-12-06T14:59:45.791 INFO:teuthology.orchestra.run.smithi152.stdout:standby_count_wanted 1 2023-12-06T14:59:45.791 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.acqswy{0:14464} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.152:6826/2467413186,v1:172.21.15.152:6827/2467413186] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T14:59:45.791 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi190.edwtqj{0:24271} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.190:6826/2256465065,v1:172.21.15.190:6827/2256465065] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T14:59:45.792 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi190.uucxzu{1:24255} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.190:6824/3250692478,v1:172.21.15.190:6825/3250692478] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T14:59:45.792 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.ypivwc{1:14480} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.152:6828/697313573,v1:172.21.15.152:6829/697313573] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T14:59:45.792 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:59:45.792 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T14:59:45.793 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.791+0000 7f06d826c700 1 -- 172.21.15.152:0/3898330371 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f06bc038710 msgr2=0x7f06bc03abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:45.793 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.791+0000 7f06d826c700 1 --2- 172.21.15.152:0/3898330371 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f06bc038710 0x7f06bc03abc0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f06cc004890 tx=0x7f06cc009e30 comp rx=0 tx=0).stop 2023-12-06T14:59:45.793 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.791+0000 7f06d826c700 1 -- 172.21.15.152:0/3898330371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06d0100050 msgr2=0x7f06d00fb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:45.793 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.791+0000 7f06d826c700 1 --2- 172.21.15.152:0/3898330371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06d0100050 0x7f06d00fb640 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f06c000eb40 tx=0x7f06c000b040 comp rx=0 tx=0).stop 2023-12-06T14:59:45.793 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.792+0000 7f06d826c700 1 -- 172.21.15.152:0/3898330371 shutdown_connections 2023-12-06T14:59:45.793 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.792+0000 7f06d826c700 1 --2- 172.21.15.152:0/3898330371 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f06bc038710 0x7f06bc03abc0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:45.793 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.792+0000 7f06d826c700 1 --2- 172.21.15.152:0/3898330371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06d00fd730 0x7f06d00fd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:45.793 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.792+0000 7f06d826c700 1 --2- 172.21.15.152:0/3898330371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06d0100050 0x7f06d00fb640 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:45.793 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.792+0000 7f06d826c700 1 -- 172.21.15.152:0/3898330371 >> 172.21.15.152:0/3898330371 conn(0x7f06d00f7190 msgr2=0x7f06d00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:59:45.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.792+0000 7f06d826c700 1 -- 172.21.15.152:0/3898330371 shutdown_connections 2023-12-06T14:59:45.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.792+0000 7f06d826c700 1 -- 172.21.15.152:0/3898330371 wait complete. 2023-12-06T14:59:45.794 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 14 2023-12-06T14:59:45.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:45 smithi190 ceph-mon[121340]: [06/Dec/2023:14:59:43] ENGINE Bus STARTING 2023-12-06T14:59:45.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:45 smithi190 ceph-mon[121340]: [06/Dec/2023:14:59:43] ENGINE Serving on http://172.21.15.190:8765 2023-12-06T14:59:45.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:45 smithi190 ceph-mon[121340]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:59:45.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:45 smithi190 ceph-mon[121340]: [06/Dec/2023:14:59:44] ENGINE Serving on https://172.21.15.190:7150 2023-12-06T14:59:45.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:45 smithi190 ceph-mon[121340]: [06/Dec/2023:14:59:44] ENGINE Bus STARTED 2023-12-06T14:59:45.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:45 smithi190 ceph-mon[121340]: from='client.24393 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:59:45.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:45 smithi190 ceph-mon[121340]: pgmap v4: 65 pgs: 65 active+clean; 4.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:59:45.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:45 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/4244278251' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T14:59:45.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:45 smithi152 ceph-mon[111954]: [06/Dec/2023:14:59:43] ENGINE Bus STARTING 2023-12-06T14:59:45.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:45 smithi152 ceph-mon[111954]: [06/Dec/2023:14:59:43] ENGINE Serving on http://172.21.15.190:8765 2023-12-06T14:59:45.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:45 smithi152 ceph-mon[111954]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:59:45.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:45 smithi152 ceph-mon[111954]: [06/Dec/2023:14:59:44] ENGINE Serving on https://172.21.15.190:7150 2023-12-06T14:59:45.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:45 smithi152 ceph-mon[111954]: [06/Dec/2023:14:59:44] ENGINE Bus STARTED 2023-12-06T14:59:45.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:45 smithi152 ceph-mon[111954]: from='client.24393 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:59:45.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:45 smithi152 ceph-mon[111954]: pgmap v4: 65 pgs: 65 active+clean; 4.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:59:45.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:45 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/4244278251' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T14:59:45.924 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.924+0000 7fa0e09a4700 1 -- 172.21.15.152:0/3185917665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0dc0fbe10 msgr2=0x7fa0dc0fc280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:45.924 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.924+0000 7fa0e09a4700 1 --2- 172.21.15.152:0/3185917665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0dc0fbe10 0x7fa0dc0fc280 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0004940 tx=0x7fa0d0009e30 comp rx=0 tx=0).stop 2023-12-06T14:59:45.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.924+0000 7fa0e09a4700 1 -- 172.21.15.152:0/3185917665 shutdown_connections 2023-12-06T14:59:45.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.924+0000 7fa0e09a4700 1 --2- 172.21.15.152:0/3185917665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0dc0fbe10 0x7fa0dc0fc280 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:45.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.924+0000 7fa0e09a4700 1 --2- 172.21.15.152:0/3185917665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0dc0fd190 0x7fa0dc0fd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:45.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.924+0000 7fa0e09a4700 1 -- 172.21.15.152:0/3185917665 >> 172.21.15.152:0/3185917665 conn(0x7fa0dc0f6950 msgr2=0x7fa0dc0f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:59:45.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.924+0000 7fa0e09a4700 1 -- 172.21.15.152:0/3185917665 shutdown_connections 2023-12-06T14:59:45.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.924+0000 7fa0e09a4700 1 -- 172.21.15.152:0/3185917665 wait complete. 2023-12-06T14:59:45.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.924+0000 7fa0e09a4700 1 Processor -- start 2023-12-06T14:59:45.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.924+0000 7fa0e09a4700 1 -- start start 2023-12-06T14:59:45.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.924+0000 7fa0e09a4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0dc0fbe10 0x7fa0dc10e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:45.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.925+0000 7fa0e09a4700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0dc0fd190 0x7fa0dc110570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:45.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.925+0000 7fa0e09a4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc0fbaa0 con 0x7fa0dc0fbe10 2023-12-06T14:59:45.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.925+0000 7fa0e09a4700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc0fbbe0 con 0x7fa0dc0fd190 2023-12-06T14:59:45.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.925+0000 7fa0da59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0dc0fbe10 0x7fa0dc10e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:45.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.925+0000 7fa0da59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0dc0fbe10 0x7fa0dc10e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:42662/0 (socket says 172.21.15.152:42662) 2023-12-06T14:59:45.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.925+0000 7fa0da59c700 1 -- 172.21.15.152:0/987704354 learned_addr learned my addr 172.21.15.152:0/987704354 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:59:45.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.925+0000 7fa0d9d9b700 1 --2- 172.21.15.152:0/987704354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0dc0fd190 0x7fa0dc110570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:45.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.925+0000 7fa0d9d9b700 1 -- 172.21.15.152:0/987704354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0dc0fbe10 msgr2=0x7fa0dc10e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:45.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.925+0000 7fa0d9d9b700 1 --2- 172.21.15.152:0/987704354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0dc0fbe10 0x7fa0dc10e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:45.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.925+0000 7fa0d9d9b700 1 -- 172.21.15.152:0/987704354 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d0005040 con 0x7fa0dc0fd190 2023-12-06T14:59:45.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.925+0000 7fa0da59c700 1 --2- 172.21.15.152:0/987704354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0dc0fbe10 0x7fa0dc10e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-06T14:59:45.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.925+0000 7fa0d9d9b700 1 --2- 172.21.15.152:0/987704354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0dc0fd190 0x7fa0dc110570 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa0d000b0d0 tx=0x7fa0d0009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:59:45.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.925+0000 7fa0caffd700 1 -- 172.21.15.152:0/987704354 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0d000e070 con 0x7fa0dc0fd190 2023-12-06T14:59:45.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.925+0000 7fa0caffd700 1 -- 172.21.15.152:0/987704354 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa0d001c400 con 0x7fa0dc0fd190 2023-12-06T14:59:45.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.925+0000 7fa0caffd700 1 -- 172.21.15.152:0/987704354 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0d000b650 con 0x7fa0dc0fd190 2023-12-06T14:59:45.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.926+0000 7fa0e09a4700 1 -- 172.21.15.152:0/987704354 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0dc110b10 con 0x7fa0dc0fd190 2023-12-06T14:59:45.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.926+0000 7fa0e09a4700 1 -- 172.21.15.152:0/987704354 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0dc110fd0 con 0x7fa0dc0fd190 2023-12-06T14:59:45.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.927+0000 7fa0e09a4700 1 -- 172.21.15.152:0/987704354 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0dc04bb80 con 0x7fa0dc0fd190 2023-12-06T14:59:45.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.927+0000 7fa0caffd700 1 -- 172.21.15.152:0/987704354 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 23) v1 ==== 45673+0+0 (secure 0 0 0) 0x7fa0d001c9e0 con 0x7fa0dc0fd190 2023-12-06T14:59:45.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.927+0000 7fa0caffd700 1 --2- 172.21.15.152:0/987704354 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7fa0c40386e0 0x7fa0c403ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:45.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.928+0000 7fa0caffd700 1 -- 172.21.15.152:0/987704354 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fa0d004d6a0 con 0x7fa0dc0fd190 2023-12-06T14:59:45.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.928+0000 7fa0da59c700 1 --2- 172.21.15.152:0/987704354 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7fa0c40386e0 0x7fa0c403ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:45.929 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.928+0000 7fa0da59c700 1 --2- 172.21.15.152:0/987704354 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7fa0c40386e0 0x7fa0c403ab90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc004fd0 tx=0x7fa0cc00b040 comp rx=0 tx=0).ready entity=mgr.14612 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:59:45.932 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:45.933+0000 7fa0caffd700 1 -- 172.21.15.152:0/987704354 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fa0d0024b50 con 0x7fa0dc0fd190 2023-12-06T14:59:46.294 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.294+0000 7fa0e09a4700 1 -- 172.21.15.152:0/987704354 --> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa0dc101770 con 0x7fa0c40386e0 2023-12-06T14:59:46.305 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.305+0000 7fa0caffd700 1 -- 172.21.15.152:0/987704354 <== mgr.14612 v2:172.21.15.190:6828/3047155534 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fa0dc101770 con 0x7fa0c40386e0 2023-12-06T14:59:46.305 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-12-06T14:59:46.305 INFO:teuthology.orchestra.run.smithi152.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e331a81036b9c4be9167bdaf54e458c7294ca3446212b9c6126786d23318b1cf", 2023-12-06T14:59:46.305 INFO:teuthology.orchestra.run.smithi152.stdout: "in_progress": true, 2023-12-06T14:59:46.305 INFO:teuthology.orchestra.run.smithi152.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-06T14:59:46.306 INFO:teuthology.orchestra.run.smithi152.stdout: "services_complete": [], 2023-12-06T14:59:46.306 INFO:teuthology.orchestra.run.smithi152.stdout: "progress": "1/21 daemons upgraded", 2023-12-06T14:59:46.306 INFO:teuthology.orchestra.run.smithi152.stdout: "message": "", 2023-12-06T14:59:46.306 INFO:teuthology.orchestra.run.smithi152.stdout: "is_paused": false 2023-12-06T14:59:46.306 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-12-06T14:59:46.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.308+0000 7fa0e09a4700 1 -- 172.21.15.152:0/987704354 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7fa0c40386e0 msgr2=0x7fa0c403ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:46.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.308+0000 7fa0e09a4700 1 --2- 172.21.15.152:0/987704354 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7fa0c40386e0 0x7fa0c403ab90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc004fd0 tx=0x7fa0cc00b040 comp rx=0 tx=0).stop 2023-12-06T14:59:46.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.308+0000 7fa0e09a4700 1 -- 172.21.15.152:0/987704354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0dc0fd190 msgr2=0x7fa0dc110570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:46.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.308+0000 7fa0e09a4700 1 --2- 172.21.15.152:0/987704354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0dc0fd190 0x7fa0dc110570 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa0d000b0d0 tx=0x7fa0d0009e30 comp rx=0 tx=0).stop 2023-12-06T14:59:46.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.309+0000 7fa0e09a4700 1 -- 172.21.15.152:0/987704354 shutdown_connections 2023-12-06T14:59:46.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.309+0000 7fa0e09a4700 1 --2- 172.21.15.152:0/987704354 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7fa0c40386e0 0x7fa0c403ab90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:46.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.309+0000 7fa0e09a4700 1 --2- 172.21.15.152:0/987704354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa0dc0fbe10 0x7fa0dc10e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:46.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.309+0000 7fa0e09a4700 1 --2- 172.21.15.152:0/987704354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0dc0fd190 0x7fa0dc110570 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:46.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.309+0000 7fa0e09a4700 1 -- 172.21.15.152:0/987704354 >> 172.21.15.152:0/987704354 conn(0x7fa0dc0f6950 msgr2=0x7fa0dc100050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:59:46.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.309+0000 7fa0e09a4700 1 -- 172.21.15.152:0/987704354 shutdown_connections 2023-12-06T14:59:46.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.309+0000 7fa0e09a4700 1 -- 172.21.15.152:0/987704354 wait complete. 2023-12-06T14:59:46.422 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.422+0000 7fd026bc9700 1 -- 172.21.15.152:0/802659938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0200fbaf0 msgr2=0x7fd0200fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:46.422 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.422+0000 7fd026bc9700 1 --2- 172.21.15.152:0/802659938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0200fbaf0 0x7fd0200fbf00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd014004880 tx=0x7fd014009e30 comp rx=0 tx=0).stop 2023-12-06T14:59:46.423 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.422+0000 7fd026bc9700 1 -- 172.21.15.152:0/802659938 shutdown_connections 2023-12-06T14:59:46.423 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.422+0000 7fd026bc9700 1 --2- 172.21.15.152:0/802659938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0200fcd00 0x7fd0200fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:46.423 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.422+0000 7fd026bc9700 1 --2- 172.21.15.152:0/802659938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0200fbaf0 0x7fd0200fbf00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:46.423 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.422+0000 7fd026bc9700 1 -- 172.21.15.152:0/802659938 >> 172.21.15.152:0/802659938 conn(0x7fd0200f7190 msgr2=0x7fd0200f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:59:46.423 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.422+0000 7fd026bc9700 1 -- 172.21.15.152:0/802659938 shutdown_connections 2023-12-06T14:59:46.423 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.422+0000 7fd026bc9700 1 -- 172.21.15.152:0/802659938 wait complete. 2023-12-06T14:59:46.423 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.422+0000 7fd026bc9700 1 Processor -- start 2023-12-06T14:59:46.423 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.422+0000 7fd026bc9700 1 -- start start 2023-12-06T14:59:46.425 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.423+0000 7fd026bc9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0200fbaf0 0x7fd02010d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:46.425 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.423+0000 7fd026bc9700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0200fcd00 0x7fd02010da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:46.425 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.423+0000 7fd026bc9700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd02010e000 con 0x7fd0200fbaf0 2023-12-06T14:59:46.425 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.423+0000 7fd026bc9700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd02010e8a0 con 0x7fd0200fcd00 2023-12-06T14:59:46.425 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.423+0000 7fd01ffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0200fcd00 0x7fd02010da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:46.425 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.423+0000 7fd01ffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0200fcd00 0x7fd02010da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.152:41246/0 (socket says 172.21.15.152:41246) 2023-12-06T14:59:46.425 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.423+0000 7fd01ffff700 1 -- 172.21.15.152:0/3193438936 learned_addr learned my addr 172.21.15.152:0/3193438936 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T14:59:46.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.423+0000 7fd01ffff700 1 -- 172.21.15.152:0/3193438936 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0200fbaf0 msgr2=0x7fd02010d4c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-06T14:59:46.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.423+0000 7fd01ffff700 1 --2- 172.21.15.152:0/3193438936 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0200fbaf0 0x7fd02010d4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:46.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.423+0000 7fd01ffff700 1 -- 172.21.15.152:0/3193438936 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd00c005040 con 0x7fd0200fcd00 2023-12-06T14:59:46.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.423+0000 7fd01ffff700 1 --2- 172.21.15.152:0/3193438936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0200fcd00 0x7fd02010da00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd00c0096b0 tx=0x7fd00c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:59:46.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.424+0000 7fd01d7fa700 1 -- 172.21.15.152:0/3193438936 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd00c017070 con 0x7fd0200fcd00 2023-12-06T14:59:46.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.424+0000 7fd01d7fa700 1 -- 172.21.15.152:0/3193438936 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd00c00f040 con 0x7fd0200fcd00 2023-12-06T14:59:46.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.424+0000 7fd026bc9700 1 -- 172.21.15.152:0/3193438936 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd014005040 con 0x7fd0200fcd00 2023-12-06T14:59:46.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.424+0000 7fd026bc9700 1 -- 172.21.15.152:0/3193438936 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd02010eed0 con 0x7fd0200fcd00 2023-12-06T14:59:46.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.424+0000 7fd01d7fa700 1 -- 172.21.15.152:0/3193438936 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd00c013b70 con 0x7fd0200fcd00 2023-12-06T14:59:46.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.425+0000 7fd01d7fa700 1 -- 172.21.15.152:0/3193438936 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 23) v1 ==== 45673+0+0 (secure 0 0 0) 0x7fd00c01c410 con 0x7fd0200fcd00 2023-12-06T14:59:46.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.425+0000 7fd026bc9700 1 -- 172.21.15.152:0/3193438936 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0040052e0 con 0x7fd0200fcd00 2023-12-06T14:59:46.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.425+0000 7fd01d7fa700 1 --2- 172.21.15.152:0/3193438936 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7fd0100386e0 0x7fd01003ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T14:59:46.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.425+0000 7fd01d7fa700 1 -- 172.21.15.152:0/3193438936 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fd00c04bdb0 con 0x7fd0200fcd00 2023-12-06T14:59:46.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.425+0000 7fd024965700 1 --2- 172.21.15.152:0/3193438936 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7fd0100386e0 0x7fd01003ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T14:59:46.427 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.426+0000 7fd024965700 1 --2- 172.21.15.152:0/3193438936 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7fd0100386e0 0x7fd01003ab90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd014009fd0 tx=0x7fd014009e30 comp rx=0 tx=0).ready entity=mgr.14612 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T14:59:46.430 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.430+0000 7fd01d7fa700 1 -- 172.21.15.152:0/3193438936 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fd00c0198b0 con 0x7fd0200fcd00 2023-12-06T14:59:46.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:46 smithi190 ceph-mon[121340]: from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:59:46.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:46 smithi190 ceph-mon[121340]: mgrmap e23: smithi190.ubusrr(active, since 3s) 2023-12-06T14:59:46.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:46 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/3898330371' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-06T14:59:46.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:46 smithi152 ceph-mon[111954]: from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:59:46.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:46 smithi152 ceph-mon[111954]: mgrmap e23: smithi190.ubusrr(active, since 3s) 2023-12-06T14:59:46.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:46 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/3898330371' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-06T14:59:46.931 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.929+0000 7fd026bc9700 1 -- 172.21.15.152:0/3193438936 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd004005860 con 0x7fd0200fcd00 2023-12-06T14:59:46.933 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.933+0000 7fd01d7fa700 1 -- 172.21.15.152:0/3193438936 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fd00c0192c0 con 0x7fd0200fcd00 2023-12-06T14:59:46.934 INFO:teuthology.orchestra.run.smithi152.stdout:HEALTH_OK 2023-12-06T14:59:46.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.947+0000 7fd026bc9700 1 -- 172.21.15.152:0/3193438936 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7fd0100386e0 msgr2=0x7fd01003ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:46.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.947+0000 7fd026bc9700 1 --2- 172.21.15.152:0/3193438936 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7fd0100386e0 0x7fd01003ab90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd014009fd0 tx=0x7fd014009e30 comp rx=0 tx=0).stop 2023-12-06T14:59:46.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.947+0000 7fd026bc9700 1 -- 172.21.15.152:0/3193438936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0200fcd00 msgr2=0x7fd02010da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T14:59:46.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.947+0000 7fd026bc9700 1 --2- 172.21.15.152:0/3193438936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0200fcd00 0x7fd02010da00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd00c0096b0 tx=0x7fd00c009e30 comp rx=0 tx=0).stop 2023-12-06T14:59:46.953 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.952+0000 7fd026bc9700 1 -- 172.21.15.152:0/3193438936 shutdown_connections 2023-12-06T14:59:46.953 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.952+0000 7fd026bc9700 1 --2- 172.21.15.152:0/3193438936 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7fd0100386e0 0x7fd01003ab90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:46.953 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.952+0000 7fd026bc9700 1 --2- 172.21.15.152:0/3193438936 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0200fbaf0 0x7fd02010d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:46.953 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.952+0000 7fd026bc9700 1 --2- 172.21.15.152:0/3193438936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0200fcd00 0x7fd02010da00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T14:59:46.953 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.952+0000 7fd026bc9700 1 -- 172.21.15.152:0/3193438936 >> 172.21.15.152:0/3193438936 conn(0x7fd0200f7190 msgr2=0x7fd0200fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T14:59:46.961 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.961+0000 7fd026bc9700 1 -- 172.21.15.152:0/3193438936 shutdown_connections 2023-12-06T14:59:46.961 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T14:59:46.961+0000 7fd026bc9700 1 -- 172.21.15.152:0/3193438936 wait complete. 2023-12-06T14:59:47.631 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:47 smithi152 ceph-mon[111954]: from='client.24413 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:59:47.631 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:47 smithi152 ceph-mon[111954]: pgmap v5: 65 pgs: 65 active+clean; 4.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:59:47.631 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:47 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/3193438936' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-06T14:59:47.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:47 smithi190 ceph-mon[121340]: from='client.24413 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T14:59:47.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:47 smithi190 ceph-mon[121340]: pgmap v5: 65 pgs: 65 active+clean; 4.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2023-12-06T14:59:47.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:47 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/3193438936' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-06T14:59:48.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:48 smithi152 ceph-mon[111954]: mgrmap e24: smithi190.ubusrr(active, since 5s) 2023-12-06T14:59:48.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:48 smithi190 ceph-mon[121340]: mgrmap e24: smithi190.ubusrr(active, since 5s) 2023-12-06T14:59:49.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:49 smithi190 ceph-mon[121340]: pgmap v6: 65 pgs: 65 active+clean; 25 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 4.2 MiB/s wr, 396 op/s 2023-12-06T14:59:49.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:49 smithi190 ceph-mon[121340]: Standby manager daemon smithi152.meodco started 2023-12-06T14:59:49.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:49 smithi190 ceph-mon[121340]: from='mgr.? 172.21.15.152:0/1148449172' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.meodco/crt"}]: dispatch 2023-12-06T14:59:49.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:49 smithi190 ceph-mon[121340]: from='mgr.? 172.21.15.152:0/1148449172' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-06T14:59:49.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:49 smithi190 ceph-mon[121340]: from='mgr.? 172.21.15.152:0/1148449172' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.meodco/key"}]: dispatch 2023-12-06T14:59:49.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:49 smithi190 ceph-mon[121340]: from='mgr.? 172.21.15.152:0/1148449172' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-06T14:59:49.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:49 smithi152 ceph-mon[111954]: pgmap v6: 65 pgs: 65 active+clean; 25 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 4.2 MiB/s wr, 396 op/s 2023-12-06T14:59:49.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:49 smithi152 ceph-mon[111954]: Standby manager daemon smithi152.meodco started 2023-12-06T14:59:49.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:49 smithi152 ceph-mon[111954]: from='mgr.? 172.21.15.152:0/1148449172' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.meodco/crt"}]: dispatch 2023-12-06T14:59:49.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:49 smithi152 ceph-mon[111954]: from='mgr.? 172.21.15.152:0/1148449172' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-06T14:59:49.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:49 smithi152 ceph-mon[111954]: from='mgr.? 172.21.15.152:0/1148449172' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.meodco/key"}]: dispatch 2023-12-06T14:59:49.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:49 smithi152 ceph-mon[111954]: from='mgr.? 172.21.15.152:0/1148449172' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-06T14:59:50.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:50 smithi190 ceph-mon[121340]: mgrmap e25: smithi190.ubusrr(active, since 7s), standbys: smithi152.meodco 2023-12-06T14:59:50.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:50 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "mgr metadata", "who": "smithi152.meodco", "id": "smithi152.meodco"}]: dispatch 2023-12-06T14:59:50.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:50 smithi152 ceph-mon[111954]: mgrmap e25: smithi190.ubusrr(active, since 7s), standbys: smithi152.meodco 2023-12-06T14:59:50.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:50 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "mgr metadata", "who": "smithi152.meodco", "id": "smithi152.meodco"}]: dispatch 2023-12-06T14:59:51.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:51 smithi152 ceph-mon[111954]: pgmap v7: 65 pgs: 65 active+clean; 54 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 7.5 MiB/s wr, 728 op/s 2023-12-06T14:59:51.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:51 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:51.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:51 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:51.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:51 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:51.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:51 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:51.967 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:51 smithi190 ceph-mon[121340]: pgmap v7: 65 pgs: 65 active+clean; 54 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 7.5 MiB/s wr, 728 op/s 2023-12-06T14:59:51.967 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:51 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:51.967 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:51 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:51.967 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:51 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:51.967 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:51 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:53.550 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:53 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:53.550 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:53 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:53.550 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:53 smithi190 ceph-mon[121340]: fsmap cephfs:2 {0=cephfs.smithi152.acqswy=up:active,1=cephfs.smithi190.uucxzu=up:active} 2 up:standby-replay 2023-12-06T14:59:53.550 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:53 smithi190 ceph-mon[121340]: pgmap v8: 65 pgs: 65 active+clean; 54 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 5.8 MiB/s wr, 566 op/s 2023-12-06T14:59:53.550 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:53 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:53.551 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:53 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:53.551 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:53 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:59:53.551 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:53 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:59:53.551 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:53 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:59:53.551 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:53 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:59:53.551 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:53 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:59:53.551 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:53 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:59:53.551 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:53 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:53.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:53 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:53.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:53 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:53.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:53 smithi152 ceph-mon[111954]: fsmap cephfs:2 {0=cephfs.smithi152.acqswy=up:active,1=cephfs.smithi190.uucxzu=up:active} 2 up:standby-replay 2023-12-06T14:59:53.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:53 smithi152 ceph-mon[111954]: pgmap v8: 65 pgs: 65 active+clean; 54 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 5.8 MiB/s wr, 566 op/s 2023-12-06T14:59:53.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:53 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:53.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:53 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:53.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:53 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:59:53.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:53 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:59:53.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:53 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:59:53.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:53 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:59:53.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:53 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:59:53.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:53 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:59:53.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:53 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:54.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:54 smithi190 ceph-mon[121340]: Adjusting osd_memory_target on smithi152 to 1568M 2023-12-06T14:59:54.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:54 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:54.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:54 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:54.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:54 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:59:54.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:54 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:59:54.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:54 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:59:54.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:54 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:59:54.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:54 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:59:54.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:54 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:59:54.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:54 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:54.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:54 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:59:54.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:54 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:59:54.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:54 smithi152 ceph-mon[111954]: Adjusting osd_memory_target on smithi152 to 1568M 2023-12-06T14:59:54.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:54 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:54.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:54 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:54.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:54 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:59:54.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:54 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:59:54.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:54 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:59:54.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:54 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:59:54.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:54 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:59:54.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:54 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-06T14:59:54.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:54 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:54.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:54 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T14:59:54.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:54 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T14:59:55.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:55 smithi152 ceph-mon[111954]: Adjusting osd_memory_target on smithi190 to 2592M 2023-12-06T14:59:55.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:55 smithi152 ceph-mon[111954]: Updating smithi152:/etc/ceph/ceph.conf 2023-12-06T14:59:55.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:55 smithi152 ceph-mon[111954]: Updating smithi190:/etc/ceph/ceph.conf 2023-12-06T14:59:55.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:55 smithi152 ceph-mon[111954]: Updating smithi190:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-06T14:59:55.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:55 smithi152 ceph-mon[111954]: Updating smithi152:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-06T14:59:55.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:55 smithi152 ceph-mon[111954]: pgmap v9: 65 pgs: 65 active+clean; 69 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 6.1 MiB/s wr, 485 op/s 2023-12-06T14:59:55.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:55 smithi152 ceph-mon[111954]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2023-12-06T14:59:55.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:55 smithi152 ceph-mon[111954]: Updating smithi190:/etc/ceph/ceph.client.admin.keyring 2023-12-06T14:59:55.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:55 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:55.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:55 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:55.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:55 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:55.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:55 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:55.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:55 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:55.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:55 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:55.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:55 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:55.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:55 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:55.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:55 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:55.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:55 smithi190 ceph-mon[121340]: Adjusting osd_memory_target on smithi190 to 2592M 2023-12-06T14:59:55.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:55 smithi190 ceph-mon[121340]: Updating smithi152:/etc/ceph/ceph.conf 2023-12-06T14:59:55.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:55 smithi190 ceph-mon[121340]: Updating smithi190:/etc/ceph/ceph.conf 2023-12-06T14:59:55.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:55 smithi190 ceph-mon[121340]: Updating smithi190:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-06T14:59:55.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:55 smithi190 ceph-mon[121340]: Updating smithi152:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-06T14:59:55.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:55 smithi190 ceph-mon[121340]: pgmap v9: 65 pgs: 65 active+clean; 69 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 2.5 MiB/s rd, 6.1 MiB/s wr, 485 op/s 2023-12-06T14:59:55.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:55 smithi190 ceph-mon[121340]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2023-12-06T14:59:55.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:55 smithi190 ceph-mon[121340]: Updating smithi190:/etc/ceph/ceph.client.admin.keyring 2023-12-06T14:59:55.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:55 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:55.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:55 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:55.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:55 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:55.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:55 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:55.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:55 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:55.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:55 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:55.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:55 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:55.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:55 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:55.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:55 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:56.585 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:56 smithi152 ceph-mon[111954]: Updating smithi152:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-06T14:59:56.585 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:56 smithi152 ceph-mon[111954]: Updating smithi190:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-06T14:59:56.585 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:56 smithi152 ceph-mon[111954]: Reconfiguring node-exporter.smithi152 (dependencies changed)... 2023-12-06T14:59:56.585 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:56 smithi152 ceph-mon[111954]: Reconfiguring daemon node-exporter.smithi152 on smithi152 2023-12-06T14:59:56.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:56 smithi190 ceph-mon[121340]: Updating smithi152:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-06T14:59:56.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:56 smithi190 ceph-mon[121340]: Updating smithi190:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-06T14:59:56.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:56 smithi190 ceph-mon[121340]: Reconfiguring node-exporter.smithi152 (dependencies changed)... 2023-12-06T14:59:56.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:56 smithi190 ceph-mon[121340]: Reconfiguring daemon node-exporter.smithi152 on smithi152 2023-12-06T14:59:57.755 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:57 smithi152 ceph-mon[111954]: pgmap v10: 65 pgs: 65 active+clean; 69 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 5.6 MiB/s wr, 444 op/s 2023-12-06T14:59:57.755 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:57 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:57.755 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:57 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:57.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:57 smithi190 ceph-mon[121340]: pgmap v10: 65 pgs: 65 active+clean; 69 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 5.6 MiB/s wr, 444 op/s 2023-12-06T14:59:57.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:57 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:57.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:57 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T14:59:58.668 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:58 smithi152 ceph-mon[111954]: Reconfiguring alertmanager.smithi152 (dependencies changed)... 2023-12-06T14:59:58.668 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:58 smithi152 ceph-mon[111954]: Reconfiguring daemon alertmanager.smithi152 on smithi152 2023-12-06T14:59:58.668 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:58 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:59:58.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:58 smithi190 ceph-mon[121340]: Reconfiguring alertmanager.smithi152 (dependencies changed)... 2023-12-06T14:59:58.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:58 smithi190 ceph-mon[121340]: Reconfiguring daemon alertmanager.smithi152 on smithi152 2023-12-06T14:59:58.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:58 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T14:59:59.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 14:59:59 smithi190 ceph-mon[121340]: pgmap v11: 65 pgs: 65 active+clean; 86 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.9 MiB/s rd, 7.1 MiB/s wr, 601 op/s 2023-12-06T14:59:59.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 14:59:59 smithi152 ceph-mon[111954]: pgmap v11: 65 pgs: 65 active+clean; 86 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.9 MiB/s rd, 7.1 MiB/s wr, 601 op/s 2023-12-06T15:00:00.987 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:00 smithi152 ceph-mon[111954]: overall HEALTH_OK 2023-12-06T15:00:00.988 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:00 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:00.988 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:00 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:00.988 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:00 smithi152 ceph-mon[111954]: Reconfiguring grafana.smithi152 (dependencies changed)... 2023-12-06T15:00:00.988 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:00 smithi152 ceph-mon[111954]: Reconfiguring daemon grafana.smithi152 on smithi152 2023-12-06T15:00:00.988 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:00 smithi152 ceph-mon[111954]: pgmap v12: 65 pgs: 65 active+clean; 107 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 7.3 MiB/s wr, 694 op/s 2023-12-06T15:00:01.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:00 smithi190 ceph-mon[121340]: overall HEALTH_OK 2023-12-06T15:00:01.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:00 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:01.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:00 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:01.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:00 smithi190 ceph-mon[121340]: Reconfiguring grafana.smithi152 (dependencies changed)... 2023-12-06T15:00:01.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:00 smithi190 ceph-mon[121340]: Reconfiguring daemon grafana.smithi152 on smithi152 2023-12-06T15:00:01.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:00 smithi190 ceph-mon[121340]: pgmap v12: 65 pgs: 65 active+clean; 107 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 7.3 MiB/s wr, 694 op/s 2023-12-06T15:00:02.696 INFO:tasks.workunit.client.0.smithi152.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2023-12-06T15:00:02.699 INFO:tasks.workunit.client.0.smithi152.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-06T15:00:02.699 INFO:tasks.workunit.client.0.smithi152.stderr:+ make 2023-12-06T15:00:02.797 INFO:tasks.workunit.client.0.smithi152.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2023-12-06T15:00:03.076 INFO:tasks.workunit.client.0.smithi152.stderr:++ readlink -f fsstress 2023-12-06T15:00:03.077 INFO:tasks.workunit.client.0.smithi152.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2023-12-06T15:00:03.077 INFO:tasks.workunit.client.0.smithi152.stderr:+ popd 2023-12-06T15:00:03.078 INFO:tasks.workunit.client.0.smithi152.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2023-12-06T15:00:03.078 INFO:tasks.workunit.client.0.smithi152.stderr:+ popd 2023-12-06T15:00:03.079 INFO:tasks.workunit.client.0.smithi152.stdout:~/cephtest/mnt.0/client.0/tmp 2023-12-06T15:00:03.079 INFO:tasks.workunit.client.0.smithi152.stderr:++ mktemp -d -p . 2023-12-06T15:00:03.080 INFO:tasks.workunit.client.0.smithi152.stderr:+ T=./tmp.3iFOkx2sIG 2023-12-06T15:00:03.080 INFO:tasks.workunit.client.0.smithi152.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.3iFOkx2sIG -l 1 -n 1000 -p 10 -v 2023-12-06T15:00:03.082 INFO:tasks.workunit.client.0.smithi152.stdout:seed = 1701956201 2023-12-06T15:00:03.085 INFO:tasks.workunit.client.0.smithi152.stdout:0/0: write - no filename 2023-12-06T15:00:03.085 INFO:tasks.workunit.client.0.smithi152.stdout:0/1: fsync - no filename 2023-12-06T15:00:03.085 INFO:tasks.workunit.client.0.smithi152.stdout:0/2: chown . 814711193 1 2023-12-06T15:00:03.085 INFO:tasks.workunit.client.0.smithi152.stdout:0/3: readlink - no filename 2023-12-06T15:00:03.086 INFO:tasks.workunit.client.0.smithi152.stdout:0/4: dwrite - no filename 2023-12-06T15:00:03.086 INFO:tasks.workunit.client.0.smithi152.stdout:0/5: dwrite - no filename 2023-12-06T15:00:03.086 INFO:tasks.workunit.client.0.smithi152.stdout:0/6: write - no filename 2023-12-06T15:00:03.086 INFO:tasks.workunit.client.0.smithi152.stdout:0/7: dread - no filename 2023-12-06T15:00:03.087 INFO:tasks.workunit.client.0.smithi152.stdout:0/8: mknod c0 0 2023-12-06T15:00:03.087 INFO:tasks.workunit.client.0.smithi152.stdout:0/9: chown c0 5617 1 2023-12-06T15:00:03.087 INFO:tasks.workunit.client.0.smithi152.stdout:0/10: readlink - no filename 2023-12-06T15:00:03.087 INFO:tasks.workunit.client.0.smithi152.stdout:0/11: fdatasync - no filename 2023-12-06T15:00:03.087 INFO:tasks.workunit.client.0.smithi152.stdout:2/0: write - no filename 2023-12-06T15:00:03.088 INFO:tasks.workunit.client.0.smithi152.stdout:1/0: creat f0 x:0 0 0 2023-12-06T15:00:03.090 INFO:tasks.workunit.client.0.smithi152.stdout:0/12: creat f1 x:0 0 0 2023-12-06T15:00:03.091 INFO:tasks.workunit.client.0.smithi152.stdout:3/0: write - no filename 2023-12-06T15:00:03.091 INFO:tasks.workunit.client.0.smithi152.stdout:3/1: truncate - no filename 2023-12-06T15:00:03.091 INFO:tasks.workunit.client.0.smithi152.stdout:3/2: dread - no filename 2023-12-06T15:00:03.091 INFO:tasks.workunit.client.0.smithi152.stdout:3/3: write - no filename 2023-12-06T15:00:03.091 INFO:tasks.workunit.client.0.smithi152.stdout:3/4: dwrite - no filename 2023-12-06T15:00:03.091 INFO:tasks.workunit.client.0.smithi152.stdout:3/5: write - no filename 2023-12-06T15:00:03.091 INFO:tasks.workunit.client.0.smithi152.stdout:2/1: creat f0 x:0 0 0 2023-12-06T15:00:03.092 INFO:tasks.workunit.client.0.smithi152.stdout:1/1: symlink l1 0 2023-12-06T15:00:03.093 INFO:tasks.workunit.client.0.smithi152.stdout:0/13: rename f1 to f2 0 2023-12-06T15:00:03.095 INFO:tasks.workunit.client.0.smithi152.stdout:4/0: link - no file 2023-12-06T15:00:03.095 INFO:tasks.workunit.client.0.smithi152.stdout:4/1: truncate - no filename 2023-12-06T15:00:03.100 INFO:tasks.workunit.client.0.smithi152.stdout:3/6: creat f0 x:0 0 0 2023-12-06T15:00:03.100 INFO:tasks.workunit.client.0.smithi152.stdout:0/14: creat f3 x:0 0 0 2023-12-06T15:00:03.100 INFO:tasks.workunit.client.0.smithi152.stdout:2/2: creat f1 x:0 0 0 2023-12-06T15:00:03.100 INFO:tasks.workunit.client.0.smithi152.stdout:5/0: readlink - no filename 2023-12-06T15:00:03.100 INFO:tasks.workunit.client.0.smithi152.stdout:5/1: truncate - no filename 2023-12-06T15:00:03.100 INFO:tasks.workunit.client.0.smithi152.stdout:5/2: rmdir - no directory 2023-12-06T15:00:03.101 INFO:tasks.workunit.client.0.smithi152.stdout:4/2: creat f0 x:0 0 0 2023-12-06T15:00:03.101 INFO:tasks.workunit.client.0.smithi152.stdout:5/3: getdents . 0 2023-12-06T15:00:03.101 INFO:tasks.workunit.client.0.smithi152.stdout:5/4: fsync - no filename 2023-12-06T15:00:03.101 INFO:tasks.workunit.client.0.smithi152.stdout:5/5: chown . 780479 1 2023-12-06T15:00:03.101 INFO:tasks.workunit.client.0.smithi152.stdout:3/7: creat f1 x:0 0 0 2023-12-06T15:00:03.103 INFO:tasks.workunit.client.0.smithi152.stdout:0/15: unlink c0 0 2023-12-06T15:00:03.103 INFO:tasks.workunit.client.0.smithi152.stdout:0/16: write f2 [669219,43979] 0 2023-12-06T15:00:03.107 INFO:tasks.workunit.client.0.smithi152.stdout:6/0: fdatasync - no filename 2023-12-06T15:00:03.107 INFO:tasks.workunit.client.0.smithi152.stdout:6/1: link - no file 2023-12-06T15:00:03.107 INFO:tasks.workunit.client.0.smithi152.stdout:4/3: unlink f0 0 2023-12-06T15:00:03.107 INFO:tasks.workunit.client.0.smithi152.stdout:4/4: fdatasync - no filename 2023-12-06T15:00:03.107 INFO:tasks.workunit.client.0.smithi152.stdout:4/5: write - no filename 2023-12-06T15:00:03.107 INFO:tasks.workunit.client.0.smithi152.stdout:4/6: write - no filename 2023-12-06T15:00:03.107 INFO:tasks.workunit.client.0.smithi152.stdout:4/7: truncate - no filename 2023-12-06T15:00:03.107 INFO:tasks.workunit.client.0.smithi152.stdout:4/8: link - no file 2023-12-06T15:00:03.107 INFO:tasks.workunit.client.0.smithi152.stdout:4/9: dwrite - no filename 2023-12-06T15:00:03.107 INFO:tasks.workunit.client.0.smithi152.stdout:4/10: write - no filename 2023-12-06T15:00:03.107 INFO:tasks.workunit.client.0.smithi152.stdout:4/11: write - no filename 2023-12-06T15:00:03.107 INFO:tasks.workunit.client.0.smithi152.stdout:4/12: link - no file 2023-12-06T15:00:03.108 INFO:tasks.workunit.client.0.smithi152.stdout:4/13: write - no filename 2023-12-06T15:00:03.108 INFO:tasks.workunit.client.0.smithi152.stdout:5/6: mknod c0 0 2023-12-06T15:00:03.111 INFO:tasks.workunit.client.0.smithi152.stdout:7/0: dwrite - no filename 2023-12-06T15:00:03.111 INFO:tasks.workunit.client.0.smithi152.stdout:7/1: truncate - no filename 2023-12-06T15:00:03.111 INFO:tasks.workunit.client.0.smithi152.stdout:7/2: fdatasync - no filename 2023-12-06T15:00:03.111 INFO:tasks.workunit.client.0.smithi152.stdout:7/3: rmdir - no directory 2023-12-06T15:00:03.111 INFO:tasks.workunit.client.0.smithi152.stdout:7/4: dread - no filename 2023-12-06T15:00:03.112 INFO:tasks.workunit.client.0.smithi152.stdout:6/2: symlink l0 0 2023-12-06T15:00:03.112 INFO:tasks.workunit.client.0.smithi152.stdout:6/3: chown l0 22 1 2023-12-06T15:00:03.117 INFO:tasks.workunit.client.0.smithi152.stdout:4/14: creat f1 x:0 0 0 2023-12-06T15:00:03.117 INFO:tasks.workunit.client.0.smithi152.stdout:4/15: truncate f1 428746 0 2023-12-06T15:00:03.117 INFO:tasks.workunit.client.0.smithi152.stdout:1/2: getdents . 0 2023-12-06T15:00:03.117 INFO:tasks.workunit.client.0.smithi152.stdout:8/0: dread - no filename 2023-12-06T15:00:03.117 INFO:tasks.workunit.client.0.smithi152.stdout:8/1: stat - no entries 2023-12-06T15:00:03.117 INFO:tasks.workunit.client.0.smithi152.stdout:8/2: read - no filename 2023-12-06T15:00:03.117 INFO:tasks.workunit.client.0.smithi152.stdout:8/3: truncate - no filename 2023-12-06T15:00:03.118 INFO:tasks.workunit.client.0.smithi152.stdout:0/17: rename f2 to f4 0 2023-12-06T15:00:03.118 INFO:tasks.workunit.client.0.smithi152.stdout:7/5: mknod c0 0 2023-12-06T15:00:03.120 INFO:tasks.workunit.client.0.smithi152.stdout:6/4: mkdir d1 0 2023-12-06T15:00:03.120 INFO:tasks.workunit.client.0.smithi152.stdout:6/5: truncate - no filename 2023-12-06T15:00:03.122 INFO:tasks.workunit.client.0.smithi152.stdout:1/3: rename l1 to l2 0 2023-12-06T15:00:03.123 INFO:tasks.workunit.client.0.smithi152.stdout:7/6: creat f1 x:0 0 0 2023-12-06T15:00:03.124 INFO:tasks.workunit.client.0.smithi152.stdout:6/6: creat d1/f2 x:0 0 0 2023-12-06T15:00:03.124 INFO:tasks.workunit.client.0.smithi152.stdout:6/7: write d1/f2 [664032,128539] 0 2023-12-06T15:00:03.133 INFO:tasks.workunit.client.0.smithi152.stdout:3/8: dwrite f0 [0,4194304] 0 2023-12-06T15:00:03.138 INFO:tasks.workunit.client.0.smithi152.stdout:2/3: dwrite f1 [0,4194304] 0 2023-12-06T15:00:03.138 INFO:tasks.workunit.client.0.smithi152.stdout:2/4: readlink - no filename 2023-12-06T15:00:03.138 INFO:tasks.workunit.client.0.smithi152.stdout:9/0: mkdir d0 0 2023-12-06T15:00:03.138 INFO:tasks.workunit.client.0.smithi152.stdout:1/4: mkdir d3 0 2023-12-06T15:00:03.138 INFO:tasks.workunit.client.0.smithi152.stdout:1/5: dread - f0 zero size 2023-12-06T15:00:03.138 INFO:tasks.workunit.client.0.smithi152.stdout:1/6: write f0 [263813,37631] 0 2023-12-06T15:00:03.139 INFO:tasks.workunit.client.0.smithi152.stdout:5/7: getdents . 0 2023-12-06T15:00:03.139 INFO:tasks.workunit.client.0.smithi152.stdout:5/8: truncate - no filename 2023-12-06T15:00:03.139 INFO:tasks.workunit.client.0.smithi152.stdout:5/9: write - no filename 2023-12-06T15:00:03.139 INFO:tasks.workunit.client.0.smithi152.stdout:5/10: dread - no filename 2023-12-06T15:00:03.139 INFO:tasks.workunit.client.0.smithi152.stdout:5/11: chown c0 200572271 1 2023-12-06T15:00:03.139 INFO:tasks.workunit.client.0.smithi152.stdout:5/12: chown c0 6254 1 2023-12-06T15:00:03.139 INFO:tasks.workunit.client.0.smithi152.stdout:5/13: write - no filename 2023-12-06T15:00:03.139 INFO:tasks.workunit.client.0.smithi152.stdout:5/14: truncate - no filename 2023-12-06T15:00:03.139 INFO:tasks.workunit.client.0.smithi152.stdout:7/7: unlink c0 0 2023-12-06T15:00:03.139 INFO:tasks.workunit.client.0.smithi152.stdout:7/8: truncate f1 639197 0 2023-12-06T15:00:03.139 INFO:tasks.workunit.client.0.smithi152.stdout:7/9: chown f1 0 1 2023-12-06T15:00:03.150 INFO:tasks.workunit.client.0.smithi152.stdout:9/1: creat d0/f1 x:0 0 0 2023-12-06T15:00:03.166 INFO:tasks.workunit.client.0.smithi152.stdout:9/2: mknod d0/c2 0 2023-12-06T15:00:03.166 INFO:tasks.workunit.client.0.smithi152.stdout:9/3: write d0/f1 [796414,11508] 0 2023-12-06T15:00:03.167 INFO:tasks.workunit.client.0.smithi152.stdout:9/4: write d0/f1 [1567357,125633] 0 2023-12-06T15:00:03.167 INFO:tasks.workunit.client.0.smithi152.stdout:1/7: link f0 d3/f4 0 2023-12-06T15:00:03.184 INFO:tasks.workunit.client.0.smithi152.stdout:9/5: unlink d0/c2 0 2023-12-06T15:00:03.356 INFO:tasks.workunit.client.0.smithi152.stdout:0/18: dwrite f3 [0,4194304] 0 2023-12-06T15:00:03.490 INFO:tasks.workunit.client.0.smithi152.stdout:6/8: fdatasync d1/f2 0 2023-12-06T15:00:03.490 INFO:tasks.workunit.client.0.smithi152.stdout:6/9: chown d1/f2 6648 1 2023-12-06T15:00:03.490 INFO:tasks.workunit.client.0.smithi152.stdout:2/5: dwrite f0 [0,4194304] 0 2023-12-06T15:00:03.642 INFO:tasks.workunit.client.0.smithi152.stdout:0/19: creat f5 x:0 0 0 2023-12-06T15:00:03.726 INFO:tasks.workunit.client.0.smithi152.stdout:3/9: dwrite f0 [0,4194304] 0 2023-12-06T15:00:03.840 INFO:tasks.workunit.client.0.smithi152.stdout:4/16: truncate f1 383912 0 2023-12-06T15:00:03.880 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:03 smithi152 ceph-mon[111954]: pgmap v13: 65 pgs: 65 active+clean; 107 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.7 MiB/s wr, 434 op/s 2023-12-06T15:00:04.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:03 smithi190 ceph-mon[121340]: pgmap v13: 65 pgs: 65 active+clean; 107 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.7 MiB/s wr, 434 op/s 2023-12-06T15:00:04.456 INFO:tasks.workunit.client.0.smithi152.stdout:1/8: dread d3/f4 [0,4194304] 0 2023-12-06T15:00:04.456 INFO:tasks.workunit.client.0.smithi152.stdout:1/9: truncate f0 373550 0 2023-12-06T15:00:04.639 INFO:tasks.workunit.client.0.smithi152.stdout:9/6: fdatasync d0/f1 0 2023-12-06T15:00:04.705 INFO:tasks.workunit.client.0.smithi152.stdout:0/20: symlink l6 0 2023-12-06T15:00:04.706 INFO:tasks.workunit.client.0.smithi152.stdout:0/21: fdatasync f3 0 2023-12-06T15:00:04.859 INFO:tasks.workunit.client.0.smithi152.stdout:6/10: read d1/f2 [66784,12596] 0 2023-12-06T15:00:04.859 INFO:tasks.workunit.client.0.smithi152.stdout:2/6: write f1 [3246303,956] 0 2023-12-06T15:00:04.860 INFO:tasks.workunit.client.0.smithi152.stdout:7/10: write f1 [119854,74131] 0 2023-12-06T15:00:04.895 INFO:tasks.workunit.client.0.smithi152.stdout:6/11: dwrite d1/f2 [0,4194304] 0 2023-12-06T15:00:04.898 INFO:tasks.workunit.client.0.smithi152.stdout:6/12: write d1/f2 [3280661,124784] 0 2023-12-06T15:00:04.898 INFO:tasks.workunit.client.0.smithi152.stdout:6/13: rename d1 to d1/d3 22 2023-12-06T15:00:05.040 INFO:tasks.workunit.client.0.smithi152.stdout:3/10: unlink f1 0 2023-12-06T15:00:05.041 INFO:tasks.workunit.client.0.smithi152.stdout:3/11: fsync f0 0 2023-12-06T15:00:05.041 INFO:tasks.workunit.client.0.smithi152.stdout:3/12: write f0 [5225037,92337] 0 2023-12-06T15:00:05.419 INFO:tasks.workunit.client.0.smithi152.stdout:4/17: read f1 [196717,130529] 0 2023-12-06T15:00:05.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:05 smithi152 ceph-mon[111954]: pgmap v14: 65 pgs: 65 active+clean; 159 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.5 MiB/s rd, 9.4 MiB/s wr, 647 op/s 2023-12-06T15:00:05.918 INFO:tasks.workunit.client.1.smithi190.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2023-12-06T15:00:05.918 INFO:tasks.workunit.client.1.smithi190.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-06T15:00:05.918 INFO:tasks.workunit.client.1.smithi190.stderr:+ make 2023-12-06T15:00:06.049 INFO:tasks.workunit.client.1.smithi190.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2023-12-06T15:00:06.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:05 smithi190 ceph-mon[121340]: pgmap v14: 65 pgs: 65 active+clean; 159 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.5 MiB/s rd, 9.4 MiB/s wr, 647 op/s 2023-12-06T15:00:06.896 INFO:tasks.workunit.client.1.smithi190.stderr:++ readlink -f fsstress 2023-12-06T15:00:06.897 INFO:tasks.workunit.client.1.smithi190.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2023-12-06T15:00:06.897 INFO:tasks.workunit.client.1.smithi190.stderr:+ popd 2023-12-06T15:00:06.897 INFO:tasks.workunit.client.1.smithi190.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2023-12-06T15:00:06.898 INFO:tasks.workunit.client.1.smithi190.stderr:+ popd 2023-12-06T15:00:06.898 INFO:tasks.workunit.client.1.smithi190.stdout:~/cephtest/mnt.1/client.1/tmp 2023-12-06T15:00:06.898 INFO:tasks.workunit.client.1.smithi190.stderr:++ mktemp -d -p . 2023-12-06T15:00:06.899 INFO:tasks.workunit.client.1.smithi190.stderr:+ T=./tmp.6ERj4rYCIq 2023-12-06T15:00:06.899 INFO:tasks.workunit.client.1.smithi190.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.6ERj4rYCIq -l 1 -n 1000 -p 10 -v 2023-12-06T15:00:06.900 INFO:tasks.workunit.client.1.smithi190.stdout:seed = 1702710678 2023-12-06T15:00:06.902 INFO:tasks.workunit.client.1.smithi190.stdout:0/0: read - no filename 2023-12-06T15:00:06.902 INFO:tasks.workunit.client.1.smithi190.stdout:0/1: rename - no filename 2023-12-06T15:00:06.902 INFO:tasks.workunit.client.1.smithi190.stdout:0/2: readlink - no filename 2023-12-06T15:00:06.902 INFO:tasks.workunit.client.1.smithi190.stdout:0/3: getdents . 0 2023-12-06T15:00:06.902 INFO:tasks.workunit.client.1.smithi190.stdout:0/4: rename - no filename 2023-12-06T15:00:06.902 INFO:tasks.workunit.client.1.smithi190.stdout:0/5: dread - no filename 2023-12-06T15:00:06.908 INFO:tasks.workunit.client.1.smithi190.stdout:1/0: fdatasync - no filename 2023-12-06T15:00:06.908 INFO:tasks.workunit.client.1.smithi190.stdout:1/1: truncate - no filename 2023-12-06T15:00:06.908 INFO:tasks.workunit.client.1.smithi190.stdout:1/2: dread - no filename 2023-12-06T15:00:06.908 INFO:tasks.workunit.client.1.smithi190.stdout:1/3: getdents . 0 2023-12-06T15:00:06.908 INFO:tasks.workunit.client.1.smithi190.stdout:1/4: truncate - no filename 2023-12-06T15:00:06.908 INFO:tasks.workunit.client.1.smithi190.stdout:1/5: read - no filename 2023-12-06T15:00:06.908 INFO:tasks.workunit.client.1.smithi190.stdout:1/6: dwrite - no filename 2023-12-06T15:00:06.909 INFO:tasks.workunit.client.1.smithi190.stdout:2/0: unlink - no file 2023-12-06T15:00:06.909 INFO:tasks.workunit.client.1.smithi190.stdout:2/1: truncate - no filename 2023-12-06T15:00:06.909 INFO:tasks.workunit.client.1.smithi190.stdout:2/2: dwrite - no filename 2023-12-06T15:00:06.910 INFO:tasks.workunit.client.1.smithi190.stdout:1/7: creat f0 x:0 0 0 2023-12-06T15:00:06.915 INFO:tasks.workunit.client.1.smithi190.stdout:2/3: mknod c0 0 2023-12-06T15:00:06.915 INFO:tasks.workunit.client.1.smithi190.stdout:2/4: dread - no filename 2023-12-06T15:00:06.915 INFO:tasks.workunit.client.1.smithi190.stdout:3/0: rename - no filename 2023-12-06T15:00:06.915 INFO:tasks.workunit.client.1.smithi190.stdout:3/1: dwrite - no filename 2023-12-06T15:00:06.915 INFO:tasks.workunit.client.1.smithi190.stdout:3/2: dwrite - no filename 2023-12-06T15:00:06.915 INFO:tasks.workunit.client.1.smithi190.stdout:3/3: dread - no filename 2023-12-06T15:00:06.928 INFO:tasks.workunit.client.1.smithi190.stdout:3/4: symlink l0 0 2023-12-06T15:00:06.928 INFO:tasks.workunit.client.1.smithi190.stdout:2/5: link c0 c1 0 2023-12-06T15:00:06.928 INFO:tasks.workunit.client.1.smithi190.stdout:2/6: write - no filename 2023-12-06T15:00:06.933 INFO:tasks.workunit.client.1.smithi190.stdout:3/5: creat f1 x:0 0 0 2023-12-06T15:00:06.933 INFO:tasks.workunit.client.1.smithi190.stdout:3/6: dread - f1 zero size 2023-12-06T15:00:06.934 INFO:tasks.workunit.client.1.smithi190.stdout:4/0: creat f0 x:0 0 0 2023-12-06T15:00:06.938 INFO:tasks.workunit.client.1.smithi190.stdout:2/7: mknod c2 0 2023-12-06T15:00:06.939 INFO:tasks.workunit.client.1.smithi190.stdout:2/8: readlink - no filename 2023-12-06T15:00:06.939 INFO:tasks.workunit.client.1.smithi190.stdout:3/7: unlink f1 0 2023-12-06T15:00:06.939 INFO:tasks.workunit.client.1.smithi190.stdout:3/8: fdatasync - no filename 2023-12-06T15:00:06.939 INFO:tasks.workunit.client.1.smithi190.stdout:3/9: write - no filename 2023-12-06T15:00:06.940 INFO:tasks.workunit.client.1.smithi190.stdout:2/9: creat f3 x:0 0 0 2023-12-06T15:00:06.944 INFO:tasks.workunit.client.1.smithi190.stdout:3/10: rename l0 to l2 0 2023-12-06T15:00:06.953 INFO:tasks.workunit.client.1.smithi190.stdout:3/11: symlink l3 0 2023-12-06T15:00:06.953 INFO:tasks.workunit.client.1.smithi190.stdout:3/12: read - no filename 2023-12-06T15:00:06.953 INFO:tasks.workunit.client.1.smithi190.stdout:2/10: creat f4 x:0 0 0 2023-12-06T15:00:06.953 INFO:tasks.workunit.client.1.smithi190.stdout:2/11: fdatasync f3 0 2023-12-06T15:00:06.953 INFO:tasks.workunit.client.1.smithi190.stdout:2/12: write f3 [775592,18179] 0 2023-12-06T15:00:06.960 INFO:tasks.workunit.client.1.smithi190.stdout:3/13: mkdir d4 0 2023-12-06T15:00:06.960 INFO:tasks.workunit.client.1.smithi190.stdout:3/14: readlink l2 0 2023-12-06T15:00:06.961 INFO:tasks.workunit.client.1.smithi190.stdout:3/15: dwrite - no filename 2023-12-06T15:00:06.961 INFO:tasks.workunit.client.1.smithi190.stdout:3/16: dread - no filename 2023-12-06T15:00:06.961 INFO:tasks.workunit.client.1.smithi190.stdout:3/17: getdents d4 0 2023-12-06T15:00:06.961 INFO:tasks.workunit.client.1.smithi190.stdout:3/18: dwrite - no filename 2023-12-06T15:00:06.964 INFO:tasks.workunit.client.1.smithi190.stdout:3/19: creat d4/f5 x:0 0 0 2023-12-06T15:00:06.966 INFO:tasks.workunit.client.1.smithi190.stdout:3/20: symlink d4/l6 0 2023-12-06T15:00:06.976 INFO:tasks.workunit.client.1.smithi190.stdout:3/21: rename l3 to d4/l7 0 2023-12-06T15:00:06.977 INFO:tasks.workunit.client.1.smithi190.stdout:3/22: dread - d4/f5 zero size 2023-12-06T15:00:06.977 INFO:tasks.workunit.client.1.smithi190.stdout:3/23: chown d4 22737223 1 2023-12-06T15:00:06.979 INFO:tasks.workunit.client.1.smithi190.stdout:3/24: creat d4/f8 x:0 0 0 2023-12-06T15:00:06.984 INFO:tasks.workunit.client.1.smithi190.stdout:3/25: creat d4/f9 x:0 0 0 2023-12-06T15:00:07.188 INFO:tasks.workunit.client.1.smithi190.stdout:3/26: rename l2 to d4/la 0 2023-12-06T15:00:07.192 INFO:tasks.workunit.client.1.smithi190.stdout:2/13: fsync f4 0 2023-12-06T15:00:07.193 INFO:tasks.workunit.client.1.smithi190.stdout:2/14: truncate f4 114720 0 2023-12-06T15:00:07.514 INFO:tasks.workunit.client.1.smithi190.stdout:2/15: rename f4 to f5 0 2023-12-06T15:00:07.575 INFO:tasks.workunit.client.1.smithi190.stdout:1/8: dwrite f0 [0,4194304] 0 2023-12-06T15:00:07.683 INFO:tasks.workunit.client.1.smithi190.stdout:5/0: dwrite - no filename 2023-12-06T15:00:07.683 INFO:tasks.workunit.client.1.smithi190.stdout:5/1: rename - no filename 2023-12-06T15:00:07.683 INFO:tasks.workunit.client.1.smithi190.stdout:5/2: fdatasync - no filename 2023-12-06T15:00:07.683 INFO:tasks.workunit.client.1.smithi190.stdout:5/3: rename - no filename 2023-12-06T15:00:07.684 INFO:tasks.workunit.client.1.smithi190.stdout:5/4: dwrite - no filename 2023-12-06T15:00:07.684 INFO:tasks.workunit.client.1.smithi190.stdout:5/5: dwrite - no filename 2023-12-06T15:00:07.684 INFO:tasks.workunit.client.1.smithi190.stdout:5/6: getdents . 0 2023-12-06T15:00:07.684 INFO:tasks.workunit.client.1.smithi190.stdout:5/7: chown . 361 1 2023-12-06T15:00:07.684 INFO:tasks.workunit.client.1.smithi190.stdout:5/8: rename - no filename 2023-12-06T15:00:07.684 INFO:tasks.workunit.client.1.smithi190.stdout:5/9: dwrite - no filename 2023-12-06T15:00:07.684 INFO:tasks.workunit.client.1.smithi190.stdout:5/10: truncate - no filename 2023-12-06T15:00:07.684 INFO:tasks.workunit.client.1.smithi190.stdout:5/11: stat - no entries 2023-12-06T15:00:07.684 INFO:tasks.workunit.client.1.smithi190.stdout:5/12: fsync - no filename 2023-12-06T15:00:07.684 INFO:tasks.workunit.client.1.smithi190.stdout:4/1: read - f0 zero size 2023-12-06T15:00:07.684 INFO:tasks.workunit.client.1.smithi190.stdout:6/0: readlink - no filename 2023-12-06T15:00:07.684 INFO:tasks.workunit.client.1.smithi190.stdout:6/1: link - no file 2023-12-06T15:00:07.684 INFO:tasks.workunit.client.1.smithi190.stdout:6/2: fsync - no filename 2023-12-06T15:00:07.685 INFO:tasks.workunit.client.1.smithi190.stdout:6/3: rmdir - no directory 2023-12-06T15:00:07.685 INFO:tasks.workunit.client.1.smithi190.stdout:6/4: rmdir - no directory 2023-12-06T15:00:07.685 INFO:tasks.workunit.client.1.smithi190.stdout:6/5: write - no filename 2023-12-06T15:00:07.685 INFO:tasks.workunit.client.1.smithi190.stdout:6/6: rename - no filename 2023-12-06T15:00:07.685 INFO:tasks.workunit.client.1.smithi190.stdout:6/7: rename - no filename 2023-12-06T15:00:07.685 INFO:tasks.workunit.client.1.smithi190.stdout:6/8: fdatasync - no filename 2023-12-06T15:00:07.685 INFO:tasks.workunit.client.1.smithi190.stdout:8/0: truncate - no filename 2023-12-06T15:00:07.685 INFO:tasks.workunit.client.1.smithi190.stdout:9/0: dwrite - no filename 2023-12-06T15:00:07.685 INFO:tasks.workunit.client.1.smithi190.stdout:9/1: chown . 670 1 2023-12-06T15:00:07.685 INFO:tasks.workunit.client.1.smithi190.stdout:9/2: readlink - no filename 2023-12-06T15:00:07.760 INFO:tasks.workunit.client.1.smithi190.stdout:3/27: dwrite d4/f5 [0,4194304] 0 2023-12-06T15:00:07.760 INFO:tasks.workunit.client.1.smithi190.stdout:3/28: read - d4/f9 zero size 2023-12-06T15:00:07.760 INFO:tasks.workunit.client.1.smithi190.stdout:1/9: dread f0 [0,4194304] 0 2023-12-06T15:00:07.770 INFO:tasks.workunit.client.1.smithi190.stdout:3/29: dread d4/f5 [0,4194304] 0 2023-12-06T15:00:07.812 INFO:tasks.workunit.client.0.smithi152.stdout:1/10: creat d3/f5 x:0 0 0 2023-12-06T15:00:07.812 INFO:tasks.workunit.client.0.smithi152.stdout:1/11: chown d3/f5 1 1 2023-12-06T15:00:07.812 INFO:tasks.workunit.client.0.smithi152.stdout:1/12: fsync d3/f4 0 2023-12-06T15:00:07.877 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:07 smithi152 ceph-mon[111954]: pgmap v15: 65 pgs: 65 active+clean; 159 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.2 MiB/s rd, 8.1 MiB/s wr, 627 op/s 2023-12-06T15:00:08.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:07 smithi190 ceph-mon[121340]: pgmap v15: 65 pgs: 65 active+clean; 159 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.2 MiB/s rd, 8.1 MiB/s wr, 627 op/s 2023-12-06T15:00:08.245 INFO:tasks.workunit.client.1.smithi190.stdout:2/16: unlink c2 0 2023-12-06T15:00:08.368 INFO:tasks.workunit.client.1.smithi190.stdout:2/17: fsync f5 0 2023-12-06T15:00:08.904 INFO:tasks.workunit.client.1.smithi190.stdout:5/13: mkdir d0 0 2023-12-06T15:00:08.904 INFO:tasks.workunit.client.1.smithi190.stdout:5/14: write - no filename 2023-12-06T15:00:08.905 INFO:tasks.workunit.client.1.smithi190.stdout:4/2: creat f1 x:0 0 0 2023-12-06T15:00:08.905 INFO:tasks.workunit.client.1.smithi190.stdout:4/3: chown f0 1 1 2023-12-06T15:00:08.905 INFO:tasks.workunit.client.1.smithi190.stdout:4/4: dread - f0 zero size 2023-12-06T15:00:08.905 INFO:tasks.workunit.client.1.smithi190.stdout:6/9: creat f0 x:0 0 0 2023-12-06T15:00:08.906 INFO:tasks.workunit.client.1.smithi190.stdout:8/1: mknod c0 0 2023-12-06T15:00:08.906 INFO:tasks.workunit.client.1.smithi190.stdout:8/2: readlink - no filename 2023-12-06T15:00:08.906 INFO:tasks.workunit.client.1.smithi190.stdout:8/3: truncate - no filename 2023-12-06T15:00:08.907 INFO:tasks.workunit.client.1.smithi190.stdout:8/4: dwrite - no filename 2023-12-06T15:00:08.907 INFO:tasks.workunit.client.1.smithi190.stdout:7/0: mkdir d0 0 2023-12-06T15:00:08.907 INFO:tasks.workunit.client.1.smithi190.stdout:7/1: link - no file 2023-12-06T15:00:08.908 INFO:tasks.workunit.client.1.smithi190.stdout:7/2: dread - no filename 2023-12-06T15:00:08.908 INFO:tasks.workunit.client.1.smithi190.stdout:7/3: chown d0 15195 1 2023-12-06T15:00:08.908 INFO:tasks.workunit.client.1.smithi190.stdout:7/4: dwrite - no filename 2023-12-06T15:00:08.908 INFO:tasks.workunit.client.1.smithi190.stdout:7/5: dwrite - no filename 2023-12-06T15:00:08.908 INFO:tasks.workunit.client.1.smithi190.stdout:7/6: read - no filename 2023-12-06T15:00:08.908 INFO:tasks.workunit.client.1.smithi190.stdout:7/7: chown d0 857302914 1 2023-12-06T15:00:08.908 INFO:tasks.workunit.client.1.smithi190.stdout:7/8: stat d0 0 2023-12-06T15:00:08.909 INFO:tasks.workunit.client.1.smithi190.stdout:9/3: creat f0 x:0 0 0 2023-12-06T15:00:08.909 INFO:tasks.workunit.client.1.smithi190.stdout:9/4: dread - f0 zero size 2023-12-06T15:00:08.909 INFO:tasks.workunit.client.1.smithi190.stdout:9/5: truncate f0 720744 0 2023-12-06T15:00:09.125 INFO:tasks.workunit.client.0.smithi152.stdout:2/7: getdents . 0 2023-12-06T15:00:09.125 INFO:tasks.workunit.client.0.smithi152.stdout:2/8: stat f1 0 2023-12-06T15:00:09.126 INFO:tasks.workunit.client.0.smithi152.stdout:7/11: symlink l2 0 2023-12-06T15:00:09.127 INFO:tasks.workunit.client.0.smithi152.stdout:7/12: read f1 [487535,86134] 0 2023-12-06T15:00:09.127 INFO:tasks.workunit.client.0.smithi152.stdout:7/13: readlink l2 0 2023-12-06T15:00:09.127 INFO:tasks.workunit.client.0.smithi152.stdout:7/14: stat f1 0 2023-12-06T15:00:09.129 INFO:tasks.workunit.client.0.smithi152.stdout:7/15: fdatasync f1 0 2023-12-06T15:00:09.129 INFO:tasks.workunit.client.0.smithi152.stdout:7/16: readlink l2 0 2023-12-06T15:00:09.129 INFO:tasks.workunit.client.0.smithi152.stdout:7/17: chown l2 413 1 2023-12-06T15:00:09.225 INFO:tasks.workunit.client.0.smithi152.stdout:6/14: link d1/f2 d1/f4 0 2023-12-06T15:00:09.226 INFO:tasks.workunit.client.0.smithi152.stdout:6/15: write d1/f4 [2825524,18507] 0 2023-12-06T15:00:09.284 INFO:tasks.workunit.client.1.smithi190.stdout:3/30: symlink d4/lb 0 2023-12-06T15:00:09.326 INFO:tasks.workunit.client.1.smithi190.stdout:2/18: link c1 c6 0 2023-12-06T15:00:09.328 INFO:tasks.workunit.client.1.smithi190.stdout:5/15: creat d0/f1 x:0 0 0 2023-12-06T15:00:09.329 INFO:tasks.workunit.client.1.smithi190.stdout:4/5: creat f2 x:0 0 0 2023-12-06T15:00:09.329 INFO:tasks.workunit.client.1.smithi190.stdout:4/6: fdatasync f1 0 2023-12-06T15:00:09.329 INFO:tasks.workunit.client.1.smithi190.stdout:4/7: dread - f2 zero size 2023-12-06T15:00:09.330 INFO:tasks.workunit.client.1.smithi190.stdout:6/10: mknod c1 0 2023-12-06T15:00:09.331 INFO:tasks.workunit.client.1.smithi190.stdout:8/5: mkdir d1 0 2023-12-06T15:00:09.331 INFO:tasks.workunit.client.1.smithi190.stdout:8/6: write - no filename 2023-12-06T15:00:09.331 INFO:tasks.workunit.client.1.smithi190.stdout:8/7: dread - no filename 2023-12-06T15:00:09.332 INFO:tasks.workunit.client.1.smithi190.stdout:7/9: mknod d0/c1 0 2023-12-06T15:00:09.332 INFO:tasks.workunit.client.1.smithi190.stdout:7/10: dwrite - no filename 2023-12-06T15:00:09.333 INFO:tasks.workunit.client.1.smithi190.stdout:7/11: chown d0 377236 1 2023-12-06T15:00:09.333 INFO:tasks.workunit.client.1.smithi190.stdout:7/12: chown d0/c1 1 1 2023-12-06T15:00:09.333 INFO:tasks.workunit.client.1.smithi190.stdout:7/13: fsync - no filename 2023-12-06T15:00:09.334 INFO:tasks.workunit.client.1.smithi190.stdout:9/6: creat f1 x:0 0 0 2023-12-06T15:00:09.334 INFO:tasks.workunit.client.1.smithi190.stdout:9/7: write f0 [1732096,113171] 0 2023-12-06T15:00:09.334 INFO:tasks.workunit.client.1.smithi190.stdout:9/8: write f1 [880447,86853] 0 2023-12-06T15:00:09.337 INFO:tasks.workunit.client.1.smithi190.stdout:2/19: symlink l7 0 2023-12-06T15:00:09.338 INFO:tasks.workunit.client.1.smithi190.stdout:5/16: symlink d0/l2 0 2023-12-06T15:00:09.339 INFO:tasks.workunit.client.1.smithi190.stdout:4/8: mkdir d3 0 2023-12-06T15:00:09.340 INFO:tasks.workunit.client.1.smithi190.stdout:8/8: mknod d1/c2 0 2023-12-06T15:00:09.341 INFO:tasks.workunit.client.1.smithi190.stdout:8/9: dread - no filename 2023-12-06T15:00:09.343 INFO:tasks.workunit.client.1.smithi190.stdout:7/14: symlink d0/l2 0 2023-12-06T15:00:09.344 INFO:tasks.workunit.client.1.smithi190.stdout:7/15: readlink d0/l2 0 2023-12-06T15:00:09.344 INFO:tasks.workunit.client.1.smithi190.stdout:9/9: creat f2 x:0 0 0 2023-12-06T15:00:09.345 INFO:tasks.workunit.client.1.smithi190.stdout:2/20: creat f8 x:0 0 0 2023-12-06T15:00:09.345 INFO:tasks.workunit.client.0.smithi152.stdout:4/18: mkdir d2 0 2023-12-06T15:00:09.346 INFO:tasks.workunit.client.0.smithi152.stdout:4/19: fdatasync f1 0 2023-12-06T15:00:09.346 INFO:tasks.workunit.client.0.smithi152.stdout:4/20: stat d2 0 2023-12-06T15:00:09.346 INFO:tasks.workunit.client.0.smithi152.stdout:3/13: rename f0 to f2 0 2023-12-06T15:00:09.349 INFO:tasks.workunit.client.1.smithi190.stdout:5/17: creat d0/f3 x:0 0 0 2023-12-06T15:00:09.351 INFO:tasks.workunit.client.1.smithi190.stdout:7/16: rmdir d0 39 2023-12-06T15:00:09.351 INFO:tasks.workunit.client.1.smithi190.stdout:7/17: write - no filename 2023-12-06T15:00:09.354 INFO:tasks.workunit.client.1.smithi190.stdout:9/10: link f0 f3 0 2023-12-06T15:00:09.355 INFO:tasks.workunit.client.1.smithi190.stdout:2/21: mknod c9 0 2023-12-06T15:00:09.355 INFO:tasks.workunit.client.1.smithi190.stdout:2/22: fsync f3 0 2023-12-06T15:00:09.355 INFO:tasks.workunit.client.0.smithi152.stdout:0/22: rename f3 to f7 0 2023-12-06T15:00:09.355 INFO:tasks.workunit.client.0.smithi152.stdout:0/23: readlink l6 0 2023-12-06T15:00:09.356 INFO:tasks.workunit.client.1.smithi190.stdout:6/11: dwrite f0 [0,4194304] 0 2023-12-06T15:00:09.356 INFO:tasks.workunit.client.0.smithi152.stdout:2/9: creat f2 x:0 0 0 2023-12-06T15:00:09.357 INFO:tasks.workunit.client.1.smithi190.stdout:6/12: write f0 [1139471,42990] 0 2023-12-06T15:00:09.359 INFO:tasks.workunit.client.0.smithi152.stdout:7/18: creat f3 x:0 0 0 2023-12-06T15:00:09.359 INFO:tasks.workunit.client.0.smithi152.stdout:7/19: read - f3 zero size 2023-12-06T15:00:09.359 INFO:tasks.workunit.client.0.smithi152.stdout:7/20: stat l2 0 2023-12-06T15:00:09.359 INFO:tasks.workunit.client.1.smithi190.stdout:7/18: unlink d0/l2 0 2023-12-06T15:00:09.360 INFO:tasks.workunit.client.1.smithi190.stdout:9/11: mkdir d4 0 2023-12-06T15:00:09.360 INFO:tasks.workunit.client.1.smithi190.stdout:9/12: readlink - no filename 2023-12-06T15:00:09.361 INFO:tasks.workunit.client.0.smithi152.stdout:4/21: mknod d2/c3 0 2023-12-06T15:00:09.361 INFO:tasks.workunit.client.0.smithi152.stdout:6/16: mkdir d1/d5 0 2023-12-06T15:00:09.361 INFO:tasks.workunit.client.1.smithi190.stdout:2/23: creat fa x:0 0 0 2023-12-06T15:00:09.361 INFO:tasks.workunit.client.1.smithi190.stdout:2/24: chown c6 20957 1 2023-12-06T15:00:09.363 INFO:tasks.workunit.client.0.smithi152.stdout:7/21: creat f4 x:0 0 0 2023-12-06T15:00:09.363 INFO:tasks.workunit.client.0.smithi152.stdout:7/22: rmdir - no directory 2023-12-06T15:00:09.363 INFO:tasks.workunit.client.0.smithi152.stdout:7/23: stat f1 0 2023-12-06T15:00:09.363 INFO:tasks.workunit.client.0.smithi152.stdout:7/24: readlink l2 0 2023-12-06T15:00:09.363 INFO:tasks.workunit.client.0.smithi152.stdout:3/14: dread f2 [0,4194304] 0 2023-12-06T15:00:09.365 INFO:tasks.workunit.client.0.smithi152.stdout:6/17: creat d1/f6 x:0 0 0 2023-12-06T15:00:09.365 INFO:tasks.workunit.client.0.smithi152.stdout:6/18: readlink l0 0 2023-12-06T15:00:09.366 INFO:tasks.workunit.client.1.smithi190.stdout:7/19: creat d0/f3 x:0 0 0 2023-12-06T15:00:09.367 INFO:tasks.workunit.client.1.smithi190.stdout:2/25: dread f3 [0,4194304] 0 2023-12-06T15:00:09.367 INFO:tasks.workunit.client.1.smithi190.stdout:2/26: chown c1 779 1 2023-12-06T15:00:09.368 INFO:tasks.workunit.client.0.smithi152.stdout:4/22: symlink d2/l4 0 2023-12-06T15:00:09.368 INFO:tasks.workunit.client.0.smithi152.stdout:4/23: chown f1 505395 1 2023-12-06T15:00:09.368 INFO:tasks.workunit.client.0.smithi152.stdout:4/24: stat f1 0 2023-12-06T15:00:09.368 INFO:tasks.workunit.client.0.smithi152.stdout:4/25: truncate f1 1398001 0 2023-12-06T15:00:09.368 INFO:tasks.workunit.client.0.smithi152.stdout:4/26: write f1 [2140033,101790] 0 2023-12-06T15:00:09.369 INFO:tasks.workunit.client.1.smithi190.stdout:7/20: symlink d0/l4 0 2023-12-06T15:00:09.371 INFO:tasks.workunit.client.1.smithi190.stdout:2/27: link f8 fb 0 2023-12-06T15:00:09.375 INFO:tasks.workunit.client.0.smithi152.stdout:4/27: mknod d2/c5 0 2023-12-06T15:00:09.376 INFO:tasks.workunit.client.1.smithi190.stdout:4/9: dwrite f1 [0,4194304] 0 2023-12-06T15:00:09.381 INFO:tasks.workunit.client.0.smithi152.stdout:4/28: creat d2/f6 x:0 0 0 2023-12-06T15:00:09.382 INFO:tasks.workunit.client.1.smithi190.stdout:4/10: creat d3/f4 x:0 0 0 2023-12-06T15:00:09.382 INFO:tasks.workunit.client.1.smithi190.stdout:4/11: stat f0 0 2023-12-06T15:00:09.383 INFO:tasks.workunit.client.0.smithi152.stdout:4/29: symlink d2/l7 0 2023-12-06T15:00:09.384 INFO:tasks.workunit.client.1.smithi190.stdout:4/12: symlink d3/l5 0 2023-12-06T15:00:09.384 INFO:tasks.workunit.client.1.smithi190.stdout:4/13: dread - d3/f4 zero size 2023-12-06T15:00:09.384 INFO:tasks.workunit.client.1.smithi190.stdout:4/14: dread - d3/f4 zero size 2023-12-06T15:00:09.386 INFO:tasks.workunit.client.0.smithi152.stdout:4/30: creat d2/f8 x:0 0 0 2023-12-06T15:00:09.386 INFO:tasks.workunit.client.0.smithi152.stdout:4/31: stat f1 0 2023-12-06T15:00:09.387 INFO:tasks.workunit.client.0.smithi152.stdout:4/32: creat d2/f9 x:0 0 0 2023-12-06T15:00:09.392 INFO:tasks.workunit.client.0.smithi152.stdout:4/33: creat d2/fa x:0 0 0 2023-12-06T15:00:09.393 INFO:tasks.workunit.client.1.smithi190.stdout:6/13: dwrite f0 [0,4194304] 0 2023-12-06T15:00:09.396 INFO:tasks.workunit.client.0.smithi152.stdout:0/24: write f7 [498369,128278] 0 2023-12-06T15:00:09.397 INFO:tasks.workunit.client.0.smithi152.stdout:4/34: unlink d2/l7 0 2023-12-06T15:00:09.399 INFO:tasks.workunit.client.0.smithi152.stdout:0/25: mkdir d8 0 2023-12-06T15:00:09.400 INFO:tasks.workunit.client.0.smithi152.stdout:4/35: symlink d2/lb 0 2023-12-06T15:00:09.402 INFO:tasks.workunit.client.0.smithi152.stdout:0/26: creat d8/f9 x:0 0 0 2023-12-06T15:00:09.402 INFO:tasks.workunit.client.0.smithi152.stdout:0/27: chown l6 3333307 1 2023-12-06T15:00:09.402 INFO:tasks.workunit.client.0.smithi152.stdout:0/28: dread - d8/f9 zero size 2023-12-06T15:00:09.406 INFO:tasks.workunit.client.1.smithi190.stdout:7/21: dwrite d0/f3 [0,4194304] 0 2023-12-06T15:00:09.406 INFO:tasks.workunit.client.0.smithi152.stdout:4/36: link d2/fa d2/fc 0 2023-12-06T15:00:09.406 INFO:tasks.workunit.client.0.smithi152.stdout:4/37: stat d2/f6 0 2023-12-06T15:00:09.407 INFO:tasks.workunit.client.1.smithi190.stdout:2/28: dwrite f5 [0,4194304] 0 2023-12-06T15:00:09.407 INFO:tasks.workunit.client.1.smithi190.stdout:9/13: dwrite f1 [0,4194304] 0 2023-12-06T15:00:09.407 INFO:tasks.workunit.client.1.smithi190.stdout:4/15: dwrite f2 [0,4194304] 0 2023-12-06T15:00:09.408 INFO:tasks.workunit.client.1.smithi190.stdout:4/16: chown d3/l5 173571648 1 2023-12-06T15:00:09.408 INFO:tasks.workunit.client.1.smithi190.stdout:4/17: write d3/f4 [386216,106587] 0 2023-12-06T15:00:09.408 INFO:tasks.workunit.client.1.smithi190.stdout:4/18: truncate d3/f4 634949 0 2023-12-06T15:00:09.408 INFO:tasks.workunit.client.0.smithi152.stdout:2/10: dread f0 [0,4194304] 0 2023-12-06T15:00:09.410 INFO:tasks.workunit.client.1.smithi190.stdout:2/29: rename f8 to fc 0 2023-12-06T15:00:09.411 INFO:tasks.workunit.client.1.smithi190.stdout:9/14: mkdir d4/d5 0 2023-12-06T15:00:09.413 INFO:tasks.workunit.client.1.smithi190.stdout:4/19: mkdir d3/d6 0 2023-12-06T15:00:09.414 INFO:tasks.workunit.client.1.smithi190.stdout:2/30: mknod cd 0 2023-12-06T15:00:09.414 INFO:tasks.workunit.client.1.smithi190.stdout:2/31: read - fc zero size 2023-12-06T15:00:09.416 INFO:tasks.workunit.client.1.smithi190.stdout:4/20: rename f0 to d3/f7 0 2023-12-06T15:00:09.417 INFO:tasks.workunit.client.1.smithi190.stdout:4/21: rmdir d3/d6 0 2023-12-06T15:00:09.418 INFO:tasks.workunit.client.1.smithi190.stdout:4/22: symlink d3/l8 0 2023-12-06T15:00:09.420 INFO:tasks.workunit.client.1.smithi190.stdout:1/10: truncate f0 3032152 0 2023-12-06T15:00:09.422 INFO:tasks.workunit.client.0.smithi152.stdout:6/19: dread d1/f4 [0,4194304] 0 2023-12-06T15:00:09.422 INFO:tasks.workunit.client.0.smithi152.stdout:6/20: chown d1 7936 1 2023-12-06T15:00:09.423 INFO:tasks.workunit.client.1.smithi190.stdout:4/23: write f2 [1187614,115933] 0 2023-12-06T15:00:09.423 INFO:tasks.workunit.client.1.smithi190.stdout:4/24: write d3/f7 [584413,2041] 0 2023-12-06T15:00:09.424 INFO:tasks.workunit.client.0.smithi152.stdout:4/38: creat d2/fd x:0 0 0 2023-12-06T15:00:09.426 INFO:tasks.workunit.client.1.smithi190.stdout:4/25: write f1 [3061980,4223] 0 2023-12-06T15:00:09.426 INFO:tasks.workunit.client.0.smithi152.stdout:2/11: truncate f0 2424359 0 2023-12-06T15:00:09.426 INFO:tasks.workunit.client.0.smithi152.stdout:6/21: creat d1/f7 x:0 0 0 2023-12-06T15:00:09.426 INFO:tasks.workunit.client.0.smithi152.stdout:6/22: getdents d1/d5 0 2023-12-06T15:00:09.428 INFO:tasks.workunit.client.1.smithi190.stdout:4/26: rename f1 to d3/f9 0 2023-12-06T15:00:09.428 INFO:tasks.workunit.client.0.smithi152.stdout:4/39: rename d2/f6 to d2/fe 0 2023-12-06T15:00:09.428 INFO:tasks.workunit.client.0.smithi152.stdout:4/40: dread - d2/fc zero size 2023-12-06T15:00:09.428 INFO:tasks.workunit.client.0.smithi152.stdout:4/41: dread - d2/f8 zero size 2023-12-06T15:00:09.429 INFO:tasks.workunit.client.0.smithi152.stdout:4/42: creat d2/ff x:0 0 0 2023-12-06T15:00:09.429 INFO:tasks.workunit.client.0.smithi152.stdout:4/43: read - d2/fc zero size 2023-12-06T15:00:09.430 INFO:tasks.workunit.client.0.smithi152.stdout:2/12: symlink l3 0 2023-12-06T15:00:09.431 INFO:tasks.workunit.client.0.smithi152.stdout:2/13: fdatasync f2 0 2023-12-06T15:00:09.432 INFO:tasks.workunit.client.0.smithi152.stdout:4/44: mkdir d2/d10 0 2023-12-06T15:00:09.432 INFO:tasks.workunit.client.0.smithi152.stdout:4/45: truncate d2/f8 775384 0 2023-12-06T15:00:09.436 INFO:tasks.workunit.client.0.smithi152.stdout:2/14: link f1 f4 0 2023-12-06T15:00:09.436 INFO:tasks.workunit.client.0.smithi152.stdout:2/15: dread - f2 zero size 2023-12-06T15:00:09.439 INFO:tasks.workunit.client.0.smithi152.stdout:2/16: rename f2 to f5 0 2023-12-06T15:00:09.439 INFO:tasks.workunit.client.0.smithi152.stdout:2/17: fdatasync f0 0 2023-12-06T15:00:09.439 INFO:tasks.workunit.client.1.smithi190.stdout:2/32: dwrite fc [0,4194304] 0 2023-12-06T15:00:09.441 INFO:tasks.workunit.client.1.smithi190.stdout:9/15: dread f1 [0,4194304] 0 2023-12-06T15:00:09.442 INFO:tasks.workunit.client.1.smithi190.stdout:2/33: creat fe x:0 0 0 2023-12-06T15:00:09.443 INFO:tasks.workunit.client.1.smithi190.stdout:9/16: rmdir d4/d5 0 2023-12-06T15:00:09.444 INFO:tasks.workunit.client.1.smithi190.stdout:2/34: creat ff x:0 0 0 2023-12-06T15:00:09.444 INFO:tasks.workunit.client.1.smithi190.stdout:2/35: readlink l7 0 2023-12-06T15:00:09.446 INFO:tasks.workunit.client.1.smithi190.stdout:9/17: link f1 d4/f6 0 2023-12-06T15:00:09.448 INFO:tasks.workunit.client.0.smithi152.stdout:4/46: dwrite d2/ff [0,4194304] 0 2023-12-06T15:00:09.448 INFO:tasks.workunit.client.0.smithi152.stdout:4/47: dread - d2/f9 zero size 2023-12-06T15:00:09.451 INFO:tasks.workunit.client.0.smithi152.stdout:4/48: symlink d2/l11 0 2023-12-06T15:00:09.453 INFO:tasks.workunit.client.0.smithi152.stdout:4/49: dread f1 [0,4194304] 0 2023-12-06T15:00:09.454 INFO:tasks.workunit.client.0.smithi152.stdout:4/50: creat d2/f12 x:0 0 0 2023-12-06T15:00:09.454 INFO:tasks.workunit.client.0.smithi152.stdout:4/51: stat d2/f12 0 2023-12-06T15:00:09.454 INFO:tasks.workunit.client.0.smithi152.stdout:4/52: mkdir d2/d10/d13 0 2023-12-06T15:00:09.456 INFO:tasks.workunit.client.0.smithi152.stdout:4/53: mknod d2/c14 0 2023-12-06T15:00:09.456 INFO:tasks.workunit.client.0.smithi152.stdout:4/54: chown d2/d10/d13 818 1 2023-12-06T15:00:09.456 INFO:tasks.workunit.client.0.smithi152.stdout:4/55: mkdir d2/d15 0 2023-12-06T15:00:09.458 INFO:tasks.workunit.client.0.smithi152.stdout:4/56: creat d2/d10/f16 x:0 0 0 2023-12-06T15:00:09.458 INFO:tasks.workunit.client.0.smithi152.stdout:4/57: stat d2/fc 0 2023-12-06T15:00:09.458 INFO:tasks.workunit.client.0.smithi152.stdout:4/58: getdents d2/d10/d13 0 2023-12-06T15:00:09.458 INFO:tasks.workunit.client.0.smithi152.stdout:4/59: dread - d2/d10/f16 zero size 2023-12-06T15:00:09.458 INFO:tasks.workunit.client.0.smithi152.stdout:4/60: chown d2/c14 1 1 2023-12-06T15:00:09.458 INFO:tasks.workunit.client.0.smithi152.stdout:4/61: write d2/fc [293837,111655] 0 2023-12-06T15:00:09.458 INFO:tasks.workunit.client.0.smithi152.stdout:4/62: stat d2/d10 0 2023-12-06T15:00:09.471 INFO:tasks.workunit.client.0.smithi152.stdout:4/63: dwrite f1 [0,4194304] 0 2023-12-06T15:00:09.471 INFO:tasks.workunit.client.0.smithi152.stdout:4/64: dread - d2/f9 zero size 2023-12-06T15:00:09.471 INFO:tasks.workunit.client.0.smithi152.stdout:4/65: truncate d2/f9 993743 0 2023-12-06T15:00:09.471 INFO:tasks.workunit.client.0.smithi152.stdout:4/66: write d2/fd [648837,97078] 0 2023-12-06T15:00:09.472 INFO:tasks.workunit.client.0.smithi152.stdout:4/67: write d2/f9 [792039,95638] 0 2023-12-06T15:00:09.476 INFO:tasks.workunit.client.0.smithi152.stdout:4/68: dread d2/fa [0,4194304] 0 2023-12-06T15:00:09.683 INFO:tasks.workunit.client.1.smithi190.stdout:3/31: getdents d4 0 2023-12-06T15:00:09.684 INFO:tasks.workunit.client.1.smithi190.stdout:3/32: getdents d4 0 2023-12-06T15:00:09.684 INFO:tasks.workunit.client.1.smithi190.stdout:3/33: chown d4/l6 808188501 1 2023-12-06T15:00:09.684 INFO:tasks.workunit.client.1.smithi190.stdout:3/34: stat d4/l7 0 2023-12-06T15:00:09.687 INFO:tasks.workunit.client.1.smithi190.stdout:3/35: dread d4/f5 [0,4194304] 0 2023-12-06T15:00:09.687 INFO:tasks.workunit.client.1.smithi190.stdout:3/36: getdents d4 0 2023-12-06T15:00:09.687 INFO:tasks.workunit.client.1.smithi190.stdout:3/37: dread - d4/f8 zero size 2023-12-06T15:00:09.688 INFO:tasks.workunit.client.1.smithi190.stdout:3/38: creat d4/fc x:0 0 0 2023-12-06T15:00:09.699 INFO:tasks.workunit.client.1.smithi190.stdout:5/18: rmdir d0 39 2023-12-06T15:00:09.699 INFO:tasks.workunit.client.1.smithi190.stdout:5/19: dread - d0/f1 zero size 2023-12-06T15:00:09.699 INFO:tasks.workunit.client.1.smithi190.stdout:5/20: read - d0/f3 zero size 2023-12-06T15:00:09.704 INFO:tasks.workunit.client.1.smithi190.stdout:7/22: getdents d0 0 2023-12-06T15:00:09.704 INFO:tasks.workunit.client.1.smithi190.stdout:7/23: fdatasync d0/f3 0 2023-12-06T15:00:09.706 INFO:tasks.workunit.client.1.smithi190.stdout:7/24: mkdir d0/d5 0 2023-12-06T15:00:09.709 INFO:tasks.workunit.client.1.smithi190.stdout:4/27: write f2 [4360773,9125] 0 2023-12-06T15:00:09.717 INFO:tasks.workunit.client.1.smithi190.stdout:7/25: dread d0/f3 [0,4194304] 0 2023-12-06T15:00:09.718 INFO:tasks.workunit.client.1.smithi190.stdout:7/26: creat d0/f6 x:0 0 0 2023-12-06T15:00:09.719 INFO:tasks.workunit.client.1.smithi190.stdout:9/18: getdents d4 0 2023-12-06T15:00:09.720 INFO:tasks.workunit.client.1.smithi190.stdout:7/27: symlink d0/d5/l7 0 2023-12-06T15:00:09.724 INFO:tasks.workunit.client.1.smithi190.stdout:4/28: truncate d3/f9 292956 0 2023-12-06T15:00:09.724 INFO:tasks.workunit.client.1.smithi190.stdout:5/21: dwrite d0/f3 [0,4194304] 0 2023-12-06T15:00:09.724 INFO:tasks.workunit.client.1.smithi190.stdout:5/22: stat d0 0 2023-12-06T15:00:09.725 INFO:tasks.workunit.client.1.smithi190.stdout:6/14: dwrite f0 [4194304,4194304] 0 2023-12-06T15:00:09.725 INFO:tasks.workunit.client.1.smithi190.stdout:4/29: creat d3/fa x:0 0 0 2023-12-06T15:00:09.728 INFO:tasks.workunit.client.1.smithi190.stdout:5/23: symlink d0/l4 0 2023-12-06T15:00:09.732 INFO:tasks.workunit.client.1.smithi190.stdout:1/11: dread f0 [0,4194304] 0 2023-12-06T15:00:09.732 INFO:tasks.workunit.client.1.smithi190.stdout:1/12: write f0 [1703737,90394] 0 2023-12-06T15:00:09.733 INFO:tasks.workunit.client.1.smithi190.stdout:5/24: mkdir d0/d5 0 2023-12-06T15:00:09.735 INFO:tasks.workunit.client.1.smithi190.stdout:5/25: creat d0/f6 x:0 0 0 2023-12-06T15:00:09.737 INFO:tasks.workunit.client.1.smithi190.stdout:5/26: link d0/f6 d0/f7 0 2023-12-06T15:00:09.739 INFO:tasks.workunit.client.1.smithi190.stdout:1/13: dread f0 [0,4194304] 0 2023-12-06T15:00:09.739 INFO:tasks.workunit.client.1.smithi190.stdout:5/27: rmdir d0/d5 0 2023-12-06T15:00:09.739 INFO:tasks.workunit.client.1.smithi190.stdout:5/28: dread - d0/f7 zero size 2023-12-06T15:00:09.740 INFO:tasks.workunit.client.1.smithi190.stdout:1/14: creat f1 x:0 0 0 2023-12-06T15:00:09.740 INFO:tasks.workunit.client.1.smithi190.stdout:1/15: write f1 [527462,25376] 0 2023-12-06T15:00:09.742 INFO:tasks.workunit.client.1.smithi190.stdout:5/29: unlink d0/l4 0 2023-12-06T15:00:09.743 INFO:tasks.workunit.client.1.smithi190.stdout:9/19: dread d4/f6 [0,4194304] 0 2023-12-06T15:00:09.743 INFO:tasks.workunit.client.1.smithi190.stdout:7/28: dwrite d0/f3 [4194304,4194304] 0 2023-12-06T15:00:09.744 INFO:tasks.workunit.client.1.smithi190.stdout:1/16: symlink l2 0 2023-12-06T15:00:09.747 INFO:tasks.workunit.client.1.smithi190.stdout:9/20: mknod d4/c7 0 2023-12-06T15:00:09.748 INFO:tasks.workunit.client.1.smithi190.stdout:6/15: truncate f0 643742 0 2023-12-06T15:00:09.748 INFO:tasks.workunit.client.1.smithi190.stdout:7/29: creat d0/d5/f8 x:0 0 0 2023-12-06T15:00:09.748 INFO:tasks.workunit.client.1.smithi190.stdout:7/30: write d0/f6 [19987,93560] 0 2023-12-06T15:00:09.749 INFO:tasks.workunit.client.1.smithi190.stdout:7/31: read d0/f6 [27920,116306] 0 2023-12-06T15:00:09.751 INFO:tasks.workunit.client.1.smithi190.stdout:1/17: creat f3 x:0 0 0 2023-12-06T15:00:09.751 INFO:tasks.workunit.client.1.smithi190.stdout:9/21: mknod d4/c8 0 2023-12-06T15:00:09.751 INFO:tasks.workunit.client.1.smithi190.stdout:9/22: readlink - no filename 2023-12-06T15:00:09.752 INFO:tasks.workunit.client.1.smithi190.stdout:9/23: fsync f1 0 2023-12-06T15:00:09.753 INFO:tasks.workunit.client.1.smithi190.stdout:9/24: mknod d4/c9 0 2023-12-06T15:00:09.753 INFO:tasks.workunit.client.1.smithi190.stdout:1/18: dread f0 [0,4194304] 0 2023-12-06T15:00:09.754 INFO:tasks.workunit.client.1.smithi190.stdout:9/25: creat d4/fa x:0 0 0 2023-12-06T15:00:09.756 INFO:tasks.workunit.client.1.smithi190.stdout:1/19: link l2 l4 0 2023-12-06T15:00:09.756 INFO:tasks.workunit.client.1.smithi190.stdout:1/20: chown f0 0 1 2023-12-06T15:00:09.756 INFO:tasks.workunit.client.1.smithi190.stdout:1/21: fdatasync f3 0 2023-12-06T15:00:09.756 INFO:tasks.workunit.client.1.smithi190.stdout:1/22: write f1 [1312951,7528] 0 2023-12-06T15:00:09.756 INFO:tasks.workunit.client.1.smithi190.stdout:1/23: truncate f1 1844865 0 2023-12-06T15:00:09.756 INFO:tasks.workunit.client.1.smithi190.stdout:1/24: write f1 [782694,129567] 0 2023-12-06T15:00:09.757 INFO:tasks.workunit.client.1.smithi190.stdout:9/26: creat d4/fb x:0 0 0 2023-12-06T15:00:09.757 INFO:tasks.workunit.client.1.smithi190.stdout:5/30: dwrite d0/f7 [0,4194304] 0 2023-12-06T15:00:09.760 INFO:tasks.workunit.client.1.smithi190.stdout:1/25: creat f5 x:0 0 0 2023-12-06T15:00:09.761 INFO:tasks.workunit.client.1.smithi190.stdout:5/31: mknod d0/c8 0 2023-12-06T15:00:09.761 INFO:tasks.workunit.client.1.smithi190.stdout:1/26: write f1 [396225,18884] 0 2023-12-06T15:00:09.761 INFO:tasks.workunit.client.1.smithi190.stdout:1/27: read - f5 zero size 2023-12-06T15:00:09.761 INFO:tasks.workunit.client.1.smithi190.stdout:1/28: dread - f3 zero size 2023-12-06T15:00:09.764 INFO:tasks.workunit.client.1.smithi190.stdout:5/32: creat d0/f9 x:0 0 0 2023-12-06T15:00:09.767 INFO:tasks.workunit.client.1.smithi190.stdout:5/33: link d0/c8 d0/ca 0 2023-12-06T15:00:09.769 INFO:tasks.workunit.client.1.smithi190.stdout:5/34: truncate d0/f3 1600146 0 2023-12-06T15:00:09.771 INFO:tasks.workunit.client.1.smithi190.stdout:5/35: creat d0/fb x:0 0 0 2023-12-06T15:00:09.783 INFO:tasks.workunit.client.1.smithi190.stdout:7/32: dwrite d0/f6 [0,4194304] 0 2023-12-06T15:00:09.784 INFO:tasks.workunit.client.1.smithi190.stdout:7/33: write d0/f6 [4137586,23305] 0 2023-12-06T15:00:09.785 INFO:tasks.workunit.client.1.smithi190.stdout:7/34: creat d0/d5/f9 x:0 0 0 2023-12-06T15:00:09.785 INFO:tasks.workunit.client.1.smithi190.stdout:7/35: dread - d0/d5/f8 zero size 2023-12-06T15:00:09.789 INFO:tasks.workunit.client.1.smithi190.stdout:7/36: write d0/f6 [1406611,77000] 0 2023-12-06T15:00:09.790 INFO:tasks.workunit.client.1.smithi190.stdout:7/37: mkdir d0/d5/da 0 2023-12-06T15:00:09.790 INFO:tasks.workunit.client.1.smithi190.stdout:7/38: write d0/d5/f9 [856278,15435] 0 2023-12-06T15:00:09.794 INFO:tasks.workunit.client.1.smithi190.stdout:9/27: dwrite f2 [0,4194304] 0 2023-12-06T15:00:09.796 INFO:tasks.workunit.client.1.smithi190.stdout:1/29: dwrite f3 [0,4194304] 0 2023-12-06T15:00:09.797 INFO:tasks.workunit.client.1.smithi190.stdout:6/16: dwrite f0 [0,4194304] 0 2023-12-06T15:00:09.797 INFO:tasks.workunit.client.1.smithi190.stdout:6/17: rmdir - no directory 2023-12-06T15:00:09.801 INFO:tasks.workunit.client.1.smithi190.stdout:6/18: unlink c1 0 2023-12-06T15:00:09.814 INFO:tasks.workunit.client.1.smithi190.stdout:9/28: dread d4/f6 [0,4194304] 0 2023-12-06T15:00:09.814 INFO:tasks.workunit.client.1.smithi190.stdout:9/29: chown d4/c9 51 1 2023-12-06T15:00:09.819 INFO:tasks.workunit.client.0.smithi152.stdout:9/7: truncate d0/f1 1299520 0 2023-12-06T15:00:09.820 INFO:tasks.workunit.client.1.smithi190.stdout:7/39: dwrite d0/d5/f9 [0,4194304] 0 2023-12-06T15:00:09.822 INFO:tasks.workunit.client.1.smithi190.stdout:7/40: getdents d0/d5 0 2023-12-06T15:00:09.823 INFO:tasks.workunit.client.1.smithi190.stdout:1/30: dwrite f0 [0,4194304] 0 2023-12-06T15:00:09.824 INFO:tasks.workunit.client.1.smithi190.stdout:1/31: dread - f5 zero size 2023-12-06T15:00:09.824 INFO:tasks.workunit.client.1.smithi190.stdout:9/30: dread f1 [0,4194304] 0 2023-12-06T15:00:09.825 INFO:tasks.workunit.client.1.smithi190.stdout:9/31: creat d4/fc x:0 0 0 2023-12-06T15:00:09.825 INFO:tasks.workunit.client.1.smithi190.stdout:9/32: link d4/fb d4/fd 0 2023-12-06T15:00:09.827 INFO:tasks.workunit.client.1.smithi190.stdout:9/33: creat d4/fe x:0 0 0 2023-12-06T15:00:09.828 INFO:tasks.workunit.client.1.smithi190.stdout:9/34: fdatasync d4/fe 0 2023-12-06T15:00:09.829 INFO:tasks.workunit.client.1.smithi190.stdout:6/19: dwrite f0 [0,4194304] 0 2023-12-06T15:00:09.830 INFO:tasks.workunit.client.0.smithi152.stdout:4/69: fsync d2/f8 0 2023-12-06T15:00:09.830 INFO:tasks.workunit.client.0.smithi152.stdout:4/70: stat d2/d15 0 2023-12-06T15:00:09.830 INFO:tasks.workunit.client.0.smithi152.stdout:4/71: chown f1 99458 1 2023-12-06T15:00:09.830 INFO:tasks.workunit.client.1.smithi190.stdout:6/20: symlink l2 0 2023-12-06T15:00:09.832 INFO:tasks.workunit.client.1.smithi190.stdout:6/21: symlink l3 0 2023-12-06T15:00:09.843 INFO:tasks.workunit.client.0.smithi152.stdout:0/29: rmdir d8 39 2023-12-06T15:00:09.844 INFO:tasks.workunit.client.1.smithi190.stdout:6/22: dread f0 [0,4194304] 0 2023-12-06T15:00:09.845 INFO:tasks.workunit.client.0.smithi152.stdout:0/30: creat d8/fa x:0 0 0 2023-12-06T15:00:09.845 INFO:tasks.workunit.client.0.smithi152.stdout:0/31: chown d8/f9 144 1 2023-12-06T15:00:09.845 INFO:tasks.workunit.client.1.smithi190.stdout:6/23: mkdir d4 0 2023-12-06T15:00:09.847 INFO:tasks.workunit.client.1.smithi190.stdout:6/24: mknod d4/c5 0 2023-12-06T15:00:09.848 INFO:tasks.workunit.client.1.smithi190.stdout:6/25: rename l3 to d4/l6 0 2023-12-06T15:00:09.848 INFO:tasks.workunit.client.1.smithi190.stdout:6/26: fdatasync f0 0 2023-12-06T15:00:09.849 INFO:tasks.workunit.client.1.smithi190.stdout:6/27: write f0 [2368657,11784] 0 2023-12-06T15:00:09.849 INFO:tasks.workunit.client.1.smithi190.stdout:6/28: write f0 [3564275,46410] 0 2023-12-06T15:00:09.854 INFO:tasks.workunit.client.1.smithi190.stdout:1/32: dwrite f0 [0,4194304] 0 2023-12-06T15:00:09.855 INFO:tasks.workunit.client.1.smithi190.stdout:1/33: unlink f5 0 2023-12-06T15:00:09.855 INFO:tasks.workunit.client.1.smithi190.stdout:7/41: dwrite d0/f6 [0,4194304] 0 2023-12-06T15:00:09.862 INFO:tasks.workunit.client.1.smithi190.stdout:7/42: dread d0/f3 [0,4194304] 0 2023-12-06T15:00:09.863 INFO:tasks.workunit.client.1.smithi190.stdout:9/35: dwrite d4/f6 [0,4194304] 0 2023-12-06T15:00:09.863 INFO:tasks.workunit.client.1.smithi190.stdout:7/43: read d0/f3 [3516380,40452] 0 2023-12-06T15:00:09.865 INFO:tasks.workunit.client.1.smithi190.stdout:9/36: unlink d4/c9 0 2023-12-06T15:00:09.867 INFO:tasks.workunit.client.0.smithi152.stdout:4/72: truncate d2/ff 1110202 0 2023-12-06T15:00:09.867 INFO:tasks.workunit.client.0.smithi152.stdout:4/73: truncate d2/f8 1701952 0 2023-12-06T15:00:09.867 INFO:tasks.workunit.client.1.smithi190.stdout:7/44: creat d0/d5/da/fb x:0 0 0 2023-12-06T15:00:09.867 INFO:tasks.workunit.client.1.smithi190.stdout:7/45: stat d0/d5/l7 0 2023-12-06T15:00:09.867 INFO:tasks.workunit.client.1.smithi190.stdout:7/46: write d0/f6 [4761661,14874] 0 2023-12-06T15:00:09.868 INFO:tasks.workunit.client.1.smithi190.stdout:7/47: write d0/d5/f8 [450558,128565] 0 2023-12-06T15:00:09.868 INFO:tasks.workunit.client.0.smithi152.stdout:4/74: unlink d2/c5 0 2023-12-06T15:00:09.868 INFO:tasks.workunit.client.1.smithi190.stdout:9/37: rename d4/fb to d4/ff 0 2023-12-06T15:00:09.869 INFO:tasks.workunit.client.0.smithi152.stdout:2/18: write f0 [2390690,29951] 0 2023-12-06T15:00:09.869 INFO:tasks.workunit.client.0.smithi152.stdout:2/19: rmdir - no directory 2023-12-06T15:00:09.869 INFO:tasks.workunit.client.0.smithi152.stdout:4/75: creat d2/d10/f17 x:0 0 0 2023-12-06T15:00:09.870 INFO:tasks.workunit.client.1.smithi190.stdout:9/38: mknod d4/c10 0 2023-12-06T15:00:09.871 INFO:tasks.workunit.client.1.smithi190.stdout:9/39: creat d4/f11 x:0 0 0 2023-12-06T15:00:09.871 INFO:tasks.workunit.client.0.smithi152.stdout:4/76: creat d2/d10/d13/f18 x:0 0 0 2023-12-06T15:00:09.873 INFO:tasks.workunit.client.1.smithi190.stdout:9/40: rename d4/c10 to d4/c12 0 2023-12-06T15:00:09.873 INFO:tasks.workunit.client.0.smithi152.stdout:2/20: mkdir d6 0 2023-12-06T15:00:09.873 INFO:tasks.workunit.client.0.smithi152.stdout:2/21: chown f4 57 1 2023-12-06T15:00:09.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:09 smithi152 ceph-mon[111954]: pgmap v16: 65 pgs: 65 active+clean; 172 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.5 MiB/s rd, 9.3 MiB/s wr, 768 op/s 2023-12-06T15:00:09.880 INFO:tasks.workunit.client.1.smithi190.stdout:1/34: dwrite f0 [0,4194304] 0 2023-12-06T15:00:09.881 INFO:tasks.workunit.client.0.smithi152.stdout:1/13: unlink l2 0 2023-12-06T15:00:09.882 INFO:tasks.workunit.client.0.smithi152.stdout:1/14: creat d3/f6 x:0 0 0 2023-12-06T15:00:09.883 INFO:tasks.workunit.client.1.smithi190.stdout:7/48: truncate d0/f3 5482620 0 2023-12-06T15:00:09.885 INFO:tasks.workunit.client.1.smithi190.stdout:7/49: getdents d0/d5/da 0 2023-12-06T15:00:09.886 INFO:tasks.workunit.client.0.smithi152.stdout:1/15: write f0 [351494,9768] 0 2023-12-06T15:00:09.887 INFO:tasks.workunit.client.1.smithi190.stdout:1/35: dread f1 [0,4194304] 0 2023-12-06T15:00:09.888 INFO:tasks.workunit.client.1.smithi190.stdout:7/50: read d0/f6 [2037909,22559] 0 2023-12-06T15:00:09.888 INFO:tasks.workunit.client.0.smithi152.stdout:1/16: rename d3/f6 to d3/f7 0 2023-12-06T15:00:09.889 INFO:tasks.workunit.client.0.smithi152.stdout:4/77: dwrite d2/f8 [0,4194304] 0 2023-12-06T15:00:09.889 INFO:tasks.workunit.client.1.smithi190.stdout:6/29: dwrite f0 [0,4194304] 0 2023-12-06T15:00:09.889 INFO:tasks.workunit.client.1.smithi190.stdout:1/36: mkdir d6 0 2023-12-06T15:00:09.889 INFO:tasks.workunit.client.1.smithi190.stdout:1/37: readlink l4 0 2023-12-06T15:00:09.889 INFO:tasks.workunit.client.1.smithi190.stdout:1/38: chown f1 4456 1 2023-12-06T15:00:09.889 INFO:tasks.workunit.client.1.smithi190.stdout:7/51: creat d0/fc x:0 0 0 2023-12-06T15:00:09.890 INFO:tasks.workunit.client.1.smithi190.stdout:6/30: read f0 [2868460,39013] 0 2023-12-06T15:00:09.890 INFO:tasks.workunit.client.0.smithi152.stdout:1/17: symlink d3/l8 0 2023-12-06T15:00:09.891 INFO:tasks.workunit.client.1.smithi190.stdout:9/41: unlink d4/c12 0 2023-12-06T15:00:09.891 INFO:tasks.workunit.client.1.smithi190.stdout:9/42: fdatasync f3 0 2023-12-06T15:00:09.892 INFO:tasks.workunit.client.0.smithi152.stdout:1/18: mknod d3/c9 0 2023-12-06T15:00:09.893 INFO:tasks.workunit.client.1.smithi190.stdout:1/39: mkdir d6/d7 0 2023-12-06T15:00:09.893 INFO:tasks.workunit.client.0.smithi152.stdout:1/19: mkdir d3/da 0 2023-12-06T15:00:09.894 INFO:tasks.workunit.client.0.smithi152.stdout:1/20: mkdir d3/da/db 0 2023-12-06T15:00:09.894 INFO:tasks.workunit.client.1.smithi190.stdout:7/52: mknod d0/cd 0 2023-12-06T15:00:09.896 INFO:tasks.workunit.client.1.smithi190.stdout:9/43: truncate f2 2068069 0 2023-12-06T15:00:09.896 INFO:tasks.workunit.client.1.smithi190.stdout:9/44: chown f1 110 1 2023-12-06T15:00:09.896 INFO:tasks.workunit.client.1.smithi190.stdout:9/45: fsync d4/fa 0 2023-12-06T15:00:09.896 INFO:tasks.workunit.client.0.smithi152.stdout:1/21: creat d3/da/fc x:0 0 0 2023-12-06T15:00:09.897 INFO:tasks.workunit.client.0.smithi152.stdout:1/22: rename d3/da/fc to d3/fd 0 2023-12-06T15:00:09.898 INFO:tasks.workunit.client.0.smithi152.stdout:1/23: write d3/fd [290112,14667] 0 2023-12-06T15:00:09.898 INFO:tasks.workunit.client.1.smithi190.stdout:1/40: link l2 d6/l8 0 2023-12-06T15:00:09.898 INFO:tasks.workunit.client.1.smithi190.stdout:1/41: chown f1 3876474 1 2023-12-06T15:00:09.898 INFO:tasks.workunit.client.1.smithi190.stdout:1/42: chown d6/d7 69433268 1 2023-12-06T15:00:09.899 INFO:tasks.workunit.client.1.smithi190.stdout:7/53: mknod d0/d5/ce 0 2023-12-06T15:00:09.901 INFO:tasks.workunit.client.1.smithi190.stdout:7/54: mkdir d0/df 0 2023-12-06T15:00:09.902 INFO:tasks.workunit.client.0.smithi152.stdout:2/22: dread f1 [0,4194304] 0 2023-12-06T15:00:09.903 INFO:tasks.workunit.client.1.smithi190.stdout:7/55: mkdir d0/df/d10 0 2023-12-06T15:00:09.905 INFO:tasks.workunit.client.1.smithi190.stdout:7/56: mkdir d0/d5/d11 0 2023-12-06T15:00:09.905 INFO:tasks.workunit.client.0.smithi152.stdout:0/32: rmdir d8 39 2023-12-06T15:00:09.906 INFO:tasks.workunit.client.0.smithi152.stdout:0/33: write d8/f9 [975997,120470] 0 2023-12-06T15:00:09.906 INFO:tasks.workunit.client.0.smithi152.stdout:0/34: write d8/f9 [587627,34894] 0 2023-12-06T15:00:09.907 INFO:tasks.workunit.client.0.smithi152.stdout:0/35: read f4 [469419,86558] 0 2023-12-06T15:00:09.909 INFO:tasks.workunit.client.0.smithi152.stdout:0/36: rename f7 to d8/fb 0 2023-12-06T15:00:09.909 INFO:tasks.workunit.client.0.smithi152.stdout:4/78: dwrite d2/fc [0,4194304] 0 2023-12-06T15:00:09.910 INFO:tasks.workunit.client.0.smithi152.stdout:1/24: dread d3/fd [0,4194304] 0 2023-12-06T15:00:09.910 INFO:tasks.workunit.client.0.smithi152.stdout:1/25: write d3/fd [1054227,74355] 0 2023-12-06T15:00:09.911 INFO:tasks.workunit.client.0.smithi152.stdout:0/37: symlink d8/lc 0 2023-12-06T15:00:09.914 INFO:tasks.workunit.client.1.smithi190.stdout:6/31: truncate f0 1811220 0 2023-12-06T15:00:09.918 INFO:tasks.workunit.client.0.smithi152.stdout:9/8: write d0/f1 [2279809,54637] 0 2023-12-06T15:00:09.919 INFO:tasks.workunit.client.0.smithi152.stdout:9/9: write d0/f1 [1938305,53828] 0 2023-12-06T15:00:09.924 INFO:tasks.workunit.client.0.smithi152.stdout:0/38: dread d8/fb [0,4194304] 0 2023-12-06T15:00:09.924 INFO:tasks.workunit.client.0.smithi152.stdout:0/39: truncate f5 791620 0 2023-12-06T15:00:09.924 INFO:tasks.workunit.client.0.smithi152.stdout:0/40: fdatasync d8/fa 0 2023-12-06T15:00:09.926 INFO:tasks.workunit.client.1.smithi190.stdout:1/43: dwrite f3 [0,4194304] 0 2023-12-06T15:00:09.926 INFO:tasks.workunit.client.0.smithi152.stdout:2/23: truncate f4 455073 0 2023-12-06T15:00:09.929 INFO:tasks.workunit.client.1.smithi190.stdout:1/44: creat d6/d7/f9 x:0 0 0 2023-12-06T15:00:09.931 INFO:tasks.workunit.client.0.smithi152.stdout:4/79: dread d2/fd [0,4194304] 0 2023-12-06T15:00:09.931 INFO:tasks.workunit.client.0.smithi152.stdout:4/80: fdatasync d2/fd 0 2023-12-06T15:00:09.937 INFO:tasks.workunit.client.1.smithi190.stdout:9/46: dwrite f2 [0,4194304] 0 2023-12-06T15:00:09.943 INFO:tasks.workunit.client.1.smithi190.stdout:1/45: dread f1 [0,4194304] 0 2023-12-06T15:00:09.943 INFO:tasks.workunit.client.1.smithi190.stdout:1/46: chown d6/d7 217041945 1 2023-12-06T15:00:09.945 INFO:tasks.workunit.client.1.smithi190.stdout:1/47: rmdir d6/d7 39 2023-12-06T15:00:09.948 INFO:tasks.workunit.client.1.smithi190.stdout:1/48: symlink d6/d7/la 0 2023-12-06T15:00:09.948 INFO:tasks.workunit.client.0.smithi152.stdout:4/81: dread d2/f8 [0,4194304] 0 2023-12-06T15:00:09.949 INFO:tasks.workunit.client.0.smithi152.stdout:4/82: creat d2/d15/f19 x:0 0 0 2023-12-06T15:00:09.954 INFO:tasks.workunit.client.1.smithi190.stdout:9/47: dread f0 [0,4194304] 0 2023-12-06T15:00:09.954 INFO:tasks.workunit.client.1.smithi190.stdout:9/48: read - d4/fc zero size 2023-12-06T15:00:09.957 INFO:tasks.workunit.client.1.smithi190.stdout:1/49: dread f1 [0,4194304] 0 2023-12-06T15:00:09.958 INFO:tasks.workunit.client.1.smithi190.stdout:9/49: dread f0 [0,4194304] 0 2023-12-06T15:00:09.958 INFO:tasks.workunit.client.1.smithi190.stdout:1/50: rename l4 to d6/lb 0 2023-12-06T15:00:09.959 INFO:tasks.workunit.client.1.smithi190.stdout:9/50: creat d4/f13 x:0 0 0 2023-12-06T15:00:09.960 INFO:tasks.workunit.client.1.smithi190.stdout:9/51: creat d4/f14 x:0 0 0 2023-12-06T15:00:09.960 INFO:tasks.workunit.client.1.smithi190.stdout:9/52: creat d4/f15 x:0 0 0 2023-12-06T15:00:09.962 INFO:tasks.workunit.client.1.smithi190.stdout:9/53: mknod d4/c16 0 2023-12-06T15:00:09.962 INFO:tasks.workunit.client.1.smithi190.stdout:9/54: fdatasync d4/f11 0 2023-12-06T15:00:09.962 INFO:tasks.workunit.client.1.smithi190.stdout:9/55: stat d4/fd 0 2023-12-06T15:00:09.968 INFO:tasks.workunit.client.0.smithi152.stdout:9/10: dwrite d0/f1 [0,4194304] 0 2023-12-06T15:00:09.969 INFO:tasks.workunit.client.1.smithi190.stdout:6/32: dwrite f0 [0,4194304] 0 2023-12-06T15:00:09.969 INFO:tasks.workunit.client.0.smithi152.stdout:1/26: dwrite f0 [0,4194304] 0 2023-12-06T15:00:09.971 INFO:tasks.workunit.client.1.smithi190.stdout:6/33: write f0 [642746,116504] 0 2023-12-06T15:00:09.971 INFO:tasks.workunit.client.0.smithi152.stdout:2/24: dwrite f5 [0,4194304] 0 2023-12-06T15:00:09.971 INFO:tasks.workunit.client.0.smithi152.stdout:1/27: rmdir d3/da 39 2023-12-06T15:00:09.972 INFO:tasks.workunit.client.0.smithi152.stdout:9/11: write d0/f1 [2000354,115182] 0 2023-12-06T15:00:09.974 INFO:tasks.workunit.client.0.smithi152.stdout:0/41: dwrite d8/f9 [0,4194304] 0 2023-12-06T15:00:09.974 INFO:tasks.workunit.client.1.smithi190.stdout:1/51: dread f3 [0,4194304] 0 2023-12-06T15:00:09.974 INFO:tasks.workunit.client.0.smithi152.stdout:1/28: rename d3/c9 to d3/da/ce 0 2023-12-06T15:00:09.976 INFO:tasks.workunit.client.1.smithi190.stdout:9/56: rmdir d4 39 2023-12-06T15:00:09.979 INFO:tasks.workunit.client.1.smithi190.stdout:9/57: link d4/f15 d4/f17 0 2023-12-06T15:00:09.979 INFO:tasks.workunit.client.1.smithi190.stdout:9/58: dread - d4/f15 zero size 2023-12-06T15:00:09.979 INFO:tasks.workunit.client.1.smithi190.stdout:9/59: dread - d4/fe zero size 2023-12-06T15:00:09.979 INFO:tasks.workunit.client.0.smithi152.stdout:0/42: link d8/fa d8/fd 0 2023-12-06T15:00:09.980 INFO:tasks.workunit.client.0.smithi152.stdout:0/43: chown d8/lc 44 1 2023-12-06T15:00:09.982 INFO:tasks.workunit.client.0.smithi152.stdout:1/29: creat d3/da/db/ff x:0 0 0 2023-12-06T15:00:09.982 INFO:tasks.workunit.client.0.smithi152.stdout:1/30: dread - d3/f5 zero size 2023-12-06T15:00:09.985 INFO:tasks.workunit.client.0.smithi152.stdout:1/31: symlink d3/da/db/l10 0 2023-12-06T15:00:09.989 INFO:tasks.workunit.client.1.smithi190.stdout:1/52: dread f0 [0,4194304] 0 2023-12-06T15:00:09.990 INFO:tasks.workunit.client.0.smithi152.stdout:1/32: creat d3/da/db/f11 x:0 0 0 2023-12-06T15:00:09.991 INFO:tasks.workunit.client.0.smithi152.stdout:0/44: write d8/f9 [4801599,22627] 0 2023-12-06T15:00:09.993 INFO:tasks.workunit.client.0.smithi152.stdout:0/45: symlink d8/le 0 2023-12-06T15:00:09.993 INFO:tasks.workunit.client.0.smithi152.stdout:0/46: write f5 [1182861,32457] 0 2023-12-06T15:00:09.993 INFO:tasks.workunit.client.0.smithi152.stdout:1/33: symlink d3/da/db/l12 0 2023-12-06T15:00:09.995 INFO:tasks.workunit.client.0.smithi152.stdout:1/34: mknod d3/da/c13 0 2023-12-06T15:00:09.995 INFO:tasks.workunit.client.0.smithi152.stdout:1/35: write d3/da/db/f11 [34407,69396] 0 2023-12-06T15:00:10.007 INFO:tasks.workunit.client.1.smithi190.stdout:6/34: dwrite f0 [0,4194304] 0 2023-12-06T15:00:10.008 INFO:tasks.workunit.client.1.smithi190.stdout:1/53: dwrite f0 [0,4194304] 0 2023-12-06T15:00:10.008 INFO:tasks.workunit.client.0.smithi152.stdout:9/12: dwrite d0/f1 [0,4194304] 0 2023-12-06T15:00:10.008 INFO:tasks.workunit.client.0.smithi152.stdout:9/13: fsync d0/f1 0 2023-12-06T15:00:10.008 INFO:tasks.workunit.client.1.smithi190.stdout:9/60: dwrite d4/f14 [0,4194304] 0 2023-12-06T15:00:10.009 INFO:tasks.workunit.client.1.smithi190.stdout:1/54: truncate f1 558029 0 2023-12-06T15:00:10.009 INFO:tasks.workunit.client.1.smithi190.stdout:1/55: write f0 [5142153,76353] 0 2023-12-06T15:00:10.009 INFO:tasks.workunit.client.0.smithi152.stdout:9/14: write d0/f1 [1778741,72703] 0 2023-12-06T15:00:10.011 INFO:tasks.workunit.client.1.smithi190.stdout:9/61: link f1 d4/f18 0 2023-12-06T15:00:10.013 INFO:tasks.workunit.client.1.smithi190.stdout:1/56: rename d6/d7 to d6/dc 0 2023-12-06T15:00:10.013 INFO:tasks.workunit.client.0.smithi152.stdout:0/47: fdatasync f5 0 2023-12-06T15:00:10.014 INFO:tasks.workunit.client.0.smithi152.stdout:9/15: fsync d0/f1 0 2023-12-06T15:00:10.015 INFO:tasks.workunit.client.0.smithi152.stdout:9/16: write d0/f1 [1222278,59094] 0 2023-12-06T15:00:10.017 INFO:tasks.workunit.client.1.smithi190.stdout:9/62: symlink d4/l19 0 2023-12-06T15:00:10.017 INFO:tasks.workunit.client.1.smithi190.stdout:9/63: write d4/f11 [28402,6372] 0 2023-12-06T15:00:10.019 INFO:tasks.workunit.client.1.smithi190.stdout:9/64: unlink d4/fd 0 2023-12-06T15:00:10.019 INFO:tasks.workunit.client.0.smithi152.stdout:0/48: creat d8/ff x:0 0 0 2023-12-06T15:00:10.019 INFO:tasks.workunit.client.0.smithi152.stdout:0/49: mkdir d8/d10 0 2023-12-06T15:00:10.019 INFO:tasks.workunit.client.0.smithi152.stdout:0/50: write f4 [1081551,4006] 0 2023-12-06T15:00:10.021 INFO:tasks.workunit.client.1.smithi190.stdout:9/65: rename d4/c8 to d4/c1a 0 2023-12-06T15:00:10.022 INFO:tasks.workunit.client.0.smithi152.stdout:0/51: rmdir d8/d10 0 2023-12-06T15:00:10.022 INFO:tasks.workunit.client.1.smithi190.stdout:9/66: symlink d4/l1b 0 2023-12-06T15:00:10.023 INFO:tasks.workunit.client.1.smithi190.stdout:9/67: dread - d4/ff zero size 2023-12-06T15:00:10.026 INFO:tasks.workunit.client.1.smithi190.stdout:6/35: dread f0 [0,4194304] 0 2023-12-06T15:00:10.030 INFO:tasks.workunit.client.1.smithi190.stdout:6/36: dread f0 [0,4194304] 0 2023-12-06T15:00:10.030 INFO:tasks.workunit.client.1.smithi190.stdout:6/37: write f0 [1944865,21849] 0 2023-12-06T15:00:10.035 INFO:tasks.workunit.client.0.smithi152.stdout:1/36: dwrite d3/da/db/f11 [0,4194304] 0 2023-12-06T15:00:10.037 INFO:tasks.workunit.client.0.smithi152.stdout:1/37: mkdir d3/d14 0 2023-12-06T15:00:10.037 INFO:tasks.workunit.client.0.smithi152.stdout:1/38: dread - d3/f7 zero size 2023-12-06T15:00:10.038 INFO:tasks.workunit.client.0.smithi152.stdout:1/39: chown d3/da/db 5452 1 2023-12-06T15:00:10.038 INFO:tasks.workunit.client.1.smithi190.stdout:1/57: dwrite d6/dc/f9 [0,4194304] 0 2023-12-06T15:00:10.039 INFO:tasks.workunit.client.0.smithi152.stdout:1/40: mkdir d3/da/d15 0 2023-12-06T15:00:10.040 INFO:tasks.workunit.client.1.smithi190.stdout:6/38: dread f0 [0,4194304] 0 2023-12-06T15:00:10.040 INFO:tasks.workunit.client.1.smithi190.stdout:1/58: read f0 [2382779,75519] 0 2023-12-06T15:00:10.040 INFO:tasks.workunit.client.0.smithi152.stdout:1/41: symlink d3/d14/l16 0 2023-12-06T15:00:10.041 INFO:tasks.workunit.client.0.smithi152.stdout:1/42: mkdir d3/da/d15/d17 0 2023-12-06T15:00:10.042 INFO:tasks.workunit.client.1.smithi190.stdout:6/39: rename d4/c5 to d4/c7 0 2023-12-06T15:00:10.043 INFO:tasks.workunit.client.1.smithi190.stdout:1/59: getdents d6 0 2023-12-06T15:00:10.056 INFO:tasks.workunit.client.1.smithi190.stdout:1/60: dread f0 [0,4194304] 0 2023-12-06T15:00:10.057 INFO:tasks.workunit.client.1.smithi190.stdout:1/61: mknod d6/dc/cd 0 2023-12-06T15:00:10.060 INFO:tasks.workunit.client.1.smithi190.stdout:9/68: dwrite f0 [0,4194304] 0 2023-12-06T15:00:10.061 INFO:tasks.workunit.client.0.smithi152.stdout:0/52: dwrite d8/ff [0,4194304] 0 2023-12-06T15:00:10.061 INFO:tasks.workunit.client.0.smithi152.stdout:0/53: chown d8/fb 22609 1 2023-12-06T15:00:10.062 INFO:tasks.workunit.client.0.smithi152.stdout:0/54: write d8/fa [141319,47645] 0 2023-12-06T15:00:10.062 INFO:tasks.workunit.client.0.smithi152.stdout:9/17: dwrite d0/f1 [0,4194304] 0 2023-12-06T15:00:10.062 INFO:tasks.workunit.client.0.smithi152.stdout:9/18: write d0/f1 [4763937,3619] 0 2023-12-06T15:00:10.062 INFO:tasks.workunit.client.0.smithi152.stdout:9/19: chown d0 5366032 1 2023-12-06T15:00:10.062 INFO:tasks.workunit.client.0.smithi152.stdout:0/55: write f5 [1143168,78277] 0 2023-12-06T15:00:10.062 INFO:tasks.workunit.client.1.smithi190.stdout:1/62: write f3 [1044638,104035] 0 2023-12-06T15:00:10.064 INFO:tasks.workunit.client.0.smithi152.stdout:0/56: mknod d8/c11 0 2023-12-06T15:00:10.065 INFO:tasks.workunit.client.0.smithi152.stdout:0/57: chown d8 10980 1 2023-12-06T15:00:10.065 INFO:tasks.workunit.client.1.smithi190.stdout:1/63: symlink d6/dc/le 0 2023-12-06T15:00:10.065 INFO:tasks.workunit.client.0.smithi152.stdout:9/20: write d0/f1 [309466,5747] 0 2023-12-06T15:00:10.068 INFO:tasks.workunit.client.0.smithi152.stdout:1/43: rename d3/d14 to d3/da/db/d18 0 2023-12-06T15:00:10.068 INFO:tasks.workunit.client.1.smithi190.stdout:6/40: truncate f0 1471939 0 2023-12-06T15:00:10.069 INFO:tasks.workunit.client.1.smithi190.stdout:6/41: symlink d4/l8 0 2023-12-06T15:00:10.069 INFO:tasks.workunit.client.1.smithi190.stdout:6/42: stat d4 0 2023-12-06T15:00:10.070 INFO:tasks.workunit.client.1.smithi190.stdout:1/64: dread f1 [0,4194304] 0 2023-12-06T15:00:10.070 INFO:tasks.workunit.client.0.smithi152.stdout:1/44: symlink d3/da/db/d18/l19 0 2023-12-06T15:00:10.070 INFO:tasks.workunit.client.1.smithi190.stdout:1/65: write f1 [200700,51232] 0 2023-12-06T15:00:10.071 INFO:tasks.workunit.client.0.smithi152.stdout:0/58: truncate f5 782553 0 2023-12-06T15:00:10.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:09 smithi190 ceph-mon[121340]: pgmap v16: 65 pgs: 65 active+clean; 172 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.5 MiB/s rd, 9.3 MiB/s wr, 768 op/s 2023-12-06T15:00:10.074 INFO:tasks.workunit.client.0.smithi152.stdout:0/59: unlink l6 0 2023-12-06T15:00:10.074 INFO:tasks.workunit.client.0.smithi152.stdout:0/60: write d8/f9 [1167664,104855] 0 2023-12-06T15:00:10.076 INFO:tasks.workunit.client.1.smithi190.stdout:1/66: truncate f0 4844399 0 2023-12-06T15:00:10.076 INFO:tasks.workunit.client.0.smithi152.stdout:9/21: dread d0/f1 [0,4194304] 0 2023-12-06T15:00:10.077 INFO:tasks.workunit.client.1.smithi190.stdout:6/43: write f0 [1849864,36555] 0 2023-12-06T15:00:10.077 INFO:tasks.workunit.client.1.smithi190.stdout:1/67: link d6/dc/f9 d6/dc/ff 0 2023-12-06T15:00:10.080 INFO:tasks.workunit.client.0.smithi152.stdout:9/22: symlink d0/l3 0 2023-12-06T15:00:10.080 INFO:tasks.workunit.client.0.smithi152.stdout:9/23: read d0/f1 [4372720,28511] 0 2023-12-06T15:00:10.080 INFO:tasks.workunit.client.0.smithi152.stdout:9/24: readlink d0/l3 0 2023-12-06T15:00:10.087 INFO:tasks.workunit.client.1.smithi190.stdout:1/68: dread d6/dc/f9 [0,4194304] 0 2023-12-06T15:00:10.088 INFO:tasks.workunit.client.1.smithi190.stdout:6/44: dread f0 [0,4194304] 0 2023-12-06T15:00:10.090 INFO:tasks.workunit.client.1.smithi190.stdout:1/69: write f0 [3372545,109942] 0 2023-12-06T15:00:10.090 INFO:tasks.workunit.client.1.smithi190.stdout:6/45: getdents d4 0 2023-12-06T15:00:10.090 INFO:tasks.workunit.client.1.smithi190.stdout:6/46: truncate f0 2926560 0 2023-12-06T15:00:10.090 INFO:tasks.workunit.client.1.smithi190.stdout:6/47: getdents d4 0 2023-12-06T15:00:10.091 INFO:tasks.workunit.client.1.smithi190.stdout:1/70: write d6/dc/ff [1661462,46656] 0 2023-12-06T15:00:10.092 INFO:tasks.workunit.client.1.smithi190.stdout:6/48: rename f0 to d4/f9 0 2023-12-06T15:00:10.093 INFO:tasks.workunit.client.0.smithi152.stdout:1/45: dwrite d3/da/db/f11 [0,4194304] 0 2023-12-06T15:00:10.093 INFO:tasks.workunit.client.0.smithi152.stdout:1/46: dread - d3/da/db/ff zero size 2023-12-06T15:00:10.095 INFO:tasks.workunit.client.1.smithi190.stdout:1/71: fsync d6/dc/ff 0 2023-12-06T15:00:10.095 INFO:tasks.workunit.client.1.smithi190.stdout:1/72: getdents d6 0 2023-12-06T15:00:10.095 INFO:tasks.workunit.client.1.smithi190.stdout:1/73: chown d6/l8 28 1 2023-12-06T15:00:10.095 INFO:tasks.workunit.client.0.smithi152.stdout:9/25: getdents d0 0 2023-12-06T15:00:10.096 INFO:tasks.workunit.client.0.smithi152.stdout:9/26: mknod d0/c4 0 2023-12-06T15:00:10.096 INFO:tasks.workunit.client.0.smithi152.stdout:9/27: fsync d0/f1 0 2023-12-06T15:00:10.097 INFO:tasks.workunit.client.0.smithi152.stdout:9/28: write d0/f1 [2917308,82227] 0 2023-12-06T15:00:10.102 INFO:tasks.workunit.client.1.smithi190.stdout:6/49: truncate d4/f9 2565603 0 2023-12-06T15:00:10.102 INFO:tasks.workunit.client.0.smithi152.stdout:9/29: creat d0/f5 x:0 0 0 2023-12-06T15:00:10.103 INFO:tasks.workunit.client.0.smithi152.stdout:9/30: creat d0/f6 x:0 0 0 2023-12-06T15:00:10.103 INFO:tasks.workunit.client.0.smithi152.stdout:9/31: dread - d0/f5 zero size 2023-12-06T15:00:10.104 INFO:tasks.workunit.client.0.smithi152.stdout:9/32: creat d0/f7 x:0 0 0 2023-12-06T15:00:10.105 INFO:tasks.workunit.client.0.smithi152.stdout:9/33: creat d0/f8 x:0 0 0 2023-12-06T15:00:10.105 INFO:tasks.workunit.client.0.smithi152.stdout:9/34: chown d0/f5 27455449 1 2023-12-06T15:00:10.107 INFO:tasks.workunit.client.0.smithi152.stdout:9/35: creat d0/f9 x:0 0 0 2023-12-06T15:00:10.107 INFO:tasks.workunit.client.0.smithi152.stdout:9/36: write d0/f6 [522643,58128] 0 2023-12-06T15:00:10.109 INFO:tasks.workunit.client.0.smithi152.stdout:9/37: creat d0/fa x:0 0 0 2023-12-06T15:00:10.112 INFO:tasks.workunit.client.0.smithi152.stdout:0/61: dwrite d8/fd [0,4194304] 0 2023-12-06T15:00:10.118 INFO:tasks.workunit.client.0.smithi152.stdout:0/62: write d8/fa [1431916,21695] 0 2023-12-06T15:00:10.119 INFO:tasks.workunit.client.0.smithi152.stdout:0/63: mknod d8/c12 0 2023-12-06T15:00:10.124 INFO:tasks.workunit.client.1.smithi190.stdout:1/74: dwrite f3 [0,4194304] 0 2023-12-06T15:00:10.124 INFO:tasks.workunit.client.1.smithi190.stdout:1/75: truncate f1 763744 0 2023-12-06T15:00:10.125 INFO:tasks.workunit.client.0.smithi152.stdout:1/47: dwrite d3/f5 [0,4194304] 0 2023-12-06T15:00:10.127 INFO:tasks.workunit.client.0.smithi152.stdout:9/38: dread d0/f1 [0,4194304] 0 2023-12-06T15:00:10.128 INFO:tasks.workunit.client.1.smithi190.stdout:1/76: dread f1 [0,4194304] 0 2023-12-06T15:00:10.128 INFO:tasks.workunit.client.1.smithi190.stdout:1/77: chown d6/dc/ff 0 1 2023-12-06T15:00:10.128 INFO:tasks.workunit.client.1.smithi190.stdout:6/50: truncate d4/f9 2547078 0 2023-12-06T15:00:10.129 INFO:tasks.workunit.client.0.smithi152.stdout:1/48: mkdir d3/da/d15/d17/d1a 0 2023-12-06T15:00:10.129 INFO:tasks.workunit.client.1.smithi190.stdout:1/78: symlink d6/dc/l10 0 2023-12-06T15:00:10.129 INFO:tasks.workunit.client.0.smithi152.stdout:1/49: write d3/f5 [2043742,89411] 0 2023-12-06T15:00:10.130 INFO:tasks.workunit.client.1.smithi190.stdout:6/51: mknod d4/ca 0 2023-12-06T15:00:10.130 INFO:tasks.workunit.client.0.smithi152.stdout:9/39: rename d0/l3 to d0/lb 0 2023-12-06T15:00:10.130 INFO:tasks.workunit.client.0.smithi152.stdout:9/40: truncate d0/f8 721206 0 2023-12-06T15:00:10.131 INFO:tasks.workunit.client.0.smithi152.stdout:9/41: truncate d0/fa 800253 0 2023-12-06T15:00:10.131 INFO:tasks.workunit.client.1.smithi190.stdout:1/79: dread f1 [0,4194304] 0 2023-12-06T15:00:10.131 INFO:tasks.workunit.client.1.smithi190.stdout:1/80: rmdir d6 39 2023-12-06T15:00:10.132 INFO:tasks.workunit.client.1.smithi190.stdout:6/52: write d4/f9 [243446,128117] 0 2023-12-06T15:00:10.133 INFO:tasks.workunit.client.0.smithi152.stdout:1/50: creat d3/f1b x:0 0 0 2023-12-06T15:00:10.133 INFO:tasks.workunit.client.0.smithi152.stdout:1/51: write d3/f7 [201264,106081] 0 2023-12-06T15:00:10.133 INFO:tasks.workunit.client.1.smithi190.stdout:1/81: creat d6/f11 x:0 0 0 2023-12-06T15:00:10.135 INFO:tasks.workunit.client.1.smithi190.stdout:6/53: rename d4/c7 to d4/cb 0 2023-12-06T15:00:10.135 INFO:tasks.workunit.client.1.smithi190.stdout:6/54: truncate d4/f9 3387261 0 2023-12-06T15:00:10.135 INFO:tasks.workunit.client.0.smithi152.stdout:1/52: truncate f0 4136162 0 2023-12-06T15:00:10.137 INFO:tasks.workunit.client.0.smithi152.stdout:1/53: getdents d3/da/d15/d17 0 2023-12-06T15:00:10.137 INFO:tasks.workunit.client.1.smithi190.stdout:6/55: fsync d4/f9 0 2023-12-06T15:00:10.138 INFO:tasks.workunit.client.0.smithi152.stdout:9/42: rmdir d0 39 2023-12-06T15:00:10.139 INFO:tasks.workunit.client.1.smithi190.stdout:1/82: getdents d6 0 2023-12-06T15:00:10.139 INFO:tasks.workunit.client.1.smithi190.stdout:1/83: getdents d6 0 2023-12-06T15:00:10.142 INFO:tasks.workunit.client.0.smithi152.stdout:9/43: mkdir d0/dc 0 2023-12-06T15:00:10.142 INFO:tasks.workunit.client.0.smithi152.stdout:9/44: chown d0/lb 1 1 2023-12-06T15:00:10.142 INFO:tasks.workunit.client.0.smithi152.stdout:9/45: truncate d0/f7 964411 0 2023-12-06T15:00:10.143 INFO:tasks.workunit.client.0.smithi152.stdout:9/46: mkdir d0/dd 0 2023-12-06T15:00:10.145 INFO:tasks.workunit.client.0.smithi152.stdout:9/47: creat d0/dd/fe x:0 0 0 2023-12-06T15:00:10.147 INFO:tasks.workunit.client.0.smithi152.stdout:9/48: link d0/fa d0/dd/ff 0 2023-12-06T15:00:10.148 INFO:tasks.workunit.client.0.smithi152.stdout:9/49: dread d0/f7 [0,4194304] 0 2023-12-06T15:00:10.148 INFO:tasks.workunit.client.0.smithi152.stdout:9/50: stat d0/f7 0 2023-12-06T15:00:10.149 INFO:tasks.workunit.client.0.smithi152.stdout:1/54: truncate d3/da/db/f11 3939558 0 2023-12-06T15:00:10.150 INFO:tasks.workunit.client.0.smithi152.stdout:1/55: creat d3/f1c x:0 0 0 2023-12-06T15:00:10.150 INFO:tasks.workunit.client.0.smithi152.stdout:1/56: dread - d3/f1b zero size 2023-12-06T15:00:10.151 INFO:tasks.workunit.client.1.smithi190.stdout:1/84: dread f3 [0,4194304] 0 2023-12-06T15:00:10.153 INFO:tasks.workunit.client.1.smithi190.stdout:1/85: creat d6/f12 x:0 0 0 2023-12-06T15:00:10.153 INFO:tasks.workunit.client.1.smithi190.stdout:1/86: fsync d6/dc/f9 0 2023-12-06T15:00:10.153 INFO:tasks.workunit.client.1.smithi190.stdout:1/87: chown d6/dc/cd 34463 1 2023-12-06T15:00:10.154 INFO:tasks.workunit.client.1.smithi190.stdout:1/88: creat d6/f13 x:0 0 0 2023-12-06T15:00:10.154 INFO:tasks.workunit.client.1.smithi190.stdout:1/89: fdatasync d6/dc/f9 0 2023-12-06T15:00:10.154 INFO:tasks.workunit.client.1.smithi190.stdout:1/90: dread - d6/f11 zero size 2023-12-06T15:00:10.163 INFO:tasks.workunit.client.0.smithi152.stdout:0/64: dwrite d8/fd [4194304,4194304] 0 2023-12-06T15:00:10.172 INFO:tasks.workunit.client.0.smithi152.stdout:9/51: dwrite d0/f8 [0,4194304] 0 2023-12-06T15:00:10.173 INFO:tasks.workunit.client.0.smithi152.stdout:9/52: symlink d0/dc/l10 0 2023-12-06T15:00:10.175 INFO:tasks.workunit.client.0.smithi152.stdout:9/53: rename d0/dc/l10 to d0/l11 0 2023-12-06T15:00:10.175 INFO:tasks.workunit.client.0.smithi152.stdout:9/54: readlink d0/lb 0 2023-12-06T15:00:10.181 INFO:tasks.workunit.client.1.smithi190.stdout:1/91: dwrite d6/f12 [0,4194304] 0 2023-12-06T15:00:10.181 INFO:tasks.workunit.client.0.smithi152.stdout:1/57: dwrite d3/f5 [0,4194304] 0 2023-12-06T15:00:10.182 INFO:tasks.workunit.client.0.smithi152.stdout:1/58: chown d3/da/d15/d17/d1a 956760 1 2023-12-06T15:00:10.185 INFO:tasks.workunit.client.1.smithi190.stdout:1/92: creat d6/f14 x:0 0 0 2023-12-06T15:00:10.186 INFO:tasks.workunit.client.1.smithi190.stdout:1/93: write d6/dc/ff [1525443,72318] 0 2023-12-06T15:00:10.189 INFO:tasks.workunit.client.1.smithi190.stdout:1/94: creat d6/dc/f15 x:0 0 0 2023-12-06T15:00:10.193 INFO:tasks.workunit.client.0.smithi152.stdout:0/65: dread d8/f9 [0,4194304] 0 2023-12-06T15:00:10.210 INFO:tasks.workunit.client.0.smithi152.stdout:1/59: dwrite f0 [0,4194304] 0 2023-12-06T15:00:10.211 INFO:tasks.workunit.client.0.smithi152.stdout:1/60: write d3/f1c [533603,61359] 0 2023-12-06T15:00:10.212 INFO:tasks.workunit.client.0.smithi152.stdout:1/61: rename f0 to d3/da/d15/f1d 0 2023-12-06T15:00:10.213 INFO:tasks.workunit.client.0.smithi152.stdout:9/55: dwrite d0/f6 [0,4194304] 0 2023-12-06T15:00:10.214 INFO:tasks.workunit.client.0.smithi152.stdout:0/66: dwrite d8/fb [0,4194304] 0 2023-12-06T15:00:10.214 INFO:tasks.workunit.client.1.smithi190.stdout:1/95: getdents d6 0 2023-12-06T15:00:10.215 INFO:tasks.workunit.client.0.smithi152.stdout:9/56: symlink d0/l12 0 2023-12-06T15:00:10.216 INFO:tasks.workunit.client.1.smithi190.stdout:1/96: mknod d6/dc/c16 0 2023-12-06T15:00:10.221 INFO:tasks.workunit.client.0.smithi152.stdout:1/62: dread d3/f5 [0,4194304] 0 2023-12-06T15:00:10.223 INFO:tasks.workunit.client.0.smithi152.stdout:0/67: dread d8/f9 [0,4194304] 0 2023-12-06T15:00:10.223 INFO:tasks.workunit.client.0.smithi152.stdout:0/68: chown f4 1502 1 2023-12-06T15:00:10.225 INFO:tasks.workunit.client.0.smithi152.stdout:1/63: creat d3/da/d15/f1e x:0 0 0 2023-12-06T15:00:10.225 INFO:tasks.workunit.client.0.smithi152.stdout:1/64: write d3/fd [1638474,100222] 0 2023-12-06T15:00:10.225 INFO:tasks.workunit.client.0.smithi152.stdout:0/69: getdents d8 0 2023-12-06T15:00:10.226 INFO:tasks.workunit.client.0.smithi152.stdout:9/57: dread d0/f6 [0,4194304] 0 2023-12-06T15:00:10.227 INFO:tasks.workunit.client.0.smithi152.stdout:1/65: creat d3/da/d15/d17/f1f x:0 0 0 2023-12-06T15:00:10.233 INFO:tasks.workunit.client.1.smithi190.stdout:1/97: dread f3 [0,4194304] 0 2023-12-06T15:00:10.234 INFO:tasks.workunit.client.1.smithi190.stdout:1/98: dread - d6/f11 zero size 2023-12-06T15:00:10.235 INFO:tasks.workunit.client.0.smithi152.stdout:9/58: truncate d0/f1 3050626 0 2023-12-06T15:00:10.236 INFO:tasks.workunit.client.1.smithi190.stdout:1/99: rename l2 to d6/dc/l17 0 2023-12-06T15:00:10.244 INFO:tasks.workunit.client.0.smithi152.stdout:9/59: dread d0/f6 [0,4194304] 0 2023-12-06T15:00:10.246 INFO:tasks.workunit.client.0.smithi152.stdout:9/60: mknod d0/c13 0 2023-12-06T15:00:10.247 INFO:tasks.workunit.client.0.smithi152.stdout:9/61: creat d0/f14 x:0 0 0 2023-12-06T15:00:10.254 INFO:tasks.workunit.client.1.smithi190.stdout:1/100: dwrite f3 [0,4194304] 0 2023-12-06T15:00:10.255 INFO:tasks.workunit.client.1.smithi190.stdout:1/101: mknod d6/dc/c18 0 2023-12-06T15:00:10.255 INFO:tasks.workunit.client.1.smithi190.stdout:1/102: truncate d6/f11 228887 0 2023-12-06T15:00:10.258 INFO:tasks.workunit.client.1.smithi190.stdout:1/103: write f3 [3842971,121081] 0 2023-12-06T15:00:10.261 INFO:tasks.workunit.client.0.smithi152.stdout:9/62: dwrite d0/f14 [0,4194304] 0 2023-12-06T15:00:10.261 INFO:tasks.workunit.client.0.smithi152.stdout:9/63: dread d0/f7 [0,4194304] 0 2023-12-06T15:00:10.275 INFO:tasks.workunit.client.1.smithi190.stdout:1/104: dwrite f0 [0,4194304] 0 2023-12-06T15:00:10.285 INFO:tasks.workunit.client.0.smithi152.stdout:9/64: dwrite d0/dd/fe [0,4194304] 0 2023-12-06T15:00:10.286 INFO:tasks.workunit.client.1.smithi190.stdout:1/105: dread f0 [0,4194304] 0 2023-12-06T15:00:10.286 INFO:tasks.workunit.client.1.smithi190.stdout:1/106: write d6/f14 [931328,112406] 0 2023-12-06T15:00:10.288 INFO:tasks.workunit.client.0.smithi152.stdout:9/65: rmdir d0 39 2023-12-06T15:00:10.293 INFO:tasks.workunit.client.1.smithi190.stdout:1/107: dread d6/dc/ff [0,4194304] 0 2023-12-06T15:00:10.293 INFO:tasks.workunit.client.1.smithi190.stdout:1/108: readlink d6/l8 0 2023-12-06T15:00:10.293 INFO:tasks.workunit.client.1.smithi190.stdout:1/109: readlink d6/dc/l10 0 2023-12-06T15:00:10.293 INFO:tasks.workunit.client.1.smithi190.stdout:1/110: fsync d6/f12 0 2023-12-06T15:00:10.294 INFO:tasks.workunit.client.1.smithi190.stdout:1/111: rename d6/dc/la to d6/dc/l19 0 2023-12-06T15:00:10.298 INFO:tasks.workunit.client.1.smithi190.stdout:1/112: rmdir d6/dc 39 2023-12-06T15:00:10.298 INFO:tasks.workunit.client.0.smithi152.stdout:9/66: dread d0/f8 [0,4194304] 0 2023-12-06T15:00:10.299 INFO:tasks.workunit.client.1.smithi190.stdout:1/113: mknod d6/c1a 0 2023-12-06T15:00:10.299 INFO:tasks.workunit.client.1.smithi190.stdout:1/114: creat d6/dc/f1b x:0 0 0 2023-12-06T15:00:10.300 INFO:tasks.workunit.client.0.smithi152.stdout:9/67: rmdir d0/dc 0 2023-12-06T15:00:10.300 INFO:tasks.workunit.client.1.smithi190.stdout:1/115: creat d6/f1c x:0 0 0 2023-12-06T15:00:10.307 INFO:tasks.workunit.client.1.smithi190.stdout:1/116: truncate f3 605795 0 2023-12-06T15:00:10.308 INFO:tasks.workunit.client.1.smithi190.stdout:1/117: symlink d6/dc/l1d 0 2023-12-06T15:00:10.315 INFO:tasks.workunit.client.0.smithi152.stdout:9/68: dwrite d0/f6 [0,4194304] 0 2023-12-06T15:00:10.317 INFO:tasks.workunit.client.0.smithi152.stdout:9/69: creat d0/f15 x:0 0 0 2023-12-06T15:00:10.317 INFO:tasks.workunit.client.0.smithi152.stdout:9/70: rmdir d0/dd 39 2023-12-06T15:00:10.321 INFO:tasks.workunit.client.1.smithi190.stdout:1/118: dwrite d6/dc/ff [4194304,4194304] 0 2023-12-06T15:00:10.323 INFO:tasks.workunit.client.0.smithi152.stdout:9/71: fsync d0/f15 0 2023-12-06T15:00:10.323 INFO:tasks.workunit.client.0.smithi152.stdout:9/72: chown d0 988322901 1 2023-12-06T15:00:10.324 INFO:tasks.workunit.client.1.smithi190.stdout:1/119: dread d6/dc/ff [0,4194304] 0 2023-12-06T15:00:10.325 INFO:tasks.workunit.client.1.smithi190.stdout:1/120: fsync d6/f13 0 2023-12-06T15:00:10.330 INFO:tasks.workunit.client.0.smithi152.stdout:9/73: dread d0/f6 [0,4194304] 0 2023-12-06T15:00:10.332 INFO:tasks.workunit.client.0.smithi152.stdout:9/74: rmdir d0 39 2023-12-06T15:00:10.334 INFO:tasks.workunit.client.0.smithi152.stdout:9/75: unlink d0/dd/ff 0 2023-12-06T15:00:10.338 INFO:tasks.workunit.client.1.smithi190.stdout:1/121: dwrite d6/dc/ff [4194304,4194304] 0 2023-12-06T15:00:10.340 INFO:tasks.workunit.client.1.smithi190.stdout:1/122: mknod d6/dc/c1e 0 2023-12-06T15:00:10.340 INFO:tasks.workunit.client.1.smithi190.stdout:1/123: truncate d6/f14 1375820 0 2023-12-06T15:00:10.340 INFO:tasks.workunit.client.1.smithi190.stdout:1/124: truncate d6/f1c 640431 0 2023-12-06T15:00:10.340 INFO:tasks.workunit.client.1.smithi190.stdout:1/125: stat d6/dc/c18 0 2023-12-06T15:00:10.340 INFO:tasks.workunit.client.1.smithi190.stdout:1/126: dread - d6/dc/f1b zero size 2023-12-06T15:00:10.353 INFO:tasks.workunit.client.0.smithi152.stdout:9/76: dwrite d0/f1 [0,4194304] 0 2023-12-06T15:00:10.355 INFO:tasks.workunit.client.1.smithi190.stdout:1/127: dwrite d6/dc/f1b [0,4194304] 0 2023-12-06T15:00:10.374 INFO:tasks.workunit.client.0.smithi152.stdout:9/77: dwrite d0/fa [0,4194304] 0 2023-12-06T15:00:10.375 INFO:tasks.workunit.client.1.smithi190.stdout:1/128: dwrite d6/f14 [0,4194304] 0 2023-12-06T15:00:10.375 INFO:tasks.workunit.client.1.smithi190.stdout:1/129: readlink d6/lb 0 2023-12-06T15:00:10.381 INFO:tasks.workunit.client.1.smithi190.stdout:1/130: truncate d6/f1c 348817 0 2023-12-06T15:00:10.381 INFO:tasks.workunit.client.1.smithi190.stdout:1/131: rename d6 to d6/dc/d1f 22 2023-12-06T15:00:10.383 INFO:tasks.workunit.client.1.smithi190.stdout:1/132: dread f3 [0,4194304] 0 2023-12-06T15:00:10.385 INFO:tasks.workunit.client.1.smithi190.stdout:1/133: rename d6/f1c to d6/dc/f20 0 2023-12-06T15:00:10.385 INFO:tasks.workunit.client.1.smithi190.stdout:1/134: creat d6/f21 x:0 0 0 2023-12-06T15:00:10.392 INFO:tasks.workunit.client.0.smithi152.stdout:9/78: dwrite d0/f14 [0,4194304] 0 2023-12-06T15:00:10.393 INFO:tasks.workunit.client.0.smithi152.stdout:9/79: creat d0/f16 x:0 0 0 2023-12-06T15:00:10.394 INFO:tasks.workunit.client.0.smithi152.stdout:9/80: unlink d0/f16 0 2023-12-06T15:00:10.395 INFO:tasks.workunit.client.1.smithi190.stdout:1/135: dread d6/f12 [0,4194304] 0 2023-12-06T15:00:10.396 INFO:tasks.workunit.client.0.smithi152.stdout:9/81: write d0/f8 [341484,8175] 0 2023-12-06T15:00:10.396 INFO:tasks.workunit.client.1.smithi190.stdout:1/136: creat d6/f22 x:0 0 0 2023-12-06T15:00:10.396 INFO:tasks.workunit.client.1.smithi190.stdout:1/137: readlink d6/dc/l1d 0 2023-12-06T15:00:10.396 INFO:tasks.workunit.client.1.smithi190.stdout:1/138: link f3 d6/f23 0 2023-12-06T15:00:10.397 INFO:tasks.workunit.client.0.smithi152.stdout:9/82: rename d0/f9 to d0/dd/f17 0 2023-12-06T15:00:10.397 INFO:tasks.workunit.client.1.smithi190.stdout:1/139: creat d6/dc/f24 x:0 0 0 2023-12-06T15:00:10.398 INFO:tasks.workunit.client.1.smithi190.stdout:1/140: creat d6/f25 x:0 0 0 2023-12-06T15:00:10.399 INFO:tasks.workunit.client.1.smithi190.stdout:1/141: unlink f0 0 2023-12-06T15:00:10.400 INFO:tasks.workunit.client.1.smithi190.stdout:1/142: rename d6/f14 to d6/f26 0 2023-12-06T15:00:10.401 INFO:tasks.workunit.client.1.smithi190.stdout:1/143: unlink f3 0 2023-12-06T15:00:10.403 INFO:tasks.workunit.client.1.smithi190.stdout:1/144: unlink d6/dc/c1e 0 2023-12-06T15:00:10.403 INFO:tasks.workunit.client.1.smithi190.stdout:1/145: readlink d6/dc/l10 0 2023-12-06T15:00:10.412 INFO:tasks.workunit.client.0.smithi152.stdout:9/83: dwrite d0/f1 [4194304,4194304] 0 2023-12-06T15:00:10.415 INFO:tasks.workunit.client.1.smithi190.stdout:1/146: getdents d6/dc 0 2023-12-06T15:00:10.430 INFO:tasks.workunit.client.1.smithi190.stdout:1/147: dwrite d6/dc/f1b [0,4194304] 0 2023-12-06T15:00:10.431 INFO:tasks.workunit.client.1.smithi190.stdout:1/148: symlink d6/l27 0 2023-12-06T15:00:10.432 INFO:tasks.workunit.client.1.smithi190.stdout:1/149: symlink d6/l28 0 2023-12-06T15:00:10.432 INFO:tasks.workunit.client.1.smithi190.stdout:1/150: dread - d6/dc/f24 zero size 2023-12-06T15:00:10.433 INFO:tasks.workunit.client.1.smithi190.stdout:1/151: mkdir d6/dc/d29 0 2023-12-06T15:00:10.454 INFO:tasks.workunit.client.1.smithi190.stdout:1/152: dwrite d6/dc/f20 [0,4194304] 0 2023-12-06T15:00:10.456 INFO:tasks.workunit.client.1.smithi190.stdout:1/153: rename d6/dc/cd to d6/dc/c2a 0 2023-12-06T15:00:10.457 INFO:tasks.workunit.client.1.smithi190.stdout:1/154: mknod d6/dc/d29/c2b 0 2023-12-06T15:00:10.459 INFO:tasks.workunit.client.1.smithi190.stdout:1/155: dread d6/dc/f9 [0,4194304] 0 2023-12-06T15:00:10.461 INFO:tasks.workunit.client.1.smithi190.stdout:1/156: dread d6/f23 [0,4194304] 0 2023-12-06T15:00:10.462 INFO:tasks.workunit.client.1.smithi190.stdout:1/157: write d6/f25 [991555,40952] 0 2023-12-06T15:00:10.463 INFO:tasks.workunit.client.1.smithi190.stdout:1/158: symlink d6/l2c 0 2023-12-06T15:00:10.463 INFO:tasks.workunit.client.1.smithi190.stdout:1/159: rmdir d6 39 2023-12-06T15:00:10.477 INFO:tasks.workunit.client.1.smithi190.stdout:1/160: dwrite d6/f25 [0,4194304] 0 2023-12-06T15:00:10.480 INFO:tasks.workunit.client.1.smithi190.stdout:1/161: link d6/f11 d6/dc/d29/f2d 0 2023-12-06T15:00:10.483 INFO:tasks.workunit.client.1.smithi190.stdout:1/162: truncate d6/dc/f9 4267862 0 2023-12-06T15:00:10.485 INFO:tasks.workunit.client.1.smithi190.stdout:1/163: rename d6/f11 to d6/dc/f2e 0 2023-12-06T15:00:10.486 INFO:tasks.workunit.client.1.smithi190.stdout:1/164: creat d6/f2f x:0 0 0 2023-12-06T15:00:10.487 INFO:tasks.workunit.client.1.smithi190.stdout:1/165: symlink d6/l30 0 2023-12-06T15:00:10.489 INFO:tasks.workunit.client.1.smithi190.stdout:1/166: mknod d6/dc/d29/c31 0 2023-12-06T15:00:10.490 INFO:tasks.workunit.client.1.smithi190.stdout:1/167: mknod d6/dc/c32 0 2023-12-06T15:00:10.492 INFO:tasks.workunit.client.1.smithi190.stdout:1/168: dread d6/dc/f9 [0,4194304] 0 2023-12-06T15:00:10.493 INFO:tasks.workunit.client.1.smithi190.stdout:1/169: chown d6/f13 280725 1 2023-12-06T15:00:10.493 INFO:tasks.workunit.client.1.smithi190.stdout:1/170: dread - d6/f21 zero size 2023-12-06T15:00:10.493 INFO:tasks.workunit.client.1.smithi190.stdout:1/171: read - d6/dc/f24 zero size 2023-12-06T15:00:10.494 INFO:tasks.workunit.client.1.smithi190.stdout:1/172: chown d6 0 1 2023-12-06T15:00:10.494 INFO:tasks.workunit.client.1.smithi190.stdout:1/173: chown d6/dc/ff 3 1 2023-12-06T15:00:10.506 INFO:tasks.workunit.client.1.smithi190.stdout:1/174: dwrite d6/dc/f1b [0,4194304] 0 2023-12-06T15:00:10.506 INFO:tasks.workunit.client.1.smithi190.stdout:1/175: rmdir d6/dc/d29 39 2023-12-06T15:00:10.510 INFO:tasks.workunit.client.1.smithi190.stdout:1/176: dread d6/dc/ff [0,4194304] 0 2023-12-06T15:00:10.510 INFO:tasks.workunit.client.1.smithi190.stdout:1/177: read - d6/dc/f15 zero size 2023-12-06T15:00:10.511 INFO:tasks.workunit.client.1.smithi190.stdout:1/178: unlink d6/f23 0 2023-12-06T15:00:11.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:11 smithi190 ceph-mon[121340]: pgmap v17: 65 pgs: 65 active+clean; 254 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 4.5 MiB/s rd, 15 MiB/s wr, 1.24k op/s 2023-12-06T15:00:11.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:11 smithi152 ceph-mon[111954]: pgmap v17: 65 pgs: 65 active+clean; 254 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 4.5 MiB/s rd, 15 MiB/s wr, 1.24k op/s 2023-12-06T15:00:13.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:13 smithi190 ceph-mon[121340]: pgmap v18: 65 pgs: 65 active+clean; 254 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 3.8 MiB/s rd, 13 MiB/s wr, 987 op/s 2023-12-06T15:00:13.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:13 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:00:13.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:13 smithi152 ceph-mon[111954]: pgmap v18: 65 pgs: 65 active+clean; 254 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 3.8 MiB/s rd, 13 MiB/s wr, 987 op/s 2023-12-06T15:00:13.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:13 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:00:15.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:15 smithi190 ceph-mon[121340]: pgmap v19: 65 pgs: 65 active+clean; 412 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 20 MiB/s rd, 38 MiB/s wr, 1.06k op/s 2023-12-06T15:00:15.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:15 smithi152 ceph-mon[111954]: pgmap v19: 65 pgs: 65 active+clean; 412 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 20 MiB/s rd, 38 MiB/s wr, 1.06k op/s 2023-12-06T15:00:17.088 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.085+0000 7f18ee803700 1 -- 172.21.15.152:0/3416804223 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18e80fbaf0 msgr2=0x7f18e80fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:17.088 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.085+0000 7f18ee803700 1 --2- 172.21.15.152:0/3416804223 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18e80fbaf0 0x7f18e80fbf00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f18d8004940 tx=0x7f18d8009e30 comp rx=0 tx=0).stop 2023-12-06T15:00:17.088 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.086+0000 7f18ee803700 1 -- 172.21.15.152:0/3416804223 shutdown_connections 2023-12-06T15:00:17.088 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.086+0000 7f18ee803700 1 --2- 172.21.15.152:0/3416804223 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18e80fcd00 0x7f18e80fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:17.088 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.086+0000 7f18ee803700 1 --2- 172.21.15.152:0/3416804223 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18e80fbaf0 0x7f18e80fbf00 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:17.088 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.086+0000 7f18ee803700 1 -- 172.21.15.152:0/3416804223 >> 172.21.15.152:0/3416804223 conn(0x7f18e80f71b0 msgr2=0x7f18e80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:00:17.088 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.086+0000 7f18ee803700 1 -- 172.21.15.152:0/3416804223 shutdown_connections 2023-12-06T15:00:17.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.086+0000 7f18ee803700 1 -- 172.21.15.152:0/3416804223 wait complete. 2023-12-06T15:00:17.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.086+0000 7f18ee803700 1 Processor -- start 2023-12-06T15:00:17.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.086+0000 7f18ee803700 1 -- start start 2023-12-06T15:00:17.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.087+0000 7f18ee803700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18e80fbaf0 0x7f18e810c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:17.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.087+0000 7f18ee803700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18e80fcd00 0x7f18e810c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:17.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.087+0000 7f18ee803700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e810cf10 con 0x7f18e80fcd00 2023-12-06T15:00:17.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.087+0000 7f18ee803700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e810d7b0 con 0x7f18e80fbaf0 2023-12-06T15:00:17.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.087+0000 7f18e77fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18e80fcd00 0x7f18e810c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:17.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.087+0000 7f18e77fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18e80fcd00 0x7f18e810c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60636/0 (socket says 172.21.15.152:60636) 2023-12-06T15:00:17.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.087+0000 7f18e77fe700 1 -- 172.21.15.152:0/3142166565 learned_addr learned my addr 172.21.15.152:0/3142166565 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:00:17.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.087+0000 7f18e7fff700 1 --2- 172.21.15.152:0/3142166565 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18e80fbaf0 0x7f18e810c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:17.090 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.087+0000 7f18e77fe700 1 -- 172.21.15.152:0/3142166565 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18e80fbaf0 msgr2=0x7f18e810c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:17.090 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.087+0000 7f18e77fe700 1 --2- 172.21.15.152:0/3142166565 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18e80fbaf0 0x7f18e810c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:17.090 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.087+0000 7f18e77fe700 1 -- 172.21.15.152:0/3142166565 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d8005040 con 0x7f18e80fcd00 2023-12-06T15:00:17.090 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.087+0000 7f18e77fe700 1 --2- 172.21.15.152:0/3142166565 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18e80fcd00 0x7f18e810c910 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f18dc010d50 tx=0x7f18dc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:00:17.091 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.087+0000 7f18e4ff9700 1 -- 172.21.15.152:0/3142166565 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18dc00ed60 con 0x7f18e80fcd00 2023-12-06T15:00:17.091 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.088+0000 7f18ee803700 1 -- 172.21.15.152:0/3142166565 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e810da30 con 0x7f18e80fcd00 2023-12-06T15:00:17.091 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.088+0000 7f18e4ff9700 1 -- 172.21.15.152:0/3142166565 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f18dc0090d0 con 0x7f18e80fcd00 2023-12-06T15:00:17.091 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.088+0000 7f18e4ff9700 1 -- 172.21.15.152:0/3142166565 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18dc012650 con 0x7f18e80fcd00 2023-12-06T15:00:17.091 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.088+0000 7f18ee803700 1 -- 172.21.15.152:0/3142166565 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e810df70 con 0x7f18e80fcd00 2023-12-06T15:00:17.091 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.089+0000 7f18ee803700 1 -- 172.21.15.152:0/3142166565 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e804bb80 con 0x7f18e80fcd00 2023-12-06T15:00:17.091 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.089+0000 7f18e4ff9700 1 -- 172.21.15.152:0/3142166565 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f18dc018030 con 0x7f18e80fcd00 2023-12-06T15:00:17.092 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.090+0000 7f18e4ff9700 1 --2- 172.21.15.152:0/3142166565 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f18d006ae40 0x7f18d006d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:17.092 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.090+0000 7f18e4ff9700 1 -- 172.21.15.152:0/3142166565 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f18dc016070 con 0x7f18e80fcd00 2023-12-06T15:00:17.092 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.090+0000 7f18e7fff700 1 --2- 172.21.15.152:0/3142166565 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f18d006ae40 0x7f18d006d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:17.092 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.090+0000 7f18e7fff700 1 --2- 172.21.15.152:0/3142166565 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f18d006ae40 0x7f18d006d2f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f18d8013680 tx=0x7f18d8009e30 comp rx=0 tx=0).ready entity=mgr.14612 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:00:17.095 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.094+0000 7f18e4ff9700 1 -- 172.21.15.152:0/3142166565 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f18dc059b90 con 0x7f18e80fcd00 2023-12-06T15:00:17.191 INFO:tasks.workunit.client.1.smithi190.stdout:6/56: sync 2023-12-06T15:00:17.191 INFO:tasks.workunit.client.1.smithi190.stdout:1/179: sync 2023-12-06T15:00:17.192 INFO:tasks.workunit.client.1.smithi190.stdout:0/6: sync 2023-12-06T15:00:17.192 INFO:tasks.workunit.client.1.smithi190.stdout:8/10: sync 2023-12-06T15:00:17.192 INFO:tasks.workunit.client.1.smithi190.stdout:8/11: dread - no filename 2023-12-06T15:00:17.192 INFO:tasks.workunit.client.1.smithi190.stdout:8/12: dwrite - no filename 2023-12-06T15:00:17.192 INFO:tasks.workunit.client.1.smithi190.stdout:8/13: dread - no filename 2023-12-06T15:00:17.192 INFO:tasks.workunit.client.1.smithi190.stdout:8/14: fsync - no filename 2023-12-06T15:00:17.192 INFO:tasks.workunit.client.1.smithi190.stdout:4/30: sync 2023-12-06T15:00:17.192 INFO:tasks.workunit.client.1.smithi190.stdout:8/15: write - no filename 2023-12-06T15:00:17.192 INFO:tasks.workunit.client.1.smithi190.stdout:3/39: sync 2023-12-06T15:00:17.192 INFO:tasks.workunit.client.1.smithi190.stdout:7/57: sync 2023-12-06T15:00:17.192 INFO:tasks.workunit.client.1.smithi190.stdout:2/36: sync 2023-12-06T15:00:17.192 INFO:tasks.workunit.client.1.smithi190.stdout:9/69: sync 2023-12-06T15:00:17.192 INFO:tasks.workunit.client.1.smithi190.stdout:5/36: sync 2023-12-06T15:00:17.192 INFO:tasks.workunit.client.1.smithi190.stdout:9/70: fsync d4/f18 0 2023-12-06T15:00:17.193 INFO:tasks.workunit.client.1.smithi190.stdout:2/37: write f5 [3758580,15835] 0 2023-12-06T15:00:17.193 INFO:tasks.workunit.client.1.smithi190.stdout:6/57: truncate d4/f9 3085906 0 2023-12-06T15:00:17.193 INFO:tasks.workunit.client.1.smithi190.stdout:0/7: mkdir d0 0 2023-12-06T15:00:17.193 INFO:tasks.workunit.client.1.smithi190.stdout:0/8: getdents d0 0 2023-12-06T15:00:17.193 INFO:tasks.workunit.client.1.smithi190.stdout:0/9: unlink - no file 2023-12-06T15:00:17.193 INFO:tasks.workunit.client.1.smithi190.stdout:0/10: write - no filename 2023-12-06T15:00:17.193 INFO:tasks.workunit.client.1.smithi190.stdout:0/11: dwrite - no filename 2023-12-06T15:00:17.194 INFO:tasks.workunit.client.1.smithi190.stdout:8/16: link d1/c2 d1/c3 0 2023-12-06T15:00:17.194 INFO:tasks.workunit.client.1.smithi190.stdout:8/17: truncate - no filename 2023-12-06T15:00:17.194 INFO:tasks.workunit.client.1.smithi190.stdout:8/18: chown d1 11040406 1 2023-12-06T15:00:17.194 INFO:tasks.workunit.client.1.smithi190.stdout:3/40: rmdir d4 39 2023-12-06T15:00:17.195 INFO:tasks.workunit.client.1.smithi190.stdout:3/41: stat d4/fc 0 2023-12-06T15:00:17.196 INFO:tasks.workunit.client.1.smithi190.stdout:1/180: dread d6/dc/ff [0,4194304] 0 2023-12-06T15:00:17.196 INFO:tasks.workunit.client.1.smithi190.stdout:1/181: dread d6/dc/d29/f2d [0,4194304] 0 2023-12-06T15:00:17.197 INFO:tasks.workunit.client.1.smithi190.stdout:4/31: link d3/f7 d3/fb 0 2023-12-06T15:00:17.198 INFO:tasks.workunit.client.1.smithi190.stdout:5/37: symlink d0/lc 0 2023-12-06T15:00:17.199 INFO:tasks.workunit.client.1.smithi190.stdout:5/38: readlink d0/l2 0 2023-12-06T15:00:17.199 INFO:tasks.workunit.client.1.smithi190.stdout:5/39: chown d0/lc 15124 1 2023-12-06T15:00:17.199 INFO:tasks.workunit.client.1.smithi190.stdout:5/40: truncate d0/f3 1715895 0 2023-12-06T15:00:17.199 INFO:tasks.workunit.client.1.smithi190.stdout:5/41: chown d0/l2 1304 1 2023-12-06T15:00:17.200 INFO:tasks.workunit.client.1.smithi190.stdout:2/38: mkdir d10 0 2023-12-06T15:00:17.200 INFO:tasks.workunit.client.1.smithi190.stdout:2/39: fdatasync f3 0 2023-12-06T15:00:17.200 INFO:tasks.workunit.client.1.smithi190.stdout:2/40: chown c1 827990 1 2023-12-06T15:00:17.201 INFO:tasks.workunit.client.1.smithi190.stdout:0/12: symlink d0/l1 0 2023-12-06T15:00:17.201 INFO:tasks.workunit.client.1.smithi190.stdout:0/13: chown d0/l1 12 1 2023-12-06T15:00:17.202 INFO:tasks.workunit.client.1.smithi190.stdout:0/14: dread - no filename 2023-12-06T15:00:17.202 INFO:tasks.workunit.client.1.smithi190.stdout:8/19: creat d1/f4 x:0 0 0 2023-12-06T15:00:17.202 INFO:tasks.workunit.client.1.smithi190.stdout:8/20: chown d1/f4 212807 1 2023-12-06T15:00:17.203 INFO:tasks.workunit.client.1.smithi190.stdout:1/182: getdents d6 0 2023-12-06T15:00:17.203 INFO:tasks.workunit.client.1.smithi190.stdout:6/58: fsync d4/f9 0 2023-12-06T15:00:17.204 INFO:tasks.workunit.client.1.smithi190.stdout:3/42: dread d4/f5 [0,4194304] 0 2023-12-06T15:00:17.208 INFO:tasks.workunit.client.1.smithi190.stdout:2/41: mkdir d10/d11 0 2023-12-06T15:00:17.208 INFO:tasks.workunit.client.1.smithi190.stdout:2/42: readlink l7 0 2023-12-06T15:00:17.208 INFO:tasks.workunit.client.1.smithi190.stdout:2/43: fdatasync fc 0 2023-12-06T15:00:17.208 INFO:tasks.workunit.client.1.smithi190.stdout:9/71: dread f1 [0,4194304] 0 2023-12-06T15:00:17.208 INFO:tasks.workunit.client.1.smithi190.stdout:9/72: chown d4/c16 11966104 1 2023-12-06T15:00:17.208 INFO:tasks.workunit.client.1.smithi190.stdout:9/73: chown d4/c7 27 1 2023-12-06T15:00:17.209 INFO:tasks.workunit.client.1.smithi190.stdout:9/74: chown d4/f6 83822703 1 2023-12-06T15:00:17.209 INFO:tasks.workunit.client.1.smithi190.stdout:0/15: symlink d0/l2 0 2023-12-06T15:00:17.210 INFO:tasks.workunit.client.1.smithi190.stdout:8/21: mknod d1/c5 0 2023-12-06T15:00:17.211 INFO:tasks.workunit.client.1.smithi190.stdout:4/32: getdents d3 0 2023-12-06T15:00:17.212 INFO:tasks.workunit.client.1.smithi190.stdout:7/58: write d0/d5/f9 [1542852,110269] 0 2023-12-06T15:00:17.215 INFO:tasks.workunit.client.1.smithi190.stdout:1/183: rename d6/dc/f20 to d6/dc/f33 0 2023-12-06T15:00:17.217 INFO:tasks.workunit.client.1.smithi190.stdout:3/43: creat d4/fd x:0 0 0 2023-12-06T15:00:17.217 INFO:tasks.workunit.client.1.smithi190.stdout:3/44: fdatasync d4/f8 0 2023-12-06T15:00:17.217 INFO:tasks.workunit.client.1.smithi190.stdout:5/42: rmdir d0 39 2023-12-06T15:00:17.218 INFO:tasks.workunit.client.1.smithi190.stdout:5/43: write d0/f7 [4393818,78970] 0 2023-12-06T15:00:17.218 INFO:tasks.workunit.client.1.smithi190.stdout:5/44: chown d0/f9 3851 1 2023-12-06T15:00:17.219 INFO:tasks.workunit.client.1.smithi190.stdout:9/75: mknod d4/c1c 0 2023-12-06T15:00:17.221 INFO:tasks.workunit.client.1.smithi190.stdout:0/16: rename d0/l2 to d0/l3 0 2023-12-06T15:00:17.221 INFO:tasks.workunit.client.1.smithi190.stdout:0/17: chown d0/l1 1 1 2023-12-06T15:00:17.222 INFO:tasks.workunit.client.1.smithi190.stdout:0/18: truncate - no filename 2023-12-06T15:00:17.224 INFO:tasks.workunit.client.1.smithi190.stdout:8/22: rename d1/c2 to d1/c6 0 2023-12-06T15:00:17.224 INFO:tasks.workunit.client.1.smithi190.stdout:8/23: chown d1 83195 1 2023-12-06T15:00:17.226 INFO:tasks.workunit.client.1.smithi190.stdout:4/33: symlink d3/lc 0 2023-12-06T15:00:17.226 INFO:tasks.workunit.client.1.smithi190.stdout:7/59: symlink d0/d5/l12 0 2023-12-06T15:00:17.231 INFO:tasks.workunit.client.1.smithi190.stdout:3/45: creat d4/fe x:0 0 0 2023-12-06T15:00:17.232 INFO:tasks.workunit.client.1.smithi190.stdout:9/76: creat d4/f1d x:0 0 0 2023-12-06T15:00:17.232 INFO:tasks.workunit.client.1.smithi190.stdout:0/19: mkdir d0/d4 0 2023-12-06T15:00:17.233 INFO:tasks.workunit.client.1.smithi190.stdout:0/20: truncate - no filename 2023-12-06T15:00:17.233 INFO:tasks.workunit.client.1.smithi190.stdout:8/24: creat d1/f7 x:0 0 0 2023-12-06T15:00:17.234 INFO:tasks.workunit.client.1.smithi190.stdout:7/60: getdents d0 0 2023-12-06T15:00:17.235 INFO:tasks.workunit.client.1.smithi190.stdout:3/46: rename d4/f8 to d4/ff 0 2023-12-06T15:00:17.236 INFO:tasks.workunit.client.1.smithi190.stdout:9/77: symlink d4/l1e 0 2023-12-06T15:00:17.237 INFO:tasks.workunit.client.1.smithi190.stdout:5/45: dread d0/f7 [0,4194304] 0 2023-12-06T15:00:17.237 INFO:tasks.workunit.client.1.smithi190.stdout:5/46: chown d0/fb 16401 1 2023-12-06T15:00:17.238 INFO:tasks.workunit.client.1.smithi190.stdout:8/25: rename d1/c5 to d1/c8 0 2023-12-06T15:00:17.238 INFO:tasks.workunit.client.1.smithi190.stdout:6/59: dwrite d4/f9 [0,4194304] 0 2023-12-06T15:00:17.239 INFO:tasks.workunit.client.1.smithi190.stdout:7/61: mkdir d0/d5/da/d13 0 2023-12-06T15:00:17.239 INFO:tasks.workunit.client.1.smithi190.stdout:7/62: chown d0/d5/f8 1798178 1 2023-12-06T15:00:17.239 INFO:tasks.workunit.client.1.smithi190.stdout:2/44: dwrite ff [0,4194304] 0 2023-12-06T15:00:17.239 INFO:tasks.workunit.client.1.smithi190.stdout:2/45: dread - fe zero size 2023-12-06T15:00:17.240 INFO:tasks.workunit.client.1.smithi190.stdout:3/47: mknod d4/c10 0 2023-12-06T15:00:17.240 INFO:tasks.workunit.client.1.smithi190.stdout:1/184: dwrite d6/f13 [0,4194304] 0 2023-12-06T15:00:17.242 INFO:tasks.workunit.client.1.smithi190.stdout:9/78: link d4/f17 d4/f1f 0 2023-12-06T15:00:17.242 INFO:tasks.workunit.client.1.smithi190.stdout:9/79: write d4/f1d [247035,121460] 0 2023-12-06T15:00:17.243 INFO:tasks.workunit.client.1.smithi190.stdout:4/34: link d3/fa d3/fd 0 2023-12-06T15:00:17.244 INFO:tasks.workunit.client.1.smithi190.stdout:6/60: creat d4/fc x:0 0 0 2023-12-06T15:00:17.247 INFO:tasks.workunit.client.1.smithi190.stdout:7/63: rmdir d0/d5/d11 0 2023-12-06T15:00:17.247 INFO:tasks.workunit.client.1.smithi190.stdout:7/64: fdatasync d0/d5/f8 0 2023-12-06T15:00:17.256 INFO:tasks.workunit.client.1.smithi190.stdout:3/48: creat d4/f11 x:0 0 0 2023-12-06T15:00:17.260 INFO:tasks.workunit.client.1.smithi190.stdout:1/185: mkdir d6/dc/d29/d34 0 2023-12-06T15:00:17.262 INFO:tasks.workunit.client.1.smithi190.stdout:9/80: truncate f3 474194 0 2023-12-06T15:00:17.263 INFO:tasks.workunit.client.1.smithi190.stdout:9/81: write d4/f18 [2415669,9688] 0 2023-12-06T15:00:17.264 INFO:tasks.workunit.client.1.smithi190.stdout:9/82: write d4/fc [800795,19203] 0 2023-12-06T15:00:17.264 INFO:tasks.workunit.client.1.smithi190.stdout:0/21: getdents d0 0 2023-12-06T15:00:17.265 INFO:tasks.workunit.client.1.smithi190.stdout:0/22: dread - no filename 2023-12-06T15:00:17.265 INFO:tasks.workunit.client.1.smithi190.stdout:0/23: getdents d0 0 2023-12-06T15:00:17.265 INFO:tasks.workunit.client.1.smithi190.stdout:0/24: truncate - no filename 2023-12-06T15:00:17.265 INFO:tasks.workunit.client.1.smithi190.stdout:0/25: truncate - no filename 2023-12-06T15:00:17.265 INFO:tasks.workunit.client.1.smithi190.stdout:0/26: chown d0/d4 376 1 2023-12-06T15:00:17.265 INFO:tasks.workunit.client.1.smithi190.stdout:0/27: read - no filename 2023-12-06T15:00:17.265 INFO:tasks.workunit.client.1.smithi190.stdout:0/28: dwrite - no filename 2023-12-06T15:00:17.265 INFO:tasks.workunit.client.1.smithi190.stdout:0/29: write - no filename 2023-12-06T15:00:17.265 INFO:tasks.workunit.client.1.smithi190.stdout:0/30: fdatasync - no filename 2023-12-06T15:00:17.265 INFO:tasks.workunit.client.1.smithi190.stdout:6/61: creat d4/fd x:0 0 0 2023-12-06T15:00:17.268 INFO:tasks.workunit.client.1.smithi190.stdout:3/49: symlink d4/l12 0 2023-12-06T15:00:17.269 INFO:tasks.workunit.client.1.smithi190.stdout:1/186: mknod d6/dc/d29/c35 0 2023-12-06T15:00:17.270 INFO:tasks.workunit.client.1.smithi190.stdout:2/46: dwrite f5 [0,4194304] 0 2023-12-06T15:00:17.270 INFO:tasks.workunit.client.1.smithi190.stdout:5/47: dwrite d0/fb [0,4194304] 0 2023-12-06T15:00:17.271 INFO:tasks.workunit.client.1.smithi190.stdout:8/26: dwrite d1/f7 [0,4194304] 0 2023-12-06T15:00:17.271 INFO:tasks.workunit.client.1.smithi190.stdout:8/27: chown d1/c8 8355221 1 2023-12-06T15:00:17.271 INFO:tasks.workunit.client.1.smithi190.stdout:9/83: mknod d4/c20 0 2023-12-06T15:00:17.272 INFO:tasks.workunit.client.1.smithi190.stdout:4/35: mknod d3/ce 0 2023-12-06T15:00:17.273 INFO:tasks.workunit.client.1.smithi190.stdout:0/31: mknod d0/c5 0 2023-12-06T15:00:17.274 INFO:tasks.workunit.client.1.smithi190.stdout:6/62: creat d4/fe x:0 0 0 2023-12-06T15:00:17.274 INFO:tasks.workunit.client.1.smithi190.stdout:6/63: dread - d4/fe zero size 2023-12-06T15:00:17.274 INFO:tasks.workunit.client.1.smithi190.stdout:6/64: write d4/fe [211269,48352] 0 2023-12-06T15:00:17.275 INFO:tasks.workunit.client.1.smithi190.stdout:3/50: rename d4/f11 to d4/f13 0 2023-12-06T15:00:17.275 INFO:tasks.workunit.client.1.smithi190.stdout:3/51: dread - d4/f9 zero size 2023-12-06T15:00:17.275 INFO:tasks.workunit.client.1.smithi190.stdout:3/52: write d4/f9 [436513,60355] 0 2023-12-06T15:00:17.276 INFO:tasks.workunit.client.1.smithi190.stdout:1/187: symlink d6/dc/d29/d34/l36 0 2023-12-06T15:00:17.276 INFO:tasks.workunit.client.1.smithi190.stdout:1/188: readlink d6/l28 0 2023-12-06T15:00:17.281 INFO:tasks.workunit.client.1.smithi190.stdout:5/48: unlink d0/f9 0 2023-12-06T15:00:17.289 INFO:tasks.workunit.client.1.smithi190.stdout:8/28: mknod d1/c9 0 2023-12-06T15:00:17.289 INFO:tasks.workunit.client.1.smithi190.stdout:8/29: truncate d1/f4 686654 0 2023-12-06T15:00:17.291 INFO:tasks.workunit.client.1.smithi190.stdout:9/84: creat d4/f21 x:0 0 0 2023-12-06T15:00:17.293 INFO:tasks.workunit.client.1.smithi190.stdout:0/32: rmdir d0 39 2023-12-06T15:00:17.293 INFO:tasks.workunit.client.1.smithi190.stdout:0/33: dwrite - no filename 2023-12-06T15:00:17.293 INFO:tasks.workunit.client.1.smithi190.stdout:0/34: write - no filename 2023-12-06T15:00:17.294 INFO:tasks.workunit.client.1.smithi190.stdout:6/65: creat d4/ff x:0 0 0 2023-12-06T15:00:17.296 INFO:tasks.workunit.client.1.smithi190.stdout:3/53: rename d4/fd to d4/f14 0 2023-12-06T15:00:17.298 INFO:tasks.workunit.client.1.smithi190.stdout:1/189: rename d6/f26 to d6/f37 0 2023-12-06T15:00:17.298 INFO:tasks.workunit.client.1.smithi190.stdout:1/190: fdatasync d6/dc/d29/f2d 0 2023-12-06T15:00:17.309 INFO:tasks.workunit.client.1.smithi190.stdout:8/30: rename c0 to d1/ca 0 2023-12-06T15:00:17.309 INFO:tasks.workunit.client.1.smithi190.stdout:4/36: truncate d3/f4 565994 0 2023-12-06T15:00:17.309 INFO:tasks.workunit.client.1.smithi190.stdout:2/47: truncate f5 4169723 0 2023-12-06T15:00:17.309 INFO:tasks.workunit.client.1.smithi190.stdout:3/54: mkdir d4/d15 0 2023-12-06T15:00:17.312 INFO:tasks.workunit.client.1.smithi190.stdout:1/191: mkdir d6/dc/d29/d38 0 2023-12-06T15:00:17.312 INFO:tasks.workunit.client.1.smithi190.stdout:1/192: chown d6/dc/d29/d34 731621295 1 2023-12-06T15:00:17.315 INFO:tasks.workunit.client.1.smithi190.stdout:2/48: creat d10/f12 x:0 0 0 2023-12-06T15:00:17.316 INFO:tasks.workunit.client.1.smithi190.stdout:3/55: mknod d4/d15/c16 0 2023-12-06T15:00:17.316 INFO:tasks.workunit.client.1.smithi190.stdout:5/49: dwrite d0/f3 [0,4194304] 0 2023-12-06T15:00:17.316 INFO:tasks.workunit.client.1.smithi190.stdout:5/50: fsync d0/f1 0 2023-12-06T15:00:17.317 INFO:tasks.workunit.client.1.smithi190.stdout:1/193: mkdir d6/dc/d29/d38/d39 0 2023-12-06T15:00:17.318 INFO:tasks.workunit.client.1.smithi190.stdout:0/35: link d0/l1 d0/l6 0 2023-12-06T15:00:17.319 INFO:tasks.workunit.client.1.smithi190.stdout:2/49: creat d10/d11/f13 x:0 0 0 2023-12-06T15:00:17.321 INFO:tasks.workunit.client.1.smithi190.stdout:8/31: dread d1/f7 [0,4194304] 0 2023-12-06T15:00:17.321 INFO:tasks.workunit.client.1.smithi190.stdout:4/37: read d3/f7 [503222,79661] 0 2023-12-06T15:00:17.321 INFO:tasks.workunit.client.1.smithi190.stdout:8/32: write d1/f4 [387992,61977] 0 2023-12-06T15:00:17.324 INFO:tasks.workunit.client.1.smithi190.stdout:1/194: dread d6/dc/f1b [0,4194304] 0 2023-12-06T15:00:17.324 INFO:tasks.workunit.client.1.smithi190.stdout:5/51: truncate d0/f7 1269707 0 2023-12-06T15:00:17.326 INFO:tasks.workunit.client.1.smithi190.stdout:2/50: creat d10/f14 x:0 0 0 2023-12-06T15:00:17.327 INFO:tasks.workunit.client.1.smithi190.stdout:8/33: dread d1/f4 [0,4194304] 0 2023-12-06T15:00:17.328 INFO:tasks.workunit.client.1.smithi190.stdout:4/38: getdents d3 0 2023-12-06T15:00:17.328 INFO:tasks.workunit.client.1.smithi190.stdout:4/39: readlink d3/l8 0 2023-12-06T15:00:17.329 INFO:tasks.workunit.client.1.smithi190.stdout:3/56: rmdir d4 39 2023-12-06T15:00:17.331 INFO:tasks.workunit.client.1.smithi190.stdout:1/195: mknod d6/dc/d29/d38/c3a 0 2023-12-06T15:00:17.333 INFO:tasks.workunit.client.1.smithi190.stdout:5/52: creat d0/fd x:0 0 0 2023-12-06T15:00:17.335 INFO:tasks.workunit.client.1.smithi190.stdout:2/51: creat d10/d11/f15 x:0 0 0 2023-12-06T15:00:17.337 INFO:tasks.workunit.client.1.smithi190.stdout:4/40: creat d3/ff x:0 0 0 2023-12-06T15:00:17.339 INFO:tasks.workunit.client.1.smithi190.stdout:1/196: rmdir d6/dc/d29 39 2023-12-06T15:00:17.339 INFO:tasks.workunit.client.1.smithi190.stdout:1/197: readlink d6/l28 0 2023-12-06T15:00:17.339 INFO:tasks.workunit.client.1.smithi190.stdout:1/198: dread - d6/f2f zero size 2023-12-06T15:00:17.339 INFO:tasks.workunit.client.1.smithi190.stdout:1/199: write d6/f12 [4548581,112175] 0 2023-12-06T15:00:17.342 INFO:tasks.workunit.client.1.smithi190.stdout:0/36: rename d0/l3 to d0/d4/l7 0 2023-12-06T15:00:17.342 INFO:tasks.workunit.client.1.smithi190.stdout:0/37: rename d0/d4 to d0/d4/d8 22 2023-12-06T15:00:17.342 INFO:tasks.workunit.client.1.smithi190.stdout:0/38: dread - no filename 2023-12-06T15:00:17.342 INFO:tasks.workunit.client.1.smithi190.stdout:0/39: read - no filename 2023-12-06T15:00:17.343 INFO:tasks.workunit.client.1.smithi190.stdout:2/52: creat d10/d11/f16 x:0 0 0 2023-12-06T15:00:17.343 INFO:tasks.workunit.client.1.smithi190.stdout:3/57: dwrite d4/f5 [4194304,4194304] 0 2023-12-06T15:00:17.345 INFO:tasks.workunit.client.1.smithi190.stdout:8/34: truncate d1/f4 22224 0 2023-12-06T15:00:17.347 INFO:tasks.workunit.client.1.smithi190.stdout:1/200: mkdir d6/dc/d3b 0 2023-12-06T15:00:17.347 INFO:tasks.workunit.client.1.smithi190.stdout:1/201: chown d6/lb 6256 1 2023-12-06T15:00:17.348 INFO:tasks.workunit.client.1.smithi190.stdout:0/40: creat d0/f9 x:0 0 0 2023-12-06T15:00:17.355 INFO:tasks.workunit.client.1.smithi190.stdout:0/41: mkdir d0/da 0 2023-12-06T15:00:17.366 INFO:tasks.workunit.client.1.smithi190.stdout:5/53: dwrite d0/f6 [0,4194304] 0 2023-12-06T15:00:17.366 INFO:tasks.workunit.client.1.smithi190.stdout:5/54: chown d0/c8 504 1 2023-12-06T15:00:17.368 INFO:tasks.workunit.client.1.smithi190.stdout:8/35: write d1/f4 [368586,98641] 0 2023-12-06T15:00:17.370 INFO:tasks.workunit.client.1.smithi190.stdout:5/55: creat d0/fe x:0 0 0 2023-12-06T15:00:17.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.370+0000 7f18ee803700 1 -- 172.21.15.152:0/3142166565 --> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f18e810e390 con 0x7f18d006ae40 2023-12-06T15:00:17.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.373+0000 7f18e4ff9700 1 -- 172.21.15.152:0/3142166565 <== mgr.14612 v2:172.21.15.190:6828/3047155534 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f18e810e390 con 0x7f18d006ae40 2023-12-06T15:00:17.375 INFO:tasks.workunit.client.1.smithi190.stdout:1/202: write d6/dc/f33 [3322268,8850] 0 2023-12-06T15:00:17.375 INFO:tasks.workunit.client.1.smithi190.stdout:8/36: unlink d1/c8 0 2023-12-06T15:00:17.375 INFO:tasks.workunit.client.1.smithi190.stdout:1/203: chown d6/f2f 232370321 1 2023-12-06T15:00:17.375 INFO:tasks.workunit.client.1.smithi190.stdout:1/204: truncate d6/dc/f15 904018 0 2023-12-06T15:00:17.375 INFO:tasks.workunit.client.1.smithi190.stdout:1/205: chown d6/dc/d29/d34/l36 17065636 1 2023-12-06T15:00:17.375 INFO:tasks.workunit.client.1.smithi190.stdout:2/53: dwrite d10/d11/f13 [0,4194304] 0 2023-12-06T15:00:17.376 INFO:tasks.workunit.client.1.smithi190.stdout:8/37: creat d1/fb x:0 0 0 2023-12-06T15:00:17.376 INFO:tasks.workunit.client.1.smithi190.stdout:8/38: truncate d1/fb 1009213 0 2023-12-06T15:00:17.377 INFO:tasks.workunit.client.1.smithi190.stdout:1/206: rmdir d6/dc 39 2023-12-06T15:00:17.377 INFO:tasks.workunit.client.1.smithi190.stdout:1/207: readlink d6/lb 0 2023-12-06T15:00:17.377 INFO:tasks.workunit.client.1.smithi190.stdout:1/208: write d6/dc/f9 [4042325,91045] 0 2023-12-06T15:00:17.378 INFO:tasks.workunit.client.1.smithi190.stdout:1/209: write d6/dc/f2e [4626,36393] 0 2023-12-06T15:00:17.378 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.377+0000 7f18ee803700 1 -- 172.21.15.152:0/3142166565 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f18d006ae40 msgr2=0x7f18d006d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:17.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.377+0000 7f18ee803700 1 --2- 172.21.15.152:0/3142166565 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f18d006ae40 0x7f18d006d2f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f18d8013680 tx=0x7f18d8009e30 comp rx=0 tx=0).stop 2023-12-06T15:00:17.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.377+0000 7f18ee803700 1 -- 172.21.15.152:0/3142166565 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18e80fcd00 msgr2=0x7f18e810c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:17.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.377+0000 7f18ee803700 1 --2- 172.21.15.152:0/3142166565 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18e80fcd00 0x7f18e810c910 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f18dc010d50 tx=0x7f18dc00b040 comp rx=0 tx=0).stop 2023-12-06T15:00:17.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.377+0000 7f18ee803700 1 -- 172.21.15.152:0/3142166565 shutdown_connections 2023-12-06T15:00:17.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.377+0000 7f18ee803700 1 --2- 172.21.15.152:0/3142166565 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f18d006ae40 0x7f18d006d2f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:17.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.377+0000 7f18ee803700 1 --2- 172.21.15.152:0/3142166565 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18e80fbaf0 0x7f18e810c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:17.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.377+0000 7f18ee803700 1 --2- 172.21.15.152:0/3142166565 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18e80fcd00 0x7f18e810c910 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:17.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.377+0000 7f18ee803700 1 -- 172.21.15.152:0/3142166565 >> 172.21.15.152:0/3142166565 conn(0x7f18e80f71b0 msgr2=0x7f18e80fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:00:17.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.377+0000 7f18ee803700 1 -- 172.21.15.152:0/3142166565 shutdown_connections 2023-12-06T15:00:17.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.377+0000 7f18ee803700 1 -- 172.21.15.152:0/3142166565 wait complete. 2023-12-06T15:00:17.380 INFO:tasks.workunit.client.1.smithi190.stdout:2/54: getdents d10 0 2023-12-06T15:00:17.380 INFO:tasks.workunit.client.1.smithi190.stdout:2/55: write f3 [1291926,72289] 0 2023-12-06T15:00:17.380 INFO:tasks.workunit.client.1.smithi190.stdout:2/56: write fe [76908,105671] 0 2023-12-06T15:00:17.380 INFO:tasks.workunit.client.1.smithi190.stdout:2/57: read - fa zero size 2023-12-06T15:00:17.381 INFO:tasks.workunit.client.1.smithi190.stdout:1/210: dread d6/f12 [0,4194304] 0 2023-12-06T15:00:17.381 INFO:tasks.workunit.client.1.smithi190.stdout:8/39: creat d1/fc x:0 0 0 2023-12-06T15:00:17.391 INFO:tasks.workunit.client.1.smithi190.stdout:3/58: dwrite d4/ff [0,4194304] 0 2023-12-06T15:00:17.391 INFO:tasks.workunit.client.1.smithi190.stdout:4/41: dwrite d3/fb [0,4194304] 0 2023-12-06T15:00:17.393 INFO:tasks.workunit.client.1.smithi190.stdout:5/56: dwrite d0/f1 [0,4194304] 0 2023-12-06T15:00:17.395 INFO:tasks.workunit.client.1.smithi190.stdout:3/59: mkdir d4/d17 0 2023-12-06T15:00:17.395 INFO:tasks.workunit.client.1.smithi190.stdout:3/60: dread - d4/f14 zero size 2023-12-06T15:00:17.395 INFO:teuthology.orchestra.run.smithi152.stdout:true 2023-12-06T15:00:17.404 INFO:tasks.workunit.client.1.smithi190.stdout:1/211: dwrite d6/dc/f24 [0,4194304] 0 2023-12-06T15:00:17.404 INFO:tasks.workunit.client.1.smithi190.stdout:1/212: write d6/f2f [378623,118105] 0 2023-12-06T15:00:17.404 INFO:tasks.workunit.client.1.smithi190.stdout:1/213: rename d6/dc/d29/d38/d39 to d6/dc/d29/d38/d39/d3c 22 2023-12-06T15:00:17.404 INFO:tasks.workunit.client.1.smithi190.stdout:8/40: dwrite d1/f7 [4194304,4194304] 0 2023-12-06T15:00:17.404 INFO:tasks.workunit.client.1.smithi190.stdout:8/41: truncate d1/fc 644028 0 2023-12-06T15:00:17.405 INFO:tasks.workunit.client.1.smithi190.stdout:5/57: mkdir d0/df 0 2023-12-06T15:00:17.406 INFO:tasks.workunit.client.1.smithi190.stdout:3/61: mknod d4/d15/c18 0 2023-12-06T15:00:17.406 INFO:tasks.workunit.client.1.smithi190.stdout:4/42: mkdir d3/d10 0 2023-12-06T15:00:17.408 INFO:tasks.workunit.client.1.smithi190.stdout:1/214: mknod d6/dc/d3b/c3d 0 2023-12-06T15:00:17.409 INFO:tasks.workunit.client.1.smithi190.stdout:4/43: fdatasync d3/f9 0 2023-12-06T15:00:17.411 INFO:tasks.workunit.client.1.smithi190.stdout:3/62: rename d4/d17 to d4/d15/d19 0 2023-12-06T15:00:17.411 INFO:tasks.workunit.client.1.smithi190.stdout:2/58: dwrite fe [0,4194304] 0 2023-12-06T15:00:17.412 INFO:tasks.workunit.client.1.smithi190.stdout:2/59: chown d10/f12 4856 1 2023-12-06T15:00:17.412 INFO:tasks.workunit.client.1.smithi190.stdout:8/42: dread d1/f7 [4194304,4194304] 0 2023-12-06T15:00:17.412 INFO:tasks.workunit.client.1.smithi190.stdout:1/215: link d6/f2f d6/dc/d29/d38/d39/f3e 0 2023-12-06T15:00:17.413 INFO:tasks.workunit.client.1.smithi190.stdout:4/44: fsync d3/f4 0 2023-12-06T15:00:17.414 INFO:tasks.workunit.client.1.smithi190.stdout:3/63: creat d4/d15/d19/f1a x:0 0 0 2023-12-06T15:00:17.414 INFO:tasks.workunit.client.1.smithi190.stdout:3/64: stat d4 0 2023-12-06T15:00:17.415 INFO:tasks.workunit.client.1.smithi190.stdout:2/60: getdents d10/d11 0 2023-12-06T15:00:17.418 INFO:tasks.workunit.client.1.smithi190.stdout:8/43: rename d1/fc to d1/fd 0 2023-12-06T15:00:17.421 INFO:tasks.workunit.client.1.smithi190.stdout:3/65: mkdir d4/d1b 0 2023-12-06T15:00:17.421 INFO:tasks.workunit.client.1.smithi190.stdout:3/66: chown d4/f5 55661268 1 2023-12-06T15:00:17.424 INFO:tasks.workunit.client.1.smithi190.stdout:2/61: link c9 d10/d11/c17 0 2023-12-06T15:00:17.424 INFO:tasks.workunit.client.1.smithi190.stdout:2/62: readlink l7 0 2023-12-06T15:00:17.427 INFO:tasks.workunit.client.1.smithi190.stdout:8/44: creat d1/fe x:0 0 0 2023-12-06T15:00:17.429 INFO:tasks.workunit.client.1.smithi190.stdout:8/45: write d1/f7 [2130805,939] 0 2023-12-06T15:00:17.429 INFO:tasks.workunit.client.1.smithi190.stdout:4/45: symlink d3/l11 0 2023-12-06T15:00:17.429 INFO:tasks.workunit.client.1.smithi190.stdout:4/46: chown f2 27038054 1 2023-12-06T15:00:17.430 INFO:tasks.workunit.client.1.smithi190.stdout:3/67: mkdir d4/d15/d19/d1c 0 2023-12-06T15:00:17.434 INFO:tasks.workunit.client.1.smithi190.stdout:3/68: unlink d4/d15/c18 0 2023-12-06T15:00:17.434 INFO:tasks.workunit.client.1.smithi190.stdout:3/69: read - d4/f14 zero size 2023-12-06T15:00:17.441 INFO:tasks.workunit.client.1.smithi190.stdout:5/58: dwrite d0/f1 [0,4194304] 0 2023-12-06T15:00:17.441 INFO:tasks.workunit.client.1.smithi190.stdout:5/59: truncate d0/fd 319960 0 2023-12-06T15:00:17.442 INFO:tasks.workunit.client.1.smithi190.stdout:1/216: dwrite d6/dc/f15 [0,4194304] 0 2023-12-06T15:00:17.444 INFO:tasks.workunit.client.1.smithi190.stdout:8/46: fsync d1/fe 0 2023-12-06T15:00:17.444 INFO:tasks.workunit.client.1.smithi190.stdout:8/47: chown d1/c6 3 1 2023-12-06T15:00:17.447 INFO:tasks.workunit.client.1.smithi190.stdout:1/217: read d6/dc/f1b [2180833,114883] 0 2023-12-06T15:00:17.448 INFO:tasks.workunit.client.1.smithi190.stdout:5/60: creat d0/df/f10 x:0 0 0 2023-12-06T15:00:17.448 INFO:tasks.workunit.client.1.smithi190.stdout:5/61: write d0/fe [124349,31645] 0 2023-12-06T15:00:17.451 INFO:tasks.workunit.client.1.smithi190.stdout:3/70: getdents d4/d15 0 2023-12-06T15:00:17.452 INFO:tasks.workunit.client.1.smithi190.stdout:4/47: dread d3/f7 [0,4194304] 0 2023-12-06T15:00:17.453 INFO:tasks.workunit.client.1.smithi190.stdout:5/62: symlink d0/l11 0 2023-12-06T15:00:17.457 INFO:tasks.workunit.client.1.smithi190.stdout:2/63: dwrite f3 [0,4194304] 0 2023-12-06T15:00:17.458 INFO:tasks.workunit.client.1.smithi190.stdout:2/64: fsync fa 0 2023-12-06T15:00:17.458 INFO:tasks.workunit.client.1.smithi190.stdout:4/48: chown d3/lc 1977 1 2023-12-06T15:00:17.460 INFO:tasks.workunit.client.1.smithi190.stdout:2/65: fsync d10/d11/f13 0 2023-12-06T15:00:17.460 INFO:tasks.workunit.client.1.smithi190.stdout:4/49: creat d3/f12 x:0 0 0 2023-12-06T15:00:17.461 INFO:tasks.workunit.client.1.smithi190.stdout:4/50: fdatasync d3/f7 0 2023-12-06T15:00:17.463 INFO:tasks.workunit.client.1.smithi190.stdout:4/51: mkdir d3/d13 0 2023-12-06T15:00:17.463 INFO:tasks.workunit.client.1.smithi190.stdout:5/63: dread d0/fe [0,4194304] 0 2023-12-06T15:00:17.465 INFO:tasks.workunit.client.1.smithi190.stdout:5/64: truncate d0/f7 3506508 0 2023-12-06T15:00:17.471 INFO:tasks.workunit.client.1.smithi190.stdout:3/71: dwrite d4/f5 [4194304,4194304] 0 2023-12-06T15:00:17.484 INFO:tasks.workunit.client.1.smithi190.stdout:1/218: dwrite f1 [0,4194304] 0 2023-12-06T15:00:17.484 INFO:tasks.workunit.client.1.smithi190.stdout:1/219: fsync d6/dc/f1b 0 2023-12-06T15:00:17.485 INFO:tasks.workunit.client.1.smithi190.stdout:4/52: dwrite d3/ff [0,4194304] 0 2023-12-06T15:00:17.488 INFO:tasks.workunit.client.1.smithi190.stdout:4/53: creat d3/f14 x:0 0 0 2023-12-06T15:00:17.488 INFO:tasks.workunit.client.1.smithi190.stdout:4/54: truncate f2 5416341 0 2023-12-06T15:00:17.488 INFO:tasks.workunit.client.1.smithi190.stdout:2/66: dwrite d10/d11/f13 [0,4194304] 0 2023-12-06T15:00:17.490 INFO:tasks.workunit.client.1.smithi190.stdout:2/67: mknod d10/d11/c18 0 2023-12-06T15:00:17.490 INFO:tasks.workunit.client.1.smithi190.stdout:2/68: stat d10/d11/c17 0 2023-12-06T15:00:17.492 INFO:tasks.workunit.client.1.smithi190.stdout:3/72: truncate d4/f5 2452889 0 2023-12-06T15:00:17.493 INFO:tasks.workunit.client.1.smithi190.stdout:1/220: dread d6/f37 [0,4194304] 0 2023-12-06T15:00:17.495 INFO:tasks.workunit.client.1.smithi190.stdout:3/73: rename d4/l6 to d4/l1d 0 2023-12-06T15:00:17.495 INFO:tasks.workunit.client.1.smithi190.stdout:3/74: fdatasync d4/ff 0 2023-12-06T15:00:17.495 INFO:tasks.workunit.client.1.smithi190.stdout:3/75: write d4/fc [808205,23739] 0 2023-12-06T15:00:17.495 INFO:tasks.workunit.client.1.smithi190.stdout:3/76: write d4/fe [692652,25043] 0 2023-12-06T15:00:17.495 INFO:tasks.workunit.client.1.smithi190.stdout:3/77: write d4/f14 [25713,108422] 0 2023-12-06T15:00:17.495 INFO:tasks.workunit.client.1.smithi190.stdout:3/78: chown d4 3048789 1 2023-12-06T15:00:17.495 INFO:tasks.workunit.client.1.smithi190.stdout:1/221: getdents d6/dc/d29/d34 0 2023-12-06T15:00:17.501 INFO:tasks.workunit.client.1.smithi190.stdout:3/79: dread d4/f14 [0,4194304] 0 2023-12-06T15:00:17.501 INFO:tasks.workunit.client.1.smithi190.stdout:3/80: write d4/fc [911946,94941] 0 2023-12-06T15:00:17.503 INFO:tasks.workunit.client.1.smithi190.stdout:3/81: write d4/f5 [1684983,105449] 0 2023-12-06T15:00:17.503 INFO:tasks.workunit.client.1.smithi190.stdout:3/82: chown d4/d1b 13401 1 2023-12-06T15:00:17.503 INFO:tasks.workunit.client.1.smithi190.stdout:3/83: getdents d4/d15/d19/d1c 0 2023-12-06T15:00:17.505 INFO:tasks.workunit.client.1.smithi190.stdout:3/84: link d4/f13 d4/d15/d19/d1c/f1e 0 2023-12-06T15:00:17.505 INFO:tasks.workunit.client.1.smithi190.stdout:3/85: chown d4/l7 2126416 1 2023-12-06T15:00:17.512 INFO:tasks.workunit.client.1.smithi190.stdout:2/69: dwrite f3 [0,4194304] 0 2023-12-06T15:00:17.512 INFO:tasks.workunit.client.1.smithi190.stdout:2/70: chown d10/f12 15750181 1 2023-12-06T15:00:17.513 INFO:tasks.workunit.client.1.smithi190.stdout:2/71: mknod d10/c19 0 2023-12-06T15:00:17.516 INFO:tasks.workunit.client.1.smithi190.stdout:1/222: dwrite d6/f12 [0,4194304] 0 2023-12-06T15:00:17.517 INFO:tasks.workunit.client.1.smithi190.stdout:3/86: fsync d4/f13 0 2023-12-06T15:00:17.518 INFO:tasks.workunit.client.1.smithi190.stdout:1/223: creat d6/dc/d29/d38/d39/f3f x:0 0 0 2023-12-06T15:00:17.519 INFO:tasks.workunit.client.1.smithi190.stdout:3/87: fdatasync d4/fc 0 2023-12-06T15:00:17.519 INFO:tasks.workunit.client.1.smithi190.stdout:1/224: creat d6/dc/d3b/f40 x:0 0 0 2023-12-06T15:00:17.520 INFO:tasks.workunit.client.1.smithi190.stdout:2/72: truncate f3 2585954 0 2023-12-06T15:00:17.521 INFO:tasks.workunit.client.1.smithi190.stdout:3/88: link d4/l1d d4/d15/d19/l1f 0 2023-12-06T15:00:17.522 INFO:tasks.workunit.client.1.smithi190.stdout:2/73: write ff [2825998,90154] 0 2023-12-06T15:00:17.523 INFO:tasks.workunit.client.1.smithi190.stdout:1/225: unlink d6/dc/f24 0 2023-12-06T15:00:17.524 INFO:tasks.workunit.client.1.smithi190.stdout:3/89: creat d4/d15/d19/f20 x:0 0 0 2023-12-06T15:00:17.524 INFO:tasks.workunit.client.1.smithi190.stdout:3/90: write d4/d15/d19/f20 [637734,103520] 0 2023-12-06T15:00:17.524 INFO:tasks.workunit.client.1.smithi190.stdout:3/91: chown d4/l12 0 1 2023-12-06T15:00:17.526 INFO:tasks.workunit.client.1.smithi190.stdout:2/74: write d10/d11/f15 [161252,56500] 0 2023-12-06T15:00:17.526 INFO:tasks.workunit.client.1.smithi190.stdout:2/75: write d10/f12 [299051,45467] 0 2023-12-06T15:00:17.526 INFO:tasks.workunit.client.1.smithi190.stdout:1/226: creat d6/dc/d29/d34/f41 x:0 0 0 2023-12-06T15:00:17.526 INFO:tasks.workunit.client.1.smithi190.stdout:1/227: chown d6/dc/f9 807184 1 2023-12-06T15:00:17.528 INFO:tasks.workunit.client.1.smithi190.stdout:3/92: creat d4/d1b/f21 x:0 0 0 2023-12-06T15:00:17.528 INFO:tasks.workunit.client.1.smithi190.stdout:3/93: fsync d4/d15/d19/d1c/f1e 0 2023-12-06T15:00:17.528 INFO:tasks.workunit.client.1.smithi190.stdout:2/76: creat d10/d11/f1a x:0 0 0 2023-12-06T15:00:17.528 INFO:tasks.workunit.client.1.smithi190.stdout:2/77: dread - fa zero size 2023-12-06T15:00:17.530 INFO:tasks.workunit.client.1.smithi190.stdout:1/228: creat d6/dc/d3b/f42 x:0 0 0 2023-12-06T15:00:17.532 INFO:tasks.workunit.client.1.smithi190.stdout:1/229: mkdir d6/dc/d29/d38/d43 0 2023-12-06T15:00:17.532 INFO:tasks.workunit.client.1.smithi190.stdout:1/230: fdatasync d6/f21 0 2023-12-06T15:00:17.534 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.532+0000 7fae10258700 1 -- 172.21.15.152:0/3637974469 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae080fde00 msgr2=0x7fae080fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:17.534 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.532+0000 7fae10258700 1 --2- 172.21.15.152:0/3637974469 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae080fde00 0x7fae080fe250 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fae04004940 tx=0x7fae04009e30 comp rx=0 tx=0).stop 2023-12-06T15:00:17.534 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.532+0000 7fae10258700 1 -- 172.21.15.152:0/3637974469 shutdown_connections 2023-12-06T15:00:17.534 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.532+0000 7fae10258700 1 --2- 172.21.15.152:0/3637974469 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae080fde00 0x7fae080fe250 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:17.534 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.532+0000 7fae10258700 1 --2- 172.21.15.152:0/3637974469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae080fcbf0 0x7fae080fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:17.534 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.532+0000 7fae10258700 1 -- 172.21.15.152:0/3637974469 >> 172.21.15.152:0/3637974469 conn(0x7fae080f82d0 msgr2=0x7fae080fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:00:17.534 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.533+0000 7fae10258700 1 -- 172.21.15.152:0/3637974469 shutdown_connections 2023-12-06T15:00:17.534 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.533+0000 7fae10258700 1 -- 172.21.15.152:0/3637974469 wait complete. 2023-12-06T15:00:17.535 INFO:tasks.workunit.client.1.smithi190.stdout:1/231: symlink d6/dc/d29/l44 0 2023-12-06T15:00:17.535 INFO:tasks.workunit.client.1.smithi190.stdout:1/232: symlink d6/dc/d29/d34/l45 0 2023-12-06T15:00:17.536 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.533+0000 7fae10258700 1 Processor -- start 2023-12-06T15:00:17.536 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.534+0000 7fae10258700 1 -- start start 2023-12-06T15:00:17.536 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.534+0000 7fae10258700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae080fcbf0 0x7fae08071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:17.536 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.534+0000 7fae10258700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae080fde00 0x7fae0806ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:17.536 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.534+0000 7fae10258700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae08111220 con 0x7fae080fde00 2023-12-06T15:00:17.536 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.534+0000 7fae10258700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae08111390 con 0x7fae080fcbf0 2023-12-06T15:00:17.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.534+0000 7fae0d7f3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae080fde00 0x7fae0806ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:17.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.534+0000 7fae0d7f3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae080fde00 0x7fae0806ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60652/0 (socket says 172.21.15.152:60652) 2023-12-06T15:00:17.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.534+0000 7fae0d7f3700 1 -- 172.21.15.152:0/3166231383 learned_addr learned my addr 172.21.15.152:0/3166231383 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:00:17.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.534+0000 7fae0d7f3700 1 -- 172.21.15.152:0/3166231383 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae080fcbf0 msgr2=0x7fae08071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:17.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.534+0000 7fae0d7f3700 1 --2- 172.21.15.152:0/3166231383 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae080fcbf0 0x7fae08071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:17.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.534+0000 7fae0d7f3700 1 -- 172.21.15.152:0/3166231383 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae04005040 con 0x7fae080fde00 2023-12-06T15:00:17.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.535+0000 7fae0d7f3700 1 --2- 172.21.15.152:0/3166231383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae080fde00 0x7fae0806ff90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fae04009380 tx=0x7fae04009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:00:17.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.535+0000 7fadfe7fc700 1 -- 172.21.15.152:0/3166231383 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae0400e040 con 0x7fae080fde00 2023-12-06T15:00:17.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.535+0000 7fae10258700 1 -- 172.21.15.152:0/3166231383 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae08111610 con 0x7fae080fde00 2023-12-06T15:00:17.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.535+0000 7fae10258700 1 -- 172.21.15.152:0/3166231383 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae08111b50 con 0x7fae080fde00 2023-12-06T15:00:17.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.535+0000 7fadfe7fc700 1 -- 172.21.15.152:0/3166231383 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fae0400bda0 con 0x7fae080fde00 2023-12-06T15:00:17.537 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.535+0000 7fadfe7fc700 1 -- 172.21.15.152:0/3166231383 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae0401c3f0 con 0x7fae080fde00 2023-12-06T15:00:17.538 INFO:tasks.workunit.client.1.smithi190.stdout:1/233: write d6/f2f [171232,113503] 0 2023-12-06T15:00:17.538 INFO:tasks.workunit.client.1.smithi190.stdout:1/234: truncate d6/dc/f15 443768 0 2023-12-06T15:00:17.538 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.537+0000 7fae10258700 1 -- 172.21.15.152:0/3166231383 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadec0052e0 con 0x7fae080fde00 2023-12-06T15:00:17.539 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.537+0000 7fadfe7fc700 1 -- 172.21.15.152:0/3166231383 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7fae04013420 con 0x7fae080fde00 2023-12-06T15:00:17.539 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.537+0000 7fadfe7fc700 1 --2- 172.21.15.152:0/3166231383 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7fadf406ae40 0x7fadf406d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:17.539 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.537+0000 7fadfe7fc700 1 -- 172.21.15.152:0/3166231383 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fae0408ac40 con 0x7fae080fde00 2023-12-06T15:00:17.540 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.539+0000 7fae0dff4700 1 --2- 172.21.15.152:0/3166231383 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7fadf406ae40 0x7fadf406d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:17.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.540+0000 7fae0dff4700 1 --2- 172.21.15.152:0/3166231383 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7fadf406ae40 0x7fadf406d2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fae080718a0 tx=0x7fadf8007ce0 comp rx=0 tx=0).ready entity=mgr.14612 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:00:17.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.545+0000 7fadfe7fc700 1 -- 172.21.15.152:0/3166231383 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fae04058a40 con 0x7fae080fde00 2023-12-06T15:00:17.557 INFO:tasks.workunit.client.1.smithi190.stdout:3/94: dwrite d4/ff [0,4194304] 0 2023-12-06T15:00:17.557 INFO:tasks.workunit.client.1.smithi190.stdout:3/95: chown d4/l7 62234714 1 2023-12-06T15:00:17.558 INFO:tasks.workunit.client.1.smithi190.stdout:3/96: creat d4/d1b/f22 x:0 0 0 2023-12-06T15:00:17.558 INFO:tasks.workunit.client.1.smithi190.stdout:2/78: dwrite ff [0,4194304] 0 2023-12-06T15:00:17.559 INFO:tasks.workunit.client.1.smithi190.stdout:3/97: creat d4/d15/f23 x:0 0 0 2023-12-06T15:00:17.560 INFO:tasks.workunit.client.1.smithi190.stdout:3/98: fdatasync d4/d1b/f21 0 2023-12-06T15:00:17.560 INFO:tasks.workunit.client.1.smithi190.stdout:2/79: creat d10/d11/f1b x:0 0 0 2023-12-06T15:00:17.563 INFO:tasks.workunit.client.1.smithi190.stdout:2/80: dread d10/f12 [0,4194304] 0 2023-12-06T15:00:17.564 INFO:tasks.workunit.client.1.smithi190.stdout:2/81: mknod d10/c1c 0 2023-12-06T15:00:17.566 INFO:tasks.workunit.client.1.smithi190.stdout:2/82: mknod d10/d11/c1d 0 2023-12-06T15:00:17.566 INFO:tasks.workunit.client.1.smithi190.stdout:2/83: stat d10/d11/f16 0 2023-12-06T15:00:17.568 INFO:tasks.workunit.client.1.smithi190.stdout:3/99: dread d4/ff [0,4194304] 0 2023-12-06T15:00:17.568 INFO:tasks.workunit.client.1.smithi190.stdout:3/100: chown d4/d15/d19/d1c/f1e 187 1 2023-12-06T15:00:17.568 INFO:tasks.workunit.client.1.smithi190.stdout:3/101: chown d4/l1d 136 1 2023-12-06T15:00:17.568 INFO:tasks.workunit.client.1.smithi190.stdout:3/102: truncate d4/d15/f23 664929 0 2023-12-06T15:00:17.568 INFO:tasks.workunit.client.1.smithi190.stdout:3/103: write d4/d1b/f22 [552714,78708] 0 2023-12-06T15:00:17.568 INFO:tasks.workunit.client.1.smithi190.stdout:2/84: mknod d10/d11/c1e 0 2023-12-06T15:00:17.569 INFO:tasks.workunit.client.1.smithi190.stdout:3/104: rmdir d4 39 2023-12-06T15:00:17.569 INFO:tasks.workunit.client.1.smithi190.stdout:3/105: stat d4/f5 0 2023-12-06T15:00:17.569 INFO:tasks.workunit.client.1.smithi190.stdout:2/85: rmdir d10 39 2023-12-06T15:00:17.569 INFO:tasks.workunit.client.1.smithi190.stdout:2/86: stat fb 0 2023-12-06T15:00:17.569 INFO:tasks.workunit.client.1.smithi190.stdout:3/106: write d4/d15/d19/f20 [8401,72535] 0 2023-12-06T15:00:17.570 INFO:tasks.workunit.client.1.smithi190.stdout:3/107: creat d4/f24 x:0 0 0 2023-12-06T15:00:17.570 INFO:tasks.workunit.client.1.smithi190.stdout:3/108: mkdir d4/d1b/d25 0 2023-12-06T15:00:17.571 INFO:tasks.workunit.client.1.smithi190.stdout:3/109: fdatasync d4/f13 0 2023-12-06T15:00:17.571 INFO:tasks.workunit.client.1.smithi190.stdout:3/110: chown d4/f5 129076494 1 2023-12-06T15:00:17.589 INFO:tasks.workunit.client.1.smithi190.stdout:2/87: dwrite f5 [0,4194304] 0 2023-12-06T15:00:17.589 INFO:tasks.workunit.client.1.smithi190.stdout:2/88: chown ff 3586 1 2023-12-06T15:00:17.589 INFO:tasks.workunit.client.1.smithi190.stdout:3/111: dwrite d4/d15/d19/d1c/f1e [0,4194304] 0 2023-12-06T15:00:17.591 INFO:tasks.workunit.client.1.smithi190.stdout:2/89: creat d10/f1f x:0 0 0 2023-12-06T15:00:17.591 INFO:tasks.workunit.client.1.smithi190.stdout:2/90: readlink l7 0 2023-12-06T15:00:17.594 INFO:tasks.workunit.client.1.smithi190.stdout:2/91: symlink d10/d11/l20 0 2023-12-06T15:00:17.609 INFO:tasks.workunit.client.1.smithi190.stdout:3/112: dwrite d4/fe [0,4194304] 0 2023-12-06T15:00:17.610 INFO:tasks.workunit.client.1.smithi190.stdout:3/113: write d4/f13 [355016,66455] 0 2023-12-06T15:00:17.610 INFO:tasks.workunit.client.1.smithi190.stdout:3/114: chown d4/d15/d19/f1a 639139345 1 2023-12-06T15:00:17.615 INFO:tasks.workunit.client.1.smithi190.stdout:3/115: rename d4/d15/c16 to d4/d15/c26 0 2023-12-06T15:00:17.616 INFO:tasks.workunit.client.1.smithi190.stdout:2/92: dwrite fc [0,4194304] 0 2023-12-06T15:00:17.619 INFO:tasks.workunit.client.1.smithi190.stdout:2/93: mknod d10/c21 0 2023-12-06T15:00:17.619 INFO:tasks.workunit.client.1.smithi190.stdout:2/94: dread - d10/f1f zero size 2023-12-06T15:00:17.620 INFO:tasks.workunit.client.1.smithi190.stdout:3/116: dread d4/d15/d19/f20 [0,4194304] 0 2023-12-06T15:00:17.623 INFO:tasks.workunit.client.1.smithi190.stdout:2/95: truncate fc 1246184 0 2023-12-06T15:00:17.623 INFO:tasks.workunit.client.1.smithi190.stdout:2/96: fdatasync fc 0 2023-12-06T15:00:17.630 INFO:tasks.workunit.client.1.smithi190.stdout:2/97: truncate fb 31165 0 2023-12-06T15:00:17.633 INFO:tasks.workunit.client.1.smithi190.stdout:2/98: unlink fb 0 2023-12-06T15:00:17.646 INFO:tasks.workunit.client.1.smithi190.stdout:2/99: dwrite fa [0,4194304] 0 2023-12-06T15:00:17.646 INFO:tasks.workunit.client.1.smithi190.stdout:2/100: chown d10/f14 3039234 1 2023-12-06T15:00:17.647 INFO:tasks.workunit.client.1.smithi190.stdout:2/101: stat d10/d11/c1e 0 2023-12-06T15:00:17.648 INFO:tasks.workunit.client.1.smithi190.stdout:2/102: mknod d10/c22 0 2023-12-06T15:00:17.649 INFO:tasks.workunit.client.1.smithi190.stdout:2/103: getdents d10/d11 0 2023-12-06T15:00:17.651 INFO:tasks.workunit.client.1.smithi190.stdout:2/104: dread d10/d11/f15 [0,4194304] 0 2023-12-06T15:00:17.651 INFO:tasks.workunit.client.1.smithi190.stdout:2/105: mknod d10/c23 0 2023-12-06T15:00:17.652 INFO:tasks.workunit.client.1.smithi190.stdout:2/106: chown d10/d11/c1d 180515 1 2023-12-06T15:00:17.652 INFO:tasks.workunit.client.1.smithi190.stdout:2/107: creat d10/d11/f24 x:0 0 0 2023-12-06T15:00:17.654 INFO:tasks.workunit.client.1.smithi190.stdout:2/108: write ff [2927340,29774] 0 2023-12-06T15:00:17.655 INFO:tasks.workunit.client.1.smithi190.stdout:2/109: creat d10/d11/f25 x:0 0 0 2023-12-06T15:00:17.655 INFO:tasks.workunit.client.1.smithi190.stdout:2/110: fsync f5 0 2023-12-06T15:00:17.665 INFO:tasks.workunit.client.1.smithi190.stdout:2/111: dread ff [0,4194304] 0 2023-12-06T15:00:17.666 INFO:tasks.workunit.client.1.smithi190.stdout:2/112: fsync d10/d11/f15 0 2023-12-06T15:00:17.666 INFO:tasks.workunit.client.1.smithi190.stdout:2/113: fdatasync d10/f14 0 2023-12-06T15:00:17.666 INFO:tasks.workunit.client.1.smithi190.stdout:2/114: write d10/d11/f1b [794691,54900] 0 2023-12-06T15:00:17.670 INFO:tasks.workunit.client.1.smithi190.stdout:7/65: sync 2023-12-06T15:00:17.672 INFO:tasks.workunit.client.1.smithi190.stdout:7/66: symlink d0/df/d10/l14 0 2023-12-06T15:00:17.672 INFO:tasks.workunit.client.1.smithi190.stdout:7/67: chown d0/f6 36881 1 2023-12-06T15:00:17.673 INFO:tasks.workunit.client.1.smithi190.stdout:7/68: truncate d0/f3 3074960 0 2023-12-06T15:00:17.673 INFO:tasks.workunit.client.1.smithi190.stdout:7/69: stat d0/d5/f9 0 2023-12-06T15:00:17.675 INFO:tasks.workunit.client.1.smithi190.stdout:7/70: getdents d0/df 0 2023-12-06T15:00:17.675 INFO:tasks.workunit.client.1.smithi190.stdout:7/71: read - d0/d5/da/fb zero size 2023-12-06T15:00:17.675 INFO:tasks.workunit.client.1.smithi190.stdout:7/72: write d0/d5/f9 [5043338,241] 0 2023-12-06T15:00:17.675 INFO:tasks.workunit.client.1.smithi190.stdout:7/73: chown d0/d5/f9 5129 1 2023-12-06T15:00:17.676 INFO:tasks.workunit.client.1.smithi190.stdout:7/74: mkdir d0/df/d10/d15 0 2023-12-06T15:00:17.679 INFO:tasks.workunit.client.1.smithi190.stdout:7/75: fsync d0/d5/f9 0 2023-12-06T15:00:17.679 INFO:tasks.workunit.client.1.smithi190.stdout:7/76: fdatasync d0/fc 0 2023-12-06T15:00:17.680 INFO:tasks.workunit.client.1.smithi190.stdout:2/115: dwrite d10/f12 [0,4194304] 0 2023-12-06T15:00:17.680 INFO:tasks.workunit.client.1.smithi190.stdout:7/77: symlink d0/df/d10/d15/l16 0 2023-12-06T15:00:17.683 INFO:tasks.workunit.client.1.smithi190.stdout:2/116: rmdir d10/d11 39 2023-12-06T15:00:17.685 INFO:tasks.workunit.client.1.smithi190.stdout:2/117: mkdir d10/d26 0 2023-12-06T15:00:17.790 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.789+0000 7fae10258700 1 -- 172.21.15.152:0/3166231383 --> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fadec000bf0 con 0x7fadf406ae40 2023-12-06T15:00:17.791 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.790+0000 7fadfe7fc700 1 -- 172.21.15.152:0/3166231383 <== mgr.14612 v2:172.21.15.190:6828/3047155534 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fadec000bf0 con 0x7fadf406ae40 2023-12-06T15:00:17.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.792+0000 7fae10258700 1 -- 172.21.15.152:0/3166231383 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7fadf406ae40 msgr2=0x7fadf406d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:17.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.792+0000 7fae10258700 1 --2- 172.21.15.152:0/3166231383 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7fadf406ae40 0x7fadf406d2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fae080718a0 tx=0x7fadf8007ce0 comp rx=0 tx=0).stop 2023-12-06T15:00:17.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.792+0000 7fae10258700 1 -- 172.21.15.152:0/3166231383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae080fde00 msgr2=0x7fae0806ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:17.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.792+0000 7fae10258700 1 --2- 172.21.15.152:0/3166231383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae080fde00 0x7fae0806ff90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fae04009380 tx=0x7fae04009e30 comp rx=0 tx=0).stop 2023-12-06T15:00:17.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.792+0000 7fae10258700 1 -- 172.21.15.152:0/3166231383 shutdown_connections 2023-12-06T15:00:17.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.793+0000 7fae10258700 1 --2- 172.21.15.152:0/3166231383 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7fadf406ae40 0x7fadf406d2f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:17.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.793+0000 7fae10258700 1 --2- 172.21.15.152:0/3166231383 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae080fcbf0 0x7fae08071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:17.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.793+0000 7fae10258700 1 --2- 172.21.15.152:0/3166231383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae080fde00 0x7fae0806ff90 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:17.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.793+0000 7fae10258700 1 -- 172.21.15.152:0/3166231383 >> 172.21.15.152:0/3166231383 conn(0x7fae080f82d0 msgr2=0x7fae08101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:00:17.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.793+0000 7fae10258700 1 -- 172.21.15.152:0/3166231383 shutdown_connections 2023-12-06T15:00:17.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.793+0000 7fae10258700 1 -- 172.21.15.152:0/3166231383 wait complete. 2023-12-06T15:00:17.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:17 smithi190 ceph-mon[121340]: pgmap v20: 65 pgs: 65 active+clean; 412 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 18 MiB/s rd, 33 MiB/s wr, 845 op/s 2023-12-06T15:00:17.877 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:17 smithi152 ceph-mon[111954]: pgmap v20: 65 pgs: 65 active+clean; 412 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 18 MiB/s rd, 33 MiB/s wr, 845 op/s 2023-12-06T15:00:17.893 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.892+0000 7f0950c84700 1 -- 172.21.15.152:0/816668550 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f094c066070 msgr2=0x7f094c0ff7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:17.893 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.892+0000 7f0950c84700 1 --2- 172.21.15.152:0/816668550 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f094c066070 0x7f094c0ff7c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f093c004940 tx=0x7f093c009e30 comp rx=0 tx=0).stop 2023-12-06T15:00:17.893 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.892+0000 7f0950c84700 1 -- 172.21.15.152:0/816668550 shutdown_connections 2023-12-06T15:00:17.893 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.892+0000 7f0950c84700 1 --2- 172.21.15.152:0/816668550 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f094c0ffd90 0x7f094c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:17.893 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.892+0000 7f0950c84700 1 --2- 172.21.15.152:0/816668550 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f094c066070 0x7f094c0ff7c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:17.893 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.892+0000 7f0950c84700 1 -- 172.21.15.152:0/816668550 >> 172.21.15.152:0/816668550 conn(0x7f094c0f7190 msgr2=0x7f094c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:00:17.893 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.892+0000 7f0950c84700 1 -- 172.21.15.152:0/816668550 shutdown_connections 2023-12-06T15:00:17.893 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.892+0000 7f0950c84700 1 -- 172.21.15.152:0/816668550 wait complete. 2023-12-06T15:00:17.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.892+0000 7f0950c84700 1 Processor -- start 2023-12-06T15:00:17.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.892+0000 7f0950c84700 1 -- start start 2023-12-06T15:00:17.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.893+0000 7f0950c84700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f094c066070 0x7f094c10d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:17.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.893+0000 7f0950c84700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f094c0ffd90 0x7f094c10da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:17.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.893+0000 7f0950c84700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c10e070 con 0x7f094c0ffd90 2023-12-06T15:00:17.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.893+0000 7f0950c84700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c10e910 con 0x7f094c066070 2023-12-06T15:00:17.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.893+0000 7f0949d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f094c0ffd90 0x7f094c10da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:17.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.893+0000 7f0949d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f094c0ffd90 0x7f094c10da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60666/0 (socket says 172.21.15.152:60666) 2023-12-06T15:00:17.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.893+0000 7f0949d9b700 1 -- 172.21.15.152:0/428138492 learned_addr learned my addr 172.21.15.152:0/428138492 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:00:17.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.893+0000 7f094a59c700 1 --2- 172.21.15.152:0/428138492 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f094c066070 0x7f094c10d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:17.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.893+0000 7f0949d9b700 1 -- 172.21.15.152:0/428138492 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f094c066070 msgr2=0x7f094c10d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:17.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.893+0000 7f0949d9b700 1 --2- 172.21.15.152:0/428138492 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f094c066070 0x7f094c10d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:17.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.893+0000 7f0949d9b700 1 -- 172.21.15.152:0/428138492 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093c005040 con 0x7f094c0ffd90 2023-12-06T15:00:17.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.893+0000 7f0949d9b700 1 --2- 172.21.15.152:0/428138492 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f094c0ffd90 0x7f094c10da70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0934002a50 tx=0x7f0934004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:00:17.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.893+0000 7f0942ffd700 1 -- 172.21.15.152:0/428138492 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0934007cc0 con 0x7f094c0ffd90 2023-12-06T15:00:17.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.893+0000 7f0950c84700 1 -- 172.21.15.152:0/428138492 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f094c10ebf0 con 0x7f094c0ffd90 2023-12-06T15:00:17.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.893+0000 7f0942ffd700 1 -- 172.21.15.152:0/428138492 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f093400f040 con 0x7f094c0ffd90 2023-12-06T15:00:17.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.893+0000 7f0942ffd700 1 -- 172.21.15.152:0/428138492 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f093400d920 con 0x7f094c0ffd90 2023-12-06T15:00:17.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.893+0000 7f0950c84700 1 -- 172.21.15.152:0/428138492 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f094c10f130 con 0x7f094c0ffd90 2023-12-06T15:00:17.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.894+0000 7f0950c84700 1 -- 172.21.15.152:0/428138492 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f094c1075f0 con 0x7f094c0ffd90 2023-12-06T15:00:17.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.895+0000 7f0942ffd700 1 -- 172.21.15.152:0/428138492 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f0934009680 con 0x7f094c0ffd90 2023-12-06T15:00:17.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.895+0000 7f0942ffd700 1 --2- 172.21.15.152:0/428138492 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f093806ae40 0x7f093806d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:17.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.895+0000 7f0942ffd700 1 -- 172.21.15.152:0/428138492 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f0934089580 con 0x7f094c0ffd90 2023-12-06T15:00:17.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.895+0000 7f094a59c700 1 --2- 172.21.15.152:0/428138492 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f093806ae40 0x7f093806d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:17.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.896+0000 7f094a59c700 1 --2- 172.21.15.152:0/428138492 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f093806ae40 0x7f093806d2f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f093c00b3b0 tx=0x7f093c009e30 comp rx=0 tx=0).ready entity=mgr.14612 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:00:17.900 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:17.899+0000 7f0942ffd700 1 -- 172.21.15.152:0/428138492 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f0934057300 con 0x7f094c0ffd90 2023-12-06T15:00:18.099 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.098+0000 7f0950c84700 1 -- 172.21.15.152:0/428138492 --> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f094c10f3c0 con 0x7f093806ae40 2023-12-06T15:00:18.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.109+0000 7f0942ffd700 1 -- 172.21.15.152:0/428138492 <== mgr.14612 v2:172.21.15.190:6828/3047155534 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f094c10f3c0 con 0x7f093806ae40 2023-12-06T15:00:18.109 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-06T15:00:18.109 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 starting - - - - 2023-12-06T15:00:18.109 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (6m) 25s ago 6m 7436k - 17.2.7-113-gece0d607 a5c6421f1c5f 40d5cebbdb93 2023-12-06T15:00:18.109 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi190 smithi190 running (5m) 27s ago 5m 7461k - 17.2.7-113-gece0d607 a5c6421f1c5f 3a387cddf7e6 2023-12-06T15:00:18.109 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (5m) 25s ago 5m 95.9M - 9.4.7 954c08fa6188 22085689650a 2023-12-06T15:00:18.109 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.acqswy smithi152 running (2m) 25s ago 2m 573M - 17.2.7-113-gece0d607 a5c6421f1c5f ff9375cec192 2023-12-06T15:00:18.109 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.ypivwc smithi152 running (2m) 25s ago 2m 18.8M - 17.2.7-113-gece0d607 a5c6421f1c5f d809a681491b 2023-12-06T15:00:18.109 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi190.edwtqj smithi190 running (2m) 27s ago 2m 92.6M - 17.2.7-113-gece0d607 a5c6421f1c5f f3b7ebd93b04 2023-12-06T15:00:18.109 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi190.uucxzu smithi190 running (2m) 27s ago 2m 20.9M - 17.2.7-113-gece0d607 a5c6421f1c5f c01be1409c5f 2023-12-06T15:00:18.110 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.meodco smithi152 *:9283 running (7m) 25s ago 7m 433M - 17.2.7-113-gece0d607 a5c6421f1c5f 9d7a3190a8fa 2023-12-06T15:00:18.110 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi190.ubusrr smithi190 *:8443,9283 running (43s) 27s ago 5m 497M - 19.0.0-26-g0482646f 26bb7d89db2e 80c6d3654b71 2023-12-06T15:00:18.110 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (7m) 25s ago 7m 82.0M 2048M 17.2.7-113-gece0d607 a5c6421f1c5f 2b9f6058715d 2023-12-06T15:00:18.110 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi190 smithi190 running (5m) 27s ago 5m 55.3M 2048M 17.2.7-113-gece0d607 a5c6421f1c5f 3a81d140940b 2023-12-06T15:00:18.110 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 starting - - - - 2023-12-06T15:00:18.110 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi190 smithi190 *:9100 running (5m) 27s ago 5m 19.3M - 1.5.0 0da6a335fe13 39b96c91b1ce 2023-12-06T15:00:18.110 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (4m) 25s ago 4m 128M 1568M 17.2.7-113-gece0d607 a5c6421f1c5f 499f740f966e 2023-12-06T15:00:18.110 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (4m) 25s ago 4m 142M 1568M 17.2.7-113-gece0d607 a5c6421f1c5f 3942f134581a 2023-12-06T15:00:18.110 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (4m) 25s ago 4m 117M 1568M 17.2.7-113-gece0d607 a5c6421f1c5f 80bcc4927bb2 2023-12-06T15:00:18.110 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi190 running (3m) 27s ago 3m 141M 2592M 17.2.7-113-gece0d607 a5c6421f1c5f f0281d01fec4 2023-12-06T15:00:18.110 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi190 running (3m) 27s ago 3m 121M 2592M 17.2.7-113-gece0d607 a5c6421f1c5f a415b29ad9c7 2023-12-06T15:00:18.110 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi190 running (3m) 27s ago 3m 127M 2592M 17.2.7-113-gece0d607 a5c6421f1c5f b0f2767055a5 2023-12-06T15:00:18.110 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi152 smithi152 *:9095 running (4m) 25s ago 5m 57.8M - 2.43.0 a07b618ecd1d fabe795a329c 2023-12-06T15:00:18.111 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.110+0000 7f0950c84700 1 -- 172.21.15.152:0/428138492 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f093806ae40 msgr2=0x7f093806d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:18.111 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.110+0000 7f0950c84700 1 --2- 172.21.15.152:0/428138492 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f093806ae40 0x7f093806d2f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f093c00b3b0 tx=0x7f093c009e30 comp rx=0 tx=0).stop 2023-12-06T15:00:18.111 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.110+0000 7f0950c84700 1 -- 172.21.15.152:0/428138492 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f094c0ffd90 msgr2=0x7f094c10da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:18.111 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.110+0000 7f0950c84700 1 --2- 172.21.15.152:0/428138492 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f094c0ffd90 0x7f094c10da70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0934002a50 tx=0x7f0934004600 comp rx=0 tx=0).stop 2023-12-06T15:00:18.111 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.110+0000 7f0950c84700 1 -- 172.21.15.152:0/428138492 shutdown_connections 2023-12-06T15:00:18.111 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.110+0000 7f0950c84700 1 --2- 172.21.15.152:0/428138492 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f093806ae40 0x7f093806d2f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:18.112 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.110+0000 7f0950c84700 1 --2- 172.21.15.152:0/428138492 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f094c066070 0x7f094c10d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:18.112 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.110+0000 7f0950c84700 1 --2- 172.21.15.152:0/428138492 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f094c0ffd90 0x7f094c10da70 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:18.112 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.110+0000 7f0950c84700 1 -- 172.21.15.152:0/428138492 >> 172.21.15.152:0/428138492 conn(0x7f094c0f7190 msgr2=0x7f094c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:00:18.112 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.110+0000 7f0950c84700 1 -- 172.21.15.152:0/428138492 shutdown_connections 2023-12-06T15:00:18.112 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.110+0000 7f0950c84700 1 -- 172.21.15.152:0/428138492 wait complete. 2023-12-06T15:00:18.210 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.208+0000 7f3ad33a3700 1 -- 172.21.15.152:0/2863824144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3acc0fbaf0 msgr2=0x7f3acc0fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:18.210 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.208+0000 7f3ad33a3700 1 --2- 172.21.15.152:0/2863824144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3acc0fbaf0 0x7f3acc0fbf00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8004940 tx=0x7f3ac8009e30 comp rx=0 tx=0).stop 2023-12-06T15:00:18.210 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.208+0000 7f3ad33a3700 1 -- 172.21.15.152:0/2863824144 shutdown_connections 2023-12-06T15:00:18.210 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.208+0000 7f3ad33a3700 1 --2- 172.21.15.152:0/2863824144 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3acc0fcd00 0x7f3acc0fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:18.210 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.209+0000 7f3ad33a3700 1 --2- 172.21.15.152:0/2863824144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3acc0fbaf0 0x7f3acc0fbf00 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:18.210 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.209+0000 7f3ad33a3700 1 -- 172.21.15.152:0/2863824144 >> 172.21.15.152:0/2863824144 conn(0x7f3acc0f71d0 msgr2=0x7f3acc0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:00:18.210 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.209+0000 7f3ad33a3700 1 -- 172.21.15.152:0/2863824144 shutdown_connections 2023-12-06T15:00:18.210 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.209+0000 7f3ad33a3700 1 -- 172.21.15.152:0/2863824144 wait complete. 2023-12-06T15:00:18.212 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.209+0000 7f3ad33a3700 1 Processor -- start 2023-12-06T15:00:18.212 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.209+0000 7f3ad33a3700 1 -- start start 2023-12-06T15:00:18.212 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.209+0000 7f3ad33a3700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3acc0fbaf0 0x7f3acc10c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:18.212 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.209+0000 7f3ad33a3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3acc0fcd00 0x7f3acc10c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:18.213 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.209+0000 7f3ad33a3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc10cfa0 con 0x7f3acc0fcd00 2023-12-06T15:00:18.213 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.209+0000 7f3ad33a3700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc10d840 con 0x7f3acc0fbaf0 2023-12-06T15:00:18.213 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.209+0000 7f3ad093e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3acc0fcd00 0x7f3acc10c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:18.213 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.209+0000 7f3ad093e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3acc0fcd00 0x7f3acc10c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60692/0 (socket says 172.21.15.152:60692) 2023-12-06T15:00:18.213 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.209+0000 7f3ad093e700 1 -- 172.21.15.152:0/1605883931 learned_addr learned my addr 172.21.15.152:0/1605883931 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:00:18.213 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.209+0000 7f3ad113f700 1 --2- 172.21.15.152:0/1605883931 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3acc0fbaf0 0x7f3acc10c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:18.213 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.210+0000 7f3ad093e700 1 -- 172.21.15.152:0/1605883931 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3acc0fbaf0 msgr2=0x7f3acc10c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:18.213 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.210+0000 7f3ad093e700 1 --2- 172.21.15.152:0/1605883931 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3acc0fbaf0 0x7f3acc10c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:18.213 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.210+0000 7f3ad093e700 1 -- 172.21.15.152:0/1605883931 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac8005040 con 0x7f3acc0fcd00 2023-12-06T15:00:18.213 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.210+0000 7f3ad093e700 1 --2- 172.21.15.152:0/1605883931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3acc0fcd00 0x7f3acc10c9a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3abc00c830 tx=0x7f3abc004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:00:18.213 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.210+0000 7f3ac1ffb700 1 -- 172.21.15.152:0/1605883931 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3abc0106f0 con 0x7f3acc0fcd00 2023-12-06T15:00:18.213 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.210+0000 7f3ac1ffb700 1 -- 172.21.15.152:0/1605883931 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3abc010d00 con 0x7f3acc0fcd00 2023-12-06T15:00:18.213 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.210+0000 7f3ad33a3700 1 -- 172.21.15.152:0/1605883931 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3acc10db20 con 0x7f3acc0fcd00 2023-12-06T15:00:18.213 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.210+0000 7f3ac1ffb700 1 -- 172.21.15.152:0/1605883931 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3abc012e90 con 0x7f3acc0fcd00 2023-12-06T15:00:18.213 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.210+0000 7f3ad33a3700 1 -- 172.21.15.152:0/1605883931 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3acc10e060 con 0x7f3acc0fcd00 2023-12-06T15:00:18.214 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.211+0000 7f3ad33a3700 1 -- 172.21.15.152:0/1605883931 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3acc04bb80 con 0x7f3acc0fcd00 2023-12-06T15:00:18.214 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.211+0000 7f3ac1ffb700 1 -- 172.21.15.152:0/1605883931 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f3abc010850 con 0x7f3acc0fcd00 2023-12-06T15:00:18.214 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.212+0000 7f3ac1ffb700 1 --2- 172.21.15.152:0/1605883931 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f3ab806ae40 0x7f3ab806d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:18.214 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.212+0000 7f3ac1ffb700 1 -- 172.21.15.152:0/1605883931 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f3abc0896a0 con 0x7f3acc0fcd00 2023-12-06T15:00:18.215 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.212+0000 7f3ad113f700 1 --2- 172.21.15.152:0/1605883931 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f3ab806ae40 0x7f3ab806d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:18.215 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.212+0000 7f3ad113f700 1 --2- 172.21.15.152:0/1605883931 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f3ab806ae40 0x7f3ab806d2f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8004890 tx=0x7f3ac8009e30 comp rx=0 tx=0).ready entity=mgr.14612 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:00:18.217 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.216+0000 7f3ac1ffb700 1 -- 172.21.15.152:0/1605883931 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f3abc0575b0 con 0x7f3acc0fcd00 2023-12-06T15:00:18.493 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.492+0000 7f3ad33a3700 1 -- 172.21.15.152:0/1605883931 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3acc104490 con 0x7f3acc0fcd00 2023-12-06T15:00:18.494 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.493+0000 7f3ac1ffb700 1 -- 172.21.15.152:0/1605883931 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+840 (secure 0 0 0) 0x7f3abc057140 con 0x7f3acc0fcd00 2023-12-06T15:00:18.494 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-12-06T15:00:18.494 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": { 2023-12-06T15:00:18.494 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 2 2023-12-06T15:00:18.494 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:00:18.494 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": { 2023-12-06T15:00:18.494 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 1, 2023-12-06T15:00:18.494 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 1 2023-12-06T15:00:18.494 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:00:18.495 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": { 2023-12-06T15:00:18.495 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 6 2023-12-06T15:00:18.495 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:00:18.495 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2023-12-06T15:00:18.495 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 4 2023-12-06T15:00:18.495 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:00:18.495 INFO:teuthology.orchestra.run.smithi152.stdout: "overall": { 2023-12-06T15:00:18.495 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 13, 2023-12-06T15:00:18.495 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 1 2023-12-06T15:00:18.495 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-12-06T15:00:18.495 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-12-06T15:00:18.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.495+0000 7f3ad33a3700 1 -- 172.21.15.152:0/1605883931 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f3ab806ae40 msgr2=0x7f3ab806d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:18.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.495+0000 7f3ad33a3700 1 --2- 172.21.15.152:0/1605883931 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f3ab806ae40 0x7f3ab806d2f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8004890 tx=0x7f3ac8009e30 comp rx=0 tx=0).stop 2023-12-06T15:00:18.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.495+0000 7f3ad33a3700 1 -- 172.21.15.152:0/1605883931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3acc0fcd00 msgr2=0x7f3acc10c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:18.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.495+0000 7f3ad33a3700 1 --2- 172.21.15.152:0/1605883931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3acc0fcd00 0x7f3acc10c9a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3abc00c830 tx=0x7f3abc004470 comp rx=0 tx=0).stop 2023-12-06T15:00:18.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.495+0000 7f3ad33a3700 1 -- 172.21.15.152:0/1605883931 shutdown_connections 2023-12-06T15:00:18.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.495+0000 7f3ad33a3700 1 --2- 172.21.15.152:0/1605883931 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f3ab806ae40 0x7f3ab806d2f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:18.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.495+0000 7f3ad33a3700 1 --2- 172.21.15.152:0/1605883931 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3acc0fbaf0 0x7f3acc10c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:18.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.495+0000 7f3ad33a3700 1 --2- 172.21.15.152:0/1605883931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3acc0fcd00 0x7f3acc10c9a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:18.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.495+0000 7f3ad33a3700 1 -- 172.21.15.152:0/1605883931 >> 172.21.15.152:0/1605883931 conn(0x7f3acc0f71d0 msgr2=0x7f3acc0fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:00:18.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.495+0000 7f3ad33a3700 1 -- 172.21.15.152:0/1605883931 shutdown_connections 2023-12-06T15:00:18.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.495+0000 7f3ad33a3700 1 -- 172.21.15.152:0/1605883931 wait complete. 2023-12-06T15:00:18.598 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.597+0000 7efca3855700 1 -- 172.21.15.152:0/3119993859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc9c100050 msgr2=0x7efc9c102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:18.598 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.597+0000 7efca3855700 1 --2- 172.21.15.152:0/3119993859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc9c100050 0x7efc9c102430 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7efc98004940 tx=0x7efc98009e30 comp rx=0 tx=0).stop 2023-12-06T15:00:18.598 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.597+0000 7efca3855700 1 -- 172.21.15.152:0/3119993859 shutdown_connections 2023-12-06T15:00:18.598 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.597+0000 7efca3855700 1 --2- 172.21.15.152:0/3119993859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc9c100050 0x7efc9c102430 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:18.599 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.597+0000 7efca3855700 1 --2- 172.21.15.152:0/3119993859 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc9c0fd730 0x7efc9c0ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:18.599 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.597+0000 7efca3855700 1 -- 172.21.15.152:0/3119993859 >> 172.21.15.152:0/3119993859 conn(0x7efc9c0f7190 msgr2=0x7efc9c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:00:18.599 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.597+0000 7efca3855700 1 -- 172.21.15.152:0/3119993859 shutdown_connections 2023-12-06T15:00:18.599 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.597+0000 7efca3855700 1 -- 172.21.15.152:0/3119993859 wait complete. 2023-12-06T15:00:18.600 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.598+0000 7efca3855700 1 Processor -- start 2023-12-06T15:00:18.600 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.598+0000 7efca3855700 1 -- start start 2023-12-06T15:00:18.601 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.598+0000 7efca3855700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc9c0fd730 0x7efc9c10d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:18.601 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.598+0000 7efca3855700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc9c100050 0x7efc9c10da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:18.601 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.598+0000 7efca3855700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c10e070 con 0x7efc9c0fd730 2023-12-06T15:00:18.601 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.598+0000 7efca3855700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c10e910 con 0x7efc9c100050 2023-12-06T15:00:18.601 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.598+0000 7efca15f1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc9c0fd730 0x7efc9c10d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:18.601 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.598+0000 7efca15f1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc9c0fd730 0x7efc9c10d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60704/0 (socket says 172.21.15.152:60704) 2023-12-06T15:00:18.601 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.598+0000 7efca15f1700 1 -- 172.21.15.152:0/1690032725 learned_addr learned my addr 172.21.15.152:0/1690032725 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:00:18.601 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.598+0000 7efca0df0700 1 --2- 172.21.15.152:0/1690032725 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc9c100050 0x7efc9c10da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:18.601 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.598+0000 7efca15f1700 1 -- 172.21.15.152:0/1690032725 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc9c100050 msgr2=0x7efc9c10da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:18.601 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.598+0000 7efca15f1700 1 --2- 172.21.15.152:0/1690032725 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc9c100050 0x7efc9c10da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:18.601 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.598+0000 7efca15f1700 1 -- 172.21.15.152:0/1690032725 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc98005040 con 0x7efc9c0fd730 2023-12-06T15:00:18.601 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.598+0000 7efca15f1700 1 --2- 172.21.15.152:0/1690032725 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc9c0fd730 0x7efc9c10d530 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7efc8c002a50 tx=0x7efc8c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:00:18.601 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.599+0000 7efc91ffb700 1 -- 172.21.15.152:0/1690032725 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc8c007cc0 con 0x7efc9c0fd730 2023-12-06T15:00:18.601 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.599+0000 7efc91ffb700 1 -- 172.21.15.152:0/1690032725 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efc8c00f040 con 0x7efc9c0fd730 2023-12-06T15:00:18.602 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.599+0000 7efca3855700 1 -- 172.21.15.152:0/1690032725 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc9c10ebf0 con 0x7efc9c0fd730 2023-12-06T15:00:18.602 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.599+0000 7efc91ffb700 1 -- 172.21.15.152:0/1690032725 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc8c00d9c0 con 0x7efc9c0fd730 2023-12-06T15:00:18.602 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.599+0000 7efca3855700 1 -- 172.21.15.152:0/1690032725 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc9c10f130 con 0x7efc9c0fd730 2023-12-06T15:00:18.603 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.600+0000 7efca3855700 1 -- 172.21.15.152:0/1690032725 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc9c1075c0 con 0x7efc9c0fd730 2023-12-06T15:00:18.603 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.600+0000 7efc91ffb700 1 -- 172.21.15.152:0/1690032725 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7efc8c00db20 con 0x7efc9c0fd730 2023-12-06T15:00:18.603 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.601+0000 7efc91ffb700 1 --2- 172.21.15.152:0/1690032725 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7efc8806ae40 0x7efc8806d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:18.603 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.601+0000 7efc91ffb700 1 -- 172.21.15.152:0/1690032725 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7efc8c089430 con 0x7efc9c0fd730 2023-12-06T15:00:18.603 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.601+0000 7efca0df0700 1 --2- 172.21.15.152:0/1690032725 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7efc8806ae40 0x7efc8806d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:18.603 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.601+0000 7efca0df0700 1 --2- 172.21.15.152:0/1690032725 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7efc8806ae40 0x7efc8806d2f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efc98004890 tx=0x7efc98009e30 comp rx=0 tx=0).ready entity=mgr.14612 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:00:18.606 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.605+0000 7efc91ffb700 1 -- 172.21.15.152:0/1690032725 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7efc8c057230 con 0x7efc9c0fd730 2023-12-06T15:00:18.841 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.839+0000 7efca3855700 1 -- 172.21.15.152:0/1690032725 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efc9c10f3a0 con 0x7efc9c0fd730 2023-12-06T15:00:18.841 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.840+0000 7efc91ffb700 1 -- 172.21.15.152:0/1690032725 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1852 (secure 0 0 0) 0x7efc8c056dc0 con 0x7efc9c0fd730 2023-12-06T15:00:18.841 INFO:teuthology.orchestra.run.smithi152.stdout:e15 2023-12-06T15:00:18.841 INFO:teuthology.orchestra.run.smithi152.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-06T15:00:18.841 INFO:teuthology.orchestra.run.smithi152.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-06T15:00:18.841 INFO:teuthology.orchestra.run.smithi152.stdout:legacy client fscid: 1 2023-12-06T15:00:18.841 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T15:00:18.841 INFO:teuthology.orchestra.run.smithi152.stdout:Filesystem 'cephfs' (1) 2023-12-06T15:00:18.842 INFO:teuthology.orchestra.run.smithi152.stdout:fs_name cephfs 2023-12-06T15:00:18.842 INFO:teuthology.orchestra.run.smithi152.stdout:epoch 15 2023-12-06T15:00:18.842 INFO:teuthology.orchestra.run.smithi152.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-06T15:00:18.842 INFO:teuthology.orchestra.run.smithi152.stdout:created 2023-12-06T14:57:59.352201+0000 2023-12-06T15:00:18.842 INFO:teuthology.orchestra.run.smithi152.stdout:modified 2023-12-06T14:59:52.365348+0000 2023-12-06T15:00:18.842 INFO:teuthology.orchestra.run.smithi152.stdout:tableserver 0 2023-12-06T15:00:18.842 INFO:teuthology.orchestra.run.smithi152.stdout:root 0 2023-12-06T15:00:18.842 INFO:teuthology.orchestra.run.smithi152.stdout:session_timeout 60 2023-12-06T15:00:18.842 INFO:teuthology.orchestra.run.smithi152.stdout:session_autoclose 300 2023-12-06T15:00:18.842 INFO:teuthology.orchestra.run.smithi152.stdout:max_file_size 1099511627776 2023-12-06T15:00:18.842 INFO:teuthology.orchestra.run.smithi152.stdout:required_client_features {} 2023-12-06T15:00:18.842 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure 0 2023-12-06T15:00:18.842 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure_osd_epoch 0 2023-12-06T15:00:18.843 INFO:teuthology.orchestra.run.smithi152.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-06T15:00:18.843 INFO:teuthology.orchestra.run.smithi152.stdout:max_mds 2 2023-12-06T15:00:18.843 INFO:teuthology.orchestra.run.smithi152.stdout:in 0,1 2023-12-06T15:00:18.843 INFO:teuthology.orchestra.run.smithi152.stdout:up {0=14464,1=24255} 2023-12-06T15:00:18.843 INFO:teuthology.orchestra.run.smithi152.stdout:failed 2023-12-06T15:00:18.843 INFO:teuthology.orchestra.run.smithi152.stdout:damaged 2023-12-06T15:00:18.843 INFO:teuthology.orchestra.run.smithi152.stdout:stopped 2023-12-06T15:00:18.843 INFO:teuthology.orchestra.run.smithi152.stdout:data_pools [3] 2023-12-06T15:00:18.843 INFO:teuthology.orchestra.run.smithi152.stdout:metadata_pool 2 2023-12-06T15:00:18.843 INFO:teuthology.orchestra.run.smithi152.stdout:inline_data disabled 2023-12-06T15:00:18.843 INFO:teuthology.orchestra.run.smithi152.stdout:balancer 2023-12-06T15:00:18.843 INFO:teuthology.orchestra.run.smithi152.stdout:standby_count_wanted 1 2023-12-06T15:00:18.843 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.acqswy{0:14464} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.152:6826/2467413186,v1:172.21.15.152:6827/2467413186] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:00:18.843 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi190.edwtqj{0:24271} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.190:6826/2256465065,v1:172.21.15.190:6827/2256465065] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:00:18.843 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi190.uucxzu{1:24255} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.190:6824/3250692478,v1:172.21.15.190:6825/3250692478] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:00:18.844 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.ypivwc{1:14480} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.152:6828/697313573,v1:172.21.15.152:6829/697313573] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:00:18.844 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T15:00:18.844 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T15:00:18.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.842+0000 7efca3855700 1 -- 172.21.15.152:0/1690032725 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7efc8806ae40 msgr2=0x7efc8806d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:18.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.842+0000 7efca3855700 1 --2- 172.21.15.152:0/1690032725 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7efc8806ae40 0x7efc8806d2f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efc98004890 tx=0x7efc98009e30 comp rx=0 tx=0).stop 2023-12-06T15:00:18.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.842+0000 7efca3855700 1 -- 172.21.15.152:0/1690032725 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc9c0fd730 msgr2=0x7efc9c10d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:18.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.842+0000 7efca3855700 1 --2- 172.21.15.152:0/1690032725 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc9c0fd730 0x7efc9c10d530 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7efc8c002a50 tx=0x7efc8c0046b0 comp rx=0 tx=0).stop 2023-12-06T15:00:18.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.842+0000 7efca3855700 1 -- 172.21.15.152:0/1690032725 shutdown_connections 2023-12-06T15:00:18.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.842+0000 7efca3855700 1 --2- 172.21.15.152:0/1690032725 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7efc8806ae40 0x7efc8806d2f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:18.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.842+0000 7efca3855700 1 --2- 172.21.15.152:0/1690032725 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc9c0fd730 0x7efc9c10d530 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:18.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.842+0000 7efca3855700 1 --2- 172.21.15.152:0/1690032725 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efc9c100050 0x7efc9c10da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:18.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.842+0000 7efca3855700 1 -- 172.21.15.152:0/1690032725 >> 172.21.15.152:0/1690032725 conn(0x7efc9c0f7190 msgr2=0x7efc9c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:00:18.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.842+0000 7efca3855700 1 -- 172.21.15.152:0/1690032725 shutdown_connections 2023-12-06T15:00:18.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.842+0000 7efca3855700 1 -- 172.21.15.152:0/1690032725 wait complete. 2023-12-06T15:00:18.845 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 15 2023-12-06T15:00:18.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:18 smithi152 ceph-mon[111954]: from='client.14668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:00:18.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:18 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/1605883931' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:00:18.947 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.944+0000 7f6af3627700 1 -- 172.21.15.152:0/2179989908 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6aec0fcd00 msgr2=0x7f6aec0fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:18.947 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.944+0000 7f6af3627700 1 --2- 172.21.15.152:0/2179989908 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6aec0fcd00 0x7f6aec0fd150 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6adc004940 tx=0x7f6adc009e30 comp rx=0 tx=0).stop 2023-12-06T15:00:18.947 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.944+0000 7f6af3627700 1 -- 172.21.15.152:0/2179989908 shutdown_connections 2023-12-06T15:00:18.947 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.944+0000 7f6af3627700 1 --2- 172.21.15.152:0/2179989908 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6aec0fcd00 0x7f6aec0fd150 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:18.947 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.944+0000 7f6af3627700 1 --2- 172.21.15.152:0/2179989908 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6aec0fbaf0 0x7f6aec0fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:18.947 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.944+0000 7f6af3627700 1 -- 172.21.15.152:0/2179989908 >> 172.21.15.152:0/2179989908 conn(0x7f6aec0f7190 msgr2=0x7f6aec0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:00:18.947 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.945+0000 7f6af3627700 1 -- 172.21.15.152:0/2179989908 shutdown_connections 2023-12-06T15:00:18.947 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.945+0000 7f6af3627700 1 -- 172.21.15.152:0/2179989908 wait complete. 2023-12-06T15:00:18.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.945+0000 7f6af3627700 1 Processor -- start 2023-12-06T15:00:18.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.945+0000 7f6af3627700 1 -- start start 2023-12-06T15:00:18.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.945+0000 7f6af3627700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6aec0fbaf0 0x7f6aec10d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:18.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.945+0000 7f6af3627700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6aec0fcd00 0x7f6aec10dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:18.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.945+0000 7f6af3627700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec10e0b0 con 0x7f6aec0fcd00 2023-12-06T15:00:18.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.945+0000 7f6af3627700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec10e950 con 0x7f6aec0fbaf0 2023-12-06T15:00:18.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.945+0000 7f6af0bc2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6aec0fcd00 0x7f6aec10dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:18.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.945+0000 7f6af0bc2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6aec0fcd00 0x7f6aec10dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60722/0 (socket says 172.21.15.152:60722) 2023-12-06T15:00:18.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.945+0000 7f6af0bc2700 1 -- 172.21.15.152:0/1035475844 learned_addr learned my addr 172.21.15.152:0/1035475844 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:00:18.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.945+0000 7f6af13c3700 1 --2- 172.21.15.152:0/1035475844 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6aec0fbaf0 0x7f6aec10d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:18.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.946+0000 7f6af0bc2700 1 -- 172.21.15.152:0/1035475844 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6aec0fbaf0 msgr2=0x7f6aec10d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:18.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.946+0000 7f6af0bc2700 1 --2- 172.21.15.152:0/1035475844 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6aec0fbaf0 0x7f6aec10d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:18.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.946+0000 7f6af0bc2700 1 -- 172.21.15.152:0/1035475844 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6adc005040 con 0x7f6aec0fcd00 2023-12-06T15:00:18.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.946+0000 7f6af0bc2700 1 --2- 172.21.15.152:0/1035475844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6aec0fcd00 0x7f6aec10dab0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6adc009360 tx=0x7f6adc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:00:18.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.946+0000 7f6ae1ffb700 1 -- 172.21.15.152:0/1035475844 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6adc00e040 con 0x7f6aec0fcd00 2023-12-06T15:00:18.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.946+0000 7f6af3627700 1 -- 172.21.15.152:0/1035475844 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aec10ebd0 con 0x7f6aec0fcd00 2023-12-06T15:00:18.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.946+0000 7f6ae1ffb700 1 -- 172.21.15.152:0/1035475844 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6adc00bc50 con 0x7f6aec0fcd00 2023-12-06T15:00:18.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.946+0000 7f6ae1ffb700 1 -- 172.21.15.152:0/1035475844 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6adc01c3f0 con 0x7f6aec0fcd00 2023-12-06T15:00:18.950 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.946+0000 7f6af3627700 1 -- 172.21.15.152:0/1035475844 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aec10f110 con 0x7f6aec0fcd00 2023-12-06T15:00:18.950 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.947+0000 7f6af3627700 1 -- 172.21.15.152:0/1035475844 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aec04bb80 con 0x7f6aec0fcd00 2023-12-06T15:00:18.950 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.948+0000 7f6ae1ffb700 1 -- 172.21.15.152:0/1035475844 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f6adc013420 con 0x7f6aec0fcd00 2023-12-06T15:00:18.950 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.948+0000 7f6ae1ffb700 1 --2- 172.21.15.152:0/1035475844 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f6ad806ae40 0x7f6ad806d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:18.950 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.948+0000 7f6ae1ffb700 1 -- 172.21.15.152:0/1035475844 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f6adc08ab60 con 0x7f6aec0fcd00 2023-12-06T15:00:18.950 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.948+0000 7f6af13c3700 1 --2- 172.21.15.152:0/1035475844 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f6ad806ae40 0x7f6ad806d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:18.950 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.949+0000 7f6af13c3700 1 --2- 172.21.15.152:0/1035475844 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f6ad806ae40 0x7f6ad806d2f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6aec0fcb60 tx=0x7f6ae800b040 comp rx=0 tx=0).ready entity=mgr.14612 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:00:18.954 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:18.953+0000 7f6ae1ffb700 1 -- 172.21.15.152:0/1035475844 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f6adc0588e0 con 0x7f6aec0fcd00 2023-12-06T15:00:19.057 INFO:tasks.workunit.client.1.smithi190.stdout:9/85: sync 2023-12-06T15:00:19.057 INFO:tasks.workunit.client.1.smithi190.stdout:0/42: sync 2023-12-06T15:00:19.057 INFO:tasks.workunit.client.1.smithi190.stdout:6/66: sync 2023-12-06T15:00:19.057 INFO:tasks.workunit.client.1.smithi190.stdout:4/55: sync 2023-12-06T15:00:19.057 INFO:tasks.workunit.client.1.smithi190.stdout:0/43: dread - d0/f9 zero size 2023-12-06T15:00:19.057 INFO:tasks.workunit.client.1.smithi190.stdout:0/44: chown d0/d4 3 1 2023-12-06T15:00:19.057 INFO:tasks.workunit.client.1.smithi190.stdout:6/67: fsync d4/fe 0 2023-12-06T15:00:19.057 INFO:tasks.workunit.client.1.smithi190.stdout:0/45: rename d0 to d0/da/db 22 2023-12-06T15:00:19.057 INFO:tasks.workunit.client.1.smithi190.stdout:0/46: truncate d0/f9 177741 0 2023-12-06T15:00:19.057 INFO:tasks.workunit.client.1.smithi190.stdout:7/78: sync 2023-12-06T15:00:19.058 INFO:tasks.workunit.client.1.smithi190.stdout:2/118: sync 2023-12-06T15:00:19.058 INFO:tasks.workunit.client.1.smithi190.stdout:0/47: readlink d0/l6 0 2023-12-06T15:00:19.058 INFO:tasks.workunit.client.1.smithi190.stdout:7/79: readlink d0/df/d10/d15/l16 0 2023-12-06T15:00:19.058 INFO:tasks.workunit.client.1.smithi190.stdout:6/68: write d4/fc [367012,69513] 0 2023-12-06T15:00:19.058 INFO:tasks.workunit.client.1.smithi190.stdout:6/69: write d4/ff [766162,59499] 0 2023-12-06T15:00:19.058 INFO:tasks.workunit.client.1.smithi190.stdout:6/70: fdatasync d4/fe 0 2023-12-06T15:00:19.058 INFO:tasks.workunit.client.1.smithi190.stdout:3/117: sync 2023-12-06T15:00:19.058 INFO:tasks.workunit.client.1.smithi190.stdout:8/48: sync 2023-12-06T15:00:19.058 INFO:tasks.workunit.client.1.smithi190.stdout:5/65: sync 2023-12-06T15:00:19.058 INFO:tasks.workunit.client.1.smithi190.stdout:1/235: sync 2023-12-06T15:00:19.059 INFO:tasks.workunit.client.1.smithi190.stdout:4/56: chown d3/fd 5926 1 2023-12-06T15:00:19.059 INFO:tasks.workunit.client.1.smithi190.stdout:0/48: rmdir d0 39 2023-12-06T15:00:19.060 INFO:tasks.workunit.client.1.smithi190.stdout:7/80: dread d0/d5/f8 [0,4194304] 0 2023-12-06T15:00:19.064 INFO:tasks.workunit.client.1.smithi190.stdout:2/119: rename d10/d11/f1a to d10/d26/f27 0 2023-12-06T15:00:19.064 INFO:tasks.workunit.client.1.smithi190.stdout:8/49: symlink d1/lf 0 2023-12-06T15:00:19.065 INFO:tasks.workunit.client.1.smithi190.stdout:6/71: truncate d4/f9 3891958 0 2023-12-06T15:00:19.065 INFO:tasks.workunit.client.1.smithi190.stdout:1/236: creat d6/dc/f46 x:0 0 0 2023-12-06T15:00:19.065 INFO:tasks.workunit.client.1.smithi190.stdout:8/50: write d1/f7 [5937037,49741] 0 2023-12-06T15:00:19.066 INFO:tasks.workunit.client.1.smithi190.stdout:4/57: unlink d3/f4 0 2023-12-06T15:00:19.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:18 smithi190 ceph-mon[121340]: from='client.14668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:00:19.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:18 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/1605883931' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:00:19.073 INFO:tasks.workunit.client.1.smithi190.stdout:0/49: symlink d0/da/lc 0 2023-12-06T15:00:19.073 INFO:tasks.workunit.client.1.smithi190.stdout:7/81: mkdir d0/d5/da/d13/d17 0 2023-12-06T15:00:19.073 INFO:tasks.workunit.client.1.smithi190.stdout:7/82: readlink d0/df/d10/d15/l16 0 2023-12-06T15:00:19.073 INFO:tasks.workunit.client.1.smithi190.stdout:7/83: chown d0/c1 1175 1 2023-12-06T15:00:19.073 INFO:tasks.workunit.client.1.smithi190.stdout:3/118: rename d4/d15/d19/f1a to d4/d1b/d25/f27 0 2023-12-06T15:00:19.074 INFO:tasks.workunit.client.1.smithi190.stdout:7/84: write d0/f6 [981672,1085] 0 2023-12-06T15:00:19.074 INFO:tasks.workunit.client.1.smithi190.stdout:2/120: creat d10/d11/f28 x:0 0 0 2023-12-06T15:00:19.075 INFO:tasks.workunit.client.1.smithi190.stdout:2/121: chown c9 26 1 2023-12-06T15:00:19.075 INFO:tasks.workunit.client.1.smithi190.stdout:7/85: fdatasync d0/d5/f9 0 2023-12-06T15:00:19.075 INFO:tasks.workunit.client.1.smithi190.stdout:1/237: unlink d6/dc/d3b/f40 0 2023-12-06T15:00:19.075 INFO:tasks.workunit.client.1.smithi190.stdout:1/238: readlink d6/l27 0 2023-12-06T15:00:19.075 INFO:tasks.workunit.client.1.smithi190.stdout:1/239: chown d6/dc/f1b 79 1 2023-12-06T15:00:19.075 INFO:tasks.workunit.client.1.smithi190.stdout:1/240: write d6/dc/d29/f2d [1006166,75358] 0 2023-12-06T15:00:19.076 INFO:tasks.workunit.client.1.smithi190.stdout:8/51: mkdir d1/d10 0 2023-12-06T15:00:19.076 INFO:tasks.workunit.client.1.smithi190.stdout:8/52: chown d1/d10 307 1 2023-12-06T15:00:19.077 INFO:tasks.workunit.client.1.smithi190.stdout:4/58: mkdir d3/d10/d15 0 2023-12-06T15:00:19.081 INFO:tasks.workunit.client.1.smithi190.stdout:1/241: dread d6/dc/d29/d38/d39/f3e [0,4194304] 0 2023-12-06T15:00:19.082 INFO:tasks.workunit.client.1.smithi190.stdout:7/86: symlink d0/df/d10/l18 0 2023-12-06T15:00:19.083 INFO:tasks.workunit.client.1.smithi190.stdout:2/122: creat d10/d26/f29 x:0 0 0 2023-12-06T15:00:19.086 INFO:tasks.workunit.client.1.smithi190.stdout:1/242: creat d6/dc/d29/f47 x:0 0 0 2023-12-06T15:00:19.086 INFO:tasks.workunit.client.1.smithi190.stdout:4/59: creat d3/d10/d15/f16 x:0 0 0 2023-12-06T15:00:19.086 INFO:tasks.workunit.client.1.smithi190.stdout:4/60: creat d3/d10/d15/f17 x:0 0 0 2023-12-06T15:00:19.088 INFO:tasks.workunit.client.1.smithi190.stdout:4/61: creat d3/d13/f18 x:0 0 0 2023-12-06T15:00:19.090 INFO:tasks.workunit.client.1.smithi190.stdout:4/62: mkdir d3/d13/d19 0 2023-12-06T15:00:19.090 INFO:tasks.workunit.client.1.smithi190.stdout:4/63: truncate d3/d10/d15/f17 872561 0 2023-12-06T15:00:19.090 INFO:tasks.workunit.client.1.smithi190.stdout:4/64: write d3/d10/d15/f17 [1584353,97346] 0 2023-12-06T15:00:19.091 INFO:tasks.workunit.client.1.smithi190.stdout:4/65: creat d3/d10/d15/f1a x:0 0 0 2023-12-06T15:00:19.097 INFO:tasks.workunit.client.1.smithi190.stdout:6/72: dwrite d4/fd [0,4194304] 0 2023-12-06T15:00:19.101 INFO:tasks.workunit.client.1.smithi190.stdout:3/119: dread d4/fe [0,4194304] 0 2023-12-06T15:00:19.101 INFO:tasks.workunit.client.1.smithi190.stdout:4/66: write d3/fb [2511451,114113] 0 2023-12-06T15:00:19.105 INFO:tasks.workunit.client.1.smithi190.stdout:3/120: unlink d4/f24 0 2023-12-06T15:00:19.105 INFO:tasks.workunit.client.1.smithi190.stdout:9/86: dwrite f3 [0,4194304] 0 2023-12-06T15:00:19.105 INFO:tasks.workunit.client.1.smithi190.stdout:4/67: symlink d3/d10/d15/l1b 0 2023-12-06T15:00:19.109 INFO:tasks.workunit.client.1.smithi190.stdout:3/121: mknod d4/d1b/c28 0 2023-12-06T15:00:19.109 INFO:tasks.workunit.client.1.smithi190.stdout:5/66: dwrite d0/f3 [0,4194304] 0 2023-12-06T15:00:19.109 INFO:tasks.workunit.client.1.smithi190.stdout:3/122: chown d4/lb 6 1 2023-12-06T15:00:19.109 INFO:tasks.workunit.client.1.smithi190.stdout:5/67: write d0/fb [4257451,33189] 0 2023-12-06T15:00:19.109 INFO:tasks.workunit.client.1.smithi190.stdout:6/73: dread d4/f9 [0,4194304] 0 2023-12-06T15:00:19.115 INFO:tasks.workunit.client.1.smithi190.stdout:5/68: rmdir d0 39 2023-12-06T15:00:19.117 INFO:tasks.workunit.client.1.smithi190.stdout:5/69: mkdir d0/d12 0 2023-12-06T15:00:19.117 INFO:tasks.workunit.client.1.smithi190.stdout:5/70: chown d0/f6 7198 1 2023-12-06T15:00:19.121 INFO:tasks.workunit.client.1.smithi190.stdout:6/74: write d4/fd [3647416,61572] 0 2023-12-06T15:00:19.122 INFO:tasks.workunit.client.1.smithi190.stdout:0/50: dwrite d0/f9 [0,4194304] 0 2023-12-06T15:00:19.124 INFO:tasks.workunit.client.1.smithi190.stdout:6/75: mkdir d4/d10 0 2023-12-06T15:00:19.124 INFO:tasks.workunit.client.1.smithi190.stdout:1/243: write d6/dc/f15 [126001,89200] 0 2023-12-06T15:00:19.124 INFO:tasks.workunit.client.1.smithi190.stdout:1/244: chown d6/dc/f9 250083872 1 2023-12-06T15:00:19.126 INFO:tasks.workunit.client.1.smithi190.stdout:0/51: write d0/f9 [3370335,80606] 0 2023-12-06T15:00:19.126 INFO:tasks.workunit.client.1.smithi190.stdout:0/52: chown d0/d4/l7 12038014 1 2023-12-06T15:00:19.127 INFO:tasks.workunit.client.1.smithi190.stdout:8/53: dwrite d1/fe [0,4194304] 0 2023-12-06T15:00:19.127 INFO:tasks.workunit.client.1.smithi190.stdout:1/245: symlink d6/dc/d29/l48 0 2023-12-06T15:00:19.128 INFO:tasks.workunit.client.1.smithi190.stdout:1/246: chown d6/l2c 7443553 1 2023-12-06T15:00:19.128 INFO:tasks.workunit.client.1.smithi190.stdout:2/123: dwrite f5 [0,4194304] 0 2023-12-06T15:00:19.128 INFO:tasks.workunit.client.1.smithi190.stdout:7/87: dwrite d0/d5/f9 [0,4194304] 0 2023-12-06T15:00:19.128 INFO:tasks.workunit.client.1.smithi190.stdout:7/88: fdatasync d0/d5/f9 0 2023-12-06T15:00:19.128 INFO:tasks.workunit.client.1.smithi190.stdout:7/89: stat d0/d5/da 0 2023-12-06T15:00:19.128 INFO:tasks.workunit.client.1.smithi190.stdout:7/90: readlink d0/d5/l7 0 2023-12-06T15:00:19.128 INFO:tasks.workunit.client.1.smithi190.stdout:0/53: link d0/da/lc d0/d4/ld 0 2023-12-06T15:00:19.131 INFO:tasks.workunit.client.1.smithi190.stdout:1/247: mkdir d6/d49 0 2023-12-06T15:00:19.131 INFO:tasks.workunit.client.1.smithi190.stdout:1/248: readlink d6/lb 0 2023-12-06T15:00:19.132 INFO:tasks.workunit.client.1.smithi190.stdout:2/124: creat d10/d11/f2a x:0 0 0 2023-12-06T15:00:19.132 INFO:tasks.workunit.client.1.smithi190.stdout:8/54: dread d1/f4 [0,4194304] 0 2023-12-06T15:00:19.133 INFO:tasks.workunit.client.1.smithi190.stdout:7/91: mknod d0/c19 0 2023-12-06T15:00:19.134 INFO:tasks.workunit.client.1.smithi190.stdout:0/54: creat d0/d4/fe x:0 0 0 2023-12-06T15:00:19.139 INFO:tasks.workunit.client.1.smithi190.stdout:8/55: mknod d1/c11 0 2023-12-06T15:00:19.139 INFO:tasks.workunit.client.1.smithi190.stdout:0/55: creat d0/da/ff x:0 0 0 2023-12-06T15:00:19.140 INFO:tasks.workunit.client.1.smithi190.stdout:0/56: dread - d0/d4/fe zero size 2023-12-06T15:00:19.141 INFO:tasks.workunit.client.1.smithi190.stdout:8/56: dread d1/fd [0,4194304] 0 2023-12-06T15:00:19.143 INFO:tasks.workunit.client.1.smithi190.stdout:2/125: dread f3 [0,4194304] 0 2023-12-06T15:00:19.145 INFO:tasks.workunit.client.1.smithi190.stdout:8/57: mkdir d1/d10/d12 0 2023-12-06T15:00:19.145 INFO:tasks.workunit.client.1.smithi190.stdout:8/58: write d1/f4 [1355657,128193] 0 2023-12-06T15:00:19.146 INFO:tasks.workunit.client.1.smithi190.stdout:2/126: creat d10/d11/f2b x:0 0 0 2023-12-06T15:00:19.147 INFO:tasks.workunit.client.1.smithi190.stdout:8/59: symlink d1/l13 0 2023-12-06T15:00:19.149 INFO:tasks.workunit.client.1.smithi190.stdout:8/60: mkdir d1/d10/d12/d14 0 2023-12-06T15:00:19.149 INFO:tasks.workunit.client.1.smithi190.stdout:8/61: chown d1/c11 1 1 2023-12-06T15:00:19.150 INFO:tasks.workunit.client.1.smithi190.stdout:8/62: symlink d1/l15 0 2023-12-06T15:00:19.152 INFO:tasks.workunit.client.1.smithi190.stdout:8/63: rmdir d1/d10/d12/d14 0 2023-12-06T15:00:19.158 INFO:tasks.workunit.client.1.smithi190.stdout:9/87: dwrite d4/f13 [0,4194304] 0 2023-12-06T15:00:19.160 INFO:tasks.workunit.client.1.smithi190.stdout:9/88: creat d4/f22 x:0 0 0 2023-12-06T15:00:19.160 INFO:tasks.workunit.client.1.smithi190.stdout:9/89: truncate d4/ff 30252 0 2023-12-06T15:00:19.160 INFO:tasks.workunit.client.1.smithi190.stdout:4/68: dwrite d3/f12 [0,4194304] 0 2023-12-06T15:00:19.161 INFO:tasks.workunit.client.1.smithi190.stdout:5/71: dwrite d0/f7 [0,4194304] 0 2023-12-06T15:00:19.164 INFO:tasks.workunit.client.1.smithi190.stdout:4/69: creat d3/d13/d19/f1c x:0 0 0 2023-12-06T15:00:19.164 INFO:tasks.workunit.client.1.smithi190.stdout:4/70: chown d3/d10 18 1 2023-12-06T15:00:19.165 INFO:tasks.workunit.client.1.smithi190.stdout:4/71: read d3/ff [3405988,118802] 0 2023-12-06T15:00:19.168 INFO:tasks.workunit.client.1.smithi190.stdout:7/92: dwrite d0/d5/f8 [0,4194304] 0 2023-12-06T15:00:19.168 INFO:tasks.workunit.client.1.smithi190.stdout:7/93: rename d0/df to d0/df/d10/d15/d1a 22 2023-12-06T15:00:19.168 INFO:tasks.workunit.client.1.smithi190.stdout:5/72: write d0/f3 [4058431,89681] 0 2023-12-06T15:00:19.168 INFO:tasks.workunit.client.1.smithi190.stdout:4/72: mkdir d3/d10/d1d 0 2023-12-06T15:00:19.171 INFO:tasks.workunit.client.1.smithi190.stdout:2/127: dwrite d10/d11/f25 [0,4194304] 0 2023-12-06T15:00:19.171 INFO:tasks.workunit.client.1.smithi190.stdout:1/249: dwrite d6/dc/d29/d34/f41 [0,4194304] 0 2023-12-06T15:00:19.171 INFO:tasks.workunit.client.1.smithi190.stdout:2/128: dread - d10/f14 zero size 2023-12-06T15:00:19.171 INFO:tasks.workunit.client.1.smithi190.stdout:2/129: write d10/d26/f27 [346004,91135] 0 2023-12-06T15:00:19.171 INFO:tasks.workunit.client.1.smithi190.stdout:1/250: write d6/f25 [5239142,115208] 0 2023-12-06T15:00:19.171 INFO:tasks.workunit.client.1.smithi190.stdout:2/130: fdatasync d10/d11/f16 0 2023-12-06T15:00:19.171 INFO:tasks.workunit.client.1.smithi190.stdout:1/251: stat d6/dc/d3b 0 2023-12-06T15:00:19.171 INFO:tasks.workunit.client.1.smithi190.stdout:2/131: write d10/d11/f24 [883427,108303] 0 2023-12-06T15:00:19.172 INFO:tasks.workunit.client.1.smithi190.stdout:2/132: stat cd 0 2023-12-06T15:00:19.172 INFO:tasks.workunit.client.1.smithi190.stdout:3/123: dwrite d4/d1b/f21 [0,4194304] 0 2023-12-06T15:00:19.174 INFO:tasks.workunit.client.1.smithi190.stdout:5/73: rename d0/f3 to d0/d12/f13 0 2023-12-06T15:00:19.174 INFO:tasks.workunit.client.1.smithi190.stdout:5/74: chown d0/f6 306 1 2023-12-06T15:00:19.177 INFO:tasks.workunit.client.1.smithi190.stdout:4/73: creat d3/d10/f1e x:0 0 0 2023-12-06T15:00:19.178 INFO:tasks.workunit.client.1.smithi190.stdout:1/252: write d6/f25 [1333182,90826] 0 2023-12-06T15:00:19.187 INFO:tasks.workunit.client.1.smithi190.stdout:3/124: symlink d4/d1b/d25/l29 0 2023-12-06T15:00:19.189 INFO:tasks.workunit.client.1.smithi190.stdout:6/76: dwrite d4/fc [0,4194304] 0 2023-12-06T15:00:19.189 INFO:tasks.workunit.client.1.smithi190.stdout:0/57: rmdir d0/da 39 2023-12-06T15:00:19.190 INFO:tasks.workunit.client.1.smithi190.stdout:9/90: dwrite d4/fa [0,4194304] 0 2023-12-06T15:00:19.190 INFO:tasks.workunit.client.1.smithi190.stdout:7/94: dwrite d0/d5/f8 [0,4194304] 0 2023-12-06T15:00:19.195 INFO:tasks.workunit.client.1.smithi190.stdout:5/75: creat d0/d12/f14 x:0 0 0 2023-12-06T15:00:19.196 INFO:tasks.workunit.client.1.smithi190.stdout:4/74: link d3/d10/d15/l1b d3/d10/d1d/l1f 0 2023-12-06T15:00:19.200 INFO:tasks.workunit.client.1.smithi190.stdout:1/253: getdents d6/dc 0 2023-12-06T15:00:19.200 INFO:tasks.workunit.client.1.smithi190.stdout:1/254: fdatasync d6/f13 0 2023-12-06T15:00:19.201 INFO:tasks.workunit.client.1.smithi190.stdout:1/255: write d6/dc/d29/d34/f41 [2674871,95818] 0 2023-12-06T15:00:19.201 INFO:tasks.workunit.client.1.smithi190.stdout:1/256: stat d6/dc/f2e 0 2023-12-06T15:00:19.201 INFO:tasks.workunit.client.1.smithi190.stdout:1/257: chown d6/c1a 382300 1 2023-12-06T15:00:19.201 INFO:tasks.workunit.client.1.smithi190.stdout:1/258: fdatasync d6/dc/d29/d38/d39/f3e 0 2023-12-06T15:00:19.203 INFO:tasks.workunit.client.1.smithi190.stdout:3/125: rename d4/lb to d4/d1b/l2a 0 2023-12-06T15:00:19.204 INFO:tasks.workunit.client.1.smithi190.stdout:3/126: chown d4/d1b/d25 509 1 2023-12-06T15:00:19.204 INFO:tasks.workunit.client.1.smithi190.stdout:3/127: chown d4/d1b/d25/l29 6 1 2023-12-06T15:00:19.206 INFO:tasks.workunit.client.1.smithi190.stdout:6/77: rename d4/l8 to d4/l11 0 2023-12-06T15:00:19.206 INFO:tasks.workunit.client.1.smithi190.stdout:6/78: chown d4/fd 44622486 1 2023-12-06T15:00:19.207 INFO:tasks.workunit.client.1.smithi190.stdout:0/58: mknod d0/d4/c10 0 2023-12-06T15:00:19.207 INFO:tasks.workunit.client.1.smithi190.stdout:0/59: fdatasync d0/f9 0 2023-12-06T15:00:19.213 INFO:tasks.workunit.client.1.smithi190.stdout:9/91: getdents d4 0 2023-12-06T15:00:19.214 INFO:tasks.workunit.client.1.smithi190.stdout:9/92: dread d4/f1d [0,4194304] 0 2023-12-06T15:00:19.214 INFO:tasks.workunit.client.1.smithi190.stdout:9/93: write f3 [5207651,69265] 0 2023-12-06T15:00:19.218 INFO:tasks.workunit.client.1.smithi190.stdout:5/76: creat d0/d12/f15 x:0 0 0 2023-12-06T15:00:19.221 INFO:tasks.workunit.client.1.smithi190.stdout:1/259: symlink d6/dc/d29/d38/d43/l4a 0 2023-12-06T15:00:19.221 INFO:tasks.workunit.client.1.smithi190.stdout:1/260: readlink d6/dc/d29/d34/l36 0 2023-12-06T15:00:19.221 INFO:tasks.workunit.client.1.smithi190.stdout:7/95: dread d0/f3 [0,4194304] 0 2023-12-06T15:00:19.223 INFO:tasks.workunit.client.1.smithi190.stdout:4/75: creat d3/d10/d15/f20 x:0 0 0 2023-12-06T15:00:19.223 INFO:tasks.workunit.client.1.smithi190.stdout:3/128: link d4/d1b/d25/l29 d4/l2b 0 2023-12-06T15:00:19.223 INFO:tasks.workunit.client.1.smithi190.stdout:3/129: chown d4/ff 0 1 2023-12-06T15:00:19.224 INFO:tasks.workunit.client.1.smithi190.stdout:3/130: write d4/f5 [2046404,71301] 0 2023-12-06T15:00:19.224 INFO:tasks.workunit.client.1.smithi190.stdout:3/131: write d4/d1b/d25/f27 [54042,113014] 0 2023-12-06T15:00:19.226 INFO:tasks.workunit.client.1.smithi190.stdout:6/79: rmdir d4/d10 0 2023-12-06T15:00:19.226 INFO:tasks.workunit.client.1.smithi190.stdout:6/80: fdatasync d4/fd 0 2023-12-06T15:00:19.226 INFO:tasks.workunit.client.1.smithi190.stdout:6/81: chown d4/fc 10 1 2023-12-06T15:00:19.227 INFO:tasks.workunit.client.1.smithi190.stdout:0/60: creat d0/f11 x:0 0 0 2023-12-06T15:00:19.227 INFO:tasks.workunit.client.1.smithi190.stdout:0/61: chown d0 15 1 2023-12-06T15:00:19.233 INFO:tasks.workunit.client.1.smithi190.stdout:1/261: creat d6/dc/d29/d38/d43/f4b x:0 0 0 2023-12-06T15:00:19.233 INFO:tasks.workunit.client.1.smithi190.stdout:7/96: rmdir d0/d5 39 2023-12-06T15:00:19.235 INFO:tasks.workunit.client.1.smithi190.stdout:3/132: rename d4/d15/d19/l1f to d4/d1b/d25/l2c 0 2023-12-06T15:00:19.235 INFO:tasks.workunit.client.1.smithi190.stdout:3/133: chown d4/d1b 0 1 2023-12-06T15:00:19.236 INFO:tasks.workunit.client.1.smithi190.stdout:7/97: mkdir d0/d5/d1b 0 2023-12-06T15:00:19.236 INFO:tasks.workunit.client.1.smithi190.stdout:7/98: read - d0/d5/da/fb zero size 2023-12-06T15:00:19.237 INFO:tasks.workunit.client.1.smithi190.stdout:7/99: chown d0/d5/f8 197 1 2023-12-06T15:00:19.237 INFO:tasks.workunit.client.1.smithi190.stdout:7/100: truncate d0/d5/da/fb 732197 0 2023-12-06T15:00:19.237 INFO:tasks.workunit.client.1.smithi190.stdout:7/101: fdatasync d0/f3 0 2023-12-06T15:00:19.237 INFO:tasks.workunit.client.1.smithi190.stdout:7/102: readlink d0/d5/l7 0 2023-12-06T15:00:19.237 INFO:tasks.workunit.client.1.smithi190.stdout:7/103: write d0/d5/da/fb [1571390,75639] 0 2023-12-06T15:00:19.237 INFO:tasks.workunit.client.1.smithi190.stdout:7/104: dread - d0/fc zero size 2023-12-06T15:00:19.238 INFO:tasks.workunit.client.1.smithi190.stdout:7/105: write d0/d5/da/fb [139268,83209] 0 2023-12-06T15:00:19.238 INFO:tasks.workunit.client.1.smithi190.stdout:7/106: readlink d0/d5/l12 0 2023-12-06T15:00:19.238 INFO:tasks.workunit.client.1.smithi190.stdout:9/94: dwrite d4/f1d [0,4194304] 0 2023-12-06T15:00:19.239 INFO:tasks.workunit.client.1.smithi190.stdout:5/77: dwrite d0/fb [4194304,4194304] 0 2023-12-06T15:00:19.243 INFO:tasks.workunit.client.1.smithi190.stdout:6/82: truncate d4/fc 3244141 0 2023-12-06T15:00:19.305 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-12-06T15:00:19.305 INFO:teuthology.orchestra.run.smithi152.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e331a81036b9c4be9167bdaf54e458c7294ca3446212b9c6126786d23318b1cf", 2023-12-06T15:00:19.305 INFO:teuthology.orchestra.run.smithi152.stdout: "in_progress": true, 2023-12-06T15:00:19.305 INFO:teuthology.orchestra.run.smithi152.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-06T15:00:19.305 INFO:teuthology.orchestra.run.smithi152.stdout: "services_complete": [], 2023-12-06T15:00:19.305 INFO:teuthology.orchestra.run.smithi152.stdout: "progress": "1/21 daemons upgraded", 2023-12-06T15:00:19.305 INFO:teuthology.orchestra.run.smithi152.stdout: "message": "", 2023-12-06T15:00:19.305 INFO:teuthology.orchestra.run.smithi152.stdout: "is_paused": false 2023-12-06T15:00:19.305 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-12-06T15:00:19.306 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.252+0000 7f6af3627700 1 -- 172.21.15.152:0/1035475844 --> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6aec10f560 con 0x7f6ad806ae40 2023-12-06T15:00:19.306 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.255+0000 7f6ae1ffb700 1 -- 172.21.15.152:0/1035475844 <== mgr.14612 v2:172.21.15.190:6828/3047155534 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f6aec10f560 con 0x7f6ad806ae40 2023-12-06T15:00:19.306 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.256+0000 7f6af3627700 1 -- 172.21.15.152:0/1035475844 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f6ad806ae40 msgr2=0x7f6ad806d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:19.306 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.256+0000 7f6af3627700 1 --2- 172.21.15.152:0/1035475844 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f6ad806ae40 0x7f6ad806d2f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6aec0fcb60 tx=0x7f6ae800b040 comp rx=0 tx=0).stop 2023-12-06T15:00:19.306 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.256+0000 7f6af3627700 1 -- 172.21.15.152:0/1035475844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6aec0fcd00 msgr2=0x7f6aec10dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:19.306 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.256+0000 7f6af3627700 1 --2- 172.21.15.152:0/1035475844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6aec0fcd00 0x7f6aec10dab0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6adc009360 tx=0x7f6adc009e30 comp rx=0 tx=0).stop 2023-12-06T15:00:19.306 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.256+0000 7f6af3627700 1 -- 172.21.15.152:0/1035475844 shutdown_connections 2023-12-06T15:00:19.306 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.256+0000 7f6af3627700 1 --2- 172.21.15.152:0/1035475844 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f6ad806ae40 0x7f6ad806d2f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:19.306 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.256+0000 7f6af3627700 1 --2- 172.21.15.152:0/1035475844 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6aec0fbaf0 0x7f6aec10d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:19.306 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.256+0000 7f6af3627700 1 --2- 172.21.15.152:0/1035475844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6aec0fcd00 0x7f6aec10dab0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:19.306 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.256+0000 7f6af3627700 1 -- 172.21.15.152:0/1035475844 >> 172.21.15.152:0/1035475844 conn(0x7f6aec0f7190 msgr2=0x7f6aec065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:00:19.306 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.256+0000 7f6af3627700 1 -- 172.21.15.152:0/1035475844 shutdown_connections 2023-12-06T15:00:19.307 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.256+0000 7f6af3627700 1 -- 172.21.15.152:0/1035475844 wait complete. 2023-12-06T15:00:19.315 INFO:tasks.workunit.client.1.smithi190.stdout:5/78: creat d0/d12/f16 x:0 0 0 2023-12-06T15:00:19.316 INFO:tasks.workunit.client.1.smithi190.stdout:6/83: mkdir d4/d12 0 2023-12-06T15:00:19.316 INFO:tasks.workunit.client.1.smithi190.stdout:6/84: read d4/f9 [2622752,77720] 0 2023-12-06T15:00:19.319 INFO:tasks.workunit.client.1.smithi190.stdout:5/79: link d0/fb d0/df/f17 0 2023-12-06T15:00:19.341 INFO:tasks.workunit.client.1.smithi190.stdout:4/76: dwrite d3/d10/d15/f16 [0,4194304] 0 2023-12-06T15:00:19.341 INFO:tasks.workunit.client.1.smithi190.stdout:1/262: dwrite d6/dc/f15 [0,4194304] 0 2023-12-06T15:00:19.341 INFO:tasks.workunit.client.1.smithi190.stdout:0/62: dwrite d0/da/ff [0,4194304] 0 2023-12-06T15:00:19.341 INFO:tasks.workunit.client.1.smithi190.stdout:1/263: write d6/dc/d29/d38/d39/f3f [320290,65320] 0 2023-12-06T15:00:19.342 INFO:tasks.workunit.client.1.smithi190.stdout:3/134: dwrite d4/ff [0,4194304] 0 2023-12-06T15:00:19.342 INFO:tasks.workunit.client.1.smithi190.stdout:9/95: dwrite d4/ff [0,4194304] 0 2023-12-06T15:00:19.342 INFO:tasks.workunit.client.1.smithi190.stdout:4/77: write d3/d10/d15/f17 [614216,116659] 0 2023-12-06T15:00:19.354 INFO:tasks.workunit.client.1.smithi190.stdout:0/63: creat d0/d4/f12 x:0 0 0 2023-12-06T15:00:19.357 INFO:tasks.workunit.client.1.smithi190.stdout:1/264: mknod d6/dc/d29/d34/c4c 0 2023-12-06T15:00:19.361 INFO:tasks.workunit.client.1.smithi190.stdout:3/135: mknod d4/d1b/d25/c2d 0 2023-12-06T15:00:19.366 INFO:tasks.workunit.client.1.smithi190.stdout:3/136: dread d4/f14 [0,4194304] 0 2023-12-06T15:00:19.366 INFO:tasks.workunit.client.1.smithi190.stdout:3/137: fsync d4/d1b/f22 0 2023-12-06T15:00:19.370 INFO:tasks.workunit.client.1.smithi190.stdout:3/138: rename d4/d1b/d25/l29 to d4/l2e 0 2023-12-06T15:00:19.370 INFO:tasks.workunit.client.1.smithi190.stdout:3/139: write d4/d1b/d25/f27 [756891,87440] 0 2023-12-06T15:00:19.372 INFO:tasks.workunit.client.1.smithi190.stdout:4/78: dwrite d3/d13/d19/f1c [0,4194304] 0 2023-12-06T15:00:19.373 INFO:tasks.workunit.client.1.smithi190.stdout:3/140: unlink d4/l12 0 2023-12-06T15:00:19.383 INFO:tasks.workunit.client.1.smithi190.stdout:6/85: dread d4/fc [0,4194304] 0 2023-12-06T15:00:19.383 INFO:tasks.workunit.client.1.smithi190.stdout:6/86: write d4/fd [4369536,105741] 0 2023-12-06T15:00:19.384 INFO:tasks.workunit.client.1.smithi190.stdout:1/265: dwrite d6/dc/f15 [0,4194304] 0 2023-12-06T15:00:19.384 INFO:tasks.workunit.client.1.smithi190.stdout:0/64: dwrite d0/da/ff [0,4194304] 0 2023-12-06T15:00:19.384 INFO:tasks.workunit.client.1.smithi190.stdout:9/96: dwrite d4/f6 [0,4194304] 0 2023-12-06T15:00:19.384 INFO:tasks.workunit.client.1.smithi190.stdout:9/97: chown d4/l1b 42561731 1 2023-12-06T15:00:19.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.384+0000 7f483a840700 1 -- 172.21.15.152:0/1541441646 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48340fbaf0 msgr2=0x7f48340fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:19.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.384+0000 7f483a840700 1 --2- 172.21.15.152:0/1541441646 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48340fbaf0 0x7f48340fbf00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4824004940 tx=0x7f4824009e30 comp rx=0 tx=0).stop 2023-12-06T15:00:19.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.384+0000 7f483a840700 1 -- 172.21.15.152:0/1541441646 shutdown_connections 2023-12-06T15:00:19.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.384+0000 7f483a840700 1 --2- 172.21.15.152:0/1541441646 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48340fcd00 0x7f48340fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:19.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.384+0000 7f483a840700 1 --2- 172.21.15.152:0/1541441646 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48340fbaf0 0x7f48340fbf00 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:19.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.384+0000 7f483a840700 1 -- 172.21.15.152:0/1541441646 >> 172.21.15.152:0/1541441646 conn(0x7f48340f7190 msgr2=0x7f48340f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:00:19.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.384+0000 7f483a840700 1 -- 172.21.15.152:0/1541441646 shutdown_connections 2023-12-06T15:00:19.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.384+0000 7f483a840700 1 -- 172.21.15.152:0/1541441646 wait complete. 2023-12-06T15:00:19.387 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.384+0000 7f483a840700 1 Processor -- start 2023-12-06T15:00:19.387 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.385+0000 7f483a840700 1 -- start start 2023-12-06T15:00:19.387 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.385+0000 7f483a840700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48340fbaf0 0x7f4834112610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:19.387 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.385+0000 7f483a840700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48340fcd00 0x7f4834114b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:19.387 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.385+0000 7f483a840700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4834066000 con 0x7f48340fbaf0 2023-12-06T15:00:19.387 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.385+0000 7f483a840700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4834066140 con 0x7f48340fcd00 2023-12-06T15:00:19.387 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.385+0000 7f4833fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48340fbaf0 0x7f4834112610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:19.387 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.385+0000 7f4833fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48340fbaf0 0x7f4834112610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46714/0 (socket says 172.21.15.152:46714) 2023-12-06T15:00:19.387 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.385+0000 7f4833fff700 1 -- 172.21.15.152:0/2227027350 learned_addr learned my addr 172.21.15.152:0/2227027350 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:00:19.388 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.385+0000 7f48337fe700 1 --2- 172.21.15.152:0/2227027350 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48340fcd00 0x7f4834114b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:19.388 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.385+0000 7f4833fff700 1 -- 172.21.15.152:0/2227027350 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48340fcd00 msgr2=0x7f4834114b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:19.388 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.385+0000 7f4833fff700 1 --2- 172.21.15.152:0/2227027350 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48340fcd00 0x7f4834114b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:19.388 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.385+0000 7f4833fff700 1 -- 172.21.15.152:0/2227027350 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4824005040 con 0x7f48340fbaf0 2023-12-06T15:00:19.388 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.385+0000 7f4833fff700 1 --2- 172.21.15.152:0/2227027350 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48340fbaf0 0x7f4834112610 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4824000c00 tx=0x7f4824009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:00:19.388 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.386+0000 7f4830ff9700 1 -- 172.21.15.152:0/2227027350 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4824021070 con 0x7f48340fbaf0 2023-12-06T15:00:19.388 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.386+0000 7f483a840700 1 -- 172.21.15.152:0/2227027350 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48341150a0 con 0x7f48340fbaf0 2023-12-06T15:00:19.388 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.386+0000 7f4830ff9700 1 -- 172.21.15.152:0/2227027350 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f482401c400 con 0x7f48340fbaf0 2023-12-06T15:00:19.388 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.386+0000 7f4830ff9700 1 -- 172.21.15.152:0/2227027350 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f482400e070 con 0x7f48340fbaf0 2023-12-06T15:00:19.388 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.386+0000 7f483a840700 1 -- 172.21.15.152:0/2227027350 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4834115440 con 0x7f48340fbaf0 2023-12-06T15:00:19.389 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.387+0000 7f483a840700 1 -- 172.21.15.152:0/2227027350 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f483404bb80 con 0x7f48340fbaf0 2023-12-06T15:00:19.389 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.387+0000 7f4830ff9700 1 -- 172.21.15.152:0/2227027350 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f482401ca00 con 0x7f48340fbaf0 2023-12-06T15:00:19.389 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.387+0000 7f4830ff9700 1 --2- 172.21.15.152:0/2227027350 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f481c06ae40 0x7f481c06d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:19.389 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.387+0000 7f4830ff9700 1 -- 172.21.15.152:0/2227027350 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f482408a9a0 con 0x7f48340fbaf0 2023-12-06T15:00:19.389 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.388+0000 7f48337fe700 1 --2- 172.21.15.152:0/2227027350 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f481c06ae40 0x7f481c06d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:19.389 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.388+0000 7f48337fe700 1 --2- 172.21.15.152:0/2227027350 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f481c06ae40 0x7f481c06d2f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4828009b80 tx=0x7f482800b040 comp rx=0 tx=0).ready entity=mgr.14612 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:00:19.393 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.392+0000 7f4830ff9700 1 -- 172.21.15.152:0/2227027350 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f4824054d10 con 0x7f48340fbaf0 2023-12-06T15:00:19.409 INFO:tasks.workunit.client.1.smithi190.stdout:3/141: symlink d4/d1b/d25/l2f 0 2023-12-06T15:00:19.410 INFO:tasks.workunit.client.1.smithi190.stdout:4/79: rename d3/d10/d15/f1a to d3/f21 0 2023-12-06T15:00:19.411 INFO:tasks.workunit.client.1.smithi190.stdout:6/87: creat d4/f13 x:0 0 0 2023-12-06T15:00:19.413 INFO:tasks.workunit.client.1.smithi190.stdout:1/266: mkdir d6/dc/d3b/d4d 0 2023-12-06T15:00:19.413 INFO:tasks.workunit.client.1.smithi190.stdout:1/267: chown d6/f12 17127 1 2023-12-06T15:00:19.413 INFO:tasks.workunit.client.1.smithi190.stdout:1/268: chown d6/dc/d3b/d4d 122087811 1 2023-12-06T15:00:19.413 INFO:tasks.workunit.client.1.smithi190.stdout:1/269: read d6/dc/f1b [1911411,96381] 0 2023-12-06T15:00:19.414 INFO:tasks.workunit.client.1.smithi190.stdout:9/98: rename d4/f1d to d4/f23 0 2023-12-06T15:00:19.415 INFO:tasks.workunit.client.1.smithi190.stdout:3/142: truncate d4/d15/d19/d1c/f1e 486138 0 2023-12-06T15:00:19.417 INFO:tasks.workunit.client.1.smithi190.stdout:3/143: dread d4/d15/d19/f20 [0,4194304] 0 2023-12-06T15:00:19.417 INFO:tasks.workunit.client.1.smithi190.stdout:3/144: fdatasync d4/f5 0 2023-12-06T15:00:19.417 INFO:tasks.workunit.client.1.smithi190.stdout:0/65: rename d0/d4/ld to d0/da/l13 0 2023-12-06T15:00:19.418 INFO:tasks.workunit.client.1.smithi190.stdout:4/80: creat d3/d13/f22 x:0 0 0 2023-12-06T15:00:19.419 INFO:tasks.workunit.client.1.smithi190.stdout:6/88: creat d4/f14 x:0 0 0 2023-12-06T15:00:19.419 INFO:tasks.workunit.client.1.smithi190.stdout:6/89: fdatasync d4/fc 0 2023-12-06T15:00:19.419 INFO:tasks.workunit.client.1.smithi190.stdout:6/90: readlink l2 0 2023-12-06T15:00:19.420 INFO:tasks.workunit.client.1.smithi190.stdout:1/270: creat d6/dc/d29/d34/f4e x:0 0 0 2023-12-06T15:00:19.420 INFO:tasks.workunit.client.1.smithi190.stdout:1/271: fdatasync d6/f12 0 2023-12-06T15:00:19.420 INFO:tasks.workunit.client.1.smithi190.stdout:1/272: fsync d6/f21 0 2023-12-06T15:00:19.421 INFO:tasks.workunit.client.1.smithi190.stdout:1/273: dread d6/dc/ff [4194304,4194304] 0 2023-12-06T15:00:19.421 INFO:tasks.workunit.client.1.smithi190.stdout:1/274: truncate d6/dc/f2e 1374534 0 2023-12-06T15:00:19.421 INFO:tasks.workunit.client.1.smithi190.stdout:9/99: rename d4/f15 to d4/f24 0 2023-12-06T15:00:19.421 INFO:tasks.workunit.client.1.smithi190.stdout:9/100: truncate d4/f1f 125560 0 2023-12-06T15:00:19.422 INFO:tasks.workunit.client.1.smithi190.stdout:9/101: truncate d4/f23 4768382 0 2023-12-06T15:00:19.422 INFO:tasks.workunit.client.1.smithi190.stdout:9/102: write d4/f13 [2426313,2338] 0 2023-12-06T15:00:19.423 INFO:tasks.workunit.client.1.smithi190.stdout:0/66: symlink d0/da/l14 0 2023-12-06T15:00:19.423 INFO:tasks.workunit.client.1.smithi190.stdout:0/67: stat d0/da/l14 0 2023-12-06T15:00:19.423 INFO:tasks.workunit.client.1.smithi190.stdout:0/68: chown d0/c5 182 1 2023-12-06T15:00:19.423 INFO:tasks.workunit.client.1.smithi190.stdout:9/103: write d4/f14 [197180,72347] 0 2023-12-06T15:00:19.423 INFO:tasks.workunit.client.1.smithi190.stdout:9/104: readlink d4/l19 0 2023-12-06T15:00:19.424 INFO:tasks.workunit.client.1.smithi190.stdout:1/275: rmdir d6/dc/d29/d38 39 2023-12-06T15:00:19.424 INFO:tasks.workunit.client.1.smithi190.stdout:1/276: readlink d6/l27 0 2023-12-06T15:00:19.426 INFO:tasks.workunit.client.1.smithi190.stdout:0/69: rmdir d0/da 39 2023-12-06T15:00:19.427 INFO:tasks.workunit.client.1.smithi190.stdout:0/70: write d0/d4/f12 [755682,50557] 0 2023-12-06T15:00:19.427 INFO:tasks.workunit.client.1.smithi190.stdout:0/71: truncate d0/d4/fe 974798 0 2023-12-06T15:00:19.428 INFO:tasks.workunit.client.1.smithi190.stdout:9/105: truncate d4/fa 1660375 0 2023-12-06T15:00:19.432 INFO:tasks.workunit.client.1.smithi190.stdout:0/72: getdents d0/d4 0 2023-12-06T15:00:19.437 INFO:tasks.workunit.client.1.smithi190.stdout:0/73: write d0/da/ff [1681784,60075] 0 2023-12-06T15:00:19.451 INFO:tasks.workunit.client.1.smithi190.stdout:9/106: dwrite d4/fe [0,4194304] 0 2023-12-06T15:00:19.451 INFO:tasks.workunit.client.1.smithi190.stdout:3/145: dwrite d4/d15/d19/d1c/f1e [0,4194304] 0 2023-12-06T15:00:19.451 INFO:tasks.workunit.client.1.smithi190.stdout:0/74: dread d0/da/ff [0,4194304] 0 2023-12-06T15:00:19.452 INFO:tasks.workunit.client.1.smithi190.stdout:3/146: dread d4/d1b/f22 [0,4194304] 0 2023-12-06T15:00:19.453 INFO:tasks.workunit.client.1.smithi190.stdout:9/107: dread d4/fc [0,4194304] 0 2023-12-06T15:00:19.454 INFO:tasks.workunit.client.1.smithi190.stdout:3/147: write d4/d15/f23 [343245,80871] 0 2023-12-06T15:00:19.454 INFO:tasks.workunit.client.1.smithi190.stdout:9/108: write d4/fe [262749,102545] 0 2023-12-06T15:00:19.455 INFO:tasks.workunit.client.1.smithi190.stdout:3/148: mknod d4/d15/c30 0 2023-12-06T15:00:19.457 INFO:tasks.workunit.client.1.smithi190.stdout:3/149: mknod d4/d1b/c31 0 2023-12-06T15:00:19.458 INFO:tasks.workunit.client.1.smithi190.stdout:3/150: chown d4/d15 23401389 1 2023-12-06T15:00:19.461 INFO:tasks.workunit.client.1.smithi190.stdout:3/151: getdents d4/d1b/d25 0 2023-12-06T15:00:19.461 INFO:tasks.workunit.client.1.smithi190.stdout:3/152: chown d4/d1b/l2a 15270 1 2023-12-06T15:00:19.463 INFO:tasks.workunit.client.1.smithi190.stdout:3/153: rename d4/d1b/l2a to d4/d15/d19/d1c/l32 0 2023-12-06T15:00:19.465 INFO:tasks.workunit.client.1.smithi190.stdout:3/154: mkdir d4/d15/d33 0 2023-12-06T15:00:19.466 INFO:tasks.workunit.client.1.smithi190.stdout:3/155: creat d4/d1b/f34 x:0 0 0 2023-12-06T15:00:19.467 INFO:tasks.workunit.client.1.smithi190.stdout:3/156: symlink d4/d15/d33/l35 0 2023-12-06T15:00:19.467 INFO:tasks.workunit.client.1.smithi190.stdout:3/157: truncate d4/d1b/f34 655560 0 2023-12-06T15:00:19.469 INFO:tasks.workunit.client.1.smithi190.stdout:3/158: rename d4/d1b/d25 to d4/d15/d33/d36 0 2023-12-06T15:00:19.474 INFO:tasks.workunit.client.1.smithi190.stdout:9/109: dwrite d4/f14 [0,4194304] 0 2023-12-06T15:00:19.477 INFO:tasks.workunit.client.1.smithi190.stdout:0/75: dwrite d0/f11 [0,4194304] 0 2023-12-06T15:00:19.477 INFO:tasks.workunit.client.1.smithi190.stdout:0/76: stat d0/d4/l7 0 2023-12-06T15:00:19.477 INFO:tasks.workunit.client.1.smithi190.stdout:9/110: unlink d4/f23 0 2023-12-06T15:00:19.477 INFO:tasks.workunit.client.1.smithi190.stdout:0/77: dread d0/d4/fe [0,4194304] 0 2023-12-06T15:00:19.479 INFO:tasks.workunit.client.1.smithi190.stdout:9/111: creat d4/f25 x:0 0 0 2023-12-06T15:00:19.481 INFO:tasks.workunit.client.1.smithi190.stdout:0/78: symlink d0/da/l15 0 2023-12-06T15:00:19.481 INFO:tasks.workunit.client.1.smithi190.stdout:0/79: readlink d0/l1 0 2023-12-06T15:00:19.482 INFO:tasks.workunit.client.1.smithi190.stdout:3/159: dread d4/d15/d19/d1c/f1e [0,4194304] 0 2023-12-06T15:00:19.482 INFO:tasks.workunit.client.1.smithi190.stdout:3/160: chown d4/d1b/f22 0 1 2023-12-06T15:00:19.482 INFO:tasks.workunit.client.1.smithi190.stdout:0/80: dread d0/d4/fe [0,4194304] 0 2023-12-06T15:00:19.484 INFO:tasks.workunit.client.1.smithi190.stdout:3/161: rename d4/f13 to d4/d1b/f37 0 2023-12-06T15:00:19.484 INFO:tasks.workunit.client.1.smithi190.stdout:3/162: write d4/fe [3676074,35551] 0 2023-12-06T15:00:19.485 INFO:tasks.workunit.client.1.smithi190.stdout:3/163: read d4/fe [3694198,93793] 0 2023-12-06T15:00:19.485 INFO:tasks.workunit.client.1.smithi190.stdout:3/164: chown d4/d15/d33/d36/f27 2257 1 2023-12-06T15:00:19.487 INFO:tasks.workunit.client.1.smithi190.stdout:3/165: unlink d4/d15/d33/d36/l2f 0 2023-12-06T15:00:19.487 INFO:tasks.workunit.client.1.smithi190.stdout:3/166: chown d4/d15/d33 17745479 1 2023-12-06T15:00:19.488 INFO:tasks.workunit.client.1.smithi190.stdout:9/112: dread f1 [0,4194304] 0 2023-12-06T15:00:19.490 INFO:tasks.workunit.client.1.smithi190.stdout:3/167: creat d4/d1b/f38 x:0 0 0 2023-12-06T15:00:19.490 INFO:tasks.workunit.client.1.smithi190.stdout:3/168: stat d4/fe 0 2023-12-06T15:00:19.490 INFO:tasks.workunit.client.1.smithi190.stdout:3/169: truncate d4/d15/d33/d36/f27 1810502 0 2023-12-06T15:00:19.492 INFO:tasks.workunit.client.1.smithi190.stdout:3/170: truncate d4/d1b/f22 380 0 2023-12-06T15:00:19.492 INFO:tasks.workunit.client.1.smithi190.stdout:3/171: chown d4/d15/c26 90359914 1 2023-12-06T15:00:19.492 INFO:tasks.workunit.client.1.smithi190.stdout:3/172: fsync d4/d15/d33/d36/f27 0 2023-12-06T15:00:19.494 INFO:tasks.workunit.client.1.smithi190.stdout:3/173: dread d4/fc [0,4194304] 0 2023-12-06T15:00:19.494 INFO:tasks.workunit.client.1.smithi190.stdout:9/113: write f1 [3830511,87491] 0 2023-12-06T15:00:19.494 INFO:tasks.workunit.client.1.smithi190.stdout:9/114: chown d4/f25 3548 1 2023-12-06T15:00:19.494 INFO:tasks.workunit.client.1.smithi190.stdout:9/115: dread - d4/f25 zero size 2023-12-06T15:00:19.494 INFO:tasks.workunit.client.1.smithi190.stdout:3/174: write d4/f9 [85077,68262] 0 2023-12-06T15:00:19.495 INFO:tasks.workunit.client.1.smithi190.stdout:9/116: mkdir d4/d26 0 2023-12-06T15:00:19.495 INFO:tasks.workunit.client.1.smithi190.stdout:9/117: write d4/f11 [577218,108776] 0 2023-12-06T15:00:19.497 INFO:tasks.workunit.client.1.smithi190.stdout:3/175: rename d4/d15/d19/f20 to d4/d15/d33/f39 0 2023-12-06T15:00:19.499 INFO:tasks.workunit.client.1.smithi190.stdout:9/118: rmdir d4/d26 0 2023-12-06T15:00:19.500 INFO:tasks.workunit.client.1.smithi190.stdout:3/176: mkdir d4/d15/d19/d3a 0 2023-12-06T15:00:19.501 INFO:tasks.workunit.client.1.smithi190.stdout:9/119: mkdir d4/d27 0 2023-12-06T15:00:19.501 INFO:tasks.workunit.client.1.smithi190.stdout:9/120: dread d4/f1f [0,4194304] 0 2023-12-06T15:00:19.504 INFO:tasks.workunit.client.1.smithi190.stdout:3/177: write d4/d1b/f21 [2882921,28219] 0 2023-12-06T15:00:19.504 INFO:tasks.workunit.client.1.smithi190.stdout:0/81: dwrite d0/d4/f12 [0,4194304] 0 2023-12-06T15:00:19.505 INFO:tasks.workunit.client.1.smithi190.stdout:9/121: mkdir d4/d28 0 2023-12-06T15:00:19.507 INFO:tasks.workunit.client.1.smithi190.stdout:9/122: write d4/fe [2597392,97347] 0 2023-12-06T15:00:19.507 INFO:tasks.workunit.client.1.smithi190.stdout:9/123: dread d4/f17 [0,4194304] 0 2023-12-06T15:00:19.508 INFO:tasks.workunit.client.1.smithi190.stdout:3/178: unlink d4/d15/d19/d1c/f1e 0 2023-12-06T15:00:19.511 INFO:tasks.workunit.client.1.smithi190.stdout:9/124: mknod d4/c29 0 2023-12-06T15:00:19.513 INFO:tasks.workunit.client.1.smithi190.stdout:9/125: mknod d4/d28/c2a 0 2023-12-06T15:00:19.522 INFO:tasks.workunit.client.1.smithi190.stdout:3/179: truncate d4/d1b/f21 2385543 0 2023-12-06T15:00:19.522 INFO:tasks.workunit.client.1.smithi190.stdout:3/180: getdents d4/d15/d19/d3a 0 2023-12-06T15:00:19.523 INFO:tasks.workunit.client.1.smithi190.stdout:3/181: dread d4/f14 [0,4194304] 0 2023-12-06T15:00:19.525 INFO:tasks.workunit.client.1.smithi190.stdout:3/182: mkdir d4/d15/d19/d3a/d3b 0 2023-12-06T15:00:19.526 INFO:tasks.workunit.client.1.smithi190.stdout:3/183: creat d4/d15/d33/d36/f3c x:0 0 0 2023-12-06T15:00:19.526 INFO:tasks.workunit.client.1.smithi190.stdout:3/184: write d4/f9 [1494802,76620] 0 2023-12-06T15:00:19.526 INFO:tasks.workunit.client.1.smithi190.stdout:3/185: mkdir d4/d15/d19/d1c/d3d 0 2023-12-06T15:00:19.528 INFO:tasks.workunit.client.1.smithi190.stdout:3/186: rename d4/d15/c30 to d4/d15/d33/c3e 0 2023-12-06T15:00:19.528 INFO:tasks.workunit.client.1.smithi190.stdout:3/187: creat d4/d15/d19/f3f x:0 0 0 2023-12-06T15:00:19.530 INFO:tasks.workunit.client.1.smithi190.stdout:3/188: link d4/f9 d4/d15/d19/d1c/d3d/f40 0 2023-12-06T15:00:19.530 INFO:tasks.workunit.client.1.smithi190.stdout:0/82: dwrite d0/f11 [0,4194304] 0 2023-12-06T15:00:19.530 INFO:tasks.workunit.client.1.smithi190.stdout:0/83: fdatasync d0/d4/fe 0 2023-12-06T15:00:19.530 INFO:tasks.workunit.client.1.smithi190.stdout:0/84: fdatasync d0/f9 0 2023-12-06T15:00:19.530 INFO:tasks.workunit.client.1.smithi190.stdout:9/126: dwrite d4/f21 [0,4194304] 0 2023-12-06T15:00:19.531 INFO:tasks.workunit.client.1.smithi190.stdout:9/127: truncate d4/fc 1516596 0 2023-12-06T15:00:19.531 INFO:tasks.workunit.client.1.smithi190.stdout:9/128: write d4/f13 [2172965,85262] 0 2023-12-06T15:00:19.531 INFO:tasks.workunit.client.1.smithi190.stdout:9/129: readlink d4/l1e 0 2023-12-06T15:00:19.532 INFO:tasks.workunit.client.1.smithi190.stdout:0/85: getdents d0 0 2023-12-06T15:00:19.536 INFO:tasks.workunit.client.1.smithi190.stdout:0/86: creat d0/d4/f16 x:0 0 0 2023-12-06T15:00:19.544 INFO:tasks.workunit.client.1.smithi190.stdout:9/130: dread f0 [0,4194304] 0 2023-12-06T15:00:19.556 INFO:tasks.workunit.client.1.smithi190.stdout:3/189: dwrite d4/d15/d33/d36/f3c [0,4194304] 0 2023-12-06T15:00:19.556 INFO:tasks.workunit.client.1.smithi190.stdout:9/131: dread d4/f21 [0,4194304] 0 2023-12-06T15:00:19.558 INFO:tasks.workunit.client.1.smithi190.stdout:0/87: dwrite d0/f9 [0,4194304] 0 2023-12-06T15:00:19.559 INFO:tasks.workunit.client.1.smithi190.stdout:3/190: unlink d4/fe 0 2023-12-06T15:00:19.559 INFO:tasks.workunit.client.1.smithi190.stdout:3/191: stat d4/d15/d19/d3a/d3b 0 2023-12-06T15:00:19.559 INFO:tasks.workunit.client.1.smithi190.stdout:3/192: write d4/f14 [56228,106182] 0 2023-12-06T15:00:19.560 INFO:tasks.workunit.client.1.smithi190.stdout:9/132: symlink d4/d28/l2b 0 2023-12-06T15:00:19.561 INFO:tasks.workunit.client.1.smithi190.stdout:3/193: creat d4/d15/d19/f41 x:0 0 0 2023-12-06T15:00:19.564 INFO:tasks.workunit.client.1.smithi190.stdout:3/194: creat d4/d15/d19/d1c/f42 x:0 0 0 2023-12-06T15:00:19.566 INFO:tasks.workunit.client.1.smithi190.stdout:3/195: unlink d4/d15/d33/d36/l2c 0 2023-12-06T15:00:19.568 INFO:tasks.workunit.client.1.smithi190.stdout:3/196: rename d4/d15/f23 to d4/d15/d19/d1c/d3d/f43 0 2023-12-06T15:00:19.577 INFO:tasks.workunit.client.1.smithi190.stdout:0/88: dwrite d0/d4/fe [0,4194304] 0 2023-12-06T15:00:19.580 INFO:tasks.workunit.client.1.smithi190.stdout:0/89: symlink d0/d4/l17 0 2023-12-06T15:00:19.580 INFO:tasks.workunit.client.1.smithi190.stdout:0/90: chown d0/da/lc 349198 1 2023-12-06T15:00:19.583 INFO:tasks.workunit.client.1.smithi190.stdout:0/91: write d0/d4/fe [3516484,11946] 0 2023-12-06T15:00:19.590 INFO:tasks.workunit.client.1.smithi190.stdout:9/133: dwrite d4/fe [0,4194304] 0 2023-12-06T15:00:19.591 INFO:tasks.workunit.client.1.smithi190.stdout:3/197: dwrite d4/d15/d33/f39 [0,4194304] 0 2023-12-06T15:00:19.591 INFO:tasks.workunit.client.1.smithi190.stdout:3/198: chown d4/d15/c26 172682173 1 2023-12-06T15:00:19.591 INFO:tasks.workunit.client.1.smithi190.stdout:3/199: readlink d4/l2e 0 2023-12-06T15:00:19.591 INFO:tasks.workunit.client.1.smithi190.stdout:3/200: readlink d4/l2e 0 2023-12-06T15:00:19.591 INFO:tasks.workunit.client.1.smithi190.stdout:3/201: write d4/d15/d19/d1c/d3d/f40 [2098786,100179] 0 2023-12-06T15:00:19.592 INFO:tasks.workunit.client.1.smithi190.stdout:9/134: dread d4/f24 [0,4194304] 0 2023-12-06T15:00:19.592 INFO:tasks.workunit.client.1.smithi190.stdout:0/92: getdents d0/d4 0 2023-12-06T15:00:19.594 INFO:tasks.workunit.client.1.smithi190.stdout:3/202: symlink d4/d15/d19/d1c/d3d/l44 0 2023-12-06T15:00:19.594 INFO:tasks.workunit.client.1.smithi190.stdout:3/203: dread - d4/d1b/f38 zero size 2023-12-06T15:00:19.594 INFO:tasks.workunit.client.1.smithi190.stdout:9/135: mknod d4/d28/c2c 0 2023-12-06T15:00:19.595 INFO:tasks.workunit.client.1.smithi190.stdout:0/93: rename d0/f9 to d0/f18 0 2023-12-06T15:00:19.596 INFO:tasks.workunit.client.1.smithi190.stdout:3/204: mkdir d4/d15/d33/d45 0 2023-12-06T15:00:19.596 INFO:tasks.workunit.client.1.smithi190.stdout:9/136: creat d4/f2d x:0 0 0 2023-12-06T15:00:19.598 INFO:tasks.workunit.client.1.smithi190.stdout:0/94: creat d0/f19 x:0 0 0 2023-12-06T15:00:19.598 INFO:tasks.workunit.client.1.smithi190.stdout:0/95: getdents d0/d4 0 2023-12-06T15:00:19.598 INFO:tasks.workunit.client.1.smithi190.stdout:0/96: chown d0/f19 183 1 2023-12-06T15:00:19.599 INFO:tasks.workunit.client.1.smithi190.stdout:9/137: write f0 [4237310,67060] 0 2023-12-06T15:00:19.603 INFO:tasks.workunit.client.1.smithi190.stdout:3/205: rmdir d4/d15 39 2023-12-06T15:00:19.605 INFO:tasks.workunit.client.1.smithi190.stdout:3/206: creat d4/d15/d19/d3a/f46 x:0 0 0 2023-12-06T15:00:19.605 INFO:tasks.workunit.client.1.smithi190.stdout:3/207: dread - d4/d15/d19/f3f zero size 2023-12-06T15:00:19.607 INFO:tasks.workunit.client.1.smithi190.stdout:3/208: creat d4/d15/d33/d45/f47 x:0 0 0 2023-12-06T15:00:19.608 INFO:tasks.workunit.client.1.smithi190.stdout:3/209: creat d4/d15/d19/f48 x:0 0 0 2023-12-06T15:00:19.610 INFO:tasks.workunit.client.1.smithi190.stdout:9/138: dread f0 [0,4194304] 0 2023-12-06T15:00:19.612 INFO:tasks.workunit.client.1.smithi190.stdout:9/139: creat d4/f2e x:0 0 0 2023-12-06T15:00:19.612 INFO:tasks.workunit.client.1.smithi190.stdout:9/140: fdatasync f2 0 2023-12-06T15:00:19.617 INFO:tasks.workunit.client.1.smithi190.stdout:9/141: dread d4/fa [0,4194304] 0 2023-12-06T15:00:19.618 INFO:tasks.workunit.client.1.smithi190.stdout:9/142: write f1 [1274064,33107] 0 2023-12-06T15:00:19.618 INFO:tasks.workunit.client.1.smithi190.stdout:9/143: fdatasync d4/f21 0 2023-12-06T15:00:19.621 INFO:tasks.workunit.client.1.smithi190.stdout:0/97: dwrite d0/da/ff [0,4194304] 0 2023-12-06T15:00:19.626 INFO:tasks.workunit.client.1.smithi190.stdout:9/144: dread d4/fa [0,4194304] 0 2023-12-06T15:00:19.627 INFO:tasks.workunit.client.1.smithi190.stdout:9/145: mkdir d4/d27/d2f 0 2023-12-06T15:00:19.628 INFO:tasks.workunit.client.1.smithi190.stdout:9/146: write d4/f21 [248862,97106] 0 2023-12-06T15:00:19.630 INFO:tasks.workunit.client.1.smithi190.stdout:9/147: creat d4/d28/f30 x:0 0 0 2023-12-06T15:00:19.630 INFO:tasks.workunit.client.1.smithi190.stdout:0/98: dread d0/d4/fe [0,4194304] 0 2023-12-06T15:00:19.637 INFO:tasks.workunit.client.1.smithi190.stdout:9/148: rename d4/d28 to d4/d27/d2f/d31 0 2023-12-06T15:00:19.639 INFO:tasks.workunit.client.1.smithi190.stdout:9/149: symlink d4/d27/d2f/l32 0 2023-12-06T15:00:19.639 INFO:tasks.workunit.client.1.smithi190.stdout:0/99: dread d0/f11 [0,4194304] 0 2023-12-06T15:00:19.641 INFO:tasks.workunit.client.1.smithi190.stdout:0/100: mkdir d0/da/d1a 0 2023-12-06T15:00:19.641 INFO:tasks.workunit.client.1.smithi190.stdout:0/101: fdatasync d0/f11 0 2023-12-06T15:00:19.641 INFO:tasks.workunit.client.1.smithi190.stdout:0/102: write d0/f19 [971263,46453] 0 2023-12-06T15:00:19.643 INFO:tasks.workunit.client.1.smithi190.stdout:0/103: unlink d0/d4/f12 0 2023-12-06T15:00:19.672 INFO:tasks.workunit.client.1.smithi190.stdout:9/150: dwrite d4/f21 [0,4194304] 0 2023-12-06T15:00:19.672 INFO:tasks.workunit.client.1.smithi190.stdout:0/104: dwrite d0/da/ff [0,4194304] 0 2023-12-06T15:00:19.673 INFO:tasks.workunit.client.1.smithi190.stdout:0/105: fdatasync d0/f18 0 2023-12-06T15:00:19.675 INFO:tasks.workunit.client.1.smithi190.stdout:0/106: link d0/c5 d0/c1b 0 2023-12-06T15:00:19.675 INFO:tasks.workunit.client.1.smithi190.stdout:0/107: stat d0/d4/l7 0 2023-12-06T15:00:19.698 INFO:tasks.workunit.client.1.smithi190.stdout:8/64: sync 2023-12-06T15:00:19.698 INFO:tasks.workunit.client.1.smithi190.stdout:7/107: sync 2023-12-06T15:00:19.699 INFO:tasks.workunit.client.1.smithi190.stdout:2/133: sync 2023-12-06T15:00:19.699 INFO:tasks.workunit.client.1.smithi190.stdout:5/80: sync 2023-12-06T15:00:19.699 INFO:tasks.workunit.client.1.smithi190.stdout:5/81: write d0/d12/f16 [563079,94400] 0 2023-12-06T15:00:19.700 INFO:tasks.workunit.client.1.smithi190.stdout:2/134: rename c6 to d10/c2c 0 2023-12-06T15:00:19.701 INFO:tasks.workunit.client.1.smithi190.stdout:2/135: truncate d10/d11/f15 967343 0 2023-12-06T15:00:19.701 INFO:tasks.workunit.client.1.smithi190.stdout:2/136: write d10/d11/f2a [415843,110719] 0 2023-12-06T15:00:19.701 INFO:tasks.workunit.client.1.smithi190.stdout:2/137: dread - d10/d26/f29 zero size 2023-12-06T15:00:19.703 INFO:tasks.workunit.client.1.smithi190.stdout:7/108: rename d0/d5/da/d13 to d0/d5/d1b/d1c 0 2023-12-06T15:00:19.706 INFO:tasks.workunit.client.1.smithi190.stdout:7/109: rename d0/d5/l7 to d0/df/d10/l1d 0 2023-12-06T15:00:19.715 INFO:tasks.workunit.client.1.smithi190.stdout:5/82: dread d0/d12/f16 [0,4194304] 0 2023-12-06T15:00:19.718 INFO:tasks.workunit.client.1.smithi190.stdout:5/83: link d0/d12/f14 d0/f18 0 2023-12-06T15:00:19.719 INFO:tasks.workunit.client.1.smithi190.stdout:5/84: truncate d0/fb 6499642 0 2023-12-06T15:00:19.719 INFO:tasks.workunit.client.1.smithi190.stdout:5/85: dread - d0/f18 zero size 2023-12-06T15:00:19.720 INFO:tasks.workunit.client.1.smithi190.stdout:2/138: fsync d10/d11/f2a 0 2023-12-06T15:00:19.720 INFO:tasks.workunit.client.1.smithi190.stdout:2/139: fdatasync d10/d11/f24 0 2023-12-06T15:00:19.722 INFO:tasks.workunit.client.1.smithi190.stdout:2/140: creat d10/f2d x:0 0 0 2023-12-06T15:00:19.723 INFO:tasks.workunit.client.1.smithi190.stdout:8/65: dwrite d1/fb [0,4194304] 0 2023-12-06T15:00:19.723 INFO:tasks.workunit.client.1.smithi190.stdout:7/110: dwrite d0/f3 [0,4194304] 0 2023-12-06T15:00:19.723 INFO:tasks.workunit.client.1.smithi190.stdout:7/111: chown d0/c1 576 1 2023-12-06T15:00:19.729 INFO:tasks.workunit.client.1.smithi190.stdout:2/141: symlink d10/d26/l2e 0 2023-12-06T15:00:19.730 INFO:tasks.workunit.client.1.smithi190.stdout:7/112: link d0/d5/da/fb d0/df/d10/f1e 0 2023-12-06T15:00:19.731 INFO:tasks.workunit.client.1.smithi190.stdout:7/113: fsync d0/d5/f9 0 2023-12-06T15:00:19.733 INFO:tasks.workunit.client.1.smithi190.stdout:7/114: dread d0/df/d10/f1e [0,4194304] 0 2023-12-06T15:00:19.736 INFO:tasks.workunit.client.1.smithi190.stdout:7/115: unlink d0/df/d10/l18 0 2023-12-06T15:00:19.738 INFO:tasks.workunit.client.1.smithi190.stdout:7/116: mkdir d0/df/d1f 0 2023-12-06T15:00:19.740 INFO:tasks.workunit.client.1.smithi190.stdout:7/117: symlink d0/df/d10/l20 0 2023-12-06T15:00:19.740 INFO:tasks.workunit.client.1.smithi190.stdout:7/118: read - d0/fc zero size 2023-12-06T15:00:19.740 INFO:tasks.workunit.client.1.smithi190.stdout:7/119: write d0/fc [997523,120587] 0 2023-12-06T15:00:19.740 INFO:tasks.workunit.client.1.smithi190.stdout:7/120: truncate d0/df/d10/f1e 1674664 0 2023-12-06T15:00:19.742 INFO:tasks.workunit.client.1.smithi190.stdout:8/66: dwrite d1/f4 [0,4194304] 0 2023-12-06T15:00:19.742 INFO:tasks.workunit.client.1.smithi190.stdout:8/67: chown d1/fb 1632 1 2023-12-06T15:00:19.742 INFO:tasks.workunit.client.1.smithi190.stdout:2/142: dread d10/d26/f27 [0,4194304] 0 2023-12-06T15:00:19.744 INFO:tasks.workunit.client.1.smithi190.stdout:2/143: dread d10/d11/f15 [0,4194304] 0 2023-12-06T15:00:19.746 INFO:tasks.workunit.client.1.smithi190.stdout:8/68: creat d1/f16 x:0 0 0 2023-12-06T15:00:19.746 INFO:tasks.workunit.client.1.smithi190.stdout:8/69: stat d1/d10 0 2023-12-06T15:00:19.746 INFO:tasks.workunit.client.1.smithi190.stdout:5/86: write d0/df/f17 [2254425,59927] 0 2023-12-06T15:00:19.749 INFO:tasks.workunit.client.1.smithi190.stdout:2/144: rmdir d10 39 2023-12-06T15:00:19.751 INFO:tasks.workunit.client.1.smithi190.stdout:8/70: symlink d1/d10/l17 0 2023-12-06T15:00:19.754 INFO:tasks.workunit.client.1.smithi190.stdout:5/87: mknod d0/df/c19 0 2023-12-06T15:00:19.758 INFO:tasks.workunit.client.1.smithi190.stdout:2/145: rename d10/f12 to d10/d26/f2f 0 2023-12-06T15:00:19.761 INFO:tasks.workunit.client.1.smithi190.stdout:2/146: dread f3 [0,4194304] 0 2023-12-06T15:00:19.761 INFO:tasks.workunit.client.1.smithi190.stdout:2/147: fsync d10/d11/f24 0 2023-12-06T15:00:19.763 INFO:tasks.workunit.client.1.smithi190.stdout:2/148: mknod d10/c30 0 2023-12-06T15:00:19.769 INFO:tasks.workunit.client.1.smithi190.stdout:2/149: mkdir d10/d31 0 2023-12-06T15:00:19.770 INFO:tasks.workunit.client.1.smithi190.stdout:2/150: creat d10/d26/f32 x:0 0 0 2023-12-06T15:00:19.771 INFO:tasks.workunit.client.1.smithi190.stdout:2/151: rmdir d10/d11 39 2023-12-06T15:00:19.773 INFO:tasks.workunit.client.1.smithi190.stdout:2/152: creat d10/d31/f33 x:0 0 0 2023-12-06T15:00:19.773 INFO:tasks.workunit.client.1.smithi190.stdout:2/153: fsync d10/f2d 0 2023-12-06T15:00:19.775 INFO:tasks.workunit.client.1.smithi190.stdout:8/71: dwrite d1/fb [0,4194304] 0 2023-12-06T15:00:19.775 INFO:tasks.workunit.client.1.smithi190.stdout:2/154: rename d10/f14 to d10/d26/f34 0 2023-12-06T15:00:19.777 INFO:tasks.workunit.client.1.smithi190.stdout:5/88: dwrite d0/fb [4194304,4194304] 0 2023-12-06T15:00:19.779 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.778+0000 7f483a840700 1 -- 172.21.15.152:0/2227027350 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f48341157b0 con 0x7f48340fbaf0 2023-12-06T15:00:19.779 INFO:tasks.workunit.client.1.smithi190.stdout:5/89: creat d0/df/f1a x:0 0 0 2023-12-06T15:00:19.779 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.778+0000 7f4830ff9700 1 -- 172.21.15.152:0/2227027350 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f4824058330 con 0x7f48340fbaf0 2023-12-06T15:00:19.780 INFO:teuthology.orchestra.run.smithi152.stdout:HEALTH_OK 2023-12-06T15:00:19.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.781+0000 7f483a840700 1 -- 172.21.15.152:0/2227027350 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f481c06ae40 msgr2=0x7f481c06d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:19.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.781+0000 7f483a840700 1 --2- 172.21.15.152:0/2227027350 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f481c06ae40 0x7f481c06d2f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4828009b80 tx=0x7f482800b040 comp rx=0 tx=0).stop 2023-12-06T15:00:19.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.781+0000 7f483a840700 1 -- 172.21.15.152:0/2227027350 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48340fbaf0 msgr2=0x7f4834112610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:19.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.781+0000 7f483a840700 1 --2- 172.21.15.152:0/2227027350 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48340fbaf0 0x7f4834112610 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4824000c00 tx=0x7f4824009e30 comp rx=0 tx=0).stop 2023-12-06T15:00:19.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.781+0000 7f483a840700 1 -- 172.21.15.152:0/2227027350 shutdown_connections 2023-12-06T15:00:19.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.781+0000 7f483a840700 1 --2- 172.21.15.152:0/2227027350 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f481c06ae40 0x7f481c06d2f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:19.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.781+0000 7f483a840700 1 --2- 172.21.15.152:0/2227027350 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48340fbaf0 0x7f4834112610 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:19.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.781+0000 7f483a840700 1 --2- 172.21.15.152:0/2227027350 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f48340fcd00 0x7f4834114b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:19.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.781+0000 7f483a840700 1 -- 172.21.15.152:0/2227027350 >> 172.21.15.152:0/2227027350 conn(0x7f48340f7190 msgr2=0x7f48340fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:00:19.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.781+0000 7f483a840700 1 -- 172.21.15.152:0/2227027350 shutdown_connections 2023-12-06T15:00:19.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:19.781+0000 7f483a840700 1 -- 172.21.15.152:0/2227027350 wait complete. 2023-12-06T15:00:19.788 INFO:tasks.workunit.client.1.smithi190.stdout:5/90: dread d0/f1 [0,4194304] 0 2023-12-06T15:00:19.789 INFO:tasks.workunit.client.1.smithi190.stdout:2/155: dread d10/d11/f25 [0,4194304] 0 2023-12-06T15:00:19.791 INFO:tasks.workunit.client.1.smithi190.stdout:5/91: truncate d0/f6 1640455 0 2023-12-06T15:00:19.791 INFO:tasks.workunit.client.1.smithi190.stdout:5/92: fdatasync d0/f7 0 2023-12-06T15:00:19.793 INFO:tasks.workunit.client.1.smithi190.stdout:5/93: mknod d0/df/c1b 0 2023-12-06T15:00:19.793 INFO:tasks.workunit.client.1.smithi190.stdout:5/94: fdatasync d0/d12/f15 0 2023-12-06T15:00:19.793 INFO:tasks.workunit.client.1.smithi190.stdout:8/72: dwrite d1/f7 [4194304,4194304] 0 2023-12-06T15:00:19.793 INFO:tasks.workunit.client.1.smithi190.stdout:5/95: stat d0/ca 0 2023-12-06T15:00:19.793 INFO:tasks.workunit.client.1.smithi190.stdout:5/96: dread - d0/d12/f15 zero size 2023-12-06T15:00:19.794 INFO:tasks.workunit.client.1.smithi190.stdout:8/73: creat d1/d10/d12/f18 x:0 0 0 2023-12-06T15:00:19.795 INFO:tasks.workunit.client.1.smithi190.stdout:5/97: mkdir d0/d1c 0 2023-12-06T15:00:19.795 INFO:tasks.workunit.client.1.smithi190.stdout:5/98: read - d0/df/f1a zero size 2023-12-06T15:00:19.796 INFO:tasks.workunit.client.1.smithi190.stdout:5/99: write d0/f1 [3556982,7794] 0 2023-12-06T15:00:19.796 INFO:tasks.workunit.client.1.smithi190.stdout:5/100: stat d0/fe 0 2023-12-06T15:00:19.796 INFO:tasks.workunit.client.1.smithi190.stdout:8/74: rename d1/fe to d1/f19 0 2023-12-06T15:00:19.796 INFO:tasks.workunit.client.1.smithi190.stdout:8/75: chown d1/d10 16348 1 2023-12-06T15:00:19.797 INFO:tasks.workunit.client.1.smithi190.stdout:5/101: symlink d0/d1c/l1d 0 2023-12-06T15:00:19.797 INFO:tasks.workunit.client.1.smithi190.stdout:5/102: write d0/df/f10 [259297,32500] 0 2023-12-06T15:00:19.803 INFO:tasks.workunit.client.1.smithi190.stdout:8/76: creat d1/f1a x:0 0 0 2023-12-06T15:00:19.804 INFO:tasks.workunit.client.1.smithi190.stdout:8/77: chown d1/d10/d12 9429941 1 2023-12-06T15:00:19.804 INFO:tasks.workunit.client.1.smithi190.stdout:2/156: getdents d10 0 2023-12-06T15:00:19.804 INFO:tasks.workunit.client.1.smithi190.stdout:2/157: chown f3 24147530 1 2023-12-06T15:00:19.805 INFO:tasks.workunit.client.1.smithi190.stdout:2/158: mkdir d10/d31/d35 0 2023-12-06T15:00:19.805 INFO:tasks.workunit.client.1.smithi190.stdout:2/159: mknod d10/d11/c36 0 2023-12-06T15:00:19.814 INFO:tasks.workunit.client.1.smithi190.stdout:5/103: dwrite d0/d12/f13 [0,4194304] 0 2023-12-06T15:00:19.814 INFO:tasks.workunit.client.1.smithi190.stdout:8/78: dread d1/fb [0,4194304] 0 2023-12-06T15:00:19.817 INFO:tasks.workunit.client.1.smithi190.stdout:2/160: dread d10/d11/f13 [0,4194304] 0 2023-12-06T15:00:19.820 INFO:tasks.workunit.client.1.smithi190.stdout:8/79: getdents d1/d10/d12 0 2023-12-06T15:00:19.821 INFO:tasks.workunit.client.1.smithi190.stdout:8/80: creat d1/f1b x:0 0 0 2023-12-06T15:00:19.823 INFO:tasks.workunit.client.1.smithi190.stdout:2/161: getdents d10/d11 0 2023-12-06T15:00:19.825 INFO:tasks.workunit.client.1.smithi190.stdout:2/162: mkdir d10/d31/d37 0 2023-12-06T15:00:19.826 INFO:tasks.workunit.client.1.smithi190.stdout:2/163: rename d10/d11/f28 to d10/d31/d37/f38 0 2023-12-06T15:00:19.827 INFO:tasks.workunit.client.1.smithi190.stdout:2/164: dread d10/d26/f27 [0,4194304] 0 2023-12-06T15:00:19.828 INFO:tasks.workunit.client.1.smithi190.stdout:2/165: creat d10/f39 x:0 0 0 2023-12-06T15:00:19.828 INFO:tasks.workunit.client.1.smithi190.stdout:2/166: truncate d10/d31/f33 269975 0 2023-12-06T15:00:19.831 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:19 smithi152 ceph-mon[111954]: from='client.14672 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:00:19.831 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:19 smithi152 ceph-mon[111954]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:00:19.831 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:19 smithi152 ceph-mon[111954]: pgmap v21: 65 pgs: 65 active+clean; 420 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 18 MiB/s rd, 34 MiB/s wr, 847 op/s 2023-12-06T15:00:19.831 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:19 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/1690032725' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-06T15:00:19.836 INFO:tasks.workunit.client.1.smithi190.stdout:2/167: write d10/d11/f24 [868610,120858] 0 2023-12-06T15:00:19.841 INFO:tasks.workunit.client.1.smithi190.stdout:2/168: creat d10/d26/f3a x:0 0 0 2023-12-06T15:00:19.843 INFO:tasks.workunit.client.1.smithi190.stdout:2/169: symlink d10/d26/l3b 0 2023-12-06T15:00:19.845 INFO:tasks.workunit.client.1.smithi190.stdout:2/170: creat d10/d11/f3c x:0 0 0 2023-12-06T15:00:19.846 INFO:tasks.workunit.client.1.smithi190.stdout:2/171: chown fc 326 1 2023-12-06T15:00:19.846 INFO:tasks.workunit.client.1.smithi190.stdout:2/172: creat d10/d31/d37/f3d x:0 0 0 2023-12-06T15:00:19.849 INFO:tasks.workunit.client.1.smithi190.stdout:6/91: sync 2023-12-06T15:00:19.849 INFO:tasks.workunit.client.1.smithi190.stdout:4/81: sync 2023-12-06T15:00:19.849 INFO:tasks.workunit.client.1.smithi190.stdout:1/277: sync 2023-12-06T15:00:19.849 INFO:tasks.workunit.client.1.smithi190.stdout:1/278: readlink d6/dc/l19 0 2023-12-06T15:00:19.849 INFO:tasks.workunit.client.1.smithi190.stdout:6/92: mkdir d4/d15 0 2023-12-06T15:00:19.850 INFO:tasks.workunit.client.1.smithi190.stdout:4/82: creat d3/d10/d15/f23 x:0 0 0 2023-12-06T15:00:19.850 INFO:tasks.workunit.client.1.smithi190.stdout:4/83: truncate d3/d10/d15/f20 156254 0 2023-12-06T15:00:19.851 INFO:tasks.workunit.client.1.smithi190.stdout:4/84: write d3/d10/d15/f17 [1160376,57123] 0 2023-12-06T15:00:19.851 INFO:tasks.workunit.client.1.smithi190.stdout:6/93: rename d4/l11 to d4/l16 0 2023-12-06T15:00:19.851 INFO:tasks.workunit.client.1.smithi190.stdout:4/85: read d3/d10/d15/f16 [3736222,58250] 0 2023-12-06T15:00:19.852 INFO:tasks.workunit.client.1.smithi190.stdout:6/94: write d4/fd [2879350,81133] 0 2023-12-06T15:00:19.853 INFO:tasks.workunit.client.1.smithi190.stdout:4/86: read d3/fb [3486758,128611] 0 2023-12-06T15:00:19.853 INFO:tasks.workunit.client.1.smithi190.stdout:6/95: symlink d4/d15/l17 0 2023-12-06T15:00:19.854 INFO:tasks.workunit.client.1.smithi190.stdout:6/96: write d4/fd [2505188,91154] 0 2023-12-06T15:00:19.854 INFO:tasks.workunit.client.1.smithi190.stdout:4/87: symlink d3/d13/d19/l24 0 2023-12-06T15:00:19.855 INFO:tasks.workunit.client.1.smithi190.stdout:4/88: fdatasync d3/fd 0 2023-12-06T15:00:19.855 INFO:tasks.workunit.client.1.smithi190.stdout:4/89: dread - d3/d13/f18 zero size 2023-12-06T15:00:19.855 INFO:tasks.workunit.client.1.smithi190.stdout:6/97: write d4/fe [49873,38148] 0 2023-12-06T15:00:19.857 INFO:tasks.workunit.client.1.smithi190.stdout:6/98: dread d4/ff [0,4194304] 0 2023-12-06T15:00:19.870 INFO:tasks.workunit.client.1.smithi190.stdout:4/90: dwrite d3/ff [0,4194304] 0 2023-12-06T15:00:19.871 INFO:tasks.workunit.client.1.smithi190.stdout:4/91: read d3/d13/d19/f1c [833808,33239] 0 2023-12-06T15:00:19.874 INFO:tasks.workunit.client.1.smithi190.stdout:4/92: getdents d3 0 2023-12-06T15:00:19.874 INFO:tasks.workunit.client.1.smithi190.stdout:4/93: readlink d3/l8 0 2023-12-06T15:00:19.889 INFO:tasks.workunit.client.1.smithi190.stdout:6/99: dwrite d4/fe [0,4194304] 0 2023-12-06T15:00:19.904 INFO:tasks.workunit.client.1.smithi190.stdout:4/94: dwrite d3/d10/d15/f20 [0,4194304] 0 2023-12-06T15:00:19.904 INFO:tasks.workunit.client.1.smithi190.stdout:4/95: write d3/d13/f22 [16759,54500] 0 2023-12-06T15:00:19.905 INFO:tasks.workunit.client.1.smithi190.stdout:6/100: dwrite d4/f14 [0,4194304] 0 2023-12-06T15:00:19.905 INFO:tasks.workunit.client.1.smithi190.stdout:6/101: getdents d4/d12 0 2023-12-06T15:00:19.906 INFO:tasks.workunit.client.1.smithi190.stdout:4/96: truncate d3/f12 1308016 0 2023-12-06T15:00:19.910 INFO:tasks.workunit.client.1.smithi190.stdout:6/102: creat d4/d12/f18 x:0 0 0 2023-12-06T15:00:19.915 INFO:tasks.workunit.client.1.smithi190.stdout:6/103: rmdir d4 39 2023-12-06T15:00:19.917 INFO:tasks.workunit.client.1.smithi190.stdout:6/104: unlink d4/d12/f18 0 2023-12-06T15:00:19.917 INFO:tasks.workunit.client.1.smithi190.stdout:6/105: chown d4/d12 221 1 2023-12-06T15:00:19.925 INFO:tasks.workunit.client.1.smithi190.stdout:4/97: dwrite d3/d13/f18 [0,4194304] 0 2023-12-06T15:00:19.926 INFO:tasks.workunit.client.1.smithi190.stdout:4/98: write d3/f12 [2047349,9376] 0 2023-12-06T15:00:19.929 INFO:tasks.workunit.client.1.smithi190.stdout:4/99: creat d3/d10/d1d/f25 x:0 0 0 2023-12-06T15:00:19.929 INFO:tasks.workunit.client.1.smithi190.stdout:4/100: dread - d3/fd zero size 2023-12-06T15:00:19.929 INFO:tasks.workunit.client.1.smithi190.stdout:4/101: fdatasync d3/fb 0 2023-12-06T15:00:19.929 INFO:tasks.workunit.client.1.smithi190.stdout:4/102: write d3/f14 [761238,72882] 0 2023-12-06T15:00:19.929 INFO:tasks.workunit.client.1.smithi190.stdout:4/103: chown d3/d10/d15 50 1 2023-12-06T15:00:19.929 INFO:tasks.workunit.client.1.smithi190.stdout:4/104: getdents d3/d10/d15 0 2023-12-06T15:00:19.929 INFO:tasks.workunit.client.1.smithi190.stdout:4/105: write d3/d13/f22 [367286,69072] 0 2023-12-06T15:00:19.931 INFO:tasks.workunit.client.1.smithi190.stdout:4/106: rename d3/ff to d3/f26 0 2023-12-06T15:00:19.931 INFO:tasks.workunit.client.1.smithi190.stdout:4/107: chown d3/f26 104102754 1 2023-12-06T15:00:19.935 INFO:tasks.workunit.client.1.smithi190.stdout:6/106: dwrite d4/f14 [0,4194304] 0 2023-12-06T15:00:19.935 INFO:tasks.workunit.client.1.smithi190.stdout:4/108: fsync d3/f12 0 2023-12-06T15:00:19.935 INFO:tasks.workunit.client.1.smithi190.stdout:6/107: write d4/f9 [4906249,128655] 0 2023-12-06T15:00:19.939 INFO:tasks.workunit.client.1.smithi190.stdout:4/109: unlink d3/l5 0 2023-12-06T15:00:19.939 INFO:tasks.workunit.client.1.smithi190.stdout:4/110: write d3/d10/d1d/f25 [653524,125473] 0 2023-12-06T15:00:19.939 INFO:tasks.workunit.client.1.smithi190.stdout:4/111: write d3/d10/d1d/f25 [904787,71476] 0 2023-12-06T15:00:19.940 INFO:tasks.workunit.client.1.smithi190.stdout:6/108: getdents d4 0 2023-12-06T15:00:19.945 INFO:tasks.workunit.client.1.smithi190.stdout:4/112: truncate d3/d10/d1d/f25 662616 0 2023-12-06T15:00:19.945 INFO:tasks.workunit.client.1.smithi190.stdout:4/113: chown d3/f14 0 1 2023-12-06T15:00:19.945 INFO:tasks.workunit.client.1.smithi190.stdout:4/114: readlink d3/l11 0 2023-12-06T15:00:19.947 INFO:tasks.workunit.client.1.smithi190.stdout:6/109: dread d4/fd [0,4194304] 0 2023-12-06T15:00:19.948 INFO:tasks.workunit.client.1.smithi190.stdout:6/110: mkdir d4/d15/d19 0 2023-12-06T15:00:19.948 INFO:tasks.workunit.client.1.smithi190.stdout:6/111: chown d4/l16 3201 1 2023-12-06T15:00:19.949 INFO:tasks.workunit.client.1.smithi190.stdout:6/112: rename d4/d15/d19 to d4/d12/d1a 0 2023-12-06T15:00:19.950 INFO:tasks.workunit.client.1.smithi190.stdout:6/113: link d4/l16 d4/d12/d1a/l1b 0 2023-12-06T15:00:19.950 INFO:tasks.workunit.client.1.smithi190.stdout:6/114: write d4/f13 [758455,120510] 0 2023-12-06T15:00:19.951 INFO:tasks.workunit.client.1.smithi190.stdout:6/115: chown d4/f9 156734628 1 2023-12-06T15:00:19.952 INFO:tasks.workunit.client.1.smithi190.stdout:6/116: rename d4/f13 to d4/d12/d1a/f1c 0 2023-12-06T15:00:19.953 INFO:tasks.workunit.client.1.smithi190.stdout:6/117: creat d4/d12/f1d x:0 0 0 2023-12-06T15:00:19.953 INFO:tasks.workunit.client.1.smithi190.stdout:6/118: chown d4/d12/d1a/l1b 581978 1 2023-12-06T15:00:19.953 INFO:tasks.workunit.client.1.smithi190.stdout:4/115: dread d3/d10/d1d/f25 [0,4194304] 0 2023-12-06T15:00:19.954 INFO:tasks.workunit.client.1.smithi190.stdout:6/119: mkdir d4/d12/d1a/d1e 0 2023-12-06T15:00:19.956 INFO:tasks.workunit.client.1.smithi190.stdout:4/116: unlink d3/d10/d15/f17 0 2023-12-06T15:00:19.956 INFO:tasks.workunit.client.1.smithi190.stdout:4/117: dread - d3/fa zero size 2023-12-06T15:00:19.956 INFO:tasks.workunit.client.1.smithi190.stdout:6/120: creat d4/d12/d1a/f1f x:0 0 0 2023-12-06T15:00:19.957 INFO:tasks.workunit.client.1.smithi190.stdout:4/118: mknod d3/c27 0 2023-12-06T15:00:19.984 INFO:tasks.workunit.client.1.smithi190.stdout:6/121: dwrite d4/fd [4194304,4194304] 0 2023-12-06T15:00:19.985 INFO:tasks.workunit.client.1.smithi190.stdout:4/119: dwrite d3/fb [0,4194304] 0 2023-12-06T15:00:19.985 INFO:tasks.workunit.client.1.smithi190.stdout:4/120: truncate d3/d13/f22 1404876 0 2023-12-06T15:00:19.985 INFO:tasks.workunit.client.1.smithi190.stdout:6/122: creat d4/d12/d1a/f20 x:0 0 0 2023-12-06T15:00:19.990 INFO:tasks.workunit.client.0.smithi152.stdout:7/25: sync 2023-12-06T15:00:19.990 INFO:tasks.workunit.client.0.smithi152.stdout:0/70: sync 2023-12-06T15:00:19.990 INFO:tasks.workunit.client.0.smithi152.stdout:3/15: sync 2023-12-06T15:00:19.991 INFO:tasks.workunit.client.0.smithi152.stdout:6/23: sync 2023-12-06T15:00:19.991 INFO:tasks.workunit.client.0.smithi152.stdout:7/26: fsync f4 0 2023-12-06T15:00:19.991 INFO:tasks.workunit.client.0.smithi152.stdout:7/27: dread - f3 zero size 2023-12-06T15:00:19.991 INFO:tasks.workunit.client.0.smithi152.stdout:9/84: sync 2023-12-06T15:00:19.991 INFO:tasks.workunit.client.0.smithi152.stdout:2/25: sync 2023-12-06T15:00:19.991 INFO:tasks.workunit.client.0.smithi152.stdout:4/83: sync 2023-12-06T15:00:19.991 INFO:tasks.workunit.client.0.smithi152.stdout:2/26: chown d6 28592 1 2023-12-06T15:00:19.991 INFO:tasks.workunit.client.0.smithi152.stdout:2/27: fsync f1 0 2023-12-06T15:00:19.991 INFO:tasks.workunit.client.0.smithi152.stdout:4/84: write d2/f12 [43857,88807] 0 2023-12-06T15:00:19.991 INFO:tasks.workunit.client.0.smithi152.stdout:4/85: fdatasync d2/f9 0 2023-12-06T15:00:19.991 INFO:tasks.workunit.client.0.smithi152.stdout:1/66: sync 2023-12-06T15:00:19.991 INFO:tasks.workunit.client.0.smithi152.stdout:8/4: sync 2023-12-06T15:00:19.991 INFO:tasks.workunit.client.0.smithi152.stdout:5/15: sync 2023-12-06T15:00:19.991 INFO:tasks.workunit.client.0.smithi152.stdout:5/16: write - no filename 2023-12-06T15:00:19.991 INFO:tasks.workunit.client.0.smithi152.stdout:5/17: read - no filename 2023-12-06T15:00:19.992 INFO:tasks.workunit.client.0.smithi152.stdout:5/18: fdatasync - no filename 2023-12-06T15:00:19.992 INFO:tasks.workunit.client.0.smithi152.stdout:5/19: fsync - no filename 2023-12-06T15:00:19.992 INFO:tasks.workunit.client.0.smithi152.stdout:5/20: write - no filename 2023-12-06T15:00:19.993 INFO:tasks.workunit.client.0.smithi152.stdout:2/28: dread f4 [0,4194304] 0 2023-12-06T15:00:19.993 INFO:tasks.workunit.client.0.smithi152.stdout:3/16: link f2 f3 0 2023-12-06T15:00:19.993 INFO:tasks.workunit.client.0.smithi152.stdout:9/85: write d0/dd/fe [2257552,75492] 0 2023-12-06T15:00:19.993 INFO:tasks.workunit.client.1.smithi190.stdout:6/123: unlink d4/ff 0 2023-12-06T15:00:19.994 INFO:tasks.workunit.client.0.smithi152.stdout:6/24: rename d1/f4 to d1/f8 0 2023-12-06T15:00:19.995 INFO:tasks.workunit.client.0.smithi152.stdout:7/28: rename l2 to l5 0 2023-12-06T15:00:19.995 INFO:tasks.workunit.client.1.smithi190.stdout:4/121: getdents d3 0 2023-12-06T15:00:19.995 INFO:tasks.workunit.client.1.smithi190.stdout:4/122: fsync d3/d10/f1e 0 2023-12-06T15:00:19.996 INFO:tasks.workunit.client.1.smithi190.stdout:4/123: creat d3/d10/d15/f28 x:0 0 0 2023-12-06T15:00:19.996 INFO:tasks.workunit.client.0.smithi152.stdout:4/86: rename d2/ff to d2/f1a 0 2023-12-06T15:00:19.998 INFO:tasks.workunit.client.0.smithi152.stdout:1/67: link d3/f1c d3/da/d15/f20 0 2023-12-06T15:00:19.998 INFO:tasks.workunit.client.0.smithi152.stdout:1/68: truncate d3/da/db/ff 231904 0 2023-12-06T15:00:19.999 INFO:tasks.workunit.client.0.smithi152.stdout:8/5: mkdir d0 0 2023-12-06T15:00:19.999 INFO:tasks.workunit.client.0.smithi152.stdout:8/6: dwrite - no filename 2023-12-06T15:00:19.999 INFO:tasks.workunit.client.0.smithi152.stdout:5/21: symlink l1 0 2023-12-06T15:00:20.000 INFO:tasks.workunit.client.0.smithi152.stdout:3/17: symlink l4 0 2023-12-06T15:00:20.002 INFO:tasks.workunit.client.1.smithi190.stdout:4/124: write d3/d10/d15/f20 [1061466,96648] 0 2023-12-06T15:00:20.003 INFO:tasks.workunit.client.0.smithi152.stdout:6/25: creat d1/d5/f9 x:0 0 0 2023-12-06T15:00:20.003 INFO:tasks.workunit.client.0.smithi152.stdout:7/29: symlink l6 0 2023-12-06T15:00:20.003 INFO:tasks.workunit.client.0.smithi152.stdout:7/30: chown f3 0 1 2023-12-06T15:00:20.004 INFO:tasks.workunit.client.1.smithi190.stdout:4/125: dread d3/f9 [0,4194304] 0 2023-12-06T15:00:20.004 INFO:tasks.workunit.client.1.smithi190.stdout:4/126: stat d3/f9 0 2023-12-06T15:00:20.005 INFO:tasks.workunit.client.0.smithi152.stdout:4/87: rename d2/d10/f16 to d2/f1b 0 2023-12-06T15:00:20.006 INFO:tasks.workunit.client.0.smithi152.stdout:1/69: getdents d3/da/db 0 2023-12-06T15:00:20.006 INFO:tasks.workunit.client.0.smithi152.stdout:1/70: dread - d3/f1b zero size 2023-12-06T15:00:20.006 INFO:tasks.workunit.client.1.smithi190.stdout:4/127: link d3/fd d3/d10/d15/f29 0 2023-12-06T15:00:20.007 INFO:tasks.workunit.client.0.smithi152.stdout:8/7: rmdir d0 0 2023-12-06T15:00:20.007 INFO:tasks.workunit.client.0.smithi152.stdout:8/8: rename - no filename 2023-12-06T15:00:20.008 INFO:tasks.workunit.client.0.smithi152.stdout:5/22: symlink l2 0 2023-12-06T15:00:20.008 INFO:tasks.workunit.client.0.smithi152.stdout:3/18: creat f5 x:0 0 0 2023-12-06T15:00:20.008 INFO:tasks.workunit.client.0.smithi152.stdout:5/23: chown l1 8432 1 2023-12-06T15:00:20.008 INFO:tasks.workunit.client.0.smithi152.stdout:5/24: dread - no filename 2023-12-06T15:00:20.008 INFO:tasks.workunit.client.1.smithi190.stdout:4/128: link d3/fb d3/d10/f2a 0 2023-12-06T15:00:20.009 INFO:tasks.workunit.client.1.smithi190.stdout:4/129: fdatasync d3/d10/d15/f28 0 2023-12-06T15:00:20.009 INFO:tasks.workunit.client.0.smithi152.stdout:4/88: symlink d2/l1c 0 2023-12-06T15:00:20.010 INFO:tasks.workunit.client.0.smithi152.stdout:1/71: rmdir d3 39 2023-12-06T15:00:20.010 INFO:tasks.workunit.client.1.smithi190.stdout:4/130: link d3/lc d3/d10/l2b 0 2023-12-06T15:00:20.010 INFO:tasks.workunit.client.0.smithi152.stdout:8/9: mkdir d1 0 2023-12-06T15:00:20.010 INFO:tasks.workunit.client.0.smithi152.stdout:8/10: dread - no filename 2023-12-06T15:00:20.010 INFO:tasks.workunit.client.0.smithi152.stdout:8/11: dread - no filename 2023-12-06T15:00:20.011 INFO:tasks.workunit.client.0.smithi152.stdout:3/19: truncate f3 1805052 0 2023-12-06T15:00:20.012 INFO:tasks.workunit.client.1.smithi190.stdout:4/131: symlink d3/d10/d15/l2c 0 2023-12-06T15:00:20.013 INFO:tasks.workunit.client.0.smithi152.stdout:5/25: unlink l1 0 2023-12-06T15:00:20.015 INFO:tasks.workunit.client.0.smithi152.stdout:2/29: dwrite f5 [0,4194304] 0 2023-12-06T15:00:20.015 INFO:tasks.workunit.client.1.smithi190.stdout:4/132: mknod d3/c2d 0 2023-12-06T15:00:20.017 INFO:tasks.workunit.client.1.smithi190.stdout:4/133: mknod d3/c2e 0 2023-12-06T15:00:20.018 INFO:tasks.workunit.client.1.smithi190.stdout:4/134: chown d3/d10/f1e 342 1 2023-12-06T15:00:20.018 INFO:tasks.workunit.client.0.smithi152.stdout:8/12: creat d1/f2 x:0 0 0 2023-12-06T15:00:20.018 INFO:tasks.workunit.client.0.smithi152.stdout:8/13: truncate d1/f2 38748 0 2023-12-06T15:00:20.019 INFO:tasks.workunit.client.0.smithi152.stdout:8/14: write d1/f2 [356207,90254] 0 2023-12-06T15:00:20.022 INFO:tasks.workunit.client.0.smithi152.stdout:3/20: creat f6 x:0 0 0 2023-12-06T15:00:20.023 INFO:tasks.workunit.client.1.smithi190.stdout:3/210: sync 2023-12-06T15:00:20.023 INFO:tasks.workunit.client.1.smithi190.stdout:9/151: sync 2023-12-06T15:00:20.024 INFO:tasks.workunit.client.1.smithi190.stdout:3/211: symlink d4/d15/l49 0 2023-12-06T15:00:20.025 INFO:tasks.workunit.client.1.smithi190.stdout:3/212: fdatasync d4/d15/d19/f48 0 2023-12-06T15:00:20.025 INFO:tasks.workunit.client.0.smithi152.stdout:6/26: dread d1/f2 [0,4194304] 0 2023-12-06T15:00:20.025 INFO:tasks.workunit.client.0.smithi152.stdout:6/27: fdatasync d1/d5/f9 0 2023-12-06T15:00:20.026 INFO:tasks.workunit.client.0.smithi152.stdout:5/26: rename l2 to l3 0 2023-12-06T15:00:20.026 INFO:tasks.workunit.client.0.smithi152.stdout:5/27: dread - no filename 2023-12-06T15:00:20.026 INFO:tasks.workunit.client.0.smithi152.stdout:5/28: write - no filename 2023-12-06T15:00:20.026 INFO:tasks.workunit.client.0.smithi152.stdout:5/29: truncate - no filename 2023-12-06T15:00:20.029 INFO:tasks.workunit.client.0.smithi152.stdout:8/15: mkdir d1/d3 0 2023-12-06T15:00:20.029 INFO:tasks.workunit.client.1.smithi190.stdout:9/152: rename d4/ff to d4/f33 0 2023-12-06T15:00:20.032 INFO:tasks.workunit.client.0.smithi152.stdout:6/28: link d1/f8 d1/d5/fa 0 2023-12-06T15:00:20.032 INFO:tasks.workunit.client.0.smithi152.stdout:6/29: write d1/d5/f9 [1044302,74686] 0 2023-12-06T15:00:20.032 INFO:tasks.workunit.client.1.smithi190.stdout:9/153: unlink d4/d27/d2f/d31/f30 0 2023-12-06T15:00:20.036 INFO:tasks.workunit.client.0.smithi152.stdout:5/30: symlink l4 0 2023-12-06T15:00:20.037 INFO:tasks.workunit.client.0.smithi152.stdout:8/16: mkdir d1/d3/d4 0 2023-12-06T15:00:20.038 INFO:tasks.workunit.client.0.smithi152.stdout:7/31: getdents . 0 2023-12-06T15:00:20.038 INFO:tasks.workunit.client.0.smithi152.stdout:7/32: read - f3 zero size 2023-12-06T15:00:20.038 INFO:tasks.workunit.client.0.smithi152.stdout:7/33: dread - f4 zero size 2023-12-06T15:00:20.038 INFO:tasks.workunit.client.0.smithi152.stdout:9/86: write d0/f14 [30873,35935] 0 2023-12-06T15:00:20.038 INFO:tasks.workunit.client.0.smithi152.stdout:6/30: creat d1/d5/fb x:0 0 0 2023-12-06T15:00:20.039 INFO:tasks.workunit.client.0.smithi152.stdout:6/31: chown d1/f8 5586 1 2023-12-06T15:00:20.039 INFO:tasks.workunit.client.0.smithi152.stdout:6/32: write d1/f8 [4641706,108307] 0 2023-12-06T15:00:20.042 INFO:tasks.workunit.client.0.smithi152.stdout:7/34: creat f7 x:0 0 0 2023-12-06T15:00:20.044 INFO:tasks.workunit.client.0.smithi152.stdout:6/33: link d1/d5/fb d1/d5/fc 0 2023-12-06T15:00:20.044 INFO:tasks.workunit.client.0.smithi152.stdout:6/34: readlink l0 0 2023-12-06T15:00:20.045 INFO:tasks.workunit.client.0.smithi152.stdout:7/35: creat f8 x:0 0 0 2023-12-06T15:00:20.045 INFO:tasks.workunit.client.0.smithi152.stdout:6/35: mkdir d1/d5/dd 0 2023-12-06T15:00:20.046 INFO:tasks.workunit.client.0.smithi152.stdout:7/36: creat f9 x:0 0 0 2023-12-06T15:00:20.046 INFO:tasks.workunit.client.0.smithi152.stdout:9/87: mknod d0/c18 0 2023-12-06T15:00:20.046 INFO:tasks.workunit.client.0.smithi152.stdout:9/88: readlink d0/l12 0 2023-12-06T15:00:20.049 INFO:tasks.workunit.client.0.smithi152.stdout:1/72: dwrite d3/da/d15/f1e [0,4194304] 0 2023-12-06T15:00:20.049 INFO:tasks.workunit.client.0.smithi152.stdout:1/73: fsync d3/f1c 0 2023-12-06T15:00:20.051 INFO:tasks.workunit.client.0.smithi152.stdout:1/74: write d3/da/db/f11 [801332,71815] 0 2023-12-06T15:00:20.051 INFO:tasks.workunit.client.0.smithi152.stdout:1/75: readlink d3/da/db/d18/l16 0 2023-12-06T15:00:20.051 INFO:tasks.workunit.client.0.smithi152.stdout:4/89: dwrite d2/f12 [0,4194304] 0 2023-12-06T15:00:20.051 INFO:tasks.workunit.client.0.smithi152.stdout:1/76: creat d3/da/d15/d17/f21 x:0 0 0 2023-12-06T15:00:20.054 INFO:tasks.workunit.client.0.smithi152.stdout:1/77: symlink d3/da/db/d18/l22 0 2023-12-06T15:00:20.060 INFO:tasks.workunit.client.1.smithi190.stdout:3/213: dwrite d4/d1b/f37 [0,4194304] 0 2023-12-06T15:00:20.062 INFO:tasks.workunit.client.1.smithi190.stdout:3/214: rename d4/d15/d19/d1c/d3d/l44 to d4/d15/d19/d1c/d3d/l4a 0 2023-12-06T15:00:20.064 INFO:tasks.workunit.client.1.smithi190.stdout:3/215: symlink d4/d1b/l4b 0 2023-12-06T15:00:20.064 INFO:tasks.workunit.client.0.smithi152.stdout:4/90: dread d2/fa [0,4194304] 0 2023-12-06T15:00:20.065 INFO:tasks.workunit.client.1.smithi190.stdout:3/216: write d4/f9 [876615,16443] 0 2023-12-06T15:00:20.067 INFO:tasks.workunit.client.0.smithi152.stdout:4/91: unlink d2/f12 0 2023-12-06T15:00:20.067 INFO:tasks.workunit.client.0.smithi152.stdout:4/92: fsync d2/d10/d13/f18 0 2023-12-06T15:00:20.067 INFO:tasks.workunit.client.0.smithi152.stdout:4/93: fdatasync d2/fd 0 2023-12-06T15:00:20.070 INFO:tasks.workunit.client.0.smithi152.stdout:8/17: dread d1/f2 [0,4194304] 0 2023-12-06T15:00:20.070 INFO:tasks.workunit.client.0.smithi152.stdout:2/30: dwrite f4 [0,4194304] 0 2023-12-06T15:00:20.071 INFO:tasks.workunit.client.0.smithi152.stdout:4/94: dread d2/fd [0,4194304] 0 2023-12-06T15:00:20.071 INFO:tasks.workunit.client.0.smithi152.stdout:4/95: chown d2/l11 12938822 1 2023-12-06T15:00:20.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:19 smithi190 ceph-mon[121340]: from='client.14672 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:00:20.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:19 smithi190 ceph-mon[121340]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:00:20.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:19 smithi190 ceph-mon[121340]: pgmap v21: 65 pgs: 65 active+clean; 420 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 18 MiB/s rd, 34 MiB/s wr, 847 op/s 2023-12-06T15:00:20.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:19 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/1690032725' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-06T15:00:20.072 INFO:tasks.workunit.client.0.smithi152.stdout:5/31: unlink l3 0 2023-12-06T15:00:20.072 INFO:tasks.workunit.client.0.smithi152.stdout:5/32: dread - no filename 2023-12-06T15:00:20.072 INFO:tasks.workunit.client.0.smithi152.stdout:5/33: dwrite - no filename 2023-12-06T15:00:20.072 INFO:tasks.workunit.client.0.smithi152.stdout:5/34: dwrite - no filename 2023-12-06T15:00:20.073 INFO:tasks.workunit.client.0.smithi152.stdout:8/18: rmdir d1/d3/d4 0 2023-12-06T15:00:20.074 INFO:tasks.workunit.client.0.smithi152.stdout:2/31: mkdir d6/d7 0 2023-12-06T15:00:20.074 INFO:tasks.workunit.client.0.smithi152.stdout:8/19: dread d1/f2 [0,4194304] 0 2023-12-06T15:00:20.075 INFO:tasks.workunit.client.0.smithi152.stdout:5/35: creat f5 x:0 0 0 2023-12-06T15:00:20.076 INFO:tasks.workunit.client.0.smithi152.stdout:8/20: link d1/f2 d1/f5 0 2023-12-06T15:00:20.076 INFO:tasks.workunit.client.0.smithi152.stdout:8/21: write d1/f5 [714845,44644] 0 2023-12-06T15:00:20.077 INFO:tasks.workunit.client.0.smithi152.stdout:5/36: link f5 f6 0 2023-12-06T15:00:20.078 INFO:tasks.workunit.client.0.smithi152.stdout:5/37: mkdir d7 0 2023-12-06T15:00:20.078 INFO:tasks.workunit.client.0.smithi152.stdout:9/89: fsync d0/dd/fe 0 2023-12-06T15:00:20.079 INFO:tasks.workunit.client.1.smithi190.stdout:9/154: dwrite f0 [0,4194304] 0 2023-12-06T15:00:20.079 INFO:tasks.workunit.client.1.smithi190.stdout:9/155: chown d4/f24 36497388 1 2023-12-06T15:00:20.079 INFO:tasks.workunit.client.0.smithi152.stdout:7/37: dwrite f9 [0,4194304] 0 2023-12-06T15:00:20.079 INFO:tasks.workunit.client.0.smithi152.stdout:4/96: dread d2/f1a [0,4194304] 0 2023-12-06T15:00:20.079 INFO:tasks.workunit.client.0.smithi152.stdout:4/97: chown d2/f1a 64762 1 2023-12-06T15:00:20.083 INFO:tasks.workunit.client.0.smithi152.stdout:9/90: rename d0/fa to d0/f19 0 2023-12-06T15:00:20.084 INFO:tasks.workunit.client.0.smithi152.stdout:3/21: dread f3 [0,4194304] 0 2023-12-06T15:00:20.086 INFO:tasks.workunit.client.1.smithi190.stdout:3/217: rmdir d4 39 2023-12-06T15:00:20.088 INFO:tasks.workunit.client.0.smithi152.stdout:7/38: creat fa x:0 0 0 2023-12-06T15:00:20.088 INFO:tasks.workunit.client.0.smithi152.stdout:4/98: mknod d2/d10/c1d 0 2023-12-06T15:00:20.089 INFO:tasks.workunit.client.0.smithi152.stdout:9/91: mkdir d0/dd/d1a 0 2023-12-06T15:00:20.089 INFO:tasks.workunit.client.0.smithi152.stdout:9/92: fdatasync d0/f8 0 2023-12-06T15:00:20.089 INFO:tasks.workunit.client.0.smithi152.stdout:9/93: readlink d0/l11 0 2023-12-06T15:00:20.091 INFO:tasks.workunit.client.1.smithi190.stdout:3/218: link d4/d15/l49 d4/d15/d19/d3a/l4c 0 2023-12-06T15:00:20.092 INFO:tasks.workunit.client.0.smithi152.stdout:4/99: mknod d2/c1e 0 2023-12-06T15:00:20.092 INFO:tasks.workunit.client.0.smithi152.stdout:6/36: truncate d1/f8 755182 0 2023-12-06T15:00:20.092 INFO:tasks.workunit.client.0.smithi152.stdout:6/37: dread - d1/d5/fb zero size 2023-12-06T15:00:20.093 INFO:tasks.workunit.client.0.smithi152.stdout:7/39: creat fb x:0 0 0 2023-12-06T15:00:20.093 INFO:tasks.workunit.client.0.smithi152.stdout:7/40: stat f9 0 2023-12-06T15:00:20.093 INFO:tasks.workunit.client.0.smithi152.stdout:7/41: dread - fa zero size 2023-12-06T15:00:20.093 INFO:tasks.workunit.client.0.smithi152.stdout:2/32: dwrite f4 [4194304,4194304] 0 2023-12-06T15:00:20.093 INFO:tasks.workunit.client.0.smithi152.stdout:2/33: stat f0 0 2023-12-06T15:00:20.093 INFO:tasks.workunit.client.0.smithi152.stdout:2/34: readlink l3 0 2023-12-06T15:00:20.093 INFO:tasks.workunit.client.1.smithi190.stdout:3/219: rmdir d4/d15/d33/d45 39 2023-12-06T15:00:20.094 INFO:tasks.workunit.client.0.smithi152.stdout:9/94: rmdir d0/dd/d1a 0 2023-12-06T15:00:20.094 INFO:tasks.workunit.client.1.smithi190.stdout:3/220: read d4/d15/d33/d36/f27 [1587024,75922] 0 2023-12-06T15:00:20.094 INFO:tasks.workunit.client.0.smithi152.stdout:2/35: write f1 [14878,123739] 0 2023-12-06T15:00:20.095 INFO:tasks.workunit.client.0.smithi152.stdout:4/100: creat d2/f1f x:0 0 0 2023-12-06T15:00:20.095 INFO:tasks.workunit.client.0.smithi152.stdout:4/101: fsync f1 0 2023-12-06T15:00:20.095 INFO:tasks.workunit.client.0.smithi152.stdout:4/102: fsync d2/fe 0 2023-12-06T15:00:20.095 INFO:tasks.workunit.client.0.smithi152.stdout:4/103: chown d2/c14 69 1 2023-12-06T15:00:20.095 INFO:tasks.workunit.client.0.smithi152.stdout:4/104: write d2/f1b [129469,47994] 0 2023-12-06T15:00:20.096 INFO:tasks.workunit.client.0.smithi152.stdout:6/38: creat d1/d5/dd/fe x:0 0 0 2023-12-06T15:00:20.096 INFO:tasks.workunit.client.1.smithi190.stdout:3/221: rename d4/d15/d33/c3e to d4/d15/d33/c4d 0 2023-12-06T15:00:20.096 INFO:tasks.workunit.client.1.smithi190.stdout:3/222: write d4/d1b/f22 [545303,106469] 0 2023-12-06T15:00:20.096 INFO:tasks.workunit.client.1.smithi190.stdout:3/223: chown d4/l7 2689 1 2023-12-06T15:00:20.096 INFO:tasks.workunit.client.1.smithi190.stdout:3/224: dread - d4/d15/d19/f3f zero size 2023-12-06T15:00:20.097 INFO:tasks.workunit.client.1.smithi190.stdout:3/225: fsync d4/fc 0 2023-12-06T15:00:20.097 INFO:tasks.workunit.client.0.smithi152.stdout:9/95: write d0/dd/fe [148890,82518] 0 2023-12-06T15:00:20.097 INFO:tasks.workunit.client.0.smithi152.stdout:9/96: dread - d0/f15 zero size 2023-12-06T15:00:20.098 INFO:tasks.workunit.client.1.smithi190.stdout:3/226: write d4/ff [1427479,130138] 0 2023-12-06T15:00:20.098 INFO:tasks.workunit.client.1.smithi190.stdout:3/227: dread - d4/d15/d19/f41 zero size 2023-12-06T15:00:20.100 INFO:tasks.workunit.client.1.smithi190.stdout:3/228: creat d4/d15/d19/d1c/f4e x:0 0 0 2023-12-06T15:00:20.100 INFO:tasks.workunit.client.1.smithi190.stdout:3/229: dread - d4/d1b/f38 zero size 2023-12-06T15:00:20.101 INFO:tasks.workunit.client.1.smithi190.stdout:3/230: creat d4/d15/d33/d36/f4f x:0 0 0 2023-12-06T15:00:20.103 INFO:tasks.workunit.client.1.smithi190.stdout:3/231: truncate d4/d15/d19/d1c/d3d/f43 322004 0 2023-12-06T15:00:20.103 INFO:tasks.workunit.client.1.smithi190.stdout:3/232: write d4/d1b/f38 [968200,82691] 0 2023-12-06T15:00:20.103 INFO:tasks.workunit.client.1.smithi190.stdout:3/233: chown d4/d15/d33/d36/f4f 12621 1 2023-12-06T15:00:20.104 INFO:tasks.workunit.client.0.smithi152.stdout:3/22: dwrite f3 [0,4194304] 0 2023-12-06T15:00:20.104 INFO:tasks.workunit.client.0.smithi152.stdout:3/23: chown f3 7866 1 2023-12-06T15:00:20.105 INFO:tasks.workunit.client.1.smithi190.stdout:3/234: write d4/d1b/f37 [1803467,107266] 0 2023-12-06T15:00:20.108 INFO:tasks.workunit.client.1.smithi190.stdout:3/235: mkdir d4/d15/d19/d3a/d3b/d50 0 2023-12-06T15:00:20.113 INFO:tasks.workunit.client.0.smithi152.stdout:2/36: dwrite f0 [0,4194304] 0 2023-12-06T15:00:20.113 INFO:tasks.workunit.client.1.smithi190.stdout:3/236: fsync d4/d1b/f38 0 2023-12-06T15:00:20.114 INFO:tasks.workunit.client.1.smithi190.stdout:3/237: chown d4/f5 126573820 1 2023-12-06T15:00:20.130 INFO:tasks.workunit.client.1.smithi190.stdout:3/238: dwrite d4/d15/d33/d45/f47 [0,4194304] 0 2023-12-06T15:00:20.146 INFO:tasks.workunit.client.1.smithi190.stdout:3/239: dwrite d4/d15/d33/d36/f4f [0,4194304] 0 2023-12-06T15:00:20.146 INFO:tasks.workunit.client.1.smithi190.stdout:3/240: readlink d4/d15/d19/d1c/d3d/l4a 0 2023-12-06T15:00:20.149 INFO:tasks.workunit.client.1.smithi190.stdout:3/241: mkdir d4/d15/d19/d51 0 2023-12-06T15:00:20.149 INFO:tasks.workunit.client.1.smithi190.stdout:3/242: getdents d4/d15/d19/d3a/d3b 0 2023-12-06T15:00:20.150 INFO:tasks.workunit.client.1.smithi190.stdout:3/243: readlink d4/l7 0 2023-12-06T15:00:20.151 INFO:tasks.workunit.client.1.smithi190.stdout:3/244: symlink d4/d15/d19/l52 0 2023-12-06T15:00:20.152 INFO:tasks.workunit.client.1.smithi190.stdout:3/245: mkdir d4/d15/d53 0 2023-12-06T15:00:20.154 INFO:tasks.workunit.client.1.smithi190.stdout:3/246: mkdir d4/d1b/d54 0 2023-12-06T15:00:20.155 INFO:tasks.workunit.client.1.smithi190.stdout:3/247: creat d4/d15/d19/d3a/d3b/f55 x:0 0 0 2023-12-06T15:00:20.155 INFO:tasks.workunit.client.1.smithi190.stdout:3/248: chown d4/d15/d19/d1c/d3d/f40 9302 1 2023-12-06T15:00:20.157 INFO:tasks.workunit.client.1.smithi190.stdout:3/249: mkdir d4/d15/d53/d56 0 2023-12-06T15:00:20.159 INFO:tasks.workunit.client.1.smithi190.stdout:3/250: creat d4/d15/d19/f57 x:0 0 0 2023-12-06T15:00:20.160 INFO:tasks.workunit.client.1.smithi190.stdout:3/251: truncate d4/d1b/f37 1012469 0 2023-12-06T15:00:20.177 INFO:tasks.workunit.client.1.smithi190.stdout:0/108: sync 2023-12-06T15:00:20.177 INFO:tasks.workunit.client.1.smithi190.stdout:8/81: sync 2023-12-06T15:00:20.178 INFO:tasks.workunit.client.1.smithi190.stdout:7/121: sync 2023-12-06T15:00:20.178 INFO:tasks.workunit.client.1.smithi190.stdout:5/104: sync 2023-12-06T15:00:20.178 INFO:tasks.workunit.client.1.smithi190.stdout:7/122: stat d0/f3 0 2023-12-06T15:00:20.178 INFO:tasks.workunit.client.1.smithi190.stdout:8/82: readlink d1/d10/l17 0 2023-12-06T15:00:20.178 INFO:tasks.workunit.client.1.smithi190.stdout:8/83: chown d1/l15 172 1 2023-12-06T15:00:20.179 INFO:tasks.workunit.client.1.smithi190.stdout:7/123: unlink d0/df/d10/f1e 0 2023-12-06T15:00:20.180 INFO:tasks.workunit.client.1.smithi190.stdout:7/124: fsync d0/d5/f9 0 2023-12-06T15:00:20.180 INFO:tasks.workunit.client.0.smithi152.stdout:1/78: write d3/f5 [5221835,97083] 0 2023-12-06T15:00:20.180 INFO:tasks.workunit.client.1.smithi190.stdout:0/109: symlink d0/da/d1a/l1c 0 2023-12-06T15:00:20.182 INFO:tasks.workunit.client.1.smithi190.stdout:8/84: unlink d1/d10/l17 0 2023-12-06T15:00:20.183 INFO:tasks.workunit.client.1.smithi190.stdout:7/125: mknod d0/df/c21 0 2023-12-06T15:00:20.184 INFO:tasks.workunit.client.1.smithi190.stdout:8/85: write d1/f19 [3496097,53212] 0 2023-12-06T15:00:20.184 INFO:tasks.workunit.client.1.smithi190.stdout:8/86: readlink d1/lf 0 2023-12-06T15:00:20.184 INFO:tasks.workunit.client.1.smithi190.stdout:0/110: link d0/da/l15 d0/da/l1d 0 2023-12-06T15:00:20.185 INFO:tasks.workunit.client.1.smithi190.stdout:0/111: write d0/d4/f16 [447576,91712] 0 2023-12-06T15:00:20.185 INFO:tasks.workunit.client.1.smithi190.stdout:0/112: chown d0/da/ff 190593086 1 2023-12-06T15:00:20.185 INFO:tasks.workunit.client.1.smithi190.stdout:7/126: truncate d0/d5/f8 1935833 0 2023-12-06T15:00:20.187 INFO:tasks.workunit.client.1.smithi190.stdout:8/87: mkdir d1/d10/d1c 0 2023-12-06T15:00:20.189 INFO:tasks.workunit.client.1.smithi190.stdout:0/113: creat d0/f1e x:0 0 0 2023-12-06T15:00:20.189 INFO:tasks.workunit.client.1.smithi190.stdout:0/114: chown d0/l1 0 1 2023-12-06T15:00:20.189 INFO:tasks.workunit.client.0.smithi152.stdout:4/105: link d2/c14 d2/d10/d13/c20 0 2023-12-06T15:00:20.189 INFO:tasks.workunit.client.0.smithi152.stdout:6/39: creat d1/ff x:0 0 0 2023-12-06T15:00:20.190 INFO:tasks.workunit.client.0.smithi152.stdout:8/22: rename d1/d3 to d1/d6 0 2023-12-06T15:00:20.190 INFO:tasks.workunit.client.1.smithi190.stdout:0/115: truncate d0/da/ff 2775832 0 2023-12-06T15:00:20.191 INFO:tasks.workunit.client.0.smithi152.stdout:9/97: symlink d0/dd/l1b 0 2023-12-06T15:00:20.191 INFO:tasks.workunit.client.0.smithi152.stdout:1/79: dread d3/da/d15/f1e [0,4194304] 0 2023-12-06T15:00:20.191 INFO:tasks.workunit.client.0.smithi152.stdout:1/80: fdatasync d3/fd 0 2023-12-06T15:00:20.192 INFO:tasks.workunit.client.1.smithi190.stdout:8/88: dread d1/fb [0,4194304] 0 2023-12-06T15:00:20.193 INFO:tasks.workunit.client.0.smithi152.stdout:8/23: dread d1/f2 [0,4194304] 0 2023-12-06T15:00:20.193 INFO:tasks.workunit.client.0.smithi152.stdout:1/81: read d3/da/d15/f1e [3511457,89003] 0 2023-12-06T15:00:20.193 INFO:tasks.workunit.client.0.smithi152.stdout:1/82: stat d3/f7 0 2023-12-06T15:00:20.193 INFO:tasks.workunit.client.0.smithi152.stdout:3/24: rename f5 to f7 0 2023-12-06T15:00:20.193 INFO:tasks.workunit.client.1.smithi190.stdout:7/127: write d0/d5/da/fb [1397223,97686] 0 2023-12-06T15:00:20.193 INFO:tasks.workunit.client.1.smithi190.stdout:5/105: dwrite d0/f7 [0,4194304] 0 2023-12-06T15:00:20.196 INFO:tasks.workunit.client.0.smithi152.stdout:5/38: fsync f5 0 2023-12-06T15:00:20.197 INFO:tasks.workunit.client.1.smithi190.stdout:7/128: mknod d0/df/c22 0 2023-12-06T15:00:20.198 INFO:tasks.workunit.client.1.smithi190.stdout:5/106: mknod d0/c1e 0 2023-12-06T15:00:20.199 INFO:tasks.workunit.client.1.smithi190.stdout:7/129: creat d0/d5/d1b/d1c/f23 x:0 0 0 2023-12-06T15:00:20.201 INFO:tasks.workunit.client.1.smithi190.stdout:8/89: dread d1/f7 [4194304,4194304] 0 2023-12-06T15:00:20.202 INFO:tasks.workunit.client.1.smithi190.stdout:7/130: mknod d0/d5/d1b/c24 0 2023-12-06T15:00:20.203 INFO:tasks.workunit.client.0.smithi152.stdout:7/42: mknod cc 0 2023-12-06T15:00:20.205 INFO:tasks.workunit.client.0.smithi152.stdout:4/106: rename d2/d10/d13/c20 to d2/c21 0 2023-12-06T15:00:20.205 INFO:tasks.workunit.client.0.smithi152.stdout:4/107: chown d2/l11 6 1 2023-12-06T15:00:20.211 INFO:tasks.workunit.client.0.smithi152.stdout:6/40: mknod d1/c10 0 2023-12-06T15:00:20.213 INFO:tasks.workunit.client.0.smithi152.stdout:6/41: write d1/d5/f9 [206581,46804] 0 2023-12-06T15:00:20.213 INFO:tasks.workunit.client.0.smithi152.stdout:6/42: truncate d1/d5/f9 1716955 0 2023-12-06T15:00:20.213 INFO:tasks.workunit.client.0.smithi152.stdout:9/98: creat d0/f1c x:0 0 0 2023-12-06T15:00:20.214 INFO:tasks.workunit.client.0.smithi152.stdout:8/24: mkdir d1/d6/d7 0 2023-12-06T15:00:20.215 INFO:tasks.workunit.client.0.smithi152.stdout:1/83: symlink d3/da/d15/d17/d1a/l23 0 2023-12-06T15:00:20.216 INFO:tasks.workunit.client.0.smithi152.stdout:4/108: dread d2/f8 [0,4194304] 0 2023-12-06T15:00:20.217 INFO:tasks.workunit.client.0.smithi152.stdout:5/39: mknod d7/c8 0 2023-12-06T15:00:20.220 INFO:tasks.workunit.client.0.smithi152.stdout:6/43: mknod d1/d5/dd/c11 0 2023-12-06T15:00:20.220 INFO:tasks.workunit.client.0.smithi152.stdout:1/84: dread d3/f7 [0,4194304] 0 2023-12-06T15:00:20.220 INFO:tasks.workunit.client.0.smithi152.stdout:9/99: symlink d0/l1d 0 2023-12-06T15:00:20.221 INFO:tasks.workunit.client.0.smithi152.stdout:8/25: creat d1/f8 x:0 0 0 2023-12-06T15:00:20.225 INFO:tasks.workunit.client.1.smithi190.stdout:0/116: dwrite d0/f18 [0,4194304] 0 2023-12-06T15:00:20.225 INFO:tasks.workunit.client.0.smithi152.stdout:5/40: unlink d7/c8 0 2023-12-06T15:00:20.225 INFO:tasks.workunit.client.0.smithi152.stdout:5/41: chown f5 2 1 2023-12-06T15:00:20.225 INFO:tasks.workunit.client.0.smithi152.stdout:5/42: write f6 [407471,25626] 0 2023-12-06T15:00:20.225 INFO:tasks.workunit.client.0.smithi152.stdout:5/43: stat c0 0 2023-12-06T15:00:20.225 INFO:tasks.workunit.client.0.smithi152.stdout:5/44: chown d7 1604 1 2023-12-06T15:00:20.226 INFO:tasks.workunit.client.0.smithi152.stdout:7/43: mkdir dd 0 2023-12-06T15:00:20.226 INFO:tasks.workunit.client.1.smithi190.stdout:0/117: unlink d0/d4/fe 0 2023-12-06T15:00:20.226 INFO:tasks.workunit.client.1.smithi190.stdout:0/118: truncate d0/f1e 645262 0 2023-12-06T15:00:20.226 INFO:tasks.workunit.client.1.smithi190.stdout:0/119: stat d0/da/d1a/l1c 0 2023-12-06T15:00:20.227 INFO:tasks.workunit.client.0.smithi152.stdout:1/85: mknod d3/c24 0 2023-12-06T15:00:20.227 INFO:tasks.workunit.client.0.smithi152.stdout:6/44: creat d1/d5/f12 x:0 0 0 2023-12-06T15:00:20.228 INFO:tasks.workunit.client.0.smithi152.stdout:8/26: symlink d1/l9 0 2023-12-06T15:00:20.230 INFO:tasks.workunit.client.0.smithi152.stdout:6/45: rename d1/f2 to d1/f13 0 2023-12-06T15:00:20.231 INFO:tasks.workunit.client.1.smithi190.stdout:0/120: write d0/f18 [2013964,122519] 0 2023-12-06T15:00:20.231 INFO:tasks.workunit.client.1.smithi190.stdout:5/107: dwrite d0/d12/f16 [0,4194304] 0 2023-12-06T15:00:20.231 INFO:tasks.workunit.client.1.smithi190.stdout:7/131: dwrite d0/d5/f9 [4194304,4194304] 0 2023-12-06T15:00:20.231 INFO:tasks.workunit.client.1.smithi190.stdout:0/121: mknod d0/da/d1a/c1f 0 2023-12-06T15:00:20.231 INFO:tasks.workunit.client.1.smithi190.stdout:0/122: stat d0/d4/l7 0 2023-12-06T15:00:20.231 INFO:tasks.workunit.client.0.smithi152.stdout:1/86: symlink d3/da/db/l25 0 2023-12-06T15:00:20.232 INFO:tasks.workunit.client.1.smithi190.stdout:8/90: dwrite d1/fb [0,4194304] 0 2023-12-06T15:00:20.232 INFO:tasks.workunit.client.0.smithi152.stdout:6/46: unlink d1/d5/fc 0 2023-12-06T15:00:20.233 INFO:tasks.workunit.client.1.smithi190.stdout:5/108: rename d0/fe to d0/d12/f1f 0 2023-12-06T15:00:20.236 INFO:tasks.workunit.client.0.smithi152.stdout:1/87: creat d3/da/f26 x:0 0 0 2023-12-06T15:00:20.237 INFO:tasks.workunit.client.0.smithi152.stdout:6/47: creat d1/d5/f14 x:0 0 0 2023-12-06T15:00:20.238 INFO:tasks.workunit.client.0.smithi152.stdout:1/88: creat d3/da/db/f27 x:0 0 0 2023-12-06T15:00:20.240 INFO:tasks.workunit.client.1.smithi190.stdout:7/132: rmdir d0/d5 39 2023-12-06T15:00:20.240 INFO:tasks.workunit.client.0.smithi152.stdout:6/48: mkdir d1/d5/d15 0 2023-12-06T15:00:20.241 INFO:tasks.workunit.client.1.smithi190.stdout:0/123: mknod d0/da/d1a/c20 0 2023-12-06T15:00:20.243 INFO:tasks.workunit.client.0.smithi152.stdout:1/89: creat d3/da/d15/d17/d1a/f28 x:0 0 0 2023-12-06T15:00:20.244 INFO:tasks.workunit.client.1.smithi190.stdout:8/91: unlink d1/ca 0 2023-12-06T15:00:20.244 INFO:tasks.workunit.client.1.smithi190.stdout:0/124: write d0/f18 [2388866,105748] 0 2023-12-06T15:00:20.245 INFO:tasks.workunit.client.0.smithi152.stdout:5/45: dwrite f5 [0,4194304] 0 2023-12-06T15:00:20.247 INFO:tasks.workunit.client.0.smithi152.stdout:1/90: creat d3/da/d15/f29 x:0 0 0 2023-12-06T15:00:20.247 INFO:tasks.workunit.client.0.smithi152.stdout:1/91: chown d3/da/d15/d17/d1a/f28 121818864 1 2023-12-06T15:00:20.248 INFO:tasks.workunit.client.0.smithi152.stdout:5/46: mknod d7/c9 0 2023-12-06T15:00:20.248 INFO:tasks.workunit.client.0.smithi152.stdout:4/109: rename d2/d10/d13 to d2/d22 0 2023-12-06T15:00:20.248 INFO:tasks.workunit.client.0.smithi152.stdout:4/110: chown d2/d15 1 1 2023-12-06T15:00:20.249 INFO:tasks.workunit.client.0.smithi152.stdout:1/92: mkdir d3/da/d2a 0 2023-12-06T15:00:20.249 INFO:tasks.workunit.client.0.smithi152.stdout:1/93: readlink d3/da/db/d18/l19 0 2023-12-06T15:00:20.250 INFO:tasks.workunit.client.0.smithi152.stdout:5/47: creat d7/fa x:0 0 0 2023-12-06T15:00:20.251 INFO:tasks.workunit.client.1.smithi190.stdout:7/133: mknod d0/d5/da/c25 0 2023-12-06T15:00:20.251 INFO:tasks.workunit.client.0.smithi152.stdout:1/94: read d3/da/db/f11 [1642674,707] 0 2023-12-06T15:00:20.252 INFO:tasks.workunit.client.0.smithi152.stdout:4/111: truncate f1 3871158 0 2023-12-06T15:00:20.252 INFO:tasks.workunit.client.1.smithi190.stdout:8/92: mkdir d1/d10/d1d 0 2023-12-06T15:00:20.252 INFO:tasks.workunit.client.1.smithi190.stdout:8/93: read d1/f7 [7393650,15578] 0 2023-12-06T15:00:20.253 INFO:tasks.workunit.client.1.smithi190.stdout:0/125: rmdir d0/da 39 2023-12-06T15:00:20.253 INFO:tasks.workunit.client.0.smithi152.stdout:3/25: truncate f2 2442182 0 2023-12-06T15:00:20.254 INFO:tasks.workunit.client.0.smithi152.stdout:5/48: write f6 [1112807,58160] 0 2023-12-06T15:00:20.255 INFO:tasks.workunit.client.1.smithi190.stdout:5/109: unlink d0/d12/f16 0 2023-12-06T15:00:20.258 INFO:tasks.workunit.client.1.smithi190.stdout:7/134: creat d0/d5/d1b/d1c/d17/f26 x:0 0 0 2023-12-06T15:00:20.259 INFO:tasks.workunit.client.1.smithi190.stdout:8/94: unlink d1/fd 0 2023-12-06T15:00:20.261 INFO:tasks.workunit.client.1.smithi190.stdout:0/126: rename d0/f1e to d0/d4/f21 0 2023-12-06T15:00:20.262 INFO:tasks.workunit.client.1.smithi190.stdout:5/110: rmdir d0/df 39 2023-12-06T15:00:20.262 INFO:tasks.workunit.client.1.smithi190.stdout:5/111: write d0/d12/f14 [267998,75611] 0 2023-12-06T15:00:20.262 INFO:tasks.workunit.client.1.smithi190.stdout:5/112: chown d0/d12/f15 0 1 2023-12-06T15:00:20.262 INFO:tasks.workunit.client.0.smithi152.stdout:5/49: creat d7/fb x:0 0 0 2023-12-06T15:00:20.264 INFO:tasks.workunit.client.0.smithi152.stdout:6/49: dwrite d1/d5/dd/fe [0,4194304] 0 2023-12-06T15:00:20.264 INFO:tasks.workunit.client.0.smithi152.stdout:6/50: read - d1/ff zero size 2023-12-06T15:00:20.264 INFO:tasks.workunit.client.0.smithi152.stdout:6/51: chown d1/d5/dd/c11 1 1 2023-12-06T15:00:20.266 INFO:tasks.workunit.client.1.smithi190.stdout:8/95: creat d1/f1e x:0 0 0 2023-12-06T15:00:20.268 INFO:tasks.workunit.client.1.smithi190.stdout:0/127: rename d0/f19 to d0/da/f22 0 2023-12-06T15:00:20.270 INFO:tasks.workunit.client.0.smithi152.stdout:6/52: dread d1/f8 [0,4194304] 0 2023-12-06T15:00:20.270 INFO:tasks.workunit.client.1.smithi190.stdout:5/113: creat d0/df/f20 x:0 0 0 2023-12-06T15:00:20.270 INFO:tasks.workunit.client.1.smithi190.stdout:5/114: chown d0/d12/f1f 17 1 2023-12-06T15:00:20.271 INFO:tasks.workunit.client.1.smithi190.stdout:5/115: write d0/df/f10 [294642,120642] 0 2023-12-06T15:00:20.272 INFO:tasks.workunit.client.0.smithi152.stdout:6/53: creat d1/f16 x:0 0 0 2023-12-06T15:00:20.273 INFO:tasks.workunit.client.1.smithi190.stdout:8/96: unlink d1/lf 0 2023-12-06T15:00:20.273 INFO:tasks.workunit.client.1.smithi190.stdout:8/97: dread - d1/f1b zero size 2023-12-06T15:00:20.276 INFO:tasks.workunit.client.1.smithi190.stdout:8/98: creat d1/d10/d1c/f1f x:0 0 0 2023-12-06T15:00:20.276 INFO:tasks.workunit.client.1.smithi190.stdout:8/99: chown d1/f1e 3 1 2023-12-06T15:00:20.276 INFO:tasks.workunit.client.1.smithi190.stdout:8/100: fdatasync d1/d10/d1c/f1f 0 2023-12-06T15:00:20.279 INFO:tasks.workunit.client.1.smithi190.stdout:5/116: dread d0/f6 [0,4194304] 0 2023-12-06T15:00:20.282 INFO:tasks.workunit.client.0.smithi152.stdout:4/112: dwrite d2/f9 [0,4194304] 0 2023-12-06T15:00:20.285 INFO:tasks.workunit.client.0.smithi152.stdout:4/113: mkdir d2/d15/d23 0 2023-12-06T15:00:20.286 INFO:tasks.workunit.client.0.smithi152.stdout:4/114: read d2/f1a [529681,49286] 0 2023-12-06T15:00:20.286 INFO:tasks.workunit.client.0.smithi152.stdout:4/115: truncate d2/f1f 202019 0 2023-12-06T15:00:20.292 INFO:tasks.workunit.client.0.smithi152.stdout:1/95: dwrite d3/f1b [0,4194304] 0 2023-12-06T15:00:20.300 INFO:tasks.workunit.client.0.smithi152.stdout:1/96: write d3/f5 [42366,101515] 0 2023-12-06T15:00:20.300 INFO:tasks.workunit.client.0.smithi152.stdout:1/97: chown d3/da 7604 1 2023-12-06T15:00:20.301 INFO:tasks.workunit.client.0.smithi152.stdout:1/98: read - d3/da/d15/d17/f21 zero size 2023-12-06T15:00:20.301 INFO:tasks.workunit.client.0.smithi152.stdout:1/99: readlink d3/da/db/l12 0 2023-12-06T15:00:20.301 INFO:tasks.workunit.client.1.smithi190.stdout:0/128: truncate d0/f18 2475103 0 2023-12-06T15:00:20.304 INFO:tasks.workunit.client.1.smithi190.stdout:0/129: getdents d0/da 0 2023-12-06T15:00:20.306 INFO:tasks.workunit.client.1.smithi190.stdout:0/130: link d0/c5 d0/c23 0 2023-12-06T15:00:20.308 INFO:tasks.workunit.client.0.smithi152.stdout:6/54: dwrite d1/d5/fb [0,4194304] 0 2023-12-06T15:00:20.308 INFO:tasks.workunit.client.0.smithi152.stdout:6/55: write d1/d5/f9 [2675751,56863] 0 2023-12-06T15:00:20.308 INFO:tasks.workunit.client.0.smithi152.stdout:4/116: dwrite d2/fd [0,4194304] 0 2023-12-06T15:00:20.308 INFO:tasks.workunit.client.0.smithi152.stdout:4/117: stat d2/fa 0 2023-12-06T15:00:20.311 INFO:tasks.workunit.client.1.smithi190.stdout:0/131: dread d0/da/f22 [0,4194304] 0 2023-12-06T15:00:20.313 INFO:tasks.workunit.client.1.smithi190.stdout:0/132: write d0/d4/f16 [263069,95569] 0 2023-12-06T15:00:20.313 INFO:tasks.workunit.client.0.smithi152.stdout:4/118: link d2/d15/f19 d2/d10/f24 0 2023-12-06T15:00:20.313 INFO:tasks.workunit.client.1.smithi190.stdout:0/133: getdents d0/da/d1a 0 2023-12-06T15:00:20.313 INFO:tasks.workunit.client.1.smithi190.stdout:0/134: write d0/da/ff [2874764,97266] 0 2023-12-06T15:00:20.313 INFO:tasks.workunit.client.1.smithi190.stdout:0/135: fsync d0/d4/f21 0 2023-12-06T15:00:20.313 INFO:tasks.workunit.client.1.smithi190.stdout:0/136: truncate d0/d4/f16 1424625 0 2023-12-06T15:00:20.332 INFO:tasks.workunit.client.0.smithi152.stdout:4/119: dwrite f1 [0,4194304] 0 2023-12-06T15:00:20.333 INFO:tasks.workunit.client.0.smithi152.stdout:6/56: dwrite d1/d5/dd/fe [4194304,4194304] 0 2023-12-06T15:00:20.333 INFO:tasks.workunit.client.0.smithi152.stdout:6/57: dread - d1/f7 zero size 2023-12-06T15:00:20.333 INFO:tasks.workunit.client.0.smithi152.stdout:6/58: chown d1/d5/fa 30333507 1 2023-12-06T15:00:20.333 INFO:tasks.workunit.client.0.smithi152.stdout:6/59: stat d1/d5/fb 0 2023-12-06T15:00:20.339 INFO:tasks.workunit.client.0.smithi152.stdout:4/120: symlink d2/d15/d23/l25 0 2023-12-06T15:00:20.346 INFO:tasks.workunit.client.0.smithi152.stdout:6/60: dread d1/d5/dd/fe [4194304,4194304] 0 2023-12-06T15:00:20.348 INFO:tasks.workunit.client.0.smithi152.stdout:6/61: rename d1/d5/f12 to d1/d5/f17 0 2023-12-06T15:00:20.348 INFO:tasks.workunit.client.0.smithi152.stdout:6/62: write d1/f7 [696501,67768] 0 2023-12-06T15:00:20.348 INFO:tasks.workunit.client.0.smithi152.stdout:6/63: read - d1/d5/f14 zero size 2023-12-06T15:00:20.348 INFO:tasks.workunit.client.0.smithi152.stdout:6/64: write d1/f16 [602316,66373] 0 2023-12-06T15:00:20.349 INFO:tasks.workunit.client.0.smithi152.stdout:6/65: fsync d1/d5/f14 0 2023-12-06T15:00:20.349 INFO:tasks.workunit.client.0.smithi152.stdout:6/66: chown d1/d5/fb 70095 1 2023-12-06T15:00:20.349 INFO:tasks.workunit.client.0.smithi152.stdout:6/67: mkdir d1/d5/dd/d18 0 2023-12-06T15:00:20.350 INFO:tasks.workunit.client.0.smithi152.stdout:6/68: mkdir d1/d19 0 2023-12-06T15:00:20.353 INFO:tasks.workunit.client.0.smithi152.stdout:6/69: rmdir d1/d5 39 2023-12-06T15:00:20.353 INFO:tasks.workunit.client.0.smithi152.stdout:6/70: readlink l0 0 2023-12-06T15:00:20.353 INFO:tasks.workunit.client.0.smithi152.stdout:6/71: read d1/d5/fa [595399,107499] 0 2023-12-06T15:00:20.353 INFO:tasks.workunit.client.0.smithi152.stdout:6/72: write d1/d5/f9 [3776756,126401] 0 2023-12-06T15:00:20.374 INFO:tasks.workunit.client.0.smithi152.stdout:6/73: dwrite d1/f16 [0,4194304] 0 2023-12-06T15:00:20.376 INFO:tasks.workunit.client.0.smithi152.stdout:6/74: mkdir d1/d19/d1a 0 2023-12-06T15:00:20.376 INFO:tasks.workunit.client.0.smithi152.stdout:6/75: dread - d1/d5/f14 zero size 2023-12-06T15:00:20.376 INFO:tasks.workunit.client.0.smithi152.stdout:6/76: symlink d1/d5/dd/d18/l1b 0 2023-12-06T15:00:20.377 INFO:tasks.workunit.client.0.smithi152.stdout:6/77: mkdir d1/d1c 0 2023-12-06T15:00:20.377 INFO:tasks.workunit.client.0.smithi152.stdout:6/78: readlink d1/d5/dd/d18/l1b 0 2023-12-06T15:00:20.377 INFO:tasks.workunit.client.0.smithi152.stdout:6/79: stat d1/c10 0 2023-12-06T15:00:20.382 INFO:tasks.workunit.client.0.smithi152.stdout:6/80: link d1/d5/dd/fe d1/d5/d15/f1d 0 2023-12-06T15:00:20.383 INFO:tasks.workunit.client.0.smithi152.stdout:6/81: symlink d1/d5/l1e 0 2023-12-06T15:00:20.383 INFO:tasks.workunit.client.0.smithi152.stdout:6/82: chown d1/f16 30 1 2023-12-06T15:00:20.383 INFO:tasks.workunit.client.0.smithi152.stdout:6/83: write d1/f8 [686908,85301] 0 2023-12-06T15:00:20.391 INFO:tasks.workunit.client.0.smithi152.stdout:6/84: getdents d1/d5/dd/d18 0 2023-12-06T15:00:20.406 INFO:tasks.workunit.client.0.smithi152.stdout:6/85: dwrite d1/f16 [0,4194304] 0 2023-12-06T15:00:20.413 INFO:tasks.workunit.client.0.smithi152.stdout:3/26: write f2 [351080,65910] 0 2023-12-06T15:00:20.413 INFO:tasks.workunit.client.0.smithi152.stdout:3/27: chown f2 244578361 1 2023-12-06T15:00:20.413 INFO:tasks.workunit.client.0.smithi152.stdout:3/28: chown f7 538441 1 2023-12-06T15:00:20.413 INFO:tasks.workunit.client.0.smithi152.stdout:3/29: chown f7 406104 1 2023-12-06T15:00:20.413 INFO:tasks.workunit.client.0.smithi152.stdout:3/30: rmdir - no directory 2023-12-06T15:00:20.413 INFO:tasks.workunit.client.0.smithi152.stdout:3/31: write f6 [840567,32249] 0 2023-12-06T15:00:20.414 INFO:tasks.workunit.client.0.smithi152.stdout:3/32: mknod c8 0 2023-12-06T15:00:20.414 INFO:tasks.workunit.client.1.smithi190.stdout:0/137: write d0/f11 [3879863,125008] 0 2023-12-06T15:00:20.414 INFO:tasks.workunit.client.1.smithi190.stdout:0/138: stat d0/f11 0 2023-12-06T15:00:20.415 INFO:tasks.workunit.client.0.smithi152.stdout:3/33: mkdir d9 0 2023-12-06T15:00:20.416 INFO:tasks.workunit.client.1.smithi190.stdout:0/139: creat d0/d4/f24 x:0 0 0 2023-12-06T15:00:20.418 INFO:tasks.workunit.client.1.smithi190.stdout:0/140: creat d0/da/f25 x:0 0 0 2023-12-06T15:00:20.419 INFO:tasks.workunit.client.0.smithi152.stdout:9/100: dwrite d0/f6 [4194304,4194304] 0 2023-12-06T15:00:20.423 INFO:tasks.workunit.client.0.smithi152.stdout:9/101: mknod d0/c1e 0 2023-12-06T15:00:20.423 INFO:tasks.workunit.client.0.smithi152.stdout:9/102: write d0/f15 [433933,110913] 0 2023-12-06T15:00:20.426 INFO:tasks.workunit.client.0.smithi152.stdout:5/50: dread f6 [0,4194304] 0 2023-12-06T15:00:20.426 INFO:tasks.workunit.client.0.smithi152.stdout:5/51: fdatasync f5 0 2023-12-06T15:00:20.426 INFO:tasks.workunit.client.0.smithi152.stdout:5/52: chown f5 113343 1 2023-12-06T15:00:20.432 INFO:tasks.workunit.client.1.smithi190.stdout:5/117: truncate d0/df/f10 341354 0 2023-12-06T15:00:20.432 INFO:tasks.workunit.client.1.smithi190.stdout:8/101: dwrite d1/f4 [4194304,4194304] 0 2023-12-06T15:00:20.432 INFO:tasks.workunit.client.1.smithi190.stdout:5/118: readlink d0/d1c/l1d 0 2023-12-06T15:00:20.434 INFO:tasks.workunit.client.0.smithi152.stdout:5/53: dread f6 [0,4194304] 0 2023-12-06T15:00:20.436 INFO:tasks.workunit.client.1.smithi190.stdout:8/102: truncate d1/fb 2775138 0 2023-12-06T15:00:20.436 INFO:tasks.workunit.client.1.smithi190.stdout:8/103: fsync d1/f1b 0 2023-12-06T15:00:20.436 INFO:tasks.workunit.client.1.smithi190.stdout:5/119: getdents d0/df 0 2023-12-06T15:00:20.437 INFO:tasks.workunit.client.1.smithi190.stdout:8/104: mkdir d1/d20 0 2023-12-06T15:00:20.438 INFO:tasks.workunit.client.1.smithi190.stdout:5/120: rename d0/d12/f14 to d0/d1c/f21 0 2023-12-06T15:00:20.439 INFO:tasks.workunit.client.1.smithi190.stdout:8/105: symlink d1/d10/d1c/l21 0 2023-12-06T15:00:20.439 INFO:tasks.workunit.client.1.smithi190.stdout:8/106: stat d1/c11 0 2023-12-06T15:00:20.440 INFO:tasks.workunit.client.0.smithi152.stdout:3/34: fdatasync f3 0 2023-12-06T15:00:20.440 INFO:tasks.workunit.client.0.smithi152.stdout:1/100: dwrite d3/da/d15/f1d [0,4194304] 0 2023-12-06T15:00:20.441 INFO:tasks.workunit.client.0.smithi152.stdout:3/35: chown l4 109297505 1 2023-12-06T15:00:20.441 INFO:tasks.workunit.client.0.smithi152.stdout:3/36: chown c8 5383 1 2023-12-06T15:00:20.441 INFO:tasks.workunit.client.0.smithi152.stdout:3/37: rename d9 to d9/da 22 2023-12-06T15:00:20.441 INFO:tasks.workunit.client.0.smithi152.stdout:3/38: fsync f3 0 2023-12-06T15:00:20.441 INFO:tasks.workunit.client.1.smithi190.stdout:5/121: rename d0/df/c19 to d0/d12/c22 0 2023-12-06T15:00:20.442 INFO:tasks.workunit.client.1.smithi190.stdout:8/107: link d1/d10/d12/f18 d1/d10/d1c/f22 0 2023-12-06T15:00:20.442 INFO:tasks.workunit.client.0.smithi152.stdout:1/101: creat d3/f2b x:0 0 0 2023-12-06T15:00:20.443 INFO:tasks.workunit.client.0.smithi152.stdout:1/102: chown d3/da 479576 1 2023-12-06T15:00:20.443 INFO:tasks.workunit.client.1.smithi190.stdout:0/141: dwrite d0/d4/f24 [0,4194304] 0 2023-12-06T15:00:20.443 INFO:tasks.workunit.client.0.smithi152.stdout:5/54: truncate f5 3682378 0 2023-12-06T15:00:20.443 INFO:tasks.workunit.client.0.smithi152.stdout:5/55: write d7/fb [817460,5160] 0 2023-12-06T15:00:20.444 INFO:tasks.workunit.client.1.smithi190.stdout:5/122: unlink d0/l11 0 2023-12-06T15:00:20.444 INFO:tasks.workunit.client.1.smithi190.stdout:5/123: truncate d0/f6 4628537 0 2023-12-06T15:00:20.445 INFO:tasks.workunit.client.1.smithi190.stdout:8/108: stat d1/c6 0 2023-12-06T15:00:20.445 INFO:tasks.workunit.client.0.smithi152.stdout:1/103: creat d3/da/db/f2c x:0 0 0 2023-12-06T15:00:20.445 INFO:tasks.workunit.client.0.smithi152.stdout:4/121: dwrite d2/d10/f24 [0,4194304] 0 2023-12-06T15:00:20.448 INFO:tasks.workunit.client.0.smithi152.stdout:1/104: creat d3/da/d15/d17/f2d x:0 0 0 2023-12-06T15:00:20.449 INFO:tasks.workunit.client.1.smithi190.stdout:8/109: symlink d1/d20/l23 0 2023-12-06T15:00:20.449 INFO:tasks.workunit.client.1.smithi190.stdout:8/110: write d1/f16 [652942,53091] 0 2023-12-06T15:00:20.451 INFO:tasks.workunit.client.0.smithi152.stdout:4/122: creat d2/f26 x:0 0 0 2023-12-06T15:00:20.453 INFO:tasks.workunit.client.0.smithi152.stdout:1/105: symlink d3/da/db/l2e 0 2023-12-06T15:00:20.453 INFO:tasks.workunit.client.0.smithi152.stdout:1/106: fdatasync d3/f4 0 2023-12-06T15:00:20.453 INFO:tasks.workunit.client.0.smithi152.stdout:1/107: write d3/da/db/f27 [492435,20169] 0 2023-12-06T15:00:20.454 INFO:tasks.workunit.client.1.smithi190.stdout:5/124: dread d0/fb [4194304,4194304] 0 2023-12-06T15:00:20.454 INFO:tasks.workunit.client.1.smithi190.stdout:5/125: truncate d0/d12/f1f 496484 0 2023-12-06T15:00:20.454 INFO:tasks.workunit.client.1.smithi190.stdout:5/126: chown d0/c1e 29020 1 2023-12-06T15:00:20.454 INFO:tasks.workunit.client.1.smithi190.stdout:5/127: chown d0/fb 46 1 2023-12-06T15:00:20.455 INFO:tasks.workunit.client.0.smithi152.stdout:4/123: rmdir d2/d15 39 2023-12-06T15:00:20.455 INFO:tasks.workunit.client.1.smithi190.stdout:8/111: rename d1/c6 to d1/d10/d1c/c24 0 2023-12-06T15:00:20.455 INFO:tasks.workunit.client.1.smithi190.stdout:8/112: dread - d1/f1a zero size 2023-12-06T15:00:20.455 INFO:tasks.workunit.client.0.smithi152.stdout:6/86: dwrite d1/d5/fa [0,4194304] 0 2023-12-06T15:00:20.455 INFO:tasks.workunit.client.0.smithi152.stdout:6/87: chown d1/f7 331160 1 2023-12-06T15:00:20.456 INFO:tasks.workunit.client.0.smithi152.stdout:6/88: symlink d1/l1f 0 2023-12-06T15:00:20.457 INFO:tasks.workunit.client.1.smithi190.stdout:8/113: getdents d1/d10 0 2023-12-06T15:00:20.457 INFO:tasks.workunit.client.1.smithi190.stdout:8/114: write d1/f1b [226258,21406] 0 2023-12-06T15:00:20.458 INFO:tasks.workunit.client.0.smithi152.stdout:3/39: truncate f2 2364854 0 2023-12-06T15:00:20.459 INFO:tasks.workunit.client.0.smithi152.stdout:6/89: mknod d1/d5/dd/c20 0 2023-12-06T15:00:20.460 INFO:tasks.workunit.client.1.smithi190.stdout:8/115: mkdir d1/d10/d25 0 2023-12-06T15:00:20.461 INFO:tasks.workunit.client.1.smithi190.stdout:8/116: rmdir d1/d10/d12 39 2023-12-06T15:00:20.461 INFO:tasks.workunit.client.1.smithi190.stdout:1/279: sync 2023-12-06T15:00:20.461 INFO:tasks.workunit.client.1.smithi190.stdout:2/173: sync 2023-12-06T15:00:20.461 INFO:tasks.workunit.client.1.smithi190.stdout:6/124: sync 2023-12-06T15:00:20.461 INFO:tasks.workunit.client.1.smithi190.stdout:4/135: sync 2023-12-06T15:00:20.465 INFO:tasks.workunit.client.0.smithi152.stdout:6/90: rename d1/f16 to d1/d19/d1a/f21 0 2023-12-06T15:00:20.465 INFO:tasks.workunit.client.0.smithi152.stdout:1/108: truncate d3/f4 987964 0 2023-12-06T15:00:20.466 INFO:tasks.workunit.client.0.smithi152.stdout:6/91: creat d1/d5/dd/f22 x:0 0 0 2023-12-06T15:00:20.467 INFO:tasks.workunit.client.0.smithi152.stdout:4/124: dread f1 [0,4194304] 0 2023-12-06T15:00:20.467 INFO:tasks.workunit.client.0.smithi152.stdout:1/109: mkdir d3/da/d2a/d2f 0 2023-12-06T15:00:20.468 INFO:tasks.workunit.client.1.smithi190.stdout:4/136: write d3/fb [494758,105246] 0 2023-12-06T15:00:20.468 INFO:tasks.workunit.client.0.smithi152.stdout:6/92: mkdir d1/d19/d1a/d23 0 2023-12-06T15:00:20.468 INFO:tasks.workunit.client.1.smithi190.stdout:2/174: symlink d10/d26/l3e 0 2023-12-06T15:00:20.469 INFO:tasks.workunit.client.1.smithi190.stdout:2/175: dread - d10/d11/f16 zero size 2023-12-06T15:00:20.469 INFO:tasks.workunit.client.1.smithi190.stdout:2/176: dread - d10/d26/f32 zero size 2023-12-06T15:00:20.469 INFO:tasks.workunit.client.1.smithi190.stdout:2/177: chown c9 1 1 2023-12-06T15:00:20.469 INFO:tasks.workunit.client.1.smithi190.stdout:2/178: chown fa 66659 1 2023-12-06T15:00:20.469 INFO:tasks.workunit.client.1.smithi190.stdout:5/128: rename d0/d1c/f21 to d0/f23 0 2023-12-06T15:00:20.471 INFO:tasks.workunit.client.0.smithi152.stdout:1/110: creat d3/f30 x:0 0 0 2023-12-06T15:00:20.471 INFO:tasks.workunit.client.1.smithi190.stdout:4/137: unlink d3/d10/d15/f28 0 2023-12-06T15:00:20.472 INFO:tasks.workunit.client.1.smithi190.stdout:9/156: sync 2023-12-06T15:00:20.472 INFO:tasks.workunit.client.0.smithi152.stdout:6/93: creat d1/d19/d1a/d23/f24 x:0 0 0 2023-12-06T15:00:20.472 INFO:tasks.workunit.client.0.smithi152.stdout:6/94: stat d1/f13 0 2023-12-06T15:00:20.473 INFO:tasks.workunit.client.1.smithi190.stdout:1/280: rename d6/dc/l1d to d6/dc/d29/d38/d43/l4f 0 2023-12-06T15:00:20.476 INFO:tasks.workunit.client.0.smithi152.stdout:1/111: rmdir d3/da/d2a/d2f 0 2023-12-06T15:00:20.476 INFO:tasks.workunit.client.1.smithi190.stdout:9/157: symlink d4/l34 0 2023-12-06T15:00:20.477 INFO:tasks.workunit.client.1.smithi190.stdout:0/142: dwrite d0/d4/f16 [0,4194304] 0 2023-12-06T15:00:20.478 INFO:tasks.workunit.client.0.smithi152.stdout:6/95: creat d1/f25 x:0 0 0 2023-12-06T15:00:20.479 INFO:tasks.workunit.client.1.smithi190.stdout:2/179: rename d10/d11/f2a to d10/d31/d37/f3f 0 2023-12-06T15:00:20.480 INFO:tasks.workunit.client.0.smithi152.stdout:1/112: creat d3/da/db/d18/f31 x:0 0 0 2023-12-06T15:00:20.480 INFO:tasks.workunit.client.0.smithi152.stdout:1/113: write d3/f30 [971094,13420] 0 2023-12-06T15:00:20.482 INFO:tasks.workunit.client.1.smithi190.stdout:9/158: rmdir d4/d27/d2f/d31 39 2023-12-06T15:00:20.486 INFO:tasks.workunit.client.1.smithi190.stdout:6/125: dwrite d4/fc [0,4194304] 0 2023-12-06T15:00:20.486 INFO:tasks.workunit.client.0.smithi152.stdout:4/125: dread d2/fd [0,4194304] 0 2023-12-06T15:00:20.488 INFO:tasks.workunit.client.0.smithi152.stdout:4/126: rmdir d2 39 2023-12-06T15:00:20.489 INFO:tasks.workunit.client.1.smithi190.stdout:2/180: creat d10/f40 x:0 0 0 2023-12-06T15:00:20.489 INFO:tasks.workunit.client.1.smithi190.stdout:2/181: fsync d10/d31/f33 0 2023-12-06T15:00:20.495 INFO:tasks.workunit.client.1.smithi190.stdout:6/126: link d4/fe d4/d12/f21 0 2023-12-06T15:00:20.496 INFO:tasks.workunit.client.0.smithi152.stdout:4/127: mkdir d2/d10/d27 0 2023-12-06T15:00:20.500 INFO:tasks.workunit.client.1.smithi190.stdout:6/127: unlink d4/f9 0 2023-12-06T15:00:20.501 INFO:tasks.workunit.client.1.smithi190.stdout:9/159: dread f1 [0,4194304] 0 2023-12-06T15:00:20.502 INFO:tasks.workunit.client.0.smithi152.stdout:6/96: dread d1/f13 [0,4194304] 0 2023-12-06T15:00:20.503 INFO:tasks.workunit.client.1.smithi190.stdout:6/128: getdents d4/d15 0 2023-12-06T15:00:20.503 INFO:tasks.workunit.client.1.smithi190.stdout:9/160: symlink d4/l35 0 2023-12-06T15:00:20.506 INFO:tasks.workunit.client.1.smithi190.stdout:9/161: mknod d4/d27/d2f/c36 0 2023-12-06T15:00:20.506 INFO:tasks.workunit.client.1.smithi190.stdout:3/252: sync 2023-12-06T15:00:20.506 INFO:tasks.workunit.client.1.smithi190.stdout:7/135: sync 2023-12-06T15:00:20.506 INFO:tasks.workunit.client.1.smithi190.stdout:7/136: stat d0/d5/d1b/d1c 0 2023-12-06T15:00:20.508 INFO:tasks.workunit.client.1.smithi190.stdout:3/253: symlink d4/d15/l58 0 2023-12-06T15:00:20.509 INFO:tasks.workunit.client.0.smithi152.stdout:4/128: dread f1 [0,4194304] 0 2023-12-06T15:00:20.509 INFO:tasks.workunit.client.0.smithi152.stdout:6/97: rmdir d1/d5/dd/d18 39 2023-12-06T15:00:20.511 INFO:tasks.workunit.client.1.smithi190.stdout:9/162: creat d4/d27/d2f/f37 x:0 0 0 2023-12-06T15:00:20.511 INFO:tasks.workunit.client.1.smithi190.stdout:3/254: rename d4/d15/d19/f48 to d4/d15/d33/d45/f59 0 2023-12-06T15:00:20.513 INFO:tasks.workunit.client.1.smithi190.stdout:7/137: write d0/d5/f9 [7140218,102645] 0 2023-12-06T15:00:20.515 INFO:tasks.workunit.client.1.smithi190.stdout:7/138: symlink d0/d5/d1b/l27 0 2023-12-06T15:00:20.515 INFO:tasks.workunit.client.1.smithi190.stdout:9/163: read f1 [2092090,39805] 0 2023-12-06T15:00:20.515 INFO:tasks.workunit.client.1.smithi190.stdout:9/164: chown d4/f18 564475779 1 2023-12-06T15:00:20.516 INFO:tasks.workunit.client.1.smithi190.stdout:5/129: dwrite d0/d12/f1f [0,4194304] 0 2023-12-06T15:00:20.516 INFO:tasks.workunit.client.1.smithi190.stdout:5/130: chown d0/f18 1965392 1 2023-12-06T15:00:20.518 INFO:tasks.workunit.client.0.smithi152.stdout:3/40: dread f2 [0,4194304] 0 2023-12-06T15:00:20.519 INFO:tasks.workunit.client.0.smithi152.stdout:6/98: mkdir d1/d19/d1a/d23/d26 0 2023-12-06T15:00:20.519 INFO:tasks.workunit.client.0.smithi152.stdout:6/99: chown d1/d5 53773470 1 2023-12-06T15:00:20.521 INFO:tasks.workunit.client.0.smithi152.stdout:3/41: symlink d9/lb 0 2023-12-06T15:00:20.521 INFO:tasks.workunit.client.0.smithi152.stdout:6/100: mknod d1/d19/d1a/d23/d26/c27 0 2023-12-06T15:00:20.522 INFO:tasks.workunit.client.1.smithi190.stdout:9/165: rename f3 to d4/d27/d2f/d31/f38 0 2023-12-06T15:00:20.523 INFO:tasks.workunit.client.1.smithi190.stdout:5/131: rmdir d0/df 39 2023-12-06T15:00:20.525 INFO:tasks.workunit.client.1.smithi190.stdout:7/139: dread d0/f3 [0,4194304] 0 2023-12-06T15:00:20.525 INFO:tasks.workunit.client.1.smithi190.stdout:9/166: link d4/f2e d4/f39 0 2023-12-06T15:00:20.526 INFO:tasks.workunit.client.1.smithi190.stdout:3/255: dread d4/d1b/f38 [0,4194304] 0 2023-12-06T15:00:20.527 INFO:tasks.workunit.client.1.smithi190.stdout:8/117: dwrite d1/f16 [0,4194304] 0 2023-12-06T15:00:20.528 INFO:tasks.workunit.client.0.smithi152.stdout:5/56: truncate f6 2484935 0 2023-12-06T15:00:20.529 INFO:tasks.workunit.client.1.smithi190.stdout:5/132: unlink d0/l2 0 2023-12-06T15:00:20.529 INFO:tasks.workunit.client.1.smithi190.stdout:1/281: dwrite d6/f2f [0,4194304] 0 2023-12-06T15:00:20.529 INFO:tasks.workunit.client.1.smithi190.stdout:1/282: fsync d6/dc/f33 0 2023-12-06T15:00:20.531 INFO:tasks.workunit.client.1.smithi190.stdout:4/138: dwrite d3/d13/f18 [0,4194304] 0 2023-12-06T15:00:20.533 INFO:tasks.workunit.client.1.smithi190.stdout:1/283: write d6/f37 [1710005,85722] 0 2023-12-06T15:00:20.533 INFO:tasks.workunit.client.1.smithi190.stdout:1/284: read - d6/f22 zero size 2023-12-06T15:00:20.533 INFO:tasks.workunit.client.1.smithi190.stdout:1/285: chown d6/dc/c32 852 1 2023-12-06T15:00:20.533 INFO:tasks.workunit.client.1.smithi190.stdout:1/286: stat d6/dc/d29/d38/d39/f3f 0 2023-12-06T15:00:20.533 INFO:tasks.workunit.client.1.smithi190.stdout:1/287: write d6/dc/d29/d38/d43/f4b [51238,128102] 0 2023-12-06T15:00:20.533 INFO:tasks.workunit.client.1.smithi190.stdout:7/140: creat d0/d5/d1b/d1c/f28 x:0 0 0 2023-12-06T15:00:20.533 INFO:tasks.workunit.client.1.smithi190.stdout:9/167: link d4/d27/d2f/c36 d4/d27/c3a 0 2023-12-06T15:00:20.534 INFO:tasks.workunit.client.1.smithi190.stdout:7/141: stat d0/d5/d1b/d1c/f28 0 2023-12-06T15:00:20.535 INFO:tasks.workunit.client.1.smithi190.stdout:5/133: creat d0/f24 x:0 0 0 2023-12-06T15:00:20.535 INFO:tasks.workunit.client.1.smithi190.stdout:4/139: creat d3/d10/d15/f2f x:0 0 0 2023-12-06T15:00:20.536 INFO:tasks.workunit.client.1.smithi190.stdout:1/288: symlink d6/l50 0 2023-12-06T15:00:20.537 INFO:tasks.workunit.client.1.smithi190.stdout:9/168: rmdir d4/d27 39 2023-12-06T15:00:20.537 INFO:tasks.workunit.client.1.smithi190.stdout:9/169: chown d4/d27/d2f/d31/c2a 0 1 2023-12-06T15:00:20.539 INFO:tasks.workunit.client.1.smithi190.stdout:5/134: link d0/lc d0/d12/l25 0 2023-12-06T15:00:20.539 INFO:tasks.workunit.client.1.smithi190.stdout:6/129: dwrite d4/fd [4194304,4194304] 0 2023-12-06T15:00:20.540 INFO:tasks.workunit.client.1.smithi190.stdout:3/256: dread d4/d1b/f21 [0,4194304] 0 2023-12-06T15:00:20.540 INFO:tasks.workunit.client.1.smithi190.stdout:3/257: truncate d4/d15/d19/f57 345538 0 2023-12-06T15:00:20.540 INFO:tasks.workunit.client.1.smithi190.stdout:4/140: mkdir d3/d13/d19/d30 0 2023-12-06T15:00:20.541 INFO:tasks.workunit.client.1.smithi190.stdout:7/142: dread d0/d5/f8 [0,4194304] 0 2023-12-06T15:00:20.541 INFO:tasks.workunit.client.1.smithi190.stdout:1/289: creat d6/dc/f51 x:0 0 0 2023-12-06T15:00:20.541 INFO:tasks.workunit.client.1.smithi190.stdout:9/170: mknod d4/d27/d2f/d31/c3b 0 2023-12-06T15:00:20.543 INFO:tasks.workunit.client.1.smithi190.stdout:5/135: unlink d0/c1e 0 2023-12-06T15:00:20.543 INFO:tasks.workunit.client.0.smithi152.stdout:4/129: dwrite d2/d22/f18 [0,4194304] 0 2023-12-06T15:00:20.543 INFO:tasks.workunit.client.0.smithi152.stdout:4/130: readlink d2/l4 0 2023-12-06T15:00:20.546 INFO:tasks.workunit.client.1.smithi190.stdout:3/258: symlink d4/d15/d19/d51/l5a 0 2023-12-06T15:00:20.546 INFO:tasks.workunit.client.1.smithi190.stdout:3/259: readlink d4/d15/d19/d3a/l4c 0 2023-12-06T15:00:20.546 INFO:tasks.workunit.client.1.smithi190.stdout:6/130: mknod d4/d12/c22 0 2023-12-06T15:00:20.546 INFO:tasks.workunit.client.1.smithi190.stdout:3/260: dread - d4/d15/d33/d45/f59 zero size 2023-12-06T15:00:20.546 INFO:tasks.workunit.client.1.smithi190.stdout:6/131: chown d4/d12/d1a/f1f 89693559 1 2023-12-06T15:00:20.546 INFO:tasks.workunit.client.1.smithi190.stdout:6/132: read - d4/d12/d1a/f1f zero size 2023-12-06T15:00:20.546 INFO:tasks.workunit.client.1.smithi190.stdout:6/133: readlink l2 0 2023-12-06T15:00:20.546 INFO:tasks.workunit.client.1.smithi190.stdout:2/182: dwrite d10/d26/f34 [0,4194304] 0 2023-12-06T15:00:20.547 INFO:tasks.workunit.client.1.smithi190.stdout:4/141: unlink d3/f7 0 2023-12-06T15:00:20.547 INFO:tasks.workunit.client.1.smithi190.stdout:4/142: chown d3/f9 5585994 1 2023-12-06T15:00:20.549 INFO:tasks.workunit.client.0.smithi152.stdout:3/42: dwrite f6 [0,4194304] 0 2023-12-06T15:00:20.549 INFO:tasks.workunit.client.1.smithi190.stdout:1/290: getdents d6/dc/d29/d38/d43 0 2023-12-06T15:00:20.551 INFO:tasks.workunit.client.1.smithi190.stdout:9/171: symlink d4/d27/d2f/d31/l3c 0 2023-12-06T15:00:20.551 INFO:tasks.workunit.client.1.smithi190.stdout:9/172: truncate d4/f39 192163 0 2023-12-06T15:00:20.553 INFO:tasks.workunit.client.0.smithi152.stdout:3/43: symlink d9/lc 0 2023-12-06T15:00:20.554 INFO:tasks.workunit.client.1.smithi190.stdout:6/134: write d4/fd [68872,75405] 0 2023-12-06T15:00:20.555 INFO:tasks.workunit.client.0.smithi152.stdout:3/44: mkdir d9/dd 0 2023-12-06T15:00:20.569 INFO:tasks.workunit.client.1.smithi190.stdout:3/261: rmdir d4/d15/d19/d3a/d3b/d50 0 2023-12-06T15:00:20.570 INFO:tasks.workunit.client.1.smithi190.stdout:3/262: readlink d4/d15/d19/d51/l5a 0 2023-12-06T15:00:20.574 INFO:tasks.workunit.client.1.smithi190.stdout:1/291: rename d6/dc/d29/d34/l36 to d6/dc/d3b/l52 0 2023-12-06T15:00:20.578 INFO:tasks.workunit.client.1.smithi190.stdout:3/263: truncate d4/d15/d33/d36/f4f 1517985 0 2023-12-06T15:00:20.580 INFO:tasks.workunit.client.0.smithi152.stdout:6/101: dwrite d1/d5/f14 [0,4194304] 0 2023-12-06T15:00:20.580 INFO:tasks.workunit.client.0.smithi152.stdout:1/114: dwrite d3/f30 [0,4194304] 0 2023-12-06T15:00:20.581 INFO:tasks.workunit.client.1.smithi190.stdout:3/264: creat d4/d15/d33/d45/f5b x:0 0 0 2023-12-06T15:00:20.581 INFO:tasks.workunit.client.1.smithi190.stdout:8/118: write d1/f16 [4764766,118353] 0 2023-12-06T15:00:20.581 INFO:tasks.workunit.client.1.smithi190.stdout:8/119: rename d1/d10 to d1/d10/d1d/d26 22 2023-12-06T15:00:20.581 INFO:tasks.workunit.client.1.smithi190.stdout:8/120: stat d1/d10/d1c/f22 0 2023-12-06T15:00:20.581 INFO:tasks.workunit.client.1.smithi190.stdout:3/265: link d4/f5 d4/d15/d19/d1c/d3d/f5c 0 2023-12-06T15:00:20.582 INFO:tasks.workunit.client.1.smithi190.stdout:7/143: dwrite d0/d5/d1b/d1c/f28 [0,4194304] 0 2023-12-06T15:00:20.582 INFO:tasks.workunit.client.1.smithi190.stdout:5/136: dwrite d0/f24 [0,4194304] 0 2023-12-06T15:00:20.582 INFO:tasks.workunit.client.1.smithi190.stdout:2/183: dwrite d10/f2d [0,4194304] 0 2023-12-06T15:00:20.583 INFO:tasks.workunit.client.0.smithi152.stdout:6/102: creat d1/d5/dd/d18/f28 x:0 0 0 2023-12-06T15:00:20.583 INFO:tasks.workunit.client.0.smithi152.stdout:3/45: dwrite f3 [0,4194304] 0 2023-12-06T15:00:20.584 INFO:tasks.workunit.client.1.smithi190.stdout:8/121: symlink d1/d20/l27 0 2023-12-06T15:00:20.584 INFO:tasks.workunit.client.0.smithi152.stdout:4/131: truncate d2/d22/f18 838017 0 2023-12-06T15:00:20.587 INFO:tasks.workunit.client.0.smithi152.stdout:1/115: creat d3/da/f32 x:0 0 0 2023-12-06T15:00:20.587 INFO:tasks.workunit.client.1.smithi190.stdout:3/266: mkdir d4/d1b/d5d 0 2023-12-06T15:00:20.588 INFO:tasks.workunit.client.0.smithi152.stdout:3/46: rename d9/lc to d9/le 0 2023-12-06T15:00:20.590 INFO:tasks.workunit.client.1.smithi190.stdout:7/144: creat d0/df/d1f/f29 x:0 0 0 2023-12-06T15:00:20.594 INFO:tasks.workunit.client.0.smithi152.stdout:5/57: truncate f5 1308614 0 2023-12-06T15:00:20.594 INFO:tasks.workunit.client.0.smithi152.stdout:5/58: readlink l4 0 2023-12-06T15:00:20.594 INFO:tasks.workunit.client.0.smithi152.stdout:4/132: dread d2/f9 [0,4194304] 0 2023-12-06T15:00:20.595 INFO:tasks.workunit.client.1.smithi190.stdout:5/137: symlink d0/d12/l26 0 2023-12-06T15:00:20.595 INFO:tasks.workunit.client.0.smithi152.stdout:5/59: creat d7/fc x:0 0 0 2023-12-06T15:00:20.595 INFO:tasks.workunit.client.1.smithi190.stdout:1/292: getdents d6/dc 0 2023-12-06T15:00:20.597 INFO:tasks.workunit.client.0.smithi152.stdout:4/133: link d2/c21 d2/d22/c28 0 2023-12-06T15:00:20.597 INFO:tasks.workunit.client.0.smithi152.stdout:4/134: chown d2/f1b 24 1 2023-12-06T15:00:20.597 INFO:tasks.workunit.client.0.smithi152.stdout:4/135: stat d2/d15/f19 0 2023-12-06T15:00:20.597 INFO:tasks.workunit.client.0.smithi152.stdout:4/136: truncate d2/fe 34901 0 2023-12-06T15:00:20.598 INFO:tasks.workunit.client.0.smithi152.stdout:3/47: dread f6 [0,4194304] 0 2023-12-06T15:00:20.599 INFO:tasks.workunit.client.0.smithi152.stdout:4/137: mkdir d2/d10/d27/d29 0 2023-12-06T15:00:20.600 INFO:tasks.workunit.client.1.smithi190.stdout:2/184: rename fe to d10/d31/d37/f41 0 2023-12-06T15:00:20.600 INFO:tasks.workunit.client.1.smithi190.stdout:6/135: getdents d4/d12 0 2023-12-06T15:00:20.601 INFO:tasks.workunit.client.1.smithi190.stdout:2/185: write d10/d11/f15 [26119,12160] 0 2023-12-06T15:00:20.601 INFO:tasks.workunit.client.1.smithi190.stdout:8/122: rmdir d1/d10 39 2023-12-06T15:00:20.601 INFO:tasks.workunit.client.1.smithi190.stdout:8/123: dread - d1/f1a zero size 2023-12-06T15:00:20.602 INFO:tasks.workunit.client.0.smithi152.stdout:3/48: rmdir d9/dd 0 2023-12-06T15:00:20.602 INFO:tasks.workunit.client.0.smithi152.stdout:4/138: rename d2/f1a to d2/d10/f2a 0 2023-12-06T15:00:20.605 INFO:tasks.workunit.client.1.smithi190.stdout:7/145: mknod d0/d5/d1b/d1c/c2a 0 2023-12-06T15:00:20.605 INFO:tasks.workunit.client.1.smithi190.stdout:7/146: dread - d0/df/d1f/f29 zero size 2023-12-06T15:00:20.607 INFO:tasks.workunit.client.1.smithi190.stdout:5/138: creat d0/df/f27 x:0 0 0 2023-12-06T15:00:20.608 INFO:tasks.workunit.client.1.smithi190.stdout:6/136: mkdir d4/d15/d23 0 2023-12-06T15:00:20.609 INFO:tasks.workunit.client.1.smithi190.stdout:6/137: chown d4/d12/c22 37559517 1 2023-12-06T15:00:20.610 INFO:tasks.workunit.client.1.smithi190.stdout:2/186: mkdir d10/d31/d42 0 2023-12-06T15:00:20.610 INFO:tasks.workunit.client.1.smithi190.stdout:2/187: fsync d10/f1f 0 2023-12-06T15:00:20.611 INFO:tasks.workunit.client.1.smithi190.stdout:8/124: mknod d1/d10/d25/c28 0 2023-12-06T15:00:20.611 INFO:tasks.workunit.client.1.smithi190.stdout:8/125: chown d1/d10/d1c 3 1 2023-12-06T15:00:20.611 INFO:tasks.workunit.client.0.smithi152.stdout:6/103: dwrite d1/f25 [0,4194304] 0 2023-12-06T15:00:20.611 INFO:tasks.workunit.client.0.smithi152.stdout:6/104: fdatasync d1/f7 0 2023-12-06T15:00:20.611 INFO:tasks.workunit.client.0.smithi152.stdout:6/105: stat d1/d5 0 2023-12-06T15:00:20.613 INFO:tasks.workunit.client.0.smithi152.stdout:4/139: dread d2/f8 [0,4194304] 0 2023-12-06T15:00:20.613 INFO:tasks.workunit.client.0.smithi152.stdout:4/140: chown d2/d15 52 1 2023-12-06T15:00:20.613 INFO:tasks.workunit.client.0.smithi152.stdout:5/60: fsync f6 0 2023-12-06T15:00:20.613 INFO:tasks.workunit.client.0.smithi152.stdout:5/61: dread - d7/fa zero size 2023-12-06T15:00:20.614 INFO:tasks.workunit.client.0.smithi152.stdout:6/106: symlink d1/l29 0 2023-12-06T15:00:20.615 INFO:tasks.workunit.client.1.smithi190.stdout:5/139: dread d0/f1 [0,4194304] 0 2023-12-06T15:00:20.615 INFO:tasks.workunit.client.1.smithi190.stdout:7/147: symlink d0/l2b 0 2023-12-06T15:00:20.615 INFO:tasks.workunit.client.1.smithi190.stdout:5/140: fsync d0/df/f17 0 2023-12-06T15:00:20.615 INFO:tasks.workunit.client.1.smithi190.stdout:5/141: write d0/f18 [1143520,112854] 0 2023-12-06T15:00:20.615 INFO:tasks.workunit.client.1.smithi190.stdout:3/267: rmdir d4/d15/d19/d3a/d3b 39 2023-12-06T15:00:20.616 INFO:tasks.workunit.client.0.smithi152.stdout:1/116: dwrite d3/f30 [0,4194304] 0 2023-12-06T15:00:20.619 INFO:tasks.workunit.client.0.smithi152.stdout:5/62: dread f6 [0,4194304] 0 2023-12-06T15:00:20.619 INFO:tasks.workunit.client.1.smithi190.stdout:6/138: rmdir d4/d15/d23 0 2023-12-06T15:00:20.621 INFO:tasks.workunit.client.1.smithi190.stdout:2/188: creat d10/d31/f43 x:0 0 0 2023-12-06T15:00:20.624 INFO:tasks.workunit.client.1.smithi190.stdout:8/126: creat d1/d10/f29 x:0 0 0 2023-12-06T15:00:20.627 INFO:tasks.workunit.client.1.smithi190.stdout:7/148: mknod d0/d5/d1b/c2c 0 2023-12-06T15:00:20.627 INFO:tasks.workunit.client.1.smithi190.stdout:7/149: write d0/d5/da/fb [1823769,24251] 0 2023-12-06T15:00:20.629 INFO:tasks.workunit.client.1.smithi190.stdout:3/268: link d4/d1b/c28 d4/d1b/d54/c5e 0 2023-12-06T15:00:20.629 INFO:tasks.workunit.client.1.smithi190.stdout:3/269: chown d4/l7 0 1 2023-12-06T15:00:20.630 INFO:tasks.workunit.client.1.smithi190.stdout:6/139: dread d4/fd [4194304,4194304] 0 2023-12-06T15:00:20.630 INFO:tasks.workunit.client.1.smithi190.stdout:2/189: creat d10/d31/d42/f44 x:0 0 0 2023-12-06T15:00:20.631 INFO:tasks.workunit.client.1.smithi190.stdout:3/270: truncate d4/d15/d33/f39 112627 0 2023-12-06T15:00:20.634 INFO:tasks.workunit.client.1.smithi190.stdout:6/140: truncate d4/d12/f21 733457 0 2023-12-06T15:00:20.634 INFO:tasks.workunit.client.1.smithi190.stdout:6/141: truncate d4/d12/d1a/f20 795176 0 2023-12-06T15:00:20.636 INFO:tasks.workunit.client.1.smithi190.stdout:2/190: link d10/d11/f24 d10/d31/f45 0 2023-12-06T15:00:20.638 INFO:tasks.workunit.client.1.smithi190.stdout:3/271: rename d4/f14 to d4/d15/d19/d51/f5f 0 2023-12-06T15:00:20.638 INFO:tasks.workunit.client.1.smithi190.stdout:5/142: dwrite d0/f6 [0,4194304] 0 2023-12-06T15:00:20.639 INFO:tasks.workunit.client.1.smithi190.stdout:2/191: unlink d10/c22 0 2023-12-06T15:00:20.639 INFO:tasks.workunit.client.1.smithi190.stdout:2/192: truncate d10/d31/d42/f44 586831 0 2023-12-06T15:00:20.640 INFO:tasks.workunit.client.0.smithi152.stdout:4/141: dwrite d2/fd [0,4194304] 0 2023-12-06T15:00:20.640 INFO:tasks.workunit.client.0.smithi152.stdout:4/142: fdatasync d2/d15/f19 0 2023-12-06T15:00:20.641 INFO:tasks.workunit.client.0.smithi152.stdout:4/143: write d2/d10/f2a [762674,50527] 0 2023-12-06T15:00:20.641 INFO:tasks.workunit.client.0.smithi152.stdout:4/144: chown d2/c3 474 1 2023-12-06T15:00:20.642 INFO:tasks.workunit.client.0.smithi152.stdout:4/145: dread d2/fe [0,4194304] 0 2023-12-06T15:00:20.643 INFO:tasks.workunit.client.0.smithi152.stdout:4/146: dread d2/f1f [0,4194304] 0 2023-12-06T15:00:20.643 INFO:tasks.workunit.client.0.smithi152.stdout:4/147: fsync d2/fa 0 2023-12-06T15:00:20.644 INFO:tasks.workunit.client.1.smithi190.stdout:2/193: truncate d10/d11/f25 2539844 0 2023-12-06T15:00:20.644 INFO:tasks.workunit.client.1.smithi190.stdout:2/194: truncate d10/f1f 718391 0 2023-12-06T15:00:20.645 INFO:tasks.workunit.client.1.smithi190.stdout:2/195: dread d10/d31/d42/f44 [0,4194304] 0 2023-12-06T15:00:20.647 INFO:tasks.workunit.client.1.smithi190.stdout:2/196: creat d10/d31/d37/f46 x:0 0 0 2023-12-06T15:00:20.647 INFO:tasks.workunit.client.1.smithi190.stdout:2/197: fdatasync d10/d11/f2b 0 2023-12-06T15:00:20.648 INFO:tasks.workunit.client.0.smithi152.stdout:6/107: creat d1/d5/dd/d18/f2a x:0 0 0 2023-12-06T15:00:20.648 INFO:tasks.workunit.client.1.smithi190.stdout:5/143: rmdir d0 39 2023-12-06T15:00:20.648 INFO:tasks.workunit.client.1.smithi190.stdout:8/127: dwrite d1/d10/d1c/f1f [0,4194304] 0 2023-12-06T15:00:20.649 INFO:tasks.workunit.client.0.smithi152.stdout:1/117: mknod d3/da/d15/c33 0 2023-12-06T15:00:20.649 INFO:tasks.workunit.client.0.smithi152.stdout:1/118: fsync d3/da/db/d18/f31 0 2023-12-06T15:00:20.650 INFO:tasks.workunit.client.0.smithi152.stdout:5/63: mkdir d7/dd 0 2023-12-06T15:00:20.654 INFO:tasks.workunit.client.1.smithi190.stdout:2/198: creat d10/d11/f47 x:0 0 0 2023-12-06T15:00:20.656 INFO:tasks.workunit.client.0.smithi152.stdout:4/148: unlink d2/c3 0 2023-12-06T15:00:20.656 INFO:tasks.workunit.client.0.smithi152.stdout:6/108: symlink d1/d5/dd/l2b 0 2023-12-06T15:00:20.657 INFO:tasks.workunit.client.0.smithi152.stdout:5/64: creat d7/fe x:0 0 0 2023-12-06T15:00:20.657 INFO:tasks.workunit.client.0.smithi152.stdout:6/109: creat d1/f2c x:0 0 0 2023-12-06T15:00:20.658 INFO:tasks.workunit.client.1.smithi190.stdout:5/144: rename d0/df/f10 to d0/f28 0 2023-12-06T15:00:20.659 INFO:tasks.workunit.client.0.smithi152.stdout:5/65: link d7/fe d7/dd/ff 0 2023-12-06T15:00:20.662 INFO:tasks.workunit.client.0.smithi152.stdout:5/66: symlink d7/dd/l10 0 2023-12-06T15:00:20.662 INFO:tasks.workunit.client.0.smithi152.stdout:5/67: read - d7/fa zero size 2023-12-06T15:00:20.663 INFO:tasks.workunit.client.1.smithi190.stdout:5/145: dread d0/fd [0,4194304] 0 2023-12-06T15:00:20.663 INFO:tasks.workunit.client.1.smithi190.stdout:3/272: dwrite d4/d15/d19/d1c/d3d/f43 [0,4194304] 0 2023-12-06T15:00:20.664 INFO:tasks.workunit.client.0.smithi152.stdout:5/68: symlink d7/dd/l11 0 2023-12-06T15:00:20.666 INFO:tasks.workunit.client.0.smithi152.stdout:5/69: link f6 d7/dd/f12 0 2023-12-06T15:00:20.666 INFO:tasks.workunit.client.0.smithi152.stdout:5/70: truncate d7/fa 803237 0 2023-12-06T15:00:20.667 INFO:tasks.workunit.client.0.smithi152.stdout:4/149: dread d2/f9 [0,4194304] 0 2023-12-06T15:00:20.667 INFO:tasks.workunit.client.0.smithi152.stdout:4/150: dread - d2/f26 zero size 2023-12-06T15:00:20.667 INFO:tasks.workunit.client.0.smithi152.stdout:4/151: stat d2/d10/d27 0 2023-12-06T15:00:20.667 INFO:tasks.workunit.client.0.smithi152.stdout:5/71: rename d7/fa to d7/f13 0 2023-12-06T15:00:20.667 INFO:tasks.workunit.client.0.smithi152.stdout:5/72: dread - d7/fc zero size 2023-12-06T15:00:20.667 INFO:tasks.workunit.client.1.smithi190.stdout:2/199: link c1 d10/d31/d37/c48 0 2023-12-06T15:00:20.673 INFO:tasks.workunit.client.1.smithi190.stdout:5/146: unlink d0/f1 0 2023-12-06T15:00:20.673 INFO:tasks.workunit.client.1.smithi190.stdout:5/147: chown d0/df 35482 1 2023-12-06T15:00:20.673 INFO:tasks.workunit.client.1.smithi190.stdout:2/200: write f3 [1882165,83568] 0 2023-12-06T15:00:20.674 INFO:tasks.workunit.client.1.smithi190.stdout:5/148: write d0/f6 [3861531,44355] 0 2023-12-06T15:00:20.675 INFO:tasks.workunit.client.1.smithi190.stdout:3/273: creat d4/d1b/d54/f60 x:0 0 0 2023-12-06T15:00:20.677 INFO:tasks.workunit.client.1.smithi190.stdout:2/201: mkdir d10/d31/d49 0 2023-12-06T15:00:20.677 INFO:tasks.workunit.client.1.smithi190.stdout:2/202: write d10/f39 [280488,106383] 0 2023-12-06T15:00:20.680 INFO:tasks.workunit.client.0.smithi152.stdout:5/73: rename d7/f13 to d7/dd/f14 0 2023-12-06T15:00:20.681 INFO:tasks.workunit.client.0.smithi152.stdout:5/74: creat d7/f15 x:0 0 0 2023-12-06T15:00:20.682 INFO:tasks.workunit.client.1.smithi190.stdout:3/274: unlink d4/f9 0 2023-12-06T15:00:20.685 INFO:tasks.workunit.client.0.smithi152.stdout:4/152: dread d2/fc [0,4194304] 0 2023-12-06T15:00:20.685 INFO:tasks.workunit.client.0.smithi152.stdout:4/153: fdatasync d2/fc 0 2023-12-06T15:00:20.685 INFO:tasks.workunit.client.0.smithi152.stdout:4/154: chown d2/d10/f17 248528 1 2023-12-06T15:00:20.685 INFO:tasks.workunit.client.0.smithi152.stdout:4/155: dread - d2/f26 zero size 2023-12-06T15:00:20.687 INFO:tasks.workunit.client.1.smithi190.stdout:3/275: link d4/l2e d4/d15/l61 0 2023-12-06T15:00:20.688 INFO:tasks.workunit.client.1.smithi190.stdout:8/128: dwrite d1/d10/d1c/f22 [0,4194304] 0 2023-12-06T15:00:20.689 INFO:tasks.workunit.client.1.smithi190.stdout:0/143: sync 2023-12-06T15:00:20.691 INFO:tasks.workunit.client.0.smithi152.stdout:0/71: sync 2023-12-06T15:00:20.691 INFO:tasks.workunit.client.1.smithi190.stdout:3/276: write d4/d1b/f37 [331841,69982] 0 2023-12-06T15:00:20.692 INFO:tasks.workunit.client.1.smithi190.stdout:3/277: write d4/fc [1824500,34530] 0 2023-12-06T15:00:20.692 INFO:tasks.workunit.client.1.smithi190.stdout:0/144: write d0/d4/f24 [2202717,80661] 0 2023-12-06T15:00:20.696 INFO:tasks.workunit.client.0.smithi152.stdout:0/72: unlink f4 0 2023-12-06T15:00:20.696 INFO:tasks.workunit.client.0.smithi152.stdout:0/73: chown d8/fa 871738405 1 2023-12-06T15:00:20.696 INFO:tasks.workunit.client.1.smithi190.stdout:3/278: creat d4/d1b/f62 x:0 0 0 2023-12-06T15:00:20.697 INFO:tasks.workunit.client.1.smithi190.stdout:3/279: write d4/d15/d19/d51/f5f [387799,55015] 0 2023-12-06T15:00:20.697 INFO:tasks.workunit.client.1.smithi190.stdout:0/145: truncate d0/f18 1455268 0 2023-12-06T15:00:20.697 INFO:tasks.workunit.client.1.smithi190.stdout:3/280: mknod d4/d15/d19/d1c/d3d/c63 0 2023-12-06T15:00:20.698 INFO:tasks.workunit.client.1.smithi190.stdout:0/146: creat d0/d4/f26 x:0 0 0 2023-12-06T15:00:20.699 INFO:tasks.workunit.client.1.smithi190.stdout:6/142: write d4/fe [151894,102093] 0 2023-12-06T15:00:20.699 INFO:tasks.workunit.client.1.smithi190.stdout:6/143: read - d4/d12/d1a/f1f zero size 2023-12-06T15:00:20.700 INFO:tasks.workunit.client.1.smithi190.stdout:6/144: readlink d4/d12/d1a/l1b 0 2023-12-06T15:00:20.700 INFO:tasks.workunit.client.1.smithi190.stdout:6/145: rename d4 to d4/d12/d24 22 2023-12-06T15:00:20.700 INFO:tasks.workunit.client.1.smithi190.stdout:3/281: link d4/d15/d19/f3f d4/d1b/f64 0 2023-12-06T15:00:20.700 INFO:tasks.workunit.client.1.smithi190.stdout:3/282: chown d4/d15/c26 44331754 1 2023-12-06T15:00:20.701 INFO:tasks.workunit.client.1.smithi190.stdout:0/147: truncate d0/d4/f21 507202 0 2023-12-06T15:00:20.701 INFO:tasks.workunit.client.1.smithi190.stdout:0/148: write d0/d4/f16 [4560835,126802] 0 2023-12-06T15:00:20.701 INFO:tasks.workunit.client.1.smithi190.stdout:0/149: write d0/da/f22 [682613,125433] 0 2023-12-06T15:00:20.702 INFO:tasks.workunit.client.1.smithi190.stdout:0/150: write d0/d4/f24 [3551925,86168] 0 2023-12-06T15:00:20.704 INFO:tasks.workunit.client.1.smithi190.stdout:6/146: rmdir d4 39 2023-12-06T15:00:20.704 INFO:tasks.workunit.client.1.smithi190.stdout:6/147: truncate d4/fc 4971780 0 2023-12-06T15:00:20.705 INFO:tasks.workunit.client.1.smithi190.stdout:8/129: dread d1/f19 [0,4194304] 0 2023-12-06T15:00:20.706 INFO:tasks.workunit.client.1.smithi190.stdout:8/130: truncate d1/f19 708289 0 2023-12-06T15:00:20.710 INFO:tasks.workunit.client.1.smithi190.stdout:8/131: creat d1/d10/d25/f2a x:0 0 0 2023-12-06T15:00:20.711 INFO:tasks.workunit.client.0.smithi152.stdout:1/119: dwrite d3/da/d15/f1d [0,4194304] 0 2023-12-06T15:00:20.711 INFO:tasks.workunit.client.0.smithi152.stdout:0/74: dread d8/f9 [0,4194304] 0 2023-12-06T15:00:20.711 INFO:tasks.workunit.client.0.smithi152.stdout:0/75: readlink d8/le 0 2023-12-06T15:00:20.713 INFO:tasks.workunit.client.0.smithi152.stdout:1/120: rmdir d3/da 39 2023-12-06T15:00:20.713 INFO:tasks.workunit.client.0.smithi152.stdout:1/121: chown d3/da/d15/d17/f1f 10558 1 2023-12-06T15:00:20.714 INFO:tasks.workunit.client.1.smithi190.stdout:8/132: mknod d1/d10/d25/c2b 0 2023-12-06T15:00:20.714 INFO:tasks.workunit.client.0.smithi152.stdout:1/122: creat d3/da/d15/d17/f34 x:0 0 0 2023-12-06T15:00:20.714 INFO:tasks.workunit.client.1.smithi190.stdout:5/149: dwrite d0/df/f1a [0,4194304] 0 2023-12-06T15:00:20.715 INFO:tasks.workunit.client.1.smithi190.stdout:0/151: write d0/d4/f16 [784517,68082] 0 2023-12-06T15:00:20.716 INFO:tasks.workunit.client.1.smithi190.stdout:5/150: mknod d0/d1c/c29 0 2023-12-06T15:00:20.717 INFO:tasks.workunit.client.1.smithi190.stdout:0/152: getdents d0 0 2023-12-06T15:00:20.719 INFO:tasks.workunit.client.1.smithi190.stdout:5/151: write d0/df/f1a [1750518,48103] 0 2023-12-06T15:00:20.721 INFO:tasks.workunit.client.1.smithi190.stdout:2/203: dwrite d10/d26/f32 [0,4194304] 0 2023-12-06T15:00:20.722 INFO:tasks.workunit.client.1.smithi190.stdout:5/152: creat d0/f2a x:0 0 0 2023-12-06T15:00:20.723 INFO:tasks.workunit.client.0.smithi152.stdout:6/110: dwrite d1/f25 [4194304,4194304] 0 2023-12-06T15:00:20.724 INFO:tasks.workunit.client.0.smithi152.stdout:6/111: chown d1/d5/dd/d18/l1b 5539 1 2023-12-06T15:00:20.724 INFO:tasks.workunit.client.0.smithi152.stdout:6/112: write d1/f7 [1443081,98825] 0 2023-12-06T15:00:20.724 INFO:tasks.workunit.client.1.smithi190.stdout:3/283: dwrite d4/d1b/f38 [0,4194304] 0 2023-12-06T15:00:20.725 INFO:tasks.workunit.client.1.smithi190.stdout:5/153: dread d0/f18 [0,4194304] 0 2023-12-06T15:00:20.725 INFO:tasks.workunit.client.1.smithi190.stdout:5/154: write d0/df/f27 [1033470,12566] 0 2023-12-06T15:00:20.726 INFO:tasks.workunit.client.0.smithi152.stdout:0/76: dread d8/fb [0,4194304] 0 2023-12-06T15:00:20.726 INFO:tasks.workunit.client.0.smithi152.stdout:0/77: readlink d8/lc 0 2023-12-06T15:00:20.726 INFO:tasks.workunit.client.0.smithi152.stdout:4/156: dwrite d2/d10/f24 [0,4194304] 0 2023-12-06T15:00:20.726 INFO:tasks.workunit.client.0.smithi152.stdout:4/157: read - d2/f26 zero size 2023-12-06T15:00:20.727 INFO:tasks.workunit.client.0.smithi152.stdout:6/113: creat d1/d19/d1a/d23/d26/f2d x:0 0 0 2023-12-06T15:00:20.729 INFO:tasks.workunit.client.0.smithi152.stdout:6/114: creat d1/d19/d1a/d23/f2e x:0 0 0 2023-12-06T15:00:20.730 INFO:tasks.workunit.client.0.smithi152.stdout:4/158: link d2/d15/d23/l25 d2/d10/d27/l2b 0 2023-12-06T15:00:20.730 INFO:tasks.workunit.client.0.smithi152.stdout:4/159: fdatasync d2/f9 0 2023-12-06T15:00:20.731 INFO:tasks.workunit.client.1.smithi190.stdout:5/155: mkdir d0/d1c/d2b 0 2023-12-06T15:00:20.732 INFO:tasks.workunit.client.0.smithi152.stdout:6/115: write d1/d5/fa [3860134,68549] 0 2023-12-06T15:00:20.732 INFO:tasks.workunit.client.0.smithi152.stdout:6/116: fsync d1/d5/f9 0 2023-12-06T15:00:20.732 INFO:tasks.workunit.client.1.smithi190.stdout:2/204: dread d10/d11/f15 [0,4194304] 0 2023-12-06T15:00:20.733 INFO:tasks.workunit.client.1.smithi190.stdout:6/148: dread d4/d12/f21 [0,4194304] 0 2023-12-06T15:00:20.735 INFO:tasks.workunit.client.0.smithi152.stdout:6/117: getdents d1/d19/d1a 0 2023-12-06T15:00:20.735 INFO:tasks.workunit.client.0.smithi152.stdout:4/160: write d2/d22/f18 [159291,24198] 0 2023-12-06T15:00:20.735 INFO:tasks.workunit.client.1.smithi190.stdout:8/133: dread d1/f7 [0,4194304] 0 2023-12-06T15:00:20.735 INFO:tasks.workunit.client.0.smithi152.stdout:6/118: symlink d1/d5/dd/l2f 0 2023-12-06T15:00:20.736 INFO:tasks.workunit.client.1.smithi190.stdout:2/205: unlink d10/d11/f15 0 2023-12-06T15:00:20.738 INFO:tasks.workunit.client.0.smithi152.stdout:4/161: unlink d2/l11 0 2023-12-06T15:00:20.744 INFO:tasks.workunit.client.1.smithi190.stdout:6/149: creat d4/d12/d1a/f25 x:0 0 0 2023-12-06T15:00:20.744 INFO:tasks.workunit.client.1.smithi190.stdout:8/134: rmdir d1/d10/d1d 0 2023-12-06T15:00:20.744 INFO:tasks.workunit.client.1.smithi190.stdout:8/135: stat d1/d10/d1c/f22 0 2023-12-06T15:00:20.744 INFO:tasks.workunit.client.1.smithi190.stdout:8/136: readlink d1/l15 0 2023-12-06T15:00:20.744 INFO:tasks.workunit.client.1.smithi190.stdout:8/137: dread - d1/f1e zero size 2023-12-06T15:00:20.749 INFO:tasks.workunit.client.0.smithi152.stdout:0/78: dread d8/fa [4194304,4194304] 0 2023-12-06T15:00:20.754 INFO:tasks.workunit.client.0.smithi152.stdout:0/79: truncate d8/fa 4282058 0 2023-12-06T15:00:20.755 INFO:tasks.workunit.client.0.smithi152.stdout:1/123: dwrite d3/da/d15/f1e [0,4194304] 0 2023-12-06T15:00:20.755 INFO:tasks.workunit.client.0.smithi152.stdout:0/80: unlink d8/fb 0 2023-12-06T15:00:20.762 INFO:tasks.workunit.client.1.smithi190.stdout:8/138: dread d1/d10/d12/f18 [0,4194304] 0 2023-12-06T15:00:20.763 INFO:tasks.workunit.client.1.smithi190.stdout:8/139: unlink d1/d10/d1c/c24 0 2023-12-06T15:00:20.764 INFO:tasks.workunit.client.1.smithi190.stdout:8/140: truncate d1/d10/d1c/f22 3504755 0 2023-12-06T15:00:20.764 INFO:tasks.workunit.client.1.smithi190.stdout:8/141: chown d1/f1e 0 1 2023-12-06T15:00:20.764 INFO:tasks.workunit.client.1.smithi190.stdout:8/142: dread - d1/d10/d25/f2a zero size 2023-12-06T15:00:20.770 INFO:tasks.workunit.client.0.smithi152.stdout:0/81: creat d8/f13 x:0 0 0 2023-12-06T15:00:20.782 INFO:tasks.workunit.client.0.smithi152.stdout:1/124: dwrite d3/f1b [4194304,4194304] 0 2023-12-06T15:00:20.783 INFO:tasks.workunit.client.0.smithi152.stdout:1/125: getdents d3/da/d15/d17/d1a 0 2023-12-06T15:00:20.826 INFO:tasks.workunit.client.1.smithi190.stdout:3/284: dwrite d4/d15/d33/d36/f3c [0,4194304] 0 2023-12-06T15:00:20.826 INFO:tasks.workunit.client.1.smithi190.stdout:0/153: dwrite d0/d4/f26 [0,4194304] 0 2023-12-06T15:00:20.829 INFO:tasks.workunit.client.0.smithi152.stdout:6/119: rename d1/d5/dd to d1/d19/d1a/d30 0 2023-12-06T15:00:20.830 INFO:tasks.workunit.client.0.smithi152.stdout:4/162: rmdir d2 39 2023-12-06T15:00:20.831 INFO:tasks.workunit.client.1.smithi190.stdout:8/143: read d1/f19 [277772,72581] 0 2023-12-06T15:00:20.834 INFO:tasks.workunit.client.0.smithi152.stdout:6/120: rename d1/f25 to d1/d19/d1a/f31 0 2023-12-06T15:00:20.836 INFO:tasks.workunit.client.0.smithi152.stdout:4/163: creat d2/d10/d27/f2c x:0 0 0 2023-12-06T15:00:20.837 INFO:tasks.workunit.client.0.smithi152.stdout:6/121: getdents d1/d19 0 2023-12-06T15:00:20.844 INFO:tasks.workunit.client.1.smithi190.stdout:2/206: dwrite ff [0,4194304] 0 2023-12-06T15:00:20.847 INFO:tasks.workunit.client.1.smithi190.stdout:5/156: dwrite d0/f7 [0,4194304] 0 2023-12-06T15:00:20.847 INFO:tasks.workunit.client.1.smithi190.stdout:5/157: stat d0/df 0 2023-12-06T15:00:20.848 INFO:tasks.workunit.client.1.smithi190.stdout:0/154: rename d0/d4/c10 to d0/d4/c27 0 2023-12-06T15:00:20.854 INFO:tasks.workunit.client.1.smithi190.stdout:8/144: unlink d1/l13 0 2023-12-06T15:00:20.854 INFO:tasks.workunit.client.1.smithi190.stdout:8/145: chown d1/f19 1786578 1 2023-12-06T15:00:20.854 INFO:tasks.workunit.client.1.smithi190.stdout:6/150: dwrite d4/fd [8388608,4194304] 0 2023-12-06T15:00:20.854 INFO:tasks.workunit.client.0.smithi152.stdout:1/126: dwrite d3/fd [0,4194304] 0 2023-12-06T15:00:20.855 INFO:tasks.workunit.client.1.smithi190.stdout:3/285: dwrite d4/d15/d19/f57 [0,4194304] 0 2023-12-06T15:00:20.855 INFO:tasks.workunit.client.1.smithi190.stdout:2/207: symlink d10/d31/d49/l4a 0 2023-12-06T15:00:20.855 INFO:tasks.workunit.client.1.smithi190.stdout:6/151: write d4/fd [1255318,106249] 0 2023-12-06T15:00:20.856 INFO:tasks.workunit.client.1.smithi190.stdout:5/158: mkdir d0/d1c/d2b/d2c 0 2023-12-06T15:00:20.857 INFO:tasks.workunit.client.1.smithi190.stdout:0/155: rmdir d0/da 39 2023-12-06T15:00:20.860 INFO:tasks.workunit.client.0.smithi152.stdout:1/127: creat d3/da/f35 x:0 0 0 2023-12-06T15:00:20.863 INFO:tasks.workunit.client.0.smithi152.stdout:0/82: write d8/fd [2052462,62380] 0 2023-12-06T15:00:20.863 INFO:tasks.workunit.client.0.smithi152.stdout:0/83: write d8/f13 [225732,130592] 0 2023-12-06T15:00:20.863 INFO:tasks.workunit.client.0.smithi152.stdout:1/128: rename d3/da/d15/f1e to d3/da/f36 0 2023-12-06T15:00:20.863 INFO:tasks.workunit.client.0.smithi152.stdout:1/129: write d3/da/d15/d17/f2d [535348,37487] 0 2023-12-06T15:00:20.865 INFO:tasks.workunit.client.0.smithi152.stdout:1/130: symlink d3/da/db/d18/l37 0 2023-12-06T15:00:20.868 INFO:tasks.workunit.client.0.smithi152.stdout:1/131: rename d3/da/f32 to d3/da/d15/d17/d1a/f38 0 2023-12-06T15:00:20.869 INFO:tasks.workunit.client.1.smithi190.stdout:0/156: link d0/d4/f24 d0/d4/f28 0 2023-12-06T15:00:20.870 INFO:tasks.workunit.client.0.smithi152.stdout:1/132: unlink d3/da/d15/f29 0 2023-12-06T15:00:20.872 INFO:tasks.workunit.client.0.smithi152.stdout:1/133: rmdir d3/da/db/d18 39 2023-12-06T15:00:20.872 INFO:tasks.workunit.client.0.smithi152.stdout:1/134: readlink d3/da/db/l2e 0 2023-12-06T15:00:20.877 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:20 smithi152 ceph-mon[111954]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:00:20.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:20 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:20.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:20 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:20.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:20 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/2227027350' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-06T15:00:20.892 INFO:tasks.workunit.client.1.smithi190.stdout:9/173: sync 2023-12-06T15:00:20.893 INFO:tasks.workunit.client.1.smithi190.stdout:1/293: sync 2023-12-06T15:00:20.893 INFO:tasks.workunit.client.1.smithi190.stdout:4/143: sync 2023-12-06T15:00:20.893 INFO:tasks.workunit.client.1.smithi190.stdout:1/294: chown d6/dc/d29/d38/d43 21 1 2023-12-06T15:00:20.893 INFO:tasks.workunit.client.1.smithi190.stdout:7/150: sync 2023-12-06T15:00:20.893 INFO:tasks.workunit.client.1.smithi190.stdout:1/295: dread - d6/dc/d29/d34/f4e zero size 2023-12-06T15:00:20.893 INFO:tasks.workunit.client.1.smithi190.stdout:4/144: write d3/d10/d15/f23 [752183,51615] 0 2023-12-06T15:00:20.895 INFO:tasks.workunit.client.1.smithi190.stdout:3/286: dwrite d4/d15/d19/f3f [0,4194304] 0 2023-12-06T15:00:20.895 INFO:tasks.workunit.client.1.smithi190.stdout:5/159: dwrite d0/df/f27 [0,4194304] 0 2023-12-06T15:00:20.895 INFO:tasks.workunit.client.1.smithi190.stdout:9/174: creat d4/d27/d2f/f3d x:0 0 0 2023-12-06T15:00:20.895 INFO:tasks.workunit.client.1.smithi190.stdout:9/175: chown d4/f14 3604 1 2023-12-06T15:00:20.895 INFO:tasks.workunit.client.1.smithi190.stdout:9/176: chown d4/d27/d2f 809566027 1 2023-12-06T15:00:20.895 INFO:tasks.workunit.client.1.smithi190.stdout:6/152: dwrite d4/fc [4194304,4194304] 0 2023-12-06T15:00:20.895 INFO:tasks.workunit.client.1.smithi190.stdout:6/153: dread - d4/d12/d1a/f1f zero size 2023-12-06T15:00:20.895 INFO:tasks.workunit.client.1.smithi190.stdout:8/146: dread d1/d10/d12/f18 [0,4194304] 0 2023-12-06T15:00:20.896 INFO:tasks.workunit.client.0.smithi152.stdout:1/135: dwrite d3/fd [0,4194304] 0 2023-12-06T15:00:20.896 INFO:tasks.workunit.client.1.smithi190.stdout:0/157: dwrite d0/da/ff [0,4194304] 0 2023-12-06T15:00:20.896 INFO:tasks.workunit.client.1.smithi190.stdout:7/151: rename d0/df/c21 to d0/d5/da/c2d 0 2023-12-06T15:00:20.912 INFO:tasks.workunit.client.1.smithi190.stdout:5/160: link d0/f6 d0/df/f2d 0 2023-12-06T15:00:20.912 INFO:tasks.workunit.client.1.smithi190.stdout:6/154: creat d4/d15/f26 x:0 0 0 2023-12-06T15:00:20.912 INFO:tasks.workunit.client.1.smithi190.stdout:0/158: link d0/d4/f21 d0/da/f29 0 2023-12-06T15:00:20.912 INFO:tasks.workunit.client.1.smithi190.stdout:8/147: write d1/d10/d12/f18 [3678374,107694] 0 2023-12-06T15:00:20.913 INFO:tasks.workunit.client.1.smithi190.stdout:5/161: read d0/df/f27 [3279525,10937] 0 2023-12-06T15:00:20.913 INFO:tasks.workunit.client.1.smithi190.stdout:5/162: truncate d0/fd 1033172 0 2023-12-06T15:00:20.914 INFO:tasks.workunit.client.1.smithi190.stdout:9/177: rename d4/l19 to d4/d27/d2f/l3e 0 2023-12-06T15:00:20.914 INFO:tasks.workunit.client.1.smithi190.stdout:9/178: write d4/f24 [643238,102802] 0 2023-12-06T15:00:20.914 INFO:tasks.workunit.client.1.smithi190.stdout:9/179: truncate d4/f39 698615 0 2023-12-06T15:00:20.914 INFO:tasks.workunit.client.1.smithi190.stdout:9/180: fsync d4/f33 0 2023-12-06T15:00:20.914 INFO:tasks.workunit.client.1.smithi190.stdout:9/181: dread - d4/f22 zero size 2023-12-06T15:00:20.914 INFO:tasks.workunit.client.1.smithi190.stdout:9/182: dread - d4/d27/d2f/f3d zero size 2023-12-06T15:00:20.914 INFO:tasks.workunit.client.1.smithi190.stdout:9/183: stat d4/f17 0 2023-12-06T15:00:20.914 INFO:tasks.workunit.client.1.smithi190.stdout:9/184: readlink d4/l1e 0 2023-12-06T15:00:20.915 INFO:tasks.workunit.client.1.smithi190.stdout:8/148: write d1/d10/d12/f18 [58180,74025] 0 2023-12-06T15:00:20.916 INFO:tasks.workunit.client.1.smithi190.stdout:6/155: symlink d4/d12/d1a/l27 0 2023-12-06T15:00:20.918 INFO:tasks.workunit.client.1.smithi190.stdout:7/152: rename d0/d5/f9 to d0/d5/d1b/f2e 0 2023-12-06T15:00:20.919 INFO:tasks.workunit.client.1.smithi190.stdout:9/185: mkdir d4/d27/d2f/d31/d3f 0 2023-12-06T15:00:20.920 INFO:tasks.workunit.client.1.smithi190.stdout:6/156: creat d4/d12/d1a/f28 x:0 0 0 2023-12-06T15:00:20.920 INFO:tasks.workunit.client.1.smithi190.stdout:6/157: readlink d4/d12/d1a/l27 0 2023-12-06T15:00:20.921 INFO:tasks.workunit.client.1.smithi190.stdout:5/163: rename d0/f23 to d0/df/f2e 0 2023-12-06T15:00:20.922 INFO:tasks.workunit.client.1.smithi190.stdout:7/153: mkdir d0/df/d10/d2f 0 2023-12-06T15:00:20.923 INFO:tasks.workunit.client.1.smithi190.stdout:9/186: symlink d4/d27/d2f/d31/l40 0 2023-12-06T15:00:20.924 INFO:tasks.workunit.client.1.smithi190.stdout:6/158: symlink d4/l29 0 2023-12-06T15:00:20.925 INFO:tasks.workunit.client.1.smithi190.stdout:7/154: creat d0/f30 x:0 0 0 2023-12-06T15:00:20.927 INFO:tasks.workunit.client.1.smithi190.stdout:9/187: link d4/d27/d2f/f3d d4/d27/d2f/f41 0 2023-12-06T15:00:20.927 INFO:tasks.workunit.client.1.smithi190.stdout:9/188: write d4/f17 [743832,38809] 0 2023-12-06T15:00:20.928 INFO:tasks.workunit.client.1.smithi190.stdout:7/155: write d0/fc [220172,32579] 0 2023-12-06T15:00:20.928 INFO:tasks.workunit.client.1.smithi190.stdout:7/156: chown d0 277813 1 2023-12-06T15:00:20.928 INFO:tasks.workunit.client.1.smithi190.stdout:6/159: unlink d4/d12/f21 0 2023-12-06T15:00:20.929 INFO:tasks.workunit.client.1.smithi190.stdout:7/157: read d0/f6 [2831475,57997] 0 2023-12-06T15:00:20.929 INFO:tasks.workunit.client.1.smithi190.stdout:9/189: mknod d4/d27/d2f/c42 0 2023-12-06T15:00:20.929 INFO:tasks.workunit.client.1.smithi190.stdout:9/190: readlink d4/l1b 0 2023-12-06T15:00:20.929 INFO:tasks.workunit.client.1.smithi190.stdout:9/191: fsync d4/f33 0 2023-12-06T15:00:20.934 INFO:tasks.workunit.client.1.smithi190.stdout:5/164: write d0/fb [1862962,7861] 0 2023-12-06T15:00:20.935 INFO:tasks.workunit.client.1.smithi190.stdout:5/165: getdents d0/d1c/d2b 0 2023-12-06T15:00:20.937 INFO:tasks.workunit.client.1.smithi190.stdout:5/166: mknod d0/df/c2f 0 2023-12-06T15:00:20.938 INFO:tasks.workunit.client.1.smithi190.stdout:5/167: creat d0/df/f30 x:0 0 0 2023-12-06T15:00:20.939 INFO:tasks.workunit.client.1.smithi190.stdout:5/168: write d0/df/f17 [7774048,80213] 0 2023-12-06T15:00:20.945 INFO:tasks.workunit.client.1.smithi190.stdout:7/158: dread d0/d5/d1b/d1c/f28 [0,4194304] 0 2023-12-06T15:00:20.946 INFO:tasks.workunit.client.1.smithi190.stdout:5/169: dread d0/df/f27 [0,4194304] 0 2023-12-06T15:00:20.947 INFO:tasks.workunit.client.1.smithi190.stdout:5/170: mknod d0/d1c/d2b/d2c/c31 0 2023-12-06T15:00:20.947 INFO:tasks.workunit.client.1.smithi190.stdout:5/171: truncate d0/f7 5303570 0 2023-12-06T15:00:20.948 INFO:tasks.workunit.client.1.smithi190.stdout:1/296: dwrite d6/dc/f33 [0,4194304] 0 2023-12-06T15:00:20.948 INFO:tasks.workunit.client.1.smithi190.stdout:1/297: write d6/dc/d29/f47 [456261,43011] 0 2023-12-06T15:00:20.948 INFO:tasks.workunit.client.1.smithi190.stdout:5/172: creat d0/d1c/d2b/f32 x:0 0 0 2023-12-06T15:00:20.949 INFO:tasks.workunit.client.1.smithi190.stdout:4/145: dwrite d3/fb [0,4194304] 0 2023-12-06T15:00:20.949 INFO:tasks.workunit.client.1.smithi190.stdout:8/149: dwrite d1/f1b [0,4194304] 0 2023-12-06T15:00:20.949 INFO:tasks.workunit.client.0.smithi152.stdout:1/136: dwrite d3/da/d15/f20 [0,4194304] 0 2023-12-06T15:00:20.951 INFO:tasks.workunit.client.1.smithi190.stdout:1/298: unlink d6/dc/f1b 0 2023-12-06T15:00:20.951 INFO:tasks.workunit.client.1.smithi190.stdout:5/173: getdents d0/d12 0 2023-12-06T15:00:20.951 INFO:tasks.workunit.client.1.smithi190.stdout:5/174: fsync d0/d12/f15 0 2023-12-06T15:00:20.952 INFO:tasks.workunit.client.1.smithi190.stdout:9/192: dwrite d4/f11 [0,4194304] 0 2023-12-06T15:00:20.955 INFO:tasks.workunit.client.1.smithi190.stdout:8/150: fdatasync d1/f19 0 2023-12-06T15:00:20.956 INFO:tasks.workunit.client.1.smithi190.stdout:0/159: rmdir d0/d4 39 2023-12-06T15:00:20.960 INFO:tasks.workunit.client.1.smithi190.stdout:5/175: unlink d0/d12/c22 0 2023-12-06T15:00:20.961 INFO:tasks.workunit.client.1.smithi190.stdout:1/299: dread d6/f13 [0,4194304] 0 2023-12-06T15:00:20.961 INFO:tasks.workunit.client.1.smithi190.stdout:1/300: truncate d6/dc/d29/d38/d43/f4b 195854 0 2023-12-06T15:00:20.962 INFO:tasks.workunit.client.0.smithi152.stdout:1/137: rename d3/da/db/d18/l16 to d3/da/l39 0 2023-12-06T15:00:20.969 INFO:tasks.workunit.client.1.smithi190.stdout:9/193: rename d4/d27/d2f/f3d to d4/f43 0 2023-12-06T15:00:20.972 INFO:tasks.workunit.client.1.smithi190.stdout:8/151: symlink d1/d10/d1c/l2c 0 2023-12-06T15:00:20.972 INFO:tasks.workunit.client.1.smithi190.stdout:0/160: truncate d0/f11 3068399 0 2023-12-06T15:00:20.974 INFO:tasks.workunit.client.1.smithi190.stdout:5/176: link d0/f6 d0/d1c/f33 0 2023-12-06T15:00:20.975 INFO:tasks.workunit.client.1.smithi190.stdout:0/161: write d0/da/f29 [385849,38077] 0 2023-12-06T15:00:20.976 INFO:tasks.workunit.client.1.smithi190.stdout:1/301: rename d6/dc/d29/f2d to d6/dc/d29/f53 0 2023-12-06T15:00:20.977 INFO:tasks.workunit.client.1.smithi190.stdout:5/177: symlink d0/d12/l34 0 2023-12-06T15:00:20.977 INFO:tasks.workunit.client.1.smithi190.stdout:5/178: truncate d0/fd 1377359 0 2023-12-06T15:00:20.979 INFO:tasks.workunit.client.1.smithi190.stdout:6/160: getdents d4/d12 0 2023-12-06T15:00:20.979 INFO:tasks.workunit.client.1.smithi190.stdout:5/179: dread d0/f18 [0,4194304] 0 2023-12-06T15:00:20.979 INFO:tasks.workunit.client.1.smithi190.stdout:0/162: truncate d0/d4/f26 3373150 0 2023-12-06T15:00:20.982 INFO:tasks.workunit.client.1.smithi190.stdout:1/302: link d6/dc/f15 d6/dc/d3b/d4d/f54 0 2023-12-06T15:00:20.982 INFO:tasks.workunit.client.1.smithi190.stdout:1/303: chown d6/l30 0 1 2023-12-06T15:00:20.984 INFO:tasks.workunit.client.1.smithi190.stdout:7/159: dwrite d0/fc [0,4194304] 0 2023-12-06T15:00:20.987 INFO:tasks.workunit.client.0.smithi152.stdout:1/138: dwrite d3/f2b [0,4194304] 0 2023-12-06T15:00:20.987 INFO:tasks.workunit.client.0.smithi152.stdout:1/139: write d3/da/d15/d17/f34 [452755,12588] 0 2023-12-06T15:00:20.988 INFO:tasks.workunit.client.1.smithi190.stdout:1/304: link d6/dc/c16 d6/dc/d29/c55 0 2023-12-06T15:00:20.991 INFO:tasks.workunit.client.1.smithi190.stdout:1/305: symlink d6/d49/l56 0 2023-12-06T15:00:20.991 INFO:tasks.workunit.client.1.smithi190.stdout:7/160: dread d0/d5/f8 [0,4194304] 0 2023-12-06T15:00:20.991 INFO:tasks.workunit.client.1.smithi190.stdout:7/161: chown d0/df/d10/d15/l16 0 1 2023-12-06T15:00:20.993 INFO:tasks.workunit.client.1.smithi190.stdout:9/194: dwrite d4/f25 [0,4194304] 0 2023-12-06T15:00:20.995 INFO:tasks.workunit.client.1.smithi190.stdout:9/195: dread d4/f39 [0,4194304] 0 2023-12-06T15:00:20.996 INFO:tasks.workunit.client.1.smithi190.stdout:1/306: write d6/f12 [1782805,29895] 0 2023-12-06T15:00:21.000 INFO:tasks.workunit.client.0.smithi152.stdout:1/140: symlink d3/da/l3a 0 2023-12-06T15:00:21.001 INFO:tasks.workunit.client.0.smithi152.stdout:1/141: unlink d3/da/ce 0 2023-12-06T15:00:21.004 INFO:tasks.workunit.client.0.smithi152.stdout:1/142: symlink d3/da/l3b 0 2023-12-06T15:00:21.004 INFO:tasks.workunit.client.1.smithi190.stdout:5/180: rmdir d0/d12 39 2023-12-06T15:00:21.006 INFO:tasks.workunit.client.0.smithi152.stdout:1/143: truncate d3/da/db/ff 666722 0 2023-12-06T15:00:21.007 INFO:tasks.workunit.client.1.smithi190.stdout:9/196: dread d4/f14 [0,4194304] 0 2023-12-06T15:00:21.007 INFO:tasks.workunit.client.1.smithi190.stdout:9/197: chown f2 10924036 1 2023-12-06T15:00:21.007 INFO:tasks.workunit.client.1.smithi190.stdout:6/161: dwrite d4/fd [4194304,4194304] 0 2023-12-06T15:00:21.008 INFO:tasks.workunit.client.1.smithi190.stdout:5/181: rename d0/df/f2d to d0/d1c/f35 0 2023-12-06T15:00:21.008 INFO:tasks.workunit.client.0.smithi152.stdout:1/144: unlink d3/da/db/d18/l19 0 2023-12-06T15:00:21.008 INFO:tasks.workunit.client.0.smithi152.stdout:1/145: stat d3/da/db/f2c 0 2023-12-06T15:00:21.009 INFO:tasks.workunit.client.1.smithi190.stdout:6/162: symlink d4/d12/d1a/d1e/l2a 0 2023-12-06T15:00:21.010 INFO:tasks.workunit.client.1.smithi190.stdout:9/198: rename d4/d27/d2f/d31/c2a to d4/d27/c44 0 2023-12-06T15:00:21.011 INFO:tasks.workunit.client.1.smithi190.stdout:9/199: write d4/d27/d2f/f41 [850051,31705] 0 2023-12-06T15:00:21.011 INFO:tasks.workunit.client.1.smithi190.stdout:9/200: chown d4/c20 41439337 1 2023-12-06T15:00:21.012 INFO:tasks.workunit.client.1.smithi190.stdout:6/163: creat d4/f2b x:0 0 0 2023-12-06T15:00:21.013 INFO:tasks.workunit.client.1.smithi190.stdout:6/164: rmdir d4/d12/d1a/d1e 39 2023-12-06T15:00:21.014 INFO:tasks.workunit.client.1.smithi190.stdout:6/165: symlink d4/d12/d1a/l2c 0 2023-12-06T15:00:21.014 INFO:tasks.workunit.client.1.smithi190.stdout:6/166: write d4/d15/f26 [1036690,28123] 0 2023-12-06T15:00:21.014 INFO:tasks.workunit.client.1.smithi190.stdout:6/167: chown d4/d12/d1a/f1c 251197 1 2023-12-06T15:00:21.014 INFO:tasks.workunit.client.1.smithi190.stdout:6/168: write d4/d12/d1a/f20 [1389117,41210] 0 2023-12-06T15:00:21.020 INFO:tasks.workunit.client.0.smithi152.stdout:1/146: dread d3/f4 [0,4194304] 0 2023-12-06T15:00:21.020 INFO:tasks.workunit.client.0.smithi152.stdout:7/44: sync 2023-12-06T15:00:21.021 INFO:tasks.workunit.client.0.smithi152.stdout:7/45: mknod dd/ce 0 2023-12-06T15:00:21.021 INFO:tasks.workunit.client.0.smithi152.stdout:2/37: sync 2023-12-06T15:00:21.022 INFO:tasks.workunit.client.1.smithi190.stdout:7/162: dwrite d0/f6 [0,4194304] 0 2023-12-06T15:00:21.024 INFO:tasks.workunit.client.1.smithi190.stdout:1/307: dwrite d6/dc/d29/d38/d39/f3f [0,4194304] 0 2023-12-06T15:00:21.025 INFO:tasks.workunit.client.1.smithi190.stdout:0/163: dwrite d0/da/f29 [0,4194304] 0 2023-12-06T15:00:21.025 INFO:tasks.workunit.client.1.smithi190.stdout:0/164: fsync d0/da/f25 0 2023-12-06T15:00:21.025 INFO:tasks.workunit.client.1.smithi190.stdout:8/152: dwrite d1/d10/d1c/f22 [0,4194304] 0 2023-12-06T15:00:21.025 INFO:tasks.workunit.client.0.smithi152.stdout:7/46: chown l6 12688188 1 2023-12-06T15:00:21.025 INFO:tasks.workunit.client.0.smithi152.stdout:2/38: creat d6/f8 x:0 0 0 2023-12-06T15:00:21.026 INFO:tasks.workunit.client.1.smithi190.stdout:1/308: write d6/dc/ff [2590183,82959] 0 2023-12-06T15:00:21.026 INFO:tasks.workunit.client.1.smithi190.stdout:0/165: write d0/d4/f28 [2784786,127619] 0 2023-12-06T15:00:21.027 INFO:tasks.workunit.client.0.smithi152.stdout:1/147: rmdir d3/da/d2a 0 2023-12-06T15:00:21.028 INFO:tasks.workunit.client.0.smithi152.stdout:7/47: mkdir dd/df 0 2023-12-06T15:00:21.029 INFO:tasks.workunit.client.0.smithi152.stdout:7/48: readlink l6 0 2023-12-06T15:00:21.029 INFO:tasks.workunit.client.0.smithi152.stdout:2/39: write f5 [1593252,40393] 0 2023-12-06T15:00:21.030 INFO:tasks.workunit.client.0.smithi152.stdout:1/148: truncate d3/da/db/f27 97331 0 2023-12-06T15:00:21.031 INFO:tasks.workunit.client.0.smithi152.stdout:7/49: write f3 [57958,84076] 0 2023-12-06T15:00:21.032 INFO:tasks.workunit.client.0.smithi152.stdout:2/40: mknod d6/c9 0 2023-12-06T15:00:21.032 INFO:tasks.workunit.client.0.smithi152.stdout:2/41: fsync f1 0 2023-12-06T15:00:21.034 INFO:tasks.workunit.client.0.smithi152.stdout:1/149: rename d3/f1b to d3/da/d15/d17/f3c 0 2023-12-06T15:00:21.035 INFO:tasks.workunit.client.1.smithi190.stdout:9/201: dwrite d4/f39 [0,4194304] 0 2023-12-06T15:00:21.035 INFO:tasks.workunit.client.0.smithi152.stdout:1/150: fsync d3/da/d15/d17/f34 0 2023-12-06T15:00:21.037 INFO:tasks.workunit.client.0.smithi152.stdout:2/42: rename d6/d7 to d6/da 0 2023-12-06T15:00:21.038 INFO:tasks.workunit.client.0.smithi152.stdout:1/151: unlink d3/da/db/l2e 0 2023-12-06T15:00:21.039 INFO:tasks.workunit.client.0.smithi152.stdout:7/50: dread f1 [0,4194304] 0 2023-12-06T15:00:21.039 INFO:tasks.workunit.client.0.smithi152.stdout:7/51: fsync f1 0 2023-12-06T15:00:21.042 INFO:tasks.workunit.client.0.smithi152.stdout:9/103: sync 2023-12-06T15:00:21.042 INFO:tasks.workunit.client.0.smithi152.stdout:8/27: sync 2023-12-06T15:00:21.042 INFO:tasks.workunit.client.0.smithi152.stdout:9/104: read - d0/f1c zero size 2023-12-06T15:00:21.043 INFO:tasks.workunit.client.0.smithi152.stdout:7/52: mknod dd/c10 0 2023-12-06T15:00:21.043 INFO:tasks.workunit.client.0.smithi152.stdout:7/53: dread - f7 zero size 2023-12-06T15:00:21.043 INFO:tasks.workunit.client.0.smithi152.stdout:8/28: rmdir d1/d6 39 2023-12-06T15:00:21.044 INFO:tasks.workunit.client.0.smithi152.stdout:9/105: symlink d0/l1f 0 2023-12-06T15:00:21.046 INFO:tasks.workunit.client.0.smithi152.stdout:7/54: link f8 dd/f11 0 2023-12-06T15:00:21.046 INFO:tasks.workunit.client.0.smithi152.stdout:7/55: dread - f8 zero size 2023-12-06T15:00:21.048 INFO:tasks.workunit.client.0.smithi152.stdout:8/29: rename d1/f5 to d1/d6/d7/fa 0 2023-12-06T15:00:21.050 INFO:tasks.workunit.client.0.smithi152.stdout:7/56: symlink dd/l12 0 2023-12-06T15:00:21.053 INFO:tasks.workunit.client.0.smithi152.stdout:7/57: creat dd/f13 x:0 0 0 2023-12-06T15:00:21.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:20 smithi190 ceph-mon[121340]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:00:21.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:20 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:21.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:20 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:21.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:20 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/2227027350' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-06T15:00:21.152 INFO:tasks.workunit.client.1.smithi190.stdout:7/163: symlink d0/l31 0 2023-12-06T15:00:21.157 INFO:tasks.workunit.client.1.smithi190.stdout:8/153: creat d1/d10/d12/f2d x:0 0 0 2023-12-06T15:00:21.157 INFO:tasks.workunit.client.0.smithi152.stdout:9/106: dwrite d0/f19 [0,4194304] 0 2023-12-06T15:00:21.158 INFO:tasks.workunit.client.0.smithi152.stdout:7/58: getdents dd 0 2023-12-06T15:00:21.158 INFO:tasks.workunit.client.0.smithi152.stdout:1/152: dwrite d3/da/d15/d17/d1a/f38 [0,4194304] 0 2023-12-06T15:00:21.158 INFO:tasks.workunit.client.0.smithi152.stdout:1/153: fdatasync d3/da/d15/f20 0 2023-12-06T15:00:21.158 INFO:tasks.workunit.client.0.smithi152.stdout:1/154: chown d3/da/d15/d17/d1a/f38 1 1 2023-12-06T15:00:21.159 INFO:tasks.workunit.client.0.smithi152.stdout:9/107: read d0/dd/fe [3438225,13097] 0 2023-12-06T15:00:21.159 INFO:tasks.workunit.client.1.smithi190.stdout:0/166: symlink d0/da/d1a/l2a 0 2023-12-06T15:00:21.159 INFO:tasks.workunit.client.1.smithi190.stdout:0/167: chown d0/da/d1a/c1f 20321287 1 2023-12-06T15:00:21.159 INFO:tasks.workunit.client.1.smithi190.stdout:0/168: write d0/da/ff [4704754,19803] 0 2023-12-06T15:00:21.161 INFO:tasks.workunit.client.0.smithi152.stdout:7/59: truncate f1 541744 0 2023-12-06T15:00:21.161 INFO:tasks.workunit.client.0.smithi152.stdout:1/155: creat d3/da/d15/d17/f3d x:0 0 0 2023-12-06T15:00:21.161 INFO:tasks.workunit.client.0.smithi152.stdout:1/156: stat d3/fd 0 2023-12-06T15:00:21.161 INFO:tasks.workunit.client.0.smithi152.stdout:7/60: write fa [1019650,30807] 0 2023-12-06T15:00:21.161 INFO:tasks.workunit.client.0.smithi152.stdout:7/61: dread - fb zero size 2023-12-06T15:00:21.161 INFO:tasks.workunit.client.0.smithi152.stdout:7/62: chown dd 610208 1 2023-12-06T15:00:21.161 INFO:tasks.workunit.client.0.smithi152.stdout:7/63: readlink dd/l12 0 2023-12-06T15:00:21.162 INFO:tasks.workunit.client.0.smithi152.stdout:7/64: chown fb 185 1 2023-12-06T15:00:21.162 INFO:tasks.workunit.client.0.smithi152.stdout:9/108: dread d0/f15 [0,4194304] 0 2023-12-06T15:00:21.162 INFO:tasks.workunit.client.0.smithi152.stdout:7/65: rename dd/ce to dd/df/c14 0 2023-12-06T15:00:21.163 INFO:tasks.workunit.client.0.smithi152.stdout:1/157: write d3/f30 [4121860,72100] 0 2023-12-06T15:00:21.163 INFO:tasks.workunit.client.0.smithi152.stdout:7/66: creat dd/f15 x:0 0 0 2023-12-06T15:00:21.164 INFO:tasks.workunit.client.0.smithi152.stdout:7/67: stat f4 0 2023-12-06T15:00:21.164 INFO:tasks.workunit.client.1.smithi190.stdout:9/202: rename d4/l35 to d4/d27/d2f/d31/l45 0 2023-12-06T15:00:21.165 INFO:tasks.workunit.client.1.smithi190.stdout:7/164: mkdir d0/d5/d1b/d32 0 2023-12-06T15:00:21.165 INFO:tasks.workunit.client.1.smithi190.stdout:8/154: mknod d1/d10/d1c/c2e 0 2023-12-06T15:00:21.166 INFO:tasks.workunit.client.1.smithi190.stdout:8/155: write d1/f19 [1283746,121144] 0 2023-12-06T15:00:21.166 INFO:tasks.workunit.client.1.smithi190.stdout:0/169: mkdir d0/da/d1a/d2b 0 2023-12-06T15:00:21.169 INFO:tasks.workunit.client.0.smithi152.stdout:8/30: dwrite d1/d6/d7/fa [0,4194304] 0 2023-12-06T15:00:21.170 INFO:tasks.workunit.client.1.smithi190.stdout:9/203: rename d4/c20 to d4/d27/d2f/d31/c46 0 2023-12-06T15:00:21.171 INFO:tasks.workunit.client.1.smithi190.stdout:7/165: rmdir d0/d5/d1b 39 2023-12-06T15:00:21.172 INFO:tasks.workunit.client.1.smithi190.stdout:8/156: mknod d1/d10/d25/c2f 0 2023-12-06T15:00:21.173 INFO:tasks.workunit.client.0.smithi152.stdout:2/43: dwrite f0 [0,4194304] 0 2023-12-06T15:00:21.173 INFO:tasks.workunit.client.0.smithi152.stdout:1/158: dread d3/da/db/f11 [0,4194304] 0 2023-12-06T15:00:21.173 INFO:tasks.workunit.client.0.smithi152.stdout:7/68: truncate f1 685315 0 2023-12-06T15:00:21.173 INFO:tasks.workunit.client.0.smithi152.stdout:7/69: write f3 [198620,61637] 0 2023-12-06T15:00:21.173 INFO:tasks.workunit.client.0.smithi152.stdout:7/70: write f7 [316518,35496] 0 2023-12-06T15:00:21.173 INFO:tasks.workunit.client.1.smithi190.stdout:7/166: dread d0/f6 [4194304,4194304] 0 2023-12-06T15:00:21.173 INFO:tasks.workunit.client.1.smithi190.stdout:7/167: chown d0/d5/d1b/d1c/f28 3 1 2023-12-06T15:00:21.174 INFO:tasks.workunit.client.0.smithi152.stdout:8/31: mkdir d1/d6/db 0 2023-12-06T15:00:21.174 INFO:tasks.workunit.client.0.smithi152.stdout:8/32: write d1/f8 [508292,40214] 0 2023-12-06T15:00:21.175 INFO:tasks.workunit.client.1.smithi190.stdout:0/170: symlink d0/l2c 0 2023-12-06T15:00:21.175 INFO:tasks.workunit.client.1.smithi190.stdout:9/204: symlink d4/d27/d2f/d31/d3f/l47 0 2023-12-06T15:00:21.175 INFO:tasks.workunit.client.1.smithi190.stdout:9/205: fdatasync d4/f2d 0 2023-12-06T15:00:21.175 INFO:tasks.workunit.client.1.smithi190.stdout:9/206: write d4/f6 [5035717,30572] 0 2023-12-06T15:00:21.175 INFO:tasks.workunit.client.1.smithi190.stdout:8/157: creat d1/d10/d12/f30 x:0 0 0 2023-12-06T15:00:21.176 INFO:tasks.workunit.client.1.smithi190.stdout:7/168: mkdir d0/d5/d1b/d33 0 2023-12-06T15:00:21.176 INFO:tasks.workunit.client.1.smithi190.stdout:7/169: write d0/df/d1f/f29 [1038312,46446] 0 2023-12-06T15:00:21.176 INFO:tasks.workunit.client.1.smithi190.stdout:7/170: readlink d0/d5/d1b/l27 0 2023-12-06T15:00:21.178 INFO:tasks.workunit.client.0.smithi152.stdout:2/44: mkdir d6/db 0 2023-12-06T15:00:21.179 INFO:tasks.workunit.client.1.smithi190.stdout:9/207: rename d4/d27/d2f/d31/c2c to d4/d27/d2f/d31/c48 0 2023-12-06T15:00:21.179 INFO:tasks.workunit.client.0.smithi152.stdout:7/71: dread f3 [0,4194304] 0 2023-12-06T15:00:21.179 INFO:tasks.workunit.client.0.smithi152.stdout:8/33: rename d1/f8 to d1/d6/fc 0 2023-12-06T15:00:21.180 INFO:tasks.workunit.client.1.smithi190.stdout:2/208: sync 2023-12-06T15:00:21.180 INFO:tasks.workunit.client.1.smithi190.stdout:7/171: creat d0/f34 x:0 0 0 2023-12-06T15:00:21.181 INFO:tasks.workunit.client.1.smithi190.stdout:7/172: write d0/df/d1f/f29 [1332013,63117] 0 2023-12-06T15:00:21.181 INFO:tasks.workunit.client.0.smithi152.stdout:7/72: mknod dd/c16 0 2023-12-06T15:00:21.181 INFO:tasks.workunit.client.0.smithi152.stdout:7/73: chown cc 803895272 1 2023-12-06T15:00:21.181 INFO:tasks.workunit.client.0.smithi152.stdout:7/74: write fa [68991,102299] 0 2023-12-06T15:00:21.183 INFO:tasks.workunit.client.1.smithi190.stdout:9/208: creat d4/d27/f49 x:0 0 0 2023-12-06T15:00:21.183 INFO:tasks.workunit.client.1.smithi190.stdout:9/209: chown d4/d27/d2f/f41 22 1 2023-12-06T15:00:21.183 INFO:tasks.workunit.client.0.smithi152.stdout:7/75: mkdir dd/d17 0 2023-12-06T15:00:21.184 INFO:tasks.workunit.client.0.smithi152.stdout:8/34: link d1/d6/d7/fa d1/d6/fd 0 2023-12-06T15:00:21.188 INFO:tasks.workunit.client.0.smithi152.stdout:1/159: dread d3/da/d15/f20 [0,4194304] 0 2023-12-06T15:00:21.189 INFO:tasks.workunit.client.1.smithi190.stdout:2/209: creat d10/d31/f4b x:0 0 0 2023-12-06T15:00:21.191 INFO:tasks.workunit.client.0.smithi152.stdout:1/160: link d3/da/l3a d3/l3e 0 2023-12-06T15:00:21.191 INFO:tasks.workunit.client.0.smithi152.stdout:1/161: stat d3/f5 0 2023-12-06T15:00:21.192 INFO:tasks.workunit.client.0.smithi152.stdout:8/35: dread d1/d6/fc [0,4194304] 0 2023-12-06T15:00:21.192 INFO:tasks.workunit.client.0.smithi152.stdout:8/36: rename d1/d6 to d1/d6/db/de 22 2023-12-06T15:00:21.193 INFO:tasks.workunit.client.0.smithi152.stdout:8/37: chown d1/f2 1 1 2023-12-06T15:00:21.193 INFO:tasks.workunit.client.1.smithi190.stdout:3/287: sync 2023-12-06T15:00:21.193 INFO:tasks.workunit.client.1.smithi190.stdout:4/146: sync 2023-12-06T15:00:21.193 INFO:tasks.workunit.client.1.smithi190.stdout:5/182: sync 2023-12-06T15:00:21.193 INFO:tasks.workunit.client.1.smithi190.stdout:2/210: rename d10/d31/d37/f46 to d10/d26/f4c 0 2023-12-06T15:00:21.193 INFO:tasks.workunit.client.1.smithi190.stdout:4/147: chown d3/l8 3 1 2023-12-06T15:00:21.193 INFO:tasks.workunit.client.1.smithi190.stdout:3/288: dread - d4/d15/d33/d45/f5b zero size 2023-12-06T15:00:21.193 INFO:tasks.workunit.client.1.smithi190.stdout:6/169: sync 2023-12-06T15:00:21.195 INFO:tasks.workunit.client.1.smithi190.stdout:2/211: write ff [452999,104280] 0 2023-12-06T15:00:21.195 INFO:tasks.workunit.client.1.smithi190.stdout:2/212: dread - d10/d11/f16 zero size 2023-12-06T15:00:21.196 INFO:tasks.workunit.client.0.smithi152.stdout:8/38: creat d1/d6/ff x:0 0 0 2023-12-06T15:00:21.196 INFO:tasks.workunit.client.0.smithi152.stdout:1/162: creat d3/da/d15/f3f x:0 0 0 2023-12-06T15:00:21.200 INFO:tasks.workunit.client.1.smithi190.stdout:4/148: rmdir d3/d10 39 2023-12-06T15:00:21.200 INFO:tasks.workunit.client.0.smithi152.stdout:8/39: creat d1/f10 x:0 0 0 2023-12-06T15:00:21.201 INFO:tasks.workunit.client.0.smithi152.stdout:1/163: symlink d3/da/d15/d17/l40 0 2023-12-06T15:00:21.201 INFO:tasks.workunit.client.0.smithi152.stdout:8/40: chown d1/d6/ff 465330 1 2023-12-06T15:00:21.201 INFO:tasks.workunit.client.0.smithi152.stdout:1/164: dread - d3/da/d15/d17/d1a/f28 zero size 2023-12-06T15:00:21.201 INFO:tasks.workunit.client.1.smithi190.stdout:2/213: symlink d10/d31/d35/l4d 0 2023-12-06T15:00:21.202 INFO:tasks.workunit.client.0.smithi152.stdout:2/45: dwrite f1 [4194304,4194304] 0 2023-12-06T15:00:21.203 INFO:tasks.workunit.client.1.smithi190.stdout:6/170: write d4/f14 [364794,117464] 0 2023-12-06T15:00:21.203 INFO:tasks.workunit.client.1.smithi190.stdout:4/149: mknod d3/d13/d19/d30/c31 0 2023-12-06T15:00:21.204 INFO:tasks.workunit.client.1.smithi190.stdout:4/150: symlink d3/d13/l32 0 2023-12-06T15:00:21.206 INFO:tasks.workunit.client.1.smithi190.stdout:2/214: write ff [3312606,84803] 0 2023-12-06T15:00:21.206 INFO:tasks.workunit.client.1.smithi190.stdout:7/173: dread d0/d5/d1b/f2e [0,4194304] 0 2023-12-06T15:00:21.206 INFO:tasks.workunit.client.1.smithi190.stdout:7/174: read - d0/d5/d1b/d1c/f23 zero size 2023-12-06T15:00:21.208 INFO:tasks.workunit.client.1.smithi190.stdout:7/175: mkdir d0/d35 0 2023-12-06T15:00:21.209 INFO:tasks.workunit.client.0.smithi152.stdout:8/41: write d1/f2 [2614775,85710] 0 2023-12-06T15:00:21.212 INFO:tasks.workunit.client.0.smithi152.stdout:2/46: write f4 [5086776,18714] 0 2023-12-06T15:00:21.212 INFO:tasks.workunit.client.1.smithi190.stdout:7/176: write d0/fc [1060285,3177] 0 2023-12-06T15:00:21.213 INFO:tasks.workunit.client.1.smithi190.stdout:7/177: getdents d0/d35 0 2023-12-06T15:00:21.216 INFO:tasks.workunit.client.0.smithi152.stdout:2/47: link f5 d6/db/fc 0 2023-12-06T15:00:21.216 INFO:tasks.workunit.client.0.smithi152.stdout:2/48: readlink l3 0 2023-12-06T15:00:21.219 INFO:tasks.workunit.client.1.smithi190.stdout:2/215: dread d10/d11/f13 [0,4194304] 0 2023-12-06T15:00:21.220 INFO:tasks.workunit.client.1.smithi190.stdout:2/216: mknod d10/d11/c4e 0 2023-12-06T15:00:21.221 INFO:tasks.workunit.client.1.smithi190.stdout:2/217: creat d10/f4f x:0 0 0 2023-12-06T15:00:21.221 INFO:tasks.workunit.client.1.smithi190.stdout:2/218: write d10/d31/f33 [277257,65723] 0 2023-12-06T15:00:21.226 INFO:tasks.workunit.client.1.smithi190.stdout:2/219: dread d10/d11/f1b [0,4194304] 0 2023-12-06T15:00:21.226 INFO:tasks.workunit.client.1.smithi190.stdout:2/220: chown c0 721641 1 2023-12-06T15:00:21.226 INFO:tasks.workunit.client.1.smithi190.stdout:2/221: fsync d10/d11/f3c 0 2023-12-06T15:00:21.226 INFO:tasks.workunit.client.1.smithi190.stdout:2/222: chown d10/d31/d35/l4d 172 1 2023-12-06T15:00:21.234 INFO:tasks.workunit.client.1.smithi190.stdout:0/171: dwrite d0/da/ff [4194304,4194304] 0 2023-12-06T15:00:21.234 INFO:tasks.workunit.client.1.smithi190.stdout:0/172: fsync d0/f18 0 2023-12-06T15:00:21.237 INFO:tasks.workunit.client.1.smithi190.stdout:0/173: creat d0/f2d x:0 0 0 2023-12-06T15:00:21.245 INFO:tasks.workunit.client.0.smithi152.stdout:7/76: dwrite f8 [0,4194304] 0 2023-12-06T15:00:21.246 INFO:tasks.workunit.client.1.smithi190.stdout:4/151: dwrite d3/d10/d15/f2f [0,4194304] 0 2023-12-06T15:00:21.246 INFO:tasks.workunit.client.1.smithi190.stdout:2/223: dread d10/f2d [0,4194304] 0 2023-12-06T15:00:21.248 INFO:tasks.workunit.client.0.smithi152.stdout:7/77: creat dd/f18 x:0 0 0 2023-12-06T15:00:21.248 INFO:tasks.workunit.client.0.smithi152.stdout:7/78: fdatasync dd/f13 0 2023-12-06T15:00:21.248 INFO:tasks.workunit.client.1.smithi190.stdout:4/152: fdatasync d3/d10/f1e 0 2023-12-06T15:00:21.248 INFO:tasks.workunit.client.1.smithi190.stdout:4/153: stat d3/l8 0 2023-12-06T15:00:21.250 INFO:tasks.workunit.client.1.smithi190.stdout:2/224: creat d10/d31/d35/f50 x:0 0 0 2023-12-06T15:00:21.250 INFO:tasks.workunit.client.1.smithi190.stdout:5/183: dwrite d0/df/f27 [0,4194304] 0 2023-12-06T15:00:21.250 INFO:tasks.workunit.client.0.smithi152.stdout:1/165: dwrite d3/da/d15/d17/f2d [0,4194304] 0 2023-12-06T15:00:21.251 INFO:tasks.workunit.client.0.smithi152.stdout:2/49: dwrite f0 [0,4194304] 0 2023-12-06T15:00:21.251 INFO:tasks.workunit.client.0.smithi152.stdout:1/166: readlink d3/da/d15/d17/l40 0 2023-12-06T15:00:21.251 INFO:tasks.workunit.client.1.smithi190.stdout:3/289: dwrite d4/d1b/f64 [4194304,4194304] 0 2023-12-06T15:00:21.251 INFO:tasks.workunit.client.1.smithi190.stdout:4/154: rename d3/fb to d3/f33 0 2023-12-06T15:00:21.252 INFO:tasks.workunit.client.1.smithi190.stdout:5/184: write d0/d12/f1f [2023925,11112] 0 2023-12-06T15:00:21.252 INFO:tasks.workunit.client.1.smithi190.stdout:5/185: chown d0/d1c/f35 2 1 2023-12-06T15:00:21.252 INFO:tasks.workunit.client.1.smithi190.stdout:2/225: mknod d10/d26/c51 0 2023-12-06T15:00:21.253 INFO:tasks.workunit.client.0.smithi152.stdout:7/79: dread f7 [0,4194304] 0 2023-12-06T15:00:21.253 INFO:tasks.workunit.client.1.smithi190.stdout:4/155: write d3/d10/d15/f20 [2924535,68025] 0 2023-12-06T15:00:21.254 INFO:tasks.workunit.client.1.smithi190.stdout:4/156: read d3/f14 [564635,76969] 0 2023-12-06T15:00:21.254 INFO:tasks.workunit.client.1.smithi190.stdout:4/157: chown d3/d13/l32 293847121 1 2023-12-06T15:00:21.254 INFO:tasks.workunit.client.1.smithi190.stdout:6/171: dread d4/f14 [0,4194304] 0 2023-12-06T15:00:21.255 INFO:tasks.workunit.client.0.smithi152.stdout:1/167: truncate d3/f5 3029698 0 2023-12-06T15:00:21.255 INFO:tasks.workunit.client.1.smithi190.stdout:3/290: creat d4/d15/d53/f65 x:0 0 0 2023-12-06T15:00:21.256 INFO:tasks.workunit.client.1.smithi190.stdout:3/291: readlink d4/d15/d19/d51/l5a 0 2023-12-06T15:00:21.256 INFO:tasks.workunit.client.0.smithi152.stdout:1/168: write d3/f4 [401996,56621] 0 2023-12-06T15:00:21.259 INFO:tasks.workunit.client.1.smithi190.stdout:5/186: link d0/d1c/d2b/f32 d0/d1c/f36 0 2023-12-06T15:00:21.262 INFO:tasks.workunit.client.1.smithi190.stdout:2/226: creat d10/d31/d37/f52 x:0 0 0 2023-12-06T15:00:21.264 INFO:tasks.workunit.client.1.smithi190.stdout:7/178: truncate d0/df/d1f/f29 938731 0 2023-12-06T15:00:21.265 INFO:tasks.workunit.client.1.smithi190.stdout:4/158: rename d3/d13/d19/f1c to d3/d10/d15/f34 0 2023-12-06T15:00:21.266 INFO:tasks.workunit.client.1.smithi190.stdout:4/159: fdatasync d3/d10/d15/f2f 0 2023-12-06T15:00:21.266 INFO:tasks.workunit.client.1.smithi190.stdout:3/292: dread d4/d15/d33/d36/f3c [0,4194304] 0 2023-12-06T15:00:21.266 INFO:tasks.workunit.client.1.smithi190.stdout:3/293: read - d4/d15/d19/d1c/f4e zero size 2023-12-06T15:00:21.266 INFO:tasks.workunit.client.1.smithi190.stdout:7/179: write d0/f6 [1868227,39237] 0 2023-12-06T15:00:21.266 INFO:tasks.workunit.client.1.smithi190.stdout:6/172: rmdir d4/d12 39 2023-12-06T15:00:21.266 INFO:tasks.workunit.client.1.smithi190.stdout:6/173: dread - d4/d12/d1a/f1f zero size 2023-12-06T15:00:21.267 INFO:tasks.workunit.client.1.smithi190.stdout:3/294: getdents d4/d15/d19/d1c 0 2023-12-06T15:00:21.268 INFO:tasks.workunit.client.1.smithi190.stdout:3/295: write d4/d15/d19/d51/f5f [1435638,77643] 0 2023-12-06T15:00:21.269 INFO:tasks.workunit.client.0.smithi152.stdout:7/80: symlink dd/l19 0 2023-12-06T15:00:21.269 INFO:tasks.workunit.client.0.smithi152.stdout:1/169: rmdir d3/da/d15/d17/d1a 39 2023-12-06T15:00:21.269 INFO:tasks.workunit.client.0.smithi152.stdout:8/42: getdents d1 0 2023-12-06T15:00:21.269 INFO:tasks.workunit.client.0.smithi152.stdout:1/170: chown d3/da/l3b 48501310 1 2023-12-06T15:00:21.269 INFO:tasks.workunit.client.0.smithi152.stdout:2/50: truncate f1 2676227 0 2023-12-06T15:00:21.270 INFO:tasks.workunit.client.0.smithi152.stdout:1/171: read d3/da/d15/d17/f34 [111996,14716] 0 2023-12-06T15:00:21.273 INFO:tasks.workunit.client.0.smithi152.stdout:7/81: creat dd/df/f1a x:0 0 0 2023-12-06T15:00:21.274 INFO:tasks.workunit.client.1.smithi190.stdout:7/180: mknod d0/df/d1f/c36 0 2023-12-06T15:00:21.275 INFO:tasks.workunit.client.1.smithi190.stdout:7/181: chown d0/df/d10 10 1 2023-12-06T15:00:21.275 INFO:tasks.workunit.client.1.smithi190.stdout:7/182: chown d0/d5/d1b/c2c 682893 1 2023-12-06T15:00:21.275 INFO:tasks.workunit.client.1.smithi190.stdout:7/183: write d0/d5/da/fb [169648,41475] 0 2023-12-06T15:00:21.277 INFO:tasks.workunit.client.1.smithi190.stdout:7/184: mkdir d0/df/d37 0 2023-12-06T15:00:21.277 INFO:tasks.workunit.client.1.smithi190.stdout:6/174: write d4/d12/d1a/f20 [1202275,78567] 0 2023-12-06T15:00:21.277 INFO:tasks.workunit.client.1.smithi190.stdout:6/175: chown d4/d15/l17 526 1 2023-12-06T15:00:21.282 INFO:tasks.workunit.client.1.smithi190.stdout:1/309: sync 2023-12-06T15:00:21.283 INFO:tasks.workunit.client.0.smithi152.stdout:1/172: dread d3/da/d15/f20 [0,4194304] 0 2023-12-06T15:00:21.284 INFO:tasks.workunit.client.1.smithi190.stdout:6/176: dread d4/fe [0,4194304] 0 2023-12-06T15:00:21.284 INFO:tasks.workunit.client.1.smithi190.stdout:6/177: write d4/f2b [39157,102849] 0 2023-12-06T15:00:21.284 INFO:tasks.workunit.client.1.smithi190.stdout:6/178: read - d4/d12/f1d zero size 2023-12-06T15:00:21.284 INFO:tasks.workunit.client.1.smithi190.stdout:1/310: unlink d6/dc/d29/f47 0 2023-12-06T15:00:21.286 INFO:tasks.workunit.client.0.smithi152.stdout:1/173: link d3/da/d15/f20 d3/da/d15/d17/f41 0 2023-12-06T15:00:21.286 INFO:tasks.workunit.client.0.smithi152.stdout:1/174: write d3/da/d15/d17/d1a/f28 [44843,41184] 0 2023-12-06T15:00:21.286 INFO:tasks.workunit.client.1.smithi190.stdout:6/179: creat d4/d12/f2d x:0 0 0 2023-12-06T15:00:21.287 INFO:tasks.workunit.client.0.smithi152.stdout:1/175: creat d3/da/d15/d17/f42 x:0 0 0 2023-12-06T15:00:21.287 INFO:tasks.workunit.client.0.smithi152.stdout:2/51: dread f0 [0,4194304] 0 2023-12-06T15:00:21.287 INFO:tasks.workunit.client.0.smithi152.stdout:2/52: stat f5 0 2023-12-06T15:00:21.287 INFO:tasks.workunit.client.0.smithi152.stdout:2/53: fdatasync f5 0 2023-12-06T15:00:21.287 INFO:tasks.workunit.client.0.smithi152.stdout:1/176: mkdir d3/da/d15/d17/d43 0 2023-12-06T15:00:21.288 INFO:tasks.workunit.client.1.smithi190.stdout:1/311: unlink d6/dc/l10 0 2023-12-06T15:00:21.288 INFO:tasks.workunit.client.1.smithi190.stdout:6/180: truncate d4/f14 3458109 0 2023-12-06T15:00:21.289 INFO:tasks.workunit.client.0.smithi152.stdout:2/54: mknod d6/cd 0 2023-12-06T15:00:21.289 INFO:tasks.workunit.client.1.smithi190.stdout:6/181: mknod d4/d15/c2e 0 2023-12-06T15:00:21.289 INFO:tasks.workunit.client.1.smithi190.stdout:6/182: read - d4/d12/f1d zero size 2023-12-06T15:00:21.289 INFO:tasks.workunit.client.0.smithi152.stdout:1/177: mkdir d3/d44 0 2023-12-06T15:00:21.290 INFO:tasks.workunit.client.1.smithi190.stdout:4/160: dwrite d3/d10/d15/f2f [0,4194304] 0 2023-12-06T15:00:21.291 INFO:tasks.workunit.client.0.smithi152.stdout:2/55: unlink d6/f8 0 2023-12-06T15:00:21.292 INFO:tasks.workunit.client.0.smithi152.stdout:1/178: unlink d3/da/db/l25 0 2023-12-06T15:00:21.294 INFO:tasks.workunit.client.0.smithi152.stdout:2/56: rmdir d6/da 0 2023-12-06T15:00:21.295 INFO:tasks.workunit.client.0.smithi152.stdout:1/179: creat d3/da/d15/d17/d1a/f45 x:0 0 0 2023-12-06T15:00:21.296 INFO:tasks.workunit.client.0.smithi152.stdout:2/57: symlink d6/db/le 0 2023-12-06T15:00:21.298 INFO:tasks.workunit.client.0.smithi152.stdout:1/180: creat d3/d44/f46 x:0 0 0 2023-12-06T15:00:21.299 INFO:tasks.workunit.client.0.smithi152.stdout:2/58: mkdir d6/db/df 0 2023-12-06T15:00:21.303 INFO:tasks.workunit.client.0.smithi152.stdout:1/181: dread d3/da/db/f11 [0,4194304] 0 2023-12-06T15:00:21.303 INFO:tasks.workunit.client.0.smithi152.stdout:1/182: read - d3/da/d15/d17/f21 zero size 2023-12-06T15:00:21.316 INFO:tasks.workunit.client.1.smithi190.stdout:4/161: dwrite d3/d10/d15/f29 [0,4194304] 0 2023-12-06T15:00:21.318 INFO:tasks.workunit.client.1.smithi190.stdout:6/183: dwrite d4/d12/d1a/f20 [0,4194304] 0 2023-12-06T15:00:21.318 INFO:tasks.workunit.client.1.smithi190.stdout:6/184: chown d4/d15/l17 690905 1 2023-12-06T15:00:21.318 INFO:tasks.workunit.client.1.smithi190.stdout:6/185: chown d4/d12/d1a/f1c 1 1 2023-12-06T15:00:21.318 INFO:tasks.workunit.client.1.smithi190.stdout:6/186: readlink d4/d15/l17 0 2023-12-06T15:00:21.319 INFO:tasks.workunit.client.1.smithi190.stdout:6/187: write d4/f14 [1052635,66556] 0 2023-12-06T15:00:21.319 INFO:tasks.workunit.client.1.smithi190.stdout:4/162: rename d3/d13 to d3/d35 0 2023-12-06T15:00:21.319 INFO:tasks.workunit.client.1.smithi190.stdout:4/163: chown d3/d35/d19/d30 1 1 2023-12-06T15:00:21.321 INFO:tasks.workunit.client.1.smithi190.stdout:6/188: symlink d4/d15/l2f 0 2023-12-06T15:00:21.321 INFO:tasks.workunit.client.1.smithi190.stdout:6/189: read - d4/d12/d1a/f1f zero size 2023-12-06T15:00:21.322 INFO:tasks.workunit.client.1.smithi190.stdout:4/164: symlink d3/d35/l36 0 2023-12-06T15:00:21.323 INFO:tasks.workunit.client.1.smithi190.stdout:6/190: creat d4/f30 x:0 0 0 2023-12-06T15:00:21.323 INFO:tasks.workunit.client.1.smithi190.stdout:6/191: fsync d4/fe 0 2023-12-06T15:00:21.325 INFO:tasks.workunit.client.1.smithi190.stdout:4/165: creat d3/d35/d19/d30/f37 x:0 0 0 2023-12-06T15:00:21.325 INFO:tasks.workunit.client.1.smithi190.stdout:4/166: chown d3/d35/d19/d30 1939322927 1 2023-12-06T15:00:21.325 INFO:tasks.workunit.client.1.smithi190.stdout:4/167: read d3/f12 [1020893,31834] 0 2023-12-06T15:00:21.325 INFO:tasks.workunit.client.1.smithi190.stdout:6/192: mknod d4/c31 0 2023-12-06T15:00:21.326 INFO:tasks.workunit.client.1.smithi190.stdout:4/168: write d3/d10/d15/f29 [3118300,67063] 0 2023-12-06T15:00:21.326 INFO:tasks.workunit.client.1.smithi190.stdout:6/193: unlink d4/f2b 0 2023-12-06T15:00:21.327 INFO:tasks.workunit.client.1.smithi190.stdout:6/194: chown d4/fe 0 1 2023-12-06T15:00:21.327 INFO:tasks.workunit.client.1.smithi190.stdout:4/169: link d3/d10/d15/l1b d3/l38 0 2023-12-06T15:00:21.328 INFO:tasks.workunit.client.1.smithi190.stdout:6/195: rename d4/d12/d1a/d1e to d4/d12/d1a/d32 0 2023-12-06T15:00:21.329 INFO:tasks.workunit.client.1.smithi190.stdout:4/170: read d3/d10/d1d/f25 [40362,31348] 0 2023-12-06T15:00:21.329 INFO:tasks.workunit.client.1.smithi190.stdout:4/171: stat d3/d35/d19/l24 0 2023-12-06T15:00:21.331 INFO:tasks.workunit.client.1.smithi190.stdout:4/172: rename d3/d10/d1d to d3/d10/d39 0 2023-12-06T15:00:21.332 INFO:tasks.workunit.client.1.smithi190.stdout:4/173: unlink d3/d35/l36 0 2023-12-06T15:00:21.334 INFO:tasks.workunit.client.1.smithi190.stdout:4/174: rename d3/d10/d15/f29 to d3/d35/d19/d30/f3a 0 2023-12-06T15:00:21.334 INFO:tasks.workunit.client.1.smithi190.stdout:6/196: fsync d4/f30 0 2023-12-06T15:00:21.334 INFO:tasks.workunit.client.1.smithi190.stdout:6/197: truncate d4/d12/d1a/f28 598911 0 2023-12-06T15:00:21.335 INFO:tasks.workunit.client.1.smithi190.stdout:4/175: unlink d3/f21 0 2023-12-06T15:00:21.335 INFO:tasks.workunit.client.1.smithi190.stdout:4/176: truncate d3/d10/f1e 120630 0 2023-12-06T15:00:21.336 INFO:tasks.workunit.client.1.smithi190.stdout:6/198: rename d4/d12/d1a/f25 to d4/d12/d1a/f33 0 2023-12-06T15:00:21.339 INFO:tasks.workunit.client.1.smithi190.stdout:4/177: unlink d3/d35/f18 0 2023-12-06T15:00:21.341 INFO:tasks.workunit.client.1.smithi190.stdout:6/199: mknod d4/d12/c34 0 2023-12-06T15:00:21.341 INFO:tasks.workunit.client.1.smithi190.stdout:6/200: read - d4/d12/d1a/f33 zero size 2023-12-06T15:00:21.341 INFO:tasks.workunit.client.1.smithi190.stdout:6/201: write d4/d15/f26 [1743981,122665] 0 2023-12-06T15:00:21.343 INFO:tasks.workunit.client.1.smithi190.stdout:4/178: fsync d3/d10/f2a 0 2023-12-06T15:00:21.343 INFO:tasks.workunit.client.1.smithi190.stdout:7/185: read d0/f6 [942103,49257] 0 2023-12-06T15:00:21.344 INFO:tasks.workunit.client.1.smithi190.stdout:4/179: symlink d3/l3b 0 2023-12-06T15:00:21.345 INFO:tasks.workunit.client.1.smithi190.stdout:4/180: dread d3/d10/f1e [0,4194304] 0 2023-12-06T15:00:21.350 INFO:tasks.workunit.client.1.smithi190.stdout:4/181: mkdir d3/d35/d19/d30/d3c 0 2023-12-06T15:00:21.368 INFO:tasks.workunit.client.1.smithi190.stdout:3/296: dwrite d4/d15/d19/f3f [0,4194304] 0 2023-12-06T15:00:21.369 INFO:tasks.workunit.client.0.smithi152.stdout:7/82: dwrite f9 [0,4194304] 0 2023-12-06T15:00:21.369 INFO:tasks.workunit.client.0.smithi152.stdout:2/59: write f1 [758120,93178] 0 2023-12-06T15:00:21.369 INFO:tasks.workunit.client.1.smithi190.stdout:2/227: dwrite d10/d31/d37/f52 [0,4194304] 0 2023-12-06T15:00:21.371 INFO:tasks.workunit.client.0.smithi152.stdout:7/83: write f1 [214626,30482] 0 2023-12-06T15:00:21.373 INFO:tasks.workunit.client.0.smithi152.stdout:1/183: getdents d3/da/d15/d17 0 2023-12-06T15:00:21.374 INFO:tasks.workunit.client.0.smithi152.stdout:1/184: truncate d3/fd 2390964 0 2023-12-06T15:00:21.375 INFO:tasks.workunit.client.1.smithi190.stdout:3/297: symlink d4/d15/d19/d1c/l66 0 2023-12-06T15:00:21.375 INFO:tasks.workunit.client.1.smithi190.stdout:2/228: getdents d10/d31/d37 0 2023-12-06T15:00:21.375 INFO:tasks.workunit.client.1.smithi190.stdout:7/186: dwrite d0/d5/d1b/f2e [0,4194304] 0 2023-12-06T15:00:21.377 INFO:tasks.workunit.client.1.smithi190.stdout:3/298: creat d4/d15/d19/d3a/f67 x:0 0 0 2023-12-06T15:00:21.377 INFO:tasks.workunit.client.1.smithi190.stdout:3/299: read - d4/d15/d33/d45/f59 zero size 2023-12-06T15:00:21.378 INFO:tasks.workunit.client.0.smithi152.stdout:1/185: rename d3/da/d15/c33 to d3/da/d15/d17/c47 0 2023-12-06T15:00:21.378 INFO:tasks.workunit.client.0.smithi152.stdout:1/186: stat d3/da/d15/d17/d1a/f28 0 2023-12-06T15:00:21.378 INFO:tasks.workunit.client.1.smithi190.stdout:1/312: dwrite d6/f2f [0,4194304] 0 2023-12-06T15:00:21.379 INFO:tasks.workunit.client.0.smithi152.stdout:1/187: read d3/da/d15/d17/d1a/f38 [2069682,16013] 0 2023-12-06T15:00:21.379 INFO:tasks.workunit.client.1.smithi190.stdout:3/300: mkdir d4/d15/d33/d36/d68 0 2023-12-06T15:00:21.384 INFO:tasks.workunit.client.0.smithi152.stdout:1/188: read d3/da/d15/f1d [153572,44398] 0 2023-12-06T15:00:21.384 INFO:tasks.workunit.client.0.smithi152.stdout:1/189: truncate d3/da/db/d18/f31 1046637 0 2023-12-06T15:00:21.385 INFO:tasks.workunit.client.0.smithi152.stdout:3/49: sync 2023-12-06T15:00:21.385 INFO:tasks.workunit.client.0.smithi152.stdout:3/50: fdatasync f3 0 2023-12-06T15:00:21.385 INFO:tasks.workunit.client.1.smithi190.stdout:2/229: dread f3 [0,4194304] 0 2023-12-06T15:00:21.386 INFO:tasks.workunit.client.1.smithi190.stdout:1/313: mknod d6/dc/d29/c57 0 2023-12-06T15:00:21.386 INFO:tasks.workunit.client.1.smithi190.stdout:1/314: chown d6/dc/d29/d38/d43 0 1 2023-12-06T15:00:21.386 INFO:tasks.workunit.client.1.smithi190.stdout:3/301: mkdir d4/d1b/d69 0 2023-12-06T15:00:21.386 INFO:tasks.workunit.client.1.smithi190.stdout:2/230: write d10/f1f [318877,46638] 0 2023-12-06T15:00:21.386 INFO:tasks.workunit.client.0.smithi152.stdout:1/190: rmdir d3/da/db/d18 39 2023-12-06T15:00:21.387 INFO:tasks.workunit.client.0.smithi152.stdout:1/191: dread - d3/da/d15/d17/f3d zero size 2023-12-06T15:00:21.389 INFO:tasks.workunit.client.0.smithi152.stdout:1/192: creat d3/da/db/f48 x:0 0 0 2023-12-06T15:00:21.390 INFO:tasks.workunit.client.1.smithi190.stdout:3/302: rename d4/c10 to d4/d15/d53/d56/c6a 0 2023-12-06T15:00:21.391 INFO:tasks.workunit.client.0.smithi152.stdout:1/193: rename d3/da/l3a to d3/da/d15/d17/d43/l49 0 2023-12-06T15:00:21.391 INFO:tasks.workunit.client.0.smithi152.stdout:1/194: symlink d3/l4a 0 2023-12-06T15:00:21.392 INFO:tasks.workunit.client.0.smithi152.stdout:2/60: write f4 [1966872,104934] 0 2023-12-06T15:00:21.392 INFO:tasks.workunit.client.1.smithi190.stdout:2/231: mknod d10/d31/d37/c53 0 2023-12-06T15:00:21.393 INFO:tasks.workunit.client.0.smithi152.stdout:2/61: unlink l3 0 2023-12-06T15:00:21.393 INFO:tasks.workunit.client.0.smithi152.stdout:2/62: chown f5 1 1 2023-12-06T15:00:21.394 INFO:tasks.workunit.client.0.smithi152.stdout:1/195: creat d3/da/db/f4b x:0 0 0 2023-12-06T15:00:21.395 INFO:tasks.workunit.client.1.smithi190.stdout:2/232: getdents d10/d11 0 2023-12-06T15:00:21.396 INFO:tasks.workunit.client.0.smithi152.stdout:2/63: mknod d6/db/df/c10 0 2023-12-06T15:00:21.397 INFO:tasks.workunit.client.1.smithi190.stdout:3/303: truncate d4/d1b/f64 2797939 0 2023-12-06T15:00:21.397 INFO:tasks.workunit.client.1.smithi190.stdout:3/304: write d4/d15/d19/d3a/d3b/f55 [301689,48770] 0 2023-12-06T15:00:21.399 INFO:tasks.workunit.client.1.smithi190.stdout:1/315: dread d6/dc/f33 [0,4194304] 0 2023-12-06T15:00:21.399 INFO:tasks.workunit.client.1.smithi190.stdout:1/316: chown d6/dc/d29/d38/d43/f4b 42072819 1 2023-12-06T15:00:21.399 INFO:tasks.workunit.client.1.smithi190.stdout:7/187: fsync d0/f6 0 2023-12-06T15:00:21.399 INFO:tasks.workunit.client.1.smithi190.stdout:7/188: chown d0/d5 165 1 2023-12-06T15:00:21.399 INFO:tasks.workunit.client.1.smithi190.stdout:2/233: mkdir d10/d31/d49/d54 0 2023-12-06T15:00:21.400 INFO:tasks.workunit.client.1.smithi190.stdout:2/234: write f3 [2926800,85107] 0 2023-12-06T15:00:21.400 INFO:tasks.workunit.client.1.smithi190.stdout:6/202: dwrite d4/d15/f26 [0,4194304] 0 2023-12-06T15:00:21.401 INFO:tasks.workunit.client.1.smithi190.stdout:1/317: mknod d6/dc/d29/d38/d43/c58 0 2023-12-06T15:00:21.401 INFO:tasks.workunit.client.1.smithi190.stdout:1/318: readlink d6/l8 0 2023-12-06T15:00:21.401 INFO:tasks.workunit.client.1.smithi190.stdout:4/182: dwrite d3/d35/d19/d30/f3a [4194304,4194304] 0 2023-12-06T15:00:21.402 INFO:tasks.workunit.client.1.smithi190.stdout:4/183: fsync d3/d35/f22 0 2023-12-06T15:00:21.402 INFO:tasks.workunit.client.1.smithi190.stdout:3/305: dread d4/d15/d33/d36/f3c [0,4194304] 0 2023-12-06T15:00:21.402 INFO:tasks.workunit.client.1.smithi190.stdout:3/306: chown d4/d1b/c31 406980847 1 2023-12-06T15:00:21.402 INFO:tasks.workunit.client.1.smithi190.stdout:3/307: write d4/d15/d19/d51/f5f [1920086,58409] 0 2023-12-06T15:00:21.402 INFO:tasks.workunit.client.1.smithi190.stdout:7/189: symlink d0/d5/d1b/d32/l38 0 2023-12-06T15:00:21.402 INFO:tasks.workunit.client.0.smithi152.stdout:2/64: mkdir d6/d11 0 2023-12-06T15:00:21.403 INFO:tasks.workunit.client.1.smithi190.stdout:7/190: write d0/f6 [4476886,62309] 0 2023-12-06T15:00:21.405 INFO:tasks.workunit.client.1.smithi190.stdout:2/235: creat d10/d31/d49/f55 x:0 0 0 2023-12-06T15:00:21.408 INFO:tasks.workunit.client.1.smithi190.stdout:4/184: link d3/l8 d3/d35/d19/l3d 0 2023-12-06T15:00:21.409 INFO:tasks.workunit.client.0.smithi152.stdout:3/51: dwrite f3 [0,4194304] 0 2023-12-06T15:00:21.413 INFO:tasks.workunit.client.1.smithi190.stdout:6/203: dread d4/fd [4194304,4194304] 0 2023-12-06T15:00:21.414 INFO:tasks.workunit.client.1.smithi190.stdout:6/204: fsync d4/fe 0 2023-12-06T15:00:21.415 INFO:tasks.workunit.client.1.smithi190.stdout:3/308: symlink d4/d15/d33/l6b 0 2023-12-06T15:00:21.416 INFO:tasks.workunit.client.1.smithi190.stdout:4/185: stat d3/l8 0 2023-12-06T15:00:21.418 INFO:tasks.workunit.client.0.smithi152.stdout:1/196: dwrite d3/f2b [0,4194304] 0 2023-12-06T15:00:21.419 INFO:tasks.workunit.client.1.smithi190.stdout:4/186: symlink d3/d35/d19/d30/d3c/l3e 0 2023-12-06T15:00:21.419 INFO:tasks.workunit.client.1.smithi190.stdout:4/187: chown d3/l8 236 1 2023-12-06T15:00:21.421 INFO:tasks.workunit.client.1.smithi190.stdout:4/188: creat d3/f3f x:0 0 0 2023-12-06T15:00:21.422 INFO:tasks.workunit.client.0.smithi152.stdout:7/84: dwrite f8 [0,4194304] 0 2023-12-06T15:00:21.423 INFO:tasks.workunit.client.0.smithi152.stdout:3/52: dread f2 [0,4194304] 0 2023-12-06T15:00:21.424 INFO:tasks.workunit.client.0.smithi152.stdout:3/53: chown d9/lb 45171 1 2023-12-06T15:00:21.425 INFO:tasks.workunit.client.0.smithi152.stdout:1/197: write d3/f30 [1226798,103983] 0 2023-12-06T15:00:21.426 INFO:tasks.workunit.client.0.smithi152.stdout:3/54: getdents d9 0 2023-12-06T15:00:21.426 INFO:tasks.workunit.client.1.smithi190.stdout:4/189: creat d3/f40 x:0 0 0 2023-12-06T15:00:21.427 INFO:tasks.workunit.client.0.smithi152.stdout:1/198: mkdir d3/da/d4c 0 2023-12-06T15:00:21.427 INFO:tasks.workunit.client.0.smithi152.stdout:1/199: write d3/da/f35 [641499,36919] 0 2023-12-06T15:00:21.429 INFO:tasks.workunit.client.0.smithi152.stdout:1/200: mkdir d3/da/d15/d17/d4d 0 2023-12-06T15:00:21.429 INFO:tasks.workunit.client.0.smithi152.stdout:1/201: chown d3/da/d15/d17/f41 55749279 1 2023-12-06T15:00:21.430 INFO:tasks.workunit.client.0.smithi152.stdout:1/202: creat d3/da/d15/d17/d1a/f4e x:0 0 0 2023-12-06T15:00:21.433 INFO:tasks.workunit.client.0.smithi152.stdout:3/55: write f3 [2588083,42917] 0 2023-12-06T15:00:21.433 INFO:tasks.workunit.client.0.smithi152.stdout:3/56: chown c8 171 1 2023-12-06T15:00:21.434 INFO:tasks.workunit.client.0.smithi152.stdout:3/57: rmdir d9 39 2023-12-06T15:00:21.435 INFO:tasks.workunit.client.0.smithi152.stdout:3/58: rmdir d9 39 2023-12-06T15:00:21.436 INFO:tasks.workunit.client.0.smithi152.stdout:2/65: dread f1 [0,4194304] 0 2023-12-06T15:00:21.436 INFO:tasks.workunit.client.0.smithi152.stdout:3/59: dread - f7 zero size 2023-12-06T15:00:21.437 INFO:tasks.workunit.client.0.smithi152.stdout:2/66: mknod d6/c12 0 2023-12-06T15:00:21.439 INFO:tasks.workunit.client.0.smithi152.stdout:3/60: read f6 [1888005,57982] 0 2023-12-06T15:00:21.439 INFO:tasks.workunit.client.0.smithi152.stdout:3/61: stat c8 0 2023-12-06T15:00:21.439 INFO:tasks.workunit.client.0.smithi152.stdout:3/62: stat l4 0 2023-12-06T15:00:21.444 INFO:tasks.workunit.client.1.smithi190.stdout:4/190: dread d3/d10/d15/f34 [0,4194304] 0 2023-12-06T15:00:21.444 INFO:tasks.workunit.client.1.smithi190.stdout:4/191: fsync d3/fa 0 2023-12-06T15:00:21.445 INFO:tasks.workunit.client.1.smithi190.stdout:4/192: getdents d3/d10 0 2023-12-06T15:00:21.445 INFO:tasks.workunit.client.1.smithi190.stdout:1/319: dwrite d6/dc/f51 [0,4194304] 0 2023-12-06T15:00:21.445 INFO:tasks.workunit.client.0.smithi152.stdout:3/63: unlink f3 0 2023-12-06T15:00:21.445 INFO:tasks.workunit.client.0.smithi152.stdout:3/64: truncate f7 445801 0 2023-12-06T15:00:21.446 INFO:tasks.workunit.client.0.smithi152.stdout:3/65: write f6 [2137651,31878] 0 2023-12-06T15:00:21.447 INFO:tasks.workunit.client.1.smithi190.stdout:1/320: mknod d6/dc/d29/d38/d43/c59 0 2023-12-06T15:00:21.447 INFO:tasks.workunit.client.1.smithi190.stdout:1/321: stat d6/f2f 0 2023-12-06T15:00:21.448 INFO:tasks.workunit.client.0.smithi152.stdout:3/66: creat d9/ff x:0 0 0 2023-12-06T15:00:21.448 INFO:tasks.workunit.client.0.smithi152.stdout:3/67: write f7 [1423880,13285] 0 2023-12-06T15:00:21.448 INFO:tasks.workunit.client.1.smithi190.stdout:1/322: creat d6/f5a x:0 0 0 2023-12-06T15:00:21.449 INFO:tasks.workunit.client.1.smithi190.stdout:1/323: unlink d6/dc/d3b/l52 0 2023-12-06T15:00:21.450 INFO:tasks.workunit.client.1.smithi190.stdout:1/324: mknod d6/dc/d3b/d4d/c5b 0 2023-12-06T15:00:21.451 INFO:tasks.workunit.client.1.smithi190.stdout:1/325: mkdir d6/dc/d29/d34/d5c 0 2023-12-06T15:00:21.452 INFO:tasks.workunit.client.1.smithi190.stdout:1/326: rename d6/dc/c2a to d6/dc/d3b/c5d 0 2023-12-06T15:00:21.452 INFO:tasks.workunit.client.1.smithi190.stdout:1/327: symlink d6/dc/d3b/l5e 0 2023-12-06T15:00:21.453 INFO:tasks.workunit.client.1.smithi190.stdout:1/328: symlink d6/dc/d29/l5f 0 2023-12-06T15:00:21.455 INFO:tasks.workunit.client.1.smithi190.stdout:1/329: rename d6/dc/d3b/f42 to d6/dc/d3b/f60 0 2023-12-06T15:00:21.456 INFO:tasks.workunit.client.1.smithi190.stdout:6/205: dwrite d4/d12/f1d [0,4194304] 0 2023-12-06T15:00:21.456 INFO:tasks.workunit.client.1.smithi190.stdout:6/206: fdatasync d4/d12/d1a/f1c 0 2023-12-06T15:00:21.463 INFO:tasks.workunit.client.1.smithi190.stdout:7/191: dwrite d0/d5/d1b/d1c/f28 [4194304,4194304] 0 2023-12-06T15:00:21.463 INFO:tasks.workunit.client.1.smithi190.stdout:7/192: truncate d0/d5/d1b/d1c/f23 1033203 0 2023-12-06T15:00:21.463 INFO:tasks.workunit.client.1.smithi190.stdout:7/193: stat d0/cd 0 2023-12-06T15:00:21.464 INFO:tasks.workunit.client.0.smithi152.stdout:2/67: dwrite f0 [4194304,4194304] 0 2023-12-06T15:00:21.464 INFO:tasks.workunit.client.1.smithi190.stdout:4/193: dread d3/d10/d15/f2f [0,4194304] 0 2023-12-06T15:00:21.464 INFO:tasks.workunit.client.1.smithi190.stdout:2/236: dwrite d10/d26/f2f [0,4194304] 0 2023-12-06T15:00:21.464 INFO:tasks.workunit.client.1.smithi190.stdout:3/309: dwrite d4/d1b/f22 [0,4194304] 0 2023-12-06T15:00:21.464 INFO:tasks.workunit.client.1.smithi190.stdout:3/310: write d4/d15/d53/f65 [776396,45373] 0 2023-12-06T15:00:21.464 INFO:tasks.workunit.client.1.smithi190.stdout:7/194: write d0/d5/da/fb [917529,51331] 0 2023-12-06T15:00:21.467 INFO:tasks.workunit.client.0.smithi152.stdout:2/68: rename d6/d11 to d6/db/d13 0 2023-12-06T15:00:21.469 INFO:tasks.workunit.client.0.smithi152.stdout:2/69: creat d6/db/d13/f14 x:0 0 0 2023-12-06T15:00:21.470 INFO:tasks.workunit.client.0.smithi152.stdout:1/203: rmdir d3/da/db 39 2023-12-06T15:00:21.471 INFO:tasks.workunit.client.0.smithi152.stdout:2/70: creat d6/f15 x:0 0 0 2023-12-06T15:00:21.471 INFO:tasks.workunit.client.0.smithi152.stdout:2/71: fdatasync d6/db/fc 0 2023-12-06T15:00:21.471 INFO:tasks.workunit.client.0.smithi152.stdout:2/72: write d6/f15 [302692,7689] 0 2023-12-06T15:00:21.472 INFO:tasks.workunit.client.1.smithi190.stdout:1/330: dwrite d6/f21 [0,4194304] 0 2023-12-06T15:00:21.473 INFO:tasks.workunit.client.1.smithi190.stdout:2/237: dread d10/d11/f13 [0,4194304] 0 2023-12-06T15:00:21.473 INFO:tasks.workunit.client.1.smithi190.stdout:2/238: chown f3 3771807 1 2023-12-06T15:00:21.473 INFO:tasks.workunit.client.1.smithi190.stdout:2/239: truncate d10/d31/f45 1502976 0 2023-12-06T15:00:21.473 INFO:tasks.workunit.client.1.smithi190.stdout:7/195: dread d0/df/d1f/f29 [0,4194304] 0 2023-12-06T15:00:21.473 INFO:tasks.workunit.client.0.smithi152.stdout:1/204: creat d3/da/d15/d17/f4f x:0 0 0 2023-12-06T15:00:21.474 INFO:tasks.workunit.client.0.smithi152.stdout:1/205: chown d3/da/db/f48 134300 1 2023-12-06T15:00:21.474 INFO:tasks.workunit.client.1.smithi190.stdout:7/196: dread d0/d5/d1b/d1c/f23 [0,4194304] 0 2023-12-06T15:00:21.475 INFO:tasks.workunit.client.0.smithi152.stdout:1/206: creat d3/da/d15/d17/f50 x:0 0 0 2023-12-06T15:00:21.477 INFO:tasks.workunit.client.0.smithi152.stdout:1/207: unlink d3/da/d15/d17/f34 0 2023-12-06T15:00:21.478 INFO:tasks.workunit.client.1.smithi190.stdout:7/197: dread d0/f3 [0,4194304] 0 2023-12-06T15:00:21.478 INFO:tasks.workunit.client.1.smithi190.stdout:7/198: rename d0 to d0/d5/d1b/d1c/d17/d39 22 2023-12-06T15:00:21.478 INFO:tasks.workunit.client.1.smithi190.stdout:7/199: write d0/d5/d1b/d1c/d17/f26 [968709,82121] 0 2023-12-06T15:00:21.478 INFO:tasks.workunit.client.1.smithi190.stdout:7/200: chown d0/df/c22 126 1 2023-12-06T15:00:21.478 INFO:tasks.workunit.client.1.smithi190.stdout:7/201: write d0/f30 [690800,20211] 0 2023-12-06T15:00:21.484 INFO:tasks.workunit.client.0.smithi152.stdout:1/208: unlink d3/da/l39 0 2023-12-06T15:00:21.484 INFO:tasks.workunit.client.0.smithi152.stdout:1/209: chown d3/f7 1085 1 2023-12-06T15:00:21.485 INFO:tasks.workunit.client.0.smithi152.stdout:1/210: write d3/f5 [1365665,5181] 0 2023-12-06T15:00:21.487 INFO:tasks.workunit.client.0.smithi152.stdout:3/68: truncate f6 2737874 0 2023-12-06T15:00:21.487 INFO:tasks.workunit.client.0.smithi152.stdout:3/69: dread - d9/ff zero size 2023-12-06T15:00:21.488 INFO:tasks.workunit.client.1.smithi190.stdout:7/202: dread d0/d5/d1b/d1c/d17/f26 [0,4194304] 0 2023-12-06T15:00:21.491 INFO:tasks.workunit.client.0.smithi152.stdout:1/211: dread d3/da/db/f11 [0,4194304] 0 2023-12-06T15:00:21.491 INFO:tasks.workunit.client.0.smithi152.stdout:1/212: chown d3/da/d15/d17/f1f 543413651 1 2023-12-06T15:00:21.492 INFO:tasks.workunit.client.1.smithi190.stdout:2/240: dwrite d10/d26/f34 [4194304,4194304] 0 2023-12-06T15:00:21.493 INFO:tasks.workunit.client.0.smithi152.stdout:1/213: symlink d3/da/db/l51 0 2023-12-06T15:00:21.494 INFO:tasks.workunit.client.0.smithi152.stdout:1/214: mkdir d3/da/db/d18/d52 0 2023-12-06T15:00:21.496 INFO:tasks.workunit.client.0.smithi152.stdout:1/215: creat d3/da/db/f53 x:0 0 0 2023-12-06T15:00:21.497 INFO:tasks.workunit.client.0.smithi152.stdout:1/216: mkdir d3/da/db/d54 0 2023-12-06T15:00:21.501 INFO:tasks.workunit.client.0.smithi152.stdout:1/217: write d3/da/d15/d17/f41 [1950928,17298] 0 2023-12-06T15:00:21.502 INFO:tasks.workunit.client.0.smithi152.stdout:1/218: mkdir d3/da/db/d18/d52/d55 0 2023-12-06T15:00:21.504 INFO:tasks.workunit.client.0.smithi152.stdout:1/219: rename d3/da/d15/f20 to d3/da/db/d18/d52/d55/f56 0 2023-12-06T15:00:21.504 INFO:tasks.workunit.client.0.smithi152.stdout:1/220: chown d3/f7 335 1 2023-12-06T15:00:21.505 INFO:tasks.workunit.client.1.smithi190.stdout:7/203: dwrite d0/d5/d1b/d1c/d17/f26 [0,4194304] 0 2023-12-06T15:00:21.505 INFO:tasks.workunit.client.0.smithi152.stdout:1/221: unlink d3/da/d15/d17/f50 0 2023-12-06T15:00:21.505 INFO:tasks.workunit.client.0.smithi152.stdout:3/70: dwrite d9/ff [0,4194304] 0 2023-12-06T15:00:21.507 INFO:tasks.workunit.client.0.smithi152.stdout:1/222: rename d3/da/d15/d17/f21 to d3/da/d15/f57 0 2023-12-06T15:00:21.511 INFO:tasks.workunit.client.0.smithi152.stdout:1/223: mkdir d3/da/d15/d17/d58 0 2023-12-06T15:00:21.513 INFO:tasks.workunit.client.0.smithi152.stdout:1/224: symlink d3/da/d15/d17/l59 0 2023-12-06T15:00:21.517 INFO:tasks.workunit.client.0.smithi152.stdout:1/225: unlink d3/da/db/f27 0 2023-12-06T15:00:21.517 INFO:tasks.workunit.client.0.smithi152.stdout:1/226: dread - d3/da/d15/d17/d1a/f45 zero size 2023-12-06T15:00:21.518 INFO:tasks.workunit.client.0.smithi152.stdout:3/71: dwrite f7 [0,4194304] 0 2023-12-06T15:00:21.518 INFO:tasks.workunit.client.0.smithi152.stdout:1/227: mknod d3/da/db/c5a 0 2023-12-06T15:00:21.520 INFO:tasks.workunit.client.0.smithi152.stdout:3/72: mkdir d9/d10 0 2023-12-06T15:00:21.521 INFO:tasks.workunit.client.0.smithi152.stdout:1/228: mknod d3/da/db/c5b 0 2023-12-06T15:00:21.526 INFO:tasks.workunit.client.1.smithi190.stdout:3/311: creat d4/d15/d19/d1c/f6c x:0 0 0 2023-12-06T15:00:21.528 INFO:tasks.workunit.client.0.smithi152.stdout:1/229: link d3/f5 d3/da/f5c 0 2023-12-06T15:00:21.530 INFO:tasks.workunit.client.0.smithi152.stdout:1/230: mknod d3/da/d15/d17/d1a/c5d 0 2023-12-06T15:00:21.530 INFO:tasks.workunit.client.0.smithi152.stdout:1/231: stat d3/d44 0 2023-12-06T15:00:21.535 INFO:tasks.workunit.client.0.smithi152.stdout:3/73: dwrite f6 [0,4194304] 0 2023-12-06T15:00:21.538 INFO:tasks.workunit.client.0.smithi152.stdout:3/74: write f2 [2211035,78755] 0 2023-12-06T15:00:21.541 INFO:tasks.workunit.client.0.smithi152.stdout:3/75: link f2 d9/f11 0 2023-12-06T15:00:21.542 INFO:tasks.workunit.client.0.smithi152.stdout:3/76: chown c8 7875 1 2023-12-06T15:00:21.545 INFO:tasks.workunit.client.1.smithi190.stdout:1/331: link d6/dc/f2e d6/dc/d29/d38/d43/f61 0 2023-12-06T15:00:21.545 INFO:tasks.workunit.client.1.smithi190.stdout:1/332: fdatasync d6/dc/d29/d38/d39/f3f 0 2023-12-06T15:00:21.549 INFO:tasks.workunit.client.1.smithi190.stdout:8/158: sync 2023-12-06T15:00:21.550 INFO:tasks.workunit.client.1.smithi190.stdout:2/241: mknod d10/c56 0 2023-12-06T15:00:21.550 INFO:tasks.workunit.client.1.smithi190.stdout:2/242: readlink d10/d26/l2e 0 2023-12-06T15:00:21.550 INFO:tasks.workunit.client.1.smithi190.stdout:2/243: getdents d10/d11 0 2023-12-06T15:00:21.551 INFO:tasks.workunit.client.0.smithi152.stdout:1/232: dwrite d3/f5 [0,4194304] 0 2023-12-06T15:00:21.551 INFO:tasks.workunit.client.0.smithi152.stdout:1/233: write d3/f7 [474090,63487] 0 2023-12-06T15:00:21.551 INFO:tasks.workunit.client.0.smithi152.stdout:3/77: dread f7 [0,4194304] 0 2023-12-06T15:00:21.551 INFO:tasks.workunit.client.0.smithi152.stdout:3/78: fdatasync f6 0 2023-12-06T15:00:21.552 INFO:tasks.workunit.client.1.smithi190.stdout:7/204: link d0/d5/da/c2d d0/df/d10/d15/c3a 0 2023-12-06T15:00:21.552 INFO:tasks.workunit.client.1.smithi190.stdout:7/205: write d0/d5/d1b/d1c/f23 [932378,16706] 0 2023-12-06T15:00:21.552 INFO:tasks.workunit.client.0.smithi152.stdout:1/234: unlink d3/da/d15/d17/f3c 0 2023-12-06T15:00:21.553 INFO:tasks.workunit.client.1.smithi190.stdout:7/206: read d0/f30 [644618,41210] 0 2023-12-06T15:00:21.553 INFO:tasks.workunit.client.1.smithi190.stdout:3/312: creat d4/d15/d53/f6d x:0 0 0 2023-12-06T15:00:21.553 INFO:tasks.workunit.client.0.smithi152.stdout:3/79: mkdir d9/d10/d12 0 2023-12-06T15:00:21.554 INFO:tasks.workunit.client.1.smithi190.stdout:1/333: creat d6/dc/d3b/f62 x:0 0 0 2023-12-06T15:00:21.554 INFO:tasks.workunit.client.0.smithi152.stdout:1/235: rename d3/f4 to d3/da/d15/f5e 0 2023-12-06T15:00:21.555 INFO:tasks.workunit.client.0.smithi152.stdout:1/236: write d3/da/d15/d17/f41 [681368,25379] 0 2023-12-06T15:00:21.557 INFO:tasks.workunit.client.1.smithi190.stdout:7/207: symlink d0/df/d37/l3b 0 2023-12-06T15:00:21.557 INFO:tasks.workunit.client.0.smithi152.stdout:3/80: mknod d9/d10/c13 0 2023-12-06T15:00:21.557 INFO:tasks.workunit.client.0.smithi152.stdout:1/237: creat d3/da/d15/d17/d1a/f5f x:0 0 0 2023-12-06T15:00:21.558 INFO:tasks.workunit.client.0.smithi152.stdout:3/81: write f2 [1656445,40291] 0 2023-12-06T15:00:21.558 INFO:tasks.workunit.client.1.smithi190.stdout:3/313: mknod d4/d1b/d54/c6e 0 2023-12-06T15:00:21.561 INFO:tasks.workunit.client.1.smithi190.stdout:7/208: link d0/f3 d0/df/d10/f3c 0 2023-12-06T15:00:21.561 INFO:tasks.workunit.client.1.smithi190.stdout:7/209: chown d0/d5/da/c25 1049437 1 2023-12-06T15:00:21.563 INFO:tasks.workunit.client.0.smithi152.stdout:3/82: symlink d9/l14 0 2023-12-06T15:00:21.563 INFO:tasks.workunit.client.0.smithi152.stdout:3/83: stat d9 0 2023-12-06T15:00:21.563 INFO:tasks.workunit.client.1.smithi190.stdout:8/159: dread d1/f16 [0,4194304] 0 2023-12-06T15:00:21.564 INFO:tasks.workunit.client.1.smithi190.stdout:8/160: stat d1/d10/d1c 0 2023-12-06T15:00:21.564 INFO:tasks.workunit.client.1.smithi190.stdout:3/314: rename d4/d15/d19/f3f to d4/d1b/d69/f6f 0 2023-12-06T15:00:21.564 INFO:tasks.workunit.client.0.smithi152.stdout:3/84: mknod d9/c15 0 2023-12-06T15:00:21.565 INFO:tasks.workunit.client.1.smithi190.stdout:2/244: dread d10/d26/f2f [0,4194304] 0 2023-12-06T15:00:21.568 INFO:tasks.workunit.client.0.smithi152.stdout:1/238: truncate d3/da/db/d18/d52/d55/f56 829778 0 2023-12-06T15:00:21.568 INFO:tasks.workunit.client.0.smithi152.stdout:1/239: fsync d3/da/db/d18/f31 0 2023-12-06T15:00:21.569 INFO:tasks.workunit.client.0.smithi152.stdout:1/240: creat d3/da/d15/d17/f60 x:0 0 0 2023-12-06T15:00:21.571 INFO:tasks.workunit.client.0.smithi152.stdout:1/241: rename d3/da/db/l12 to d3/da/db/d18/d52/l61 0 2023-12-06T15:00:21.572 INFO:tasks.workunit.client.1.smithi190.stdout:1/334: dwrite d6/dc/d29/d38/d39/f3e [4194304,4194304] 0 2023-12-06T15:00:21.573 INFO:tasks.workunit.client.1.smithi190.stdout:6/207: write d4/d12/f1d [5030984,113628] 0 2023-12-06T15:00:21.573 INFO:tasks.workunit.client.1.smithi190.stdout:5/187: sync 2023-12-06T15:00:21.576 INFO:tasks.workunit.client.1.smithi190.stdout:0/174: sync 2023-12-06T15:00:21.576 INFO:tasks.workunit.client.1.smithi190.stdout:6/208: write d4/f14 [2772887,86657] 0 2023-12-06T15:00:21.576 INFO:tasks.workunit.client.1.smithi190.stdout:5/188: read d0/d12/f1f [3900401,27178] 0 2023-12-06T15:00:21.580 INFO:tasks.workunit.client.1.smithi190.stdout:0/175: creat d0/f2e x:0 0 0 2023-12-06T15:00:21.583 INFO:tasks.workunit.client.1.smithi190.stdout:1/335: dread d6/dc/f51 [0,4194304] 0 2023-12-06T15:00:21.584 INFO:tasks.workunit.client.1.smithi190.stdout:6/209: creat d4/f35 x:0 0 0 2023-12-06T15:00:21.585 INFO:tasks.workunit.client.1.smithi190.stdout:5/189: creat d0/d1c/f37 x:0 0 0 2023-12-06T15:00:21.587 INFO:tasks.workunit.client.1.smithi190.stdout:1/336: mkdir d6/dc/d29/d38/d39/d63 0 2023-12-06T15:00:21.589 INFO:tasks.workunit.client.1.smithi190.stdout:6/210: symlink d4/d12/l36 0 2023-12-06T15:00:21.591 INFO:tasks.workunit.client.1.smithi190.stdout:5/190: truncate d0/f24 870842 0 2023-12-06T15:00:21.595 INFO:tasks.workunit.client.1.smithi190.stdout:7/210: dwrite d0/f30 [0,4194304] 0 2023-12-06T15:00:21.595 INFO:tasks.workunit.client.1.smithi190.stdout:7/211: chown d0/df/d1f/f29 0 1 2023-12-06T15:00:21.595 INFO:tasks.workunit.client.1.smithi190.stdout:7/212: stat d0/f30 0 2023-12-06T15:00:21.597 INFO:tasks.workunit.client.1.smithi190.stdout:6/211: symlink d4/d15/l37 0 2023-12-06T15:00:21.597 INFO:tasks.workunit.client.1.smithi190.stdout:6/212: truncate d4/fe 1371156 0 2023-12-06T15:00:21.597 INFO:tasks.workunit.client.1.smithi190.stdout:7/213: dread d0/d5/f8 [0,4194304] 0 2023-12-06T15:00:21.598 INFO:tasks.workunit.client.1.smithi190.stdout:5/191: creat d0/df/f38 x:0 0 0 2023-12-06T15:00:21.599 INFO:tasks.workunit.client.1.smithi190.stdout:5/192: dread d0/d1c/f33 [4194304,4194304] 0 2023-12-06T15:00:21.600 INFO:tasks.workunit.client.1.smithi190.stdout:6/213: truncate d4/d12/d1a/f20 1069925 0 2023-12-06T15:00:21.601 INFO:tasks.workunit.client.1.smithi190.stdout:7/214: symlink d0/d5/da/l3d 0 2023-12-06T15:00:21.601 INFO:tasks.workunit.client.1.smithi190.stdout:7/215: dread - d0/f34 zero size 2023-12-06T15:00:21.601 INFO:tasks.workunit.client.1.smithi190.stdout:7/216: chown d0/d5/d1b/l27 10227 1 2023-12-06T15:00:21.601 INFO:tasks.workunit.client.0.smithi152.stdout:4/164: sync 2023-12-06T15:00:21.602 INFO:tasks.workunit.client.0.smithi152.stdout:4/165: write d2/d10/f17 [868643,52230] 0 2023-12-06T15:00:21.602 INFO:tasks.workunit.client.0.smithi152.stdout:5/75: sync 2023-12-06T15:00:21.602 INFO:tasks.workunit.client.0.smithi152.stdout:5/76: write d7/f15 [909183,7904] 0 2023-12-06T15:00:21.604 INFO:tasks.workunit.client.1.smithi190.stdout:5/193: creat d0/d12/f39 x:0 0 0 2023-12-06T15:00:21.604 INFO:tasks.workunit.client.1.smithi190.stdout:6/214: creat d4/d12/d1a/f38 x:0 0 0 2023-12-06T15:00:21.605 INFO:tasks.workunit.client.1.smithi190.stdout:7/217: getdents d0/d5 0 2023-12-06T15:00:21.606 INFO:tasks.workunit.client.0.smithi152.stdout:5/77: dread d7/fb [0,4194304] 0 2023-12-06T15:00:21.606 INFO:tasks.workunit.client.0.smithi152.stdout:4/166: dread d2/d10/f2a [0,4194304] 0 2023-12-06T15:00:21.608 INFO:tasks.workunit.client.0.smithi152.stdout:5/78: rename d7/fe to d7/dd/f16 0 2023-12-06T15:00:21.608 INFO:tasks.workunit.client.0.smithi152.stdout:5/79: write d7/dd/f12 [1056459,59710] 0 2023-12-06T15:00:21.608 INFO:tasks.workunit.client.0.smithi152.stdout:4/167: symlink d2/d10/d27/l2d 0 2023-12-06T15:00:21.609 INFO:tasks.workunit.client.1.smithi190.stdout:7/218: dread d0/d5/d1b/d1c/f23 [0,4194304] 0 2023-12-06T15:00:21.609 INFO:tasks.workunit.client.1.smithi190.stdout:7/219: fsync d0/d5/d1b/d1c/f23 0 2023-12-06T15:00:21.609 INFO:tasks.workunit.client.1.smithi190.stdout:6/215: rename d4/d12/d1a/f1f to d4/d12/d1a/f39 0 2023-12-06T15:00:21.609 INFO:tasks.workunit.client.1.smithi190.stdout:6/216: read d4/d12/d1a/f28 [515609,106168] 0 2023-12-06T15:00:21.609 INFO:tasks.workunit.client.1.smithi190.stdout:6/217: readlink d4/l6 0 2023-12-06T15:00:21.610 INFO:tasks.workunit.client.1.smithi190.stdout:6/218: mknod d4/c3a 0 2023-12-06T15:00:21.610 INFO:tasks.workunit.client.1.smithi190.stdout:6/219: chown d4/d12/d1a/l2c 5 1 2023-12-06T15:00:21.611 INFO:tasks.workunit.client.1.smithi190.stdout:6/220: write d4/d12/d1a/f1c [435891,79266] 0 2023-12-06T15:00:21.611 INFO:tasks.workunit.client.1.smithi190.stdout:6/221: truncate d4/f35 740768 0 2023-12-06T15:00:21.612 INFO:tasks.workunit.client.1.smithi190.stdout:6/222: symlink d4/d12/d1a/l3b 0 2023-12-06T15:00:21.614 INFO:tasks.workunit.client.1.smithi190.stdout:8/161: dwrite d1/f1a [0,4194304] 0 2023-12-06T15:00:21.614 INFO:tasks.workunit.client.1.smithi190.stdout:6/223: unlink d4/f14 0 2023-12-06T15:00:21.615 INFO:tasks.workunit.client.1.smithi190.stdout:8/162: write d1/f1a [3809554,34434] 0 2023-12-06T15:00:21.616 INFO:tasks.workunit.client.1.smithi190.stdout:9/210: sync 2023-12-06T15:00:21.616 INFO:tasks.workunit.client.1.smithi190.stdout:0/176: dwrite d0/f2e [0,4194304] 0 2023-12-06T15:00:21.617 INFO:tasks.workunit.client.0.smithi152.stdout:1/242: dwrite d3/da/db/f4b [0,4194304] 0 2023-12-06T15:00:21.618 INFO:tasks.workunit.client.1.smithi190.stdout:6/224: truncate d4/d12/d1a/f28 417924 0 2023-12-06T15:00:21.618 INFO:tasks.workunit.client.1.smithi190.stdout:8/163: rmdir d1 39 2023-12-06T15:00:21.620 INFO:tasks.workunit.client.0.smithi152.stdout:3/85: dwrite f2 [0,4194304] 0 2023-12-06T15:00:21.620 INFO:tasks.workunit.client.0.smithi152.stdout:3/86: chown d9/d10/c13 512807629 1 2023-12-06T15:00:21.620 INFO:tasks.workunit.client.1.smithi190.stdout:0/177: symlink d0/da/d1a/l2f 0 2023-12-06T15:00:21.621 INFO:tasks.workunit.client.1.smithi190.stdout:7/220: dread d0/df/d10/f3c [0,4194304] 0 2023-12-06T15:00:21.623 INFO:tasks.workunit.client.1.smithi190.stdout:6/225: creat d4/d15/f3c x:0 0 0 2023-12-06T15:00:21.624 INFO:tasks.workunit.client.0.smithi152.stdout:4/168: dread d2/d10/f17 [0,4194304] 0 2023-12-06T15:00:21.624 INFO:tasks.workunit.client.0.smithi152.stdout:3/87: creat d9/d10/f16 x:0 0 0 2023-12-06T15:00:21.627 INFO:tasks.workunit.client.1.smithi190.stdout:8/164: mkdir d1/d10/d12/d31 0 2023-12-06T15:00:21.629 INFO:tasks.workunit.client.0.smithi152.stdout:5/80: truncate f6 90097 0 2023-12-06T15:00:21.629 INFO:tasks.workunit.client.0.smithi152.stdout:4/169: symlink d2/d15/d23/l2e 0 2023-12-06T15:00:21.629 INFO:tasks.workunit.client.0.smithi152.stdout:4/170: write d2/d10/d27/f2c [508916,19004] 0 2023-12-06T15:00:21.629 INFO:tasks.workunit.client.0.smithi152.stdout:4/171: stat d2/f1b 0 2023-12-06T15:00:21.630 INFO:tasks.workunit.client.1.smithi190.stdout:0/178: rmdir d0/da/d1a 39 2023-12-06T15:00:21.631 INFO:tasks.workunit.client.0.smithi152.stdout:5/81: link d7/c9 d7/dd/c17 0 2023-12-06T15:00:21.631 INFO:tasks.workunit.client.1.smithi190.stdout:7/221: mkdir d0/df/d10/d2f/d3e 0 2023-12-06T15:00:21.632 INFO:tasks.workunit.client.1.smithi190.stdout:7/222: write d0/f3 [1474805,78411] 0 2023-12-06T15:00:21.635 INFO:tasks.workunit.client.1.smithi190.stdout:8/165: symlink d1/d10/d25/l32 0 2023-12-06T15:00:21.635 INFO:tasks.workunit.client.1.smithi190.stdout:8/166: stat d1/d10/d12/d31 0 2023-12-06T15:00:21.639 INFO:tasks.workunit.client.1.smithi190.stdout:0/179: dread d0/f2e [0,4194304] 0 2023-12-06T15:00:21.639 INFO:tasks.workunit.client.1.smithi190.stdout:0/180: fsync d0/d4/f21 0 2023-12-06T15:00:21.639 INFO:tasks.workunit.client.1.smithi190.stdout:0/181: chown d0/da/f22 172 1 2023-12-06T15:00:21.639 INFO:tasks.workunit.client.1.smithi190.stdout:0/182: fsync d0/d4/f26 0 2023-12-06T15:00:21.639 INFO:tasks.workunit.client.1.smithi190.stdout:3/315: rename d4/d15 to d4/d70 0 2023-12-06T15:00:21.640 INFO:tasks.workunit.client.1.smithi190.stdout:0/183: mknod d0/da/d1a/d2b/c30 0 2023-12-06T15:00:21.640 INFO:tasks.workunit.client.1.smithi190.stdout:0/184: rename d0 to d0/d31 22 2023-12-06T15:00:21.641 INFO:tasks.workunit.client.1.smithi190.stdout:8/167: write d1/d10/d1c/f1f [2008949,98992] 0 2023-12-06T15:00:21.643 INFO:tasks.workunit.client.1.smithi190.stdout:3/316: creat d4/d1b/d5d/f71 x:0 0 0 2023-12-06T15:00:21.644 INFO:tasks.workunit.client.1.smithi190.stdout:0/185: rmdir d0/da 39 2023-12-06T15:00:21.644 INFO:tasks.workunit.client.1.smithi190.stdout:7/223: dread d0/d5/d1b/d1c/f28 [0,4194304] 0 2023-12-06T15:00:21.645 INFO:tasks.workunit.client.1.smithi190.stdout:0/186: write d0/f18 [709587,44325] 0 2023-12-06T15:00:21.645 INFO:tasks.workunit.client.1.smithi190.stdout:0/187: truncate d0/f2d 749639 0 2023-12-06T15:00:21.646 INFO:tasks.workunit.client.1.smithi190.stdout:8/168: unlink d1/d10/d1c/f1f 0 2023-12-06T15:00:21.648 INFO:tasks.workunit.client.1.smithi190.stdout:3/317: mkdir d4/d70/d19/d3a/d3b/d72 0 2023-12-06T15:00:21.649 INFO:tasks.workunit.client.1.smithi190.stdout:7/224: creat d0/df/f3f x:0 0 0 2023-12-06T15:00:21.651 INFO:tasks.workunit.client.1.smithi190.stdout:0/188: rename d0/da/d1a/d2b/c30 to d0/da/c32 0 2023-12-06T15:00:21.651 INFO:tasks.workunit.client.1.smithi190.stdout:7/225: rename d0/d5 to d0/d5/da/d40 22 2023-12-06T15:00:21.651 INFO:tasks.workunit.client.0.smithi152.stdout:1/243: dwrite d3/da/d15/d17/d1a/f28 [0,4194304] 0 2023-12-06T15:00:21.651 INFO:tasks.workunit.client.0.smithi152.stdout:3/88: dwrite f6 [4194304,4194304] 0 2023-12-06T15:00:21.651 INFO:tasks.workunit.client.0.smithi152.stdout:3/89: chown d9/le 3857 1 2023-12-06T15:00:21.652 INFO:tasks.workunit.client.1.smithi190.stdout:9/211: dwrite d4/d27/d2f/d31/f38 [4194304,4194304] 0 2023-12-06T15:00:21.653 INFO:tasks.workunit.client.0.smithi152.stdout:4/172: dread d2/d10/d27/f2c [0,4194304] 0 2023-12-06T15:00:21.653 INFO:tasks.workunit.client.0.smithi152.stdout:4/173: readlink d2/d10/d27/l2b 0 2023-12-06T15:00:21.653 INFO:tasks.workunit.client.1.smithi190.stdout:8/169: unlink d1/f19 0 2023-12-06T15:00:21.654 INFO:tasks.workunit.client.1.smithi190.stdout:1/337: rmdir d6/dc/d29 39 2023-12-06T15:00:21.654 INFO:tasks.workunit.client.1.smithi190.stdout:1/338: read d6/dc/f51 [3088996,86874] 0 2023-12-06T15:00:21.656 INFO:tasks.workunit.client.0.smithi152.stdout:5/82: truncate d7/dd/f12 233556 0 2023-12-06T15:00:21.656 INFO:tasks.workunit.client.0.smithi152.stdout:1/244: write d3/da/d15/d17/d1a/f28 [2411715,118772] 0 2023-12-06T15:00:21.657 INFO:tasks.workunit.client.1.smithi190.stdout:0/189: write d0/d4/f26 [2678800,127737] 0 2023-12-06T15:00:21.657 INFO:tasks.workunit.client.1.smithi190.stdout:0/190: stat d0/da/d1a/c1f 0 2023-12-06T15:00:21.657 INFO:tasks.workunit.client.1.smithi190.stdout:8/170: read d1/d10/d1c/f22 [3817603,118080] 0 2023-12-06T15:00:21.658 INFO:tasks.workunit.client.1.smithi190.stdout:0/191: dread d0/f2d [0,4194304] 0 2023-12-06T15:00:21.658 INFO:tasks.workunit.client.0.smithi152.stdout:3/90: mknod d9/d10/c17 0 2023-12-06T15:00:21.658 INFO:tasks.workunit.client.0.smithi152.stdout:3/91: chown d9/c15 13 1 2023-12-06T15:00:21.658 INFO:tasks.workunit.client.0.smithi152.stdout:3/92: fdatasync d9/d10/f16 0 2023-12-06T15:00:21.658 INFO:tasks.workunit.client.0.smithi152.stdout:3/93: stat f7 0 2023-12-06T15:00:21.658 INFO:tasks.workunit.client.0.smithi152.stdout:3/94: write d9/d10/f16 [682723,31672] 0 2023-12-06T15:00:21.658 INFO:tasks.workunit.client.0.smithi152.stdout:1/245: dread d3/da/db/d18/f31 [0,4194304] 0 2023-12-06T15:00:21.658 INFO:tasks.workunit.client.0.smithi152.stdout:1/246: readlink d3/da/db/l10 0 2023-12-06T15:00:21.659 INFO:tasks.workunit.client.1.smithi190.stdout:7/226: truncate d0/d5/da/fb 736644 0 2023-12-06T15:00:21.659 INFO:tasks.workunit.client.0.smithi152.stdout:4/174: mkdir d2/d22/d2f 0 2023-12-06T15:00:21.659 INFO:tasks.workunit.client.0.smithi152.stdout:4/175: stat d2/f8 0 2023-12-06T15:00:21.659 INFO:tasks.workunit.client.0.smithi152.stdout:5/83: creat d7/f18 x:0 0 0 2023-12-06T15:00:21.661 INFO:tasks.workunit.client.0.smithi152.stdout:1/247: mkdir d3/da/db/d18/d52/d62 0 2023-12-06T15:00:21.662 INFO:tasks.workunit.client.0.smithi152.stdout:5/84: creat d7/f19 x:0 0 0 2023-12-06T15:00:21.664 INFO:tasks.workunit.client.0.smithi152.stdout:1/248: mkdir d3/da/d4c/d63 0 2023-12-06T15:00:21.664 INFO:tasks.workunit.client.0.smithi152.stdout:1/249: write d3/da/d15/f57 [526426,20881] 0 2023-12-06T15:00:21.664 INFO:tasks.workunit.client.0.smithi152.stdout:1/250: write d3/da/d15/d17/d1a/f4e [1025088,128562] 0 2023-12-06T15:00:21.664 INFO:tasks.workunit.client.0.smithi152.stdout:1/251: chown d3/f2b 1665016 1 2023-12-06T15:00:21.664 INFO:tasks.workunit.client.0.smithi152.stdout:5/85: mknod d7/c1a 0 2023-12-06T15:00:21.664 INFO:tasks.workunit.client.0.smithi152.stdout:4/176: write d2/d22/f18 [677658,104336] 0 2023-12-06T15:00:21.665 INFO:tasks.workunit.client.0.smithi152.stdout:1/252: creat d3/da/d15/d17/d58/f64 x:0 0 0 2023-12-06T15:00:21.666 INFO:tasks.workunit.client.0.smithi152.stdout:5/86: mknod d7/c1b 0 2023-12-06T15:00:21.667 INFO:tasks.workunit.client.0.smithi152.stdout:4/177: creat d2/d10/d27/d29/f30 x:0 0 0 2023-12-06T15:00:21.667 INFO:tasks.workunit.client.0.smithi152.stdout:1/253: mkdir d3/da/d65 0 2023-12-06T15:00:21.669 INFO:tasks.workunit.client.0.smithi152.stdout:1/254: creat d3/da/d15/d17/d43/f66 x:0 0 0 2023-12-06T15:00:21.670 INFO:tasks.workunit.client.0.smithi152.stdout:1/255: mknod d3/da/db/c67 0 2023-12-06T15:00:21.671 INFO:tasks.workunit.client.0.smithi152.stdout:1/256: creat d3/da/d65/f68 x:0 0 0 2023-12-06T15:00:21.671 INFO:tasks.workunit.client.1.smithi190.stdout:9/212: rename d4/l1e to d4/l4a 0 2023-12-06T15:00:21.671 INFO:tasks.workunit.client.1.smithi190.stdout:9/213: write d4/f21 [4866652,3856] 0 2023-12-06T15:00:21.672 INFO:tasks.workunit.client.1.smithi190.stdout:3/318: dwrite d4/d70/d33/d36/f4f [0,4194304] 0 2023-12-06T15:00:21.672 INFO:tasks.workunit.client.0.smithi152.stdout:3/95: dread f2 [0,4194304] 0 2023-12-06T15:00:21.672 INFO:tasks.workunit.client.0.smithi152.stdout:1/257: mknod d3/da/d15/d17/d43/c69 0 2023-12-06T15:00:21.672 INFO:tasks.workunit.client.0.smithi152.stdout:1/258: write d3/da/d15/d17/f60 [193286,36293] 0 2023-12-06T15:00:21.673 INFO:tasks.workunit.client.1.smithi190.stdout:1/339: rename d6/l8 to d6/dc/d29/d38/d39/d63/l64 0 2023-12-06T15:00:21.674 INFO:tasks.workunit.client.0.smithi152.stdout:1/259: creat d3/da/db/d54/f6a x:0 0 0 2023-12-06T15:00:21.676 INFO:tasks.workunit.client.0.smithi152.stdout:1/260: creat d3/da/db/d18/d52/d62/f6b x:0 0 0 2023-12-06T15:00:21.676 INFO:tasks.workunit.client.0.smithi152.stdout:3/96: mkdir d9/d18 0 2023-12-06T15:00:21.678 INFO:tasks.workunit.client.1.smithi190.stdout:5/194: rmdir d0/d12 39 2023-12-06T15:00:21.678 INFO:tasks.workunit.client.1.smithi190.stdout:8/171: truncate d1/d10/d12/f18 3571750 0 2023-12-06T15:00:21.679 INFO:tasks.workunit.client.0.smithi152.stdout:4/178: dread f1 [0,4194304] 0 2023-12-06T15:00:21.681 INFO:tasks.workunit.client.1.smithi190.stdout:0/192: creat d0/da/d1a/d2b/f33 x:0 0 0 2023-12-06T15:00:21.682 INFO:tasks.workunit.client.0.smithi152.stdout:4/179: unlink d2/fa 0 2023-12-06T15:00:21.682 INFO:tasks.workunit.client.0.smithi152.stdout:4/180: fsync d2/d10/f24 0 2023-12-06T15:00:21.682 INFO:tasks.workunit.client.0.smithi152.stdout:4/181: stat d2/lb 0 2023-12-06T15:00:21.683 INFO:tasks.workunit.client.1.smithi190.stdout:7/227: mkdir d0/d5/d1b/d41 0 2023-12-06T15:00:21.683 INFO:tasks.workunit.client.1.smithi190.stdout:0/193: dread d0/da/f22 [0,4194304] 0 2023-12-06T15:00:21.683 INFO:tasks.workunit.client.0.smithi152.stdout:4/182: rename d2/d15/d23/l25 to d2/d22/d2f/l31 0 2023-12-06T15:00:21.684 INFO:tasks.workunit.client.0.smithi152.stdout:4/183: write d2/f1b [945386,43750] 0 2023-12-06T15:00:21.685 INFO:tasks.workunit.client.0.smithi152.stdout:4/184: mkdir d2/d15/d32 0 2023-12-06T15:00:21.685 INFO:tasks.workunit.client.1.smithi190.stdout:3/319: dread d4/d1b/f38 [0,4194304] 0 2023-12-06T15:00:21.685 INFO:tasks.workunit.client.1.smithi190.stdout:3/320: stat d4/f5 0 2023-12-06T15:00:21.685 INFO:tasks.workunit.client.1.smithi190.stdout:9/214: link d4/f14 d4/d27/d2f/d31/f4b 0 2023-12-06T15:00:21.686 INFO:tasks.workunit.client.0.smithi152.stdout:5/87: dwrite f5 [0,4194304] 0 2023-12-06T15:00:21.687 INFO:tasks.workunit.client.1.smithi190.stdout:6/226: getdents d4/d12/d1a 0 2023-12-06T15:00:21.688 INFO:tasks.workunit.client.1.smithi190.stdout:1/340: symlink d6/dc/d29/l65 0 2023-12-06T15:00:21.688 INFO:tasks.workunit.client.1.smithi190.stdout:1/341: readlink d6/lb 0 2023-12-06T15:00:21.688 INFO:tasks.workunit.client.1.smithi190.stdout:1/342: readlink d6/dc/d29/d38/d43/l4a 0 2023-12-06T15:00:21.690 INFO:tasks.workunit.client.1.smithi190.stdout:5/195: symlink d0/d12/l3a 0 2023-12-06T15:00:21.690 INFO:tasks.workunit.client.1.smithi190.stdout:5/196: fsync d0/f6 0 2023-12-06T15:00:21.690 INFO:tasks.workunit.client.1.smithi190.stdout:5/197: write d0/df/f20 [643375,127374] 0 2023-12-06T15:00:21.691 INFO:tasks.workunit.client.0.smithi152.stdout:5/88: rmdir d7 39 2023-12-06T15:00:21.691 INFO:tasks.workunit.client.0.smithi152.stdout:5/89: write f5 [5191892,64768] 0 2023-12-06T15:00:21.693 INFO:tasks.workunit.client.0.smithi152.stdout:4/185: dread d2/f1b [0,4194304] 0 2023-12-06T15:00:21.693 INFO:tasks.workunit.client.0.smithi152.stdout:4/186: truncate d2/d10/d27/f2c 731082 0 2023-12-06T15:00:21.694 INFO:tasks.workunit.client.0.smithi152.stdout:5/90: creat d7/dd/f1c x:0 0 0 2023-12-06T15:00:21.695 INFO:tasks.workunit.client.1.smithi190.stdout:0/194: rename d0/da/l14 to d0/l34 0 2023-12-06T15:00:21.695 INFO:tasks.workunit.client.0.smithi152.stdout:4/187: write d2/f9 [2862619,25317] 0 2023-12-06T15:00:21.696 INFO:tasks.workunit.client.1.smithi190.stdout:7/228: creat d0/df/f42 x:0 0 0 2023-12-06T15:00:21.697 INFO:tasks.workunit.client.0.smithi152.stdout:3/97: getdents d9 0 2023-12-06T15:00:21.697 INFO:tasks.workunit.client.1.smithi190.stdout:3/321: truncate d4/d70/d19/d3a/d3b/f55 125413 0 2023-12-06T15:00:21.699 INFO:tasks.workunit.client.0.smithi152.stdout:3/98: mkdir d9/d10/d19 0 2023-12-06T15:00:21.699 INFO:tasks.workunit.client.1.smithi190.stdout:9/215: symlink d4/l4c 0 2023-12-06T15:00:21.700 INFO:tasks.workunit.client.0.smithi152.stdout:3/99: write f7 [3968447,119163] 0 2023-12-06T15:00:21.700 INFO:tasks.workunit.client.0.smithi152.stdout:5/91: dread f5 [4194304,4194304] 0 2023-12-06T15:00:21.701 INFO:tasks.workunit.client.1.smithi190.stdout:6/227: mkdir d4/d12/d1a/d3d 0 2023-12-06T15:00:21.701 INFO:tasks.workunit.client.1.smithi190.stdout:6/228: chown d4/f30 498829319 1 2023-12-06T15:00:21.702 INFO:tasks.workunit.client.1.smithi190.stdout:1/343: dread d6/dc/f15 [0,4194304] 0 2023-12-06T15:00:21.702 INFO:tasks.workunit.client.1.smithi190.stdout:5/198: symlink d0/df/l3b 0 2023-12-06T15:00:21.703 INFO:tasks.workunit.client.1.smithi190.stdout:5/199: write d0/fb [7738756,14431] 0 2023-12-06T15:00:21.703 INFO:tasks.workunit.client.1.smithi190.stdout:0/195: mknod d0/da/d1a/d2b/c35 0 2023-12-06T15:00:21.703 INFO:tasks.workunit.client.1.smithi190.stdout:0/196: truncate d0/da/ff 9114581 0 2023-12-06T15:00:21.704 INFO:tasks.workunit.client.0.smithi152.stdout:5/92: creat d7/dd/f1d x:0 0 0 2023-12-06T15:00:21.707 INFO:tasks.workunit.client.1.smithi190.stdout:7/229: rename d0/d5/da/c2d to d0/d5/d1b/d33/c43 0 2023-12-06T15:00:21.707 INFO:tasks.workunit.client.1.smithi190.stdout:7/230: write d0/df/f42 [1019927,123318] 0 2023-12-06T15:00:21.709 INFO:tasks.workunit.client.1.smithi190.stdout:3/322: unlink d4/d1b/f64 0 2023-12-06T15:00:21.709 INFO:tasks.workunit.client.1.smithi190.stdout:9/216: creat d4/d27/f4d x:0 0 0 2023-12-06T15:00:21.709 INFO:tasks.workunit.client.1.smithi190.stdout:3/323: write d4/d70/d19/d1c/f4e [970707,78898] 0 2023-12-06T15:00:21.709 INFO:tasks.workunit.client.1.smithi190.stdout:6/229: mknod d4/c3e 0 2023-12-06T15:00:21.710 INFO:tasks.workunit.client.1.smithi190.stdout:8/172: rmdir d1/d10/d25 39 2023-12-06T15:00:21.710 INFO:tasks.workunit.client.1.smithi190.stdout:8/173: truncate d1/d10/d12/f2d 241523 0 2023-12-06T15:00:21.710 INFO:tasks.workunit.client.1.smithi190.stdout:8/174: chown d1/d10/d25/c28 77 1 2023-12-06T15:00:21.711 INFO:tasks.workunit.client.1.smithi190.stdout:5/200: rmdir d0/d1c/d2b 39 2023-12-06T15:00:21.716 INFO:tasks.workunit.client.1.smithi190.stdout:0/197: unlink d0/da/d1a/l2a 0 2023-12-06T15:00:21.716 INFO:tasks.workunit.client.1.smithi190.stdout:1/344: rename d6/dc/d29/d34/l45 to d6/dc/l66 0 2023-12-06T15:00:21.716 INFO:tasks.workunit.client.1.smithi190.stdout:1/345: readlink d6/dc/le 0 2023-12-06T15:00:21.717 INFO:tasks.workunit.client.1.smithi190.stdout:9/217: mknod d4/d27/d2f/c4e 0 2023-12-06T15:00:21.719 INFO:tasks.workunit.client.1.smithi190.stdout:3/324: creat d4/d70/d19/d3a/f73 x:0 0 0 2023-12-06T15:00:21.719 INFO:tasks.workunit.client.1.smithi190.stdout:0/198: creat d0/da/d1a/d2b/f36 x:0 0 0 2023-12-06T15:00:21.721 INFO:tasks.workunit.client.1.smithi190.stdout:5/201: rename d0/d12/l26 to d0/d1c/d2b/d2c/l3c 0 2023-12-06T15:00:21.723 INFO:tasks.workunit.client.1.smithi190.stdout:1/346: mkdir d6/dc/d29/d38/d39/d63/d67 0 2023-12-06T15:00:21.725 INFO:tasks.workunit.client.1.smithi190.stdout:3/325: symlink d4/d70/d19/d3a/l74 0 2023-12-06T15:00:21.727 INFO:tasks.workunit.client.1.smithi190.stdout:0/199: stat d0/da/l13 0 2023-12-06T15:00:21.727 INFO:tasks.workunit.client.1.smithi190.stdout:0/200: write d0/da/f25 [758564,36050] 0 2023-12-06T15:00:21.731 INFO:tasks.workunit.client.1.smithi190.stdout:1/347: creat d6/d49/f68 x:0 0 0 2023-12-06T15:00:21.732 INFO:tasks.workunit.client.1.smithi190.stdout:1/348: chown d6/dc/d29/d38/d39/d63 11774 1 2023-12-06T15:00:21.732 INFO:tasks.workunit.client.1.smithi190.stdout:1/349: fsync d6/f21 0 2023-12-06T15:00:21.733 INFO:tasks.workunit.client.0.smithi152.stdout:4/188: dwrite d2/f1f [0,4194304] 0 2023-12-06T15:00:21.733 INFO:tasks.workunit.client.1.smithi190.stdout:0/201: mkdir d0/da/d1a/d2b/d37 0 2023-12-06T15:00:21.735 INFO:tasks.workunit.client.1.smithi190.stdout:1/350: link d6/dc/d29/d38/d39/f3e d6/f69 0 2023-12-06T15:00:21.740 INFO:tasks.workunit.client.0.smithi152.stdout:4/189: rmdir d2/d10/d27/d29 39 2023-12-06T15:00:21.740 INFO:tasks.workunit.client.1.smithi190.stdout:1/351: dread d6/dc/d29/d38/d43/f61 [0,4194304] 0 2023-12-06T15:00:21.743 INFO:tasks.workunit.client.1.smithi190.stdout:3/326: dread d4/d70/d33/d36/f27 [0,4194304] 0 2023-12-06T15:00:21.744 INFO:tasks.workunit.client.1.smithi190.stdout:3/327: dread d4/d1b/f34 [0,4194304] 0 2023-12-06T15:00:21.744 INFO:tasks.workunit.client.1.smithi190.stdout:1/352: creat d6/dc/d29/d38/d39/f6a x:0 0 0 2023-12-06T15:00:21.746 INFO:tasks.workunit.client.1.smithi190.stdout:1/353: truncate d6/f21 2042530 0 2023-12-06T15:00:21.747 INFO:tasks.workunit.client.1.smithi190.stdout:1/354: truncate d6/f22 541896 0 2023-12-06T15:00:21.747 INFO:tasks.workunit.client.1.smithi190.stdout:7/231: dwrite d0/df/f3f [0,4194304] 0 2023-12-06T15:00:21.747 INFO:tasks.workunit.client.1.smithi190.stdout:7/232: fsync d0/f34 0 2023-12-06T15:00:21.748 INFO:tasks.workunit.client.0.smithi152.stdout:3/100: dwrite d9/d10/f16 [0,4194304] 0 2023-12-06T15:00:21.748 INFO:tasks.workunit.client.1.smithi190.stdout:3/328: mknod d4/d70/d19/d1c/d3d/c75 0 2023-12-06T15:00:21.750 INFO:tasks.workunit.client.1.smithi190.stdout:4/194: sync 2023-12-06T15:00:21.750 INFO:tasks.workunit.client.1.smithi190.stdout:1/355: rmdir d6/dc/d3b 39 2023-12-06T15:00:21.751 INFO:tasks.workunit.client.0.smithi152.stdout:3/101: unlink d9/le 0 2023-12-06T15:00:21.752 INFO:tasks.workunit.client.0.smithi152.stdout:3/102: truncate d9/ff 2260009 0 2023-12-06T15:00:21.752 INFO:tasks.workunit.client.0.smithi152.stdout:3/103: fdatasync d9/ff 0 2023-12-06T15:00:21.752 INFO:tasks.workunit.client.0.smithi152.stdout:3/104: chown f7 0 1 2023-12-06T15:00:21.753 INFO:tasks.workunit.client.0.smithi152.stdout:4/190: dread d2/d10/f24 [0,4194304] 0 2023-12-06T15:00:21.755 INFO:tasks.workunit.client.0.smithi152.stdout:3/105: write d9/d10/f16 [3783476,35374] 0 2023-12-06T15:00:21.755 INFO:tasks.workunit.client.0.smithi152.stdout:4/191: rename d2/d10/c1d to d2/d22/d2f/c33 0 2023-12-06T15:00:21.759 INFO:tasks.workunit.client.0.smithi152.stdout:4/192: unlink d2/fe 0 2023-12-06T15:00:21.759 INFO:tasks.workunit.client.1.smithi190.stdout:4/195: mkdir d3/d35/d19/d41 0 2023-12-06T15:00:21.760 INFO:tasks.workunit.client.0.smithi152.stdout:4/193: chown d2/fd 190 1 2023-12-06T15:00:21.760 INFO:tasks.workunit.client.1.smithi190.stdout:1/356: mknod d6/dc/d29/d34/d5c/c6b 0 2023-12-06T15:00:21.762 INFO:tasks.workunit.client.1.smithi190.stdout:2/245: sync 2023-12-06T15:00:21.765 INFO:tasks.workunit.client.1.smithi190.stdout:6/230: dwrite d4/f30 [0,4194304] 0 2023-12-06T15:00:21.766 INFO:tasks.workunit.client.0.smithi152.stdout:4/194: dread d2/d22/f18 [0,4194304] 0 2023-12-06T15:00:21.767 INFO:tasks.workunit.client.1.smithi190.stdout:1/357: creat d6/f6c x:0 0 0 2023-12-06T15:00:21.767 INFO:tasks.workunit.client.1.smithi190.stdout:2/246: symlink d10/d26/l57 0 2023-12-06T15:00:21.767 INFO:tasks.workunit.client.1.smithi190.stdout:1/358: truncate d6/dc/d29/d34/f4e 389816 0 2023-12-06T15:00:21.767 INFO:tasks.workunit.client.1.smithi190.stdout:2/247: write d10/d26/f32 [4441500,100150] 0 2023-12-06T15:00:21.767 INFO:tasks.workunit.client.1.smithi190.stdout:2/248: dread - d10/d11/f16 zero size 2023-12-06T15:00:21.767 INFO:tasks.workunit.client.1.smithi190.stdout:2/249: write d10/d26/f3a [632749,65792] 0 2023-12-06T15:00:21.767 INFO:tasks.workunit.client.1.smithi190.stdout:2/250: truncate d10/d31/d37/f41 4355453 0 2023-12-06T15:00:21.768 INFO:tasks.workunit.client.0.smithi152.stdout:4/195: dread d2/d22/f18 [0,4194304] 0 2023-12-06T15:00:21.768 INFO:tasks.workunit.client.1.smithi190.stdout:9/218: dwrite d4/f33 [0,4194304] 0 2023-12-06T15:00:21.771 INFO:tasks.workunit.client.0.smithi152.stdout:4/196: write d2/d10/f24 [1777189,19479] 0 2023-12-06T15:00:21.774 INFO:tasks.workunit.client.1.smithi190.stdout:8/175: write d1/d10/d12/f18 [918214,45458] 0 2023-12-06T15:00:21.775 INFO:tasks.workunit.client.1.smithi190.stdout:5/202: dwrite d0/d12/f15 [0,4194304] 0 2023-12-06T15:00:21.776 INFO:tasks.workunit.client.0.smithi152.stdout:4/197: truncate d2/f26 233501 0 2023-12-06T15:00:21.778 INFO:tasks.workunit.client.1.smithi190.stdout:8/176: symlink d1/d10/d1c/l33 0 2023-12-06T15:00:21.778 INFO:tasks.workunit.client.1.smithi190.stdout:0/202: dwrite d0/da/f22 [0,4194304] 0 2023-12-06T15:00:21.779 INFO:tasks.workunit.client.1.smithi190.stdout:7/233: dwrite d0/d5/d1b/d1c/d17/f26 [4194304,4194304] 0 2023-12-06T15:00:21.779 INFO:tasks.workunit.client.1.smithi190.stdout:7/234: fsync d0/f6 0 2023-12-06T15:00:21.782 INFO:tasks.workunit.client.1.smithi190.stdout:5/203: symlink d0/df/l3d 0 2023-12-06T15:00:21.789 INFO:tasks.workunit.client.0.smithi152.stdout:4/198: truncate d2/f1f 4269383 0 2023-12-06T15:00:21.789 INFO:tasks.workunit.client.1.smithi190.stdout:0/203: creat d0/da/f38 x:0 0 0 2023-12-06T15:00:21.789 INFO:tasks.workunit.client.1.smithi190.stdout:7/235: unlink d0/d5/d1b/d33/c43 0 2023-12-06T15:00:21.790 INFO:tasks.workunit.client.1.smithi190.stdout:5/204: mkdir d0/d1c/d3e 0 2023-12-06T15:00:21.790 INFO:tasks.workunit.client.1.smithi190.stdout:5/205: truncate d0/d1c/f35 5640740 0 2023-12-06T15:00:21.790 INFO:tasks.workunit.client.1.smithi190.stdout:5/206: fdatasync d0/f18 0 2023-12-06T15:00:21.790 INFO:tasks.workunit.client.1.smithi190.stdout:5/207: fsync d0/df/f30 0 2023-12-06T15:00:21.790 INFO:tasks.workunit.client.1.smithi190.stdout:5/208: write d0/d1c/f36 [882803,73817] 0 2023-12-06T15:00:21.790 INFO:tasks.workunit.client.1.smithi190.stdout:5/209: write d0/d12/f39 [382324,60726] 0 2023-12-06T15:00:21.793 INFO:tasks.workunit.client.1.smithi190.stdout:7/236: rename d0/df/d10/l1d to d0/d35/l44 0 2023-12-06T15:00:21.793 INFO:tasks.workunit.client.0.smithi152.stdout:4/199: rename d2/lb to d2/d15/l34 0 2023-12-06T15:00:21.794 INFO:tasks.workunit.client.1.smithi190.stdout:1/359: truncate d6/f21 2048799 0 2023-12-06T15:00:21.794 INFO:tasks.workunit.client.1.smithi190.stdout:7/237: creat d0/df/f45 x:0 0 0 2023-12-06T15:00:21.794 INFO:tasks.workunit.client.1.smithi190.stdout:7/238: dread - d0/df/f45 zero size 2023-12-06T15:00:21.796 INFO:tasks.workunit.client.1.smithi190.stdout:7/239: creat d0/df/d1f/f46 x:0 0 0 2023-12-06T15:00:21.796 INFO:tasks.workunit.client.1.smithi190.stdout:7/240: chown d0/cd 187353 1 2023-12-06T15:00:21.797 INFO:tasks.workunit.client.0.smithi152.stdout:4/200: creat d2/d10/d27/d29/f35 x:0 0 0 2023-12-06T15:00:21.808 INFO:tasks.workunit.client.0.smithi152.stdout:4/201: dread d2/fc [0,4194304] 0 2023-12-06T15:00:21.809 INFO:tasks.workunit.client.1.smithi190.stdout:4/196: dwrite d3/fd [4194304,4194304] 0 2023-12-06T15:00:21.810 INFO:tasks.workunit.client.1.smithi190.stdout:4/197: mknod d3/c42 0 2023-12-06T15:00:21.810 INFO:tasks.workunit.client.1.smithi190.stdout:4/198: truncate d3/f9 1216575 0 2023-12-06T15:00:21.811 INFO:tasks.workunit.client.1.smithi190.stdout:4/199: symlink d3/d10/d15/l43 0 2023-12-06T15:00:21.811 INFO:tasks.workunit.client.1.smithi190.stdout:4/200: mkdir d3/d35/d19/d41/d44 0 2023-12-06T15:00:21.812 INFO:tasks.workunit.client.1.smithi190.stdout:7/241: dread d0/d5/d1b/d1c/f28 [4194304,4194304] 0 2023-12-06T15:00:21.813 INFO:tasks.workunit.client.1.smithi190.stdout:4/201: unlink d3/d35/l32 0 2023-12-06T15:00:21.813 INFO:tasks.workunit.client.1.smithi190.stdout:7/242: symlink d0/d5/da/l47 0 2023-12-06T15:00:21.813 INFO:tasks.workunit.client.1.smithi190.stdout:7/243: stat d0/l2b 0 2023-12-06T15:00:21.814 INFO:tasks.workunit.client.1.smithi190.stdout:7/244: chown d0/df/d10/l14 0 1 2023-12-06T15:00:21.814 INFO:tasks.workunit.client.1.smithi190.stdout:7/245: readlink d0/df/d10/d15/l16 0 2023-12-06T15:00:21.814 INFO:tasks.workunit.client.1.smithi190.stdout:7/246: fdatasync d0/df/d1f/f46 0 2023-12-06T15:00:21.814 INFO:tasks.workunit.client.1.smithi190.stdout:7/247: creat d0/d5/da/f48 x:0 0 0 2023-12-06T15:00:21.814 INFO:tasks.workunit.client.1.smithi190.stdout:7/248: readlink d0/d35/l44 0 2023-12-06T15:00:21.815 INFO:tasks.workunit.client.1.smithi190.stdout:7/249: creat d0/d5/da/f49 x:0 0 0 2023-12-06T15:00:21.815 INFO:tasks.workunit.client.1.smithi190.stdout:7/250: stat d0/df/d10/d15 0 2023-12-06T15:00:21.815 INFO:tasks.workunit.client.1.smithi190.stdout:7/251: chown d0/df/d1f/f46 18169 1 2023-12-06T15:00:21.815 INFO:tasks.workunit.client.0.smithi152.stdout:4/202: write d2/fd [1156752,104958] 0 2023-12-06T15:00:21.816 INFO:tasks.workunit.client.1.smithi190.stdout:7/252: truncate d0/d5/f8 555975 0 2023-12-06T15:00:21.816 INFO:tasks.workunit.client.1.smithi190.stdout:7/253: write d0/df/f42 [1958441,79144] 0 2023-12-06T15:00:21.817 INFO:tasks.workunit.client.1.smithi190.stdout:9/219: dwrite d4/f25 [0,4194304] 0 2023-12-06T15:00:21.817 INFO:tasks.workunit.client.1.smithi190.stdout:9/220: stat d4/d27/d2f/d31/d3f 0 2023-12-06T15:00:21.817 INFO:tasks.workunit.client.1.smithi190.stdout:3/329: dwrite d4/d70/d19/d1c/d3d/f5c [0,4194304] 0 2023-12-06T15:00:21.817 INFO:tasks.workunit.client.1.smithi190.stdout:3/330: dread - d4/d1b/d5d/f71 zero size 2023-12-06T15:00:21.818 INFO:tasks.workunit.client.1.smithi190.stdout:3/331: fdatasync d4/d1b/f22 0 2023-12-06T15:00:21.818 INFO:tasks.workunit.client.1.smithi190.stdout:1/360: dwrite d6/dc/f9 [0,4194304] 0 2023-12-06T15:00:21.818 INFO:tasks.workunit.client.1.smithi190.stdout:2/251: dwrite d10/d11/f16 [0,4194304] 0 2023-12-06T15:00:21.819 INFO:tasks.workunit.client.1.smithi190.stdout:8/177: dwrite d1/fb [0,4194304] 0 2023-12-06T15:00:21.819 INFO:tasks.workunit.client.1.smithi190.stdout:8/178: truncate d1/d10/d12/f2d 715116 0 2023-12-06T15:00:21.820 INFO:tasks.workunit.client.1.smithi190.stdout:7/254: rename d0/d5/da/fb to d0/d5/d1b/d1c/d17/f4a 0 2023-12-06T15:00:21.821 INFO:tasks.workunit.client.0.smithi152.stdout:3/106: truncate d9/d10/f16 3783165 0 2023-12-06T15:00:21.826 INFO:tasks.workunit.client.1.smithi190.stdout:4/202: dread d3/d10/f2a [0,4194304] 0 2023-12-06T15:00:21.826 INFO:tasks.workunit.client.1.smithi190.stdout:4/203: readlink d3/d10/d15/l2c 0 2023-12-06T15:00:21.827 INFO:tasks.workunit.client.1.smithi190.stdout:9/221: truncate f0 7792716 0 2023-12-06T15:00:21.829 INFO:tasks.workunit.client.1.smithi190.stdout:3/332: creat d4/d70/d33/d45/f76 x:0 0 0 2023-12-06T15:00:21.829 INFO:tasks.workunit.client.1.smithi190.stdout:3/333: truncate d4/d70/d53/f6d 692121 0 2023-12-06T15:00:21.829 INFO:tasks.workunit.client.1.smithi190.stdout:3/334: stat d4/d70/d19/d1c 0 2023-12-06T15:00:21.830 INFO:tasks.workunit.client.1.smithi190.stdout:1/361: rmdir d6/dc/d29/d38/d39 39 2023-12-06T15:00:21.849 INFO:tasks.workunit.client.1.smithi190.stdout:2/252: getdents d10/d31/d42 0 2023-12-06T15:00:21.849 INFO:tasks.workunit.client.1.smithi190.stdout:0/204: write d0/da/f22 [5130539,118491] 0 2023-12-06T15:00:21.849 INFO:tasks.workunit.client.1.smithi190.stdout:0/205: chown d0/da/l15 0 1 2023-12-06T15:00:21.849 INFO:tasks.workunit.client.1.smithi190.stdout:7/255: truncate d0/f6 3112906 0 2023-12-06T15:00:21.851 INFO:tasks.workunit.client.1.smithi190.stdout:4/204: creat d3/d35/d19/d30/d3c/f45 x:0 0 0 2023-12-06T15:00:21.851 INFO:tasks.workunit.client.1.smithi190.stdout:4/205: write d3/d10/f2a [4809052,3376] 0 2023-12-06T15:00:21.852 INFO:tasks.workunit.client.1.smithi190.stdout:9/222: creat d4/d27/d2f/f4f x:0 0 0 2023-12-06T15:00:21.854 INFO:tasks.workunit.client.1.smithi190.stdout:3/335: mkdir d4/d1b/d77 0 2023-12-06T15:00:21.854 INFO:tasks.workunit.client.1.smithi190.stdout:9/223: dread d4/f43 [0,4194304] 0 2023-12-06T15:00:21.855 INFO:tasks.workunit.client.1.smithi190.stdout:1/362: unlink d6/c1a 0 2023-12-06T15:00:21.859 INFO:tasks.workunit.client.1.smithi190.stdout:3/336: write d4/d70/d19/f57 [1422663,79201] 0 2023-12-06T15:00:21.863 INFO:tasks.workunit.client.0.smithi152.stdout:4/203: dwrite f1 [0,4194304] 0 2023-12-06T15:00:21.863 INFO:tasks.workunit.client.0.smithi152.stdout:4/204: stat d2/d10/d27/d29 0 2023-12-06T15:00:21.865 INFO:tasks.workunit.client.1.smithi190.stdout:8/179: dwrite d1/d10/d12/f2d [0,4194304] 0 2023-12-06T15:00:21.866 INFO:tasks.workunit.client.0.smithi152.stdout:3/107: dwrite d9/f11 [4194304,4194304] 0 2023-12-06T15:00:21.866 INFO:tasks.workunit.client.1.smithi190.stdout:2/253: creat d10/f58 x:0 0 0 2023-12-06T15:00:21.869 INFO:tasks.workunit.client.0.smithi152.stdout:3/108: mkdir d9/d18/d1a 0 2023-12-06T15:00:21.871 INFO:tasks.workunit.client.1.smithi190.stdout:7/256: link d0/d5/d1b/d1c/c2a d0/d5/d1b/c4b 0 2023-12-06T15:00:21.875 INFO:tasks.workunit.client.0.smithi152.stdout:3/109: dread d9/ff [0,4194304] 0 2023-12-06T15:00:21.877 INFO:tasks.workunit.client.0.smithi152.stdout:3/110: symlink d9/d10/d19/l1b 0 2023-12-06T15:00:21.877 INFO:tasks.workunit.client.0.smithi152.stdout:3/111: chown d9/d10/d19/l1b 76633 1 2023-12-06T15:00:21.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:21 smithi152 ceph-mon[111954]: Reconfiguring prometheus.smithi152 (dependencies changed)... 2023-12-06T15:00:21.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:21 smithi152 ceph-mon[111954]: Reconfiguring daemon prometheus.smithi152 on smithi152 2023-12-06T15:00:21.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:21 smithi152 ceph-mon[111954]: pgmap v22: 65 pgs: 65 active+clean; 479 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 22 MiB/s rd, 44 MiB/s wr, 732 op/s 2023-12-06T15:00:21.878 INFO:tasks.workunit.client.1.smithi190.stdout:9/224: creat d4/d27/d2f/d31/f50 x:0 0 0 2023-12-06T15:00:21.879 INFO:tasks.workunit.client.0.smithi152.stdout:3/112: truncate d9/ff 2080725 0 2023-12-06T15:00:21.881 INFO:tasks.workunit.client.1.smithi190.stdout:3/337: creat d4/d70/d19/d1c/d3d/f78 x:0 0 0 2023-12-06T15:00:21.883 INFO:tasks.workunit.client.0.smithi152.stdout:9/109: sync 2023-12-06T15:00:21.885 INFO:tasks.workunit.client.0.smithi152.stdout:9/110: mkdir d0/dd/d20 0 2023-12-06T15:00:21.885 INFO:tasks.workunit.client.0.smithi152.stdout:9/111: write d0/dd/f17 [113356,112625] 0 2023-12-06T15:00:21.885 INFO:tasks.workunit.client.0.smithi152.stdout:9/112: fsync d0/f1c 0 2023-12-06T15:00:21.885 INFO:tasks.workunit.client.1.smithi190.stdout:0/206: rename d0/da/f38 to d0/da/d1a/d2b/d37/f39 0 2023-12-06T15:00:21.886 INFO:tasks.workunit.client.1.smithi190.stdout:9/225: creat d4/f51 x:0 0 0 2023-12-06T15:00:21.887 INFO:tasks.workunit.client.1.smithi190.stdout:9/226: chown d4/d27/f4d 233425 1 2023-12-06T15:00:21.887 INFO:tasks.workunit.client.0.smithi152.stdout:0/84: sync 2023-12-06T15:00:21.887 INFO:tasks.workunit.client.0.smithi152.stdout:8/43: sync 2023-12-06T15:00:21.887 INFO:tasks.workunit.client.0.smithi152.stdout:6/122: sync 2023-12-06T15:00:21.888 INFO:tasks.workunit.client.1.smithi190.stdout:3/338: unlink d4/d70/d19/d1c/f6c 0 2023-12-06T15:00:21.888 INFO:tasks.workunit.client.0.smithi152.stdout:0/85: mknod d8/c14 0 2023-12-06T15:00:21.889 INFO:tasks.workunit.client.0.smithi152.stdout:0/86: chown d8 5955 1 2023-12-06T15:00:21.889 INFO:tasks.workunit.client.0.smithi152.stdout:8/44: creat d1/d6/db/f11 x:0 0 0 2023-12-06T15:00:21.890 INFO:tasks.workunit.client.1.smithi190.stdout:1/363: rename d6/dc/d29/d38/d43/c59 to d6/dc/d3b/d4d/c6d 0 2023-12-06T15:00:21.891 INFO:tasks.workunit.client.1.smithi190.stdout:0/207: truncate d0/d4/f16 2953649 0 2023-12-06T15:00:21.891 INFO:tasks.workunit.client.1.smithi190.stdout:0/208: fdatasync d0/d4/f26 0 2023-12-06T15:00:21.892 INFO:tasks.workunit.client.1.smithi190.stdout:0/209: stat d0/da/d1a/d2b 0 2023-12-06T15:00:21.892 INFO:tasks.workunit.client.1.smithi190.stdout:0/210: chown d0/da/d1a/d2b/d37/f39 342921250 1 2023-12-06T15:00:21.892 INFO:tasks.workunit.client.0.smithi152.stdout:6/123: creat d1/d5/d15/f32 x:0 0 0 2023-12-06T15:00:21.892 INFO:tasks.workunit.client.1.smithi190.stdout:9/227: mknod d4/d27/d2f/c52 0 2023-12-06T15:00:21.895 INFO:tasks.workunit.client.0.smithi152.stdout:0/87: mkdir d8/d15 0 2023-12-06T15:00:21.895 INFO:tasks.workunit.client.0.smithi152.stdout:8/45: truncate d1/f2 3983311 0 2023-12-06T15:00:21.895 INFO:tasks.workunit.client.1.smithi190.stdout:3/339: rename d4/d70/d53/f6d to d4/d70/d53/f79 0 2023-12-06T15:00:21.896 INFO:tasks.workunit.client.0.smithi152.stdout:3/113: dread f6 [0,4194304] 0 2023-12-06T15:00:21.902 INFO:tasks.workunit.client.1.smithi190.stdout:0/211: unlink d0/f18 0 2023-12-06T15:00:21.903 INFO:tasks.workunit.client.1.smithi190.stdout:9/228: getdents d4/d27/d2f/d31/d3f 0 2023-12-06T15:00:21.903 INFO:tasks.workunit.client.1.smithi190.stdout:0/212: write d0/f2e [2757589,31889] 0 2023-12-06T15:00:21.903 INFO:tasks.workunit.client.1.smithi190.stdout:3/340: write d4/d1b/f22 [2188182,101223] 0 2023-12-06T15:00:21.903 INFO:tasks.workunit.client.1.smithi190.stdout:0/213: read d0/da/f22 [4621768,91110] 0 2023-12-06T15:00:21.903 INFO:tasks.workunit.client.1.smithi190.stdout:7/257: dwrite d0/f3 [0,4194304] 0 2023-12-06T15:00:21.904 INFO:tasks.workunit.client.0.smithi152.stdout:4/205: dwrite d2/d10/f2a [0,4194304] 0 2023-12-06T15:00:21.904 INFO:tasks.workunit.client.0.smithi152.stdout:4/206: chown d2/d10/d27/d29 12281774 1 2023-12-06T15:00:21.904 INFO:tasks.workunit.client.1.smithi190.stdout:2/254: dwrite d10/d26/f3a [0,4194304] 0 2023-12-06T15:00:21.904 INFO:tasks.workunit.client.1.smithi190.stdout:2/255: chown d10/c2c 3322633 1 2023-12-06T15:00:21.905 INFO:tasks.workunit.client.1.smithi190.stdout:3/341: rmdir d4/d70/d19 39 2023-12-06T15:00:21.907 INFO:tasks.workunit.client.1.smithi190.stdout:1/364: dread d6/f69 [4194304,4194304] 0 2023-12-06T15:00:21.907 INFO:tasks.workunit.client.1.smithi190.stdout:7/258: unlink d0/df/d10/l14 0 2023-12-06T15:00:21.908 INFO:tasks.workunit.client.1.smithi190.stdout:2/256: getdents d10/d31/d35 0 2023-12-06T15:00:21.908 INFO:tasks.workunit.client.1.smithi190.stdout:8/180: dwrite d1/f4 [0,4194304] 0 2023-12-06T15:00:21.908 INFO:tasks.workunit.client.1.smithi190.stdout:3/342: symlink d4/d70/d19/d51/l7a 0 2023-12-06T15:00:21.908 INFO:tasks.workunit.client.1.smithi190.stdout:0/214: write d0/da/ff [8087121,79440] 0 2023-12-06T15:00:21.911 INFO:tasks.workunit.client.1.smithi190.stdout:9/229: dread d4/d27/d2f/d31/f4b [0,4194304] 0 2023-12-06T15:00:21.911 INFO:tasks.workunit.client.1.smithi190.stdout:9/230: chown d4/f6 238 1 2023-12-06T15:00:21.911 INFO:tasks.workunit.client.1.smithi190.stdout:9/231: truncate d4/d27/f4d 152551 0 2023-12-06T15:00:21.911 INFO:tasks.workunit.client.1.smithi190.stdout:9/232: chown d4/d27/d2f/f41 6844 1 2023-12-06T15:00:21.912 INFO:tasks.workunit.client.1.smithi190.stdout:1/365: mknod d6/dc/d29/d34/d5c/c6e 0 2023-12-06T15:00:21.912 INFO:tasks.workunit.client.1.smithi190.stdout:7/259: mkdir d0/d5/d1b/d33/d4c 0 2023-12-06T15:00:21.912 INFO:tasks.workunit.client.1.smithi190.stdout:1/366: write d6/dc/d29/d34/f4e [1363805,66204] 0 2023-12-06T15:00:21.913 INFO:tasks.workunit.client.1.smithi190.stdout:1/367: read d6/f21 [917167,40988] 0 2023-12-06T15:00:21.915 INFO:tasks.workunit.client.1.smithi190.stdout:2/257: mkdir d10/d59 0 2023-12-06T15:00:21.915 INFO:tasks.workunit.client.1.smithi190.stdout:2/258: fdatasync d10/d11/f13 0 2023-12-06T15:00:21.917 INFO:tasks.workunit.client.1.smithi190.stdout:8/181: mkdir d1/d10/d12/d34 0 2023-12-06T15:00:21.919 INFO:tasks.workunit.client.1.smithi190.stdout:0/215: mkdir d0/da/d1a/d3a 0 2023-12-06T15:00:21.919 INFO:tasks.workunit.client.1.smithi190.stdout:0/216: write d0/da/f29 [4324452,116] 0 2023-12-06T15:00:21.919 INFO:tasks.workunit.client.1.smithi190.stdout:0/217: stat d0/da/d1a/c1f 0 2023-12-06T15:00:21.920 INFO:tasks.workunit.client.1.smithi190.stdout:9/233: creat d4/d27/f53 x:0 0 0 2023-12-06T15:00:21.921 INFO:tasks.workunit.client.1.smithi190.stdout:7/260: creat d0/d5/d1b/d1c/f4d x:0 0 0 2023-12-06T15:00:21.923 INFO:tasks.workunit.client.1.smithi190.stdout:1/368: unlink d6/f37 0 2023-12-06T15:00:21.925 INFO:tasks.workunit.client.1.smithi190.stdout:2/259: rename d10/d26/f32 to d10/d31/f5a 0 2023-12-06T15:00:21.925 INFO:tasks.workunit.client.1.smithi190.stdout:2/260: dread - d10/f4f zero size 2023-12-06T15:00:21.926 INFO:tasks.workunit.client.1.smithi190.stdout:0/218: mknod d0/d4/c3b 0 2023-12-06T15:00:21.928 INFO:tasks.workunit.client.1.smithi190.stdout:9/234: mknod d4/d27/d2f/d31/c54 0 2023-12-06T15:00:21.928 INFO:tasks.workunit.client.1.smithi190.stdout:9/235: getdents d4/d27/d2f/d31/d3f 0 2023-12-06T15:00:21.928 INFO:tasks.workunit.client.0.smithi152.stdout:6/124: dwrite d1/d19/d1a/f21 [0,4194304] 0 2023-12-06T15:00:21.928 INFO:tasks.workunit.client.0.smithi152.stdout:6/125: fsync d1/d5/f9 0 2023-12-06T15:00:21.931 INFO:tasks.workunit.client.1.smithi190.stdout:7/261: rename d0/d5/d1b/d1c/c2a to d0/d5/d1b/d1c/c4e 0 2023-12-06T15:00:21.931 INFO:tasks.workunit.client.1.smithi190.stdout:1/369: mkdir d6/dc/d6f 0 2023-12-06T15:00:21.933 INFO:tasks.workunit.client.1.smithi190.stdout:2/261: dread d10/d11/f24 [0,4194304] 0 2023-12-06T15:00:21.934 INFO:tasks.workunit.client.1.smithi190.stdout:2/262: chown fa 343401618 1 2023-12-06T15:00:21.934 INFO:tasks.workunit.client.1.smithi190.stdout:2/263: fdatasync d10/d11/f25 0 2023-12-06T15:00:21.934 INFO:tasks.workunit.client.1.smithi190.stdout:0/219: mkdir d0/da/d1a/d2b/d3c 0 2023-12-06T15:00:21.935 INFO:tasks.workunit.client.1.smithi190.stdout:1/370: write d6/dc/f9 [1917175,16577] 0 2023-12-06T15:00:21.938 INFO:tasks.workunit.client.1.smithi190.stdout:9/236: creat d4/d27/d2f/d31/d3f/f55 x:0 0 0 2023-12-06T15:00:21.938 INFO:tasks.workunit.client.1.smithi190.stdout:7/262: getdents d0/d5/da 0 2023-12-06T15:00:21.941 INFO:tasks.workunit.client.1.smithi190.stdout:7/263: creat d0/df/d10/f4f x:0 0 0 2023-12-06T15:00:21.941 INFO:tasks.workunit.client.1.smithi190.stdout:7/264: chown d0/f6 90257529 1 2023-12-06T15:00:21.941 INFO:tasks.workunit.client.1.smithi190.stdout:7/265: readlink d0/l4 0 2023-12-06T15:00:21.942 INFO:tasks.workunit.client.1.smithi190.stdout:3/343: dwrite d4/d70/d19/f41 [0,4194304] 0 2023-12-06T15:00:21.943 INFO:tasks.workunit.client.1.smithi190.stdout:7/266: mknod d0/df/d37/c50 0 2023-12-06T15:00:21.943 INFO:tasks.workunit.client.1.smithi190.stdout:7/267: write d0/d5/d1b/d1c/d17/f4a [145914,101727] 0 2023-12-06T15:00:21.944 INFO:tasks.workunit.client.0.smithi152.stdout:0/88: dwrite f5 [0,4194304] 0 2023-12-06T15:00:21.945 INFO:tasks.workunit.client.1.smithi190.stdout:3/344: dread d4/d70/d33/f39 [0,4194304] 0 2023-12-06T15:00:21.946 INFO:tasks.workunit.client.1.smithi190.stdout:3/345: write d4/d70/d33/d36/f3c [4167327,104791] 0 2023-12-06T15:00:21.946 INFO:tasks.workunit.client.1.smithi190.stdout:8/182: dwrite d1/d10/d12/f2d [0,4194304] 0 2023-12-06T15:00:21.947 INFO:tasks.workunit.client.0.smithi152.stdout:0/89: creat d8/f16 x:0 0 0 2023-12-06T15:00:21.949 INFO:tasks.workunit.client.0.smithi152.stdout:0/90: creat d8/f17 x:0 0 0 2023-12-06T15:00:21.950 INFO:tasks.workunit.client.1.smithi190.stdout:7/268: truncate d0/f6 64489 0 2023-12-06T15:00:21.954 INFO:tasks.workunit.client.1.smithi190.stdout:8/183: chown d1/c9 322 1 2023-12-06T15:00:21.957 INFO:tasks.workunit.client.0.smithi152.stdout:6/126: dwrite d1/d5/f17 [0,4194304] 0 2023-12-06T15:00:21.957 INFO:tasks.workunit.client.0.smithi152.stdout:6/127: readlink d1/d5/l1e 0 2023-12-06T15:00:21.958 INFO:tasks.workunit.client.1.smithi190.stdout:7/269: creat d0/d5/da/f51 x:0 0 0 2023-12-06T15:00:21.959 INFO:tasks.workunit.client.1.smithi190.stdout:3/346: dread d4/d1b/f21 [0,4194304] 0 2023-12-06T15:00:21.960 INFO:tasks.workunit.client.0.smithi152.stdout:6/128: mknod d1/d5/d15/c33 0 2023-12-06T15:00:21.961 INFO:tasks.workunit.client.1.smithi190.stdout:8/184: creat d1/f35 x:0 0 0 2023-12-06T15:00:21.962 INFO:tasks.workunit.client.1.smithi190.stdout:7/270: symlink d0/d5/d1b/d32/l52 0 2023-12-06T15:00:21.962 INFO:tasks.workunit.client.0.smithi152.stdout:6/129: creat d1/d19/d1a/d30/f34 x:0 0 0 2023-12-06T15:00:21.965 INFO:tasks.workunit.client.1.smithi190.stdout:3/347: creat d4/d70/d19/d3a/f7b x:0 0 0 2023-12-06T15:00:21.965 INFO:tasks.workunit.client.0.smithi152.stdout:6/130: mkdir d1/d19/d1a/d23/d35 0 2023-12-06T15:00:21.967 INFO:tasks.workunit.client.1.smithi190.stdout:7/271: read d0/d5/d1b/f2e [2010156,45491] 0 2023-12-06T15:00:21.967 INFO:tasks.workunit.client.1.smithi190.stdout:7/272: write d0/d5/da/f49 [623339,109287] 0 2023-12-06T15:00:21.970 INFO:tasks.workunit.client.1.smithi190.stdout:0/220: dwrite d0/f2d [0,4194304] 0 2023-12-06T15:00:21.975 INFO:tasks.workunit.client.1.smithi190.stdout:8/185: mkdir d1/d10/d12/d36 0 2023-12-06T15:00:21.977 INFO:tasks.workunit.client.1.smithi190.stdout:3/348: unlink d4/d70/d19/d1c/d3d/f78 0 2023-12-06T15:00:21.977 INFO:tasks.workunit.client.1.smithi190.stdout:3/349: truncate d4/d70/d33/d36/f3c 4637723 0 2023-12-06T15:00:21.978 INFO:tasks.workunit.client.1.smithi190.stdout:3/350: chown d4/d1b/d54 95 1 2023-12-06T15:00:21.980 INFO:tasks.workunit.client.1.smithi190.stdout:0/221: creat d0/da/f3d x:0 0 0 2023-12-06T15:00:21.981 INFO:tasks.workunit.client.1.smithi190.stdout:3/351: write d4/d70/d33/d36/f4f [650381,114776] 0 2023-12-06T15:00:21.984 INFO:tasks.workunit.client.1.smithi190.stdout:8/186: mkdir d1/d37 0 2023-12-06T15:00:21.985 INFO:tasks.workunit.client.1.smithi190.stdout:3/352: creat d4/d70/d19/f7c x:0 0 0 2023-12-06T15:00:21.986 INFO:tasks.workunit.client.1.smithi190.stdout:3/353: write d4/d1b/f34 [1047626,1298] 0 2023-12-06T15:00:21.986 INFO:tasks.workunit.client.1.smithi190.stdout:7/273: dread d0/d5/da/f49 [0,4194304] 0 2023-12-06T15:00:21.987 INFO:tasks.workunit.client.1.smithi190.stdout:8/187: creat d1/d10/d12/d34/f38 x:0 0 0 2023-12-06T15:00:21.987 INFO:tasks.workunit.client.1.smithi190.stdout:8/188: dread - d1/f35 zero size 2023-12-06T15:00:21.988 INFO:tasks.workunit.client.1.smithi190.stdout:3/354: link d4/d1b/l4b d4/d70/d53/d56/l7d 0 2023-12-06T15:00:21.989 INFO:tasks.workunit.client.1.smithi190.stdout:7/274: getdents d0/df 0 2023-12-06T15:00:21.991 INFO:tasks.workunit.client.1.smithi190.stdout:8/189: chown d1/d20/l27 18 1 2023-12-06T15:00:21.992 INFO:tasks.workunit.client.1.smithi190.stdout:3/355: symlink d4/d1b/d54/l7e 0 2023-12-06T15:00:21.993 INFO:tasks.workunit.client.1.smithi190.stdout:9/237: rmdir d4/d27/d2f 39 2023-12-06T15:00:21.993 INFO:tasks.workunit.client.1.smithi190.stdout:8/190: read d1/d10/d1c/f22 [1648036,94356] 0 2023-12-06T15:00:21.993 INFO:tasks.workunit.client.1.smithi190.stdout:2/264: dwrite ff [4194304,4194304] 0 2023-12-06T15:00:21.995 INFO:tasks.workunit.client.0.smithi152.stdout:8/46: dwrite d1/f2 [0,4194304] 0 2023-12-06T15:00:21.995 INFO:tasks.workunit.client.0.smithi152.stdout:8/47: write d1/f10 [779284,74851] 0 2023-12-06T15:00:21.995 INFO:tasks.workunit.client.1.smithi190.stdout:3/356: mkdir d4/d70/d7f 0 2023-12-06T15:00:21.995 INFO:tasks.workunit.client.1.smithi190.stdout:3/357: write d4/fc [1842807,124722] 0 2023-12-06T15:00:21.996 INFO:tasks.workunit.client.1.smithi190.stdout:7/275: rename d0/df/d10 to d0/df/d53 0 2023-12-06T15:00:21.996 INFO:tasks.workunit.client.1.smithi190.stdout:3/358: dread d4/d70/d33/f39 [0,4194304] 0 2023-12-06T15:00:21.996 INFO:tasks.workunit.client.1.smithi190.stdout:1/371: dwrite d6/f22 [0,4194304] 0 2023-12-06T15:00:21.997 INFO:tasks.workunit.client.1.smithi190.stdout:9/238: symlink d4/d27/d2f/l56 0 2023-12-06T15:00:21.997 INFO:tasks.workunit.client.1.smithi190.stdout:9/239: dread - d4/d27/f53 zero size 2023-12-06T15:00:21.998 INFO:tasks.workunit.client.0.smithi152.stdout:4/207: dwrite d2/f1f [0,4194304] 0 2023-12-06T15:00:21.998 INFO:tasks.workunit.client.0.smithi152.stdout:4/208: fdatasync d2/d15/f19 0 2023-12-06T15:00:21.998 INFO:tasks.workunit.client.0.smithi152.stdout:4/209: fsync d2/d10/d27/d29/f30 0 2023-12-06T15:00:21.998 INFO:tasks.workunit.client.0.smithi152.stdout:0/91: dwrite d8/f13 [0,4194304] 0 2023-12-06T15:00:21.998 INFO:tasks.workunit.client.0.smithi152.stdout:0/92: fsync d8/ff 0 2023-12-06T15:00:21.998 INFO:tasks.workunit.client.0.smithi152.stdout:6/131: dwrite d1/d19/d1a/f21 [0,4194304] 0 2023-12-06T15:00:21.999 INFO:tasks.workunit.client.1.smithi190.stdout:8/191: mkdir d1/d10/d12/d34/d39 0 2023-12-06T15:00:21.999 INFO:tasks.workunit.client.0.smithi152.stdout:4/210: fdatasync d2/f9 0 2023-12-06T15:00:21.999 INFO:tasks.workunit.client.0.smithi152.stdout:4/211: readlink d2/d22/d2f/l31 0 2023-12-06T15:00:21.999 INFO:tasks.workunit.client.0.smithi152.stdout:4/212: write d2/f9 [3266179,98705] 0 2023-12-06T15:00:21.999 INFO:tasks.workunit.client.0.smithi152.stdout:4/213: fdatasync f1 0 2023-12-06T15:00:22.000 INFO:tasks.workunit.client.1.smithi190.stdout:9/240: write d4/f39 [1404981,43155] 0 2023-12-06T15:00:22.000 INFO:tasks.workunit.client.1.smithi190.stdout:2/265: mkdir d10/d26/d5b 0 2023-12-06T15:00:22.000 INFO:tasks.workunit.client.1.smithi190.stdout:2/266: fdatasync d10/d31/d37/f3f 0 2023-12-06T15:00:22.000 INFO:tasks.workunit.client.1.smithi190.stdout:2/267: chown d10/d31/d49/d54 18912885 1 2023-12-06T15:00:22.001 INFO:tasks.workunit.client.0.smithi152.stdout:0/93: creat d8/d15/f18 x:0 0 0 2023-12-06T15:00:22.002 INFO:tasks.workunit.client.0.smithi152.stdout:7/85: sync 2023-12-06T15:00:22.002 INFO:tasks.workunit.client.0.smithi152.stdout:2/73: sync 2023-12-06T15:00:22.002 INFO:tasks.workunit.client.0.smithi152.stdout:7/86: chown dd/f18 2871539 1 2023-12-06T15:00:22.003 INFO:tasks.workunit.client.1.smithi190.stdout:7/276: creat d0/d5/da/f54 x:0 0 0 2023-12-06T15:00:22.003 INFO:tasks.workunit.client.1.smithi190.stdout:3/359: creat d4/d70/d19/d3a/f80 x:0 0 0 2023-12-06T15:00:22.005 INFO:tasks.workunit.client.1.smithi190.stdout:2/268: dread d10/f39 [0,4194304] 0 2023-12-06T15:00:22.005 INFO:tasks.workunit.client.1.smithi190.stdout:2/269: fsync d10/d31/f45 0 2023-12-06T15:00:22.006 INFO:tasks.workunit.client.0.smithi152.stdout:0/94: symlink d8/d15/l19 0 2023-12-06T15:00:22.006 INFO:tasks.workunit.client.0.smithi152.stdout:0/95: dread - d8/d15/f18 zero size 2023-12-06T15:00:22.006 INFO:tasks.workunit.client.0.smithi152.stdout:2/74: symlink d6/db/df/l16 0 2023-12-06T15:00:22.006 INFO:tasks.workunit.client.0.smithi152.stdout:2/75: stat f1 0 2023-12-06T15:00:22.006 INFO:tasks.workunit.client.0.smithi152.stdout:2/76: write d6/db/d13/f14 [778635,60139] 0 2023-12-06T15:00:22.007 INFO:tasks.workunit.client.0.smithi152.stdout:7/87: write f9 [2222899,99769] 0 2023-12-06T15:00:22.009 INFO:tasks.workunit.client.0.smithi152.stdout:0/96: getdents d8 0 2023-12-06T15:00:22.010 INFO:tasks.workunit.client.0.smithi152.stdout:0/97: fsync f5 0 2023-12-06T15:00:22.010 INFO:tasks.workunit.client.0.smithi152.stdout:0/98: read - d8/f17 zero size 2023-12-06T15:00:22.010 INFO:tasks.workunit.client.0.smithi152.stdout:0/99: write d8/f17 [527891,47441] 0 2023-12-06T15:00:22.010 INFO:tasks.workunit.client.1.smithi190.stdout:8/192: dread d1/f16 [0,4194304] 0 2023-12-06T15:00:22.011 INFO:tasks.workunit.client.0.smithi152.stdout:2/77: mkdir d6/db/d17 0 2023-12-06T15:00:22.012 INFO:tasks.workunit.client.1.smithi190.stdout:1/372: link d6/f6c d6/dc/d29/d34/d5c/f70 0 2023-12-06T15:00:22.013 INFO:tasks.workunit.client.1.smithi190.stdout:9/241: mknod d4/d27/d2f/d31/d3f/c57 0 2023-12-06T15:00:22.014 INFO:tasks.workunit.client.0.smithi152.stdout:2/78: truncate f1 2275509 0 2023-12-06T15:00:22.015 INFO:tasks.workunit.client.1.smithi190.stdout:3/360: creat d4/d70/d19/d1c/f81 x:0 0 0 2023-12-06T15:00:22.015 INFO:tasks.workunit.client.1.smithi190.stdout:3/361: chown d4/d1b/d69 859 1 2023-12-06T15:00:22.015 INFO:tasks.workunit.client.1.smithi190.stdout:3/362: truncate d4/d70/d33/d45/f76 38417 0 2023-12-06T15:00:22.016 INFO:tasks.workunit.client.0.smithi152.stdout:2/79: mkdir d6/d18 0 2023-12-06T15:00:22.017 INFO:tasks.workunit.client.0.smithi152.stdout:2/80: chown f0 1 1 2023-12-06T15:00:22.017 INFO:tasks.workunit.client.1.smithi190.stdout:8/193: symlink d1/d10/d12/d34/l3a 0 2023-12-06T15:00:22.017 INFO:tasks.workunit.client.1.smithi190.stdout:1/373: mknod d6/dc/d6f/c71 0 2023-12-06T15:00:22.017 INFO:tasks.workunit.client.1.smithi190.stdout:1/374: read - d6/d49/f68 zero size 2023-12-06T15:00:22.018 INFO:tasks.workunit.client.0.smithi152.stdout:2/81: fsync f0 0 2023-12-06T15:00:22.018 INFO:tasks.workunit.client.1.smithi190.stdout:9/242: unlink d4/d27/d2f/d31/c54 0 2023-12-06T15:00:22.018 INFO:tasks.workunit.client.1.smithi190.stdout:9/243: truncate d4/f51 949230 0 2023-12-06T15:00:22.018 INFO:tasks.workunit.client.1.smithi190.stdout:9/244: readlink d4/d27/d2f/l32 0 2023-12-06T15:00:22.018 INFO:tasks.workunit.client.1.smithi190.stdout:9/245: chown d4/f17 3982733 1 2023-12-06T15:00:22.019 INFO:tasks.workunit.client.0.smithi152.stdout:6/132: rename d1/d19/d1a/d23 to d1/d19/d1a/d30/d36 0 2023-12-06T15:00:22.020 INFO:tasks.workunit.client.0.smithi152.stdout:8/48: dwrite d1/d6/fd [0,4194304] 0 2023-12-06T15:00:22.020 INFO:tasks.workunit.client.0.smithi152.stdout:8/49: fsync d1/d6/fd 0 2023-12-06T15:00:22.020 INFO:tasks.workunit.client.0.smithi152.stdout:6/133: mkdir d1/d19/d1a/d30/d36/d37 0 2023-12-06T15:00:22.020 INFO:tasks.workunit.client.0.smithi152.stdout:6/134: stat d1/d5/l1e 0 2023-12-06T15:00:22.021 INFO:tasks.workunit.client.1.smithi190.stdout:3/363: rename d4/d70/d19/d1c/l66 to d4/d1b/d77/l82 0 2023-12-06T15:00:22.023 INFO:tasks.workunit.client.1.smithi190.stdout:9/246: mkdir d4/d27/d2f/d31/d3f/d58 0 2023-12-06T15:00:22.024 INFO:tasks.workunit.client.0.smithi152.stdout:8/50: rename d1/l9 to d1/d6/db/l12 0 2023-12-06T15:00:22.026 INFO:tasks.workunit.client.0.smithi152.stdout:6/135: mknod d1/d19/d1a/d30/d36/d37/c38 0 2023-12-06T15:00:22.028 INFO:tasks.workunit.client.1.smithi190.stdout:3/364: mkdir d4/d70/d53/d56/d83 0 2023-12-06T15:00:22.028 INFO:tasks.workunit.client.1.smithi190.stdout:0/222: rmdir d0/da 39 2023-12-06T15:00:22.030 INFO:tasks.workunit.client.0.smithi152.stdout:6/136: mkdir d1/d19/d1a/d30/d36/d39 0 2023-12-06T15:00:22.030 INFO:tasks.workunit.client.0.smithi152.stdout:6/137: fsync d1/d19/d1a/d30/f22 0 2023-12-06T15:00:22.031 INFO:tasks.workunit.client.1.smithi190.stdout:3/365: getdents d4/d70/d33 0 2023-12-06T15:00:22.031 INFO:tasks.workunit.client.1.smithi190.stdout:3/366: stat d4/d1b/f37 0 2023-12-06T15:00:22.032 INFO:tasks.workunit.client.0.smithi152.stdout:8/51: write d1/d6/fd [3895443,47091] 0 2023-12-06T15:00:22.034 INFO:tasks.workunit.client.0.smithi152.stdout:8/52: mknod d1/d6/d7/c13 0 2023-12-06T15:00:22.034 INFO:tasks.workunit.client.0.smithi152.stdout:8/53: truncate d1/d6/db/f11 72409 0 2023-12-06T15:00:22.035 INFO:tasks.workunit.client.1.smithi190.stdout:1/375: dread d6/f25 [0,4194304] 0 2023-12-06T15:00:22.036 INFO:tasks.workunit.client.1.smithi190.stdout:3/367: unlink d4/d70/d33/d45/f47 0 2023-12-06T15:00:22.036 INFO:tasks.workunit.client.1.smithi190.stdout:3/368: write d4/d70/d33/d45/f59 [182253,22393] 0 2023-12-06T15:00:22.036 INFO:tasks.workunit.client.1.smithi190.stdout:0/223: rename d0/da/d1a to d0/da/d3e 0 2023-12-06T15:00:22.038 INFO:tasks.workunit.client.1.smithi190.stdout:3/369: read d4/d70/d33/d45/f59 [63614,25709] 0 2023-12-06T15:00:22.038 INFO:tasks.workunit.client.1.smithi190.stdout:1/376: mknod d6/dc/d29/d38/c72 0 2023-12-06T15:00:22.039 INFO:tasks.workunit.client.1.smithi190.stdout:2/270: dwrite d10/d11/f13 [0,4194304] 0 2023-12-06T15:00:22.039 INFO:tasks.workunit.client.1.smithi190.stdout:2/271: read - d10/d31/f43 zero size 2023-12-06T15:00:22.040 INFO:tasks.workunit.client.1.smithi190.stdout:2/272: getdents d10/d31/d35 0 2023-12-06T15:00:22.040 INFO:tasks.workunit.client.1.smithi190.stdout:2/273: fdatasync d10/d26/f4c 0 2023-12-06T15:00:22.040 INFO:tasks.workunit.client.1.smithi190.stdout:5/210: sync 2023-12-06T15:00:22.041 INFO:tasks.workunit.client.1.smithi190.stdout:3/370: symlink d4/d70/d19/l84 0 2023-12-06T15:00:22.041 INFO:tasks.workunit.client.1.smithi190.stdout:3/371: readlink d4/d70/d19/d51/l5a 0 2023-12-06T15:00:22.045 INFO:tasks.workunit.client.1.smithi190.stdout:2/274: unlink d10/c23 0 2023-12-06T15:00:22.045 INFO:tasks.workunit.client.1.smithi190.stdout:2/275: write d10/d31/f5a [5304151,18844] 0 2023-12-06T15:00:22.046 INFO:tasks.workunit.client.1.smithi190.stdout:5/211: mknod d0/df/c3f 0 2023-12-06T15:00:22.047 INFO:tasks.workunit.client.1.smithi190.stdout:5/212: symlink d0/d1c/d3e/l40 0 2023-12-06T15:00:22.049 INFO:tasks.workunit.client.1.smithi190.stdout:5/213: unlink d0/df/f27 0 2023-12-06T15:00:22.050 INFO:tasks.workunit.client.0.smithi152.stdout:6/138: dread d1/d5/fa [0,4194304] 0 2023-12-06T15:00:22.052 INFO:tasks.workunit.client.0.smithi152.stdout:6/139: symlink d1/d5/l3a 0 2023-12-06T15:00:22.053 INFO:tasks.workunit.client.0.smithi152.stdout:2/82: write f5 [193750,119695] 0 2023-12-06T15:00:22.056 INFO:tasks.workunit.client.0.smithi152.stdout:6/140: dread d1/d5/fa [0,4194304] 0 2023-12-06T15:00:22.057 INFO:tasks.workunit.client.0.smithi152.stdout:6/141: dread - d1/d5/d15/f32 zero size 2023-12-06T15:00:22.057 INFO:tasks.workunit.client.1.smithi190.stdout:0/224: dread d0/da/f22 [0,4194304] 0 2023-12-06T15:00:22.058 INFO:tasks.workunit.client.1.smithi190.stdout:0/225: creat d0/da/f3f x:0 0 0 2023-12-06T15:00:22.060 INFO:tasks.workunit.client.1.smithi190.stdout:4/206: sync 2023-12-06T15:00:22.060 INFO:tasks.workunit.client.1.smithi190.stdout:6/231: sync 2023-12-06T15:00:22.060 INFO:tasks.workunit.client.1.smithi190.stdout:0/226: unlink d0/d4/f21 0 2023-12-06T15:00:22.061 INFO:tasks.workunit.client.1.smithi190.stdout:6/232: rmdir d4/d15 39 2023-12-06T15:00:22.062 INFO:tasks.workunit.client.0.smithi152.stdout:6/142: dread d1/d5/fa [0,4194304] 0 2023-12-06T15:00:22.062 INFO:tasks.workunit.client.0.smithi152.stdout:6/143: chown d1/d19/d1a/d30/d36 3572362 1 2023-12-06T15:00:22.062 INFO:tasks.workunit.client.1.smithi190.stdout:6/233: creat d4/d12/f3f x:0 0 0 2023-12-06T15:00:22.064 INFO:tasks.workunit.client.1.smithi190.stdout:6/234: chown d4/d12/d1a/l1b 88 1 2023-12-06T15:00:22.068 INFO:tasks.workunit.client.1.smithi190.stdout:5/214: dread d0/f7 [0,4194304] 0 2023-12-06T15:00:22.069 INFO:tasks.workunit.client.0.smithi152.stdout:6/144: rmdir d1/d19/d1a/d30/d36/d39 0 2023-12-06T15:00:22.070 INFO:tasks.workunit.client.0.smithi152.stdout:6/145: mkdir d1/d19/d1a/d30/d18/d3b 0 2023-12-06T15:00:22.071 INFO:tasks.workunit.client.0.smithi152.stdout:6/146: truncate d1/f7 2588285 0 2023-12-06T15:00:22.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:21 smithi190 ceph-mon[121340]: Reconfiguring prometheus.smithi152 (dependencies changed)... 2023-12-06T15:00:22.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:21 smithi190 ceph-mon[121340]: Reconfiguring daemon prometheus.smithi152 on smithi152 2023-12-06T15:00:22.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:21 smithi190 ceph-mon[121340]: pgmap v22: 65 pgs: 65 active+clean; 479 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 22 MiB/s rd, 44 MiB/s wr, 732 op/s 2023-12-06T15:00:22.072 INFO:tasks.workunit.client.0.smithi152.stdout:6/147: mkdir d1/d3c 0 2023-12-06T15:00:22.073 INFO:tasks.workunit.client.0.smithi152.stdout:4/214: truncate d2/f9 2777868 0 2023-12-06T15:00:22.073 INFO:tasks.workunit.client.0.smithi152.stdout:4/215: getdents d2/d15/d32 0 2023-12-06T15:00:22.073 INFO:tasks.workunit.client.0.smithi152.stdout:7/88: dwrite f3 [0,4194304] 0 2023-12-06T15:00:22.075 INFO:tasks.workunit.client.0.smithi152.stdout:0/100: dwrite d8/fd [0,4194304] 0 2023-12-06T15:00:22.077 INFO:tasks.workunit.client.1.smithi190.stdout:3/372: dwrite d4/d70/d19/f7c [0,4194304] 0 2023-12-06T15:00:22.078 INFO:tasks.workunit.client.1.smithi190.stdout:9/247: dwrite d4/f21 [0,4194304] 0 2023-12-06T15:00:22.078 INFO:tasks.workunit.client.1.smithi190.stdout:9/248: readlink d4/d27/d2f/d31/d3f/l47 0 2023-12-06T15:00:22.079 INFO:tasks.workunit.client.0.smithi152.stdout:7/89: unlink dd/f18 0 2023-12-06T15:00:22.079 INFO:tasks.workunit.client.1.smithi190.stdout:7/277: dwrite d0/fc [0,4194304] 0 2023-12-06T15:00:22.079 INFO:tasks.workunit.client.1.smithi190.stdout:7/278: chown d0/d5/da/f54 1630701 1 2023-12-06T15:00:22.080 INFO:tasks.workunit.client.0.smithi152.stdout:2/83: getdents d6 0 2023-12-06T15:00:22.080 INFO:tasks.workunit.client.1.smithi190.stdout:8/194: rename d1/d10/d12 to d1/d20/d3b 0 2023-12-06T15:00:22.086 INFO:tasks.workunit.client.0.smithi152.stdout:7/90: mkdir dd/df/d1b 0 2023-12-06T15:00:22.086 INFO:tasks.workunit.client.0.smithi152.stdout:7/91: mknod dd/d17/c1c 0 2023-12-06T15:00:22.086 INFO:tasks.workunit.client.1.smithi190.stdout:5/215: dread d0/fb [0,4194304] 0 2023-12-06T15:00:22.087 INFO:tasks.workunit.client.1.smithi190.stdout:5/216: write d0/f28 [529713,66959] 0 2023-12-06T15:00:22.087 INFO:tasks.workunit.client.1.smithi190.stdout:3/373: creat d4/d70/d33/d45/f85 x:0 0 0 2023-12-06T15:00:22.087 INFO:tasks.workunit.client.0.smithi152.stdout:6/148: getdents d1/d19/d1a/d30/d36/d37 0 2023-12-06T15:00:22.087 INFO:tasks.workunit.client.0.smithi152.stdout:7/92: read f9 [1978177,123358] 0 2023-12-06T15:00:22.088 INFO:tasks.workunit.client.1.smithi190.stdout:7/279: creat d0/d35/f55 x:0 0 0 2023-12-06T15:00:22.088 INFO:tasks.workunit.client.0.smithi152.stdout:0/101: dread d8/fd [0,4194304] 0 2023-12-06T15:00:22.088 INFO:tasks.workunit.client.0.smithi152.stdout:0/102: getdents d8 0 2023-12-06T15:00:22.089 INFO:tasks.workunit.client.0.smithi152.stdout:6/149: creat d1/f3d x:0 0 0 2023-12-06T15:00:22.090 INFO:tasks.workunit.client.1.smithi190.stdout:8/195: creat d1/d20/d3b/d36/f3c x:0 0 0 2023-12-06T15:00:22.091 INFO:tasks.workunit.client.1.smithi190.stdout:8/196: write d1/d10/d25/f2a [588973,46166] 0 2023-12-06T15:00:22.091 INFO:tasks.workunit.client.1.smithi190.stdout:8/197: stat d1/d20/d3b/f2d 0 2023-12-06T15:00:22.091 INFO:tasks.workunit.client.1.smithi190.stdout:6/235: dwrite d4/d15/f26 [4194304,4194304] 0 2023-12-06T15:00:22.092 INFO:tasks.workunit.client.0.smithi152.stdout:7/93: rename l6 to dd/l1d 0 2023-12-06T15:00:22.092 INFO:tasks.workunit.client.0.smithi152.stdout:7/94: readlink dd/l1d 0 2023-12-06T15:00:22.093 INFO:tasks.workunit.client.0.smithi152.stdout:7/95: write dd/df/f1a [858370,100419] 0 2023-12-06T15:00:22.094 INFO:tasks.workunit.client.0.smithi152.stdout:6/150: mknod d1/d5/d15/c3e 0 2023-12-06T15:00:22.094 INFO:tasks.workunit.client.0.smithi152.stdout:6/151: chown d1/d19/d1a/d30/d36/d26/f2d 117122 1 2023-12-06T15:00:22.094 INFO:tasks.workunit.client.1.smithi190.stdout:2/276: rename d10/d31 to d10/d26/d5c 0 2023-12-06T15:00:22.094 INFO:tasks.workunit.client.1.smithi190.stdout:4/207: dwrite d3/fd [0,4194304] 0 2023-12-06T15:00:22.098 INFO:tasks.workunit.client.0.smithi152.stdout:4/216: dwrite f1 [0,4194304] 0 2023-12-06T15:00:22.098 INFO:tasks.workunit.client.1.smithi190.stdout:3/374: link d4/d70/d33/d45/f76 d4/d70/d19/d3a/d3b/d72/f86 0 2023-12-06T15:00:22.099 INFO:tasks.workunit.client.1.smithi190.stdout:3/375: readlink d4/d70/d33/l35 0 2023-12-06T15:00:22.101 INFO:tasks.workunit.client.0.smithi152.stdout:2/84: dread f0 [0,4194304] 0 2023-12-06T15:00:22.104 INFO:tasks.workunit.client.1.smithi190.stdout:8/198: mknod d1/d20/d3b/d34/d39/c3d 0 2023-12-06T15:00:22.104 INFO:tasks.workunit.client.0.smithi152.stdout:7/96: rmdir dd/df 39 2023-12-06T15:00:22.104 INFO:tasks.workunit.client.0.smithi152.stdout:7/97: truncate dd/f13 872602 0 2023-12-06T15:00:22.104 INFO:tasks.workunit.client.0.smithi152.stdout:7/98: chown dd 5902 1 2023-12-06T15:00:22.105 INFO:tasks.workunit.client.0.smithi152.stdout:4/217: symlink d2/d22/d2f/l36 0 2023-12-06T15:00:22.107 INFO:tasks.workunit.client.0.smithi152.stdout:2/85: unlink d6/db/df/l16 0 2023-12-06T15:00:22.108 INFO:tasks.workunit.client.1.smithi190.stdout:9/249: dwrite d4/d27/d2f/d31/f4b [0,4194304] 0 2023-12-06T15:00:22.108 INFO:tasks.workunit.client.1.smithi190.stdout:9/250: chown d4/d27/c44 63 1 2023-12-06T15:00:22.108 INFO:tasks.workunit.client.1.smithi190.stdout:9/251: write d4/fa [2375214,82441] 0 2023-12-06T15:00:22.109 INFO:tasks.workunit.client.1.smithi190.stdout:2/277: link d10/d26/d5c/f33 d10/d26/d5c/d49/d54/f5d 0 2023-12-06T15:00:22.109 INFO:tasks.workunit.client.1.smithi190.stdout:2/278: fdatasync d10/f40 0 2023-12-06T15:00:22.111 INFO:tasks.workunit.client.0.smithi152.stdout:4/218: unlink d2/d22/d2f/c33 0 2023-12-06T15:00:22.112 INFO:tasks.workunit.client.1.smithi190.stdout:4/208: link d3/f33 d3/d35/f46 0 2023-12-06T15:00:22.114 INFO:tasks.workunit.client.1.smithi190.stdout:4/209: dread d3/f9 [0,4194304] 0 2023-12-06T15:00:22.115 INFO:tasks.workunit.client.1.smithi190.stdout:3/376: creat d4/d70/d53/d56/d83/f87 x:0 0 0 2023-12-06T15:00:22.116 INFO:tasks.workunit.client.1.smithi190.stdout:8/199: write d1/f1e [888658,42417] 0 2023-12-06T15:00:22.119 INFO:tasks.workunit.client.1.smithi190.stdout:0/227: rename d0/d4 to d0/da/d3e/d3a/d40 0 2023-12-06T15:00:22.119 INFO:tasks.workunit.client.1.smithi190.stdout:0/228: truncate d0/da/d3e/d2b/f33 817774 0 2023-12-06T15:00:22.121 INFO:tasks.workunit.client.1.smithi190.stdout:9/252: creat d4/d27/d2f/d31/d3f/d58/f59 x:0 0 0 2023-12-06T15:00:22.125 INFO:tasks.workunit.client.1.smithi190.stdout:3/377: creat d4/d70/d53/d56/d83/f88 x:0 0 0 2023-12-06T15:00:22.128 INFO:tasks.workunit.client.1.smithi190.stdout:8/200: link d1/d20/d3b/f2d d1/d20/d3b/d36/f3e 0 2023-12-06T15:00:22.128 INFO:tasks.workunit.client.1.smithi190.stdout:8/201: chown d1/d20/d3b/d34/d39 0 1 2023-12-06T15:00:22.128 INFO:tasks.workunit.client.0.smithi152.stdout:2/86: dread f4 [0,4194304] 0 2023-12-06T15:00:22.132 INFO:tasks.workunit.client.0.smithi152.stdout:2/87: symlink d6/db/df/l19 0 2023-12-06T15:00:22.133 INFO:tasks.workunit.client.0.smithi152.stdout:2/88: rename f1 to d6/f1a 0 2023-12-06T15:00:22.134 INFO:tasks.workunit.client.1.smithi190.stdout:2/279: rename d10/d11 to d10/d59/d5e 0 2023-12-06T15:00:22.135 INFO:tasks.workunit.client.0.smithi152.stdout:2/89: rename d6/db/le to d6/d18/l1b 0 2023-12-06T15:00:22.136 INFO:tasks.workunit.client.1.smithi190.stdout:0/229: creat d0/f41 x:0 0 0 2023-12-06T15:00:22.136 INFO:tasks.workunit.client.1.smithi190.stdout:6/236: dwrite d4/f35 [0,4194304] 0 2023-12-06T15:00:22.141 INFO:tasks.workunit.client.1.smithi190.stdout:3/378: getdents d4/d70/d19/d1c/d3d 0 2023-12-06T15:00:22.143 INFO:tasks.workunit.client.1.smithi190.stdout:7/280: dwrite d0/df/d53/f4f [0,4194304] 0 2023-12-06T15:00:22.144 INFO:tasks.workunit.client.1.smithi190.stdout:8/202: getdents d1/d10/d25 0 2023-12-06T15:00:22.144 INFO:tasks.workunit.client.0.smithi152.stdout:6/152: dwrite d1/f7 [0,4194304] 0 2023-12-06T15:00:22.146 INFO:tasks.workunit.client.1.smithi190.stdout:0/230: chown d0/da/l15 591 1 2023-12-06T15:00:22.147 INFO:tasks.workunit.client.1.smithi190.stdout:6/237: dread d4/d15/f26 [0,4194304] 0 2023-12-06T15:00:22.151 INFO:tasks.workunit.client.1.smithi190.stdout:7/281: mkdir d0/d5/da/d56 0 2023-12-06T15:00:22.152 INFO:tasks.workunit.client.0.smithi152.stdout:0/103: dwrite d8/fd [4194304,4194304] 0 2023-12-06T15:00:22.152 INFO:tasks.workunit.client.0.smithi152.stdout:0/104: stat d8 0 2023-12-06T15:00:22.153 INFO:tasks.workunit.client.0.smithi152.stdout:0/105: creat d8/d15/f1a x:0 0 0 2023-12-06T15:00:22.153 INFO:tasks.workunit.client.1.smithi190.stdout:8/203: mknod d1/d20/d3b/d31/c3f 0 2023-12-06T15:00:22.154 INFO:tasks.workunit.client.0.smithi152.stdout:5/93: sync 2023-12-06T15:00:22.154 INFO:tasks.workunit.client.0.smithi152.stdout:1/261: sync 2023-12-06T15:00:22.154 INFO:tasks.workunit.client.0.smithi152.stdout:5/94: chown f6 7 1 2023-12-06T15:00:22.154 INFO:tasks.workunit.client.0.smithi152.stdout:5/95: chown d7/f18 112 1 2023-12-06T15:00:22.154 INFO:tasks.workunit.client.0.smithi152.stdout:1/262: mknod d3/da/d15/d17/d43/c6c 0 2023-12-06T15:00:22.155 INFO:tasks.workunit.client.1.smithi190.stdout:7/282: chown d0/df/d53/d15/l16 1 1 2023-12-06T15:00:22.157 INFO:tasks.workunit.client.1.smithi190.stdout:8/204: creat d1/d20/d3b/d34/f40 x:0 0 0 2023-12-06T15:00:22.157 INFO:tasks.workunit.client.1.smithi190.stdout:8/205: chown d1/d10/d1c/l21 21527114 1 2023-12-06T15:00:22.157 INFO:tasks.workunit.client.1.smithi190.stdout:8/206: fsync d1/d20/d3b/d34/f38 0 2023-12-06T15:00:22.158 INFO:tasks.workunit.client.1.smithi190.stdout:0/231: mknod d0/da/d3e/d2b/d3c/c42 0 2023-12-06T15:00:22.159 INFO:tasks.workunit.client.1.smithi190.stdout:7/283: stat d0/d5/d1b/c4b 0 2023-12-06T15:00:22.159 INFO:tasks.workunit.client.0.smithi152.stdout:1/263: rename d3/da/d15/d17/d43/l49 to d3/da/d15/d17/d58/l6d 0 2023-12-06T15:00:22.159 INFO:tasks.workunit.client.0.smithi152.stdout:1/264: write d3/da/d15/d17/f4f [685625,75203] 0 2023-12-06T15:00:22.162 INFO:tasks.workunit.client.1.smithi190.stdout:4/210: dwrite d3/d10/d39/f25 [0,4194304] 0 2023-12-06T15:00:22.162 INFO:tasks.workunit.client.1.smithi190.stdout:4/211: stat d3/l11 0 2023-12-06T15:00:22.165 INFO:tasks.workunit.client.1.smithi190.stdout:0/232: rename d0/da/d3e/d3a/d40/f16 to d0/f43 0 2023-12-06T15:00:22.165 INFO:tasks.workunit.client.1.smithi190.stdout:7/284: creat d0/d5/d1b/f57 x:0 0 0 2023-12-06T15:00:22.166 INFO:tasks.workunit.client.0.smithi152.stdout:1/265: rmdir d3/da/db/d54 39 2023-12-06T15:00:22.167 INFO:tasks.workunit.client.1.smithi190.stdout:9/253: dwrite d4/f39 [0,4194304] 0 2023-12-06T15:00:22.168 INFO:tasks.workunit.client.0.smithi152.stdout:1/266: creat d3/da/db/f6e x:0 0 0 2023-12-06T15:00:22.168 INFO:tasks.workunit.client.0.smithi152.stdout:1/267: truncate d3/da/db/f48 916983 0 2023-12-06T15:00:22.168 INFO:tasks.workunit.client.1.smithi190.stdout:8/207: write d1/d10/d25/f2a [574782,68052] 0 2023-12-06T15:00:22.168 INFO:tasks.workunit.client.0.smithi152.stdout:4/219: dwrite d2/f26 [0,4194304] 0 2023-12-06T15:00:22.169 INFO:tasks.workunit.client.1.smithi190.stdout:9/254: symlink d4/l5a 0 2023-12-06T15:00:22.171 INFO:tasks.workunit.client.1.smithi190.stdout:9/255: creat d4/f5b x:0 0 0 2023-12-06T15:00:22.171 INFO:tasks.workunit.client.1.smithi190.stdout:9/256: fsync d4/f24 0 2023-12-06T15:00:22.172 INFO:tasks.workunit.client.0.smithi152.stdout:4/220: creat d2/d10/f37 x:0 0 0 2023-12-06T15:00:22.174 INFO:tasks.workunit.client.1.smithi190.stdout:9/257: mkdir d4/d27/d2f/d5c 0 2023-12-06T15:00:22.174 INFO:tasks.workunit.client.1.smithi190.stdout:3/379: fsync d4/d70/d53/d56/d83/f88 0 2023-12-06T15:00:22.174 INFO:tasks.workunit.client.1.smithi190.stdout:9/258: truncate f0 7995034 0 2023-12-06T15:00:22.178 INFO:tasks.workunit.client.1.smithi190.stdout:9/259: write f2 [840940,80803] 0 2023-12-06T15:00:22.178 INFO:tasks.workunit.client.1.smithi190.stdout:3/380: unlink d4/d70/d33/d45/f59 0 2023-12-06T15:00:22.178 INFO:tasks.workunit.client.1.smithi190.stdout:3/381: fdatasync d4/d70/d19/d3a/f46 0 2023-12-06T15:00:22.180 INFO:tasks.workunit.client.1.smithi190.stdout:9/260: symlink d4/d27/d2f/l5d 0 2023-12-06T15:00:22.180 INFO:tasks.workunit.client.1.smithi190.stdout:9/261: dread - d4/f2d zero size 2023-12-06T15:00:22.182 INFO:tasks.workunit.client.0.smithi152.stdout:1/268: write d3/da/d15/d17/f4f [185370,99155] 0 2023-12-06T15:00:22.186 INFO:tasks.workunit.client.1.smithi190.stdout:0/233: creat d0/da/f44 x:0 0 0 2023-12-06T15:00:22.187 INFO:tasks.workunit.client.1.smithi190.stdout:4/212: dread d3/d10/d15/f2f [0,4194304] 0 2023-12-06T15:00:22.187 INFO:tasks.workunit.client.1.smithi190.stdout:4/213: dread - d3/d35/d19/d30/d3c/f45 zero size 2023-12-06T15:00:22.188 INFO:tasks.workunit.client.1.smithi190.stdout:3/382: link d4/d1b/c31 d4/d70/d19/d1c/d3d/c89 0 2023-12-06T15:00:22.193 INFO:tasks.workunit.client.1.smithi190.stdout:0/234: link d0/da/d3e/d2b/f33 d0/da/d3e/d2b/f45 0 2023-12-06T15:00:22.193 INFO:tasks.workunit.client.1.smithi190.stdout:4/214: creat d3/d35/d19/f47 x:0 0 0 2023-12-06T15:00:22.193 INFO:tasks.workunit.client.1.smithi190.stdout:3/383: mkdir d4/d70/d33/d36/d68/d8a 0 2023-12-06T15:00:22.197 INFO:tasks.workunit.client.1.smithi190.stdout:4/215: link d3/d35/d19/f47 d3/d10/d39/f48 0 2023-12-06T15:00:22.199 INFO:tasks.workunit.client.1.smithi190.stdout:3/384: read d4/d1b/d69/f6f [669763,93620] 0 2023-12-06T15:00:22.199 INFO:tasks.workunit.client.1.smithi190.stdout:4/216: rename f2 to d3/d35/d19/d30/d3c/f49 0 2023-12-06T15:00:22.200 INFO:tasks.workunit.client.1.smithi190.stdout:3/385: link d4/l2b d4/d70/d33/d36/l8b 0 2023-12-06T15:00:22.200 INFO:tasks.workunit.client.1.smithi190.stdout:3/386: read - d4/d70/d53/d56/d83/f88 zero size 2023-12-06T15:00:22.201 INFO:tasks.workunit.client.1.smithi190.stdout:4/217: link d3/c2e d3/d10/c4a 0 2023-12-06T15:00:22.202 INFO:tasks.workunit.client.0.smithi152.stdout:2/90: rmdir d6/db/df 39 2023-12-06T15:00:22.202 INFO:tasks.workunit.client.1.smithi190.stdout:3/387: mknod d4/d70/d33/d36/d68/c8c 0 2023-12-06T15:00:22.202 INFO:tasks.workunit.client.1.smithi190.stdout:3/388: chown d4/d1b/f62 34756153 1 2023-12-06T15:00:22.203 INFO:tasks.workunit.client.0.smithi152.stdout:2/91: write f4 [1780213,58947] 0 2023-12-06T15:00:22.203 INFO:tasks.workunit.client.0.smithi152.stdout:2/92: write f4 [520518,100200] 0 2023-12-06T15:00:22.203 INFO:tasks.workunit.client.1.smithi190.stdout:4/218: creat d3/d10/d39/f4b x:0 0 0 2023-12-06T15:00:22.203 INFO:tasks.workunit.client.0.smithi152.stdout:2/93: write d6/f15 [228160,9993] 0 2023-12-06T15:00:22.205 INFO:tasks.workunit.client.1.smithi190.stdout:3/389: rename d4/fc to d4/d1b/d77/f8d 0 2023-12-06T15:00:22.205 INFO:tasks.workunit.client.1.smithi190.stdout:6/238: dwrite d4/d12/f2d [0,4194304] 0 2023-12-06T15:00:22.205 INFO:tasks.workunit.client.1.smithi190.stdout:6/239: chown d4/d12/d1a/l1b 8737820 1 2023-12-06T15:00:22.206 INFO:tasks.workunit.client.1.smithi190.stdout:4/219: link d3/f12 d3/d35/d19/d41/d44/f4c 0 2023-12-06T15:00:22.208 INFO:tasks.workunit.client.1.smithi190.stdout:3/390: unlink d4/ff 0 2023-12-06T15:00:22.208 INFO:tasks.workunit.client.1.smithi190.stdout:3/391: write d4/d70/d53/f65 [1703846,89397] 0 2023-12-06T15:00:22.208 INFO:tasks.workunit.client.1.smithi190.stdout:3/392: write d4/d70/d19/f57 [4225638,78790] 0 2023-12-06T15:00:22.210 INFO:tasks.workunit.client.0.smithi152.stdout:0/106: dwrite d8/f17 [0,4194304] 0 2023-12-06T15:00:22.211 INFO:tasks.workunit.client.1.smithi190.stdout:6/240: mkdir d4/d12/d40 0 2023-12-06T15:00:22.212 INFO:tasks.workunit.client.1.smithi190.stdout:4/220: dread d3/d35/f22 [0,4194304] 0 2023-12-06T15:00:22.212 INFO:tasks.workunit.client.1.smithi190.stdout:4/221: stat d3/d35/d19/d41/d44/f4c 0 2023-12-06T15:00:22.212 INFO:tasks.workunit.client.1.smithi190.stdout:4/222: chown d3/d10/f2a 11 1 2023-12-06T15:00:22.212 INFO:tasks.workunit.client.1.smithi190.stdout:4/223: write d3/f12 [1689062,51295] 0 2023-12-06T15:00:22.214 INFO:tasks.workunit.client.0.smithi152.stdout:5/96: dwrite d7/dd/f12 [0,4194304] 0 2023-12-06T15:00:22.214 INFO:tasks.workunit.client.0.smithi152.stdout:5/97: dread - d7/dd/f1d zero size 2023-12-06T15:00:22.216 INFO:tasks.workunit.client.0.smithi152.stdout:5/98: creat d7/f1e x:0 0 0 2023-12-06T15:00:22.216 INFO:tasks.workunit.client.0.smithi152.stdout:5/99: write d7/f19 [634258,79134] 0 2023-12-06T15:00:22.216 INFO:tasks.workunit.client.0.smithi152.stdout:5/100: chown d7/dd/l11 60385631 1 2023-12-06T15:00:22.216 INFO:tasks.workunit.client.0.smithi152.stdout:5/101: truncate d7/fc 291707 0 2023-12-06T15:00:22.216 INFO:tasks.workunit.client.0.smithi152.stdout:5/102: write d7/fc [871391,128512] 0 2023-12-06T15:00:22.217 INFO:tasks.workunit.client.1.smithi190.stdout:3/393: creat d4/d70/d7f/f8e x:0 0 0 2023-12-06T15:00:22.217 INFO:tasks.workunit.client.0.smithi152.stdout:5/103: creat d7/f1f x:0 0 0 2023-12-06T15:00:22.218 INFO:tasks.workunit.client.1.smithi190.stdout:6/241: rename d4/ca to d4/d12/c41 0 2023-12-06T15:00:22.220 INFO:tasks.workunit.client.1.smithi190.stdout:6/242: stat d4/d12/d1a/f20 0 2023-12-06T15:00:22.220 INFO:tasks.workunit.client.1.smithi190.stdout:6/243: write d4/d12/d1a/f20 [1859167,127613] 0 2023-12-06T15:00:22.221 INFO:tasks.workunit.client.0.smithi152.stdout:5/104: dread d7/fb [0,4194304] 0 2023-12-06T15:00:22.222 INFO:tasks.workunit.client.0.smithi152.stdout:5/105: read d7/fc [270464,129614] 0 2023-12-06T15:00:22.222 INFO:tasks.workunit.client.0.smithi152.stdout:5/106: chown d7/fc 20841405 1 2023-12-06T15:00:22.222 INFO:tasks.workunit.client.0.smithi152.stdout:5/107: truncate d7/dd/ff 725553 0 2023-12-06T15:00:22.222 INFO:tasks.workunit.client.1.smithi190.stdout:6/244: creat d4/d12/d1a/f42 x:0 0 0 2023-12-06T15:00:22.224 INFO:tasks.workunit.client.1.smithi190.stdout:6/245: mkdir d4/d12/d40/d43 0 2023-12-06T15:00:22.225 INFO:tasks.workunit.client.1.smithi190.stdout:4/224: dread d3/d10/f2a [0,4194304] 0 2023-12-06T15:00:22.225 INFO:tasks.workunit.client.1.smithi190.stdout:8/208: dwrite d1/f1a [4194304,4194304] 0 2023-12-06T15:00:22.227 INFO:tasks.workunit.client.1.smithi190.stdout:4/225: mkdir d3/d35/d19/d30/d3c/d4d 0 2023-12-06T15:00:22.233 INFO:tasks.workunit.client.1.smithi190.stdout:7/285: dwrite d0/d35/f55 [0,4194304] 0 2023-12-06T15:00:22.234 INFO:tasks.workunit.client.0.smithi152.stdout:6/153: dwrite d1/f13 [4194304,4194304] 0 2023-12-06T15:00:22.234 INFO:tasks.workunit.client.0.smithi152.stdout:1/269: dwrite d3/da/d15/d17/d1a/f45 [0,4194304] 0 2023-12-06T15:00:22.234 INFO:tasks.workunit.client.0.smithi152.stdout:1/270: fdatasync d3/da/d15/d17/f1f 0 2023-12-06T15:00:22.236 INFO:tasks.workunit.client.0.smithi152.stdout:6/154: link d1/d5/l3a d1/d19/l3f 0 2023-12-06T15:00:22.236 INFO:tasks.workunit.client.0.smithi152.stdout:6/155: write d1/d19/d1a/d30/d36/d26/f2d [873346,116313] 0 2023-12-06T15:00:22.237 INFO:tasks.workunit.client.0.smithi152.stdout:1/271: symlink d3/da/d15/d17/d4d/l6f 0 2023-12-06T15:00:22.238 INFO:tasks.workunit.client.0.smithi152.stdout:6/156: symlink d1/d19/d1a/d30/d36/d26/l40 0 2023-12-06T15:00:22.238 INFO:tasks.workunit.client.1.smithi190.stdout:7/286: creat d0/df/d1f/f58 x:0 0 0 2023-12-06T15:00:22.238 INFO:tasks.workunit.client.1.smithi190.stdout:8/209: dread d1/f1b [0,4194304] 0 2023-12-06T15:00:22.239 INFO:tasks.workunit.client.0.smithi152.stdout:1/272: getdents d3/da/d15 0 2023-12-06T15:00:22.240 INFO:tasks.workunit.client.1.smithi190.stdout:8/210: creat d1/f41 x:0 0 0 2023-12-06T15:00:22.240 INFO:tasks.workunit.client.1.smithi190.stdout:8/211: write d1/d20/d3b/d34/f40 [1037434,55413] 0 2023-12-06T15:00:22.241 INFO:tasks.workunit.client.0.smithi152.stdout:1/273: creat d3/da/d15/d17/f70 x:0 0 0 2023-12-06T15:00:22.241 INFO:tasks.workunit.client.1.smithi190.stdout:7/287: rename d0/fc to d0/d5/d1b/d32/f59 0 2023-12-06T15:00:22.241 INFO:tasks.workunit.client.1.smithi190.stdout:7/288: fsync d0/d5/d1b/d1c/d17/f4a 0 2023-12-06T15:00:22.242 INFO:tasks.workunit.client.0.smithi152.stdout:1/274: symlink d3/da/d15/d17/d1a/l71 0 2023-12-06T15:00:22.242 INFO:tasks.workunit.client.1.smithi190.stdout:8/212: creat d1/d20/f42 x:0 0 0 2023-12-06T15:00:22.242 INFO:tasks.workunit.client.1.smithi190.stdout:8/213: chown d1/d37 3 1 2023-12-06T15:00:22.243 INFO:tasks.workunit.client.1.smithi190.stdout:7/289: symlink d0/d5/d1b/d1c/l5a 0 2023-12-06T15:00:22.245 INFO:tasks.workunit.client.1.smithi190.stdout:4/226: dread d3/d35/d19/d30/d3c/f49 [0,4194304] 0 2023-12-06T15:00:22.247 INFO:tasks.workunit.client.1.smithi190.stdout:4/227: unlink d3/c2d 0 2023-12-06T15:00:22.247 INFO:tasks.workunit.client.1.smithi190.stdout:4/228: mkdir d3/d4e 0 2023-12-06T15:00:22.249 INFO:tasks.workunit.client.1.smithi190.stdout:4/229: creat d3/d35/d19/d30/d3c/f4f x:0 0 0 2023-12-06T15:00:22.250 INFO:tasks.workunit.client.0.smithi152.stdout:0/107: dwrite d8/ff [0,4194304] 0 2023-12-06T15:00:22.252 INFO:tasks.workunit.client.0.smithi152.stdout:4/221: dwrite d2/d15/f19 [0,4194304] 0 2023-12-06T15:00:22.252 INFO:tasks.workunit.client.0.smithi152.stdout:0/108: write d8/f17 [1732907,58299] 0 2023-12-06T15:00:22.252 INFO:tasks.workunit.client.0.smithi152.stdout:2/94: dwrite d6/db/d13/f14 [0,4194304] 0 2023-12-06T15:00:22.252 INFO:tasks.workunit.client.0.smithi152.stdout:0/109: truncate d8/d15/f18 803500 0 2023-12-06T15:00:22.253 INFO:tasks.workunit.client.0.smithi152.stdout:2/95: fsync d6/db/d13/f14 0 2023-12-06T15:00:22.253 INFO:tasks.workunit.client.0.smithi152.stdout:4/222: truncate d2/f8 5058904 0 2023-12-06T15:00:22.253 INFO:tasks.workunit.client.0.smithi152.stdout:4/223: chown d2/d10/d27/d29 36 1 2023-12-06T15:00:22.255 INFO:tasks.workunit.client.1.smithi190.stdout:9/262: dwrite d4/d27/d2f/f37 [0,4194304] 0 2023-12-06T15:00:22.256 INFO:tasks.workunit.client.0.smithi152.stdout:2/96: symlink d6/l1c 0 2023-12-06T15:00:22.256 INFO:tasks.workunit.client.0.smithi152.stdout:0/110: write d8/f13 [2309907,55290] 0 2023-12-06T15:00:22.257 INFO:tasks.workunit.client.0.smithi152.stdout:4/224: mknod d2/d10/c38 0 2023-12-06T15:00:22.261 INFO:tasks.workunit.client.1.smithi190.stdout:3/394: dwrite d4/d70/d33/d36/f27 [0,4194304] 0 2023-12-06T15:00:22.261 INFO:tasks.workunit.client.0.smithi152.stdout:5/108: dwrite f6 [0,4194304] 0 2023-12-06T15:00:22.261 INFO:tasks.workunit.client.1.smithi190.stdout:7/290: dwrite d0/d5/d1b/f57 [0,4194304] 0 2023-12-06T15:00:22.263 INFO:tasks.workunit.client.1.smithi190.stdout:0/235: getdents d0/da/d3e/d2b 0 2023-12-06T15:00:22.263 INFO:tasks.workunit.client.1.smithi190.stdout:0/236: chown d0/da/d3e/d2b/d3c/c42 7801 1 2023-12-06T15:00:22.264 INFO:tasks.workunit.client.1.smithi190.stdout:7/291: write d0/df/d53/f4f [265129,118658] 0 2023-12-06T15:00:22.265 INFO:tasks.workunit.client.0.smithi152.stdout:6/157: dread d1/d19/d1a/d30/d36/d26/f2d [0,4194304] 0 2023-12-06T15:00:22.266 INFO:tasks.workunit.client.0.smithi152.stdout:4/225: rmdir d2/d10/d27 39 2023-12-06T15:00:22.268 INFO:tasks.workunit.client.1.smithi190.stdout:9/263: creat d4/d27/d2f/f5e x:0 0 0 2023-12-06T15:00:22.268 INFO:tasks.workunit.client.0.smithi152.stdout:5/109: creat d7/dd/f20 x:0 0 0 2023-12-06T15:00:22.268 INFO:tasks.workunit.client.0.smithi152.stdout:5/110: stat d7/c1a 0 2023-12-06T15:00:22.274 INFO:tasks.workunit.client.1.smithi190.stdout:3/395: write d4/d70/d19/d1c/d3d/f40 [1916304,110859] 0 2023-12-06T15:00:22.275 INFO:tasks.workunit.client.0.smithi152.stdout:4/226: mkdir d2/d10/d39 0 2023-12-06T15:00:22.275 INFO:tasks.workunit.client.0.smithi152.stdout:5/111: truncate d7/fb 725650 0 2023-12-06T15:00:22.278 INFO:tasks.workunit.client.1.smithi190.stdout:0/237: mkdir d0/da/d3e/d2b/d3c/d46 0 2023-12-06T15:00:22.280 INFO:tasks.workunit.client.0.smithi152.stdout:5/112: getdents d7 0 2023-12-06T15:00:22.280 INFO:tasks.workunit.client.0.smithi152.stdout:4/227: link d2/d10/f37 d2/f3a 0 2023-12-06T15:00:22.280 INFO:tasks.workunit.client.0.smithi152.stdout:4/228: chown d2/d10/f2a 47 1 2023-12-06T15:00:22.280 INFO:tasks.workunit.client.0.smithi152.stdout:4/229: chown d2/d10/d27/d29/f35 10103 1 2023-12-06T15:00:22.282 INFO:tasks.workunit.client.0.smithi152.stdout:5/113: rename d7/dd/f12 to d7/f21 0 2023-12-06T15:00:22.282 INFO:tasks.workunit.client.0.smithi152.stdout:5/114: dread - d7/dd/f20 zero size 2023-12-06T15:00:22.283 INFO:tasks.workunit.client.0.smithi152.stdout:5/115: write d7/f1e [934952,88147] 0 2023-12-06T15:00:22.283 INFO:tasks.workunit.client.1.smithi190.stdout:7/292: creat d0/d5/d1b/d32/f5b x:0 0 0 2023-12-06T15:00:22.284 INFO:tasks.workunit.client.0.smithi152.stdout:2/97: dwrite d6/f1a [0,4194304] 0 2023-12-06T15:00:22.285 INFO:tasks.workunit.client.0.smithi152.stdout:5/116: symlink d7/l22 0 2023-12-06T15:00:22.286 INFO:tasks.workunit.client.0.smithi152.stdout:4/230: dread d2/d10/d27/f2c [0,4194304] 0 2023-12-06T15:00:22.287 INFO:tasks.workunit.client.1.smithi190.stdout:7/293: symlink d0/d5/d1b/l5c 0 2023-12-06T15:00:22.289 INFO:tasks.workunit.client.1.smithi190.stdout:7/294: creat d0/df/d1f/f5d x:0 0 0 2023-12-06T15:00:22.289 INFO:tasks.workunit.client.0.smithi152.stdout:4/231: rename d2/d10/c38 to d2/d15/d23/c3b 0 2023-12-06T15:00:22.292 INFO:tasks.workunit.client.0.smithi152.stdout:4/232: rename d2/c14 to d2/d10/d27/d29/c3c 0 2023-12-06T15:00:22.293 INFO:tasks.workunit.client.1.smithi190.stdout:7/295: unlink d0/d5/da/f51 0 2023-12-06T15:00:22.294 INFO:tasks.workunit.client.0.smithi152.stdout:4/233: link d2/d22/d2f/l31 d2/d10/d27/d29/l3d 0 2023-12-06T15:00:22.295 INFO:tasks.workunit.client.1.smithi190.stdout:6/246: getdents d4/d12 0 2023-12-06T15:00:22.296 INFO:tasks.workunit.client.1.smithi190.stdout:7/296: read d0/f6 [34569,76839] 0 2023-12-06T15:00:22.296 INFO:tasks.workunit.client.1.smithi190.stdout:6/247: dread - d4/d12/f3f zero size 2023-12-06T15:00:22.296 INFO:tasks.workunit.client.1.smithi190.stdout:0/238: write d0/da/ff [8166817,106074] 0 2023-12-06T15:00:22.296 INFO:tasks.workunit.client.1.smithi190.stdout:0/239: chown d0/l6 6882876 1 2023-12-06T15:00:22.297 INFO:tasks.workunit.client.0.smithi152.stdout:4/234: symlink d2/d10/d39/l3e 0 2023-12-06T15:00:22.299 INFO:tasks.workunit.client.0.smithi152.stdout:4/235: stat d2/d10/d27/d29/l3d 0 2023-12-06T15:00:22.300 INFO:tasks.workunit.client.0.smithi152.stdout:4/236: truncate d2/fd 1836165 0 2023-12-06T15:00:22.302 INFO:tasks.workunit.client.1.smithi190.stdout:0/240: rename d0/da/d3e/d2b/c35 to d0/da/d3e/d2b/d3c/d46/c47 0 2023-12-06T15:00:22.304 INFO:tasks.workunit.client.1.smithi190.stdout:0/241: creat d0/da/d3e/d3a/d40/f48 x:0 0 0 2023-12-06T15:00:22.307 INFO:tasks.workunit.client.1.smithi190.stdout:0/242: rename d0/da/ff to d0/da/f49 0 2023-12-06T15:00:22.308 INFO:tasks.workunit.client.1.smithi190.stdout:6/248: dread d4/d15/f26 [0,4194304] 0 2023-12-06T15:00:22.308 INFO:tasks.workunit.client.1.smithi190.stdout:6/249: fdatasync d4/d15/f3c 0 2023-12-06T15:00:22.313 INFO:tasks.workunit.client.1.smithi190.stdout:6/250: mkdir d4/d12/d1a/d44 0 2023-12-06T15:00:22.313 INFO:tasks.workunit.client.0.smithi152.stdout:4/237: dread d2/fc [0,4194304] 0 2023-12-06T15:00:22.314 INFO:tasks.workunit.client.0.smithi152.stdout:4/238: mkdir d2/d10/d27/d3f 0 2023-12-06T15:00:22.315 INFO:tasks.workunit.client.1.smithi190.stdout:6/251: rename d4/d12/d1a/d3d to d4/d12/d40/d43/d45 0 2023-12-06T15:00:22.315 INFO:tasks.workunit.client.0.smithi152.stdout:4/239: getdents d2/d22 0 2023-12-06T15:00:22.316 INFO:tasks.workunit.client.0.smithi152.stdout:4/240: readlink d2/l4 0 2023-12-06T15:00:22.317 INFO:tasks.workunit.client.1.smithi190.stdout:8/214: dwrite d1/d20/d3b/d34/f40 [0,4194304] 0 2023-12-06T15:00:22.317 INFO:tasks.workunit.client.1.smithi190.stdout:9/264: dwrite d4/f2e [4194304,4194304] 0 2023-12-06T15:00:22.319 INFO:tasks.workunit.client.0.smithi152.stdout:6/158: dwrite d1/d5/f9 [0,4194304] 0 2023-12-06T15:00:22.320 INFO:tasks.workunit.client.1.smithi190.stdout:9/265: creat d4/d27/f5f x:0 0 0 2023-12-06T15:00:22.320 INFO:tasks.workunit.client.0.smithi152.stdout:6/159: symlink d1/d1c/l41 0 2023-12-06T15:00:22.320 INFO:tasks.workunit.client.0.smithi152.stdout:6/160: truncate d1/d19/d1a/d30/d36/f24 839040 0 2023-12-06T15:00:22.321 INFO:tasks.workunit.client.0.smithi152.stdout:6/161: truncate d1/ff 514290 0 2023-12-06T15:00:22.322 INFO:tasks.workunit.client.1.smithi190.stdout:9/266: unlink d4/d27/d2f/f41 0 2023-12-06T15:00:22.322 INFO:tasks.workunit.client.1.smithi190.stdout:9/267: chown d4/f24 10864 1 2023-12-06T15:00:22.322 INFO:tasks.workunit.client.0.smithi152.stdout:6/162: write d1/d5/f17 [3620367,107258] 0 2023-12-06T15:00:22.323 INFO:tasks.workunit.client.1.smithi190.stdout:9/268: unlink d4/f39 0 2023-12-06T15:00:22.324 INFO:tasks.workunit.client.1.smithi190.stdout:1/377: sync 2023-12-06T15:00:22.325 INFO:tasks.workunit.client.1.smithi190.stdout:1/378: write d6/dc/d29/d34/f4e [2012901,99871] 0 2023-12-06T15:00:22.325 INFO:tasks.workunit.client.1.smithi190.stdout:9/269: symlink d4/d27/d2f/d5c/l60 0 2023-12-06T15:00:22.325 INFO:tasks.workunit.client.1.smithi190.stdout:9/270: chown d4/f5b 16983 1 2023-12-06T15:00:22.326 INFO:tasks.workunit.client.0.smithi152.stdout:0/111: dwrite d8/f9 [0,4194304] 0 2023-12-06T15:00:22.327 INFO:tasks.workunit.client.1.smithi190.stdout:9/271: symlink d4/d27/d2f/l61 0 2023-12-06T15:00:22.330 INFO:tasks.workunit.client.1.smithi190.stdout:9/272: unlink d4/d27/d2f/d31/l45 0 2023-12-06T15:00:22.330 INFO:tasks.workunit.client.1.smithi190.stdout:9/273: truncate d4/d27/d2f/f5e 253797 0 2023-12-06T15:00:22.332 INFO:tasks.workunit.client.1.smithi190.stdout:8/215: dread d1/fb [0,4194304] 0 2023-12-06T15:00:22.332 INFO:tasks.workunit.client.1.smithi190.stdout:9/274: unlink d4/f21 0 2023-12-06T15:00:22.332 INFO:tasks.workunit.client.0.smithi152.stdout:2/98: dwrite d6/db/fc [0,4194304] 0 2023-12-06T15:00:22.334 INFO:tasks.workunit.client.1.smithi190.stdout:7/297: dwrite d0/d5/f8 [0,4194304] 0 2023-12-06T15:00:22.340 INFO:tasks.workunit.client.1.smithi190.stdout:6/252: rmdir d4 39 2023-12-06T15:00:22.343 INFO:tasks.workunit.client.1.smithi190.stdout:3/396: dwrite d4/d70/d19/f57 [0,4194304] 0 2023-12-06T15:00:22.343 INFO:tasks.workunit.client.0.smithi152.stdout:5/117: fsync f6 0 2023-12-06T15:00:22.343 INFO:tasks.workunit.client.0.smithi152.stdout:5/118: dread - d7/dd/f20 zero size 2023-12-06T15:00:22.343 INFO:tasks.workunit.client.0.smithi152.stdout:5/119: write d7/dd/f20 [353250,51830] 0 2023-12-06T15:00:22.344 INFO:tasks.workunit.client.1.smithi190.stdout:6/253: mknod d4/d12/d40/d43/d45/c46 0 2023-12-06T15:00:22.344 INFO:tasks.workunit.client.1.smithi190.stdout:7/298: creat d0/df/d37/f5e x:0 0 0 2023-12-06T15:00:22.344 INFO:tasks.workunit.client.1.smithi190.stdout:7/299: chown d0/d5/d1b 222945021 1 2023-12-06T15:00:22.345 INFO:tasks.workunit.client.1.smithi190.stdout:7/300: write d0/d5/d1b/d1c/f23 [271699,12208] 0 2023-12-06T15:00:22.346 INFO:tasks.workunit.client.1.smithi190.stdout:3/397: mkdir d4/d70/d53/d56/d8f 0 2023-12-06T15:00:22.348 INFO:tasks.workunit.client.1.smithi190.stdout:6/254: creat d4/d12/d1a/d44/f47 x:0 0 0 2023-12-06T15:00:22.349 INFO:tasks.workunit.client.1.smithi190.stdout:8/216: dread d1/f1a [4194304,4194304] 0 2023-12-06T15:00:22.349 INFO:tasks.workunit.client.1.smithi190.stdout:6/255: creat d4/d12/d40/f48 x:0 0 0 2023-12-06T15:00:22.350 INFO:tasks.workunit.client.0.smithi152.stdout:4/241: rename d2/d10/d39 to d2/d22/d2f/d40 0 2023-12-06T15:00:22.355 INFO:tasks.workunit.client.1.smithi190.stdout:6/256: rename d4/d12/c34 to d4/d12/d40/d43/d45/c49 0 2023-12-06T15:00:22.357 INFO:tasks.workunit.client.1.smithi190.stdout:6/257: mkdir d4/d12/d40/d43/d45/d4a 0 2023-12-06T15:00:22.359 INFO:tasks.workunit.client.0.smithi152.stdout:5/120: mknod d7/c23 0 2023-12-06T15:00:22.360 INFO:tasks.workunit.client.0.smithi152.stdout:4/242: fdatasync d2/f1b 0 2023-12-06T15:00:22.361 INFO:tasks.workunit.client.1.smithi190.stdout:6/258: rename d4/d12/c41 to d4/d15/c4b 0 2023-12-06T15:00:22.362 INFO:tasks.workunit.client.1.smithi190.stdout:6/259: creat d4/d12/d1a/d32/f4c x:0 0 0 2023-12-06T15:00:22.363 INFO:tasks.workunit.client.0.smithi152.stdout:4/243: creat d2/d15/d23/f41 x:0 0 0 2023-12-06T15:00:22.363 INFO:tasks.workunit.client.1.smithi190.stdout:3/398: dread d4/d70/d19/f7c [0,4194304] 0 2023-12-06T15:00:22.363 INFO:tasks.workunit.client.1.smithi190.stdout:3/399: chown d4/d1b/d77/f8d 9 1 2023-12-06T15:00:22.364 INFO:tasks.workunit.client.1.smithi190.stdout:6/260: creat d4/d12/d40/d43/f4d x:0 0 0 2023-12-06T15:00:22.364 INFO:tasks.workunit.client.0.smithi152.stdout:4/244: mkdir d2/d15/d23/d42 0 2023-12-06T15:00:22.364 INFO:tasks.workunit.client.0.smithi152.stdout:4/245: write d2/d10/d27/d29/f30 [107280,44747] 0 2023-12-06T15:00:22.365 INFO:tasks.workunit.client.0.smithi152.stdout:4/246: link d2/d15/d23/f41 d2/d10/d27/f43 0 2023-12-06T15:00:22.365 INFO:tasks.workunit.client.0.smithi152.stdout:4/247: fdatasync d2/f9 0 2023-12-06T15:00:22.366 INFO:tasks.workunit.client.0.smithi152.stdout:6/163: dwrite d1/d19/d1a/d30/d36/f2e [0,4194304] 0 2023-12-06T15:00:22.366 INFO:tasks.workunit.client.0.smithi152.stdout:4/248: unlink d2/d10/d27/l2b 0 2023-12-06T15:00:22.367 INFO:tasks.workunit.client.1.smithi190.stdout:6/261: read d4/f35 [3632887,67571] 0 2023-12-06T15:00:22.368 INFO:tasks.workunit.client.0.smithi152.stdout:6/164: creat d1/d5/f42 x:0 0 0 2023-12-06T15:00:22.368 INFO:tasks.workunit.client.0.smithi152.stdout:6/165: mknod d1/d19/d1a/d30/d18/c43 0 2023-12-06T15:00:22.369 INFO:tasks.workunit.client.0.smithi152.stdout:6/166: creat d1/d5/f44 x:0 0 0 2023-12-06T15:00:22.370 INFO:tasks.workunit.client.1.smithi190.stdout:6/262: rename d4/d12/d1a/f33 to d4/d15/f4e 0 2023-12-06T15:00:22.370 INFO:tasks.workunit.client.1.smithi190.stdout:6/263: chown d4/d12/d1a 0 1 2023-12-06T15:00:22.370 INFO:tasks.workunit.client.1.smithi190.stdout:6/264: creat d4/d12/d40/f4f x:0 0 0 2023-12-06T15:00:22.370 INFO:tasks.workunit.client.1.smithi190.stdout:6/265: write d4/d12/d1a/f39 [279568,25586] 0 2023-12-06T15:00:22.371 INFO:tasks.workunit.client.1.smithi190.stdout:6/266: truncate d4/d12/d40/f4f 925412 0 2023-12-06T15:00:22.375 INFO:tasks.workunit.client.1.smithi190.stdout:3/400: dread d4/d1b/d69/f6f [0,4194304] 0 2023-12-06T15:00:22.375 INFO:tasks.workunit.client.1.smithi190.stdout:3/401: read d4/d70/d19/d1c/d3d/f40 [2152941,127085] 0 2023-12-06T15:00:22.375 INFO:tasks.workunit.client.1.smithi190.stdout:3/402: fsync d4/d70/d33/d45/f76 0 2023-12-06T15:00:22.375 INFO:tasks.workunit.client.1.smithi190.stdout:3/403: chown d4/d70/d33/d45/f76 185 1 2023-12-06T15:00:22.376 INFO:tasks.workunit.client.1.smithi190.stdout:3/404: chown d4/d70/d19/d1c/d3d/c75 880011 1 2023-12-06T15:00:22.379 INFO:tasks.workunit.client.1.smithi190.stdout:9/275: dwrite d4/f24 [0,4194304] 0 2023-12-06T15:00:22.381 INFO:tasks.workunit.client.1.smithi190.stdout:7/301: dwrite d0/d5/d1b/d32/f5b [0,4194304] 0 2023-12-06T15:00:22.381 INFO:tasks.workunit.client.1.smithi190.stdout:7/302: write d0/f6 [682619,60311] 0 2023-12-06T15:00:22.382 INFO:tasks.workunit.client.1.smithi190.stdout:1/379: dwrite d6/dc/d29/d38/d39/f6a [0,4194304] 0 2023-12-06T15:00:22.382 INFO:tasks.workunit.client.1.smithi190.stdout:8/217: dwrite d1/f16 [0,4194304] 0 2023-12-06T15:00:22.383 INFO:tasks.workunit.client.0.smithi152.stdout:0/112: dwrite d8/ff [0,4194304] 0 2023-12-06T15:00:22.384 INFO:tasks.workunit.client.1.smithi190.stdout:1/380: write d6/dc/d29/d34/f4e [1538387,61777] 0 2023-12-06T15:00:22.384 INFO:tasks.workunit.client.1.smithi190.stdout:9/276: symlink d4/d27/d2f/d31/d3f/l62 0 2023-12-06T15:00:22.384 INFO:tasks.workunit.client.0.smithi152.stdout:0/113: mkdir d8/d1b 0 2023-12-06T15:00:22.384 INFO:tasks.workunit.client.0.smithi152.stdout:0/114: chown d8 1475 1 2023-12-06T15:00:22.385 INFO:tasks.workunit.client.0.smithi152.stdout:0/115: truncate d8/fa 9092990 0 2023-12-06T15:00:22.387 INFO:tasks.workunit.client.0.smithi152.stdout:4/249: dread d2/f1f [0,4194304] 0 2023-12-06T15:00:22.388 INFO:tasks.workunit.client.1.smithi190.stdout:8/218: getdents d1 0 2023-12-06T15:00:22.390 INFO:tasks.workunit.client.0.smithi152.stdout:9/113: sync 2023-12-06T15:00:22.390 INFO:tasks.workunit.client.0.smithi152.stdout:3/114: sync 2023-12-06T15:00:22.390 INFO:tasks.workunit.client.0.smithi152.stdout:4/250: write d2/f9 [1937188,123822] 0 2023-12-06T15:00:22.390 INFO:tasks.workunit.client.0.smithi152.stdout:5/121: getdents d7 0 2023-12-06T15:00:22.393 INFO:tasks.workunit.client.0.smithi152.stdout:3/115: rename d9/l14 to d9/d18/d1a/l1c 0 2023-12-06T15:00:22.393 INFO:tasks.workunit.client.1.smithi190.stdout:1/381: rename d6/dc/d29/d34 to d6/dc/d29/d38/d73 0 2023-12-06T15:00:22.394 INFO:tasks.workunit.client.1.smithi190.stdout:7/303: mkdir d0/df/d5f 0 2023-12-06T15:00:22.395 INFO:tasks.workunit.client.1.smithi190.stdout:7/304: chown d0/d5/d1b/d33 64874 1 2023-12-06T15:00:22.396 INFO:tasks.workunit.client.1.smithi190.stdout:9/277: dread d4/d27/d2f/d31/f4b [0,4194304] 0 2023-12-06T15:00:22.397 INFO:tasks.workunit.client.0.smithi152.stdout:3/116: write d9/f11 [8298572,56805] 0 2023-12-06T15:00:22.397 INFO:tasks.workunit.client.0.smithi152.stdout:5/122: rename f6 to d7/f24 0 2023-12-06T15:00:22.399 INFO:tasks.workunit.client.0.smithi152.stdout:6/167: dwrite d1/d5/f14 [4194304,4194304] 0 2023-12-06T15:00:22.400 INFO:tasks.workunit.client.0.smithi152.stdout:4/251: dread d2/fd [0,4194304] 0 2023-12-06T15:00:22.401 INFO:tasks.workunit.client.0.smithi152.stdout:5/123: creat d7/dd/f25 x:0 0 0 2023-12-06T15:00:22.401 INFO:tasks.workunit.client.1.smithi190.stdout:7/305: write d0/d5/d1b/d1c/f28 [333091,123625] 0 2023-12-06T15:00:22.401 INFO:tasks.workunit.client.1.smithi190.stdout:3/405: dwrite d4/d70/d33/d36/f4f [4194304,4194304] 0 2023-12-06T15:00:22.403 INFO:tasks.workunit.client.0.smithi152.stdout:6/168: mknod d1/d19/d1a/d30/d36/d37/c45 0 2023-12-06T15:00:22.403 INFO:tasks.workunit.client.0.smithi152.stdout:6/169: readlink l0 0 2023-12-06T15:00:22.404 INFO:tasks.workunit.client.0.smithi152.stdout:4/252: symlink d2/d10/d27/d29/l44 0 2023-12-06T15:00:22.404 INFO:tasks.workunit.client.0.smithi152.stdout:4/253: chown d2/l4 187192278 1 2023-12-06T15:00:22.405 INFO:tasks.workunit.client.1.smithi190.stdout:8/219: dread d1/d20/d3b/d34/f40 [0,4194304] 0 2023-12-06T15:00:22.405 INFO:tasks.workunit.client.1.smithi190.stdout:3/406: creat d4/d1b/d69/f90 x:0 0 0 2023-12-06T15:00:22.406 INFO:tasks.workunit.client.0.smithi152.stdout:5/124: mkdir d7/dd/d26 0 2023-12-06T15:00:22.407 INFO:tasks.workunit.client.1.smithi190.stdout:7/306: mkdir d0/d5/d1b/d33/d60 0 2023-12-06T15:00:22.407 INFO:tasks.workunit.client.1.smithi190.stdout:7/307: stat d0/d5/l12 0 2023-12-06T15:00:22.407 INFO:tasks.workunit.client.1.smithi190.stdout:7/308: readlink d0/df/d53/l20 0 2023-12-06T15:00:22.408 INFO:tasks.workunit.client.1.smithi190.stdout:1/382: dread d6/dc/d29/d38/d39/f3f [0,4194304] 0 2023-12-06T15:00:22.409 INFO:tasks.workunit.client.0.smithi152.stdout:5/125: dread d7/f1e [0,4194304] 0 2023-12-06T15:00:22.409 INFO:tasks.workunit.client.0.smithi152.stdout:4/254: mkdir d2/d45 0 2023-12-06T15:00:22.412 INFO:tasks.workunit.client.0.smithi152.stdout:3/117: fsync d9/f11 0 2023-12-06T15:00:22.412 INFO:tasks.workunit.client.0.smithi152.stdout:3/118: chown d9/c15 40550900 1 2023-12-06T15:00:22.412 INFO:tasks.workunit.client.0.smithi152.stdout:3/119: chown d9 15103 1 2023-12-06T15:00:22.412 INFO:tasks.workunit.client.0.smithi152.stdout:3/120: readlink l4 0 2023-12-06T15:00:22.418 INFO:tasks.workunit.client.0.smithi152.stdout:9/114: dwrite d0/f15 [0,4194304] 0 2023-12-06T15:00:22.419 INFO:tasks.workunit.client.1.smithi190.stdout:8/220: dread d1/f16 [0,4194304] 0 2023-12-06T15:00:22.419 INFO:tasks.workunit.client.1.smithi190.stdout:6/267: rmdir d4/d12/d40/d43 39 2023-12-06T15:00:22.420 INFO:tasks.workunit.client.0.smithi152.stdout:4/255: dread d2/fc [0,4194304] 0 2023-12-06T15:00:22.422 INFO:tasks.workunit.client.1.smithi190.stdout:8/221: link d1/d20/d3b/d34/f40 d1/f43 0 2023-12-06T15:00:22.423 INFO:tasks.workunit.client.1.smithi190.stdout:7/309: dread d0/d5/d1b/d32/f59 [0,4194304] 0 2023-12-06T15:00:22.423 INFO:tasks.workunit.client.1.smithi190.stdout:7/310: dread - d0/d5/d1b/d1c/f4d zero size 2023-12-06T15:00:22.423 INFO:tasks.workunit.client.1.smithi190.stdout:7/311: rename d0/d5 to d0/d5/d1b/d1c/d17/d61 22 2023-12-06T15:00:22.425 INFO:tasks.workunit.client.1.smithi190.stdout:6/268: mknod d4/d12/d40/d43/d45/c50 0 2023-12-06T15:00:22.425 INFO:tasks.workunit.client.1.smithi190.stdout:6/269: chown d4/d12 115213750 1 2023-12-06T15:00:22.426 INFO:tasks.workunit.client.0.smithi152.stdout:3/121: creat d9/f1d x:0 0 0 2023-12-06T15:00:22.427 INFO:tasks.workunit.client.0.smithi152.stdout:4/256: write d2/f1b [859656,78012] 0 2023-12-06T15:00:22.427 INFO:tasks.workunit.client.1.smithi190.stdout:8/222: mknod d1/d20/d3b/d36/c44 0 2023-12-06T15:00:22.428 INFO:tasks.workunit.client.0.smithi152.stdout:3/122: creat d9/d10/d12/f1e x:0 0 0 2023-12-06T15:00:22.428 INFO:tasks.workunit.client.0.smithi152.stdout:4/257: mknod d2/d22/d2f/c46 0 2023-12-06T15:00:22.429 INFO:tasks.workunit.client.0.smithi152.stdout:3/123: mknod d9/d10/c1f 0 2023-12-06T15:00:22.429 INFO:tasks.workunit.client.0.smithi152.stdout:3/124: write f2 [8397013,29548] 0 2023-12-06T15:00:22.429 INFO:tasks.workunit.client.0.smithi152.stdout:3/125: chown d9/d10/d12/f1e 21660 1 2023-12-06T15:00:22.431 INFO:tasks.workunit.client.1.smithi190.stdout:8/223: creat d1/d37/f45 x:0 0 0 2023-12-06T15:00:22.431 INFO:tasks.workunit.client.1.smithi190.stdout:8/224: chown d1/d20/d3b/f18 1 1 2023-12-06T15:00:22.431 INFO:tasks.workunit.client.1.smithi190.stdout:7/312: mknod d0/c62 0 2023-12-06T15:00:22.432 INFO:tasks.workunit.client.0.smithi152.stdout:3/126: symlink d9/d18/l20 0 2023-12-06T15:00:22.432 INFO:tasks.workunit.client.0.smithi152.stdout:3/127: mknod d9/d10/d19/c21 0 2023-12-06T15:00:22.433 INFO:tasks.workunit.client.1.smithi190.stdout:8/225: write d1/f1a [4148483,92711] 0 2023-12-06T15:00:22.435 INFO:tasks.workunit.client.0.smithi152.stdout:4/258: dread d2/d10/f17 [0,4194304] 0 2023-12-06T15:00:22.437 INFO:tasks.workunit.client.0.smithi152.stdout:4/259: symlink d2/d15/l47 0 2023-12-06T15:00:22.440 INFO:tasks.workunit.client.1.smithi190.stdout:8/226: write d1/f4 [4563777,64237] 0 2023-12-06T15:00:22.441 INFO:tasks.workunit.client.0.smithi152.stdout:4/260: creat d2/d10/d27/f48 x:0 0 0 2023-12-06T15:00:22.441 INFO:tasks.workunit.client.0.smithi152.stdout:4/261: truncate d2/d10/f37 676528 0 2023-12-06T15:00:22.441 INFO:tasks.workunit.client.0.smithi152.stdout:4/262: fdatasync d2/d10/d27/d29/f35 0 2023-12-06T15:00:22.442 INFO:tasks.workunit.client.1.smithi190.stdout:8/227: truncate d1/d20/d3b/d34/f40 3746792 0 2023-12-06T15:00:22.443 INFO:tasks.workunit.client.1.smithi190.stdout:8/228: stat d1/d20/d3b/d34/d39 0 2023-12-06T15:00:22.443 INFO:tasks.workunit.client.0.smithi152.stdout:4/263: rename d2/d22/d2f/d40/l3e to d2/d10/d27/d29/l49 0 2023-12-06T15:00:22.443 INFO:tasks.workunit.client.0.smithi152.stdout:4/264: readlink d2/d10/d27/d29/l44 0 2023-12-06T15:00:22.444 INFO:tasks.workunit.client.0.smithi152.stdout:4/265: truncate d2/d10/f17 135460 0 2023-12-06T15:00:22.444 INFO:tasks.workunit.client.1.smithi190.stdout:8/229: write d1/f16 [2893878,83604] 0 2023-12-06T15:00:22.444 INFO:tasks.workunit.client.1.smithi190.stdout:8/230: chown d1/d20/f42 21693182 1 2023-12-06T15:00:22.445 INFO:tasks.workunit.client.0.smithi152.stdout:4/266: write d2/fd [1430064,110210] 0 2023-12-06T15:00:22.447 INFO:tasks.workunit.client.1.smithi190.stdout:8/231: dread d1/fb [0,4194304] 0 2023-12-06T15:00:22.448 INFO:tasks.workunit.client.0.smithi152.stdout:5/126: getdents d7/dd 0 2023-12-06T15:00:22.448 INFO:tasks.workunit.client.0.smithi152.stdout:5/127: chown d7/dd/c17 21651 1 2023-12-06T15:00:22.448 INFO:tasks.workunit.client.1.smithi190.stdout:3/407: dwrite d4/d70/d33/f39 [0,4194304] 0 2023-12-06T15:00:22.448 INFO:tasks.workunit.client.1.smithi190.stdout:8/232: symlink d1/d10/d1c/l46 0 2023-12-06T15:00:22.449 INFO:tasks.workunit.client.1.smithi190.stdout:3/408: creat d4/d70/d19/d1c/f91 x:0 0 0 2023-12-06T15:00:22.449 INFO:tasks.workunit.client.0.smithi152.stdout:4/267: rename d2/d10/f2a to d2/d22/f4a 0 2023-12-06T15:00:22.450 INFO:tasks.workunit.client.0.smithi152.stdout:4/268: dread - d2/d15/d23/f41 zero size 2023-12-06T15:00:22.450 INFO:tasks.workunit.client.1.smithi190.stdout:8/233: creat d1/d37/f47 x:0 0 0 2023-12-06T15:00:22.450 INFO:tasks.workunit.client.1.smithi190.stdout:8/234: truncate d1/d20/d3b/f30 295057 0 2023-12-06T15:00:22.452 INFO:tasks.workunit.client.1.smithi190.stdout:3/409: rename d4/d70/d53/f79 to d4/d70/d33/d36/d68/f92 0 2023-12-06T15:00:22.452 INFO:tasks.workunit.client.1.smithi190.stdout:1/383: dwrite d6/dc/f9 [0,4194304] 0 2023-12-06T15:00:22.452 INFO:tasks.workunit.client.0.smithi152.stdout:4/269: mknod d2/c4b 0 2023-12-06T15:00:22.453 INFO:tasks.workunit.client.0.smithi152.stdout:4/270: getdents d2/d15/d23/d42 0 2023-12-06T15:00:22.453 INFO:tasks.workunit.client.1.smithi190.stdout:1/384: write d6/f25 [5256183,76944] 0 2023-12-06T15:00:22.453 INFO:tasks.workunit.client.1.smithi190.stdout:1/385: chown d6/dc/d3b/c5d 46 1 2023-12-06T15:00:22.453 INFO:tasks.workunit.client.1.smithi190.stdout:3/410: write d4/d70/d7f/f8e [888262,88275] 0 2023-12-06T15:00:22.453 INFO:tasks.workunit.client.1.smithi190.stdout:9/278: dwrite d4/d27/d2f/f37 [0,4194304] 0 2023-12-06T15:00:22.453 INFO:tasks.workunit.client.1.smithi190.stdout:8/235: creat d1/d20/d3b/d36/f48 x:0 0 0 2023-12-06T15:00:22.454 INFO:tasks.workunit.client.1.smithi190.stdout:8/236: dread - d1/d37/f47 zero size 2023-12-06T15:00:22.454 INFO:tasks.workunit.client.1.smithi190.stdout:3/411: symlink d4/d70/d33/d36/d68/d8a/l93 0 2023-12-06T15:00:22.454 INFO:tasks.workunit.client.0.smithi152.stdout:4/271: mknod d2/d15/d23/d42/c4c 0 2023-12-06T15:00:22.454 INFO:tasks.workunit.client.0.smithi152.stdout:6/170: dwrite d1/f13 [8388608,4194304] 0 2023-12-06T15:00:22.455 INFO:tasks.workunit.client.0.smithi152.stdout:4/272: link d2/d15/d23/f41 d2/d22/f4d 0 2023-12-06T15:00:22.456 INFO:tasks.workunit.client.0.smithi152.stdout:4/273: chown d2/fd 2229 1 2023-12-06T15:00:22.456 INFO:tasks.workunit.client.0.smithi152.stdout:9/115: dwrite d0/dd/f17 [0,4194304] 0 2023-12-06T15:00:22.456 INFO:tasks.workunit.client.0.smithi152.stdout:9/116: fdatasync d0/f7 0 2023-12-06T15:00:22.460 INFO:tasks.workunit.client.0.smithi152.stdout:3/128: fdatasync f2 0 2023-12-06T15:00:22.460 INFO:tasks.workunit.client.0.smithi152.stdout:4/274: creat d2/d45/f4e x:0 0 0 2023-12-06T15:00:22.461 INFO:tasks.workunit.client.1.smithi190.stdout:9/279: link d4/d27/d2f/c36 d4/d27/d2f/d5c/c63 0 2023-12-06T15:00:22.461 INFO:tasks.workunit.client.0.smithi152.stdout:9/117: write d0/f15 [3865273,47821] 0 2023-12-06T15:00:22.462 INFO:tasks.workunit.client.0.smithi152.stdout:4/275: symlink d2/d10/d27/d29/l4f 0 2023-12-06T15:00:22.462 INFO:tasks.workunit.client.0.smithi152.stdout:4/276: chown d2/d10/f17 2750 1 2023-12-06T15:00:22.463 INFO:tasks.workunit.client.1.smithi190.stdout:8/237: symlink d1/d10/d1c/l49 0 2023-12-06T15:00:22.465 INFO:tasks.workunit.client.0.smithi152.stdout:9/118: creat d0/dd/d20/f21 x:0 0 0 2023-12-06T15:00:22.465 INFO:tasks.workunit.client.0.smithi152.stdout:9/119: chown d0/c13 120 1 2023-12-06T15:00:22.466 INFO:tasks.workunit.client.0.smithi152.stdout:4/277: creat d2/d22/f50 x:0 0 0 2023-12-06T15:00:22.467 INFO:tasks.workunit.client.1.smithi190.stdout:8/238: symlink d1/d20/d3b/d34/l4a 0 2023-12-06T15:00:22.467 INFO:tasks.workunit.client.1.smithi190.stdout:8/239: dread - d1/d20/d3b/d36/f3c zero size 2023-12-06T15:00:22.467 INFO:tasks.workunit.client.1.smithi190.stdout:8/240: stat d1/d10/d1c/f22 0 2023-12-06T15:00:22.467 INFO:tasks.workunit.client.1.smithi190.stdout:8/241: write d1/d37/f45 [99748,41329] 0 2023-12-06T15:00:22.468 INFO:tasks.workunit.client.0.smithi152.stdout:4/278: symlink d2/d22/d2f/d40/l51 0 2023-12-06T15:00:22.468 INFO:tasks.workunit.client.1.smithi190.stdout:8/242: mkdir d1/d10/d1c/d4b 0 2023-12-06T15:00:22.469 INFO:tasks.workunit.client.1.smithi190.stdout:8/243: chown d1/f41 51964905 1 2023-12-06T15:00:22.469 INFO:tasks.workunit.client.1.smithi190.stdout:8/244: fsync d1/f1e 0 2023-12-06T15:00:22.479 INFO:tasks.workunit.client.1.smithi190.stdout:9/280: dread d4/f13 [0,4194304] 0 2023-12-06T15:00:22.491 INFO:tasks.workunit.client.1.smithi190.stdout:7/313: dwrite d0/df/f45 [0,4194304] 0 2023-12-06T15:00:22.491 INFO:tasks.workunit.client.1.smithi190.stdout:6/270: dwrite d4/f35 [0,4194304] 0 2023-12-06T15:00:22.492 INFO:tasks.workunit.client.1.smithi190.stdout:6/271: write d4/d12/d1a/f39 [1006517,49565] 0 2023-12-06T15:00:22.493 INFO:tasks.workunit.client.1.smithi190.stdout:6/272: mknod d4/c51 0 2023-12-06T15:00:22.501 INFO:tasks.workunit.client.0.smithi152.stdout:5/128: dwrite d7/fc [0,4194304] 0 2023-12-06T15:00:22.501 INFO:tasks.workunit.client.0.smithi152.stdout:3/129: dwrite f2 [0,4194304] 0 2023-12-06T15:00:22.501 INFO:tasks.workunit.client.0.smithi152.stdout:6/171: dwrite d1/d19/d1a/d30/d36/f24 [0,4194304] 0 2023-12-06T15:00:22.502 INFO:tasks.workunit.client.0.smithi152.stdout:5/129: dread d7/f1e [0,4194304] 0 2023-12-06T15:00:22.506 INFO:tasks.workunit.client.1.smithi190.stdout:1/386: dwrite d6/f2f [4194304,4194304] 0 2023-12-06T15:00:22.506 INFO:tasks.workunit.client.1.smithi190.stdout:9/281: dwrite d4/f33 [0,4194304] 0 2023-12-06T15:00:22.507 INFO:tasks.workunit.client.1.smithi190.stdout:1/387: mkdir d6/d49/d74 0 2023-12-06T15:00:22.508 INFO:tasks.workunit.client.1.smithi190.stdout:1/388: write d6/f22 [1611696,69686] 0 2023-12-06T15:00:22.511 INFO:tasks.workunit.client.1.smithi190.stdout:3/412: rename d4/d70/d19/d1c to d4/d70/d53/d56/d94 0 2023-12-06T15:00:22.515 INFO:tasks.workunit.client.1.smithi190.stdout:8/245: dread d1/f16 [0,4194304] 0 2023-12-06T15:00:22.515 INFO:tasks.workunit.client.1.smithi190.stdout:8/246: fdatasync d1/d10/d25/f2a 0 2023-12-06T15:00:22.516 INFO:tasks.workunit.client.0.smithi152.stdout:9/120: rmdir d0/dd/d20 39 2023-12-06T15:00:22.516 INFO:tasks.workunit.client.1.smithi190.stdout:9/282: rename d4/l4c to d4/d27/d2f/d31/d3f/l64 0 2023-12-06T15:00:22.516 INFO:tasks.workunit.client.1.smithi190.stdout:9/283: truncate d4/d27/d2f/f5e 428645 0 2023-12-06T15:00:22.516 INFO:tasks.workunit.client.1.smithi190.stdout:3/413: creat d4/d1b/d69/f95 x:0 0 0 2023-12-06T15:00:22.516 INFO:tasks.workunit.client.1.smithi190.stdout:9/284: write d4/f2d [146904,17505] 0 2023-12-06T15:00:22.517 INFO:tasks.workunit.client.1.smithi190.stdout:8/247: mkdir d1/d20/d3b/d4c 0 2023-12-06T15:00:22.518 INFO:tasks.workunit.client.0.smithi152.stdout:9/121: symlink d0/dd/d20/l22 0 2023-12-06T15:00:22.520 INFO:tasks.workunit.client.1.smithi190.stdout:3/414: symlink d4/d70/d53/d56/d83/l96 0 2023-12-06T15:00:22.520 INFO:tasks.workunit.client.1.smithi190.stdout:3/415: truncate d4/d70/d19/d51/f5f 2837902 0 2023-12-06T15:00:22.520 INFO:tasks.workunit.client.1.smithi190.stdout:3/416: fsync d4/d1b/f34 0 2023-12-06T15:00:22.520 INFO:tasks.workunit.client.1.smithi190.stdout:3/417: fsync d4/d70/d19/d3a/f73 0 2023-12-06T15:00:22.521 INFO:tasks.workunit.client.1.smithi190.stdout:9/285: creat d4/d27/d2f/f65 x:0 0 0 2023-12-06T15:00:22.524 INFO:tasks.workunit.client.0.smithi152.stdout:6/172: dread d1/d19/d1a/f21 [0,4194304] 0 2023-12-06T15:00:22.525 INFO:tasks.workunit.client.1.smithi190.stdout:9/286: mkdir d4/d27/d2f/d66 0 2023-12-06T15:00:22.525 INFO:tasks.workunit.client.1.smithi190.stdout:9/287: readlink d4/l34 0 2023-12-06T15:00:22.534 INFO:tasks.workunit.client.1.smithi190.stdout:7/314: dwrite d0/df/d53/f3c [0,4194304] 0 2023-12-06T15:00:22.535 INFO:tasks.workunit.client.1.smithi190.stdout:7/315: mkdir d0/d5/d63 0 2023-12-06T15:00:22.535 INFO:tasks.workunit.client.1.smithi190.stdout:6/273: dwrite d4/d12/d1a/f42 [0,4194304] 0 2023-12-06T15:00:22.536 INFO:tasks.workunit.client.1.smithi190.stdout:6/274: truncate d4/d12/d1a/d44/f47 23336 0 2023-12-06T15:00:22.536 INFO:tasks.workunit.client.1.smithi190.stdout:6/275: chown d4/d12/d40/d43/d45/d4a 4 1 2023-12-06T15:00:22.536 INFO:tasks.workunit.client.0.smithi152.stdout:4/279: rename d2/d22/d2f to d2/d10/d52 0 2023-12-06T15:00:22.536 INFO:tasks.workunit.client.0.smithi152.stdout:4/280: chown d2/d10/d52/d40/l51 50305 1 2023-12-06T15:00:22.536 INFO:tasks.workunit.client.0.smithi152.stdout:4/281: write d2/d22/f18 [1643007,26838] 0 2023-12-06T15:00:22.537 INFO:tasks.workunit.client.0.smithi152.stdout:5/130: rename l4 to d7/l27 0 2023-12-06T15:00:22.537 INFO:tasks.workunit.client.0.smithi152.stdout:5/131: chown d7/l27 803 1 2023-12-06T15:00:22.537 INFO:tasks.workunit.client.0.smithi152.stdout:5/132: stat d7/fc 0 2023-12-06T15:00:22.539 INFO:tasks.workunit.client.0.smithi152.stdout:4/282: rename d2/d22/f50 to d2/d10/d27/d29/f53 0 2023-12-06T15:00:22.539 INFO:tasks.workunit.client.0.smithi152.stdout:5/133: creat d7/f28 x:0 0 0 2023-12-06T15:00:22.540 INFO:tasks.workunit.client.0.smithi152.stdout:4/283: getdents d2/d10/d52/d40 0 2023-12-06T15:00:22.543 INFO:tasks.workunit.client.0.smithi152.stdout:6/173: dwrite d1/d5/f17 [4194304,4194304] 0 2023-12-06T15:00:22.550 INFO:tasks.workunit.client.1.smithi190.stdout:7/316: dread d0/df/d53/f3c [0,4194304] 0 2023-12-06T15:00:22.556 INFO:tasks.workunit.client.0.smithi152.stdout:6/174: dread d1/d19/d1a/d30/d36/d26/f2d [0,4194304] 0 2023-12-06T15:00:22.571 INFO:tasks.workunit.client.1.smithi190.stdout:2/280: sync 2023-12-06T15:00:22.571 INFO:tasks.workunit.client.1.smithi190.stdout:5/217: sync 2023-12-06T15:00:22.571 INFO:tasks.workunit.client.1.smithi190.stdout:4/230: sync 2023-12-06T15:00:22.571 INFO:tasks.workunit.client.1.smithi190.stdout:0/243: sync 2023-12-06T15:00:22.571 INFO:tasks.workunit.client.1.smithi190.stdout:0/244: truncate d0/da/d3e/d2b/d37/f39 526131 0 2023-12-06T15:00:22.571 INFO:tasks.workunit.client.1.smithi190.stdout:0/245: fsync d0/f2d 0 2023-12-06T15:00:22.571 INFO:tasks.workunit.client.1.smithi190.stdout:0/246: chown d0/da/d3e/d2b/d3c/d46 1828 1 2023-12-06T15:00:22.574 INFO:tasks.workunit.client.1.smithi190.stdout:4/231: symlink d3/d35/d19/l50 0 2023-12-06T15:00:22.575 INFO:tasks.workunit.client.1.smithi190.stdout:0/247: mknod d0/da/d3e/d2b/d37/c4a 0 2023-12-06T15:00:22.577 INFO:tasks.workunit.client.0.smithi152.stdout:5/134: dwrite d7/f28 [0,4194304] 0 2023-12-06T15:00:22.577 INFO:tasks.workunit.client.0.smithi152.stdout:5/135: write d7/f19 [1707917,66390] 0 2023-12-06T15:00:22.577 INFO:tasks.workunit.client.0.smithi152.stdout:5/136: chown d7/f19 271 1 2023-12-06T15:00:22.578 INFO:tasks.workunit.client.1.smithi190.stdout:4/232: getdents d3/d10/d15 0 2023-12-06T15:00:22.579 INFO:tasks.workunit.client.1.smithi190.stdout:4/233: getdents d3/d35/d19/d30 0 2023-12-06T15:00:22.582 INFO:tasks.workunit.client.0.smithi152.stdout:6/175: dread d1/d5/d15/f1d [4194304,4194304] 0 2023-12-06T15:00:22.583 INFO:tasks.workunit.client.0.smithi152.stdout:6/176: chown d1/d1c 1 1 2023-12-06T15:00:22.583 INFO:tasks.workunit.client.0.smithi152.stdout:5/137: dread d7/dd/f20 [0,4194304] 0 2023-12-06T15:00:22.588 INFO:tasks.workunit.client.1.smithi190.stdout:4/234: dread d3/d10/d15/f23 [0,4194304] 0 2023-12-06T15:00:22.590 INFO:tasks.workunit.client.1.smithi190.stdout:4/235: unlink d3/l8 0 2023-12-06T15:00:22.590 INFO:tasks.workunit.client.1.smithi190.stdout:0/248: dread d0/da/f29 [0,4194304] 0 2023-12-06T15:00:22.591 INFO:tasks.workunit.client.1.smithi190.stdout:0/249: rmdir d0/da 39 2023-12-06T15:00:22.593 INFO:tasks.workunit.client.1.smithi190.stdout:0/250: mknod d0/da/d3e/d2b/d37/c4b 0 2023-12-06T15:00:22.593 INFO:tasks.workunit.client.1.smithi190.stdout:0/251: chown d0/da/d3e/d3a/d40/f26 24 1 2023-12-06T15:00:22.595 INFO:tasks.workunit.client.1.smithi190.stdout:0/252: mkdir d0/da/d3e/d2b/d3c/d4c 0 2023-12-06T15:00:22.605 INFO:tasks.workunit.client.1.smithi190.stdout:4/236: dread d3/d10/d15/f2f [0,4194304] 0 2023-12-06T15:00:22.606 INFO:tasks.workunit.client.1.smithi190.stdout:4/237: creat d3/d10/d15/f51 x:0 0 0 2023-12-06T15:00:22.606 INFO:tasks.workunit.client.0.smithi152.stdout:9/122: dwrite d0/f7 [0,4194304] 0 2023-12-06T15:00:22.611 INFO:tasks.workunit.client.1.smithi190.stdout:4/238: write d3/d10/d39/f25 [873316,112580] 0 2023-12-06T15:00:22.614 INFO:tasks.workunit.client.1.smithi190.stdout:4/239: write d3/d10/d39/f25 [490587,23439] 0 2023-12-06T15:00:22.614 INFO:tasks.workunit.client.1.smithi190.stdout:4/240: truncate d3/f14 1765430 0 2023-12-06T15:00:22.615 INFO:tasks.workunit.client.1.smithi190.stdout:4/241: link d3/l38 d3/d35/d19/d41/l52 0 2023-12-06T15:00:22.616 INFO:tasks.workunit.client.1.smithi190.stdout:6/276: dwrite d4/d12/d1a/f38 [0,4194304] 0 2023-12-06T15:00:22.616 INFO:tasks.workunit.client.1.smithi190.stdout:3/418: dwrite d4/d70/d19/f7c [0,4194304] 0 2023-12-06T15:00:22.616 INFO:tasks.workunit.client.0.smithi152.stdout:4/284: dwrite d2/f1f [0,4194304] 0 2023-12-06T15:00:22.617 INFO:tasks.workunit.client.1.smithi190.stdout:6/277: write d4/d12/d1a/f20 [1052547,34871] 0 2023-12-06T15:00:22.618 INFO:tasks.workunit.client.1.smithi190.stdout:4/242: rmdir d3/d35/d19/d30/d3c 39 2023-12-06T15:00:22.618 INFO:tasks.workunit.client.1.smithi190.stdout:4/243: readlink d3/l38 0 2023-12-06T15:00:22.618 INFO:tasks.workunit.client.1.smithi190.stdout:4/244: dread - d3/d10/d15/f51 zero size 2023-12-06T15:00:22.618 INFO:tasks.workunit.client.1.smithi190.stdout:4/245: fdatasync d3/fa 0 2023-12-06T15:00:22.619 INFO:tasks.workunit.client.1.smithi190.stdout:1/389: dwrite d6/dc/d29/d38/d43/f4b [0,4194304] 0 2023-12-06T15:00:22.619 INFO:tasks.workunit.client.1.smithi190.stdout:1/390: chown d6/dc/d3b/d4d 125756 1 2023-12-06T15:00:22.619 INFO:tasks.workunit.client.1.smithi190.stdout:1/391: dread - d6/dc/f46 zero size 2023-12-06T15:00:22.620 INFO:tasks.workunit.client.1.smithi190.stdout:7/317: dwrite d0/df/d1f/f58 [0,4194304] 0 2023-12-06T15:00:22.620 INFO:tasks.workunit.client.1.smithi190.stdout:9/288: dwrite d4/f2d [0,4194304] 0 2023-12-06T15:00:22.620 INFO:tasks.workunit.client.1.smithi190.stdout:9/289: write d4/d27/d2f/f4f [294556,62] 0 2023-12-06T15:00:22.620 INFO:tasks.workunit.client.1.smithi190.stdout:3/419: creat d4/d1b/d54/f97 x:0 0 0 2023-12-06T15:00:22.620 INFO:tasks.workunit.client.1.smithi190.stdout:3/420: stat d4/d70/d53/d56/d94/d3d/l4a 0 2023-12-06T15:00:22.620 INFO:tasks.workunit.client.1.smithi190.stdout:0/253: dwrite d0/da/d3e/d3a/d40/f48 [0,4194304] 0 2023-12-06T15:00:22.620 INFO:tasks.workunit.client.0.smithi152.stdout:9/123: dread d0/f14 [0,4194304] 0 2023-12-06T15:00:22.620 INFO:tasks.workunit.client.0.smithi152.stdout:6/177: dwrite d1/d5/fa [8388608,4194304] 0 2023-12-06T15:00:22.620 INFO:tasks.workunit.client.0.smithi152.stdout:6/178: stat d1/d5/fb 0 2023-12-06T15:00:22.621 INFO:tasks.workunit.client.1.smithi190.stdout:6/278: mknod d4/c52 0 2023-12-06T15:00:22.621 INFO:tasks.workunit.client.1.smithi190.stdout:7/318: dread d0/d5/d1b/d1c/d17/f4a [0,4194304] 0 2023-12-06T15:00:22.621 INFO:tasks.workunit.client.1.smithi190.stdout:2/281: dwrite f3 [0,4194304] 0 2023-12-06T15:00:22.622 INFO:tasks.workunit.client.0.smithi152.stdout:9/124: truncate d0/f8 1441827 0 2023-12-06T15:00:22.622 INFO:tasks.workunit.client.1.smithi190.stdout:4/246: creat d3/d35/f53 x:0 0 0 2023-12-06T15:00:22.623 INFO:tasks.workunit.client.1.smithi190.stdout:0/254: read d0/f43 [1689136,11776] 0 2023-12-06T15:00:22.624 INFO:tasks.workunit.client.0.smithi152.stdout:6/179: creat d1/d5/f46 x:0 0 0 2023-12-06T15:00:22.625 INFO:tasks.workunit.client.0.smithi152.stdout:9/125: getdents d0/dd/d20 0 2023-12-06T15:00:22.625 INFO:tasks.workunit.client.0.smithi152.stdout:9/126: chown d0 159643 1 2023-12-06T15:00:22.625 INFO:tasks.workunit.client.0.smithi152.stdout:9/127: dread - d0/dd/d20/f21 zero size 2023-12-06T15:00:22.626 INFO:tasks.workunit.client.1.smithi190.stdout:1/392: mkdir d6/dc/d29/d38/d73/d5c/d75 0 2023-12-06T15:00:22.626 INFO:tasks.workunit.client.1.smithi190.stdout:1/393: write d6/dc/d3b/f62 [1033014,57796] 0 2023-12-06T15:00:22.626 INFO:tasks.workunit.client.0.smithi152.stdout:6/180: getdents d1/d19/d1a 0 2023-12-06T15:00:22.626 INFO:tasks.workunit.client.0.smithi152.stdout:6/181: truncate d1/d19/d1a/d30/f22 435954 0 2023-12-06T15:00:22.627 INFO:tasks.workunit.client.0.smithi152.stdout:6/182: fsync d1/d19/d1a/d30/d18/f28 0 2023-12-06T15:00:22.627 INFO:tasks.workunit.client.0.smithi152.stdout:6/183: write d1/f6 [793499,98230] 0 2023-12-06T15:00:22.627 INFO:tasks.workunit.client.0.smithi152.stdout:6/184: dread - d1/d19/d1a/d30/d18/f2a zero size 2023-12-06T15:00:22.628 INFO:tasks.workunit.client.0.smithi152.stdout:9/128: unlink d0/f7 0 2023-12-06T15:00:22.628 INFO:tasks.workunit.client.0.smithi152.stdout:9/129: fsync d0/f6 0 2023-12-06T15:00:22.629 INFO:tasks.workunit.client.0.smithi152.stdout:9/130: read d0/f14 [3274412,64703] 0 2023-12-06T15:00:22.630 INFO:tasks.workunit.client.0.smithi152.stdout:6/185: link d1/f2c d1/d19/d1a/d30/d36/d35/f47 0 2023-12-06T15:00:22.631 INFO:tasks.workunit.client.0.smithi152.stdout:9/131: creat d0/f23 x:0 0 0 2023-12-06T15:00:22.633 INFO:tasks.workunit.client.0.smithi152.stdout:6/186: link d1/d5/f14 d1/d19/f48 0 2023-12-06T15:00:22.635 INFO:tasks.workunit.client.0.smithi152.stdout:9/132: rmdir d0/dd/d20 39 2023-12-06T15:00:22.635 INFO:tasks.workunit.client.0.smithi152.stdout:9/133: dread - d0/f5 zero size 2023-12-06T15:00:22.636 INFO:tasks.workunit.client.0.smithi152.stdout:6/187: mkdir d1/d19/d1a/d30/d36/d35/d49 0 2023-12-06T15:00:22.647 INFO:tasks.workunit.client.1.smithi190.stdout:9/290: dwrite d4/f33 [0,4194304] 0 2023-12-06T15:00:22.647 INFO:tasks.workunit.client.1.smithi190.stdout:9/291: fdatasync d4/f5b 0 2023-12-06T15:00:22.647 INFO:tasks.workunit.client.1.smithi190.stdout:9/292: write d4/d27/f53 [393904,74933] 0 2023-12-06T15:00:22.649 INFO:tasks.workunit.client.0.smithi152.stdout:6/188: dread d1/d5/d15/f1d [0,4194304] 0 2023-12-06T15:00:22.649 INFO:tasks.workunit.client.0.smithi152.stdout:6/189: truncate d1/d19/d1a/d30/d36/f2e 5037081 0 2023-12-06T15:00:22.650 INFO:tasks.workunit.client.1.smithi190.stdout:3/421: rmdir d4/d70/d53 39 2023-12-06T15:00:22.650 INFO:tasks.workunit.client.1.smithi190.stdout:3/422: write d4/d70/d53/d56/d94/f4e [1482367,97720] 0 2023-12-06T15:00:22.653 INFO:tasks.workunit.client.1.smithi190.stdout:1/394: dwrite d6/dc/d3b/d4d/f54 [0,4194304] 0 2023-12-06T15:00:22.653 INFO:tasks.workunit.client.1.smithi190.stdout:1/395: dread - d6/f5a zero size 2023-12-06T15:00:22.653 INFO:tasks.workunit.client.1.smithi190.stdout:1/396: dread - d6/f5a zero size 2023-12-06T15:00:22.655 INFO:tasks.workunit.client.1.smithi190.stdout:6/279: creat d4/d12/f53 x:0 0 0 2023-12-06T15:00:22.655 INFO:tasks.workunit.client.1.smithi190.stdout:6/280: readlink d4/l6 0 2023-12-06T15:00:22.657 INFO:tasks.workunit.client.1.smithi190.stdout:7/319: creat d0/d5/d1b/d1c/d17/f64 x:0 0 0 2023-12-06T15:00:22.658 INFO:tasks.workunit.client.0.smithi152.stdout:9/134: dwrite d0/f23 [0,4194304] 0 2023-12-06T15:00:22.658 INFO:tasks.workunit.client.0.smithi152.stdout:9/135: fsync d0/f23 0 2023-12-06T15:00:22.663 INFO:tasks.workunit.client.0.smithi152.stdout:9/136: rmdir d0 39 2023-12-06T15:00:22.663 INFO:tasks.workunit.client.0.smithi152.stdout:9/137: stat d0/f1 0 2023-12-06T15:00:22.663 INFO:tasks.workunit.client.1.smithi190.stdout:2/282: symlink d10/d26/d5c/d35/l5f 0 2023-12-06T15:00:22.664 INFO:tasks.workunit.client.1.smithi190.stdout:4/247: mkdir d3/d10/d39/d54 0 2023-12-06T15:00:22.664 INFO:tasks.workunit.client.1.smithi190.stdout:4/248: chown d3/l11 1702326199 1 2023-12-06T15:00:22.664 INFO:tasks.workunit.client.1.smithi190.stdout:0/255: creat d0/da/d3e/d2b/f4d x:0 0 0 2023-12-06T15:00:22.665 INFO:tasks.workunit.client.0.smithi152.stdout:9/138: write d0/f8 [1400322,93401] 0 2023-12-06T15:00:22.666 INFO:tasks.workunit.client.0.smithi152.stdout:9/139: truncate d0/f15 57530 0 2023-12-06T15:00:22.667 INFO:tasks.workunit.client.1.smithi190.stdout:0/256: read d0/f2d [2378019,117954] 0 2023-12-06T15:00:22.668 INFO:tasks.workunit.client.1.smithi190.stdout:0/257: read d0/f2e [3791091,121632] 0 2023-12-06T15:00:22.670 INFO:tasks.workunit.client.1.smithi190.stdout:9/293: rmdir d4 39 2023-12-06T15:00:22.670 INFO:tasks.workunit.client.1.smithi190.stdout:9/294: dread - d4/f5b zero size 2023-12-06T15:00:22.673 INFO:tasks.workunit.client.1.smithi190.stdout:6/281: dwrite d4/fc [8388608,4194304] 0 2023-12-06T15:00:22.673 INFO:tasks.workunit.client.0.smithi152.stdout:6/190: dwrite d1/f3d [0,4194304] 0 2023-12-06T15:00:22.673 INFO:tasks.workunit.client.0.smithi152.stdout:6/191: write d1/f6 [1188982,35713] 0 2023-12-06T15:00:22.674 INFO:tasks.workunit.client.1.smithi190.stdout:3/423: rename d4/d70/d33/d36/f3c to d4/d70/d33/d45/f98 0 2023-12-06T15:00:22.679 INFO:tasks.workunit.client.1.smithi190.stdout:1/397: rmdir d6/dc/d29/d38/d73/d5c/d75 0 2023-12-06T15:00:22.680 INFO:tasks.workunit.client.1.smithi190.stdout:7/320: mknod d0/d5/d63/c65 0 2023-12-06T15:00:22.682 INFO:tasks.workunit.client.1.smithi190.stdout:0/258: dread - d0/da/f3f zero size 2023-12-06T15:00:22.683 INFO:tasks.workunit.client.1.smithi190.stdout:9/295: rmdir d4/d27/d2f/d31 39 2023-12-06T15:00:22.683 INFO:tasks.workunit.client.1.smithi190.stdout:9/296: stat d4/d27/d2f/d31/d3f/l62 0 2023-12-06T15:00:22.684 INFO:tasks.workunit.client.1.smithi190.stdout:6/282: rmdir d4/d12/d1a/d32 39 2023-12-06T15:00:22.686 INFO:tasks.workunit.client.0.smithi152.stdout:6/192: dread d1/d5/fa [8388608,4194304] 0 2023-12-06T15:00:22.686 INFO:tasks.workunit.client.0.smithi152.stdout:6/193: chown d1/d5/f9 26310706 1 2023-12-06T15:00:22.687 INFO:tasks.workunit.client.1.smithi190.stdout:3/424: creat d4/d70/d33/d36/f99 x:0 0 0 2023-12-06T15:00:22.687 INFO:tasks.workunit.client.1.smithi190.stdout:3/425: dread - d4/d70/d53/d56/d83/f88 zero size 2023-12-06T15:00:22.688 INFO:tasks.workunit.client.1.smithi190.stdout:3/426: chown d4/d1b/d77/f8d 957 1 2023-12-06T15:00:22.688 INFO:tasks.workunit.client.1.smithi190.stdout:1/398: mkdir d6/dc/d29/d38/d73/d76 0 2023-12-06T15:00:22.688 INFO:tasks.workunit.client.0.smithi152.stdout:6/194: creat d1/d19/d1a/f4a x:0 0 0 2023-12-06T15:00:22.689 INFO:tasks.workunit.client.0.smithi152.stdout:6/195: getdents d1/d19/d1a/d30/d36 0 2023-12-06T15:00:22.691 INFO:tasks.workunit.client.0.smithi152.stdout:6/196: mkdir d1/d19/d4b 0 2023-12-06T15:00:22.691 INFO:tasks.workunit.client.1.smithi190.stdout:4/249: creat d3/d35/d19/d30/d3c/d4d/f55 x:0 0 0 2023-12-06T15:00:22.691 INFO:tasks.workunit.client.1.smithi190.stdout:0/259: mknod d0/da/d3e/d2b/d3c/c4e 0 2023-12-06T15:00:22.691 INFO:tasks.workunit.client.1.smithi190.stdout:4/250: truncate d3/d10/d15/f2f 5226774 0 2023-12-06T15:00:22.693 INFO:tasks.workunit.client.1.smithi190.stdout:9/297: creat d4/f67 x:0 0 0 2023-12-06T15:00:22.693 INFO:tasks.workunit.client.0.smithi152.stdout:6/197: rmdir d1/d19/d1a/d30 39 2023-12-06T15:00:22.693 INFO:tasks.workunit.client.1.smithi190.stdout:6/283: rename d4/d12/d1a/f38 to d4/d15/f54 0 2023-12-06T15:00:22.694 INFO:tasks.workunit.client.1.smithi190.stdout:1/399: write d6/f12 [1999266,56101] 0 2023-12-06T15:00:22.694 INFO:tasks.workunit.client.1.smithi190.stdout:6/284: write d4/f30 [5126868,78633] 0 2023-12-06T15:00:22.694 INFO:tasks.workunit.client.1.smithi190.stdout:3/427: creat d4/d70/d53/f9a x:0 0 0 2023-12-06T15:00:22.695 INFO:tasks.workunit.client.1.smithi190.stdout:0/260: dread - d0/da/f3d zero size 2023-12-06T15:00:22.696 INFO:tasks.workunit.client.1.smithi190.stdout:9/298: mknod d4/d27/d2f/d31/d3f/c68 0 2023-12-06T15:00:22.696 INFO:tasks.workunit.client.1.smithi190.stdout:9/299: chown f0 15 1 2023-12-06T15:00:22.696 INFO:tasks.workunit.client.1.smithi190.stdout:9/300: chown d4/d27/d2f/l32 34977 1 2023-12-06T15:00:22.696 INFO:tasks.workunit.client.1.smithi190.stdout:9/301: chown d4/d27/d2f/d31/d3f/l64 4783 1 2023-12-06T15:00:22.696 INFO:tasks.workunit.client.1.smithi190.stdout:9/302: chown d4/f2e 3454043 1 2023-12-06T15:00:22.696 INFO:tasks.workunit.client.1.smithi190.stdout:9/303: fsync d4/f13 0 2023-12-06T15:00:22.697 INFO:tasks.workunit.client.1.smithi190.stdout:6/285: symlink d4/d15/l55 0 2023-12-06T15:00:22.699 INFO:tasks.workunit.client.1.smithi190.stdout:1/400: rename d6/dc/d29/c2b to d6/c77 0 2023-12-06T15:00:22.701 INFO:tasks.workunit.client.1.smithi190.stdout:2/283: dwrite d10/d26/f34 [0,4194304] 0 2023-12-06T15:00:22.701 INFO:tasks.workunit.client.1.smithi190.stdout:2/284: chown d10/d59/d5e 28 1 2023-12-06T15:00:22.701 INFO:tasks.workunit.client.1.smithi190.stdout:2/285: write d10/f2d [4776114,7692] 0 2023-12-06T15:00:22.701 INFO:tasks.workunit.client.1.smithi190.stdout:0/261: symlink d0/da/d3e/d3a/d40/l4f 0 2023-12-06T15:00:22.702 INFO:tasks.workunit.client.1.smithi190.stdout:7/321: dwrite d0/f30 [4194304,4194304] 0 2023-12-06T15:00:22.702 INFO:tasks.workunit.client.1.smithi190.stdout:7/322: write d0/df/d37/f5e [962623,28881] 0 2023-12-06T15:00:22.702 INFO:tasks.workunit.client.0.smithi152.stdout:9/140: dwrite d0/f19 [4194304,4194304] 0 2023-12-06T15:00:22.703 INFO:tasks.workunit.client.1.smithi190.stdout:1/401: fdatasync d6/dc/d3b/f62 0 2023-12-06T15:00:22.703 INFO:tasks.workunit.client.1.smithi190.stdout:6/286: truncate d4/d12/d1a/f1c 1149308 0 2023-12-06T15:00:22.709 INFO:tasks.workunit.client.1.smithi190.stdout:9/304: rename d4/d27/f5f to d4/d27/d2f/d31/d3f/f69 0 2023-12-06T15:00:22.709 INFO:tasks.workunit.client.1.smithi190.stdout:9/305: readlink d4/l34 0 2023-12-06T15:00:22.709 INFO:tasks.workunit.client.1.smithi190.stdout:9/306: chown d4/f18 19 1 2023-12-06T15:00:22.709 INFO:tasks.workunit.client.1.smithi190.stdout:0/262: truncate d0/da/f49 1806709 0 2023-12-06T15:00:22.711 INFO:tasks.workunit.client.1.smithi190.stdout:6/287: creat d4/d12/d1a/d44/f56 x:0 0 0 2023-12-06T15:00:22.713 INFO:tasks.workunit.client.1.smithi190.stdout:9/307: unlink d4/d27/d2f/l5d 0 2023-12-06T15:00:22.715 INFO:tasks.workunit.client.1.smithi190.stdout:0/263: fsync d0/da/f44 0 2023-12-06T15:00:22.716 INFO:tasks.workunit.client.1.smithi190.stdout:3/428: dwrite d4/d70/d53/d56/d94/f91 [0,4194304] 0 2023-12-06T15:00:22.718 INFO:tasks.workunit.client.1.smithi190.stdout:7/323: rename d0/df/d53/d15/l16 to d0/d5/d1b/d32/l66 0 2023-12-06T15:00:22.718 INFO:tasks.workunit.client.1.smithi190.stdout:7/324: fsync d0/d5/d1b/d1c/d17/f4a 0 2023-12-06T15:00:22.718 INFO:tasks.workunit.client.1.smithi190.stdout:7/325: dread - d0/df/d1f/f5d zero size 2023-12-06T15:00:22.718 INFO:tasks.workunit.client.1.smithi190.stdout:7/326: stat d0/cd 0 2023-12-06T15:00:22.718 INFO:tasks.workunit.client.1.smithi190.stdout:7/327: write d0/d5/da/f49 [876719,53288] 0 2023-12-06T15:00:22.718 INFO:tasks.workunit.client.1.smithi190.stdout:7/328: chown d0/df/d37/c50 1 1 2023-12-06T15:00:22.719 INFO:tasks.workunit.client.1.smithi190.stdout:6/288: creat d4/d12/d1a/d44/f57 x:0 0 0 2023-12-06T15:00:22.719 INFO:tasks.workunit.client.0.smithi152.stdout:6/198: getdents d1/d19/d1a 0 2023-12-06T15:00:22.720 INFO:tasks.workunit.client.1.smithi190.stdout:7/329: dread d0/d5/d1b/d1c/d17/f4a [0,4194304] 0 2023-12-06T15:00:22.720 INFO:tasks.workunit.client.1.smithi190.stdout:7/330: stat d0/d5/d1b/c2c 0 2023-12-06T15:00:22.722 INFO:tasks.workunit.client.0.smithi152.stdout:6/199: link d1/l29 d1/d5/d15/l4c 0 2023-12-06T15:00:22.722 INFO:tasks.workunit.client.0.smithi152.stdout:6/200: stat d1/d19/d1a/d30/d36/d37/c38 0 2023-12-06T15:00:22.723 INFO:tasks.workunit.client.0.smithi152.stdout:6/201: mknod d1/d1c/c4d 0 2023-12-06T15:00:22.724 INFO:tasks.workunit.client.1.smithi190.stdout:0/264: rename d0/da/f3d to d0/f50 0 2023-12-06T15:00:22.725 INFO:tasks.workunit.client.1.smithi190.stdout:6/289: fsync d4/d12/d1a/f28 0 2023-12-06T15:00:22.725 INFO:tasks.workunit.client.1.smithi190.stdout:6/290: stat l2 0 2023-12-06T15:00:22.725 INFO:tasks.workunit.client.1.smithi190.stdout:6/291: write d4/d12/d40/d43/f4d [185321,105947] 0 2023-12-06T15:00:22.725 INFO:tasks.workunit.client.1.smithi190.stdout:6/292: write d4/d15/f3c [71254,97868] 0 2023-12-06T15:00:22.726 INFO:tasks.workunit.client.0.smithi152.stdout:6/202: mkdir d1/d19/d1a/d30/d36/d4e 0 2023-12-06T15:00:22.726 INFO:tasks.workunit.client.0.smithi152.stdout:6/203: stat d1/f6 0 2023-12-06T15:00:22.726 INFO:tasks.workunit.client.0.smithi152.stdout:6/204: truncate d1/d19/d1a/f4a 554070 0 2023-12-06T15:00:22.726 INFO:tasks.workunit.client.0.smithi152.stdout:9/141: dwrite d0/dd/d20/f21 [0,4194304] 0 2023-12-06T15:00:22.727 INFO:tasks.workunit.client.0.smithi152.stdout:6/205: link d1/f8 d1/d19/d1a/d30/d36/f4f 0 2023-12-06T15:00:22.727 INFO:tasks.workunit.client.1.smithi190.stdout:7/331: link d0/d5/d1b/l27 d0/l67 0 2023-12-06T15:00:22.727 INFO:tasks.workunit.client.1.smithi190.stdout:7/332: readlink d0/l67 0 2023-12-06T15:00:22.729 INFO:tasks.workunit.client.1.smithi190.stdout:0/265: symlink d0/da/d3e/d2b/d3c/d4c/l51 0 2023-12-06T15:00:22.731 INFO:tasks.workunit.client.1.smithi190.stdout:7/333: mknod d0/d5/d1b/d33/d4c/c68 0 2023-12-06T15:00:22.733 INFO:tasks.workunit.client.0.smithi152.stdout:6/206: getdents d1/d19/d1a/d30 0 2023-12-06T15:00:22.734 INFO:tasks.workunit.client.0.smithi152.stdout:6/207: mkdir d1/d19/d1a/d30/d36/d35/d49/d50 0 2023-12-06T15:00:22.734 INFO:tasks.workunit.client.1.smithi190.stdout:0/266: creat d0/da/d3e/d2b/d3c/d46/f52 x:0 0 0 2023-12-06T15:00:22.734 INFO:tasks.workunit.client.0.smithi152.stdout:6/208: truncate d1/d19/d1a/f21 1929990 0 2023-12-06T15:00:22.737 INFO:tasks.workunit.client.1.smithi190.stdout:5/218: sync 2023-12-06T15:00:22.737 INFO:tasks.workunit.client.1.smithi190.stdout:8/248: sync 2023-12-06T15:00:22.738 INFO:tasks.workunit.client.1.smithi190.stdout:7/334: creat d0/df/d37/f69 x:0 0 0 2023-12-06T15:00:22.738 INFO:tasks.workunit.client.1.smithi190.stdout:7/335: fsync d0/df/d37/f5e 0 2023-12-06T15:00:22.738 INFO:tasks.workunit.client.1.smithi190.stdout:7/336: chown d0/d5/d1b/d1c/l5a 109893 1 2023-12-06T15:00:22.738 INFO:tasks.workunit.client.1.smithi190.stdout:1/402: dwrite f1 [0,4194304] 0 2023-12-06T15:00:22.739 INFO:tasks.workunit.client.1.smithi190.stdout:9/308: dwrite d4/f13 [0,4194304] 0 2023-12-06T15:00:22.741 INFO:tasks.workunit.client.1.smithi190.stdout:0/267: creat d0/da/d3e/d2b/d3c/d4c/f53 x:0 0 0 2023-12-06T15:00:22.742 INFO:tasks.workunit.client.1.smithi190.stdout:5/219: creat d0/df/f41 x:0 0 0 2023-12-06T15:00:22.742 INFO:tasks.workunit.client.1.smithi190.stdout:6/293: dread d4/f35 [0,4194304] 0 2023-12-06T15:00:22.747 INFO:tasks.workunit.client.1.smithi190.stdout:9/309: rename d4/d27/d2f/f65 to d4/d27/f6a 0 2023-12-06T15:00:22.748 INFO:tasks.workunit.client.1.smithi190.stdout:1/403: mkdir d6/dc/d3b/d78 0 2023-12-06T15:00:22.749 INFO:tasks.workunit.client.0.smithi152.stdout:9/142: dread d0/f1 [4194304,4194304] 0 2023-12-06T15:00:22.749 INFO:tasks.workunit.client.0.smithi152.stdout:8/54: sync 2023-12-06T15:00:22.750 INFO:tasks.workunit.client.0.smithi152.stdout:1/275: sync 2023-12-06T15:00:22.750 INFO:tasks.workunit.client.0.smithi152.stdout:7/99: sync 2023-12-06T15:00:22.750 INFO:tasks.workunit.client.0.smithi152.stdout:2/99: sync 2023-12-06T15:00:22.750 INFO:tasks.workunit.client.0.smithi152.stdout:9/143: getdents d0/dd 0 2023-12-06T15:00:22.751 INFO:tasks.workunit.client.1.smithi190.stdout:5/220: symlink d0/l42 0 2023-12-06T15:00:22.751 INFO:tasks.workunit.client.1.smithi190.stdout:6/294: rmdir d4/d12/d1a 39 2023-12-06T15:00:22.752 INFO:tasks.workunit.client.1.smithi190.stdout:9/310: creat d4/f6b x:0 0 0 2023-12-06T15:00:22.752 INFO:tasks.workunit.client.1.smithi190.stdout:7/337: dread d0/d5/d1b/f57 [0,4194304] 0 2023-12-06T15:00:22.752 INFO:tasks.workunit.client.1.smithi190.stdout:7/338: dread - d0/df/d1f/f5d zero size 2023-12-06T15:00:22.753 INFO:tasks.workunit.client.1.smithi190.stdout:1/404: getdents d6/dc/d29/d38 0 2023-12-06T15:00:22.753 INFO:tasks.workunit.client.1.smithi190.stdout:0/268: dread d0/da/f25 [0,4194304] 0 2023-12-06T15:00:22.754 INFO:tasks.workunit.client.0.smithi152.stdout:1/276: getdents d3/da/db/d18 0 2023-12-06T15:00:22.754 INFO:tasks.workunit.client.0.smithi152.stdout:7/100: mknod dd/d17/c1e 0 2023-12-06T15:00:22.754 INFO:tasks.workunit.client.0.smithi152.stdout:2/100: link d6/db/d13/f14 d6/db/d17/f1d 0 2023-12-06T15:00:22.755 INFO:tasks.workunit.client.1.smithi190.stdout:9/311: read f2 [4045322,85064] 0 2023-12-06T15:00:22.756 INFO:tasks.workunit.client.0.smithi152.stdout:9/144: creat d0/f24 x:0 0 0 2023-12-06T15:00:22.756 INFO:tasks.workunit.client.0.smithi152.stdout:9/145: chown d0/f14 3 1 2023-12-06T15:00:22.756 INFO:tasks.workunit.client.0.smithi152.stdout:9/146: truncate d0/dd/fe 5158060 0 2023-12-06T15:00:22.756 INFO:tasks.workunit.client.0.smithi152.stdout:9/147: chown d0/f6 22391 1 2023-12-06T15:00:22.756 INFO:tasks.workunit.client.0.smithi152.stdout:1/277: creat d3/da/db/d18/d52/d62/f72 x:0 0 0 2023-12-06T15:00:22.756 INFO:tasks.workunit.client.0.smithi152.stdout:1/278: fdatasync d3/da/d15/d17/d1a/f4e 0 2023-12-06T15:00:22.757 INFO:tasks.workunit.client.0.smithi152.stdout:7/101: creat dd/df/f1f x:0 0 0 2023-12-06T15:00:22.757 INFO:tasks.workunit.client.0.smithi152.stdout:7/102: chown f8 70 1 2023-12-06T15:00:22.757 INFO:tasks.workunit.client.0.smithi152.stdout:7/103: write dd/df/f1a [1070378,72300] 0 2023-12-06T15:00:22.757 INFO:tasks.workunit.client.0.smithi152.stdout:7/104: chown dd/f11 336708982 1 2023-12-06T15:00:22.758 INFO:tasks.workunit.client.1.smithi190.stdout:6/295: stat d4/d12/d1a/l3b 0 2023-12-06T15:00:22.759 INFO:tasks.workunit.client.1.smithi190.stdout:7/339: unlink d0/d5/d1b/d1c/l5a 0 2023-12-06T15:00:22.759 INFO:tasks.workunit.client.1.smithi190.stdout:1/405: mknod d6/dc/d3b/d78/c79 0 2023-12-06T15:00:22.762 INFO:tasks.workunit.client.1.smithi190.stdout:6/296: write d4/fd [5926445,100001] 0 2023-12-06T15:00:22.762 INFO:tasks.workunit.client.1.smithi190.stdout:9/312: rename d4/d27/d2f/f4f to d4/d27/d2f/d5c/f6c 0 2023-12-06T15:00:22.763 INFO:tasks.workunit.client.1.smithi190.stdout:7/340: unlink d0/d5/d1b/l5c 0 2023-12-06T15:00:22.763 INFO:tasks.workunit.client.1.smithi190.stdout:7/341: write d0/df/d37/f5e [1182350,33697] 0 2023-12-06T15:00:22.764 INFO:tasks.workunit.client.0.smithi152.stdout:1/279: mkdir d3/d73 0 2023-12-06T15:00:22.764 INFO:tasks.workunit.client.0.smithi152.stdout:1/280: write d3/da/db/f48 [1209463,71731] 0 2023-12-06T15:00:22.764 INFO:tasks.workunit.client.0.smithi152.stdout:2/101: rename d6/db/df to d6/d1e 0 2023-12-06T15:00:22.764 INFO:tasks.workunit.client.0.smithi152.stdout:6/209: dwrite d1/d5/f46 [0,4194304] 0 2023-12-06T15:00:22.764 INFO:tasks.workunit.client.0.smithi152.stdout:6/210: chown d1/l1f 19571403 1 2023-12-06T15:00:22.765 INFO:tasks.workunit.client.1.smithi190.stdout:8/249: dwrite d1/f1a [0,4194304] 0 2023-12-06T15:00:22.765 INFO:tasks.workunit.client.1.smithi190.stdout:8/250: getdents d1/d10/d1c/d4b 0 2023-12-06T15:00:22.765 INFO:tasks.workunit.client.1.smithi190.stdout:1/406: creat d6/dc/d29/d38/f7a x:0 0 0 2023-12-06T15:00:22.765 INFO:tasks.workunit.client.1.smithi190.stdout:7/342: write d0/f3 [2121453,113231] 0 2023-12-06T15:00:22.765 INFO:tasks.workunit.client.1.smithi190.stdout:7/343: write d0/df/d37/f69 [837240,15152] 0 2023-12-06T15:00:22.766 INFO:tasks.workunit.client.0.smithi152.stdout:2/102: mknod d6/db/d13/c1f 0 2023-12-06T15:00:22.766 INFO:tasks.workunit.client.0.smithi152.stdout:2/103: stat d6/db/d13/f14 0 2023-12-06T15:00:22.769 INFO:tasks.workunit.client.1.smithi190.stdout:0/269: link d0/da/l1d d0/da/d3e/d3a/d40/l54 0 2023-12-06T15:00:22.770 INFO:tasks.workunit.client.0.smithi152.stdout:6/211: symlink d1/d19/d1a/l51 0 2023-12-06T15:00:22.771 INFO:tasks.workunit.client.1.smithi190.stdout:7/344: dread d0/d5/d1b/f57 [0,4194304] 0 2023-12-06T15:00:22.772 INFO:tasks.workunit.client.1.smithi190.stdout:9/313: symlink d4/d27/l6d 0 2023-12-06T15:00:22.772 INFO:tasks.workunit.client.1.smithi190.stdout:9/314: readlink d4/l34 0 2023-12-06T15:00:22.772 INFO:tasks.workunit.client.1.smithi190.stdout:9/315: write d4/f22 [962758,43129] 0 2023-12-06T15:00:22.773 INFO:tasks.workunit.client.1.smithi190.stdout:8/251: mkdir d1/d20/d3b/d4d 0 2023-12-06T15:00:22.774 INFO:tasks.workunit.client.1.smithi190.stdout:1/407: truncate d6/f69 746421 0 2023-12-06T15:00:22.776 INFO:tasks.workunit.client.0.smithi152.stdout:1/281: dread d3/da/d15/d17/d1a/f28 [0,4194304] 0 2023-12-06T15:00:22.776 INFO:tasks.workunit.client.0.smithi152.stdout:1/282: stat d3/da/d4c 0 2023-12-06T15:00:22.778 INFO:tasks.workunit.client.0.smithi152.stdout:7/105: dread dd/f11 [0,4194304] 0 2023-12-06T15:00:22.779 INFO:tasks.workunit.client.1.smithi190.stdout:6/297: mknod d4/d12/d1a/c58 0 2023-12-06T15:00:22.779 INFO:tasks.workunit.client.1.smithi190.stdout:0/270: symlink d0/da/d3e/d3a/d40/l55 0 2023-12-06T15:00:22.779 INFO:tasks.workunit.client.1.smithi190.stdout:1/408: read d6/f12 [717634,48154] 0 2023-12-06T15:00:22.779 INFO:tasks.workunit.client.1.smithi190.stdout:7/345: symlink d0/d5/l6a 0 2023-12-06T15:00:22.779 INFO:tasks.workunit.client.1.smithi190.stdout:5/221: dwrite d0/fd [0,4194304] 0 2023-12-06T15:00:22.780 INFO:tasks.workunit.client.0.smithi152.stdout:1/283: link d3/da/d15/d17/f4f d3/da/db/d18/d52/d55/f74 0 2023-12-06T15:00:22.781 INFO:tasks.workunit.client.0.smithi152.stdout:6/212: dread d1/d5/f14 [4194304,4194304] 0 2023-12-06T15:00:22.781 INFO:tasks.workunit.client.0.smithi152.stdout:7/106: mkdir dd/df/d1b/d20 0 2023-12-06T15:00:22.782 INFO:tasks.workunit.client.1.smithi190.stdout:8/252: creat d1/d10/d1c/f4e x:0 0 0 2023-12-06T15:00:22.783 INFO:tasks.workunit.client.1.smithi190.stdout:0/271: symlink d0/da/d3e/d3a/l56 0 2023-12-06T15:00:22.787 INFO:tasks.workunit.client.0.smithi152.stdout:1/284: mkdir d3/da/db/d18/d75 0 2023-12-06T15:00:22.787 INFO:tasks.workunit.client.0.smithi152.stdout:1/285: stat d3/da/f36 0 2023-12-06T15:00:22.788 INFO:tasks.workunit.client.0.smithi152.stdout:1/286: truncate d3/da/db/d18/f31 839586 0 2023-12-06T15:00:22.788 INFO:tasks.workunit.client.0.smithi152.stdout:1/287: chown d3/da/f36 1 1 2023-12-06T15:00:22.790 INFO:tasks.workunit.client.0.smithi152.stdout:1/288: unlink d3/da/d15/d17/d1a/c5d 0 2023-12-06T15:00:22.790 INFO:tasks.workunit.client.0.smithi152.stdout:1/289: dread - d3/da/d15/d17/d43/f66 zero size 2023-12-06T15:00:22.793 INFO:tasks.workunit.client.1.smithi190.stdout:5/222: rename d0/fb to d0/d1c/d2b/d2c/f43 0 2023-12-06T15:00:22.793 INFO:tasks.workunit.client.1.smithi190.stdout:6/298: mkdir d4/d12/d1a/d59 0 2023-12-06T15:00:22.793 INFO:tasks.workunit.client.1.smithi190.stdout:6/299: read d4/d12/d40/d43/f4d [86491,11888] 0 2023-12-06T15:00:22.793 INFO:tasks.workunit.client.1.smithi190.stdout:6/300: write d4/d12/f53 [165328,81327] 0 2023-12-06T15:00:22.798 INFO:tasks.workunit.client.0.smithi152.stdout:9/148: dwrite d0/f5 [0,4194304] 0 2023-12-06T15:00:22.799 INFO:tasks.workunit.client.1.smithi190.stdout:8/253: creat d1/d10/d1c/f4f x:0 0 0 2023-12-06T15:00:22.799 INFO:tasks.workunit.client.1.smithi190.stdout:0/272: mknod d0/da/d3e/d2b/c57 0 2023-12-06T15:00:22.799 INFO:tasks.workunit.client.1.smithi190.stdout:5/223: creat d0/f44 x:0 0 0 2023-12-06T15:00:22.799 INFO:tasks.workunit.client.1.smithi190.stdout:5/224: dread - d0/f44 zero size 2023-12-06T15:00:22.799 INFO:tasks.workunit.client.1.smithi190.stdout:7/346: mknod d0/df/d53/d15/c6b 0 2023-12-06T15:00:22.799 INFO:tasks.workunit.client.1.smithi190.stdout:8/254: write d1/f1e [1145494,90891] 0 2023-12-06T15:00:22.799 INFO:tasks.workunit.client.1.smithi190.stdout:8/255: stat d1/d20/d3b 0 2023-12-06T15:00:22.799 INFO:tasks.workunit.client.1.smithi190.stdout:6/301: rename d4/d15/l2f to d4/d15/l5a 0 2023-12-06T15:00:22.800 INFO:tasks.workunit.client.1.smithi190.stdout:7/347: rename d0/df/d1f/f5d to d0/d5/da/d56/f6c 0 2023-12-06T15:00:22.801 INFO:tasks.workunit.client.1.smithi190.stdout:6/302: mknod d4/d12/d1a/d59/c5b 0 2023-12-06T15:00:22.801 INFO:tasks.workunit.client.1.smithi190.stdout:7/348: getdents d0/df/d53 0 2023-12-06T15:00:22.801 INFO:tasks.workunit.client.1.smithi190.stdout:7/349: truncate d0/d5/da/d56/f6c 247073 0 2023-12-06T15:00:22.802 INFO:tasks.workunit.client.0.smithi152.stdout:9/149: getdents d0 0 2023-12-06T15:00:22.802 INFO:tasks.workunit.client.1.smithi190.stdout:6/303: symlink d4/d12/d1a/d59/l5c 0 2023-12-06T15:00:22.804 INFO:tasks.workunit.client.1.smithi190.stdout:6/304: getdents d4/d12/d40/d43/d45 0 2023-12-06T15:00:22.804 INFO:tasks.workunit.client.1.smithi190.stdout:7/350: symlink d0/d5/l6d 0 2023-12-06T15:00:22.805 INFO:tasks.workunit.client.1.smithi190.stdout:7/351: mkdir d0/d5/d1b/d1c/d17/d6e 0 2023-12-06T15:00:22.807 INFO:tasks.workunit.client.1.smithi190.stdout:7/352: rename d0/d5/d1b/d1c/d17/f26 to d0/df/d1f/f6f 0 2023-12-06T15:00:22.807 INFO:tasks.workunit.client.1.smithi190.stdout:7/353: write d0/df/d1f/f29 [1701363,1664] 0 2023-12-06T15:00:22.807 INFO:tasks.workunit.client.1.smithi190.stdout:7/354: dread - d0/f34 zero size 2023-12-06T15:00:22.809 INFO:tasks.workunit.client.0.smithi152.stdout:2/104: dwrite d6/f15 [0,4194304] 0 2023-12-06T15:00:22.811 INFO:tasks.workunit.client.1.smithi190.stdout:8/256: dread d1/d10/d1c/f22 [0,4194304] 0 2023-12-06T15:00:22.811 INFO:tasks.workunit.client.0.smithi152.stdout:2/105: creat d6/f20 x:0 0 0 2023-12-06T15:00:22.813 INFO:tasks.workunit.client.0.smithi152.stdout:2/106: unlink d6/f1a 0 2023-12-06T15:00:22.814 INFO:tasks.workunit.client.0.smithi152.stdout:2/107: truncate f4 5101725 0 2023-12-06T15:00:22.814 INFO:tasks.workunit.client.0.smithi152.stdout:2/108: dread - d6/f20 zero size 2023-12-06T15:00:22.814 INFO:tasks.workunit.client.0.smithi152.stdout:2/109: mknod d6/d1e/c21 0 2023-12-06T15:00:22.815 INFO:tasks.workunit.client.1.smithi190.stdout:6/305: dread d4/f35 [0,4194304] 0 2023-12-06T15:00:22.815 INFO:tasks.workunit.client.0.smithi152.stdout:2/110: symlink d6/db/d13/l22 0 2023-12-06T15:00:22.816 INFO:tasks.workunit.client.1.smithi190.stdout:8/257: write d1/f43 [2468745,126475] 0 2023-12-06T15:00:22.816 INFO:tasks.workunit.client.1.smithi190.stdout:8/258: chown d1/d10/d1c/l49 10465 1 2023-12-06T15:00:22.817 INFO:tasks.workunit.client.0.smithi152.stdout:2/111: creat d6/db/d17/f23 x:0 0 0 2023-12-06T15:00:22.817 INFO:tasks.workunit.client.1.smithi190.stdout:9/316: dwrite d4/f67 [0,4194304] 0 2023-12-06T15:00:22.817 INFO:tasks.workunit.client.1.smithi190.stdout:6/306: read d4/f35 [2035694,107583] 0 2023-12-06T15:00:22.817 INFO:tasks.workunit.client.1.smithi190.stdout:6/307: write d4/fe [1374737,101436] 0 2023-12-06T15:00:22.817 INFO:tasks.workunit.client.1.smithi190.stdout:6/308: chown d4/d12/d40/d43/d45/d4a 34310931 1 2023-12-06T15:00:22.817 INFO:tasks.workunit.client.1.smithi190.stdout:8/259: mkdir d1/d20/d3b/d36/d50 0 2023-12-06T15:00:22.820 INFO:tasks.workunit.client.0.smithi152.stdout:7/107: dwrite dd/f15 [0,4194304] 0 2023-12-06T15:00:22.820 INFO:tasks.workunit.client.0.smithi152.stdout:6/213: dwrite d1/d19/d1a/d30/fe [4194304,4194304] 0 2023-12-06T15:00:22.820 INFO:tasks.workunit.client.0.smithi152.stdout:1/290: dwrite d3/da/d15/d17/d1a/f45 [0,4194304] 0 2023-12-06T15:00:22.820 INFO:tasks.workunit.client.0.smithi152.stdout:6/214: chown d1/f2c 363 1 2023-12-06T15:00:22.820 INFO:tasks.workunit.client.0.smithi152.stdout:6/215: write d1/d19/d1a/d30/d18/f28 [703429,11148] 0 2023-12-06T15:00:22.820 INFO:tasks.workunit.client.0.smithi152.stdout:6/216: write d1/d19/d1a/f4a [374393,1152] 0 2023-12-06T15:00:22.821 INFO:tasks.workunit.client.1.smithi190.stdout:6/309: creat d4/d12/d1a/d32/f5d x:0 0 0 2023-12-06T15:00:22.822 INFO:tasks.workunit.client.0.smithi152.stdout:6/217: read d1/d19/d1a/d30/d36/f4f [4580780,109419] 0 2023-12-06T15:00:22.822 INFO:tasks.workunit.client.0.smithi152.stdout:6/218: getdents d1/d3c 0 2023-12-06T15:00:22.822 INFO:tasks.workunit.client.1.smithi190.stdout:8/260: creat d1/f51 x:0 0 0 2023-12-06T15:00:22.824 INFO:tasks.workunit.client.0.smithi152.stdout:1/291: dread d3/f1c [0,4194304] 0 2023-12-06T15:00:22.824 INFO:tasks.workunit.client.0.smithi152.stdout:9/150: write d0/f1 [8294943,86682] 0 2023-12-06T15:00:22.824 INFO:tasks.workunit.client.0.smithi152.stdout:2/112: dread f0 [4194304,4194304] 0 2023-12-06T15:00:22.825 INFO:tasks.workunit.client.0.smithi152.stdout:7/108: link dd/c16 dd/d17/c21 0 2023-12-06T15:00:22.826 INFO:tasks.workunit.client.0.smithi152.stdout:1/292: creat d3/da/d15/d17/d4d/f76 x:0 0 0 2023-12-06T15:00:22.826 INFO:tasks.workunit.client.0.smithi152.stdout:1/293: read - d3/da/d15/d17/d43/f66 zero size 2023-12-06T15:00:22.826 INFO:tasks.workunit.client.0.smithi152.stdout:1/294: chown d3/da/d65/f68 1973 1 2023-12-06T15:00:22.826 INFO:tasks.workunit.client.0.smithi152.stdout:6/219: write d1/d19/d1a/f31 [494571,40043] 0 2023-12-06T15:00:22.826 INFO:tasks.workunit.client.0.smithi152.stdout:6/220: truncate d1/d5/d15/f1d 8893457 0 2023-12-06T15:00:22.827 INFO:tasks.workunit.client.0.smithi152.stdout:9/151: link d0/f14 d0/dd/f25 0 2023-12-06T15:00:22.827 INFO:tasks.workunit.client.0.smithi152.stdout:2/113: rmdir d6/db/d13 39 2023-12-06T15:00:22.827 INFO:tasks.workunit.client.0.smithi152.stdout:2/114: stat d6/cd 0 2023-12-06T15:00:22.828 INFO:tasks.workunit.client.0.smithi152.stdout:2/115: dread - d6/db/d17/f23 zero size 2023-12-06T15:00:22.828 INFO:tasks.workunit.client.0.smithi152.stdout:9/152: write d0/dd/f17 [3912115,16259] 0 2023-12-06T15:00:22.831 INFO:tasks.workunit.client.0.smithi152.stdout:7/109: unlink fb 0 2023-12-06T15:00:22.832 INFO:tasks.workunit.client.1.smithi190.stdout:6/310: mknod d4/d12/d1a/d59/c5e 0 2023-12-06T15:00:22.832 INFO:tasks.workunit.client.1.smithi190.stdout:8/261: truncate d1/f1b 4156514 0 2023-12-06T15:00:22.833 INFO:tasks.workunit.client.0.smithi152.stdout:1/295: creat d3/da/d65/f77 x:0 0 0 2023-12-06T15:00:22.834 INFO:tasks.workunit.client.1.smithi190.stdout:1/409: link d6/f69 d6/dc/d29/d38/d43/f7b 0 2023-12-06T15:00:22.838 INFO:tasks.workunit.client.0.smithi152.stdout:6/221: unlink d1/d19/d1a/d30/d18/c43 0 2023-12-06T15:00:22.839 INFO:tasks.workunit.client.1.smithi190.stdout:1/410: dread d6/dc/d29/d38/d43/f7b [0,4194304] 0 2023-12-06T15:00:22.843 INFO:tasks.workunit.client.0.smithi152.stdout:2/116: rename d6/db/fc to d6/db/d13/f24 0 2023-12-06T15:00:22.843 INFO:tasks.workunit.client.1.smithi190.stdout:1/411: creat d6/d49/f7c x:0 0 0 2023-12-06T15:00:22.846 INFO:tasks.workunit.client.1.smithi190.stdout:1/412: unlink d6/dc/d3b/f62 0 2023-12-06T15:00:22.848 INFO:tasks.workunit.client.0.smithi152.stdout:2/117: symlink d6/db/d13/l25 0 2023-12-06T15:00:22.848 INFO:tasks.workunit.client.1.smithi190.stdout:1/413: creat d6/dc/d29/d38/d39/d63/d67/f7d x:0 0 0 2023-12-06T15:00:22.849 INFO:tasks.workunit.client.1.smithi190.stdout:7/355: rename d0/d5/da/d56/f6c to d0/df/d53/d2f/f70 0 2023-12-06T15:00:22.849 INFO:tasks.workunit.client.0.smithi152.stdout:6/222: dread d1/d5/f9 [0,4194304] 0 2023-12-06T15:00:22.850 INFO:tasks.workunit.client.0.smithi152.stdout:6/223: write d1/d5/f44 [606073,83458] 0 2023-12-06T15:00:22.850 INFO:tasks.workunit.client.0.smithi152.stdout:6/224: chown d1/l29 0 1 2023-12-06T15:00:22.851 INFO:tasks.workunit.client.1.smithi190.stdout:9/317: rename d4/f43 to d4/d27/d2f/d66/f6e 0 2023-12-06T15:00:22.851 INFO:tasks.workunit.client.0.smithi152.stdout:6/225: link d1/d19/d1a/d30/d36/d37/c38 d1/d1c/c52 0 2023-12-06T15:00:22.852 INFO:tasks.workunit.client.1.smithi190.stdout:7/356: truncate d0/d5/d1b/f57 1724717 0 2023-12-06T15:00:22.853 INFO:tasks.workunit.client.0.smithi152.stdout:6/226: link d1/f7 d1/d19/d1a/d30/d36/d26/f53 0 2023-12-06T15:00:22.853 INFO:tasks.workunit.client.1.smithi190.stdout:7/357: creat d0/d5/d1b/d1c/f71 x:0 0 0 2023-12-06T15:00:22.853 INFO:tasks.workunit.client.1.smithi190.stdout:7/358: chown d0/d5/da/d56 4 1 2023-12-06T15:00:22.855 INFO:tasks.workunit.client.0.smithi152.stdout:6/227: creat d1/d19/d1a/f54 x:0 0 0 2023-12-06T15:00:22.855 INFO:tasks.workunit.client.0.smithi152.stdout:6/228: readlink d1/d19/d1a/d30/d36/d26/l40 0 2023-12-06T15:00:22.855 INFO:tasks.workunit.client.0.smithi152.stdout:6/229: dread - d1/d19/d1a/d30/d36/d35/f47 zero size 2023-12-06T15:00:22.855 INFO:tasks.workunit.client.0.smithi152.stdout:6/230: fsync d1/d5/fa 0 2023-12-06T15:00:22.856 INFO:tasks.workunit.client.1.smithi190.stdout:7/359: rename d0/df/d53/f4f to d0/df/d53/f72 0 2023-12-06T15:00:22.856 INFO:tasks.workunit.client.1.smithi190.stdout:7/360: fdatasync d0/df/d1f/f58 0 2023-12-06T15:00:22.856 INFO:tasks.workunit.client.0.smithi152.stdout:6/231: mkdir d1/d19/d1a/d30/d36/d4e/d55 0 2023-12-06T15:00:22.856 INFO:tasks.workunit.client.0.smithi152.stdout:6/232: dread - d1/d19/d1a/d30/d18/f2a zero size 2023-12-06T15:00:22.857 INFO:tasks.workunit.client.1.smithi190.stdout:7/361: read d0/f30 [6145405,36263] 0 2023-12-06T15:00:22.857 INFO:tasks.workunit.client.1.smithi190.stdout:7/362: chown d0/d5/d1b 39 1 2023-12-06T15:00:22.857 INFO:tasks.workunit.client.1.smithi190.stdout:1/414: dread d6/f13 [0,4194304] 0 2023-12-06T15:00:22.859 INFO:tasks.workunit.client.1.smithi190.stdout:7/363: link d0/l2b d0/d5/d1b/d1c/l73 0 2023-12-06T15:00:22.859 INFO:tasks.workunit.client.1.smithi190.stdout:7/364: readlink d0/d5/l6a 0 2023-12-06T15:00:22.860 INFO:tasks.workunit.client.1.smithi190.stdout:1/415: getdents d6/dc/d29 0 2023-12-06T15:00:22.861 INFO:tasks.workunit.client.1.smithi190.stdout:1/416: dread d6/dc/d29/d38/d43/f7b [0,4194304] 0 2023-12-06T15:00:22.863 INFO:tasks.workunit.client.1.smithi190.stdout:1/417: mkdir d6/dc/d29/d38/d73/d76/d7e 0 2023-12-06T15:00:22.863 INFO:tasks.workunit.client.0.smithi152.stdout:7/110: dwrite dd/df/f1f [0,4194304] 0 2023-12-06T15:00:22.863 INFO:tasks.workunit.client.0.smithi152.stdout:7/111: chown f8 3296 1 2023-12-06T15:00:22.863 INFO:tasks.workunit.client.0.smithi152.stdout:7/112: truncate f1 735632 0 2023-12-06T15:00:22.863 INFO:tasks.workunit.client.0.smithi152.stdout:7/113: chown dd/c10 88931 1 2023-12-06T15:00:22.865 INFO:tasks.workunit.client.1.smithi190.stdout:1/418: unlink d6/dc/d3b/d78/c79 0 2023-12-06T15:00:22.865 INFO:tasks.workunit.client.1.smithi190.stdout:1/419: fdatasync d6/dc/d29/d38/d39/f3e 0 2023-12-06T15:00:22.866 INFO:tasks.workunit.client.0.smithi152.stdout:7/114: mkdir dd/df/d22 0 2023-12-06T15:00:22.866 INFO:tasks.workunit.client.1.smithi190.stdout:1/420: getdents d6/dc/d3b/d4d 0 2023-12-06T15:00:22.866 INFO:tasks.workunit.client.0.smithi152.stdout:7/115: write dd/f11 [1590195,119242] 0 2023-12-06T15:00:22.869 INFO:tasks.workunit.client.0.smithi152.stdout:1/296: dwrite d3/da/db/d54/f6a [0,4194304] 0 2023-12-06T15:00:22.871 INFO:tasks.workunit.client.1.smithi190.stdout:6/311: dwrite d4/d12/d40/f48 [0,4194304] 0 2023-12-06T15:00:22.874 INFO:tasks.workunit.client.1.smithi190.stdout:6/312: creat d4/d12/d40/d43/d45/f5f x:0 0 0 2023-12-06T15:00:22.875 INFO:tasks.workunit.client.1.smithi190.stdout:8/262: write d1/f1b [2910082,34122] 0 2023-12-06T15:00:22.875 INFO:tasks.workunit.client.1.smithi190.stdout:8/263: write d1/f1e [1843371,91997] 0 2023-12-06T15:00:22.876 INFO:tasks.workunit.client.1.smithi190.stdout:8/264: chown d1/d20/d3b/f2d 2988 1 2023-12-06T15:00:22.876 INFO:tasks.workunit.client.1.smithi190.stdout:6/313: truncate d4/f30 4970325 0 2023-12-06T15:00:22.876 INFO:tasks.workunit.client.1.smithi190.stdout:6/314: write d4/d12/d1a/d44/f57 [358996,109695] 0 2023-12-06T15:00:22.876 INFO:tasks.workunit.client.0.smithi152.stdout:1/297: creat d3/d44/f78 x:0 0 0 2023-12-06T15:00:22.877 INFO:tasks.workunit.client.1.smithi190.stdout:8/265: symlink d1/d20/d3b/d31/l52 0 2023-12-06T15:00:22.878 INFO:tasks.workunit.client.1.smithi190.stdout:6/315: unlink d4/d12/d1a/l3b 0 2023-12-06T15:00:22.879 INFO:tasks.workunit.client.1.smithi190.stdout:6/316: unlink d4/d12/d1a/l1b 0 2023-12-06T15:00:22.884 INFO:tasks.workunit.client.0.smithi152.stdout:2/118: getdents d6/db/d13 0 2023-12-06T15:00:22.884 INFO:tasks.workunit.client.1.smithi190.stdout:9/318: dwrite d4/d27/d2f/d31/f50 [0,4194304] 0 2023-12-06T15:00:22.884 INFO:tasks.workunit.client.1.smithi190.stdout:9/319: fsync d4/d27/d2f/d31/f38 0 2023-12-06T15:00:22.885 INFO:tasks.workunit.client.1.smithi190.stdout:6/317: write d4/d12/d40/f48 [3341575,10960] 0 2023-12-06T15:00:22.885 INFO:tasks.workunit.client.1.smithi190.stdout:6/318: fsync d4/d12/d1a/f42 0 2023-12-06T15:00:22.886 INFO:tasks.workunit.client.1.smithi190.stdout:6/319: chown d4/d12/f3f 181461 1 2023-12-06T15:00:22.887 INFO:tasks.workunit.client.1.smithi190.stdout:7/365: dwrite d0/d5/d1b/d1c/d17/f4a [0,4194304] 0 2023-12-06T15:00:22.887 INFO:tasks.workunit.client.1.smithi190.stdout:1/421: dwrite d6/f13 [0,4194304] 0 2023-12-06T15:00:22.887 INFO:tasks.workunit.client.1.smithi190.stdout:1/422: write f1 [4293683,93889] 0 2023-12-06T15:00:22.888 INFO:tasks.workunit.client.0.smithi152.stdout:2/119: read d6/db/d13/f14 [3106669,10117] 0 2023-12-06T15:00:22.890 INFO:tasks.workunit.client.0.smithi152.stdout:2/120: symlink d6/db/l26 0 2023-12-06T15:00:22.891 INFO:tasks.workunit.client.1.smithi190.stdout:7/366: mknod d0/d5/d1b/d33/d60/c74 0 2023-12-06T15:00:22.891 INFO:tasks.workunit.client.1.smithi190.stdout:8/266: dread d1/d20/d3b/d36/f3e [0,4194304] 0 2023-12-06T15:00:22.893 INFO:tasks.workunit.client.1.smithi190.stdout:7/367: rename d0/d35/f55 to d0/d5/d1b/d33/d4c/f75 0 2023-12-06T15:00:22.896 INFO:tasks.workunit.client.0.smithi152.stdout:1/298: dwrite d3/da/db/d18/d52/d62/f6b [0,4194304] 0 2023-12-06T15:00:22.896 INFO:tasks.workunit.client.0.smithi152.stdout:1/299: chown d3/da/d15/d17/d1a/f28 9015554 1 2023-12-06T15:00:22.896 INFO:tasks.workunit.client.0.smithi152.stdout:1/300: dread - d3/da/d15/d17/f3d zero size 2023-12-06T15:00:22.896 INFO:tasks.workunit.client.0.smithi152.stdout:1/301: write d3/da/d15/f57 [1446474,126901] 0 2023-12-06T15:00:22.896 INFO:tasks.workunit.client.0.smithi152.stdout:1/302: truncate d3/d44/f46 59008 0 2023-12-06T15:00:22.896 INFO:tasks.workunit.client.0.smithi152.stdout:7/116: truncate dd/f11 115313 0 2023-12-06T15:00:22.896 INFO:tasks.workunit.client.0.smithi152.stdout:7/117: write dd/df/f1f [5083329,35555] 0 2023-12-06T15:00:22.899 INFO:tasks.workunit.client.0.smithi152.stdout:1/303: rename d3/f2b to d3/da/db/d18/d75/f79 0 2023-12-06T15:00:22.899 INFO:tasks.workunit.client.0.smithi152.stdout:1/304: write d3/da/f5c [4080370,25811] 0 2023-12-06T15:00:22.901 INFO:tasks.workunit.client.1.smithi190.stdout:6/320: dread d4/fe [0,4194304] 0 2023-12-06T15:00:22.901 INFO:tasks.workunit.client.1.smithi190.stdout:6/321: truncate d4/d12/d1a/d32/f4c 424365 0 2023-12-06T15:00:22.901 INFO:tasks.workunit.client.0.smithi152.stdout:1/305: creat d3/da/db/d18/d52/d62/f7a x:0 0 0 2023-12-06T15:00:22.902 INFO:tasks.workunit.client.1.smithi190.stdout:8/267: rmdir d1 39 2023-12-06T15:00:22.902 INFO:tasks.workunit.client.1.smithi190.stdout:8/268: write d1/f41 [569847,106570] 0 2023-12-06T15:00:22.904 INFO:tasks.workunit.client.1.smithi190.stdout:6/322: creat d4/d12/d40/d43/d45/f60 x:0 0 0 2023-12-06T15:00:22.906 INFO:tasks.workunit.client.0.smithi152.stdout:1/306: symlink d3/da/db/d18/d52/d55/l7b 0 2023-12-06T15:00:22.906 INFO:tasks.workunit.client.1.smithi190.stdout:8/269: rename d1/d10/f29 to d1/d20/d3b/f53 0 2023-12-06T15:00:22.908 INFO:tasks.workunit.client.0.smithi152.stdout:1/307: unlink d3/da/d15/f1d 0 2023-12-06T15:00:22.908 INFO:tasks.workunit.client.1.smithi190.stdout:8/270: symlink d1/d20/d3b/d31/l54 0 2023-12-06T15:00:22.908 INFO:tasks.workunit.client.1.smithi190.stdout:8/271: getdents d1/d20/d3b/d4c 0 2023-12-06T15:00:22.909 INFO:tasks.workunit.client.0.smithi152.stdout:1/308: mknod d3/da/db/c7c 0 2023-12-06T15:00:22.909 INFO:tasks.workunit.client.1.smithi190.stdout:6/323: link d4/d12/d1a/l2c d4/d12/d1a/d32/l61 0 2023-12-06T15:00:22.910 INFO:tasks.workunit.client.1.smithi190.stdout:6/324: mknod d4/d12/c62 0 2023-12-06T15:00:22.911 INFO:tasks.workunit.client.0.smithi152.stdout:1/309: mkdir d3/da/d15/d17/d43/d7d 0 2023-12-06T15:00:22.912 INFO:tasks.workunit.client.0.smithi152.stdout:1/310: write d3/da/db/d54/f6a [2264177,69100] 0 2023-12-06T15:00:22.912 INFO:tasks.workunit.client.0.smithi152.stdout:1/311: write d3/da/d65/f68 [215424,124836] 0 2023-12-06T15:00:22.913 INFO:tasks.workunit.client.1.smithi190.stdout:6/325: rename l2 to d4/d12/d1a/l63 0 2023-12-06T15:00:22.914 INFO:tasks.workunit.client.1.smithi190.stdout:6/326: mknod d4/d15/c64 0 2023-12-06T15:00:22.914 INFO:tasks.workunit.client.1.smithi190.stdout:6/327: fdatasync d4/d15/f26 0 2023-12-06T15:00:22.915 INFO:tasks.workunit.client.1.smithi190.stdout:6/328: creat d4/d12/d1a/d59/f65 x:0 0 0 2023-12-06T15:00:22.916 INFO:tasks.workunit.client.1.smithi190.stdout:6/329: creat d4/f66 x:0 0 0 2023-12-06T15:00:22.929 INFO:tasks.workunit.client.1.smithi190.stdout:6/330: dwrite d4/d12/d1a/f1c [0,4194304] 0 2023-12-06T15:00:22.931 INFO:tasks.workunit.client.1.smithi190.stdout:6/331: write d4/d12/d40/f48 [2267577,86428] 0 2023-12-06T15:00:22.931 INFO:tasks.workunit.client.1.smithi190.stdout:6/332: mknod d4/d12/d40/d43/c67 0 2023-12-06T15:00:22.932 INFO:tasks.workunit.client.1.smithi190.stdout:6/333: rename d4/d12/d40/d43/d45/c46 to d4/d12/d1a/d32/c68 0 2023-12-06T15:00:22.932 INFO:tasks.workunit.client.1.smithi190.stdout:6/334: truncate d4/d12/d40/d43/d45/f60 169142 0 2023-12-06T15:00:22.933 INFO:tasks.workunit.client.1.smithi190.stdout:6/335: write d4/d12/d1a/d44/f57 [311126,72432] 0 2023-12-06T15:00:22.933 INFO:tasks.workunit.client.1.smithi190.stdout:6/336: fsync d4/d12/d1a/f1c 0 2023-12-06T15:00:22.936 INFO:tasks.workunit.client.0.smithi152.stdout:0/116: sync 2023-12-06T15:00:22.946 INFO:tasks.workunit.client.1.smithi190.stdout:4/251: sync 2023-12-06T15:00:22.946 INFO:tasks.workunit.client.1.smithi190.stdout:2/286: sync 2023-12-06T15:00:22.946 INFO:tasks.workunit.client.1.smithi190.stdout:3/429: sync 2023-12-06T15:00:22.947 INFO:tasks.workunit.client.1.smithi190.stdout:4/252: symlink d3/d35/d19/d30/l56 0 2023-12-06T15:00:22.948 INFO:tasks.workunit.client.1.smithi190.stdout:6/337: dread d4/fd [8388608,4194304] 0 2023-12-06T15:00:22.948 INFO:tasks.workunit.client.1.smithi190.stdout:6/338: truncate d4/d12/d40/f4f 950540 0 2023-12-06T15:00:22.948 INFO:tasks.workunit.client.1.smithi190.stdout:2/287: symlink d10/d26/d5c/l60 0 2023-12-06T15:00:22.949 INFO:tasks.workunit.client.1.smithi190.stdout:3/430: truncate d4/d70/d19/f57 896374 0 2023-12-06T15:00:22.949 INFO:tasks.workunit.client.1.smithi190.stdout:6/339: write d4/d12/d1a/f1c [1530426,114241] 0 2023-12-06T15:00:22.950 INFO:tasks.workunit.client.1.smithi190.stdout:2/288: creat d10/d26/d5c/d49/d54/f61 x:0 0 0 2023-12-06T15:00:22.951 INFO:tasks.workunit.client.1.smithi190.stdout:6/340: creat d4/d12/d40/d43/d45/d4a/f69 x:0 0 0 2023-12-06T15:00:22.951 INFO:tasks.workunit.client.1.smithi190.stdout:6/341: stat d4/f30 0 2023-12-06T15:00:22.951 INFO:tasks.workunit.client.1.smithi190.stdout:4/253: symlink d3/d35/d19/d41/l57 0 2023-12-06T15:00:22.952 INFO:tasks.workunit.client.1.smithi190.stdout:4/254: readlink d3/d10/d15/l2c 0 2023-12-06T15:00:22.954 INFO:tasks.workunit.client.1.smithi190.stdout:2/289: creat d10/f62 x:0 0 0 2023-12-06T15:00:22.954 INFO:tasks.workunit.client.1.smithi190.stdout:2/290: write d10/f58 [430857,89663] 0 2023-12-06T15:00:22.954 INFO:tasks.workunit.client.1.smithi190.stdout:2/291: chown d10/d59/d5e/f25 414041311 1 2023-12-06T15:00:22.956 INFO:tasks.workunit.client.1.smithi190.stdout:6/342: rename d4/d15/l17 to d4/d12/d1a/d59/l6a 0 2023-12-06T15:00:22.956 INFO:tasks.workunit.client.1.smithi190.stdout:6/343: stat d4/fc 0 2023-12-06T15:00:22.956 INFO:tasks.workunit.client.1.smithi190.stdout:6/344: write d4/d12/d1a/d44/f56 [405674,71018] 0 2023-12-06T15:00:22.957 INFO:tasks.workunit.client.1.smithi190.stdout:4/255: symlink d3/d35/d19/d30/d3c/d4d/l58 0 2023-12-06T15:00:22.957 INFO:tasks.workunit.client.1.smithi190.stdout:4/256: write d3/d10/d39/f4b [232123,102519] 0 2023-12-06T15:00:22.957 INFO:tasks.workunit.client.1.smithi190.stdout:3/431: dread d4/d1b/f38 [0,4194304] 0 2023-12-06T15:00:22.958 INFO:tasks.workunit.client.1.smithi190.stdout:2/292: creat d10/d26/d5c/f63 x:0 0 0 2023-12-06T15:00:22.959 INFO:tasks.workunit.client.1.smithi190.stdout:3/432: creat d4/d70/f9b x:0 0 0 2023-12-06T15:00:22.959 INFO:tasks.workunit.client.1.smithi190.stdout:3/433: stat d4/d1b/f38 0 2023-12-06T15:00:22.960 INFO:tasks.workunit.client.1.smithi190.stdout:2/293: mknod d10/d26/d5c/d49/d54/c64 0 2023-12-06T15:00:22.960 INFO:tasks.workunit.client.1.smithi190.stdout:2/294: chown d10/d59/d5e/l20 63 1 2023-12-06T15:00:22.961 INFO:tasks.workunit.client.1.smithi190.stdout:6/345: write d4/d12/d1a/f42 [134703,32028] 0 2023-12-06T15:00:22.962 INFO:tasks.workunit.client.1.smithi190.stdout:4/257: link d3/d10/d15/f23 d3/d35/d19/f59 0 2023-12-06T15:00:22.963 INFO:tasks.workunit.client.0.smithi152.stdout:0/117: dwrite d8/f9 [0,4194304] 0 2023-12-06T15:00:22.963 INFO:tasks.workunit.client.0.smithi152.stdout:0/118: chown d8/d15/f18 2 1 2023-12-06T15:00:22.963 INFO:tasks.workunit.client.1.smithi190.stdout:3/434: stat d4/d70/d53/d56/c6a 0 2023-12-06T15:00:22.964 INFO:tasks.workunit.client.1.smithi190.stdout:2/295: creat d10/d26/d5c/d37/f65 x:0 0 0 2023-12-06T15:00:22.964 INFO:tasks.workunit.client.1.smithi190.stdout:2/296: truncate d10/f39 1038934 0 2023-12-06T15:00:22.964 INFO:tasks.workunit.client.0.smithi152.stdout:0/119: rmdir d8/d15 39 2023-12-06T15:00:22.965 INFO:tasks.workunit.client.1.smithi190.stdout:6/346: rename d4 to d4/d12/d1a/d6b 22 2023-12-06T15:00:22.965 INFO:tasks.workunit.client.0.smithi152.stdout:0/120: rename d8/c12 to d8/c1c 0 2023-12-06T15:00:22.966 INFO:tasks.workunit.client.1.smithi190.stdout:4/258: link d3/d35/d19/d30/d3c/d4d/f55 d3/d35/d19/d30/d3c/f5a 0 2023-12-06T15:00:22.966 INFO:tasks.workunit.client.1.smithi190.stdout:4/259: chown d3/d35/d19/d30/c31 78767 1 2023-12-06T15:00:22.967 INFO:tasks.workunit.client.0.smithi152.stdout:0/121: write d8/ff [328034,83647] 0 2023-12-06T15:00:22.968 INFO:tasks.workunit.client.0.smithi152.stdout:0/122: symlink d8/d1b/l1d 0 2023-12-06T15:00:22.969 INFO:tasks.workunit.client.0.smithi152.stdout:0/123: write d8/f13 [896004,10144] 0 2023-12-06T15:00:22.971 INFO:tasks.workunit.client.1.smithi190.stdout:2/297: link d10/c56 d10/d26/d5b/c66 0 2023-12-06T15:00:22.971 INFO:tasks.workunit.client.0.smithi152.stdout:0/124: mknod d8/c1e 0 2023-12-06T15:00:22.972 INFO:tasks.workunit.client.0.smithi152.stdout:0/125: write d8/f13 [3513106,5474] 0 2023-12-06T15:00:22.973 INFO:tasks.workunit.client.0.smithi152.stdout:0/126: creat d8/d1b/f1f x:0 0 0 2023-12-06T15:00:22.973 INFO:tasks.workunit.client.1.smithi190.stdout:3/435: rename d4/d70/d33/d36 to d4/d1b/d54/d9c 0 2023-12-06T15:00:22.975 INFO:tasks.workunit.client.1.smithi190.stdout:6/347: link d4/l6 d4/d12/d1a/d32/l6c 0 2023-12-06T15:00:22.977 INFO:tasks.workunit.client.1.smithi190.stdout:4/260: chown d3/d35/d19/f47 1851381703 1 2023-12-06T15:00:22.977 INFO:tasks.workunit.client.1.smithi190.stdout:4/261: chown d3/d35/d19/d41/l57 116 1 2023-12-06T15:00:22.977 INFO:tasks.workunit.client.1.smithi190.stdout:4/262: write d3/f40 [752413,62975] 0 2023-12-06T15:00:22.978 INFO:tasks.workunit.client.1.smithi190.stdout:2/298: symlink d10/d59/d5e/l67 0 2023-12-06T15:00:22.978 INFO:tasks.workunit.client.1.smithi190.stdout:2/299: readlink d10/d26/d5c/d35/l5f 0 2023-12-06T15:00:22.981 INFO:tasks.workunit.client.1.smithi190.stdout:6/348: symlink d4/d12/d40/d43/d45/l6d 0 2023-12-06T15:00:22.983 INFO:tasks.workunit.client.1.smithi190.stdout:2/300: creat d10/d26/d5c/d35/f68 x:0 0 0 2023-12-06T15:00:22.985 INFO:tasks.workunit.client.1.smithi190.stdout:3/436: rename d4/d70/d53/d56/d94/d3d/c63 to d4/d1b/c9d 0 2023-12-06T15:00:22.986 INFO:tasks.workunit.client.1.smithi190.stdout:6/349: symlink d4/d12/d1a/d59/l6e 0 2023-12-06T15:00:22.986 INFO:tasks.workunit.client.1.smithi190.stdout:6/350: truncate d4/d12/d40/d43/d45/f5f 153030 0 2023-12-06T15:00:22.987 INFO:tasks.workunit.client.1.smithi190.stdout:2/301: creat d10/d26/d5c/d37/f69 x:0 0 0 2023-12-06T15:00:22.992 INFO:tasks.workunit.client.1.smithi190.stdout:2/302: getdents d10/d26/d5c 0 2023-12-06T15:00:22.992 INFO:tasks.workunit.client.1.smithi190.stdout:2/303: fdatasync fc 0 2023-12-06T15:00:22.992 INFO:tasks.workunit.client.1.smithi190.stdout:2/304: dread - d10/d59/d5e/f2b zero size 2023-12-06T15:00:22.996 INFO:tasks.workunit.client.0.smithi152.stdout:0/127: dwrite d8/f16 [0,4194304] 0 2023-12-06T15:00:22.998 INFO:tasks.workunit.client.1.smithi190.stdout:6/351: rmdir d4 39 2023-12-06T15:00:22.999 INFO:tasks.workunit.client.0.smithi152.stdout:0/128: rmdir d8/d15 39 2023-12-06T15:00:23.000 INFO:tasks.workunit.client.1.smithi190.stdout:6/352: unlink d4/f66 0 2023-12-06T15:00:23.000 INFO:tasks.workunit.client.0.smithi152.stdout:0/129: rename d8/d15/f1a to d8/f20 0 2023-12-06T15:00:23.001 INFO:tasks.workunit.client.0.smithi152.stdout:0/130: creat d8/d15/f21 x:0 0 0 2023-12-06T15:00:23.002 INFO:tasks.workunit.client.0.smithi152.stdout:0/131: link d8/c14 d8/d15/c22 0 2023-12-06T15:00:23.006 INFO:tasks.workunit.client.0.smithi152.stdout:0/132: write f5 [194366,93924] 0 2023-12-06T15:00:23.010 INFO:tasks.workunit.client.1.smithi190.stdout:6/353: dread d4/d15/f26 [0,4194304] 0 2023-12-06T15:00:23.010 INFO:tasks.workunit.client.1.smithi190.stdout:3/437: dwrite d4/d1b/d69/f90 [0,4194304] 0 2023-12-06T15:00:23.011 INFO:tasks.workunit.client.1.smithi190.stdout:3/438: readlink d4/d1b/d54/d9c/d68/d8a/l93 0 2023-12-06T15:00:23.011 INFO:tasks.workunit.client.1.smithi190.stdout:4/263: dwrite d3/d10/d15/f2f [0,4194304] 0 2023-12-06T15:00:23.011 INFO:tasks.workunit.client.1.smithi190.stdout:2/305: dwrite d10/d59/d5e/f25 [0,4194304] 0 2023-12-06T15:00:23.012 INFO:tasks.workunit.client.1.smithi190.stdout:6/354: creat d4/d12/d1a/d32/f6f x:0 0 0 2023-12-06T15:00:23.012 INFO:tasks.workunit.client.1.smithi190.stdout:6/355: write d4/d12/d40/d43/d45/f5f [673176,106925] 0 2023-12-06T15:00:23.012 INFO:tasks.workunit.client.1.smithi190.stdout:6/356: readlink d4/d12/d1a/d59/l6e 0 2023-12-06T15:00:23.012 INFO:tasks.workunit.client.1.smithi190.stdout:6/357: dread - d4/d15/f4e zero size 2023-12-06T15:00:23.013 INFO:tasks.workunit.client.1.smithi190.stdout:3/439: creat d4/d1b/d54/f9e x:0 0 0 2023-12-06T15:00:23.016 INFO:tasks.workunit.client.1.smithi190.stdout:2/306: creat d10/d59/d5e/f6a x:0 0 0 2023-12-06T15:00:23.016 INFO:tasks.workunit.client.1.smithi190.stdout:2/307: truncate d10/d26/f2f 4258034 0 2023-12-06T15:00:23.017 INFO:tasks.workunit.client.1.smithi190.stdout:2/308: write d10/d26/d5c/f43 [436238,93874] 0 2023-12-06T15:00:23.020 INFO:tasks.workunit.client.1.smithi190.stdout:3/440: link d4/l1d d4/d70/d33/d45/l9f 0 2023-12-06T15:00:23.020 INFO:tasks.workunit.client.1.smithi190.stdout:3/441: truncate d4/d70/d53/d56/d94/d3d/f40 2605031 0 2023-12-06T15:00:23.020 INFO:tasks.workunit.client.1.smithi190.stdout:3/442: chown d4/d70/l58 67771075 1 2023-12-06T15:00:23.020 INFO:tasks.workunit.client.1.smithi190.stdout:3/443: chown d4/d1b/d77/f8d 1 1 2023-12-06T15:00:23.020 INFO:tasks.workunit.client.1.smithi190.stdout:3/444: dread - d4/d70/d33/d45/f85 zero size 2023-12-06T15:00:23.022 INFO:tasks.workunit.client.1.smithi190.stdout:2/309: rename d10/c1c to d10/d59/c6b 0 2023-12-06T15:00:23.022 INFO:tasks.workunit.client.1.smithi190.stdout:2/310: chown d10/f58 18 1 2023-12-06T15:00:23.024 INFO:tasks.workunit.client.1.smithi190.stdout:4/264: dread d3/d35/f46 [0,4194304] 0 2023-12-06T15:00:23.026 INFO:tasks.workunit.client.1.smithi190.stdout:3/445: rename d4/l1d to d4/d1b/d54/d9c/d68/d8a/la0 0 2023-12-06T15:00:23.028 INFO:tasks.workunit.client.1.smithi190.stdout:2/311: creat d10/d26/d5c/d42/f6c x:0 0 0 2023-12-06T15:00:23.028 INFO:tasks.workunit.client.1.smithi190.stdout:2/312: readlink d10/d26/d5c/d49/l4a 0 2023-12-06T15:00:23.028 INFO:tasks.workunit.client.1.smithi190.stdout:2/313: getdents d10/d26/d5c 0 2023-12-06T15:00:23.028 INFO:tasks.workunit.client.1.smithi190.stdout:4/265: mkdir d3/d35/d19/d41/d44/d5b 0 2023-12-06T15:00:23.029 INFO:tasks.workunit.client.1.smithi190.stdout:4/266: rmdir d3/d10 39 2023-12-06T15:00:23.029 INFO:tasks.workunit.client.1.smithi190.stdout:4/267: write d3/d35/f46 [5112093,115958] 0 2023-12-06T15:00:23.042 INFO:tasks.workunit.client.1.smithi190.stdout:2/314: dread ff [4194304,4194304] 0 2023-12-06T15:00:23.042 INFO:tasks.workunit.client.1.smithi190.stdout:2/315: chown d10/d26/d5c/d49/d54 226155307 1 2023-12-06T15:00:23.042 INFO:tasks.workunit.client.1.smithi190.stdout:2/316: dread - d10/d26/d5c/d37/f65 zero size 2023-12-06T15:00:23.042 INFO:tasks.workunit.client.1.smithi190.stdout:2/317: chown d10/d26/f29 110487287 1 2023-12-06T15:00:23.045 INFO:tasks.workunit.client.1.smithi190.stdout:2/318: dread d10/f58 [0,4194304] 0 2023-12-06T15:00:23.046 INFO:tasks.workunit.client.0.smithi152.stdout:0/133: dwrite d8/f13 [4194304,4194304] 0 2023-12-06T15:00:23.047 INFO:tasks.workunit.client.1.smithi190.stdout:6/358: dwrite d4/d12/f1d [4194304,4194304] 0 2023-12-06T15:00:23.047 INFO:tasks.workunit.client.1.smithi190.stdout:2/319: dread d10/d26/d5c/d49/d54/f5d [0,4194304] 0 2023-12-06T15:00:23.047 INFO:tasks.workunit.client.1.smithi190.stdout:3/446: dwrite d4/d70/d33/f39 [0,4194304] 0 2023-12-06T15:00:23.049 INFO:tasks.workunit.client.0.smithi152.stdout:0/134: creat d8/d1b/f23 x:0 0 0 2023-12-06T15:00:23.050 INFO:tasks.workunit.client.0.smithi152.stdout:0/135: mknod d8/c24 0 2023-12-06T15:00:23.050 INFO:tasks.workunit.client.0.smithi152.stdout:0/136: chown d8/d15/f18 1 1 2023-12-06T15:00:23.050 INFO:tasks.workunit.client.0.smithi152.stdout:0/137: truncate d8/d1b/f23 421524 0 2023-12-06T15:00:23.053 INFO:tasks.workunit.client.0.smithi152.stdout:0/138: mknod d8/d1b/c25 0 2023-12-06T15:00:23.055 INFO:tasks.workunit.client.0.smithi152.stdout:0/139: rename d8/f16 to d8/d15/f26 0 2023-12-06T15:00:23.071 INFO:tasks.workunit.client.1.smithi190.stdout:6/359: dwrite d4/fd [8388608,4194304] 0 2023-12-06T15:00:23.071 INFO:tasks.workunit.client.1.smithi190.stdout:2/320: dwrite d10/d26/d5c/f63 [0,4194304] 0 2023-12-06T15:00:23.074 INFO:tasks.workunit.client.1.smithi190.stdout:0/273: sync 2023-12-06T15:00:23.075 INFO:tasks.workunit.client.1.smithi190.stdout:0/274: write d0/f2e [4552042,55034] 0 2023-12-06T15:00:23.083 INFO:tasks.workunit.client.0.smithi152.stdout:3/130: sync 2023-12-06T15:00:23.084 INFO:tasks.workunit.client.0.smithi152.stdout:5/138: sync 2023-12-06T15:00:23.084 INFO:tasks.workunit.client.0.smithi152.stdout:5/139: readlink d7/dd/l10 0 2023-12-06T15:00:23.087 INFO:tasks.workunit.client.0.smithi152.stdout:3/131: dread d9/ff [0,4194304] 0 2023-12-06T15:00:23.087 INFO:tasks.workunit.client.0.smithi152.stdout:3/132: chown d9/f11 36 1 2023-12-06T15:00:23.093 INFO:tasks.workunit.client.0.smithi152.stdout:5/140: dread d7/f28 [0,4194304] 0 2023-12-06T15:00:23.093 INFO:tasks.workunit.client.0.smithi152.stdout:5/141: fsync f5 0 2023-12-06T15:00:23.094 INFO:tasks.workunit.client.0.smithi152.stdout:5/142: symlink d7/dd/d26/l29 0 2023-12-06T15:00:23.104 INFO:tasks.workunit.client.1.smithi190.stdout:4/268: creat d3/d10/d39/f5c x:0 0 0 2023-12-06T15:00:23.104 INFO:tasks.workunit.client.1.smithi190.stdout:4/269: readlink d3/d10/d15/l43 0 2023-12-06T15:00:23.104 INFO:tasks.workunit.client.1.smithi190.stdout:4/270: chown d3/f26 82099 1 2023-12-06T15:00:23.104 INFO:tasks.workunit.client.1.smithi190.stdout:4/271: dread - d3/d35/f53 zero size 2023-12-06T15:00:23.104 INFO:tasks.workunit.client.1.smithi190.stdout:4/272: chown d3/d10/d39/f5c 24 1 2023-12-06T15:00:23.105 INFO:tasks.workunit.client.0.smithi152.stdout:3/133: dwrite f2 [0,4194304] 0 2023-12-06T15:00:23.105 INFO:tasks.workunit.client.0.smithi152.stdout:5/143: dread f5 [0,4194304] 0 2023-12-06T15:00:23.105 INFO:tasks.workunit.client.0.smithi152.stdout:3/134: chown d9/d10/d12/f1e 1609 1 2023-12-06T15:00:23.105 INFO:tasks.workunit.client.0.smithi152.stdout:5/144: truncate d7/dd/f14 385424 0 2023-12-06T15:00:23.105 INFO:tasks.workunit.client.0.smithi152.stdout:3/135: write f7 [250277,94383] 0 2023-12-06T15:00:23.106 INFO:tasks.workunit.client.1.smithi190.stdout:3/447: getdents d4/d1b/d54/d9c 0 2023-12-06T15:00:23.123 INFO:tasks.workunit.client.0.smithi152.stdout:5/145: dwrite d7/f1f [0,4194304] 0 2023-12-06T15:00:23.125 INFO:tasks.workunit.client.0.smithi152.stdout:3/136: dwrite d9/f1d [0,4194304] 0 2023-12-06T15:00:23.125 INFO:tasks.workunit.client.0.smithi152.stdout:5/146: creat d7/dd/f2a x:0 0 0 2023-12-06T15:00:23.125 INFO:tasks.workunit.client.0.smithi152.stdout:5/147: write d7/dd/f1c [862864,98163] 0 2023-12-06T15:00:23.127 INFO:tasks.workunit.client.0.smithi152.stdout:5/148: getdents d7 0 2023-12-06T15:00:23.127 INFO:tasks.workunit.client.0.smithi152.stdout:5/149: chown d7/c1a 1537806 1 2023-12-06T15:00:23.128 INFO:tasks.workunit.client.0.smithi152.stdout:5/150: symlink d7/dd/l2b 0 2023-12-06T15:00:23.129 INFO:tasks.workunit.client.0.smithi152.stdout:5/151: creat d7/dd/f2c x:0 0 0 2023-12-06T15:00:23.129 INFO:tasks.workunit.client.0.smithi152.stdout:5/152: fdatasync d7/dd/f1d 0 2023-12-06T15:00:23.136 INFO:tasks.workunit.client.0.smithi152.stdout:3/137: dread f6 [4194304,4194304] 0 2023-12-06T15:00:23.137 INFO:tasks.workunit.client.0.smithi152.stdout:3/138: link d9/d10/c17 d9/d18/c22 0 2023-12-06T15:00:23.139 INFO:tasks.workunit.client.0.smithi152.stdout:5/153: dread d7/f1f [0,4194304] 0 2023-12-06T15:00:23.142 INFO:tasks.workunit.client.0.smithi152.stdout:3/139: dread f6 [4194304,4194304] 0 2023-12-06T15:00:23.142 INFO:tasks.workunit.client.0.smithi152.stdout:5/154: getdents d7/dd 0 2023-12-06T15:00:23.144 INFO:tasks.workunit.client.0.smithi152.stdout:3/140: mknod d9/d18/d1a/c23 0 2023-12-06T15:00:23.144 INFO:tasks.workunit.client.0.smithi152.stdout:3/141: chown d9/d18/d1a 231453 1 2023-12-06T15:00:23.145 INFO:tasks.workunit.client.0.smithi152.stdout:5/155: rename d7/dd/f14 to d7/dd/f2d 0 2023-12-06T15:00:23.146 INFO:tasks.workunit.client.0.smithi152.stdout:5/156: unlink d7/l22 0 2023-12-06T15:00:23.148 INFO:tasks.workunit.client.0.smithi152.stdout:5/157: link d7/f21 d7/dd/d26/f2e 0 2023-12-06T15:00:23.150 INFO:tasks.workunit.client.0.smithi152.stdout:5/158: rename c0 to d7/dd/d26/c2f 0 2023-12-06T15:00:23.150 INFO:tasks.workunit.client.0.smithi152.stdout:5/159: truncate d7/dd/f2d 1349351 0 2023-12-06T15:00:23.150 INFO:tasks.workunit.client.0.smithi152.stdout:5/160: dread - d7/dd/f25 zero size 2023-12-06T15:00:23.151 INFO:tasks.workunit.client.0.smithi152.stdout:5/161: mknod d7/dd/c30 0 2023-12-06T15:00:23.158 INFO:tasks.workunit.client.1.smithi190.stdout:2/321: creat d10/d26/d5c/d49/d54/f6d x:0 0 0 2023-12-06T15:00:23.159 INFO:tasks.workunit.client.1.smithi190.stdout:2/322: chown d10/f2d 15135 1 2023-12-06T15:00:23.160 INFO:tasks.workunit.client.1.smithi190.stdout:0/275: rename d0/da/d3e/d2b/d3c/d4c/l51 to d0/da/d3e/d2b/d3c/d46/l58 0 2023-12-06T15:00:23.162 INFO:tasks.workunit.client.1.smithi190.stdout:4/273: truncate d3/d10/d39/f25 1092825 0 2023-12-06T15:00:23.164 INFO:tasks.workunit.client.1.smithi190.stdout:6/360: mkdir d4/d12/d1a/d70 0 2023-12-06T15:00:23.165 INFO:tasks.workunit.client.0.smithi152.stdout:3/142: dwrite f6 [0,4194304] 0 2023-12-06T15:00:23.165 INFO:tasks.workunit.client.0.smithi152.stdout:3/143: fsync d9/d10/f16 0 2023-12-06T15:00:23.165 INFO:tasks.workunit.client.0.smithi152.stdout:3/144: fsync f7 0 2023-12-06T15:00:23.165 INFO:tasks.workunit.client.0.smithi152.stdout:5/162: dwrite d7/f1f [4194304,4194304] 0 2023-12-06T15:00:23.166 INFO:tasks.workunit.client.1.smithi190.stdout:2/323: unlink d10/d26/d5c/f45 0 2023-12-06T15:00:23.167 INFO:tasks.workunit.client.1.smithi190.stdout:4/274: dread d3/d35/f22 [0,4194304] 0 2023-12-06T15:00:23.168 INFO:tasks.workunit.client.1.smithi190.stdout:4/275: fsync d3/d10/d15/f23 0 2023-12-06T15:00:23.168 INFO:tasks.workunit.client.1.smithi190.stdout:0/276: rename d0/f2d to d0/da/d3e/d2b/d3c/d4c/f59 0 2023-12-06T15:00:23.171 INFO:tasks.workunit.client.1.smithi190.stdout:4/276: symlink d3/d35/l5d 0 2023-12-06T15:00:23.171 INFO:tasks.workunit.client.1.smithi190.stdout:4/277: fsync d3/f26 0 2023-12-06T15:00:23.171 INFO:tasks.workunit.client.1.smithi190.stdout:4/278: write d3/d10/d15/f20 [4206679,98444] 0 2023-12-06T15:00:23.171 INFO:tasks.workunit.client.1.smithi190.stdout:6/361: symlink d4/d12/d1a/l71 0 2023-12-06T15:00:23.171 INFO:tasks.workunit.client.1.smithi190.stdout:6/362: stat d4 0 2023-12-06T15:00:23.172 INFO:tasks.workunit.client.1.smithi190.stdout:0/277: mkdir d0/da/d5a 0 2023-12-06T15:00:23.173 INFO:tasks.workunit.client.0.smithi152.stdout:5/163: mknod d7/dd/c31 0 2023-12-06T15:00:23.175 INFO:tasks.workunit.client.1.smithi190.stdout:6/363: getdents d4/d12/d1a/d32 0 2023-12-06T15:00:23.176 INFO:tasks.workunit.client.0.smithi152.stdout:5/164: rename d7/dd/f1d to d7/dd/d26/f32 0 2023-12-06T15:00:23.176 INFO:tasks.workunit.client.1.smithi190.stdout:0/278: creat d0/da/f5b x:0 0 0 2023-12-06T15:00:23.178 INFO:tasks.workunit.client.0.smithi152.stdout:5/165: creat d7/dd/d26/f33 x:0 0 0 2023-12-06T15:00:23.179 INFO:tasks.workunit.client.1.smithi190.stdout:4/279: rename d3/d10/d39/f4b to d3/d35/d19/f5e 0 2023-12-06T15:00:23.179 INFO:tasks.workunit.client.1.smithi190.stdout:4/280: fsync d3/f33 0 2023-12-06T15:00:23.179 INFO:tasks.workunit.client.1.smithi190.stdout:4/281: write d3/f3f [408182,49985] 0 2023-12-06T15:00:23.179 INFO:tasks.workunit.client.1.smithi190.stdout:4/282: read - d3/d35/d19/d30/d3c/f45 zero size 2023-12-06T15:00:23.179 INFO:tasks.workunit.client.1.smithi190.stdout:2/324: dread d10/d26/d5c/d37/f52 [0,4194304] 0 2023-12-06T15:00:23.179 INFO:tasks.workunit.client.1.smithi190.stdout:4/283: readlink d3/d35/d19/d30/d3c/d4d/l58 0 2023-12-06T15:00:23.179 INFO:tasks.workunit.client.1.smithi190.stdout:4/284: write d3/f40 [700147,70991] 0 2023-12-06T15:00:23.180 INFO:tasks.workunit.client.0.smithi152.stdout:5/166: unlink d7/c1a 0 2023-12-06T15:00:23.180 INFO:tasks.workunit.client.1.smithi190.stdout:6/364: unlink d4/d12/d1a/d32/l2a 0 2023-12-06T15:00:23.180 INFO:tasks.workunit.client.0.smithi152.stdout:3/145: truncate d9/f11 8259003 0 2023-12-06T15:00:23.181 INFO:tasks.workunit.client.1.smithi190.stdout:0/279: creat d0/da/f5c x:0 0 0 2023-12-06T15:00:23.181 INFO:tasks.workunit.client.0.smithi152.stdout:5/167: write d7/dd/f1c [802665,9612] 0 2023-12-06T15:00:23.182 INFO:tasks.workunit.client.0.smithi152.stdout:5/168: readlink d7/l27 0 2023-12-06T15:00:23.183 INFO:tasks.workunit.client.0.smithi152.stdout:3/146: rename f6 to d9/d18/f24 0 2023-12-06T15:00:23.183 INFO:tasks.workunit.client.1.smithi190.stdout:6/365: symlink d4/l72 0 2023-12-06T15:00:23.187 INFO:tasks.workunit.client.1.smithi190.stdout:0/280: link d0/da/d3e/d3a/d40/l55 d0/da/d3e/d3a/d40/l5d 0 2023-12-06T15:00:23.187 INFO:tasks.workunit.client.1.smithi190.stdout:0/281: write d0/da/d3e/d2b/d3c/d46/f52 [409908,50184] 0 2023-12-06T15:00:23.187 INFO:tasks.workunit.client.0.smithi152.stdout:3/147: write f7 [1214919,123419] 0 2023-12-06T15:00:23.188 INFO:tasks.workunit.client.1.smithi190.stdout:6/366: dread d4/d12/d1a/f39 [0,4194304] 0 2023-12-06T15:00:23.190 INFO:tasks.workunit.client.1.smithi190.stdout:8/272: sync 2023-12-06T15:00:23.190 INFO:tasks.workunit.client.1.smithi190.stdout:1/423: sync 2023-12-06T15:00:23.190 INFO:tasks.workunit.client.1.smithi190.stdout:7/368: sync 2023-12-06T15:00:23.190 INFO:tasks.workunit.client.1.smithi190.stdout:9/320: sync 2023-12-06T15:00:23.190 INFO:tasks.workunit.client.1.smithi190.stdout:8/273: fdatasync d1/d20/d3b/d36/f48 0 2023-12-06T15:00:23.190 INFO:tasks.workunit.client.1.smithi190.stdout:1/424: fdatasync d6/f21 0 2023-12-06T15:00:23.191 INFO:tasks.workunit.client.1.smithi190.stdout:8/274: readlink d1/d20/d3b/d31/l52 0 2023-12-06T15:00:23.191 INFO:tasks.workunit.client.1.smithi190.stdout:8/275: fdatasync d1/f41 0 2023-12-06T15:00:23.191 INFO:tasks.workunit.client.1.smithi190.stdout:8/276: fsync d1/f4 0 2023-12-06T15:00:23.191 INFO:tasks.workunit.client.1.smithi190.stdout:8/277: fdatasync d1/d37/f45 0 2023-12-06T15:00:23.191 INFO:tasks.workunit.client.1.smithi190.stdout:5/225: sync 2023-12-06T15:00:23.191 INFO:tasks.workunit.client.1.smithi190.stdout:0/282: creat d0/da/d3e/d3a/d40/f5e x:0 0 0 2023-12-06T15:00:23.191 INFO:tasks.workunit.client.1.smithi190.stdout:6/367: mknod d4/d12/d1a/d44/c73 0 2023-12-06T15:00:23.191 INFO:tasks.workunit.client.1.smithi190.stdout:6/368: chown d4/f30 300750838 1 2023-12-06T15:00:23.191 INFO:tasks.workunit.client.1.smithi190.stdout:6/369: readlink d4/d15/l55 0 2023-12-06T15:00:23.194 INFO:tasks.workunit.client.1.smithi190.stdout:1/425: mkdir d6/dc/d29/d38/d43/d7f 0 2023-12-06T15:00:23.199 INFO:tasks.workunit.client.1.smithi190.stdout:8/278: mkdir d1/d10/d1c/d55 0 2023-12-06T15:00:23.199 INFO:tasks.workunit.client.1.smithi190.stdout:9/321: write d4/fe [2515388,98840] 0 2023-12-06T15:00:23.200 INFO:tasks.workunit.client.1.smithi190.stdout:0/283: creat d0/da/d3e/d2b/d3c/f5f x:0 0 0 2023-12-06T15:00:23.201 INFO:tasks.workunit.client.1.smithi190.stdout:6/370: symlink d4/d12/d40/d43/l74 0 2023-12-06T15:00:23.202 INFO:tasks.workunit.client.1.smithi190.stdout:1/426: symlink d6/dc/d29/d38/d73/l80 0 2023-12-06T15:00:23.203 INFO:tasks.workunit.client.1.smithi190.stdout:8/279: mknod d1/c56 0 2023-12-06T15:00:23.204 INFO:tasks.workunit.client.1.smithi190.stdout:0/284: rename d0/f43 to d0/da/d3e/d2b/d3c/f60 0 2023-12-06T15:00:23.204 INFO:tasks.workunit.client.1.smithi190.stdout:6/371: symlink d4/d12/d40/d43/d45/d4a/l75 0 2023-12-06T15:00:23.205 INFO:tasks.workunit.client.1.smithi190.stdout:1/427: mkdir d6/dc/d29/d38/d43/d7f/d81 0 2023-12-06T15:00:23.206 INFO:tasks.workunit.client.1.smithi190.stdout:8/280: creat d1/d20/d3b/d31/f57 x:0 0 0 2023-12-06T15:00:23.206 INFO:tasks.workunit.client.1.smithi190.stdout:7/369: dread d0/df/d53/f72 [0,4194304] 0 2023-12-06T15:00:23.207 INFO:tasks.workunit.client.1.smithi190.stdout:0/285: unlink d0/da/f3f 0 2023-12-06T15:00:23.207 INFO:tasks.workunit.client.1.smithi190.stdout:0/286: chown d0/da/f25 156 1 2023-12-06T15:00:23.209 INFO:tasks.workunit.client.1.smithi190.stdout:1/428: mknod d6/dc/d29/d38/d73/c82 0 2023-12-06T15:00:23.211 INFO:tasks.workunit.client.1.smithi190.stdout:8/281: unlink d1/f4 0 2023-12-06T15:00:23.211 INFO:tasks.workunit.client.1.smithi190.stdout:8/282: readlink d1/l15 0 2023-12-06T15:00:23.211 INFO:tasks.workunit.client.1.smithi190.stdout:6/372: mkdir d4/d12/d1a/d32/d76 0 2023-12-06T15:00:23.214 INFO:tasks.workunit.client.1.smithi190.stdout:5/226: dwrite d0/f7 [4194304,4194304] 0 2023-12-06T15:00:23.214 INFO:tasks.workunit.client.1.smithi190.stdout:5/227: readlink d0/lc 0 2023-12-06T15:00:23.214 INFO:tasks.workunit.client.1.smithi190.stdout:6/373: mkdir d4/d12/d40/d43/d45/d4a/d77 0 2023-12-06T15:00:23.214 INFO:tasks.workunit.client.1.smithi190.stdout:2/325: dwrite d10/f39 [0,4194304] 0 2023-12-06T15:00:23.214 INFO:tasks.workunit.client.1.smithi190.stdout:2/326: fsync d10/f40 0 2023-12-06T15:00:23.214 INFO:tasks.workunit.client.1.smithi190.stdout:7/370: write d0/d5/d1b/d1c/f28 [2729600,91075] 0 2023-12-06T15:00:23.215 INFO:tasks.workunit.client.1.smithi190.stdout:7/371: readlink d0/d5/l12 0 2023-12-06T15:00:23.225 INFO:tasks.workunit.client.1.smithi190.stdout:7/372: truncate d0/d5/da/f49 329118 0 2023-12-06T15:00:23.225 INFO:tasks.workunit.client.1.smithi190.stdout:6/374: truncate d4/d12/f2d 2157930 0 2023-12-06T15:00:23.225 INFO:tasks.workunit.client.1.smithi190.stdout:1/429: read d6/dc/d29/d38/d39/f6a [1850363,18951] 0 2023-12-06T15:00:23.225 INFO:tasks.workunit.client.1.smithi190.stdout:9/322: dwrite d4/d27/d2f/d31/d3f/d58/f59 [0,4194304] 0 2023-12-06T15:00:23.225 INFO:tasks.workunit.client.1.smithi190.stdout:1/430: write d6/dc/d29/d38/d39/d63/d67/f7d [352322,114092] 0 2023-12-06T15:00:23.226 INFO:tasks.workunit.client.1.smithi190.stdout:5/228: creat d0/d1c/d2b/d2c/f45 x:0 0 0 2023-12-06T15:00:23.226 INFO:tasks.workunit.client.1.smithi190.stdout:3/448: sync 2023-12-06T15:00:23.227 INFO:tasks.workunit.client.1.smithi190.stdout:3/449: write d4/d1b/d54/d9c/f27 [4757795,57786] 0 2023-12-06T15:00:23.227 INFO:tasks.workunit.client.1.smithi190.stdout:3/450: chown d4/d70/d33/l35 3604 1 2023-12-06T15:00:23.227 INFO:tasks.workunit.client.1.smithi190.stdout:4/285: dwrite d3/d10/d15/f51 [0,4194304] 0 2023-12-06T15:00:23.228 INFO:tasks.workunit.client.0.smithi152.stdout:3/148: dwrite d9/f1d [0,4194304] 0 2023-12-06T15:00:23.230 INFO:tasks.workunit.client.1.smithi190.stdout:9/323: dread d4/d27/f53 [0,4194304] 0 2023-12-06T15:00:23.230 INFO:tasks.workunit.client.0.smithi152.stdout:3/149: symlink d9/d18/l25 0 2023-12-06T15:00:23.231 INFO:tasks.workunit.client.0.smithi152.stdout:3/150: write d9/d18/f24 [6126394,5582] 0 2023-12-06T15:00:23.232 INFO:tasks.workunit.client.0.smithi152.stdout:4/285: sync 2023-12-06T15:00:23.232 INFO:tasks.workunit.client.0.smithi152.stdout:3/151: mknod d9/d10/c26 0 2023-12-06T15:00:23.233 INFO:tasks.workunit.client.1.smithi190.stdout:9/324: read d4/f6 [2934701,59417] 0 2023-12-06T15:00:23.233 INFO:tasks.workunit.client.1.smithi190.stdout:5/229: mknod d0/d1c/d2b/d2c/c46 0 2023-12-06T15:00:23.233 INFO:tasks.workunit.client.0.smithi152.stdout:3/152: link d9/d10/c26 d9/d18/d1a/c27 0 2023-12-06T15:00:23.234 INFO:tasks.workunit.client.0.smithi152.stdout:3/153: rmdir d9/d18/d1a 39 2023-12-06T15:00:23.234 INFO:tasks.workunit.client.0.smithi152.stdout:3/154: chown d9/d10/f16 45290 1 2023-12-06T15:00:23.235 INFO:tasks.workunit.client.0.smithi152.stdout:3/155: creat d9/d10/f28 x:0 0 0 2023-12-06T15:00:23.241 INFO:tasks.workunit.client.1.smithi190.stdout:4/286: creat d3/d10/f5f x:0 0 0 2023-12-06T15:00:23.241 INFO:tasks.workunit.client.1.smithi190.stdout:4/287: readlink d3/d10/d15/l43 0 2023-12-06T15:00:23.241 INFO:tasks.workunit.client.1.smithi190.stdout:4/288: getdents d3/d35/d19/d41/d44/d5b 0 2023-12-06T15:00:23.241 INFO:tasks.workunit.client.1.smithi190.stdout:6/375: dread d4/fd [4194304,4194304] 0 2023-12-06T15:00:23.243 INFO:tasks.workunit.client.1.smithi190.stdout:7/373: rename d0/df/c22 to d0/d5/d1b/c76 0 2023-12-06T15:00:23.244 INFO:tasks.workunit.client.1.smithi190.stdout:1/431: dread d6/f69 [0,4194304] 0 2023-12-06T15:00:23.244 INFO:tasks.workunit.client.1.smithi190.stdout:1/432: fsync d6/dc/d29/d38/d43/f4b 0 2023-12-06T15:00:23.244 INFO:tasks.workunit.client.1.smithi190.stdout:9/325: mknod d4/c6f 0 2023-12-06T15:00:23.245 INFO:tasks.workunit.client.1.smithi190.stdout:0/287: dwrite d0/da/d3e/d2b/d3c/f60 [0,4194304] 0 2023-12-06T15:00:23.245 INFO:tasks.workunit.client.1.smithi190.stdout:5/230: rmdir d0/d1c/d3e 39 2023-12-06T15:00:23.247 INFO:tasks.workunit.client.1.smithi190.stdout:4/289: link d3/d35/d19/d41/d44/f4c d3/d10/d39/d54/f60 0 2023-12-06T15:00:23.249 INFO:tasks.workunit.client.1.smithi190.stdout:3/451: rename d4/d70/d19/f41 to d4/d1b/d54/fa1 0 2023-12-06T15:00:23.249 INFO:tasks.workunit.client.1.smithi190.stdout:3/452: dread - d4/d70/d19/d3a/f67 zero size 2023-12-06T15:00:23.249 INFO:tasks.workunit.client.1.smithi190.stdout:3/453: chown d4/d70/d19/d51/l7a 128 1 2023-12-06T15:00:23.249 INFO:tasks.workunit.client.1.smithi190.stdout:3/454: fdatasync d4/d1b/f34 0 2023-12-06T15:00:23.250 INFO:tasks.workunit.client.1.smithi190.stdout:3/455: chown d4/d1b/d69/f6f 68828 1 2023-12-06T15:00:23.251 INFO:tasks.workunit.client.1.smithi190.stdout:9/326: symlink d4/d27/d2f/d31/d3f/l70 0 2023-12-06T15:00:23.253 INFO:tasks.workunit.client.1.smithi190.stdout:5/231: link d0/ca d0/d1c/d2b/c47 0 2023-12-06T15:00:23.254 INFO:tasks.workunit.client.0.smithi152.stdout:4/286: dwrite d2/f9 [0,4194304] 0 2023-12-06T15:00:23.255 INFO:tasks.workunit.client.1.smithi190.stdout:9/327: write d4/d27/d2f/d31/f38 [7900066,113598] 0 2023-12-06T15:00:23.255 INFO:tasks.workunit.client.1.smithi190.stdout:9/328: truncate d4/d27/d2f/f5e 677383 0 2023-12-06T15:00:23.255 INFO:tasks.workunit.client.1.smithi190.stdout:9/329: truncate d4/d27/f49 966963 0 2023-12-06T15:00:23.256 INFO:tasks.workunit.client.0.smithi152.stdout:4/287: mkdir d2/d15/d32/d54 0 2023-12-06T15:00:23.256 INFO:tasks.workunit.client.1.smithi190.stdout:4/290: link d3/d35/f53 d3/d35/d19/d41/d44/d5b/f61 0 2023-12-06T15:00:23.258 INFO:tasks.workunit.client.0.smithi152.stdout:4/288: rename d2/f9 to d2/d15/d32/f55 0 2023-12-06T15:00:23.259 INFO:tasks.workunit.client.1.smithi190.stdout:1/433: dread d6/dc/d3b/d4d/f54 [0,4194304] 0 2023-12-06T15:00:23.259 INFO:tasks.workunit.client.1.smithi190.stdout:8/283: dwrite d1/d20/d3b/d31/f57 [0,4194304] 0 2023-12-06T15:00:23.259 INFO:tasks.workunit.client.1.smithi190.stdout:8/284: chown d1/d20/f42 5479 1 2023-12-06T15:00:23.259 INFO:tasks.workunit.client.0.smithi152.stdout:4/289: stat d2/l1c 0 2023-12-06T15:00:23.260 INFO:tasks.workunit.client.1.smithi190.stdout:7/374: rename d0/df/d1f/f29 to d0/d5/da/f77 0 2023-12-06T15:00:23.261 INFO:tasks.workunit.client.0.smithi152.stdout:4/290: rename d2/fd to d2/d10/d27/d3f/f56 0 2023-12-06T15:00:23.262 INFO:tasks.workunit.client.1.smithi190.stdout:3/456: unlink d4/d1b/d77/f8d 0 2023-12-06T15:00:23.263 INFO:tasks.workunit.client.1.smithi190.stdout:9/330: dread d4/f24 [0,4194304] 0 2023-12-06T15:00:23.263 INFO:tasks.workunit.client.1.smithi190.stdout:2/327: dwrite d10/d59/d5e/f47 [0,4194304] 0 2023-12-06T15:00:23.263 INFO:tasks.workunit.client.0.smithi152.stdout:4/291: rename d2/d10/d27/f2c to d2/d10/d27/d29/f57 0 2023-12-06T15:00:23.264 INFO:tasks.workunit.client.1.smithi190.stdout:5/232: link d0/df/f2e d0/d1c/d2b/f48 0 2023-12-06T15:00:23.264 INFO:tasks.workunit.client.1.smithi190.stdout:5/233: write d0/df/f38 [575692,92987] 0 2023-12-06T15:00:23.264 INFO:tasks.workunit.client.0.smithi152.stdout:4/292: rename d2/d15/f19 to d2/d15/f58 0 2023-12-06T15:00:23.266 INFO:tasks.workunit.client.1.smithi190.stdout:4/291: creat d3/d10/d39/f62 x:0 0 0 2023-12-06T15:00:23.268 INFO:tasks.workunit.client.0.smithi152.stdout:4/293: unlink d2/d10/d27/d29/f35 0 2023-12-06T15:00:23.269 INFO:tasks.workunit.client.1.smithi190.stdout:0/288: dwrite d0/da/d3e/d2b/d3c/d4c/f53 [0,4194304] 0 2023-12-06T15:00:23.269 INFO:tasks.workunit.client.1.smithi190.stdout:0/289: chown d0/da/d3e/d2b/d3c/d46/f52 16181063 1 2023-12-06T15:00:23.270 INFO:tasks.workunit.client.1.smithi190.stdout:1/434: creat d6/dc/d29/f83 x:0 0 0 2023-12-06T15:00:23.270 INFO:tasks.workunit.client.1.smithi190.stdout:1/435: chown d6/f22 2526372 1 2023-12-06T15:00:23.271 INFO:tasks.workunit.client.1.smithi190.stdout:4/292: dread d3/f3f [0,4194304] 0 2023-12-06T15:00:23.272 INFO:tasks.workunit.client.0.smithi152.stdout:3/156: getdents d9/d10 0 2023-12-06T15:00:23.272 INFO:tasks.workunit.client.1.smithi190.stdout:8/285: symlink d1/d20/d3b/d36/l58 0 2023-12-06T15:00:23.272 INFO:tasks.workunit.client.1.smithi190.stdout:8/286: write d1/f35 [831947,78811] 0 2023-12-06T15:00:23.274 INFO:tasks.workunit.client.1.smithi190.stdout:7/375: creat d0/d5/f78 x:0 0 0 2023-12-06T15:00:23.274 INFO:tasks.workunit.client.1.smithi190.stdout:7/376: chown d0/f6 72 1 2023-12-06T15:00:23.274 INFO:tasks.workunit.client.0.smithi152.stdout:3/157: symlink d9/d18/d1a/l29 0 2023-12-06T15:00:23.275 INFO:tasks.workunit.client.1.smithi190.stdout:3/457: creat d4/d70/d53/d56/d8f/fa2 x:0 0 0 2023-12-06T15:00:23.276 INFO:tasks.workunit.client.0.smithi152.stdout:3/158: creat d9/d10/f2a x:0 0 0 2023-12-06T15:00:23.277 INFO:tasks.workunit.client.1.smithi190.stdout:9/331: mknod d4/d27/d2f/d31/c71 0 2023-12-06T15:00:23.278 INFO:tasks.workunit.client.1.smithi190.stdout:7/377: write d0/d5/d1b/f2e [2040740,96083] 0 2023-12-06T15:00:23.279 INFO:tasks.workunit.client.0.smithi152.stdout:3/159: symlink d9/d18/d1a/l2b 0 2023-12-06T15:00:23.282 INFO:tasks.workunit.client.1.smithi190.stdout:4/293: symlink d3/d35/d19/d30/l63 0 2023-12-06T15:00:23.282 INFO:tasks.workunit.client.1.smithi190.stdout:1/436: link d6/d49/f7c d6/dc/d29/d38/d43/d7f/d81/f84 0 2023-12-06T15:00:23.285 INFO:tasks.workunit.client.1.smithi190.stdout:3/458: creat d4/d1b/d5d/fa3 x:0 0 0 2023-12-06T15:00:23.285 INFO:tasks.workunit.client.1.smithi190.stdout:8/287: unlink d1/d20/d3b/d34/d39/c3d 0 2023-12-06T15:00:23.290 INFO:tasks.workunit.client.0.smithi152.stdout:3/160: dread d9/f11 [0,4194304] 0 2023-12-06T15:00:23.290 INFO:tasks.workunit.client.0.smithi152.stdout:3/161: dread - d9/d10/f2a zero size 2023-12-06T15:00:23.291 INFO:tasks.workunit.client.0.smithi152.stdout:3/162: unlink d9/d18/d1a/l1c 0 2023-12-06T15:00:23.292 INFO:tasks.workunit.client.1.smithi190.stdout:5/234: dwrite d0/d1c/f35 [0,4194304] 0 2023-12-06T15:00:23.294 INFO:tasks.workunit.client.1.smithi190.stdout:2/328: dwrite d10/f39 [0,4194304] 0 2023-12-06T15:00:23.297 INFO:tasks.workunit.client.0.smithi152.stdout:4/294: dwrite d2/d10/d27/d3f/f56 [0,4194304] 0 2023-12-06T15:00:23.298 INFO:tasks.workunit.client.1.smithi190.stdout:9/332: unlink d4/f51 0 2023-12-06T15:00:23.300 INFO:tasks.workunit.client.1.smithi190.stdout:7/378: symlink d0/d5/d1b/d1c/d17/d6e/l79 0 2023-12-06T15:00:23.301 INFO:tasks.workunit.client.1.smithi190.stdout:8/288: dread d1/d20/d3b/d34/f40 [0,4194304] 0 2023-12-06T15:00:23.301 INFO:tasks.workunit.client.1.smithi190.stdout:4/294: mknod d3/d4e/c64 0 2023-12-06T15:00:23.304 INFO:tasks.workunit.client.1.smithi190.stdout:1/437: symlink d6/l85 0 2023-12-06T15:00:23.304 INFO:tasks.workunit.client.1.smithi190.stdout:3/459: symlink d4/d70/la4 0 2023-12-06T15:00:23.304 INFO:tasks.workunit.client.1.smithi190.stdout:1/438: chown d6/dc/c32 3708858 1 2023-12-06T15:00:23.304 INFO:tasks.workunit.client.1.smithi190.stdout:5/235: creat d0/d1c/d2b/d2c/f49 x:0 0 0 2023-12-06T15:00:23.304 INFO:tasks.workunit.client.1.smithi190.stdout:9/333: write d4/d27/d2f/d31/f38 [3487339,4961] 0 2023-12-06T15:00:23.304 INFO:tasks.workunit.client.1.smithi190.stdout:9/334: fsync d4/f5b 0 2023-12-06T15:00:23.310 INFO:tasks.workunit.client.0.smithi152.stdout:4/295: dread d2/d10/d27/d3f/f56 [0,4194304] 0 2023-12-06T15:00:23.311 INFO:tasks.workunit.client.1.smithi190.stdout:7/379: rename d0/df/d37 to d0/d5/d1b/d7a 0 2023-12-06T15:00:23.311 INFO:tasks.workunit.client.1.smithi190.stdout:7/380: dread - d0/d5/d1b/d1c/f4d zero size 2023-12-06T15:00:23.313 INFO:tasks.workunit.client.0.smithi152.stdout:4/296: rename d2/f1f to d2/d22/f59 0 2023-12-06T15:00:23.314 INFO:tasks.workunit.client.1.smithi190.stdout:9/335: mkdir d4/d27/d2f/d31/d3f/d58/d72 0 2023-12-06T15:00:23.314 INFO:tasks.workunit.client.1.smithi190.stdout:5/236: dread d0/f6 [4194304,4194304] 0 2023-12-06T15:00:23.315 INFO:tasks.workunit.client.1.smithi190.stdout:3/460: rename d4/d1b/f34 to d4/fa5 0 2023-12-06T15:00:23.316 INFO:tasks.workunit.client.1.smithi190.stdout:7/381: creat d0/f7b x:0 0 0 2023-12-06T15:00:23.317 INFO:tasks.workunit.client.0.smithi152.stdout:3/163: dwrite d9/f11 [4194304,4194304] 0 2023-12-06T15:00:23.318 INFO:tasks.workunit.client.1.smithi190.stdout:9/336: symlink d4/d27/d2f/d66/l73 0 2023-12-06T15:00:23.318 INFO:tasks.workunit.client.1.smithi190.stdout:9/337: chown d4/f67 18333 1 2023-12-06T15:00:23.318 INFO:tasks.workunit.client.0.smithi152.stdout:4/297: creat d2/d15/d32/f5a x:0 0 0 2023-12-06T15:00:23.319 INFO:tasks.workunit.client.1.smithi190.stdout:5/237: rename d0/lc to d0/d1c/l4a 0 2023-12-06T15:00:23.320 INFO:tasks.workunit.client.0.smithi152.stdout:3/164: truncate f7 1563238 0 2023-12-06T15:00:23.320 INFO:tasks.workunit.client.0.smithi152.stdout:3/165: fdatasync d9/d10/f2a 0 2023-12-06T15:00:23.320 INFO:tasks.workunit.client.0.smithi152.stdout:3/166: chown d9/d10/d12/f1e 108971246 1 2023-12-06T15:00:23.323 INFO:tasks.workunit.client.0.smithi152.stdout:3/167: rename d9/f11 to d9/d10/d19/f2c 0 2023-12-06T15:00:23.324 INFO:tasks.workunit.client.1.smithi190.stdout:7/382: write d0/d5/d1b/d1c/f28 [1260555,7255] 0 2023-12-06T15:00:23.324 INFO:tasks.workunit.client.1.smithi190.stdout:7/383: dread - d0/d5/f78 zero size 2023-12-06T15:00:23.324 INFO:tasks.workunit.client.0.smithi152.stdout:3/168: creat d9/f2d x:0 0 0 2023-12-06T15:00:23.326 INFO:tasks.workunit.client.0.smithi152.stdout:4/298: link d2/c1e d2/c5b 0 2023-12-06T15:00:23.326 INFO:tasks.workunit.client.1.smithi190.stdout:9/338: unlink d4/d27/d2f/d5c/l60 0 2023-12-06T15:00:23.327 INFO:tasks.workunit.client.0.smithi152.stdout:3/169: creat d9/d10/f2e x:0 0 0 2023-12-06T15:00:23.327 INFO:tasks.workunit.client.1.smithi190.stdout:8/289: dwrite d1/d20/d3b/d36/f48 [0,4194304] 0 2023-12-06T15:00:23.327 INFO:tasks.workunit.client.1.smithi190.stdout:8/290: truncate d1/d20/d3b/f53 253294 0 2023-12-06T15:00:23.327 INFO:tasks.workunit.client.1.smithi190.stdout:8/291: chown d1/d20/d3b/d31 152 1 2023-12-06T15:00:23.328 INFO:tasks.workunit.client.0.smithi152.stdout:4/299: dread d2/f3a [0,4194304] 0 2023-12-06T15:00:23.329 INFO:tasks.workunit.client.1.smithi190.stdout:5/238: symlink d0/df/l4b 0 2023-12-06T15:00:23.329 INFO:tasks.workunit.client.0.smithi152.stdout:4/300: mknod d2/d10/d52/d40/c5c 0 2023-12-06T15:00:23.329 INFO:tasks.workunit.client.1.smithi190.stdout:1/439: dwrite d6/f5a [0,4194304] 0 2023-12-06T15:00:23.331 INFO:tasks.workunit.client.0.smithi152.stdout:3/170: truncate d9/d18/f24 4687171 0 2023-12-06T15:00:23.333 INFO:tasks.workunit.client.0.smithi152.stdout:3/171: creat d9/d10/f2f x:0 0 0 2023-12-06T15:00:23.333 INFO:tasks.workunit.client.1.smithi190.stdout:7/384: dread d0/f30 [4194304,4194304] 0 2023-12-06T15:00:23.333 INFO:tasks.workunit.client.1.smithi190.stdout:5/239: link d0/d1c/d2b/d2c/f49 d0/d1c/d3e/f4c 0 2023-12-06T15:00:23.334 INFO:tasks.workunit.client.1.smithi190.stdout:8/292: rmdir d1/d10/d1c/d55 0 2023-12-06T15:00:23.334 INFO:tasks.workunit.client.1.smithi190.stdout:5/240: readlink d0/df/l4b 0 2023-12-06T15:00:23.334 INFO:tasks.workunit.client.1.smithi190.stdout:7/385: readlink d0/d5/d1b/d7a/l3b 0 2023-12-06T15:00:23.336 INFO:tasks.workunit.client.0.smithi152.stdout:3/172: rmdir d9/d18/d1a 39 2023-12-06T15:00:23.338 INFO:tasks.workunit.client.1.smithi190.stdout:8/293: mkdir d1/d20/d3b/d4c/d59 0 2023-12-06T15:00:23.339 INFO:tasks.workunit.client.1.smithi190.stdout:8/294: fdatasync d1/d20/d3b/f30 0 2023-12-06T15:00:23.339 INFO:tasks.workunit.client.1.smithi190.stdout:8/295: chown d1/d10/d1c/l2c 62504109 1 2023-12-06T15:00:23.339 INFO:tasks.workunit.client.1.smithi190.stdout:8/296: chown d1/d20/d3b/d34/f38 65491 1 2023-12-06T15:00:23.339 INFO:tasks.workunit.client.1.smithi190.stdout:8/297: readlink d1/d10/d1c/l2c 0 2023-12-06T15:00:23.339 INFO:tasks.workunit.client.0.smithi152.stdout:3/173: creat d9/d10/d12/f30 x:0 0 0 2023-12-06T15:00:23.339 INFO:tasks.workunit.client.1.smithi190.stdout:7/386: mkdir d0/d5/d1b/d7a/d7c 0 2023-12-06T15:00:23.340 INFO:tasks.workunit.client.1.smithi190.stdout:1/440: dread d6/dc/d29/d38/d73/f41 [0,4194304] 0 2023-12-06T15:00:23.340 INFO:tasks.workunit.client.1.smithi190.stdout:7/387: creat d0/d5/d1b/d32/f7d x:0 0 0 2023-12-06T15:00:23.344 INFO:tasks.workunit.client.1.smithi190.stdout:3/461: rmdir d4 39 2023-12-06T15:00:23.344 INFO:tasks.workunit.client.1.smithi190.stdout:3/462: dread - d4/d70/d19/d3a/f7b zero size 2023-12-06T15:00:23.346 INFO:tasks.workunit.client.1.smithi190.stdout:3/463: rmdir d4/d70/d19/d51 39 2023-12-06T15:00:23.349 INFO:tasks.workunit.client.1.smithi190.stdout:3/464: symlink d4/d1b/d54/d9c/d68/d8a/la6 0 2023-12-06T15:00:23.352 INFO:tasks.workunit.client.1.smithi190.stdout:1/441: dread d6/dc/f51 [0,4194304] 0 2023-12-06T15:00:23.353 INFO:tasks.workunit.client.0.smithi152.stdout:3/174: getdents d9/d10 0 2023-12-06T15:00:23.354 INFO:tasks.workunit.client.0.smithi152.stdout:3/175: dread - d9/d10/d12/f1e zero size 2023-12-06T15:00:23.354 INFO:tasks.workunit.client.0.smithi152.stdout:3/176: dread - d9/d10/f2a zero size 2023-12-06T15:00:23.355 INFO:tasks.workunit.client.0.smithi152.stdout:3/177: creat d9/d10/d12/f31 x:0 0 0 2023-12-06T15:00:23.355 INFO:tasks.workunit.client.0.smithi152.stdout:3/178: dread - d9/d10/f2f zero size 2023-12-06T15:00:23.355 INFO:tasks.workunit.client.0.smithi152.stdout:3/179: dread - d9/d10/d12/f31 zero size 2023-12-06T15:00:23.355 INFO:tasks.workunit.client.0.smithi152.stdout:3/180: readlink d9/d18/l25 0 2023-12-06T15:00:23.356 INFO:tasks.workunit.client.0.smithi152.stdout:3/181: mkdir d9/d10/d32 0 2023-12-06T15:00:23.357 INFO:tasks.workunit.client.0.smithi152.stdout:3/182: creat d9/d10/d19/f33 x:0 0 0 2023-12-06T15:00:23.358 INFO:tasks.workunit.client.0.smithi152.stdout:3/183: link d9/d18/d1a/l29 d9/d10/d12/l34 0 2023-12-06T15:00:23.358 INFO:tasks.workunit.client.0.smithi152.stdout:3/184: chown d9/d18/f24 474 1 2023-12-06T15:00:23.363 INFO:tasks.workunit.client.0.smithi152.stdout:9/153: sync 2023-12-06T15:00:23.364 INFO:tasks.workunit.client.0.smithi152.stdout:6/233: sync 2023-12-06T15:00:23.364 INFO:tasks.workunit.client.0.smithi152.stdout:8/55: sync 2023-12-06T15:00:23.364 INFO:tasks.workunit.client.0.smithi152.stdout:8/56: truncate d1/d6/db/f11 919931 0 2023-12-06T15:00:23.364 INFO:tasks.workunit.client.0.smithi152.stdout:9/154: write d0/dd/d20/f21 [5242828,78878] 0 2023-12-06T15:00:23.364 INFO:tasks.workunit.client.0.smithi152.stdout:9/155: chown d0/dd 2965 1 2023-12-06T15:00:23.370 INFO:tasks.workunit.client.1.smithi190.stdout:1/442: dread f1 [0,4194304] 0 2023-12-06T15:00:23.370 INFO:tasks.workunit.client.0.smithi152.stdout:6/234: rename d1/d19/d1a/d30/d36/d37 to d1/d19/d1a/d30/d36/d56 0 2023-12-06T15:00:23.371 INFO:tasks.workunit.client.0.smithi152.stdout:9/156: creat d0/dd/d20/f26 x:0 0 0 2023-12-06T15:00:23.371 INFO:tasks.workunit.client.1.smithi190.stdout:8/298: dwrite d1/d20/d3b/d36/f3e [0,4194304] 0 2023-12-06T15:00:23.372 INFO:tasks.workunit.client.1.smithi190.stdout:1/443: unlink d6/dc/d3b/d4d/c5b 0 2023-12-06T15:00:23.372 INFO:tasks.workunit.client.1.smithi190.stdout:1/444: dread - d6/d49/f7c zero size 2023-12-06T15:00:23.372 INFO:tasks.workunit.client.0.smithi152.stdout:8/57: write d1/d6/d7/fa [1001200,6536] 0 2023-12-06T15:00:23.373 INFO:tasks.workunit.client.0.smithi152.stdout:8/58: fsync d1/f10 0 2023-12-06T15:00:23.373 INFO:tasks.workunit.client.0.smithi152.stdout:8/59: truncate d1/d6/ff 467756 0 2023-12-06T15:00:23.373 INFO:tasks.workunit.client.1.smithi190.stdout:8/299: truncate d1/d10/d1c/f22 905559 0 2023-12-06T15:00:23.373 INFO:tasks.workunit.client.0.smithi152.stdout:4/301: dwrite d2/d22/f59 [0,4194304] 0 2023-12-06T15:00:23.373 INFO:tasks.workunit.client.0.smithi152.stdout:4/302: fdatasync d2/d10/f17 0 2023-12-06T15:00:23.375 INFO:tasks.workunit.client.0.smithi152.stdout:6/235: read d1/d19/d1a/d30/d36/f2e [3529503,126424] 0 2023-12-06T15:00:23.377 INFO:tasks.workunit.client.1.smithi190.stdout:1/445: mknod d6/dc/d29/d38/d39/d63/d67/c86 0 2023-12-06T15:00:23.378 INFO:tasks.workunit.client.0.smithi152.stdout:4/303: getdents d2/d10/d27/d29 0 2023-12-06T15:00:23.378 INFO:tasks.workunit.client.0.smithi152.stdout:6/236: unlink d1/d5/d15/f32 0 2023-12-06T15:00:23.378 INFO:tasks.workunit.client.0.smithi152.stdout:4/304: fsync d2/f1b 0 2023-12-06T15:00:23.378 INFO:tasks.workunit.client.0.smithi152.stdout:6/237: dread - d1/f2c zero size 2023-12-06T15:00:23.378 INFO:tasks.workunit.client.0.smithi152.stdout:6/238: readlink l0 0 2023-12-06T15:00:23.379 INFO:tasks.workunit.client.1.smithi190.stdout:1/446: creat d6/dc/d3b/d4d/f87 x:0 0 0 2023-12-06T15:00:23.379 INFO:tasks.workunit.client.1.smithi190.stdout:1/447: chown d6/dc/d29/d38/d39/d63 22061335 1 2023-12-06T15:00:23.379 INFO:tasks.workunit.client.1.smithi190.stdout:1/448: fdatasync d6/dc/d29/d38/d43/f61 0 2023-12-06T15:00:23.380 INFO:tasks.workunit.client.0.smithi152.stdout:4/305: link d2/d15/d23/d42/c4c d2/d10/d27/d29/c5d 0 2023-12-06T15:00:23.380 INFO:tasks.workunit.client.0.smithi152.stdout:4/306: chown d2/f3a 14110 1 2023-12-06T15:00:23.380 INFO:tasks.workunit.client.0.smithi152.stdout:6/239: mkdir d1/d19/d1a/d30/d36/d35/d49/d57 0 2023-12-06T15:00:23.381 INFO:tasks.workunit.client.0.smithi152.stdout:4/307: mknod d2/d10/d52/d40/c5e 0 2023-12-06T15:00:23.381 INFO:tasks.workunit.client.1.smithi190.stdout:1/449: mknod d6/dc/d29/d38/d43/c88 0 2023-12-06T15:00:23.381 INFO:tasks.workunit.client.1.smithi190.stdout:5/241: dwrite d0/d12/f39 [0,4194304] 0 2023-12-06T15:00:23.382 INFO:tasks.workunit.client.1.smithi190.stdout:7/388: dwrite d0/df/d53/f3c [0,4194304] 0 2023-12-06T15:00:23.383 INFO:tasks.workunit.client.0.smithi152.stdout:4/308: write d2/d22/f18 [1250101,36409] 0 2023-12-06T15:00:23.383 INFO:tasks.workunit.client.0.smithi152.stdout:4/309: chown d2/d10/d52/d40/l51 6 1 2023-12-06T15:00:23.383 INFO:tasks.workunit.client.0.smithi152.stdout:4/310: readlink d2/d10/d52/l31 0 2023-12-06T15:00:23.383 INFO:tasks.workunit.client.0.smithi152.stdout:6/240: symlink d1/d19/d1a/d30/d36/d4e/l58 0 2023-12-06T15:00:23.383 INFO:tasks.workunit.client.0.smithi152.stdout:3/185: dwrite d9/f2d [0,4194304] 0 2023-12-06T15:00:23.383 INFO:tasks.workunit.client.0.smithi152.stdout:3/186: dread - d9/d10/d19/f33 zero size 2023-12-06T15:00:23.383 INFO:tasks.workunit.client.1.smithi190.stdout:7/389: creat d0/df/d53/d2f/d3e/f7e x:0 0 0 2023-12-06T15:00:23.385 INFO:tasks.workunit.client.1.smithi190.stdout:5/242: dread d0/d1c/d2b/f32 [0,4194304] 0 2023-12-06T15:00:23.385 INFO:tasks.workunit.client.1.smithi190.stdout:1/450: dread d6/dc/d29/f53 [0,4194304] 0 2023-12-06T15:00:23.386 INFO:tasks.workunit.client.1.smithi190.stdout:5/243: symlink d0/l4d 0 2023-12-06T15:00:23.387 INFO:tasks.workunit.client.0.smithi152.stdout:3/187: symlink d9/l35 0 2023-12-06T15:00:23.387 INFO:tasks.workunit.client.1.smithi190.stdout:5/244: write d0/f6 [6287583,52171] 0 2023-12-06T15:00:23.388 INFO:tasks.workunit.client.1.smithi190.stdout:1/451: mknod d6/dc/c89 0 2023-12-06T15:00:23.389 INFO:tasks.workunit.client.1.smithi190.stdout:5/245: creat d0/d1c/d2b/f4e x:0 0 0 2023-12-06T15:00:23.391 INFO:tasks.workunit.client.1.smithi190.stdout:1/452: rename d6/l30 to d6/dc/d29/d38/d73/d5c/l8a 0 2023-12-06T15:00:23.394 INFO:tasks.workunit.client.1.smithi190.stdout:5/246: rename d0/d1c/l1d to d0/l4f 0 2023-12-06T15:00:23.394 INFO:tasks.workunit.client.1.smithi190.stdout:5/247: fsync d0/d1c/d3e/f4c 0 2023-12-06T15:00:23.395 INFO:tasks.workunit.client.1.smithi190.stdout:1/453: read f1 [1662083,49425] 0 2023-12-06T15:00:23.396 INFO:tasks.workunit.client.0.smithi152.stdout:9/157: dwrite d0/f23 [4194304,4194304] 0 2023-12-06T15:00:23.397 INFO:tasks.workunit.client.1.smithi190.stdout:1/454: symlink d6/d49/d74/l8b 0 2023-12-06T15:00:23.397 INFO:tasks.workunit.client.0.smithi152.stdout:9/158: mknod d0/c27 0 2023-12-06T15:00:23.398 INFO:tasks.workunit.client.1.smithi190.stdout:1/455: mknod d6/dc/d29/d38/d73/c8c 0 2023-12-06T15:00:23.398 INFO:tasks.workunit.client.1.smithi190.stdout:1/456: stat d6/dc/d29/d38/d43 0 2023-12-06T15:00:23.398 INFO:tasks.workunit.client.0.smithi152.stdout:9/159: truncate d0/dd/f25 2807055 0 2023-12-06T15:00:23.399 INFO:tasks.workunit.client.1.smithi190.stdout:1/457: write d6/dc/d29/d38/d39/f3e [306438,50097] 0 2023-12-06T15:00:23.400 INFO:tasks.workunit.client.1.smithi190.stdout:1/458: symlink d6/dc/d29/d38/d43/l8d 0 2023-12-06T15:00:23.406 INFO:tasks.workunit.client.0.smithi152.stdout:6/241: dwrite d1/d19/d1a/d30/d36/d26/f53 [0,4194304] 0 2023-12-06T15:00:23.407 INFO:tasks.workunit.client.0.smithi152.stdout:4/311: dwrite d2/d10/d27/f48 [0,4194304] 0 2023-12-06T15:00:23.407 INFO:tasks.workunit.client.0.smithi152.stdout:6/242: creat d1/d19/d1a/d30/f59 x:0 0 0 2023-12-06T15:00:23.408 INFO:tasks.workunit.client.0.smithi152.stdout:3/188: rmdir d9/d10/d19 39 2023-12-06T15:00:23.414 INFO:tasks.workunit.client.0.smithi152.stdout:4/312: symlink d2/d15/l5f 0 2023-12-06T15:00:23.414 INFO:tasks.workunit.client.0.smithi152.stdout:4/313: chown d2/d10/d27/f43 116 1 2023-12-06T15:00:23.414 INFO:tasks.workunit.client.0.smithi152.stdout:6/243: symlink d1/d19/d1a/d30/d36/d4e/l5a 0 2023-12-06T15:00:23.415 INFO:tasks.workunit.client.0.smithi152.stdout:9/160: getdents d0/dd/d20 0 2023-12-06T15:00:23.415 INFO:tasks.workunit.client.0.smithi152.stdout:6/244: dread d1/ff [0,4194304] 0 2023-12-06T15:00:23.416 INFO:tasks.workunit.client.0.smithi152.stdout:3/189: getdents d9/d10 0 2023-12-06T15:00:23.417 INFO:tasks.workunit.client.0.smithi152.stdout:3/190: chown f2 288374550 1 2023-12-06T15:00:23.417 INFO:tasks.workunit.client.0.smithi152.stdout:3/191: read - d9/d10/f28 zero size 2023-12-06T15:00:23.417 INFO:tasks.workunit.client.0.smithi152.stdout:9/161: write d0/f1 [1684231,96091] 0 2023-12-06T15:00:23.417 INFO:tasks.workunit.client.0.smithi152.stdout:9/162: write d0/dd/fe [4585850,14912] 0 2023-12-06T15:00:23.418 INFO:tasks.workunit.client.0.smithi152.stdout:4/314: creat d2/d15/d32/f60 x:0 0 0 2023-12-06T15:00:23.418 INFO:tasks.workunit.client.0.smithi152.stdout:9/163: read d0/dd/f17 [3056360,68462] 0 2023-12-06T15:00:23.419 INFO:tasks.workunit.client.0.smithi152.stdout:6/245: symlink d1/d19/d1a/d30/d36/d35/d49/d57/l5b 0 2023-12-06T15:00:23.420 INFO:tasks.workunit.client.0.smithi152.stdout:9/164: symlink d0/l28 0 2023-12-06T15:00:23.422 INFO:tasks.workunit.client.1.smithi190.stdout:1/459: dwrite d6/dc/d29/d38/d43/f4b [0,4194304] 0 2023-12-06T15:00:23.422 INFO:tasks.workunit.client.1.smithi190.stdout:1/460: stat d6/dc/d29/d38/d39/d63/d67/c86 0 2023-12-06T15:00:23.422 INFO:tasks.workunit.client.0.smithi152.stdout:6/246: truncate d1/d19/f48 396565 0 2023-12-06T15:00:23.424 INFO:tasks.workunit.client.1.smithi190.stdout:5/248: dwrite d0/f7 [0,4194304] 0 2023-12-06T15:00:23.425 INFO:tasks.workunit.client.0.smithi152.stdout:9/165: creat d0/dd/d20/f29 x:0 0 0 2023-12-06T15:00:23.425 INFO:tasks.workunit.client.0.smithi152.stdout:9/166: write d0/dd/fe [5631083,63620] 0 2023-12-06T15:00:23.425 INFO:tasks.workunit.client.0.smithi152.stdout:9/167: chown d0/f15 125849 1 2023-12-06T15:00:23.425 INFO:tasks.workunit.client.0.smithi152.stdout:9/168: stat d0/c1e 0 2023-12-06T15:00:23.425 INFO:tasks.workunit.client.1.smithi190.stdout:5/249: mkdir d0/df/d50 0 2023-12-06T15:00:23.427 INFO:tasks.workunit.client.0.smithi152.stdout:9/169: rename d0/c1e to d0/c2a 0 2023-12-06T15:00:23.427 INFO:tasks.workunit.client.0.smithi152.stdout:9/170: chown d0/l1f 1 1 2023-12-06T15:00:23.428 INFO:tasks.workunit.client.1.smithi190.stdout:1/461: write d6/dc/f15 [2673043,25122] 0 2023-12-06T15:00:23.430 INFO:tasks.workunit.client.0.smithi152.stdout:4/315: dread d2/d22/f4a [0,4194304] 0 2023-12-06T15:00:23.435 INFO:tasks.workunit.client.0.smithi152.stdout:9/171: fsync d0/dd/f25 0 2023-12-06T15:00:23.437 INFO:tasks.workunit.client.0.smithi152.stdout:4/316: getdents d2/d15/d23 0 2023-12-06T15:00:23.439 INFO:tasks.workunit.client.0.smithi152.stdout:3/192: dwrite d9/d10/f2f [0,4194304] 0 2023-12-06T15:00:23.442 INFO:tasks.workunit.client.0.smithi152.stdout:3/193: mkdir d9/d18/d1a/d36 0 2023-12-06T15:00:23.451 INFO:tasks.workunit.client.0.smithi152.stdout:4/317: dread d2/fc [0,4194304] 0 2023-12-06T15:00:23.452 INFO:tasks.workunit.client.0.smithi152.stdout:4/318: symlink d2/d10/d27/d3f/l61 0 2023-12-06T15:00:23.454 INFO:tasks.workunit.client.0.smithi152.stdout:4/319: creat d2/d15/f62 x:0 0 0 2023-12-06T15:00:23.455 INFO:tasks.workunit.client.0.smithi152.stdout:4/320: mknod d2/d45/c63 0 2023-12-06T15:00:23.455 INFO:tasks.workunit.client.0.smithi152.stdout:4/321: dread - d2/d15/d32/f5a zero size 2023-12-06T15:00:23.459 INFO:tasks.workunit.client.1.smithi190.stdout:1/462: dread d6/dc/d29/d38/d43/f7b [0,4194304] 0 2023-12-06T15:00:23.459 INFO:tasks.workunit.client.1.smithi190.stdout:1/463: write d6/dc/d29/d38/d43/f61 [2328194,60503] 0 2023-12-06T15:00:23.460 INFO:tasks.workunit.client.1.smithi190.stdout:1/464: creat d6/dc/d29/d38/d73/d76/f8e x:0 0 0 2023-12-06T15:00:23.460 INFO:tasks.workunit.client.1.smithi190.stdout:1/465: stat d6/dc/d29/d38/d73/l80 0 2023-12-06T15:00:23.461 INFO:tasks.workunit.client.1.smithi190.stdout:1/466: link d6/dc/d29/d38/d43/l8d d6/dc/d29/d38/d73/d76/d7e/l8f 0 2023-12-06T15:00:23.462 INFO:tasks.workunit.client.0.smithi152.stdout:4/322: write d2/f8 [354750,9222] 0 2023-12-06T15:00:23.463 INFO:tasks.workunit.client.1.smithi190.stdout:1/467: rename f1 to d6/f90 0 2023-12-06T15:00:23.463 INFO:tasks.workunit.client.1.smithi190.stdout:1/468: chown d6/d49/d74/l8b 182512 1 2023-12-06T15:00:23.463 INFO:tasks.workunit.client.0.smithi152.stdout:4/323: creat d2/d15/f64 x:0 0 0 2023-12-06T15:00:23.463 INFO:tasks.workunit.client.0.smithi152.stdout:4/324: write d2/d10/d27/d29/f57 [1253891,9351] 0 2023-12-06T15:00:23.463 INFO:tasks.workunit.client.0.smithi152.stdout:4/325: write d2/d10/d27/d29/f53 [292575,39457] 0 2023-12-06T15:00:23.464 INFO:tasks.workunit.client.0.smithi152.stdout:4/326: write d2/d15/f64 [342430,53969] 0 2023-12-06T15:00:23.464 INFO:tasks.workunit.client.0.smithi152.stdout:4/327: write d2/d15/d32/f5a [756725,3530] 0 2023-12-06T15:00:23.465 INFO:tasks.workunit.client.0.smithi152.stdout:6/247: dwrite d1/f6 [0,4194304] 0 2023-12-06T15:00:23.465 INFO:tasks.workunit.client.0.smithi152.stdout:4/328: unlink d2/l4 0 2023-12-06T15:00:23.465 INFO:tasks.workunit.client.1.smithi190.stdout:5/250: dwrite d0/d1c/d3e/f4c [0,4194304] 0 2023-12-06T15:00:23.465 INFO:tasks.workunit.client.1.smithi190.stdout:5/251: truncate d0/d1c/d2b/f4e 987636 0 2023-12-06T15:00:23.466 INFO:tasks.workunit.client.0.smithi152.stdout:3/194: dwrite d9/d18/f24 [0,4194304] 0 2023-12-06T15:00:23.466 INFO:tasks.workunit.client.0.smithi152.stdout:9/172: dwrite d0/dd/d20/f21 [4194304,4194304] 0 2023-12-06T15:00:23.467 INFO:tasks.workunit.client.1.smithi190.stdout:1/469: creat d6/dc/d29/d38/d73/f91 x:0 0 0 2023-12-06T15:00:23.471 INFO:tasks.workunit.client.1.smithi190.stdout:5/252: creat d0/d1c/d3e/f51 x:0 0 0 2023-12-06T15:00:23.471 INFO:tasks.workunit.client.1.smithi190.stdout:5/253: readlink d0/d12/l25 0 2023-12-06T15:00:23.472 INFO:tasks.workunit.client.1.smithi190.stdout:1/470: symlink d6/dc/d29/d38/d73/d76/l92 0 2023-12-06T15:00:23.473 INFO:tasks.workunit.client.1.smithi190.stdout:5/254: unlink d0/d12/f15 0 2023-12-06T15:00:23.474 INFO:tasks.workunit.client.1.smithi190.stdout:5/255: readlink d0/l4d 0 2023-12-06T15:00:23.474 INFO:tasks.workunit.client.1.smithi190.stdout:5/256: symlink d0/d1c/d3e/l52 0 2023-12-06T15:00:23.476 INFO:tasks.workunit.client.0.smithi152.stdout:4/329: mknod d2/d15/d32/c65 0 2023-12-06T15:00:23.477 INFO:tasks.workunit.client.1.smithi190.stdout:1/471: dread d6/f21 [0,4194304] 0 2023-12-06T15:00:23.477 INFO:tasks.workunit.client.1.smithi190.stdout:1/472: truncate d6/dc/d29/d38/d39/d63/d67/f7d 869332 0 2023-12-06T15:00:23.477 INFO:tasks.workunit.client.1.smithi190.stdout:1/473: write d6/dc/d29/d38/d73/d5c/f70 [569493,128839] 0 2023-12-06T15:00:23.477 INFO:tasks.workunit.client.0.smithi152.stdout:4/330: write d2/d10/f24 [2127744,116954] 0 2023-12-06T15:00:23.478 INFO:tasks.workunit.client.1.smithi190.stdout:1/474: truncate d6/dc/f51 413177 0 2023-12-06T15:00:23.478 INFO:tasks.workunit.client.1.smithi190.stdout:5/257: creat d0/f53 x:0 0 0 2023-12-06T15:00:23.479 INFO:tasks.workunit.client.1.smithi190.stdout:1/475: getdents d6/dc/d3b/d78 0 2023-12-06T15:00:23.480 INFO:tasks.workunit.client.0.smithi152.stdout:3/195: creat d9/f37 x:0 0 0 2023-12-06T15:00:23.481 INFO:tasks.workunit.client.1.smithi190.stdout:5/258: rename d0/d12/f39 to d0/d1c/d2b/d2c/f54 0 2023-12-06T15:00:23.486 INFO:tasks.workunit.client.1.smithi190.stdout:1/476: write d6/dc/d29/d38/d39/f3f [213652,95193] 0 2023-12-06T15:00:23.486 INFO:tasks.workunit.client.1.smithi190.stdout:1/477: fdatasync d6/dc/d29/d38/d43/d7f/d81/f84 0 2023-12-06T15:00:23.487 INFO:tasks.workunit.client.1.smithi190.stdout:5/259: write d0/d1c/f36 [363393,92623] 0 2023-12-06T15:00:23.488 INFO:tasks.workunit.client.0.smithi152.stdout:6/248: dwrite d1/d19/d1a/d30/fe [8388608,4194304] 0 2023-12-06T15:00:23.488 INFO:tasks.workunit.client.1.smithi190.stdout:1/478: mknod d6/dc/d29/d38/c93 0 2023-12-06T15:00:23.490 INFO:tasks.workunit.client.0.smithi152.stdout:2/121: sync 2023-12-06T15:00:23.491 INFO:tasks.workunit.client.1.smithi190.stdout:5/260: write d0/d1c/d2b/d2c/f54 [246267,33575] 0 2023-12-06T15:00:23.491 INFO:tasks.workunit.client.1.smithi190.stdout:1/479: rename d6/dc/d3b/d4d to d6/dc/d3b/d78/d94 0 2023-12-06T15:00:23.491 INFO:tasks.workunit.client.1.smithi190.stdout:1/480: dread - d6/d49/f68 zero size 2023-12-06T15:00:23.491 INFO:tasks.workunit.client.1.smithi190.stdout:1/481: chown d6/dc/d29/c35 399 1 2023-12-06T15:00:23.496 INFO:tasks.workunit.client.1.smithi190.stdout:5/261: unlink d0/df/f30 0 2023-12-06T15:00:23.502 INFO:tasks.workunit.client.0.smithi152.stdout:2/122: dread d6/db/d13/f14 [0,4194304] 0 2023-12-06T15:00:23.502 INFO:tasks.workunit.client.0.smithi152.stdout:2/123: chown d6/d1e/c10 15418 1 2023-12-06T15:00:23.503 INFO:tasks.workunit.client.0.smithi152.stdout:2/124: write d6/db/d13/f14 [4506280,10661] 0 2023-12-06T15:00:23.503 INFO:tasks.workunit.client.0.smithi152.stdout:2/125: mkdir d6/d1e/d27 0 2023-12-06T15:00:23.504 INFO:tasks.workunit.client.0.smithi152.stdout:4/331: dwrite d2/d10/d27/f43 [0,4194304] 0 2023-12-06T15:00:23.504 INFO:tasks.workunit.client.0.smithi152.stdout:4/332: fdatasync d2/d15/f64 0 2023-12-06T15:00:23.504 INFO:tasks.workunit.client.0.smithi152.stdout:9/173: truncate d0/dd/fe 4907355 0 2023-12-06T15:00:23.504 INFO:tasks.workunit.client.0.smithi152.stdout:9/174: fdatasync d0/f19 0 2023-12-06T15:00:23.509 INFO:tasks.workunit.client.0.smithi152.stdout:4/333: dread d2/d10/d27/d29/f53 [0,4194304] 0 2023-12-06T15:00:23.509 INFO:tasks.workunit.client.0.smithi152.stdout:9/175: symlink d0/dd/d20/l2b 0 2023-12-06T15:00:23.512 INFO:tasks.workunit.client.0.smithi152.stdout:2/126: rename f0 to d6/db/d17/f28 0 2023-12-06T15:00:23.512 INFO:tasks.workunit.client.0.smithi152.stdout:4/334: dread d2/d10/d27/d29/f57 [0,4194304] 0 2023-12-06T15:00:23.515 INFO:tasks.workunit.client.0.smithi152.stdout:9/176: write d0/dd/fe [2301506,104577] 0 2023-12-06T15:00:23.534 INFO:tasks.workunit.client.0.smithi152.stdout:4/335: dwrite d2/d10/d27/d29/f57 [0,4194304] 0 2023-12-06T15:00:23.534 INFO:tasks.workunit.client.0.smithi152.stdout:9/177: getdents d0/dd/d20 0 2023-12-06T15:00:23.535 INFO:tasks.workunit.client.1.smithi190.stdout:0/290: sync 2023-12-06T15:00:23.535 INFO:tasks.workunit.client.1.smithi190.stdout:6/376: sync 2023-12-06T15:00:23.535 INFO:tasks.workunit.client.1.smithi190.stdout:0/291: chown d0/da/f44 37 1 2023-12-06T15:00:23.535 INFO:tasks.workunit.client.1.smithi190.stdout:1/482: dwrite d6/dc/f15 [0,4194304] 0 2023-12-06T15:00:23.535 INFO:tasks.workunit.client.1.smithi190.stdout:0/292: fsync d0/da/d3e/d2b/d3c/f60 0 2023-12-06T15:00:23.535 INFO:tasks.workunit.client.1.smithi190.stdout:0/293: read - d0/da/d3e/d3a/d40/f5e zero size 2023-12-06T15:00:23.535 INFO:tasks.workunit.client.1.smithi190.stdout:1/483: mkdir d6/dc/d29/d38/d43/d7f/d95 0 2023-12-06T15:00:23.535 INFO:tasks.workunit.client.1.smithi190.stdout:0/294: mkdir d0/da/d3e/d2b/d3c/d46/d61 0 2023-12-06T15:00:23.536 INFO:tasks.workunit.client.1.smithi190.stdout:1/484: creat d6/dc/d3b/d78/d94/f96 x:0 0 0 2023-12-06T15:00:23.537 INFO:tasks.workunit.client.1.smithi190.stdout:1/485: write d6/dc/d29/d38/d43/d7f/d81/f84 [972206,30704] 0 2023-12-06T15:00:23.537 INFO:tasks.workunit.client.1.smithi190.stdout:6/377: write d4/d12/d40/f48 [639619,120978] 0 2023-12-06T15:00:23.537 INFO:tasks.workunit.client.1.smithi190.stdout:6/378: getdents d4/d12/d1a/d70 0 2023-12-06T15:00:23.538 INFO:tasks.workunit.client.0.smithi152.stdout:4/336: write d2/d15/d23/f41 [2262352,53722] 0 2023-12-06T15:00:23.538 INFO:tasks.workunit.client.0.smithi152.stdout:4/337: fdatasync d2/d15/d32/f55 0 2023-12-06T15:00:23.542 INFO:tasks.workunit.client.1.smithi190.stdout:6/379: write d4/d12/d40/d43/d45/f5f [90116,89221] 0 2023-12-06T15:00:23.542 INFO:tasks.workunit.client.1.smithi190.stdout:6/380: chown d4/d15/l5a 54615325 1 2023-12-06T15:00:23.546 INFO:tasks.workunit.client.0.smithi152.stdout:4/338: read d2/f1b [500508,103298] 0 2023-12-06T15:00:23.546 INFO:tasks.workunit.client.0.smithi152.stdout:4/339: write d2/d10/f37 [647358,55107] 0 2023-12-06T15:00:23.549 INFO:tasks.workunit.client.0.smithi152.stdout:4/340: unlink d2/c1e 0 2023-12-06T15:00:23.551 INFO:tasks.workunit.client.1.smithi190.stdout:0/295: dwrite d0/f50 [0,4194304] 0 2023-12-06T15:00:23.551 INFO:tasks.workunit.client.1.smithi190.stdout:0/296: readlink d0/da/d3e/d3a/d40/l54 0 2023-12-06T15:00:23.564 INFO:tasks.workunit.client.0.smithi152.stdout:4/341: dread d2/f8 [0,4194304] 0 2023-12-06T15:00:23.564 INFO:tasks.workunit.client.0.smithi152.stdout:4/342: write d2/d45/f4e [272427,97997] 0 2023-12-06T15:00:23.568 INFO:tasks.workunit.client.0.smithi152.stdout:4/343: write d2/d22/f4d [2986021,17435] 0 2023-12-06T15:00:23.570 INFO:tasks.workunit.client.0.smithi152.stdout:4/344: creat d2/d15/d32/f66 x:0 0 0 2023-12-06T15:00:23.570 INFO:tasks.workunit.client.0.smithi152.stdout:4/345: readlink d2/d10/d52/d40/l51 0 2023-12-06T15:00:23.576 INFO:tasks.workunit.client.1.smithi190.stdout:1/486: dwrite d6/dc/d29/d38/d43/d7f/d81/f84 [0,4194304] 0 2023-12-06T15:00:23.577 INFO:tasks.workunit.client.1.smithi190.stdout:6/381: dwrite d4/d15/f54 [0,4194304] 0 2023-12-06T15:00:23.577 INFO:tasks.workunit.client.1.smithi190.stdout:6/382: getdents d4/d12/d1a/d32/d76 0 2023-12-06T15:00:23.579 INFO:tasks.workunit.client.1.smithi190.stdout:1/487: creat d6/dc/d29/d38/d39/d63/d67/f97 x:0 0 0 2023-12-06T15:00:23.580 INFO:tasks.workunit.client.0.smithi152.stdout:9/178: dwrite d0/dd/d20/f21 [4194304,4194304] 0 2023-12-06T15:00:23.580 INFO:tasks.workunit.client.1.smithi190.stdout:0/297: dwrite d0/da/d3e/d2b/f45 [0,4194304] 0 2023-12-06T15:00:23.580 INFO:tasks.workunit.client.1.smithi190.stdout:0/298: chown d0/da/f5b 84043 1 2023-12-06T15:00:23.581 INFO:tasks.workunit.client.1.smithi190.stdout:6/383: read d4/fd [141190,122718] 0 2023-12-06T15:00:23.581 INFO:tasks.workunit.client.1.smithi190.stdout:6/384: readlink d4/d12/d1a/l63 0 2023-12-06T15:00:23.582 INFO:tasks.workunit.client.1.smithi190.stdout:1/488: truncate d6/dc/d29/f53 1301640 0 2023-12-06T15:00:23.582 INFO:tasks.workunit.client.1.smithi190.stdout:1/489: stat d6/dc/d3b/d78 0 2023-12-06T15:00:23.583 INFO:tasks.workunit.client.1.smithi190.stdout:0/299: mknod d0/da/d3e/d2b/d3c/d46/d61/c62 0 2023-12-06T15:00:23.586 INFO:tasks.workunit.client.1.smithi190.stdout:1/490: rename d6/dc/d29/d38/d43/c58 to d6/c98 0 2023-12-06T15:00:23.586 INFO:tasks.workunit.client.1.smithi190.stdout:1/491: fdatasync d6/dc/f46 0 2023-12-06T15:00:23.588 INFO:tasks.workunit.client.0.smithi152.stdout:4/346: dwrite d2/d10/d27/d29/f57 [0,4194304] 0 2023-12-06T15:00:23.592 INFO:tasks.workunit.client.0.smithi152.stdout:4/347: getdents d2/d10/d27 0 2023-12-06T15:00:23.592 INFO:tasks.workunit.client.1.smithi190.stdout:1/492: write d6/dc/d29/d38/d39/f6a [3968030,5594] 0 2023-12-06T15:00:23.594 INFO:tasks.workunit.client.1.smithi190.stdout:1/493: symlink d6/dc/d3b/l99 0 2023-12-06T15:00:23.596 INFO:tasks.workunit.client.0.smithi152.stdout:4/348: write d2/d15/d32/f55 [1735586,81104] 0 2023-12-06T15:00:23.596 INFO:tasks.workunit.client.0.smithi152.stdout:4/349: write d2/d15/d32/f66 [814223,87813] 0 2023-12-06T15:00:23.597 INFO:tasks.workunit.client.1.smithi190.stdout:1/494: link d6/dc/f2e d6/dc/d3b/d78/f9a 0 2023-12-06T15:00:23.597 INFO:tasks.workunit.client.1.smithi190.stdout:1/495: stat d6/dc/d29/d38/d73/d76/l92 0 2023-12-06T15:00:23.597 INFO:tasks.workunit.client.1.smithi190.stdout:1/496: chown d6/dc/d29/l65 1545 1 2023-12-06T15:00:23.598 INFO:tasks.workunit.client.0.smithi152.stdout:4/350: symlink d2/l67 0 2023-12-06T15:00:23.598 INFO:tasks.workunit.client.0.smithi152.stdout:4/351: write f1 [4594408,91806] 0 2023-12-06T15:00:23.600 INFO:tasks.workunit.client.0.smithi152.stdout:4/352: symlink d2/d10/d52/l68 0 2023-12-06T15:00:23.601 INFO:tasks.workunit.client.0.smithi152.stdout:4/353: mkdir d2/d15/d32/d69 0 2023-12-06T15:00:23.602 INFO:tasks.workunit.client.0.smithi152.stdout:4/354: creat d2/d15/d32/f6a x:0 0 0 2023-12-06T15:00:23.603 INFO:tasks.workunit.client.0.smithi152.stdout:4/355: link d2/d15/d32/f66 d2/d45/f6b 0 2023-12-06T15:00:23.604 INFO:tasks.workunit.client.0.smithi152.stdout:4/356: mkdir d2/d10/d52/d40/d6c 0 2023-12-06T15:00:23.604 INFO:tasks.workunit.client.0.smithi152.stdout:4/357: readlink d2/d10/d27/d29/l44 0 2023-12-06T15:00:23.608 INFO:tasks.workunit.client.0.smithi152.stdout:9/179: dwrite d0/f24 [0,4194304] 0 2023-12-06T15:00:23.609 INFO:tasks.workunit.client.0.smithi152.stdout:9/180: getdents d0/dd/d20 0 2023-12-06T15:00:23.610 INFO:tasks.workunit.client.0.smithi152.stdout:9/181: link d0/l1f d0/dd/l2c 0 2023-12-06T15:00:23.618 INFO:tasks.workunit.client.1.smithi190.stdout:1/497: dwrite d6/dc/d29/f83 [0,4194304] 0 2023-12-06T15:00:23.620 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:23 smithi152 ceph-mon[111954]: pgmap v23: 65 pgs: 65 active+clean; 479 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 21 MiB/s rd, 36 MiB/s wr, 98 op/s 2023-12-06T15:00:23.620 INFO:tasks.workunit.client.1.smithi190.stdout:1/498: rename d6/dc/d29/d38/d43/f4b to d6/dc/f9b 0 2023-12-06T15:00:23.621 INFO:tasks.workunit.client.1.smithi190.stdout:1/499: creat d6/dc/d29/d38/d39/f9c x:0 0 0 2023-12-06T15:00:23.622 INFO:tasks.workunit.client.1.smithi190.stdout:1/500: write d6/f25 [6318207,67152] 0 2023-12-06T15:00:23.652 INFO:tasks.workunit.client.1.smithi190.stdout:6/385: dwrite d4/d12/d40/f4f [0,4194304] 0 2023-12-06T15:00:23.652 INFO:tasks.workunit.client.1.smithi190.stdout:6/386: write d4/d12/f53 [437433,26016] 0 2023-12-06T15:00:23.652 INFO:tasks.workunit.client.1.smithi190.stdout:6/387: readlink d4/l6 0 2023-12-06T15:00:23.658 INFO:tasks.workunit.client.1.smithi190.stdout:6/388: creat d4/d12/d1a/d59/f78 x:0 0 0 2023-12-06T15:00:23.659 INFO:tasks.workunit.client.1.smithi190.stdout:1/501: getdents d6/dc 0 2023-12-06T15:00:23.660 INFO:tasks.workunit.client.1.smithi190.stdout:6/389: creat d4/d12/d1a/d44/f79 x:0 0 0 2023-12-06T15:00:23.661 INFO:tasks.workunit.client.0.smithi152.stdout:4/358: rmdir d2/d10 39 2023-12-06T15:00:23.663 INFO:tasks.workunit.client.0.smithi152.stdout:4/359: symlink d2/d10/d52/l6d 0 2023-12-06T15:00:23.663 INFO:tasks.workunit.client.0.smithi152.stdout:9/182: dwrite d0/dd/f17 [4194304,4194304] 0 2023-12-06T15:00:23.663 INFO:tasks.workunit.client.0.smithi152.stdout:4/360: fdatasync d2/d10/f37 0 2023-12-06T15:00:23.663 INFO:tasks.workunit.client.0.smithi152.stdout:9/183: write d0/dd/f17 [8747678,53897] 0 2023-12-06T15:00:23.663 INFO:tasks.workunit.client.0.smithi152.stdout:9/184: chown d0/f6 1622701253 1 2023-12-06T15:00:23.664 INFO:tasks.workunit.client.1.smithi190.stdout:1/502: rmdir d6 39 2023-12-06T15:00:23.665 INFO:tasks.workunit.client.0.smithi152.stdout:9/185: read d0/f15 [56391,24778] 0 2023-12-06T15:00:23.665 INFO:tasks.workunit.client.1.smithi190.stdout:6/390: rename d4/d15/f3c to d4/d12/d40/d43/f7a 0 2023-12-06T15:00:23.666 INFO:tasks.workunit.client.0.smithi152.stdout:4/361: truncate d2/f3a 5363 0 2023-12-06T15:00:23.667 INFO:tasks.workunit.client.0.smithi152.stdout:9/186: read d0/dd/f25 [1347107,101551] 0 2023-12-06T15:00:23.667 INFO:tasks.workunit.client.0.smithi152.stdout:9/187: getdents d0/dd/d20 0 2023-12-06T15:00:23.668 INFO:tasks.workunit.client.1.smithi190.stdout:1/503: rename d6/dc/c18 to d6/dc/d29/c9d 0 2023-12-06T15:00:23.668 INFO:tasks.workunit.client.1.smithi190.stdout:6/391: getdents d4/d12/d40/d43/d45 0 2023-12-06T15:00:23.670 INFO:tasks.workunit.client.1.smithi190.stdout:1/504: unlink d6/dc/d29/d38/c72 0 2023-12-06T15:00:23.670 INFO:tasks.workunit.client.0.smithi152.stdout:9/188: mknod d0/dd/d20/c2d 0 2023-12-06T15:00:23.670 INFO:tasks.workunit.client.0.smithi152.stdout:9/189: readlink d0/l1d 0 2023-12-06T15:00:23.670 INFO:tasks.workunit.client.0.smithi152.stdout:9/190: chown d0/dd/d20/f26 0 1 2023-12-06T15:00:23.670 INFO:tasks.workunit.client.0.smithi152.stdout:0/140: sync 2023-12-06T15:00:23.670 INFO:tasks.workunit.client.0.smithi152.stdout:5/169: sync 2023-12-06T15:00:23.670 INFO:tasks.workunit.client.0.smithi152.stdout:7/118: sync 2023-12-06T15:00:23.671 INFO:tasks.workunit.client.0.smithi152.stdout:1/312: sync 2023-12-06T15:00:23.671 INFO:tasks.workunit.client.0.smithi152.stdout:0/141: write d8/d15/f26 [554945,129704] 0 2023-12-06T15:00:23.671 INFO:tasks.workunit.client.0.smithi152.stdout:9/191: symlink d0/dd/l2e 0 2023-12-06T15:00:23.671 INFO:tasks.workunit.client.1.smithi190.stdout:6/392: symlink d4/d12/d40/l7b 0 2023-12-06T15:00:23.672 INFO:tasks.workunit.client.0.smithi152.stdout:4/362: dread d2/d10/d27/d29/f53 [0,4194304] 0 2023-12-06T15:00:23.673 INFO:tasks.workunit.client.0.smithi152.stdout:5/170: rename f5 to d7/f34 0 2023-12-06T15:00:23.673 INFO:tasks.workunit.client.0.smithi152.stdout:9/192: creat d0/dd/f2f x:0 0 0 2023-12-06T15:00:23.675 INFO:tasks.workunit.client.0.smithi152.stdout:7/119: link l5 dd/l23 0 2023-12-06T15:00:23.676 INFO:tasks.workunit.client.1.smithi190.stdout:1/505: symlink d6/dc/d29/d38/d73/d76/d7e/l9e 0 2023-12-06T15:00:23.677 INFO:tasks.workunit.client.1.smithi190.stdout:6/393: creat d4/d12/d1a/f7c x:0 0 0 2023-12-06T15:00:23.677 INFO:tasks.workunit.client.1.smithi190.stdout:6/394: rename d4/d12/d40/d43/d45 to d4/d12/d40/d43/d45/d7d 22 2023-12-06T15:00:23.677 INFO:tasks.workunit.client.0.smithi152.stdout:9/193: creat d0/f30 x:0 0 0 2023-12-06T15:00:23.680 INFO:tasks.workunit.client.1.smithi190.stdout:1/506: mkdir d6/d9f 0 2023-12-06T15:00:23.682 INFO:tasks.workunit.client.0.smithi152.stdout:4/363: dread f1 [0,4194304] 0 2023-12-06T15:00:23.684 INFO:tasks.workunit.client.0.smithi152.stdout:9/194: mkdir d0/d31 0 2023-12-06T15:00:23.684 INFO:tasks.workunit.client.0.smithi152.stdout:5/171: link d7/dd/f2d d7/dd/f35 0 2023-12-06T15:00:23.684 INFO:tasks.workunit.client.1.smithi190.stdout:1/507: dread d6/f21 [0,4194304] 0 2023-12-06T15:00:23.685 INFO:tasks.workunit.client.1.smithi190.stdout:1/508: creat d6/dc/fa0 x:0 0 0 2023-12-06T15:00:23.686 INFO:tasks.workunit.client.1.smithi190.stdout:1/509: chown d6/f13 27122845 1 2023-12-06T15:00:23.687 INFO:tasks.workunit.client.1.smithi190.stdout:1/510: mknod d6/dc/d29/d38/d39/ca1 0 2023-12-06T15:00:23.689 INFO:tasks.workunit.client.1.smithi190.stdout:1/511: truncate d6/dc/f33 1443707 0 2023-12-06T15:00:23.689 INFO:tasks.workunit.client.1.smithi190.stdout:1/512: chown d6/dc/d29/d38/f7a 367081 1 2023-12-06T15:00:23.689 INFO:tasks.workunit.client.0.smithi152.stdout:9/195: link d0/lb d0/dd/d20/l32 0 2023-12-06T15:00:23.690 INFO:tasks.workunit.client.0.smithi152.stdout:5/172: chown d7/dd/l11 45 1 2023-12-06T15:00:23.690 INFO:tasks.workunit.client.0.smithi152.stdout:5/173: write d7/dd/d26/f32 [53067,107510] 0 2023-12-06T15:00:23.690 INFO:tasks.workunit.client.0.smithi152.stdout:5/174: write d7/dd/f1c [1567701,63213] 0 2023-12-06T15:00:23.690 INFO:tasks.workunit.client.1.smithi190.stdout:1/513: link d6/dc/d29/d38/d43/l4f d6/dc/d29/d38/la2 0 2023-12-06T15:00:23.691 INFO:tasks.workunit.client.0.smithi152.stdout:4/364: mkdir d2/d22/d6e 0 2023-12-06T15:00:23.693 INFO:tasks.workunit.client.0.smithi152.stdout:5/175: unlink d7/dd/d26/l29 0 2023-12-06T15:00:23.693 INFO:tasks.workunit.client.0.smithi152.stdout:5/176: chown d7/dd/f2d 998 1 2023-12-06T15:00:23.696 INFO:tasks.workunit.client.0.smithi152.stdout:5/177: write d7/f28 [443004,9064] 0 2023-12-06T15:00:23.696 INFO:tasks.workunit.client.0.smithi152.stdout:5/178: fdatasync d7/dd/d26/f2e 0 2023-12-06T15:00:23.698 INFO:tasks.workunit.client.0.smithi152.stdout:5/179: rename d7/dd/f25 to d7/dd/d26/f36 0 2023-12-06T15:00:23.708 INFO:tasks.workunit.client.1.smithi190.stdout:9/339: sync 2023-12-06T15:00:23.708 INFO:tasks.workunit.client.1.smithi190.stdout:4/295: sync 2023-12-06T15:00:23.708 INFO:tasks.workunit.client.1.smithi190.stdout:8/300: sync 2023-12-06T15:00:23.708 INFO:tasks.workunit.client.1.smithi190.stdout:3/465: sync 2023-12-06T15:00:23.708 INFO:tasks.workunit.client.1.smithi190.stdout:3/466: fsync d4/d1b/f22 0 2023-12-06T15:00:23.709 INFO:tasks.workunit.client.1.smithi190.stdout:4/296: write d3/d10/d39/f5c [919622,11394] 0 2023-12-06T15:00:23.709 INFO:tasks.workunit.client.1.smithi190.stdout:2/329: sync 2023-12-06T15:00:23.709 INFO:tasks.workunit.client.1.smithi190.stdout:2/330: dread d10/d26/d5c/d42/f44 [0,4194304] 0 2023-12-06T15:00:23.710 INFO:tasks.workunit.client.1.smithi190.stdout:8/301: mkdir d1/d20/d3b/d4c/d5a 0 2023-12-06T15:00:23.710 INFO:tasks.workunit.client.1.smithi190.stdout:3/467: rename d4/d1b/f21 to d4/d70/d53/d56/fa7 0 2023-12-06T15:00:23.711 INFO:tasks.workunit.client.1.smithi190.stdout:4/297: mknod d3/d10/d15/c65 0 2023-12-06T15:00:23.712 INFO:tasks.workunit.client.1.smithi190.stdout:8/302: mknod d1/d20/d3b/d4c/c5b 0 2023-12-06T15:00:23.712 INFO:tasks.workunit.client.1.smithi190.stdout:8/303: write d1/f51 [48244,6564] 0 2023-12-06T15:00:23.713 INFO:tasks.workunit.client.1.smithi190.stdout:2/331: rename f5 to d10/d26/d5b/f6e 0 2023-12-06T15:00:23.715 INFO:tasks.workunit.client.1.smithi190.stdout:3/468: mkdir d4/d1b/d77/da8 0 2023-12-06T15:00:23.716 INFO:tasks.workunit.client.1.smithi190.stdout:8/304: truncate d1/d10/d25/f2a 612569 0 2023-12-06T15:00:23.716 INFO:tasks.workunit.client.1.smithi190.stdout:8/305: write d1/f51 [699738,17269] 0 2023-12-06T15:00:23.717 INFO:tasks.workunit.client.1.smithi190.stdout:8/306: dread d1/d20/d3b/f30 [0,4194304] 0 2023-12-06T15:00:23.717 INFO:tasks.workunit.client.1.smithi190.stdout:8/307: write d1/d37/f45 [383733,15218] 0 2023-12-06T15:00:23.718 INFO:tasks.workunit.client.1.smithi190.stdout:3/469: creat d4/d70/d33/fa9 x:0 0 0 2023-12-06T15:00:23.721 INFO:tasks.workunit.client.1.smithi190.stdout:3/470: link d4/d1b/l4b d4/d70/d19/d3a/laa 0 2023-12-06T15:00:23.721 INFO:tasks.workunit.client.1.smithi190.stdout:3/471: read - d4/d1b/d54/d9c/f99 zero size 2023-12-06T15:00:23.728 INFO:tasks.workunit.client.0.smithi152.stdout:7/120: dwrite dd/df/f1a [0,4194304] 0 2023-12-06T15:00:23.730 INFO:tasks.workunit.client.0.smithi152.stdout:0/142: dwrite d8/f13 [0,4194304] 0 2023-12-06T15:00:23.730 INFO:tasks.workunit.client.0.smithi152.stdout:0/143: stat d8/d15/f26 0 2023-12-06T15:00:23.730 INFO:tasks.workunit.client.0.smithi152.stdout:0/144: write d8/d15/f21 [64840,79597] 0 2023-12-06T15:00:23.731 INFO:tasks.workunit.client.0.smithi152.stdout:0/145: truncate d8/d15/f21 568310 0 2023-12-06T15:00:23.733 INFO:tasks.workunit.client.0.smithi152.stdout:7/121: creat dd/f24 x:0 0 0 2023-12-06T15:00:23.738 INFO:tasks.workunit.client.1.smithi190.stdout:6/395: dwrite d4/f30 [0,4194304] 0 2023-12-06T15:00:23.739 INFO:tasks.workunit.client.0.smithi152.stdout:1/313: dwrite d3/da/d65/f68 [0,4194304] 0 2023-12-06T15:00:23.742 INFO:tasks.workunit.client.0.smithi152.stdout:1/314: creat d3/da/d15/f7e x:0 0 0 2023-12-06T15:00:23.742 INFO:tasks.workunit.client.0.smithi152.stdout:1/315: chown d3/da/db/d18/d52/d62/f7a 358 1 2023-12-06T15:00:23.742 INFO:tasks.workunit.client.1.smithi190.stdout:6/396: link d4/d12/d1a/d32/f4c d4/d12/d40/d43/d45/d4a/f7e 0 2023-12-06T15:00:23.743 INFO:tasks.workunit.client.0.smithi152.stdout:5/180: dwrite d7/dd/d26/f33 [0,4194304] 0 2023-12-06T15:00:23.744 INFO:tasks.workunit.client.1.smithi190.stdout:1/514: dwrite d6/dc/d29/d38/d43/d7f/d81/f84 [0,4194304] 0 2023-12-06T15:00:23.744 INFO:tasks.workunit.client.0.smithi152.stdout:9/196: dwrite d0/f24 [4194304,4194304] 0 2023-12-06T15:00:23.745 INFO:tasks.workunit.client.0.smithi152.stdout:5/181: write d7/dd/f2c [130405,99195] 0 2023-12-06T15:00:23.746 INFO:tasks.workunit.client.0.smithi152.stdout:1/316: creat d3/da/d15/d17/d4d/f7f x:0 0 0 2023-12-06T15:00:23.746 INFO:tasks.workunit.client.0.smithi152.stdout:1/317: chown d3/da/d15/d17/d58/l6d 12 1 2023-12-06T15:00:23.746 INFO:tasks.workunit.client.1.smithi190.stdout:2/332: dwrite d10/d26/f4c [0,4194304] 0 2023-12-06T15:00:23.746 INFO:tasks.workunit.client.1.smithi190.stdout:2/333: dread - d10/d59/d5e/f6a zero size 2023-12-06T15:00:23.746 INFO:tasks.workunit.client.1.smithi190.stdout:6/397: link d4/fc d4/d12/d1a/d70/f7f 0 2023-12-06T15:00:23.748 INFO:tasks.workunit.client.1.smithi190.stdout:1/515: rename d6/dc/d29/d38/d39/d63/d67/f97 to d6/dc/d29/d38/d73/d5c/fa3 0 2023-12-06T15:00:23.748 INFO:tasks.workunit.client.1.smithi190.stdout:1/516: chown d6/dc/d29/c31 47745471 1 2023-12-06T15:00:23.748 INFO:tasks.workunit.client.1.smithi190.stdout:1/517: readlink d6/l85 0 2023-12-06T15:00:23.749 INFO:tasks.workunit.client.0.smithi152.stdout:9/197: mknod d0/c33 0 2023-12-06T15:00:23.749 INFO:tasks.workunit.client.0.smithi152.stdout:1/318: mknod d3/da/db/d18/c80 0 2023-12-06T15:00:23.749 INFO:tasks.workunit.client.0.smithi152.stdout:9/198: write d0/dd/d20/f29 [10049,104639] 0 2023-12-06T15:00:23.749 INFO:tasks.workunit.client.0.smithi152.stdout:1/319: write d3/d44/f46 [319044,121391] 0 2023-12-06T15:00:23.749 INFO:tasks.workunit.client.0.smithi152.stdout:1/320: stat d3/l4a 0 2023-12-06T15:00:23.750 INFO:tasks.workunit.client.0.smithi152.stdout:9/199: creat d0/f34 x:0 0 0 2023-12-06T15:00:23.750 INFO:tasks.workunit.client.0.smithi152.stdout:1/321: creat d3/da/db/f81 x:0 0 0 2023-12-06T15:00:23.750 INFO:tasks.workunit.client.0.smithi152.stdout:1/322: chown d3/da 3 1 2023-12-06T15:00:23.750 INFO:tasks.workunit.client.0.smithi152.stdout:1/323: truncate d3/da/d15/d17/f70 467814 0 2023-12-06T15:00:23.751 INFO:tasks.workunit.client.1.smithi190.stdout:2/334: creat d10/d26/d5c/d49/f6f x:0 0 0 2023-12-06T15:00:23.751 INFO:tasks.workunit.client.1.smithi190.stdout:6/398: dread d4/d12/d1a/f39 [0,4194304] 0 2023-12-06T15:00:23.751 INFO:tasks.workunit.client.0.smithi152.stdout:1/324: read d3/f7 [409097,10319] 0 2023-12-06T15:00:23.751 INFO:tasks.workunit.client.0.smithi152.stdout:9/200: mknod d0/c35 0 2023-12-06T15:00:23.752 INFO:tasks.workunit.client.1.smithi190.stdout:1/518: mkdir d6/dc/d6f/da4 0 2023-12-06T15:00:23.752 INFO:tasks.workunit.client.0.smithi152.stdout:1/325: unlink d3/da/d15/d17/f1f 0 2023-12-06T15:00:23.753 INFO:tasks.workunit.client.1.smithi190.stdout:1/519: write d6/dc/d3b/d78/d94/f54 [709297,45528] 0 2023-12-06T15:00:23.756 INFO:tasks.workunit.client.1.smithi190.stdout:2/335: creat d10/d59/f70 x:0 0 0 2023-12-06T15:00:23.756 INFO:tasks.workunit.client.1.smithi190.stdout:6/399: symlink d4/d12/d1a/d44/l80 0 2023-12-06T15:00:23.757 INFO:tasks.workunit.client.1.smithi190.stdout:6/400: write d4/d12/d1a/f1c [4481265,58924] 0 2023-12-06T15:00:23.757 INFO:tasks.workunit.client.0.smithi152.stdout:1/326: dread d3/da/d15/f57 [0,4194304] 0 2023-12-06T15:00:23.757 INFO:tasks.workunit.client.0.smithi152.stdout:1/327: truncate d3/da/d65/f77 1024379 0 2023-12-06T15:00:23.757 INFO:tasks.workunit.client.0.smithi152.stdout:1/328: read - d3/da/d15/d17/d4d/f7f zero size 2023-12-06T15:00:23.757 INFO:tasks.workunit.client.0.smithi152.stdout:1/329: dread - d3/da/db/f81 zero size 2023-12-06T15:00:23.757 INFO:tasks.workunit.client.0.smithi152.stdout:1/330: write d3/f7 [1564556,74329] 0 2023-12-06T15:00:23.757 INFO:tasks.workunit.client.1.smithi190.stdout:1/520: getdents d6/dc/d29/d38/d43/d7f/d81 0 2023-12-06T15:00:23.758 INFO:tasks.workunit.client.1.smithi190.stdout:2/336: mkdir d10/d59/d5e/d71 0 2023-12-06T15:00:23.758 INFO:tasks.workunit.client.1.smithi190.stdout:2/337: read - d10/d26/d5c/f4b zero size 2023-12-06T15:00:23.759 INFO:tasks.workunit.client.1.smithi190.stdout:1/521: creat d6/dc/d29/d38/fa5 x:0 0 0 2023-12-06T15:00:23.761 INFO:tasks.workunit.client.1.smithi190.stdout:2/338: link d10/d59/d5e/f16 d10/d26/f72 0 2023-12-06T15:00:23.762 INFO:tasks.workunit.client.1.smithi190.stdout:8/308: dwrite d1/d20/d3b/f18 [0,4194304] 0 2023-12-06T15:00:23.762 INFO:tasks.workunit.client.1.smithi190.stdout:9/340: dwrite f2 [0,4194304] 0 2023-12-06T15:00:23.764 INFO:tasks.workunit.client.1.smithi190.stdout:2/339: rename d10/d26/d5c/d37/f65 to d10/d26/d5c/f73 0 2023-12-06T15:00:23.764 INFO:tasks.workunit.client.1.smithi190.stdout:3/472: dwrite d4/d1b/d54/f97 [0,4194304] 0 2023-12-06T15:00:23.764 INFO:tasks.workunit.client.1.smithi190.stdout:3/473: chown d4/d1b/d54/fa1 2778 1 2023-12-06T15:00:23.764 INFO:tasks.workunit.client.1.smithi190.stdout:3/474: fsync d4/d70/d53/f65 0 2023-12-06T15:00:23.766 INFO:tasks.workunit.client.0.smithi152.stdout:0/146: dwrite d8/f9 [4194304,4194304] 0 2023-12-06T15:00:23.767 INFO:tasks.workunit.client.1.smithi190.stdout:8/309: rmdir d1/d20/d3b/d36 39 2023-12-06T15:00:23.768 INFO:tasks.workunit.client.1.smithi190.stdout:8/310: write d1/d37/f45 [687280,73681] 0 2023-12-06T15:00:23.769 INFO:tasks.workunit.client.0.smithi152.stdout:7/122: dwrite dd/f15 [0,4194304] 0 2023-12-06T15:00:23.771 INFO:tasks.workunit.client.0.smithi152.stdout:7/123: dread f8 [0,4194304] 0 2023-12-06T15:00:23.773 INFO:tasks.workunit.client.0.smithi152.stdout:7/124: dread f8 [0,4194304] 0 2023-12-06T15:00:23.773 INFO:tasks.workunit.client.1.smithi190.stdout:9/341: mknod d4/d27/d2f/d31/d3f/d58/d72/c74 0 2023-12-06T15:00:23.774 INFO:tasks.workunit.client.1.smithi190.stdout:9/342: write d4/f22 [478569,107755] 0 2023-12-06T15:00:23.779 INFO:tasks.workunit.client.1.smithi190.stdout:3/475: mkdir d4/d70/d19/d51/dab 0 2023-12-06T15:00:23.781 INFO:tasks.workunit.client.1.smithi190.stdout:8/311: write d1/d20/d3b/f2d [2600047,84616] 0 2023-12-06T15:00:23.784 INFO:tasks.workunit.client.1.smithi190.stdout:6/401: dwrite d4/d12/d1a/f42 [0,4194304] 0 2023-12-06T15:00:23.784 INFO:tasks.workunit.client.1.smithi190.stdout:6/402: write d4/d12/d1a/d59/f78 [426657,127757] 0 2023-12-06T15:00:23.785 INFO:tasks.workunit.client.0.smithi152.stdout:9/201: dwrite d0/f6 [4194304,4194304] 0 2023-12-06T15:00:23.793 INFO:tasks.workunit.client.1.smithi190.stdout:3/476: creat d4/d70/d33/d45/fac x:0 0 0 2023-12-06T15:00:23.794 INFO:tasks.workunit.client.1.smithi190.stdout:8/312: mkdir d1/d37/d5c 0 2023-12-06T15:00:23.795 INFO:tasks.workunit.client.1.smithi190.stdout:6/403: mknod d4/d12/d40/d43/d45/c81 0 2023-12-06T15:00:23.795 INFO:tasks.workunit.client.1.smithi190.stdout:6/404: chown d4/d12/d40/d43/d45/c81 282904484 1 2023-12-06T15:00:23.798 INFO:tasks.workunit.client.1.smithi190.stdout:3/477: rename d4/d1b/d5d/fa3 to d4/d70/d53/fad 0 2023-12-06T15:00:23.798 INFO:tasks.workunit.client.1.smithi190.stdout:6/405: creat d4/d12/d1a/d70/f82 x:0 0 0 2023-12-06T15:00:23.800 INFO:tasks.workunit.client.1.smithi190.stdout:3/478: symlink d4/d70/d7f/lae 0 2023-12-06T15:00:23.802 INFO:tasks.workunit.client.1.smithi190.stdout:6/406: link d4/d12/d1a/f20 d4/f83 0 2023-12-06T15:00:23.802 INFO:tasks.workunit.client.1.smithi190.stdout:6/407: truncate d4/d12/f3f 986064 0 2023-12-06T15:00:23.803 INFO:tasks.workunit.client.1.smithi190.stdout:6/408: symlink d4/d12/d40/d43/d45/d4a/l84 0 2023-12-06T15:00:23.803 INFO:tasks.workunit.client.0.smithi152.stdout:5/182: dwrite d7/dd/f2c [0,4194304] 0 2023-12-06T15:00:23.805 INFO:tasks.workunit.client.0.smithi152.stdout:5/183: truncate d7/dd/f16 1593057 0 2023-12-06T15:00:23.806 INFO:tasks.workunit.client.1.smithi190.stdout:3/479: read d4/d1b/f38 [3750485,112976] 0 2023-12-06T15:00:23.806 INFO:tasks.workunit.client.1.smithi190.stdout:6/409: dread d4/d12/d40/d43/d45/d4a/f7e [0,4194304] 0 2023-12-06T15:00:23.807 INFO:tasks.workunit.client.1.smithi190.stdout:3/480: rmdir d4/d1b/d54/d9c/d68 39 2023-12-06T15:00:23.808 INFO:tasks.workunit.client.1.smithi190.stdout:2/340: getdents d10/d26/d5c/d37 0 2023-12-06T15:00:23.809 INFO:tasks.workunit.client.1.smithi190.stdout:6/410: rename d4/d12/d40/f48 to d4/d12/d40/d43/d45/d4a/d77/f85 0 2023-12-06T15:00:23.809 INFO:tasks.workunit.client.1.smithi190.stdout:3/481: stat d4/d1b/d54/d9c/l8b 0 2023-12-06T15:00:23.811 INFO:tasks.workunit.client.1.smithi190.stdout:2/341: unlink d10/d26/f3a 0 2023-12-06T15:00:23.811 INFO:tasks.workunit.client.1.smithi190.stdout:2/342: write d10/f1f [1313966,20618] 0 2023-12-06T15:00:23.812 INFO:tasks.workunit.client.1.smithi190.stdout:1/522: dwrite d6/dc/d29/d38/d39/d63/d67/f7d [0,4194304] 0 2023-12-06T15:00:23.812 INFO:tasks.workunit.client.0.smithi152.stdout:0/147: dwrite d8/d15/f21 [0,4194304] 0 2023-12-06T15:00:23.813 INFO:tasks.workunit.client.0.smithi152.stdout:1/331: rename d3/da/db/d18 to d3/da/d4c/d82 0 2023-12-06T15:00:23.814 INFO:tasks.workunit.client.0.smithi152.stdout:1/332: fsync d3/da/d15/d17/d43/f66 0 2023-12-06T15:00:23.815 INFO:tasks.workunit.client.1.smithi190.stdout:6/411: mknod d4/d12/d1a/d70/c86 0 2023-12-06T15:00:23.815 INFO:tasks.workunit.client.1.smithi190.stdout:3/482: creat d4/d1b/d5d/faf x:0 0 0 2023-12-06T15:00:23.815 INFO:tasks.workunit.client.1.smithi190.stdout:3/483: fdatasync d4/d70/d19/d3a/f73 0 2023-12-06T15:00:23.815 INFO:tasks.workunit.client.1.smithi190.stdout:9/343: dwrite d4/fe [0,4194304] 0 2023-12-06T15:00:23.816 INFO:tasks.workunit.client.1.smithi190.stdout:8/313: dwrite d1/d37/f47 [0,4194304] 0 2023-12-06T15:00:23.816 INFO:tasks.workunit.client.1.smithi190.stdout:8/314: chown d1/d20/d3b/d36/d50 2 1 2023-12-06T15:00:23.816 INFO:tasks.workunit.client.1.smithi190.stdout:2/343: symlink d10/d26/d5c/d49/d54/l74 0 2023-12-06T15:00:23.817 INFO:tasks.workunit.client.0.smithi152.stdout:5/184: dread d7/dd/d26/f33 [0,4194304] 0 2023-12-06T15:00:23.817 INFO:tasks.workunit.client.0.smithi152.stdout:0/148: creat d8/d1b/f27 x:0 0 0 2023-12-06T15:00:23.817 INFO:tasks.workunit.client.0.smithi152.stdout:0/149: chown d8/f17 0 1 2023-12-06T15:00:23.817 INFO:tasks.workunit.client.0.smithi152.stdout:0/150: chown d8/d1b 0 1 2023-12-06T15:00:23.820 INFO:tasks.workunit.client.0.smithi152.stdout:7/125: rename l5 to dd/df/d22/l25 0 2023-12-06T15:00:23.820 INFO:tasks.workunit.client.0.smithi152.stdout:7/126: dread - dd/f24 zero size 2023-12-06T15:00:23.820 INFO:tasks.workunit.client.0.smithi152.stdout:7/127: truncate f7 1067021 0 2023-12-06T15:00:23.820 INFO:tasks.workunit.client.0.smithi152.stdout:1/333: creat d3/da/d15/d17/d43/f83 x:0 0 0 2023-12-06T15:00:23.821 INFO:tasks.workunit.client.1.smithi190.stdout:1/523: rename d6/d49/f7c to d6/dc/d29/d38/d43/fa6 0 2023-12-06T15:00:23.821 INFO:tasks.workunit.client.1.smithi190.stdout:3/484: symlink d4/d70/d7f/lb0 0 2023-12-06T15:00:23.830 INFO:tasks.workunit.client.0.smithi152.stdout:0/151: dread d8/f17 [0,4194304] 0 2023-12-06T15:00:23.830 INFO:tasks.workunit.client.0.smithi152.stdout:0/152: readlink d8/d15/l19 0 2023-12-06T15:00:23.830 INFO:tasks.workunit.client.0.smithi152.stdout:0/153: fdatasync d8/d1b/f23 0 2023-12-06T15:00:23.831 INFO:tasks.workunit.client.1.smithi190.stdout:9/344: creat d4/d27/d2f/d31/d3f/d58/d72/f75 x:0 0 0 2023-12-06T15:00:23.831 INFO:tasks.workunit.client.1.smithi190.stdout:1/524: mkdir d6/dc/d29/d38/d43/d7f/da7 0 2023-12-06T15:00:23.832 INFO:tasks.workunit.client.1.smithi190.stdout:9/345: read d4/f24 [2851509,130095] 0 2023-12-06T15:00:23.832 INFO:tasks.workunit.client.1.smithi190.stdout:3/485: creat d4/d1b/d54/fb1 x:0 0 0 2023-12-06T15:00:23.833 INFO:tasks.workunit.client.0.smithi152.stdout:1/334: dread d3/da/db/f11 [0,4194304] 0 2023-12-06T15:00:23.833 INFO:tasks.workunit.client.0.smithi152.stdout:7/128: symlink dd/d17/l26 0 2023-12-06T15:00:23.834 INFO:tasks.workunit.client.0.smithi152.stdout:1/335: getdents d3/da/d4c/d82/d52/d62 0 2023-12-06T15:00:23.834 INFO:tasks.workunit.client.1.smithi190.stdout:7/390: sync 2023-12-06T15:00:23.835 INFO:tasks.workunit.client.0.smithi152.stdout:5/185: rename d7/dd/l2b to d7/dd/l37 0 2023-12-06T15:00:23.835 INFO:tasks.workunit.client.1.smithi190.stdout:1/525: unlink d6/dc/d3b/l99 0 2023-12-06T15:00:23.836 INFO:tasks.workunit.client.1.smithi190.stdout:9/346: creat d4/d27/d2f/d31/d3f/d58/d72/f76 x:0 0 0 2023-12-06T15:00:23.837 INFO:tasks.workunit.client.0.smithi152.stdout:7/129: symlink dd/l27 0 2023-12-06T15:00:23.837 INFO:tasks.workunit.client.0.smithi152.stdout:5/186: creat d7/f38 x:0 0 0 2023-12-06T15:00:23.837 INFO:tasks.workunit.client.0.smithi152.stdout:5/187: fsync d7/f15 0 2023-12-06T15:00:23.838 INFO:tasks.workunit.client.1.smithi190.stdout:9/347: mknod d4/d27/d2f/d5c/c77 0 2023-12-06T15:00:23.838 INFO:tasks.workunit.client.0.smithi152.stdout:7/130: mkdir dd/df/d1b/d20/d28 0 2023-12-06T15:00:23.839 INFO:tasks.workunit.client.1.smithi190.stdout:1/526: creat d6/dc/d29/d38/d43/d7f/d81/fa8 x:0 0 0 2023-12-06T15:00:23.839 INFO:tasks.workunit.client.1.smithi190.stdout:1/527: write d6/f90 [5058484,130959] 0 2023-12-06T15:00:23.839 INFO:tasks.workunit.client.1.smithi190.stdout:1/528: dread - d6/dc/d3b/d78/d94/f87 zero size 2023-12-06T15:00:23.841 INFO:tasks.workunit.client.0.smithi152.stdout:0/154: write d8/d15/f26 [727058,37652] 0 2023-12-06T15:00:23.842 INFO:tasks.workunit.client.1.smithi190.stdout:1/529: rename d6/dc/d29/d38/d43/d7f/d81/f84 to d6/dc/d29/d38/d39/d63/d67/fa9 0 2023-12-06T15:00:23.847 INFO:tasks.workunit.client.0.smithi152.stdout:0/155: symlink d8/l28 0 2023-12-06T15:00:23.847 INFO:tasks.workunit.client.0.smithi152.stdout:5/188: symlink d7/dd/l39 0 2023-12-06T15:00:23.848 INFO:tasks.workunit.client.0.smithi152.stdout:0/156: chown d8/f17 1169247297 1 2023-12-06T15:00:23.849 INFO:tasks.workunit.client.0.smithi152.stdout:5/189: mkdir d7/dd/d26/d3a 0 2023-12-06T15:00:23.850 INFO:tasks.workunit.client.0.smithi152.stdout:0/157: rename d8/c24 to d8/d1b/c29 0 2023-12-06T15:00:23.851 INFO:tasks.workunit.client.1.smithi190.stdout:7/391: dread d0/df/d1f/f58 [0,4194304] 0 2023-12-06T15:00:23.851 INFO:tasks.workunit.client.0.smithi152.stdout:5/190: unlink d7/dd/c31 0 2023-12-06T15:00:23.852 INFO:tasks.workunit.client.1.smithi190.stdout:1/530: dread d6/dc/d29/d38/d43/fa6 [0,4194304] 0 2023-12-06T15:00:23.852 INFO:tasks.workunit.client.0.smithi152.stdout:0/158: mknod d8/d15/c2a 0 2023-12-06T15:00:23.853 INFO:tasks.workunit.client.1.smithi190.stdout:1/531: mkdir d6/d49/daa 0 2023-12-06T15:00:23.854 INFO:tasks.workunit.client.1.smithi190.stdout:1/532: write d6/d49/f68 [514724,113757] 0 2023-12-06T15:00:23.855 INFO:tasks.workunit.client.0.smithi152.stdout:0/159: symlink d8/d1b/l2b 0 2023-12-06T15:00:23.860 INFO:tasks.workunit.client.0.smithi152.stdout:0/160: rename d8/d1b/f23 to d8/d15/f2c 0 2023-12-06T15:00:23.861 INFO:tasks.workunit.client.0.smithi152.stdout:0/161: readlink d8/lc 0 2023-12-06T15:00:23.862 INFO:tasks.workunit.client.0.smithi152.stdout:0/162: link d8/d15/l19 d8/d15/l2d 0 2023-12-06T15:00:23.863 INFO:tasks.workunit.client.1.smithi190.stdout:9/348: dread d4/d27/d2f/d31/f38 [4194304,4194304] 0 2023-12-06T15:00:23.863 INFO:tasks.workunit.client.1.smithi190.stdout:9/349: readlink d4/l4a 0 2023-12-06T15:00:23.863 INFO:tasks.workunit.client.1.smithi190.stdout:3/486: dread d4/d1b/d54/d9c/f27 [0,4194304] 0 2023-12-06T15:00:23.863 INFO:tasks.workunit.client.0.smithi152.stdout:0/163: creat d8/d15/f2e x:0 0 0 2023-12-06T15:00:23.863 INFO:tasks.workunit.client.0.smithi152.stdout:1/336: dwrite d3/da/f26 [0,4194304] 0 2023-12-06T15:00:23.864 INFO:tasks.workunit.client.1.smithi190.stdout:9/350: mknod d4/d27/d2f/d31/d3f/d58/d72/c78 0 2023-12-06T15:00:23.864 INFO:tasks.workunit.client.1.smithi190.stdout:1/533: dread d6/dc/f33 [0,4194304] 0 2023-12-06T15:00:23.866 INFO:tasks.workunit.client.1.smithi190.stdout:6/412: dwrite d4/d12/f53 [0,4194304] 0 2023-12-06T15:00:23.866 INFO:tasks.workunit.client.1.smithi190.stdout:6/413: stat d4/d12/d1a/d59/l6e 0 2023-12-06T15:00:23.866 INFO:tasks.workunit.client.1.smithi190.stdout:8/315: dwrite d1/f43 [0,4194304] 0 2023-12-06T15:00:23.866 INFO:tasks.workunit.client.1.smithi190.stdout:8/316: readlink d1/d20/d3b/d36/l58 0 2023-12-06T15:00:23.866 INFO:tasks.workunit.client.0.smithi152.stdout:8/60: sync 2023-12-06T15:00:23.866 INFO:tasks.workunit.client.0.smithi152.stdout:8/61: fsync d1/d6/d7/fa 0 2023-12-06T15:00:23.868 INFO:tasks.workunit.client.0.smithi152.stdout:1/337: truncate d3/da/d15/d17/f70 302821 0 2023-12-06T15:00:23.870 INFO:tasks.workunit.client.0.smithi152.stdout:8/62: getdents d1/d6 0 2023-12-06T15:00:23.871 INFO:tasks.workunit.client.1.smithi190.stdout:2/344: dwrite d10/d26/d5c/d37/f3d [0,4194304] 0 2023-12-06T15:00:23.871 INFO:tasks.workunit.client.1.smithi190.stdout:9/351: rename d4/l1b to d4/d27/d2f/d31/l79 0 2023-12-06T15:00:23.871 INFO:tasks.workunit.client.1.smithi190.stdout:7/392: dwrite d0/d5/d1b/d1c/f4d [0,4194304] 0 2023-12-06T15:00:23.871 INFO:tasks.workunit.client.1.smithi190.stdout:7/393: truncate d0/d5/d1b/d1c/d17/f4a 4935748 0 2023-12-06T15:00:23.872 INFO:tasks.workunit.client.1.smithi190.stdout:1/534: truncate d6/dc/d29/d38/d43/f7b 604947 0 2023-12-06T15:00:23.872 INFO:tasks.workunit.client.1.smithi190.stdout:1/535: dread - d6/dc/d29/d38/d73/d5c/fa3 zero size 2023-12-06T15:00:23.872 INFO:tasks.workunit.client.1.smithi190.stdout:1/536: dread - d6/dc/d29/d38/d43/d7f/d81/fa8 zero size 2023-12-06T15:00:23.872 INFO:tasks.workunit.client.1.smithi190.stdout:8/317: creat d1/d20/d3b/d4c/d5a/f5d x:0 0 0 2023-12-06T15:00:23.872 INFO:tasks.workunit.client.0.smithi152.stdout:1/338: mkdir d3/d44/d84 0 2023-12-06T15:00:23.873 INFO:tasks.workunit.client.0.smithi152.stdout:8/63: rmdir d1 39 2023-12-06T15:00:23.874 INFO:tasks.workunit.client.0.smithi152.stdout:8/64: chown d1/d6/fd 1742057 1 2023-12-06T15:00:23.874 INFO:tasks.workunit.client.0.smithi152.stdout:8/65: fdatasync d1/f10 0 2023-12-06T15:00:23.876 INFO:tasks.workunit.client.0.smithi152.stdout:1/339: mkdir d3/da/d4c/d85 0 2023-12-06T15:00:23.881 INFO:tasks.workunit.client.1.smithi190.stdout:7/394: rmdir d0/d5/d1b 39 2023-12-06T15:00:23.881 INFO:tasks.workunit.client.0.smithi152.stdout:5/191: rmdir d7/dd 39 2023-12-06T15:00:23.883 INFO:tasks.workunit.client.0.smithi152.stdout:1/340: dread d3/da/d4c/d82/d52/d55/f56 [0,4194304] 0 2023-12-06T15:00:23.884 INFO:tasks.workunit.client.0.smithi152.stdout:5/192: write d7/dd/f35 [1174864,126246] 0 2023-12-06T15:00:23.886 INFO:tasks.workunit.client.1.smithi190.stdout:8/318: creat d1/d10/f5e x:0 0 0 2023-12-06T15:00:23.888 INFO:tasks.workunit.client.1.smithi190.stdout:8/319: mknod d1/d20/d3b/d36/d50/c5f 0 2023-12-06T15:00:23.889 INFO:tasks.workunit.client.0.smithi152.stdout:5/193: dread d7/f19 [0,4194304] 0 2023-12-06T15:00:23.890 INFO:tasks.workunit.client.0.smithi152.stdout:1/341: creat d3/da/d15/d17/f86 x:0 0 0 2023-12-06T15:00:23.890 INFO:tasks.workunit.client.1.smithi190.stdout:8/320: mknod d1/d20/d3b/d31/c60 0 2023-12-06T15:00:23.890 INFO:tasks.workunit.client.1.smithi190.stdout:2/345: dread ff [0,4194304] 0 2023-12-06T15:00:23.891 INFO:tasks.workunit.client.1.smithi190.stdout:2/346: fdatasync d10/d26/f29 0 2023-12-06T15:00:23.891 INFO:tasks.workunit.client.1.smithi190.stdout:2/347: fdatasync d10/d26/d5c/f73 0 2023-12-06T15:00:23.891 INFO:tasks.workunit.client.0.smithi152.stdout:0/164: dread f5 [0,4194304] 0 2023-12-06T15:00:23.891 INFO:tasks.workunit.client.0.smithi152.stdout:0/165: truncate d8/d1b/f27 11082 0 2023-12-06T15:00:23.891 INFO:tasks.workunit.client.0.smithi152.stdout:0/166: fdatasync d8/d15/f18 0 2023-12-06T15:00:23.891 INFO:tasks.workunit.client.0.smithi152.stdout:5/194: mkdir d7/dd/d26/d3b 0 2023-12-06T15:00:23.892 INFO:tasks.workunit.client.0.smithi152.stdout:1/342: mkdir d3/da/d4c/d63/d87 0 2023-12-06T15:00:23.892 INFO:tasks.workunit.client.0.smithi152.stdout:1/343: chown d3 6852122 1 2023-12-06T15:00:23.893 INFO:tasks.workunit.client.0.smithi152.stdout:5/195: creat d7/dd/f3c x:0 0 0 2023-12-06T15:00:23.893 INFO:tasks.workunit.client.0.smithi152.stdout:5/196: chown d7/c1b 1228 1 2023-12-06T15:00:23.894 INFO:tasks.workunit.client.1.smithi190.stdout:2/348: symlink d10/d26/l75 0 2023-12-06T15:00:23.894 INFO:tasks.workunit.client.0.smithi152.stdout:0/167: read d8/ff [3029556,109906] 0 2023-12-06T15:00:23.895 INFO:tasks.workunit.client.0.smithi152.stdout:5/197: rename d7/f34 to d7/dd/d26/f3d 0 2023-12-06T15:00:23.896 INFO:tasks.workunit.client.0.smithi152.stdout:8/66: dread d1/d6/d7/fa [0,4194304] 0 2023-12-06T15:00:23.896 INFO:tasks.workunit.client.0.smithi152.stdout:8/67: fdatasync d1/f10 0 2023-12-06T15:00:23.896 INFO:tasks.workunit.client.1.smithi190.stdout:2/349: truncate d10/d26/d5c/f63 3703192 0 2023-12-06T15:00:23.896 INFO:tasks.workunit.client.1.smithi190.stdout:2/350: read d10/d26/d5c/d42/f44 [351290,55251] 0 2023-12-06T15:00:23.898 INFO:tasks.workunit.client.0.smithi152.stdout:0/168: link d8/f9 d8/d1b/f2f 0 2023-12-06T15:00:23.899 INFO:tasks.workunit.client.0.smithi152.stdout:8/68: write d1/d6/ff [316526,34288] 0 2023-12-06T15:00:23.900 INFO:tasks.workunit.client.0.smithi152.stdout:0/169: symlink d8/d15/l30 0 2023-12-06T15:00:23.902 INFO:tasks.workunit.client.0.smithi152.stdout:5/198: link d7/dd/c17 d7/dd/c3e 0 2023-12-06T15:00:23.905 INFO:tasks.workunit.client.0.smithi152.stdout:0/170: rename d8/d1b/l2b to d8/l31 0 2023-12-06T15:00:23.908 INFO:tasks.workunit.client.0.smithi152.stdout:8/69: dread d1/d6/fd [0,4194304] 0 2023-12-06T15:00:23.908 INFO:tasks.workunit.client.0.smithi152.stdout:8/70: truncate d1/d6/db/f11 1678189 0 2023-12-06T15:00:23.911 INFO:tasks.workunit.client.0.smithi152.stdout:0/171: write d8/fd [7633130,97409] 0 2023-12-06T15:00:23.911 INFO:tasks.workunit.client.0.smithi152.stdout:1/344: dread d3/da/d15/f5e [0,4194304] 0 2023-12-06T15:00:23.911 INFO:tasks.workunit.client.0.smithi152.stdout:8/71: creat d1/d6/db/f14 x:0 0 0 2023-12-06T15:00:23.911 INFO:tasks.workunit.client.0.smithi152.stdout:1/345: write d3/da/d4c/d82/d75/f79 [5172322,38473] 0 2023-12-06T15:00:23.911 INFO:tasks.workunit.client.0.smithi152.stdout:1/346: write d3/da/d4c/d82/d52/d62/f72 [62632,83097] 0 2023-12-06T15:00:23.912 INFO:tasks.workunit.client.0.smithi152.stdout:8/72: getdents d1 0 2023-12-06T15:00:23.912 INFO:tasks.workunit.client.1.smithi190.stdout:6/414: dwrite d4/d12/d40/d43/d45/d4a/d77/f85 [0,4194304] 0 2023-12-06T15:00:23.913 INFO:tasks.workunit.client.1.smithi190.stdout:6/415: symlink d4/d12/l87 0 2023-12-06T15:00:23.913 INFO:tasks.workunit.client.0.smithi152.stdout:1/347: link d3/da/db/d54/f6a d3/da/db/f88 0 2023-12-06T15:00:23.914 INFO:tasks.workunit.client.0.smithi152.stdout:8/73: mknod d1/c15 0 2023-12-06T15:00:23.916 INFO:tasks.workunit.client.1.smithi190.stdout:8/321: truncate d1/f43 685487 0 2023-12-06T15:00:23.916 INFO:tasks.workunit.client.1.smithi190.stdout:9/352: dwrite f1 [0,4194304] 0 2023-12-06T15:00:23.917 INFO:tasks.workunit.client.1.smithi190.stdout:6/416: write d4/d12/f2d [282748,101001] 0 2023-12-06T15:00:23.918 INFO:tasks.workunit.client.1.smithi190.stdout:8/322: symlink d1/d20/l61 0 2023-12-06T15:00:23.918 INFO:tasks.workunit.client.1.smithi190.stdout:9/353: mkdir d4/d27/d2f/d31/d3f/d58/d72/d7a 0 2023-12-06T15:00:23.920 INFO:tasks.workunit.client.1.smithi190.stdout:8/323: symlink d1/d37/l62 0 2023-12-06T15:00:23.924 INFO:tasks.workunit.client.1.smithi190.stdout:1/537: dwrite d6/f5a [4194304,4194304] 0 2023-12-06T15:00:23.925 INFO:tasks.workunit.client.1.smithi190.stdout:1/538: write d6/f69 [1290495,74555] 0 2023-12-06T15:00:23.928 INFO:tasks.workunit.client.0.smithi152.stdout:1/348: getdents d3/da/d4c 0 2023-12-06T15:00:23.928 INFO:tasks.workunit.client.0.smithi152.stdout:1/349: write d3/da/d15/d17/d43/f83 [308924,40244] 0 2023-12-06T15:00:23.929 INFO:tasks.workunit.client.1.smithi190.stdout:7/395: dwrite d0/d5/d1b/d33/d4c/f75 [0,4194304] 0 2023-12-06T15:00:23.929 INFO:tasks.workunit.client.1.smithi190.stdout:1/539: creat d6/dc/d29/d38/d43/d7f/da7/fab x:0 0 0 2023-12-06T15:00:23.929 INFO:tasks.workunit.client.1.smithi190.stdout:1/540: chown d6/dc/d29/d38/la2 50552023 1 2023-12-06T15:00:23.929 INFO:tasks.workunit.client.0.smithi152.stdout:5/199: dwrite d7/f21 [0,4194304] 0 2023-12-06T15:00:23.931 INFO:tasks.workunit.client.1.smithi190.stdout:2/351: dwrite d10/d59/d5e/f3c [0,4194304] 0 2023-12-06T15:00:23.932 INFO:tasks.workunit.client.0.smithi152.stdout:5/200: mknod d7/dd/d26/d3b/c3f 0 2023-12-06T15:00:23.933 INFO:tasks.workunit.client.1.smithi190.stdout:1/541: write d6/dc/f2e [946366,49692] 0 2023-12-06T15:00:23.934 INFO:tasks.workunit.client.1.smithi190.stdout:2/352: mkdir d10/d26/d5b/d76 0 2023-12-06T15:00:23.934 INFO:tasks.workunit.client.0.smithi152.stdout:0/172: dread d8/d1b/f2f [4194304,4194304] 0 2023-12-06T15:00:23.936 INFO:tasks.workunit.client.0.smithi152.stdout:5/201: mknod d7/dd/d26/c40 0 2023-12-06T15:00:23.942 INFO:tasks.workunit.client.1.smithi190.stdout:1/542: symlink d6/dc/d29/d38/d39/lac 0 2023-12-06T15:00:23.942 INFO:tasks.workunit.client.1.smithi190.stdout:1/543: chown d6/dc/d29/c35 21 1 2023-12-06T15:00:23.942 INFO:tasks.workunit.client.1.smithi190.stdout:1/544: creat d6/dc/d29/d38/d73/fad x:0 0 0 2023-12-06T15:00:23.942 INFO:tasks.workunit.client.1.smithi190.stdout:2/353: mkdir d10/d26/d5c/d35/d77 0 2023-12-06T15:00:23.942 INFO:tasks.workunit.client.1.smithi190.stdout:7/396: write d0/df/d1f/f6f [6178200,33975] 0 2023-12-06T15:00:23.943 INFO:tasks.workunit.client.1.smithi190.stdout:7/397: write d0/d5/da/f77 [346594,91447] 0 2023-12-06T15:00:23.943 INFO:tasks.workunit.client.1.smithi190.stdout:7/398: fdatasync d0/f6 0 2023-12-06T15:00:23.943 INFO:tasks.workunit.client.1.smithi190.stdout:2/354: link d10/d59/d5e/f25 d10/d59/d5e/f78 0 2023-12-06T15:00:23.945 INFO:tasks.workunit.client.1.smithi190.stdout:2/355: rename d10/d59/d5e/c36 to d10/d26/d5c/d37/c79 0 2023-12-06T15:00:23.946 INFO:tasks.workunit.client.1.smithi190.stdout:2/356: symlink d10/d26/d5c/d35/d77/l7a 0 2023-12-06T15:00:23.947 INFO:tasks.workunit.client.1.smithi190.stdout:7/399: dread d0/d5/da/f49 [0,4194304] 0 2023-12-06T15:00:23.947 INFO:tasks.workunit.client.1.smithi190.stdout:7/400: chown d0/d5/f78 5 1 2023-12-06T15:00:23.949 INFO:tasks.workunit.client.0.smithi152.stdout:0/173: dread d8/d15/f26 [0,4194304] 0 2023-12-06T15:00:23.949 INFO:tasks.workunit.client.0.smithi152.stdout:0/174: write d8/d15/f2e [859755,79997] 0 2023-12-06T15:00:23.951 INFO:tasks.workunit.client.1.smithi190.stdout:7/401: unlink d0/df/d53/d15/c3a 0 2023-12-06T15:00:23.953 INFO:tasks.workunit.client.0.smithi152.stdout:0/175: unlink d8/d1b/c25 0 2023-12-06T15:00:23.954 INFO:tasks.workunit.client.0.smithi152.stdout:0/176: mknod d8/d1b/c32 0 2023-12-06T15:00:23.955 INFO:tasks.workunit.client.0.smithi152.stdout:0/177: creat d8/d15/f33 x:0 0 0 2023-12-06T15:00:23.957 INFO:tasks.workunit.client.0.smithi152.stdout:0/178: rename d8/d15/f21 to d8/d1b/f34 0 2023-12-06T15:00:23.957 INFO:tasks.workunit.client.0.smithi152.stdout:0/179: fsync f5 0 2023-12-06T15:00:23.958 INFO:tasks.workunit.client.1.smithi190.stdout:6/417: dwrite d4/d12/d1a/d44/f47 [0,4194304] 0 2023-12-06T15:00:23.960 INFO:tasks.workunit.client.0.smithi152.stdout:0/180: rmdir d8 39 2023-12-06T15:00:23.960 INFO:tasks.workunit.client.1.smithi190.stdout:1/545: dread d6/f22 [0,4194304] 0 2023-12-06T15:00:23.961 INFO:tasks.workunit.client.0.smithi152.stdout:8/74: dwrite d1/d6/fd [4194304,4194304] 0 2023-12-06T15:00:23.961 INFO:tasks.workunit.client.0.smithi152.stdout:0/181: symlink d8/d1b/l35 0 2023-12-06T15:00:23.963 INFO:tasks.workunit.client.1.smithi190.stdout:6/418: creat d4/d12/d40/d43/d45/f88 x:0 0 0 2023-12-06T15:00:23.963 INFO:tasks.workunit.client.0.smithi152.stdout:8/75: symlink d1/d6/d7/l16 0 2023-12-06T15:00:23.964 INFO:tasks.workunit.client.0.smithi152.stdout:5/202: dread d7/dd/f35 [0,4194304] 0 2023-12-06T15:00:23.964 INFO:tasks.workunit.client.0.smithi152.stdout:8/76: creat d1/d6/db/f17 x:0 0 0 2023-12-06T15:00:23.964 INFO:tasks.workunit.client.0.smithi152.stdout:8/77: readlink d1/d6/db/l12 0 2023-12-06T15:00:23.964 INFO:tasks.workunit.client.1.smithi190.stdout:1/546: rmdir d6/d9f 0 2023-12-06T15:00:23.965 INFO:tasks.workunit.client.0.smithi152.stdout:5/203: truncate d7/f19 124132 0 2023-12-06T15:00:23.966 INFO:tasks.workunit.client.0.smithi152.stdout:8/78: symlink d1/d6/d7/l18 0 2023-12-06T15:00:23.967 INFO:tasks.workunit.client.0.smithi152.stdout:0/182: write d8/d1b/f2f [3764816,10339] 0 2023-12-06T15:00:23.968 INFO:tasks.workunit.client.1.smithi190.stdout:6/419: creat d4/d15/f89 x:0 0 0 2023-12-06T15:00:23.968 INFO:tasks.workunit.client.1.smithi190.stdout:6/420: fdatasync d4/d12/d1a/f28 0 2023-12-06T15:00:23.968 INFO:tasks.workunit.client.1.smithi190.stdout:1/547: write d6/f25 [876795,19910] 0 2023-12-06T15:00:23.970 INFO:tasks.workunit.client.1.smithi190.stdout:6/421: rename d4/d12/d1a/d32/d76 to d4/d12/d1a/d8a 0 2023-12-06T15:00:23.971 INFO:tasks.workunit.client.1.smithi190.stdout:6/422: read d4/d12/f3f [847553,111203] 0 2023-12-06T15:00:23.973 INFO:tasks.workunit.client.0.smithi152.stdout:1/350: dwrite d3/d44/f78 [0,4194304] 0 2023-12-06T15:00:23.974 INFO:tasks.workunit.client.1.smithi190.stdout:9/354: dwrite d4/d27/d2f/d31/f38 [8388608,4194304] 0 2023-12-06T15:00:23.974 INFO:tasks.workunit.client.1.smithi190.stdout:8/324: dwrite d1/d20/d3b/f2d [0,4194304] 0 2023-12-06T15:00:23.974 INFO:tasks.workunit.client.1.smithi190.stdout:8/325: dread - d1/d20/f42 zero size 2023-12-06T15:00:23.976 INFO:tasks.workunit.client.1.smithi190.stdout:6/423: unlink d4/d12/d1a/d32/f6f 0 2023-12-06T15:00:23.976 INFO:tasks.workunit.client.1.smithi190.stdout:6/424: fdatasync d4/fc 0 2023-12-06T15:00:23.976 INFO:tasks.workunit.client.1.smithi190.stdout:2/357: dwrite d10/d26/d5c/d37/f38 [0,4194304] 0 2023-12-06T15:00:23.977 INFO:tasks.workunit.client.1.smithi190.stdout:7/402: dwrite d0/df/f45 [0,4194304] 0 2023-12-06T15:00:23.978 INFO:tasks.workunit.client.1.smithi190.stdout:6/425: write d4/d12/d40/f4f [1129134,55760] 0 2023-12-06T15:00:23.979 INFO:tasks.workunit.client.1.smithi190.stdout:8/326: dread d1/f43 [0,4194304] 0 2023-12-06T15:00:23.979 INFO:tasks.workunit.client.1.smithi190.stdout:8/327: stat d1/d10/d25/c2b 0 2023-12-06T15:00:23.980 INFO:tasks.workunit.client.1.smithi190.stdout:7/403: creat d0/d5/f7f x:0 0 0 2023-12-06T15:00:23.982 INFO:tasks.workunit.client.1.smithi190.stdout:6/426: rename d4/f35 to d4/d12/d40/d43/d45/d4a/f8b 0 2023-12-06T15:00:23.982 INFO:tasks.workunit.client.1.smithi190.stdout:6/427: chown d4/fd 30980126 1 2023-12-06T15:00:23.982 INFO:tasks.workunit.client.1.smithi190.stdout:6/428: write d4/d12/d40/f4f [4202505,38309] 0 2023-12-06T15:00:23.983 INFO:tasks.workunit.client.1.smithi190.stdout:8/328: symlink d1/d20/d3b/d34/d39/l63 0 2023-12-06T15:00:23.983 INFO:tasks.workunit.client.1.smithi190.stdout:8/329: chown d1/d10/d1c/f4e 776273 1 2023-12-06T15:00:23.985 INFO:tasks.workunit.client.1.smithi190.stdout:8/330: rename d1/f43 to d1/d10/d1c/f64 0 2023-12-06T15:00:23.987 INFO:tasks.workunit.client.1.smithi190.stdout:8/331: link d1/d20/d3b/d31/l54 d1/d20/d3b/d36/l65 0 2023-12-06T15:00:23.989 INFO:tasks.workunit.client.1.smithi190.stdout:8/332: unlink d1/d20/d3b/d4c/d5a/f5d 0 2023-12-06T15:00:23.991 INFO:tasks.workunit.client.1.smithi190.stdout:8/333: truncate d1/f41 491649 0 2023-12-06T15:00:23.991 INFO:tasks.workunit.client.1.smithi190.stdout:1/548: dread d6/f12 [0,4194304] 0 2023-12-06T15:00:23.993 INFO:tasks.workunit.client.1.smithi190.stdout:1/549: mknod d6/dc/d29/d38/d43/d7f/da7/cae 0 2023-12-06T15:00:23.995 INFO:tasks.workunit.client.1.smithi190.stdout:5/262: sync 2023-12-06T15:00:23.995 INFO:tasks.workunit.client.1.smithi190.stdout:0/300: sync 2023-12-06T15:00:23.995 INFO:tasks.workunit.client.1.smithi190.stdout:4/298: sync 2023-12-06T15:00:23.995 INFO:tasks.workunit.client.1.smithi190.stdout:4/299: truncate d3/d10/d39/f48 562004 0 2023-12-06T15:00:23.996 INFO:tasks.workunit.client.1.smithi190.stdout:4/300: readlink d3/d35/d19/l24 0 2023-12-06T15:00:23.996 INFO:tasks.workunit.client.0.smithi152.stdout:8/79: dwrite d1/d6/fd [4194304,4194304] 0 2023-12-06T15:00:23.996 INFO:tasks.workunit.client.0.smithi152.stdout:1/351: dread d3/da/f36 [0,4194304] 0 2023-12-06T15:00:23.997 INFO:tasks.workunit.client.0.smithi152.stdout:8/80: chown d1/d6 0 1 2023-12-06T15:00:23.997 INFO:tasks.workunit.client.1.smithi190.stdout:5/263: mknod d0/d1c/d2b/c55 0 2023-12-06T15:00:23.998 INFO:tasks.workunit.client.0.smithi152.stdout:1/352: symlink d3/da/d4c/d63/l89 0 2023-12-06T15:00:23.999 INFO:tasks.workunit.client.1.smithi190.stdout:0/301: rename d0/da/f22 to d0/da/d3e/d2b/d3c/d46/d61/f63 0 2023-12-06T15:00:23.999 INFO:tasks.workunit.client.1.smithi190.stdout:0/302: stat d0/da/d3e/c20 0 2023-12-06T15:00:24.000 INFO:tasks.workunit.client.0.smithi152.stdout:1/353: creat d3/da/d15/d17/d4d/f8a x:0 0 0 2023-12-06T15:00:24.000 INFO:tasks.workunit.client.0.smithi152.stdout:1/354: truncate d3/da/db/f53 900310 0 2023-12-06T15:00:24.001 INFO:tasks.workunit.client.1.smithi190.stdout:4/301: rename d3/d10/d15/l1b to d3/d35/d19/d41/l66 0 2023-12-06T15:00:24.001 INFO:tasks.workunit.client.0.smithi152.stdout:1/355: symlink d3/d44/l8b 0 2023-12-06T15:00:24.001 INFO:tasks.workunit.client.0.smithi152.stdout:1/356: chown d3/da/d15/d17/f41 253 1 2023-12-06T15:00:24.001 INFO:tasks.workunit.client.0.smithi152.stdout:1/357: chown d3/d44/f46 136947 1 2023-12-06T15:00:24.002 INFO:tasks.workunit.client.1.smithi190.stdout:0/303: mknod d0/da/d3e/d2b/d3c/c64 0 2023-12-06T15:00:24.002 INFO:tasks.workunit.client.0.smithi152.stdout:1/358: mknod d3/da/c8c 0 2023-12-06T15:00:24.002 INFO:tasks.workunit.client.0.smithi152.stdout:1/359: chown d3/da/d4c/d82/d52/d62/f72 2 1 2023-12-06T15:00:24.003 INFO:tasks.workunit.client.1.smithi190.stdout:0/304: mkdir d0/da/d3e/d2b/d3c/d65 0 2023-12-06T15:00:24.005 INFO:tasks.workunit.client.0.smithi152.stdout:1/360: creat d3/d44/f8d x:0 0 0 2023-12-06T15:00:24.005 INFO:tasks.workunit.client.1.smithi190.stdout:4/302: mkdir d3/d35/d19/d67 0 2023-12-06T15:00:24.005 INFO:tasks.workunit.client.1.smithi190.stdout:4/303: dread - d3/d35/d19/d30/d3c/f5a zero size 2023-12-06T15:00:24.007 INFO:tasks.workunit.client.1.smithi190.stdout:2/358: dwrite d10/f58 [0,4194304] 0 2023-12-06T15:00:24.007 INFO:tasks.workunit.client.1.smithi190.stdout:0/305: creat d0/da/d3e/f66 x:0 0 0 2023-12-06T15:00:24.008 INFO:tasks.workunit.client.0.smithi152.stdout:1/361: getdents d3/da/db/d54 0 2023-12-06T15:00:24.008 INFO:tasks.workunit.client.1.smithi190.stdout:4/304: unlink d3/d35/d19/d30/c31 0 2023-12-06T15:00:24.012 INFO:tasks.workunit.client.1.smithi190.stdout:7/404: dwrite d0/df/f42 [0,4194304] 0 2023-12-06T15:00:24.012 INFO:tasks.workunit.client.1.smithi190.stdout:7/405: stat d0/d5/da/d56 0 2023-12-06T15:00:24.012 INFO:tasks.workunit.client.1.smithi190.stdout:9/355: dwrite d4/d27/f49 [0,4194304] 0 2023-12-06T15:00:24.012 INFO:tasks.workunit.client.1.smithi190.stdout:2/359: unlink d10/d26/d5c/d37/f41 0 2023-12-06T15:00:24.012 INFO:tasks.workunit.client.0.smithi152.stdout:1/362: dread d3/da/d15/d17/d43/f83 [0,4194304] 0 2023-12-06T15:00:24.013 INFO:tasks.workunit.client.0.smithi152.stdout:1/363: fdatasync d3/da/f26 0 2023-12-06T15:00:24.014 INFO:tasks.workunit.client.1.smithi190.stdout:1/550: dread d6/dc/d3b/d78/d94/f54 [0,4194304] 0 2023-12-06T15:00:24.014 INFO:tasks.workunit.client.1.smithi190.stdout:1/551: write d6/dc/d3b/d78/d94/f87 [560107,72234] 0 2023-12-06T15:00:24.015 INFO:tasks.workunit.client.0.smithi152.stdout:1/364: rename d3/da/db/f6e to d3/da/d4c/d82/d52/f8e 0 2023-12-06T15:00:24.015 INFO:tasks.workunit.client.0.smithi152.stdout:1/365: getdents d3/da/d15/d17/d43/d7d 0 2023-12-06T15:00:24.017 INFO:tasks.workunit.client.0.smithi152.stdout:1/366: unlink d3/f5 0 2023-12-06T15:00:24.018 INFO:tasks.workunit.client.0.smithi152.stdout:1/367: dread d3/da/d15/d17/f70 [0,4194304] 0 2023-12-06T15:00:24.018 INFO:tasks.workunit.client.0.smithi152.stdout:1/368: write d3/da/d4c/d82/d52/f8e [218059,36121] 0 2023-12-06T15:00:24.018 INFO:tasks.workunit.client.0.smithi152.stdout:1/369: stat d3/da/d15/d17/d1a/f4e 0 2023-12-06T15:00:24.018 INFO:tasks.workunit.client.0.smithi152.stdout:1/370: readlink d3/da/d15/d17/d58/l6d 0 2023-12-06T15:00:24.029 INFO:tasks.workunit.client.0.smithi152.stdout:1/371: dread d3/da/db/f88 [0,4194304] 0 2023-12-06T15:00:24.030 INFO:tasks.workunit.client.0.smithi152.stdout:1/372: creat d3/da/d65/f8f x:0 0 0 2023-12-06T15:00:24.030 INFO:tasks.workunit.client.0.smithi152.stdout:1/373: write d3/da/d15/d17/d43/f66 [572943,86999] 0 2023-12-06T15:00:24.031 INFO:tasks.workunit.client.0.smithi152.stdout:1/374: read - d3/da/db/f81 zero size 2023-12-06T15:00:24.031 INFO:tasks.workunit.client.0.smithi152.stdout:8/81: dwrite d1/d6/fc [0,4194304] 0 2023-12-06T15:00:24.031 INFO:tasks.workunit.client.0.smithi152.stdout:1/375: unlink d3/da/d15/d17/d1a/f4e 0 2023-12-06T15:00:24.033 INFO:tasks.workunit.client.0.smithi152.stdout:1/376: rmdir d3/da/d4c/d82/d75 39 2023-12-06T15:00:24.033 INFO:tasks.workunit.client.0.smithi152.stdout:1/377: fsync d3/da/db/f4b 0 2023-12-06T15:00:24.034 INFO:tasks.workunit.client.0.smithi152.stdout:1/378: symlink d3/da/d15/l90 0 2023-12-06T15:00:24.035 INFO:tasks.workunit.client.1.smithi190.stdout:5/264: dwrite d0/d1c/d2b/d2c/f43 [0,4194304] 0 2023-12-06T15:00:24.035 INFO:tasks.workunit.client.1.smithi190.stdout:0/306: dwrite d0/da/d3e/d3a/d40/f48 [0,4194304] 0 2023-12-06T15:00:24.035 INFO:tasks.workunit.client.1.smithi190.stdout:0/307: chown d0/da/d3e/d3a/d40 21 1 2023-12-06T15:00:24.035 INFO:tasks.workunit.client.1.smithi190.stdout:0/308: fdatasync d0/da/d3e/d2b/d3c/d4c/f59 0 2023-12-06T15:00:24.037 INFO:tasks.workunit.client.0.smithi152.stdout:1/379: rename d3/da/db/f88 to d3/da/d15/d17/d43/f91 0 2023-12-06T15:00:24.039 INFO:tasks.workunit.client.0.smithi152.stdout:8/82: dread d1/d6/d7/fa [4194304,4194304] 0 2023-12-06T15:00:24.048 INFO:tasks.workunit.client.0.smithi152.stdout:1/380: dread d3/da/db/f4b [0,4194304] 0 2023-12-06T15:00:24.049 INFO:tasks.workunit.client.0.smithi152.stdout:1/381: truncate d3/da/d15/d17/f42 751571 0 2023-12-06T15:00:24.051 INFO:tasks.workunit.client.0.smithi152.stdout:1/382: rename d3/da/d65/f68 to d3/da/db/d54/f92 0 2023-12-06T15:00:24.056 INFO:tasks.workunit.client.0.smithi152.stdout:8/83: dwrite d1/d6/db/f11 [0,4194304] 0 2023-12-06T15:00:24.059 INFO:tasks.workunit.client.0.smithi152.stdout:8/84: link d1/d6/d7/c13 d1/d6/d7/c19 0 2023-12-06T15:00:24.063 INFO:tasks.workunit.client.0.smithi152.stdout:8/85: write d1/d6/fc [1910283,113556] 0 2023-12-06T15:00:24.063 INFO:tasks.workunit.client.0.smithi152.stdout:8/86: write d1/d6/db/f17 [1007934,122674] 0 2023-12-06T15:00:24.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:23 smithi190 ceph-mon[121340]: pgmap v23: 65 pgs: 65 active+clean; 479 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 21 MiB/s rd, 36 MiB/s wr, 98 op/s 2023-12-06T15:00:24.072 INFO:tasks.workunit.client.0.smithi152.stdout:1/383: dwrite d3/da/d15/f7e [0,4194304] 0 2023-12-06T15:00:24.076 INFO:tasks.workunit.client.0.smithi152.stdout:1/384: creat d3/da/d15/d17/d58/f93 x:0 0 0 2023-12-06T15:00:24.080 INFO:tasks.workunit.client.0.smithi152.stdout:8/87: dwrite d1/d6/fd [0,4194304] 0 2023-12-06T15:00:24.080 INFO:tasks.workunit.client.0.smithi152.stdout:8/88: write d1/d6/db/f14 [403269,116194] 0 2023-12-06T15:00:24.082 INFO:tasks.workunit.client.1.smithi190.stdout:7/406: link d0/f34 d0/d5/d1b/d33/f80 0 2023-12-06T15:00:24.085 INFO:tasks.workunit.client.0.smithi152.stdout:8/89: write d1/d6/d7/fa [3943729,91165] 0 2023-12-06T15:00:24.088 INFO:tasks.workunit.client.1.smithi190.stdout:2/360: mknod d10/d26/d5c/d49/c7b 0 2023-12-06T15:00:24.088 INFO:tasks.workunit.client.1.smithi190.stdout:9/356: link d4/l34 d4/d27/d2f/d31/d3f/l7b 0 2023-12-06T15:00:24.088 INFO:tasks.workunit.client.1.smithi190.stdout:9/357: truncate d4/d27/f4d 998755 0 2023-12-06T15:00:24.092 INFO:tasks.workunit.client.1.smithi190.stdout:1/552: rmdir d6/dc/d29/d38/d43/d7f/d81 39 2023-12-06T15:00:24.093 INFO:tasks.workunit.client.1.smithi190.stdout:8/334: getdents d1/d20/d3b/d4c/d5a 0 2023-12-06T15:00:24.096 INFO:tasks.workunit.client.1.smithi190.stdout:4/305: rename d3/d35/f22 to d3/d35/d19/f68 0 2023-12-06T15:00:24.098 INFO:tasks.workunit.client.1.smithi190.stdout:5/265: link d0/d1c/d2b/f32 d0/df/f56 0 2023-12-06T15:00:24.099 INFO:tasks.workunit.client.1.smithi190.stdout:5/266: write d0/d1c/d2b/d2c/f45 [288143,103600] 0 2023-12-06T15:00:24.103 INFO:tasks.workunit.client.0.smithi152.stdout:1/385: dwrite d3/da/d4c/d82/d52/d55/f56 [0,4194304] 0 2023-12-06T15:00:24.103 INFO:tasks.workunit.client.0.smithi152.stdout:1/386: readlink d3/da/db/l51 0 2023-12-06T15:00:24.103 INFO:tasks.workunit.client.1.smithi190.stdout:7/407: dwrite d0/f3 [0,4194304] 0 2023-12-06T15:00:24.104 INFO:tasks.workunit.client.0.smithi152.stdout:1/387: link d3/da/d4c/d82/c80 d3/da/d4c/d85/c94 0 2023-12-06T15:00:24.105 INFO:tasks.workunit.client.0.smithi152.stdout:1/388: write d3/da/db/f11 [3342331,34335] 0 2023-12-06T15:00:24.105 INFO:tasks.workunit.client.1.smithi190.stdout:7/408: write d0/df/f45 [4081321,4205] 0 2023-12-06T15:00:24.105 INFO:tasks.workunit.client.1.smithi190.stdout:7/409: truncate d0/d5/d1b/d33/f80 112389 0 2023-12-06T15:00:24.106 INFO:tasks.workunit.client.1.smithi190.stdout:9/358: dwrite d4/f33 [0,4194304] 0 2023-12-06T15:00:24.106 INFO:tasks.workunit.client.0.smithi152.stdout:1/389: truncate d3/da/f26 3526436 0 2023-12-06T15:00:24.107 INFO:tasks.workunit.client.0.smithi152.stdout:1/390: write d3/da/d65/f8f [597939,82193] 0 2023-12-06T15:00:24.109 INFO:tasks.workunit.client.1.smithi190.stdout:2/361: mknod d10/d59/d5e/c7c 0 2023-12-06T15:00:24.111 INFO:tasks.workunit.client.1.smithi190.stdout:1/553: link d6/dc/d6f/c71 d6/d49/caf 0 2023-12-06T15:00:24.111 INFO:tasks.workunit.client.1.smithi190.stdout:1/554: readlink d6/dc/d29/d38/d73/d76/l92 0 2023-12-06T15:00:24.112 INFO:tasks.workunit.client.0.smithi152.stdout:8/90: dread d1/d6/db/f14 [0,4194304] 0 2023-12-06T15:00:24.114 INFO:tasks.workunit.client.0.smithi152.stdout:8/91: creat d1/d6/d7/f1a x:0 0 0 2023-12-06T15:00:24.116 INFO:tasks.workunit.client.1.smithi190.stdout:8/335: link d1/f1b d1/d20/d3b/d4c/d5a/f66 0 2023-12-06T15:00:24.119 INFO:tasks.workunit.client.1.smithi190.stdout:5/267: mknod d0/d1c/d2b/c57 0 2023-12-06T15:00:24.120 INFO:tasks.workunit.client.1.smithi190.stdout:5/268: read d0/df/f56 [227072,83442] 0 2023-12-06T15:00:24.121 INFO:tasks.workunit.client.1.smithi190.stdout:2/362: dread d10/d26/d5c/d37/f38 [0,4194304] 0 2023-12-06T15:00:24.121 INFO:tasks.workunit.client.1.smithi190.stdout:9/359: symlink d4/d27/d2f/l7c 0 2023-12-06T15:00:24.123 INFO:tasks.workunit.client.1.smithi190.stdout:1/555: getdents d6/dc/d29/d38/d73/d76 0 2023-12-06T15:00:24.125 INFO:tasks.workunit.client.0.smithi152.stdout:1/391: dwrite d3/da/db/f48 [0,4194304] 0 2023-12-06T15:00:24.125 INFO:tasks.workunit.client.1.smithi190.stdout:7/410: dwrite d0/d5/d1b/f2e [4194304,4194304] 0 2023-12-06T15:00:24.125 INFO:tasks.workunit.client.1.smithi190.stdout:0/309: rename d0/c23 to d0/da/c67 0 2023-12-06T15:00:24.127 INFO:tasks.workunit.client.0.smithi152.stdout:8/92: fdatasync d1/d6/d7/fa 0 2023-12-06T15:00:24.127 INFO:tasks.workunit.client.0.smithi152.stdout:8/93: chown d1/d6/db/f14 3235277 1 2023-12-06T15:00:24.127 INFO:tasks.workunit.client.0.smithi152.stdout:8/94: chown d1/d6/fd 9588519 1 2023-12-06T15:00:24.127 INFO:tasks.workunit.client.0.smithi152.stdout:1/392: link d3/d44/f46 d3/da/d4c/d63/f95 0 2023-12-06T15:00:24.128 INFO:tasks.workunit.client.0.smithi152.stdout:8/95: write d1/f2 [3996631,53100] 0 2023-12-06T15:00:24.128 INFO:tasks.workunit.client.0.smithi152.stdout:8/96: readlink d1/d6/db/l12 0 2023-12-06T15:00:24.129 INFO:tasks.workunit.client.0.smithi152.stdout:1/393: truncate d3/da/f26 2960208 0 2023-12-06T15:00:24.129 INFO:tasks.workunit.client.1.smithi190.stdout:2/363: symlink d10/d26/d5c/d49/d54/l7d 0 2023-12-06T15:00:24.129 INFO:tasks.workunit.client.1.smithi190.stdout:2/364: readlink d10/d26/d5c/d35/l5f 0 2023-12-06T15:00:24.130 INFO:tasks.workunit.client.1.smithi190.stdout:9/360: mkdir d4/d27/d2f/d31/d3f/d58/d7d 0 2023-12-06T15:00:24.130 INFO:tasks.workunit.client.0.smithi152.stdout:1/394: mkdir d3/da/d4c/d63/d96 0 2023-12-06T15:00:24.131 INFO:tasks.workunit.client.0.smithi152.stdout:1/395: creat d3/da/db/f97 x:0 0 0 2023-12-06T15:00:24.131 INFO:tasks.workunit.client.0.smithi152.stdout:1/396: chown d3/da/f26 326166646 1 2023-12-06T15:00:24.131 INFO:tasks.workunit.client.0.smithi152.stdout:1/397: read d3/da/d65/f77 [628747,31894] 0 2023-12-06T15:00:24.133 INFO:tasks.workunit.client.0.smithi152.stdout:1/398: creat d3/da/d15/d17/d43/d7d/f98 x:0 0 0 2023-12-06T15:00:24.133 INFO:tasks.workunit.client.0.smithi152.stdout:1/399: chown d3/da/d15/d17/d43/c6c 10924923 1 2023-12-06T15:00:24.133 INFO:tasks.workunit.client.0.smithi152.stdout:1/400: truncate d3/da/db/f4b 3325840 0 2023-12-06T15:00:24.133 INFO:tasks.workunit.client.1.smithi190.stdout:1/556: rename d6/dc/f46 to d6/dc/d3b/d78/fb0 0 2023-12-06T15:00:24.133 INFO:tasks.workunit.client.1.smithi190.stdout:1/557: truncate d6/d49/f68 1587276 0 2023-12-06T15:00:24.133 INFO:tasks.workunit.client.1.smithi190.stdout:1/558: truncate d6/dc/d3b/d78/fb0 264231 0 2023-12-06T15:00:24.134 INFO:tasks.workunit.client.1.smithi190.stdout:5/269: getdents d0/df 0 2023-12-06T15:00:24.134 INFO:tasks.workunit.client.1.smithi190.stdout:5/270: write d0/df/f41 [751556,769] 0 2023-12-06T15:00:24.135 INFO:tasks.workunit.client.0.smithi152.stdout:1/401: mknod d3/da/d4c/d85/c99 0 2023-12-06T15:00:24.135 INFO:tasks.workunit.client.1.smithi190.stdout:0/310: rename d0/c5 to d0/c68 0 2023-12-06T15:00:24.136 INFO:tasks.workunit.client.1.smithi190.stdout:9/361: symlink d4/d27/d2f/d66/l7e 0 2023-12-06T15:00:24.139 INFO:tasks.workunit.client.1.smithi190.stdout:1/559: rename d6/dc/d29/d38/d39/ca1 to d6/dc/d6f/cb1 0 2023-12-06T15:00:24.139 INFO:tasks.workunit.client.1.smithi190.stdout:1/560: fsync d6/dc/d29/d38/d39/f3e 0 2023-12-06T15:00:24.140 INFO:tasks.workunit.client.0.smithi152.stdout:3/196: sync 2023-12-06T15:00:24.140 INFO:tasks.workunit.client.0.smithi152.stdout:3/197: fsync f2 0 2023-12-06T15:00:24.140 INFO:tasks.workunit.client.0.smithi152.stdout:1/402: dread d3/da/d15/d17/f4f [0,4194304] 0 2023-12-06T15:00:24.140 INFO:tasks.workunit.client.0.smithi152.stdout:6/249: sync 2023-12-06T15:00:24.140 INFO:tasks.workunit.client.1.smithi190.stdout:5/271: creat d0/d12/f58 x:0 0 0 2023-12-06T15:00:24.141 INFO:tasks.workunit.client.1.smithi190.stdout:8/336: dwrite d1/d10/d1c/f64 [0,4194304] 0 2023-12-06T15:00:24.141 INFO:tasks.workunit.client.0.smithi152.stdout:3/198: creat d9/f38 x:0 0 0 2023-12-06T15:00:24.141 INFO:tasks.workunit.client.0.smithi152.stdout:3/199: chown d9/d10/d12/l34 3 1 2023-12-06T15:00:24.141 INFO:tasks.workunit.client.0.smithi152.stdout:3/200: fdatasync d9/ff 0 2023-12-06T15:00:24.142 INFO:tasks.workunit.client.0.smithi152.stdout:8/97: dread d1/d6/db/f11 [0,4194304] 0 2023-12-06T15:00:24.142 INFO:tasks.workunit.client.1.smithi190.stdout:7/411: dread d0/d5/d1b/d1c/f28 [0,4194304] 0 2023-12-06T15:00:24.142 INFO:tasks.workunit.client.0.smithi152.stdout:6/250: creat d1/d5/d15/f5c x:0 0 0 2023-12-06T15:00:24.143 INFO:tasks.workunit.client.1.smithi190.stdout:0/311: creat d0/da/d3e/d2b/f69 x:0 0 0 2023-12-06T15:00:24.144 INFO:tasks.workunit.client.0.smithi152.stdout:3/201: dread d9/ff [0,4194304] 0 2023-12-06T15:00:24.144 INFO:tasks.workunit.client.0.smithi152.stdout:3/202: truncate d9/f38 647740 0 2023-12-06T15:00:24.144 INFO:tasks.workunit.client.0.smithi152.stdout:3/203: dread - d9/d10/d12/f30 zero size 2023-12-06T15:00:24.144 INFO:tasks.workunit.client.0.smithi152.stdout:3/204: stat c8 0 2023-12-06T15:00:24.144 INFO:tasks.workunit.client.0.smithi152.stdout:3/205: write d9/d10/f2e [856367,56791] 0 2023-12-06T15:00:24.144 INFO:tasks.workunit.client.1.smithi190.stdout:9/362: creat d4/d27/d2f/d31/d3f/d58/d72/d7a/f7f x:0 0 0 2023-12-06T15:00:24.144 INFO:tasks.workunit.client.1.smithi190.stdout:9/363: readlink d4/d27/d2f/d31/d3f/l62 0 2023-12-06T15:00:24.144 INFO:tasks.workunit.client.1.smithi190.stdout:9/364: chown d4/f25 4286968 1 2023-12-06T15:00:24.145 INFO:tasks.workunit.client.1.smithi190.stdout:1/561: getdents d6/dc/d29/d38/d43/d7f 0 2023-12-06T15:00:24.145 INFO:tasks.workunit.client.0.smithi152.stdout:6/251: unlink d1/d5/fa 0 2023-12-06T15:00:24.146 INFO:tasks.workunit.client.1.smithi190.stdout:5/272: link d0/d1c/d2b/c57 d0/d1c/d3e/c59 0 2023-12-06T15:00:24.146 INFO:tasks.workunit.client.1.smithi190.stdout:3/487: sync 2023-12-06T15:00:24.147 INFO:tasks.workunit.client.0.smithi152.stdout:3/206: mkdir d9/d18/d39 0 2023-12-06T15:00:24.152 INFO:tasks.workunit.client.1.smithi190.stdout:1/562: dread d6/dc/d3b/d78/f9a [0,4194304] 0 2023-12-06T15:00:24.152 INFO:tasks.workunit.client.0.smithi152.stdout:6/252: stat d1/d19/l3f 0 2023-12-06T15:00:24.156 INFO:tasks.workunit.client.0.smithi152.stdout:1/403: dread d3/f1c [0,4194304] 0 2023-12-06T15:00:24.156 INFO:tasks.workunit.client.0.smithi152.stdout:3/207: link d9/d10/d12/f30 d9/d10/d12/f3a 0 2023-12-06T15:00:24.157 INFO:tasks.workunit.client.1.smithi190.stdout:7/412: symlink d0/d5/d1b/d32/l81 0 2023-12-06T15:00:24.157 INFO:tasks.workunit.client.1.smithi190.stdout:7/413: write d0/df/d1f/f46 [880076,22091] 0 2023-12-06T15:00:24.160 INFO:tasks.workunit.client.1.smithi190.stdout:0/312: symlink d0/da/d3e/d2b/d3c/l6a 0 2023-12-06T15:00:24.160 INFO:tasks.workunit.client.1.smithi190.stdout:9/365: creat d4/d27/d2f/d31/d3f/d58/d72/f80 x:0 0 0 2023-12-06T15:00:24.161 INFO:tasks.workunit.client.0.smithi152.stdout:1/404: rmdir d3/da/d65 39 2023-12-06T15:00:24.161 INFO:tasks.workunit.client.0.smithi152.stdout:1/405: chown d3/da/d15/d17/d58/f64 21927 1 2023-12-06T15:00:24.161 INFO:tasks.workunit.client.1.smithi190.stdout:3/488: creat d4/d1b/d54/d9c/fb2 x:0 0 0 2023-12-06T15:00:24.162 INFO:tasks.workunit.client.0.smithi152.stdout:3/208: mknod d9/d10/d32/c3b 0 2023-12-06T15:00:24.163 INFO:tasks.workunit.client.1.smithi190.stdout:1/563: rmdir d6/d49/daa 0 2023-12-06T15:00:24.164 INFO:tasks.workunit.client.1.smithi190.stdout:9/366: mknod d4/d27/c81 0 2023-12-06T15:00:24.165 INFO:tasks.workunit.client.1.smithi190.stdout:3/489: stat d4/d1b/c9d 0 2023-12-06T15:00:24.165 INFO:tasks.workunit.client.1.smithi190.stdout:3/490: truncate d4/d1b/d54/f60 866311 0 2023-12-06T15:00:24.165 INFO:tasks.workunit.client.1.smithi190.stdout:3/491: chown d4/d1b/d69/f6f 342 1 2023-12-06T15:00:24.166 INFO:tasks.workunit.client.1.smithi190.stdout:9/367: rmdir d4/d27/d2f/d31/d3f 39 2023-12-06T15:00:24.166 INFO:tasks.workunit.client.0.smithi152.stdout:3/209: write d9/d18/f24 [1588225,37718] 0 2023-12-06T15:00:24.166 INFO:tasks.workunit.client.0.smithi152.stdout:3/210: readlink d9/d18/l20 0 2023-12-06T15:00:24.166 INFO:tasks.workunit.client.1.smithi190.stdout:0/313: write d0/f2e [1462755,96384] 0 2023-12-06T15:00:24.167 INFO:tasks.workunit.client.1.smithi190.stdout:3/492: link d4/d70/d53/d56/d94/l32 d4/d1b/d77/lb3 0 2023-12-06T15:00:24.167 INFO:tasks.workunit.client.0.smithi152.stdout:8/98: dread d1/d6/fd [4194304,4194304] 0 2023-12-06T15:00:24.168 INFO:tasks.workunit.client.0.smithi152.stdout:3/211: creat d9/d18/f3c x:0 0 0 2023-12-06T15:00:24.168 INFO:tasks.workunit.client.0.smithi152.stdout:3/212: readlink d9/d18/d1a/l2b 0 2023-12-06T15:00:24.168 INFO:tasks.workunit.client.0.smithi152.stdout:3/213: chown f2 361 1 2023-12-06T15:00:24.168 INFO:tasks.workunit.client.0.smithi152.stdout:3/214: fsync d9/d10/d19/f33 0 2023-12-06T15:00:24.169 INFO:tasks.workunit.client.0.smithi152.stdout:3/215: rmdir d9/d18/d1a 39 2023-12-06T15:00:24.169 INFO:tasks.workunit.client.1.smithi190.stdout:9/368: creat d4/d27/d2f/d5c/f82 x:0 0 0 2023-12-06T15:00:24.169 INFO:tasks.workunit.client.1.smithi190.stdout:9/369: fsync d4/d27/d2f/d31/f38 0 2023-12-06T15:00:24.171 INFO:tasks.workunit.client.1.smithi190.stdout:0/314: symlink d0/da/d3e/d2b/d3c/l6b 0 2023-12-06T15:00:24.171 INFO:tasks.workunit.client.1.smithi190.stdout:4/306: write d3/d35/d19/d30/d3c/f49 [1696909,31269] 0 2023-12-06T15:00:24.172 INFO:tasks.workunit.client.1.smithi190.stdout:1/564: write d6/dc/f33 [132701,33552] 0 2023-12-06T15:00:24.172 INFO:tasks.workunit.client.1.smithi190.stdout:3/493: mknod d4/d70/d33/d45/cb4 0 2023-12-06T15:00:24.172 INFO:tasks.workunit.client.1.smithi190.stdout:3/494: write d4/d1b/d54/d9c/f99 [122749,106553] 0 2023-12-06T15:00:24.174 INFO:tasks.workunit.client.1.smithi190.stdout:4/307: dread d3/d35/d19/f5e [0,4194304] 0 2023-12-06T15:00:24.175 INFO:tasks.workunit.client.1.smithi190.stdout:9/370: creat d4/d27/d2f/d66/f83 x:0 0 0 2023-12-06T15:00:24.178 INFO:tasks.workunit.client.1.smithi190.stdout:1/565: rename d6/dc/d29/d38/d43/fa6 to d6/dc/d29/fb2 0 2023-12-06T15:00:24.181 INFO:tasks.workunit.client.1.smithi190.stdout:1/566: creat d6/dc/d29/d38/d73/d76/fb3 x:0 0 0 2023-12-06T15:00:24.182 INFO:tasks.workunit.client.1.smithi190.stdout:1/567: mknod d6/dc/d29/cb4 0 2023-12-06T15:00:24.182 INFO:tasks.workunit.client.1.smithi190.stdout:1/568: write d6/dc/d29/d38/d73/d5c/fa3 [411736,67346] 0 2023-12-06T15:00:24.182 INFO:tasks.workunit.client.1.smithi190.stdout:1/569: chown d6/dc/d3b/l5e 1753572 1 2023-12-06T15:00:24.183 INFO:tasks.workunit.client.1.smithi190.stdout:3/495: write d4/d70/d19/f7c [3608650,81066] 0 2023-12-06T15:00:24.183 INFO:tasks.workunit.client.1.smithi190.stdout:3/496: stat d4/d1b/d54/d9c/d68/f92 0 2023-12-06T15:00:24.183 INFO:tasks.workunit.client.1.smithi190.stdout:3/497: write d4/d70/d33/d45/fac [601106,13631] 0 2023-12-06T15:00:24.184 INFO:tasks.workunit.client.1.smithi190.stdout:8/337: dwrite d1/d20/d3b/d36/f3e [0,4194304] 0 2023-12-06T15:00:24.185 INFO:tasks.workunit.client.1.smithi190.stdout:1/570: rename d6/dc/d29/d38/d43/d7f/d81 to d6/dc/d29/d38/d73/d5c/db5 0 2023-12-06T15:00:24.185 INFO:tasks.workunit.client.1.smithi190.stdout:3/498: truncate d4/f5 3035402 0 2023-12-06T15:00:24.186 INFO:tasks.workunit.client.1.smithi190.stdout:3/499: fsync d4/d70/d19/d3a/d3b/f55 0 2023-12-06T15:00:24.188 INFO:tasks.workunit.client.1.smithi190.stdout:0/315: dread d0/f11 [0,4194304] 0 2023-12-06T15:00:24.188 INFO:tasks.workunit.client.1.smithi190.stdout:1/571: rename d6/dc/d29/d38/d43/d7f/da7/cae to d6/dc/d29/d38/d43/d7f/d95/cb6 0 2023-12-06T15:00:24.188 INFO:tasks.workunit.client.1.smithi190.stdout:5/273: dwrite d0/f6 [4194304,4194304] 0 2023-12-06T15:00:24.188 INFO:tasks.workunit.client.1.smithi190.stdout:5/274: fsync d0/df/f41 0 2023-12-06T15:00:24.188 INFO:tasks.workunit.client.1.smithi190.stdout:5/275: chown d0/d12 15564874 1 2023-12-06T15:00:24.188 INFO:tasks.workunit.client.1.smithi190.stdout:5/276: stat d0/d1c/d3e 0 2023-12-06T15:00:24.188 INFO:tasks.workunit.client.1.smithi190.stdout:5/277: write d0/f53 [58341,122314] 0 2023-12-06T15:00:24.189 INFO:tasks.workunit.client.1.smithi190.stdout:3/500: mkdir d4/d70/d7f/db5 0 2023-12-06T15:00:24.191 INFO:tasks.workunit.client.1.smithi190.stdout:8/338: write d1/d10/d1c/f22 [3702237,99637] 0 2023-12-06T15:00:24.192 INFO:tasks.workunit.client.1.smithi190.stdout:3/501: read d4/d70/d33/d45/f98 [1056875,65086] 0 2023-12-06T15:00:24.198 INFO:tasks.workunit.client.0.smithi152.stdout:1/406: dwrite d3/da/db/f48 [0,4194304] 0 2023-12-06T15:00:24.199 INFO:tasks.workunit.client.0.smithi152.stdout:6/253: dwrite d1/d19/d1a/f21 [0,4194304] 0 2023-12-06T15:00:24.201 INFO:tasks.workunit.client.0.smithi152.stdout:6/254: creat d1/d19/d1a/d30/d36/d4e/d55/f5d x:0 0 0 2023-12-06T15:00:24.202 INFO:tasks.workunit.client.0.smithi152.stdout:6/255: truncate d1/d5/d15/f5c 758502 0 2023-12-06T15:00:24.202 INFO:tasks.workunit.client.0.smithi152.stdout:6/256: fsync d1/d19/d1a/f21 0 2023-12-06T15:00:24.202 INFO:tasks.workunit.client.1.smithi190.stdout:1/572: truncate d6/dc/d29/d38/d39/d63/d67/f7d 746508 0 2023-12-06T15:00:24.203 INFO:tasks.workunit.client.0.smithi152.stdout:1/407: write d3/da/d15/d17/d1a/f38 [1066119,19965] 0 2023-12-06T15:00:24.203 INFO:tasks.workunit.client.0.smithi152.stdout:1/408: write d3/da/d15/d17/d43/d7d/f98 [621161,21474] 0 2023-12-06T15:00:24.203 INFO:tasks.workunit.client.0.smithi152.stdout:1/409: fdatasync d3/da/d15/f5e 0 2023-12-06T15:00:24.203 INFO:tasks.workunit.client.0.smithi152.stdout:1/410: write d3/f7 [1988518,11084] 0 2023-12-06T15:00:24.203 INFO:tasks.workunit.client.0.smithi152.stdout:1/411: dread - d3/da/db/f81 zero size 2023-12-06T15:00:24.205 INFO:tasks.workunit.client.0.smithi152.stdout:6/257: dread d1/d5/f44 [0,4194304] 0 2023-12-06T15:00:24.205 INFO:tasks.workunit.client.0.smithi152.stdout:6/258: chown d1 934 1 2023-12-06T15:00:24.205 INFO:tasks.workunit.client.0.smithi152.stdout:6/259: dread - d1/f2c zero size 2023-12-06T15:00:24.205 INFO:tasks.workunit.client.0.smithi152.stdout:6/260: getdents d1/d19/d1a/d30/d36/d35/d49/d50 0 2023-12-06T15:00:24.206 INFO:tasks.workunit.client.0.smithi152.stdout:1/412: creat d3/da/d4c/d82/d52/d55/f9a x:0 0 0 2023-12-06T15:00:24.206 INFO:tasks.workunit.client.0.smithi152.stdout:1/413: write d3/da/d15/d17/d43/f66 [1164573,125914] 0 2023-12-06T15:00:24.206 INFO:tasks.workunit.client.0.smithi152.stdout:1/414: readlink d3/da/d4c/d82/d52/l61 0 2023-12-06T15:00:24.206 INFO:tasks.workunit.client.0.smithi152.stdout:1/415: write d3/da/d15/d17/f60 [364343,25272] 0 2023-12-06T15:00:24.206 INFO:tasks.workunit.client.1.smithi190.stdout:5/278: unlink d0/d1c/f37 0 2023-12-06T15:00:24.207 INFO:tasks.workunit.client.1.smithi190.stdout:8/339: truncate d1/d10/d25/f2a 291265 0 2023-12-06T15:00:24.207 INFO:tasks.workunit.client.1.smithi190.stdout:1/573: mkdir d6/dc/d29/d38/d43/db7 0 2023-12-06T15:00:24.207 INFO:tasks.workunit.client.1.smithi190.stdout:1/574: chown d6/dc/d29/d38/d73/d76/fb3 2 1 2023-12-06T15:00:24.207 INFO:tasks.workunit.client.0.smithi152.stdout:1/416: rename d3/da/d15/d17/d4d/f76 to d3/d44/d84/f9b 0 2023-12-06T15:00:24.211 INFO:tasks.workunit.client.1.smithi190.stdout:5/279: mkdir d0/d1c/d3e/d5a 0 2023-12-06T15:00:24.213 INFO:tasks.workunit.client.1.smithi190.stdout:8/340: rmdir d1/d37/d5c 0 2023-12-06T15:00:24.216 INFO:tasks.workunit.client.1.smithi190.stdout:6/429: sync 2023-12-06T15:00:24.217 INFO:tasks.workunit.client.0.smithi152.stdout:8/99: dwrite d1/d6/db/f11 [0,4194304] 0 2023-12-06T15:00:24.219 INFO:tasks.workunit.client.1.smithi190.stdout:6/430: mkdir d4/d12/d1a/d8c 0 2023-12-06T15:00:24.219 INFO:tasks.workunit.client.0.smithi152.stdout:3/216: dwrite d9/d10/d19/f2c [8388608,4194304] 0 2023-12-06T15:00:24.219 INFO:tasks.workunit.client.0.smithi152.stdout:3/217: dread - d9/d10/d12/f31 zero size 2023-12-06T15:00:24.219 INFO:tasks.workunit.client.0.smithi152.stdout:3/218: readlink d9/d18/d1a/l2b 0 2023-12-06T15:00:24.219 INFO:tasks.workunit.client.0.smithi152.stdout:8/100: write d1/f10 [1572988,49306] 0 2023-12-06T15:00:24.220 INFO:tasks.workunit.client.0.smithi152.stdout:6/261: dread d1/f13 [8388608,4194304] 0 2023-12-06T15:00:24.220 INFO:tasks.workunit.client.0.smithi152.stdout:6/262: dread - d1/d19/d1a/f54 zero size 2023-12-06T15:00:24.220 INFO:tasks.workunit.client.1.smithi190.stdout:6/431: symlink d4/d12/d40/d43/l8d 0 2023-12-06T15:00:24.220 INFO:tasks.workunit.client.1.smithi190.stdout:6/432: fdatasync d4/d12/d40/d43/d45/d4a/d77/f85 0 2023-12-06T15:00:24.221 INFO:tasks.workunit.client.1.smithi190.stdout:6/433: mknod d4/d12/d1a/d70/c8e 0 2023-12-06T15:00:24.221 INFO:tasks.workunit.client.1.smithi190.stdout:6/434: getdents d4/d12/d1a/d8a 0 2023-12-06T15:00:24.221 INFO:tasks.workunit.client.1.smithi190.stdout:6/435: chown d4/d12/d40/d43/d45/d4a/d77 178498446 1 2023-12-06T15:00:24.222 INFO:tasks.workunit.client.1.smithi190.stdout:6/436: chown d4/d12/d1a/d32/l61 591 1 2023-12-06T15:00:24.223 INFO:tasks.workunit.client.1.smithi190.stdout:6/437: creat d4/d12/d1a/d44/f8f x:0 0 0 2023-12-06T15:00:24.224 INFO:tasks.workunit.client.0.smithi152.stdout:8/101: truncate d1/f2 4271638 0 2023-12-06T15:00:24.225 INFO:tasks.workunit.client.1.smithi190.stdout:9/371: dwrite d4/d27/d2f/f5e [0,4194304] 0 2023-12-06T15:00:24.225 INFO:tasks.workunit.client.0.smithi152.stdout:6/263: getdents d1 0 2023-12-06T15:00:24.227 INFO:tasks.workunit.client.0.smithi152.stdout:8/102: dread d1/d6/db/f14 [0,4194304] 0 2023-12-06T15:00:24.228 INFO:tasks.workunit.client.0.smithi152.stdout:6/264: creat d1/d19/d1a/d30/d36/d4e/f5e x:0 0 0 2023-12-06T15:00:24.228 INFO:tasks.workunit.client.1.smithi190.stdout:5/280: dread d0/fd [0,4194304] 0 2023-12-06T15:00:24.229 INFO:tasks.workunit.client.1.smithi190.stdout:5/281: getdents d0/d1c/d3e/d5a 0 2023-12-06T15:00:24.229 INFO:tasks.workunit.client.0.smithi152.stdout:8/103: creat d1/d6/f1b x:0 0 0 2023-12-06T15:00:24.229 INFO:tasks.workunit.client.0.smithi152.stdout:8/104: readlink d1/d6/d7/l16 0 2023-12-06T15:00:24.230 INFO:tasks.workunit.client.0.smithi152.stdout:6/265: creat d1/d3c/f5f x:0 0 0 2023-12-06T15:00:24.231 INFO:tasks.workunit.client.1.smithi190.stdout:5/282: mknod d0/d1c/d2b/d2c/c5b 0 2023-12-06T15:00:24.231 INFO:tasks.workunit.client.1.smithi190.stdout:5/283: chown d0/d1c/f35 0 1 2023-12-06T15:00:24.231 INFO:tasks.workunit.client.1.smithi190.stdout:1/575: fsync d6/dc/d29/d38/d73/d76/fb3 0 2023-12-06T15:00:24.232 INFO:tasks.workunit.client.0.smithi152.stdout:6/266: symlink d1/d1c/l60 0 2023-12-06T15:00:24.233 INFO:tasks.workunit.client.1.smithi190.stdout:1/576: mknod d6/dc/d29/d38/d73/d5c/cb8 0 2023-12-06T15:00:24.233 INFO:tasks.workunit.client.1.smithi190.stdout:6/438: dread d4/f83 [0,4194304] 0 2023-12-06T15:00:24.237 INFO:tasks.workunit.client.0.smithi152.stdout:1/417: dwrite d3/d44/f46 [0,4194304] 0 2023-12-06T15:00:24.237 INFO:tasks.workunit.client.0.smithi152.stdout:1/418: write d3/d44/d84/f9b [156891,106094] 0 2023-12-06T15:00:24.238 INFO:tasks.workunit.client.0.smithi152.stdout:1/419: write d3/da/db/d54/f6a [336866,58999] 0 2023-12-06T15:00:24.238 INFO:tasks.workunit.client.1.smithi190.stdout:6/439: unlink d4/c3a 0 2023-12-06T15:00:24.238 INFO:tasks.workunit.client.1.smithi190.stdout:0/316: dwrite d0/da/f44 [0,4194304] 0 2023-12-06T15:00:24.238 INFO:tasks.workunit.client.1.smithi190.stdout:0/317: stat d0/da/d3e/d3a/l56 0 2023-12-06T15:00:24.239 INFO:tasks.workunit.client.1.smithi190.stdout:3/502: dwrite d4/d1b/d54/d9c/f4f [0,4194304] 0 2023-12-06T15:00:24.239 INFO:tasks.workunit.client.0.smithi152.stdout:3/219: dwrite d9/d10/f28 [0,4194304] 0 2023-12-06T15:00:24.239 INFO:tasks.workunit.client.0.smithi152.stdout:8/105: write d1/d6/db/f11 [2027687,54814] 0 2023-12-06T15:00:24.241 INFO:tasks.workunit.client.1.smithi190.stdout:9/372: dread d4/f11 [0,4194304] 0 2023-12-06T15:00:24.245 INFO:tasks.workunit.client.0.smithi152.stdout:6/267: dread d1/f13 [4194304,4194304] 0 2023-12-06T15:00:24.245 INFO:tasks.workunit.client.0.smithi152.stdout:6/268: fdatasync d1/d5/f44 0 2023-12-06T15:00:24.246 INFO:tasks.workunit.client.0.smithi152.stdout:6/269: read d1/d5/f46 [881339,101184] 0 2023-12-06T15:00:24.248 INFO:tasks.workunit.client.0.smithi152.stdout:1/420: creat d3/da/d4c/d82/d52/f9c x:0 0 0 2023-12-06T15:00:24.248 INFO:tasks.workunit.client.0.smithi152.stdout:3/220: creat d9/d10/d32/f3d x:0 0 0 2023-12-06T15:00:24.249 INFO:tasks.workunit.client.1.smithi190.stdout:6/440: unlink d4/d12/d1a/d32/l61 0 2023-12-06T15:00:24.249 INFO:tasks.workunit.client.1.smithi190.stdout:6/441: dread - d4/d12/d40/d43/d45/d4a/f69 zero size 2023-12-06T15:00:24.249 INFO:tasks.workunit.client.1.smithi190.stdout:1/577: rename d6/dc/d29/d38/d43/d7f/d95 to d6/dc/d6f/da4/db9 0 2023-12-06T15:00:24.250 INFO:tasks.workunit.client.0.smithi152.stdout:6/270: mkdir d1/d19/d1a/d30/d36/d35/d61 0 2023-12-06T15:00:24.251 INFO:tasks.workunit.client.1.smithi190.stdout:6/442: dread d4/fe [0,4194304] 0 2023-12-06T15:00:24.253 INFO:tasks.workunit.client.1.smithi190.stdout:0/318: unlink d0/da/d3e/f66 0 2023-12-06T15:00:24.253 INFO:tasks.workunit.client.1.smithi190.stdout:0/319: dread - d0/da/d3e/d3a/d40/f5e zero size 2023-12-06T15:00:24.255 INFO:tasks.workunit.client.1.smithi190.stdout:3/503: getdents d4 0 2023-12-06T15:00:24.255 INFO:tasks.workunit.client.1.smithi190.stdout:3/504: getdents d4/d70/d19/d51/dab 0 2023-12-06T15:00:24.255 INFO:tasks.workunit.client.1.smithi190.stdout:8/341: dread d1/d20/d3b/f18 [0,4194304] 0 2023-12-06T15:00:24.256 INFO:tasks.workunit.client.0.smithi152.stdout:1/421: symlink d3/da/d4c/d85/l9d 0 2023-12-06T15:00:24.256 INFO:tasks.workunit.client.0.smithi152.stdout:3/221: creat d9/d10/d12/f3e x:0 0 0 2023-12-06T15:00:24.256 INFO:tasks.workunit.client.0.smithi152.stdout:1/422: read - d3/da/d15/d17/d58/f64 zero size 2023-12-06T15:00:24.256 INFO:tasks.workunit.client.0.smithi152.stdout:6/271: truncate d1/d19/d1a/d30/d36/f2e 898398 0 2023-12-06T15:00:24.256 INFO:tasks.workunit.client.1.smithi190.stdout:9/373: mkdir d4/d84 0 2023-12-06T15:00:24.257 INFO:tasks.workunit.client.1.smithi190.stdout:9/374: chown d4/f17 0 1 2023-12-06T15:00:24.258 INFO:tasks.workunit.client.1.smithi190.stdout:1/578: symlink d6/dc/d29/d38/d73/d5c/db5/lba 0 2023-12-06T15:00:24.258 INFO:tasks.workunit.client.1.smithi190.stdout:1/579: chown d6/d49/d74 27603 1 2023-12-06T15:00:24.258 INFO:tasks.workunit.client.0.smithi152.stdout:1/423: unlink d3/da/d15/d17/d43/c6c 0 2023-12-06T15:00:24.258 INFO:tasks.workunit.client.0.smithi152.stdout:1/424: readlink d3/da/db/l10 0 2023-12-06T15:00:24.259 INFO:tasks.workunit.client.1.smithi190.stdout:6/443: mknod d4/d12/c90 0 2023-12-06T15:00:24.259 INFO:tasks.workunit.client.1.smithi190.stdout:6/444: chown d4/d15/f4e 20720653 1 2023-12-06T15:00:24.259 INFO:tasks.workunit.client.1.smithi190.stdout:6/445: truncate d4/d12/d40/d43/d45/f60 308958 0 2023-12-06T15:00:24.260 INFO:tasks.workunit.client.0.smithi152.stdout:3/222: symlink d9/d10/d32/l3f 0 2023-12-06T15:00:24.261 INFO:tasks.workunit.client.0.smithi152.stdout:1/425: dread d3/da/db/f53 [0,4194304] 0 2023-12-06T15:00:24.262 INFO:tasks.workunit.client.0.smithi152.stdout:8/106: dwrite d1/d6/d7/f1a [0,4194304] 0 2023-12-06T15:00:24.262 INFO:tasks.workunit.client.0.smithi152.stdout:8/107: chown d1/d6/fd 264231 1 2023-12-06T15:00:24.262 INFO:tasks.workunit.client.0.smithi152.stdout:4/365: sync 2023-12-06T15:00:24.262 INFO:tasks.workunit.client.0.smithi152.stdout:2/127: sync 2023-12-06T15:00:24.262 INFO:tasks.workunit.client.0.smithi152.stdout:2/128: readlink d6/db/d13/l25 0 2023-12-06T15:00:24.262 INFO:tasks.workunit.client.0.smithi152.stdout:5/204: sync 2023-12-06T15:00:24.262 INFO:tasks.workunit.client.0.smithi152.stdout:9/202: sync 2023-12-06T15:00:24.262 INFO:tasks.workunit.client.0.smithi152.stdout:7/131: sync 2023-12-06T15:00:24.263 INFO:tasks.workunit.client.0.smithi152.stdout:0/183: sync 2023-12-06T15:00:24.266 INFO:tasks.workunit.client.1.smithi190.stdout:0/320: unlink d0/da/d3e/d2b/f36 0 2023-12-06T15:00:24.266 INFO:tasks.workunit.client.1.smithi190.stdout:8/342: truncate d1/d20/d3b/d4c/d5a/f66 2988218 0 2023-12-06T15:00:24.266 INFO:tasks.workunit.client.1.smithi190.stdout:6/446: link d4/d12/d40/d43/l8d d4/d12/d1a/d8a/l91 0 2023-12-06T15:00:24.267 INFO:tasks.workunit.client.0.smithi152.stdout:7/132: write dd/df/f1a [2517396,54764] 0 2023-12-06T15:00:24.268 INFO:tasks.workunit.client.0.smithi152.stdout:2/129: symlink d6/l29 0 2023-12-06T15:00:24.271 INFO:tasks.workunit.client.0.smithi152.stdout:9/203: creat d0/f36 x:0 0 0 2023-12-06T15:00:24.271 INFO:tasks.workunit.client.0.smithi152.stdout:1/426: read d3/da/d4c/d82/f31 [494912,73336] 0 2023-12-06T15:00:24.274 INFO:tasks.workunit.client.0.smithi152.stdout:0/184: creat d8/d1b/f36 x:0 0 0 2023-12-06T15:00:24.274 INFO:tasks.workunit.client.0.smithi152.stdout:7/133: truncate f3 987851 0 2023-12-06T15:00:24.275 INFO:tasks.workunit.client.0.smithi152.stdout:8/108: link d1/d6/db/f14 d1/f1c 0 2023-12-06T15:00:24.275 INFO:tasks.workunit.client.0.smithi152.stdout:4/366: dread d2/d45/f4e [0,4194304] 0 2023-12-06T15:00:24.275 INFO:tasks.workunit.client.0.smithi152.stdout:9/204: write d0/f6 [4223857,113876] 0 2023-12-06T15:00:24.275 INFO:tasks.workunit.client.0.smithi152.stdout:9/205: chown d0/dd 125 1 2023-12-06T15:00:24.276 INFO:tasks.workunit.client.0.smithi152.stdout:5/205: mknod d7/dd/c41 0 2023-12-06T15:00:24.278 INFO:tasks.workunit.client.1.smithi190.stdout:1/580: write d6/dc/d29/f83 [2754690,6972] 0 2023-12-06T15:00:24.278 INFO:tasks.workunit.client.1.smithi190.stdout:1/581: stat d6/f5a 0 2023-12-06T15:00:24.279 INFO:tasks.workunit.client.0.smithi152.stdout:0/185: unlink d8/l31 0 2023-12-06T15:00:24.279 INFO:tasks.workunit.client.0.smithi152.stdout:0/186: dread - d8/d1b/f1f zero size 2023-12-06T15:00:24.279 INFO:tasks.workunit.client.0.smithi152.stdout:0/187: chown d8/d15 800407084 1 2023-12-06T15:00:24.282 INFO:tasks.workunit.client.1.smithi190.stdout:8/343: dread d1/f16 [0,4194304] 0 2023-12-06T15:00:24.284 INFO:tasks.workunit.client.0.smithi152.stdout:7/134: mkdir dd/df/d22/d29 0 2023-12-06T15:00:24.284 INFO:tasks.workunit.client.0.smithi152.stdout:7/135: chown dd/f15 165 1 2023-12-06T15:00:24.285 INFO:tasks.workunit.client.0.smithi152.stdout:0/188: creat d8/f37 x:0 0 0 2023-12-06T15:00:24.285 INFO:tasks.workunit.client.1.smithi190.stdout:1/582: creat d6/dc/fbb x:0 0 0 2023-12-06T15:00:24.286 INFO:tasks.workunit.client.1.smithi190.stdout:6/447: read d4/d15/f26 [3467391,71211] 0 2023-12-06T15:00:24.289 INFO:tasks.workunit.client.0.smithi152.stdout:5/206: read d7/dd/f20 [114879,107741] 0 2023-12-06T15:00:24.289 INFO:tasks.workunit.client.0.smithi152.stdout:7/136: creat dd/df/d22/d29/f2a x:0 0 0 2023-12-06T15:00:24.289 INFO:tasks.workunit.client.0.smithi152.stdout:7/137: write dd/f24 [27907,4220] 0 2023-12-06T15:00:24.290 INFO:tasks.workunit.client.0.smithi152.stdout:8/109: link d1/d6/d7/l16 d1/l1d 0 2023-12-06T15:00:24.290 INFO:tasks.workunit.client.0.smithi152.stdout:8/110: chown d1/d6/db/l12 168821 1 2023-12-06T15:00:24.290 INFO:tasks.workunit.client.0.smithi152.stdout:2/130: dread d6/db/d17/f28 [0,4194304] 0 2023-12-06T15:00:24.290 INFO:tasks.workunit.client.0.smithi152.stdout:2/131: fsync d6/db/d13/f14 0 2023-12-06T15:00:24.293 INFO:tasks.workunit.client.1.smithi190.stdout:6/448: mknod d4/d12/d1a/c92 0 2023-12-06T15:00:24.298 INFO:tasks.workunit.client.1.smithi190.stdout:6/449: getdents d4/d12/d40/d43/d45 0 2023-12-06T15:00:24.299 INFO:tasks.workunit.client.0.smithi152.stdout:0/189: unlink d8/d15/l30 0 2023-12-06T15:00:24.299 INFO:tasks.workunit.client.0.smithi152.stdout:5/207: mknod d7/c42 0 2023-12-06T15:00:24.299 INFO:tasks.workunit.client.0.smithi152.stdout:2/132: mknod d6/d1e/d27/c2a 0 2023-12-06T15:00:24.299 INFO:tasks.workunit.client.0.smithi152.stdout:2/133: truncate d6/f20 659000 0 2023-12-06T15:00:24.299 INFO:tasks.workunit.client.0.smithi152.stdout:2/134: creat d6/db/f2b x:0 0 0 2023-12-06T15:00:24.301 INFO:tasks.workunit.client.0.smithi152.stdout:2/135: symlink d6/d18/l2c 0 2023-12-06T15:00:24.301 INFO:tasks.workunit.client.0.smithi152.stdout:2/136: readlink d6/l29 0 2023-12-06T15:00:24.307 INFO:tasks.workunit.client.1.smithi190.stdout:6/450: link d4/l72 d4/d12/d1a/d8a/l93 0 2023-12-06T15:00:24.309 INFO:tasks.workunit.client.1.smithi190.stdout:3/505: dwrite d4/d70/d53/d56/d94/f42 [0,4194304] 0 2023-12-06T15:00:24.309 INFO:tasks.workunit.client.1.smithi190.stdout:6/451: mknod d4/d12/d40/d43/d45/d4a/d77/c94 0 2023-12-06T15:00:24.309 INFO:tasks.workunit.client.1.smithi190.stdout:6/452: write d4/d15/f89 [439829,67808] 0 2023-12-06T15:00:24.312 INFO:tasks.workunit.client.1.smithi190.stdout:6/453: getdents d4/d12/d1a/d44 0 2023-12-06T15:00:24.312 INFO:tasks.workunit.client.1.smithi190.stdout:3/506: rename d4/d70/d33/f39 to d4/d1b/d54/d9c/fb6 0 2023-12-06T15:00:24.313 INFO:tasks.workunit.client.1.smithi190.stdout:6/454: unlink d4/d12/d40/d43/d45/d4a/f69 0 2023-12-06T15:00:24.314 INFO:tasks.workunit.client.1.smithi190.stdout:3/507: mkdir d4/d1b/d77/da8/db7 0 2023-12-06T15:00:24.315 INFO:tasks.workunit.client.1.smithi190.stdout:3/508: fsync d4/d1b/d54/d9c/f4f 0 2023-12-06T15:00:24.322 INFO:tasks.workunit.client.0.smithi152.stdout:5/208: dread d7/f24 [0,4194304] 0 2023-12-06T15:00:24.323 INFO:tasks.workunit.client.0.smithi152.stdout:2/137: dread d6/db/d13/f14 [0,4194304] 0 2023-12-06T15:00:24.323 INFO:tasks.workunit.client.0.smithi152.stdout:6/272: dwrite d1/d19/d1a/d30/f22 [0,4194304] 0 2023-12-06T15:00:24.323 INFO:tasks.workunit.client.0.smithi152.stdout:5/209: mkdir d7/d43 0 2023-12-06T15:00:24.323 INFO:tasks.workunit.client.0.smithi152.stdout:6/273: fsync d1/d19/d1a/d30/d18/f28 0 2023-12-06T15:00:24.325 INFO:tasks.workunit.client.0.smithi152.stdout:5/210: truncate d7/fc 2278863 0 2023-12-06T15:00:24.326 INFO:tasks.workunit.client.0.smithi152.stdout:2/138: truncate d6/db/d17/f28 101637 0 2023-12-06T15:00:24.326 INFO:tasks.workunit.client.0.smithi152.stdout:2/139: fsync d6/db/d17/f1d 0 2023-12-06T15:00:24.326 INFO:tasks.workunit.client.0.smithi152.stdout:6/274: creat d1/d19/d1a/d30/d36/f62 x:0 0 0 2023-12-06T15:00:24.327 INFO:tasks.workunit.client.0.smithi152.stdout:6/275: dread - d1/d19/d1a/d30/d36/d4e/d55/f5d zero size 2023-12-06T15:00:24.328 INFO:tasks.workunit.client.0.smithi152.stdout:5/211: creat d7/dd/d26/f44 x:0 0 0 2023-12-06T15:00:24.328 INFO:tasks.workunit.client.0.smithi152.stdout:2/140: mknod d6/c2d 0 2023-12-06T15:00:24.329 INFO:tasks.workunit.client.0.smithi152.stdout:6/276: mkdir d1/d19/d1a/d30/d36/d35/d63 0 2023-12-06T15:00:24.329 INFO:tasks.workunit.client.0.smithi152.stdout:3/223: dwrite d9/d10/d12/f30 [0,4194304] 0 2023-12-06T15:00:24.329 INFO:tasks.workunit.client.0.smithi152.stdout:3/224: chown d9/d10 82 1 2023-12-06T15:00:24.329 INFO:tasks.workunit.client.0.smithi152.stdout:3/225: fsync d9/f1d 0 2023-12-06T15:00:24.330 INFO:tasks.workunit.client.0.smithi152.stdout:3/226: fsync d9/d10/d12/f31 0 2023-12-06T15:00:24.330 INFO:tasks.workunit.client.0.smithi152.stdout:2/141: creat d6/d1e/f2e x:0 0 0 2023-12-06T15:00:24.331 INFO:tasks.workunit.client.0.smithi152.stdout:6/277: creat d1/d19/d1a/d30/d36/f64 x:0 0 0 2023-12-06T15:00:24.332 INFO:tasks.workunit.client.0.smithi152.stdout:6/278: chown d1/d1c 0 1 2023-12-06T15:00:24.332 INFO:tasks.workunit.client.0.smithi152.stdout:3/227: symlink d9/d18/d39/l40 0 2023-12-06T15:00:24.332 INFO:tasks.workunit.client.0.smithi152.stdout:3/228: truncate d9/f2d 4455051 0 2023-12-06T15:00:24.333 INFO:tasks.workunit.client.0.smithi152.stdout:2/142: creat d6/d1e/f2f x:0 0 0 2023-12-06T15:00:24.334 INFO:tasks.workunit.client.0.smithi152.stdout:3/229: mkdir d9/d41 0 2023-12-06T15:00:24.334 INFO:tasks.workunit.client.0.smithi152.stdout:3/230: fdatasync d9/d10/f16 0 2023-12-06T15:00:24.335 INFO:tasks.workunit.client.0.smithi152.stdout:3/231: getdents d9/d18/d1a 0 2023-12-06T15:00:24.336 INFO:tasks.workunit.client.0.smithi152.stdout:3/232: write d9/d10/d12/f3a [4187927,600] 0 2023-12-06T15:00:24.336 INFO:tasks.workunit.client.1.smithi190.stdout:6/455: dread d4/d12/d1a/d44/f47 [0,4194304] 0 2023-12-06T15:00:24.336 INFO:tasks.workunit.client.1.smithi190.stdout:6/456: fsync d4/d12/d40/d43/d45/f88 0 2023-12-06T15:00:24.337 INFO:tasks.workunit.client.0.smithi152.stdout:3/233: creat d9/d41/f42 x:0 0 0 2023-12-06T15:00:24.337 INFO:tasks.workunit.client.0.smithi152.stdout:3/234: chown d9/d18 20628 1 2023-12-06T15:00:24.338 INFO:tasks.workunit.client.1.smithi190.stdout:6/457: getdents d4/d12/d1a/d32 0 2023-12-06T15:00:24.338 INFO:tasks.workunit.client.1.smithi190.stdout:6/458: getdents d4/d12/d1a/d8c 0 2023-12-06T15:00:24.338 INFO:tasks.workunit.client.0.smithi152.stdout:3/235: mkdir d9/d10/d12/d43 0 2023-12-06T15:00:24.339 INFO:tasks.workunit.client.1.smithi190.stdout:6/459: mknod d4/d12/d40/d43/d45/d4a/d77/c95 0 2023-12-06T15:00:24.340 INFO:tasks.workunit.client.0.smithi152.stdout:3/236: mkdir d9/d10/d12/d44 0 2023-12-06T15:00:24.340 INFO:tasks.workunit.client.0.smithi152.stdout:3/237: chown f7 692 1 2023-12-06T15:00:24.342 INFO:tasks.workunit.client.0.smithi152.stdout:6/279: dread d1/d19/d1a/d30/d36/d26/f2d [0,4194304] 0 2023-12-06T15:00:24.344 INFO:tasks.workunit.client.0.smithi152.stdout:3/238: rename d9/d18/d1a/d36 to d9/d45 0 2023-12-06T15:00:24.344 INFO:tasks.workunit.client.0.smithi152.stdout:3/239: dread - d9/d10/d19/f33 zero size 2023-12-06T15:00:24.344 INFO:tasks.workunit.client.0.smithi152.stdout:3/240: fsync d9/d10/d12/f31 0 2023-12-06T15:00:24.344 INFO:tasks.workunit.client.0.smithi152.stdout:3/241: truncate d9/f37 233045 0 2023-12-06T15:00:24.344 INFO:tasks.workunit.client.0.smithi152.stdout:9/206: dwrite d0/f36 [0,4194304] 0 2023-12-06T15:00:24.344 INFO:tasks.workunit.client.0.smithi152.stdout:4/367: dwrite d2/f3a [0,4194304] 0 2023-12-06T15:00:24.344 INFO:tasks.workunit.client.0.smithi152.stdout:4/368: fdatasync d2/d10/f17 0 2023-12-06T15:00:24.344 INFO:tasks.workunit.client.0.smithi152.stdout:6/280: creat d1/d19/d1a/d30/d36/d35/d63/f65 x:0 0 0 2023-12-06T15:00:24.344 INFO:tasks.workunit.client.0.smithi152.stdout:6/281: write d1/d19/d1a/d30/d36/f62 [845128,103728] 0 2023-12-06T15:00:24.345 INFO:tasks.workunit.client.0.smithi152.stdout:3/242: mknod d9/d18/d1a/c46 0 2023-12-06T15:00:24.345 INFO:tasks.workunit.client.0.smithi152.stdout:3/243: write d9/d10/d12/f3e [726304,3245] 0 2023-12-06T15:00:24.349 INFO:tasks.workunit.client.0.smithi152.stdout:6/282: link d1/d5/d15/c3e d1/d19/d1a/d30/d36/d4e/d55/c66 0 2023-12-06T15:00:24.349 INFO:tasks.workunit.client.0.smithi152.stdout:1/427: dwrite d3/d44/f78 [0,4194304] 0 2023-12-06T15:00:24.349 INFO:tasks.workunit.client.0.smithi152.stdout:3/244: mknod d9/d18/d39/c47 0 2023-12-06T15:00:24.350 INFO:tasks.workunit.client.0.smithi152.stdout:4/369: rename d2/d10/d52/d40 to d2/d15/d32/d69/d6f 0 2023-12-06T15:00:24.352 INFO:tasks.workunit.client.0.smithi152.stdout:7/138: dwrite dd/df/d22/d29/f2a [0,4194304] 0 2023-12-06T15:00:24.352 INFO:tasks.workunit.client.0.smithi152.stdout:7/139: chown f4 13017646 1 2023-12-06T15:00:24.352 INFO:tasks.workunit.client.0.smithi152.stdout:1/428: creat d3/da/d15/d17/d43/f9e x:0 0 0 2023-12-06T15:00:24.353 INFO:tasks.workunit.client.1.smithi190.stdout:1/583: dwrite d6/d49/f68 [0,4194304] 0 2023-12-06T15:00:24.353 INFO:tasks.workunit.client.1.smithi190.stdout:0/321: dwrite d0/da/d3e/d2b/d37/f39 [0,4194304] 0 2023-12-06T15:00:24.353 INFO:tasks.workunit.client.1.smithi190.stdout:0/322: chown d0/da/d3e/d2b/d3c/d46/l58 3467940 1 2023-12-06T15:00:24.353 INFO:tasks.workunit.client.1.smithi190.stdout:0/323: write d0/da/d3e/d2b/d3c/d46/f52 [395084,110799] 0 2023-12-06T15:00:24.354 INFO:tasks.workunit.client.0.smithi152.stdout:3/245: symlink d9/d18/d1a/l48 0 2023-12-06T15:00:24.355 INFO:tasks.workunit.client.1.smithi190.stdout:9/375: dwrite d4/f24 [0,4194304] 0 2023-12-06T15:00:24.358 INFO:tasks.workunit.client.1.smithi190.stdout:0/324: symlink d0/da/d3e/d2b/d3c/d46/l6c 0 2023-12-06T15:00:24.358 INFO:tasks.workunit.client.1.smithi190.stdout:9/376: getdents d4/d27/d2f/d31/d3f/d58/d72/d7a 0 2023-12-06T15:00:24.359 INFO:tasks.workunit.client.0.smithi152.stdout:3/246: write d9/d18/f24 [2652728,85308] 0 2023-12-06T15:00:24.359 INFO:tasks.workunit.client.0.smithi152.stdout:4/370: link d2/d22/c28 d2/d15/d32/c70 0 2023-12-06T15:00:24.359 INFO:tasks.workunit.client.1.smithi190.stdout:9/377: fsync d4/d27/d2f/d5c/f82 0 2023-12-06T15:00:24.359 INFO:tasks.workunit.client.1.smithi190.stdout:9/378: write d4/fe [5139331,119531] 0 2023-12-06T15:00:24.360 INFO:tasks.workunit.client.1.smithi190.stdout:3/509: dwrite d4/d70/d19/f7c [0,4194304] 0 2023-12-06T15:00:24.361 INFO:tasks.workunit.client.1.smithi190.stdout:0/325: unlink d0/da/d3e/d2b/d3c/c64 0 2023-12-06T15:00:24.361 INFO:tasks.workunit.client.1.smithi190.stdout:3/510: chown d4/d1b/d69/f95 21732 1 2023-12-06T15:00:24.361 INFO:tasks.workunit.client.0.smithi152.stdout:4/371: write f1 [3090970,31048] 0 2023-12-06T15:00:24.361 INFO:tasks.workunit.client.0.smithi152.stdout:4/372: write d2/d15/f62 [184512,39266] 0 2023-12-06T15:00:24.362 INFO:tasks.workunit.client.0.smithi152.stdout:1/429: getdents d3/da/db/d54 0 2023-12-06T15:00:24.364 INFO:tasks.workunit.client.0.smithi152.stdout:0/190: dwrite d8/f9 [4194304,4194304] 0 2023-12-06T15:00:24.364 INFO:tasks.workunit.client.0.smithi152.stdout:0/191: readlink d8/lc 0 2023-12-06T15:00:24.364 INFO:tasks.workunit.client.0.smithi152.stdout:8/111: dread d1/f10 [0,4194304] 0 2023-12-06T15:00:24.364 INFO:tasks.workunit.client.0.smithi152.stdout:4/373: creat d2/d10/d27/f71 x:0 0 0 2023-12-06T15:00:24.365 INFO:tasks.workunit.client.1.smithi190.stdout:3/511: link d4/d70/d7f/lae d4/d70/d7f/db5/lb8 0 2023-12-06T15:00:24.365 INFO:tasks.workunit.client.1.smithi190.stdout:3/512: dread - d4/d70/d53/d56/d8f/fa2 zero size 2023-12-06T15:00:24.368 INFO:tasks.workunit.client.0.smithi152.stdout:0/192: mkdir d8/d38 0 2023-12-06T15:00:24.369 INFO:tasks.workunit.client.1.smithi190.stdout:8/344: truncate d1/f1b 2215050 0 2023-12-06T15:00:24.369 INFO:tasks.workunit.client.1.smithi190.stdout:8/345: chown d1 6612567 1 2023-12-06T15:00:24.370 INFO:tasks.workunit.client.0.smithi152.stdout:1/430: dread d3/da/f35 [0,4194304] 0 2023-12-06T15:00:24.370 INFO:tasks.workunit.client.0.smithi152.stdout:5/212: dwrite d7/dd/d26/f32 [0,4194304] 0 2023-12-06T15:00:24.370 INFO:tasks.workunit.client.0.smithi152.stdout:6/283: dread d1/f8 [0,4194304] 0 2023-12-06T15:00:24.370 INFO:tasks.workunit.client.0.smithi152.stdout:8/112: rename d1/d6/fc to d1/d6/d7/f1e 0 2023-12-06T15:00:24.373 INFO:tasks.workunit.client.1.smithi190.stdout:8/346: link d1/d20/d3b/d31/l52 d1/d10/l67 0 2023-12-06T15:00:24.373 INFO:tasks.workunit.client.1.smithi190.stdout:6/460: dwrite d4/d12/f3f [0,4194304] 0 2023-12-06T15:00:24.373 INFO:tasks.workunit.client.1.smithi190.stdout:3/513: dread d4/d70/d19/d51/f5f [0,4194304] 0 2023-12-06T15:00:24.373 INFO:tasks.workunit.client.1.smithi190.stdout:6/461: write d4/d12/d40/d43/d45/d4a/f7e [839684,65563] 0 2023-12-06T15:00:24.373 INFO:tasks.workunit.client.1.smithi190.stdout:6/462: stat d4/d12/d1a/d32/c68 0 2023-12-06T15:00:24.373 INFO:tasks.workunit.client.1.smithi190.stdout:6/463: read d4/d12/d40/d43/d45/d4a/f7e [856406,87879] 0 2023-12-06T15:00:24.377 INFO:tasks.workunit.client.0.smithi152.stdout:4/374: truncate d2/d10/d27/f43 2701874 0 2023-12-06T15:00:24.378 INFO:tasks.workunit.client.1.smithi190.stdout:3/514: link d4/l2e d4/d70/d19/d51/lb9 0 2023-12-06T15:00:24.378 INFO:tasks.workunit.client.1.smithi190.stdout:9/379: dread d4/d27/d2f/d31/f50 [0,4194304] 0 2023-12-06T15:00:24.379 INFO:tasks.workunit.client.1.smithi190.stdout:6/464: link d4/d12/d1a/f39 d4/d15/f96 0 2023-12-06T15:00:24.379 INFO:tasks.workunit.client.1.smithi190.stdout:6/465: fsync d4/d12/d1a/d44/f57 0 2023-12-06T15:00:24.379 INFO:tasks.workunit.client.1.smithi190.stdout:6/466: write d4/d12/d1a/d59/f78 [1169366,36804] 0 2023-12-06T15:00:24.379 INFO:tasks.workunit.client.1.smithi190.stdout:6/467: write d4/fe [1979261,51159] 0 2023-12-06T15:00:24.381 INFO:tasks.workunit.client.0.smithi152.stdout:0/193: creat d8/d1b/f39 x:0 0 0 2023-12-06T15:00:24.381 INFO:tasks.workunit.client.0.smithi152.stdout:0/194: fsync d8/f13 0 2023-12-06T15:00:24.383 INFO:tasks.workunit.client.1.smithi190.stdout:6/468: write d4/d12/d1a/d32/f4c [760515,24862] 0 2023-12-06T15:00:24.383 INFO:tasks.workunit.client.1.smithi190.stdout:6/469: getdents d4/d12/d1a/d8c 0 2023-12-06T15:00:24.383 INFO:tasks.workunit.client.1.smithi190.stdout:9/380: rename d4/c29 to d4/d27/d2f/d31/d3f/d58/d7d/c85 0 2023-12-06T15:00:24.386 INFO:tasks.workunit.client.1.smithi190.stdout:1/584: dwrite d6/dc/d29/d38/d43/f61 [0,4194304] 0 2023-12-06T15:00:24.386 INFO:tasks.workunit.client.0.smithi152.stdout:6/284: mknod d1/d3c/c67 0 2023-12-06T15:00:24.387 INFO:tasks.workunit.client.1.smithi190.stdout:9/381: unlink f0 0 2023-12-06T15:00:24.388 INFO:tasks.workunit.client.0.smithi152.stdout:5/213: symlink d7/dd/d26/d3a/l45 0 2023-12-06T15:00:24.388 INFO:tasks.workunit.client.1.smithi190.stdout:9/382: truncate d4/f33 1819941 0 2023-12-06T15:00:24.391 INFO:tasks.workunit.client.0.smithi152.stdout:1/431: rename d3/da/d4c/d63/d87 to d3/da/d15/d17/d58/d9f 0 2023-12-06T15:00:24.394 INFO:tasks.workunit.client.1.smithi190.stdout:3/515: dread d4/d1b/d69/f90 [0,4194304] 0 2023-12-06T15:00:24.394 INFO:tasks.workunit.client.0.smithi152.stdout:8/113: mknod d1/d6/c1f 0 2023-12-06T15:00:24.395 INFO:tasks.workunit.client.0.smithi152.stdout:8/114: fsync d1/f10 0 2023-12-06T15:00:24.395 INFO:tasks.workunit.client.0.smithi152.stdout:3/247: dread d9/f2d [0,4194304] 0 2023-12-06T15:00:24.395 INFO:tasks.workunit.client.0.smithi152.stdout:3/248: chown c8 201206158 1 2023-12-06T15:00:24.395 INFO:tasks.workunit.client.0.smithi152.stdout:0/195: creat d8/f3a x:0 0 0 2023-12-06T15:00:24.396 INFO:tasks.workunit.client.1.smithi190.stdout:3/516: mknod d4/d70/d19/d51/cba 0 2023-12-06T15:00:24.396 INFO:tasks.workunit.client.1.smithi190.stdout:3/517: chown d4/d1b/d77 21336 1 2023-12-06T15:00:24.397 INFO:tasks.workunit.client.0.smithi152.stdout:6/285: creat d1/d19/d1a/d30/d36/d35/d49/d57/f68 x:0 0 0 2023-12-06T15:00:24.401 INFO:tasks.workunit.client.0.smithi152.stdout:6/286: read d1/d5/d15/f5c [357224,16622] 0 2023-12-06T15:00:24.401 INFO:tasks.workunit.client.0.smithi152.stdout:6/287: chown d1/d19 27 1 2023-12-06T15:00:24.401 INFO:tasks.workunit.client.0.smithi152.stdout:9/207: dwrite d0/dd/fe [0,4194304] 0 2023-12-06T15:00:24.401 INFO:tasks.workunit.client.0.smithi152.stdout:1/432: mkdir d3/da/db/da0 0 2023-12-06T15:00:24.402 INFO:tasks.workunit.client.0.smithi152.stdout:0/196: dread d8/fd [0,4194304] 0 2023-12-06T15:00:24.405 INFO:tasks.workunit.client.1.smithi190.stdout:1/585: dread d6/dc/d29/d38/d39/f6a [0,4194304] 0 2023-12-06T15:00:24.405 INFO:tasks.workunit.client.1.smithi190.stdout:1/586: chown d6/dc/d6f/da4 46 1 2023-12-06T15:00:24.409 INFO:tasks.workunit.client.0.smithi152.stdout:3/249: creat d9/d10/d19/f49 x:0 0 0 2023-12-06T15:00:24.409 INFO:tasks.workunit.client.0.smithi152.stdout:3/250: fsync d9/d10/d12/f1e 0 2023-12-06T15:00:24.409 INFO:tasks.workunit.client.0.smithi152.stdout:3/251: stat d9/d10/f16 0 2023-12-06T15:00:24.409 INFO:tasks.workunit.client.0.smithi152.stdout:3/252: stat d9/d18/d1a/c46 0 2023-12-06T15:00:24.409 INFO:tasks.workunit.client.0.smithi152.stdout:6/288: mkdir d1/d69 0 2023-12-06T15:00:24.409 INFO:tasks.workunit.client.0.smithi152.stdout:6/289: chown d1/d3c/f5f 8645 1 2023-12-06T15:00:24.409 INFO:tasks.workunit.client.0.smithi152.stdout:6/290: write d1/d19/d1a/d30/d36/f64 [939465,115107] 0 2023-12-06T15:00:24.409 INFO:tasks.workunit.client.0.smithi152.stdout:5/214: unlink d7/dd/l10 0 2023-12-06T15:00:24.409 INFO:tasks.workunit.client.0.smithi152.stdout:2/143: getdents d6/d1e 0 2023-12-06T15:00:24.409 INFO:tasks.workunit.client.0.smithi152.stdout:2/144: write d6/db/d17/f28 [276927,88941] 0 2023-12-06T15:00:24.410 INFO:tasks.workunit.client.0.smithi152.stdout:9/208: creat d0/d31/f37 x:0 0 0 2023-12-06T15:00:24.410 INFO:tasks.workunit.client.0.smithi152.stdout:1/433: rmdir d3/da/d65 39 2023-12-06T15:00:24.412 INFO:tasks.workunit.client.0.smithi152.stdout:8/115: symlink d1/l20 0 2023-12-06T15:00:24.412 INFO:tasks.workunit.client.1.smithi190.stdout:0/326: dwrite d0/da/f29 [0,4194304] 0 2023-12-06T15:00:24.412 INFO:tasks.workunit.client.1.smithi190.stdout:0/327: readlink d0/da/d3e/d3a/d40/l55 0 2023-12-06T15:00:24.413 INFO:tasks.workunit.client.1.smithi190.stdout:9/383: dread d4/f11 [0,4194304] 0 2023-12-06T15:00:24.413 INFO:tasks.workunit.client.0.smithi152.stdout:7/140: dwrite f8 [0,4194304] 0 2023-12-06T15:00:24.414 INFO:tasks.workunit.client.0.smithi152.stdout:7/141: rename dd to dd/df/d1b/d2b 22 2023-12-06T15:00:24.414 INFO:tasks.workunit.client.0.smithi152.stdout:0/197: symlink d8/d38/l3b 0 2023-12-06T15:00:24.414 INFO:tasks.workunit.client.1.smithi190.stdout:8/347: dwrite d1/d10/d1c/f4e [0,4194304] 0 2023-12-06T15:00:24.415 INFO:tasks.workunit.client.1.smithi190.stdout:1/587: creat d6/dc/d29/d38/d73/d76/d7e/fbc x:0 0 0 2023-12-06T15:00:24.415 INFO:tasks.workunit.client.1.smithi190.stdout:1/588: chown d6/dc/d29/d38/d73/d5c/f70 775987 1 2023-12-06T15:00:24.415 INFO:tasks.workunit.client.1.smithi190.stdout:6/470: dwrite d4/d12/d1a/d44/f56 [0,4194304] 0 2023-12-06T15:00:24.416 INFO:tasks.workunit.client.1.smithi190.stdout:9/384: mknod d4/d27/d2f/d31/d3f/c86 0 2023-12-06T15:00:24.416 INFO:tasks.workunit.client.1.smithi190.stdout:9/385: truncate d4/d27/d2f/d31/d3f/f69 525088 0 2023-12-06T15:00:24.416 INFO:tasks.workunit.client.1.smithi190.stdout:1/589: write d6/dc/ff [3693167,4234] 0 2023-12-06T15:00:24.416 INFO:tasks.workunit.client.0.smithi152.stdout:3/253: creat d9/d18/d39/f4a x:0 0 0 2023-12-06T15:00:24.417 INFO:tasks.workunit.client.0.smithi152.stdout:3/254: write d9/f1d [3697914,14063] 0 2023-12-06T15:00:24.418 INFO:tasks.workunit.client.1.smithi190.stdout:3/518: dread d4/d70/d53/d56/d94/d3d/f43 [0,4194304] 0 2023-12-06T15:00:24.418 INFO:tasks.workunit.client.0.smithi152.stdout:6/291: mknod d1/d19/d1a/d30/d36/d35/d61/c6a 0 2023-12-06T15:00:24.420 INFO:tasks.workunit.client.0.smithi152.stdout:5/215: mkdir d7/dd/d26/d3b/d46 0 2023-12-06T15:00:24.421 INFO:tasks.workunit.client.1.smithi190.stdout:4/308: sync 2023-12-06T15:00:24.421 INFO:tasks.workunit.client.1.smithi190.stdout:4/309: fsync d3/fa 0 2023-12-06T15:00:24.421 INFO:tasks.workunit.client.1.smithi190.stdout:7/414: sync 2023-12-06T15:00:24.421 INFO:tasks.workunit.client.1.smithi190.stdout:2/365: sync 2023-12-06T15:00:24.422 INFO:tasks.workunit.client.1.smithi190.stdout:2/366: write d10/d26/d5c/f4b [444361,96679] 0 2023-12-06T15:00:24.425 INFO:tasks.workunit.client.0.smithi152.stdout:2/145: symlink d6/db/d13/l30 0 2023-12-06T15:00:24.427 INFO:tasks.workunit.client.0.smithi152.stdout:9/209: mkdir d0/dd/d20/d38 0 2023-12-06T15:00:24.429 INFO:tasks.workunit.client.1.smithi190.stdout:9/386: symlink d4/d84/l87 0 2023-12-06T15:00:24.430 INFO:tasks.workunit.client.0.smithi152.stdout:1/434: creat d3/da/d15/d17/d1a/fa1 x:0 0 0 2023-12-06T15:00:24.431 INFO:tasks.workunit.client.1.smithi190.stdout:1/590: symlink d6/dc/lbd 0 2023-12-06T15:00:24.434 INFO:tasks.workunit.client.1.smithi190.stdout:3/519: getdents d4/d70/d33/d45 0 2023-12-06T15:00:24.435 INFO:tasks.workunit.client.0.smithi152.stdout:8/116: creat d1/d6/d7/f21 x:0 0 0 2023-12-06T15:00:24.435 INFO:tasks.workunit.client.1.smithi190.stdout:6/471: rename d4/d15/f54 to d4/d12/d1a/f97 0 2023-12-06T15:00:24.435 INFO:tasks.workunit.client.1.smithi190.stdout:7/415: dread d0/df/d53/f3c [0,4194304] 0 2023-12-06T15:00:24.438 INFO:tasks.workunit.client.1.smithi190.stdout:4/310: rename d3/l38 to d3/d35/d19/d41/d44/d5b/l69 0 2023-12-06T15:00:24.438 INFO:tasks.workunit.client.1.smithi190.stdout:4/311: chown d3/d10/f1e 335210477 1 2023-12-06T15:00:24.438 INFO:tasks.workunit.client.1.smithi190.stdout:4/312: chown d3/d35/d19/d30/f37 14 1 2023-12-06T15:00:24.438 INFO:tasks.workunit.client.1.smithi190.stdout:6/472: creat d4/d15/f98 x:0 0 0 2023-12-06T15:00:24.441 INFO:tasks.workunit.client.1.smithi190.stdout:9/387: dread d4/d27/d2f/d66/f6e [0,4194304] 0 2023-12-06T15:00:24.441 INFO:tasks.workunit.client.1.smithi190.stdout:7/416: creat d0/d5/da/d56/f82 x:0 0 0 2023-12-06T15:00:24.441 INFO:tasks.workunit.client.1.smithi190.stdout:6/473: rmdir d4/d12/d1a/d8a 39 2023-12-06T15:00:24.441 INFO:tasks.workunit.client.1.smithi190.stdout:7/417: truncate d0/df/d53/f3c 3348648 0 2023-12-06T15:00:24.441 INFO:tasks.workunit.client.1.smithi190.stdout:7/418: stat d0/df/d53/d2f/d3e 0 2023-12-06T15:00:24.442 INFO:tasks.workunit.client.1.smithi190.stdout:6/474: mknod d4/d12/d1a/d59/c99 0 2023-12-06T15:00:24.445 INFO:tasks.workunit.client.1.smithi190.stdout:7/419: creat d0/d5/f83 x:0 0 0 2023-12-06T15:00:24.445 INFO:tasks.workunit.client.1.smithi190.stdout:7/420: chown d0/d5/d1b/d41 19126 1 2023-12-06T15:00:24.445 INFO:tasks.workunit.client.1.smithi190.stdout:7/421: chown d0/d5/d1b/f57 1 1 2023-12-06T15:00:24.445 INFO:tasks.workunit.client.1.smithi190.stdout:7/422: chown d0/d5/d1b/d7a/f69 42309 1 2023-12-06T15:00:24.450 INFO:tasks.workunit.client.0.smithi152.stdout:7/142: rename f4 to dd/df/f2c 0 2023-12-06T15:00:24.452 INFO:tasks.workunit.client.1.smithi190.stdout:2/367: dwrite d10/d59/d5e/f25 [4194304,4194304] 0 2023-12-06T15:00:24.452 INFO:tasks.workunit.client.1.smithi190.stdout:1/591: write d6/dc/d29/d38/d43/f61 [1123631,88655] 0 2023-12-06T15:00:24.453 INFO:tasks.workunit.client.1.smithi190.stdout:4/313: dread d3/d10/d39/f5c [0,4194304] 0 2023-12-06T15:00:24.455 INFO:tasks.workunit.client.1.smithi190.stdout:2/368: mkdir d10/d26/d5c/d49/d7e 0 2023-12-06T15:00:24.455 INFO:tasks.workunit.client.1.smithi190.stdout:2/369: truncate f3 5087256 0 2023-12-06T15:00:24.457 INFO:tasks.workunit.client.1.smithi190.stdout:1/592: truncate d6/dc/d29/d38/d73/f41 301199 0 2023-12-06T15:00:24.457 INFO:tasks.workunit.client.0.smithi152.stdout:0/198: truncate d8/f17 3492094 0 2023-12-06T15:00:24.458 INFO:tasks.workunit.client.0.smithi152.stdout:8/117: dread d1/f2 [0,4194304] 0 2023-12-06T15:00:24.460 INFO:tasks.workunit.client.1.smithi190.stdout:1/593: symlink d6/dc/d29/d38/d39/lbe 0 2023-12-06T15:00:24.462 INFO:tasks.workunit.client.1.smithi190.stdout:1/594: creat d6/dc/d29/d38/d73/d76/d7e/fbf x:0 0 0 2023-12-06T15:00:24.462 INFO:tasks.workunit.client.0.smithi152.stdout:3/255: mknod d9/d10/d12/d43/c4b 0 2023-12-06T15:00:24.462 INFO:tasks.workunit.client.0.smithi152.stdout:3/256: dread - d9/d41/f42 zero size 2023-12-06T15:00:24.463 INFO:tasks.workunit.client.1.smithi190.stdout:4/314: dread d3/d35/d19/d30/d3c/f49 [0,4194304] 0 2023-12-06T15:00:24.463 INFO:tasks.workunit.client.1.smithi190.stdout:1/595: symlink d6/dc/d29/d38/d43/db7/lc0 0 2023-12-06T15:00:24.463 INFO:tasks.workunit.client.1.smithi190.stdout:5/284: sync 2023-12-06T15:00:24.468 INFO:tasks.workunit.client.1.smithi190.stdout:1/596: unlink d6/dc/d29/l48 0 2023-12-06T15:00:24.470 INFO:tasks.workunit.client.0.smithi152.stdout:2/146: rmdir d6/db/d17 39 2023-12-06T15:00:24.470 INFO:tasks.workunit.client.0.smithi152.stdout:2/147: fsync d6/db/f2b 0 2023-12-06T15:00:24.470 INFO:tasks.workunit.client.0.smithi152.stdout:2/148: chown d6/d1e/c10 228766 1 2023-12-06T15:00:24.470 INFO:tasks.workunit.client.0.smithi152.stdout:9/210: symlink d0/dd/d20/l39 0 2023-12-06T15:00:24.470 INFO:tasks.workunit.client.1.smithi190.stdout:5/285: symlink d0/df/d50/l5c 0 2023-12-06T15:00:24.471 INFO:tasks.workunit.client.0.smithi152.stdout:7/143: rmdir dd/df/d1b 39 2023-12-06T15:00:24.471 INFO:tasks.workunit.client.0.smithi152.stdout:7/144: fsync dd/df/d22/d29/f2a 0 2023-12-06T15:00:24.471 INFO:tasks.workunit.client.0.smithi152.stdout:7/145: rename dd/df to dd/df/d1b/d20/d2d 22 2023-12-06T15:00:24.472 INFO:tasks.workunit.client.1.smithi190.stdout:5/286: rmdir d0/d1c/d3e 39 2023-12-06T15:00:24.472 INFO:tasks.workunit.client.1.smithi190.stdout:8/348: dwrite d1/d37/f47 [0,4194304] 0 2023-12-06T15:00:24.476 INFO:tasks.workunit.client.0.smithi152.stdout:3/257: link d9/d10/c1f d9/d10/d32/c4c 0 2023-12-06T15:00:24.477 INFO:tasks.workunit.client.0.smithi152.stdout:7/146: unlink dd/d17/c21 0 2023-12-06T15:00:24.477 INFO:tasks.workunit.client.0.smithi152.stdout:8/118: link d1/d6/fd d1/d6/f22 0 2023-12-06T15:00:24.477 INFO:tasks.workunit.client.0.smithi152.stdout:3/258: getdents d9/d45 0 2023-12-06T15:00:24.477 INFO:tasks.workunit.client.0.smithi152.stdout:3/259: write d9/d10/d19/f33 [886931,96920] 0 2023-12-06T15:00:24.477 INFO:tasks.workunit.client.1.smithi190.stdout:5/287: mkdir d0/d1c/d2b/d2c/d5d 0 2023-12-06T15:00:24.477 INFO:tasks.workunit.client.1.smithi190.stdout:8/349: creat d1/d20/d3b/d36/f68 x:0 0 0 2023-12-06T15:00:24.477 INFO:tasks.workunit.client.1.smithi190.stdout:8/350: chown d1/d37/l62 374 1 2023-12-06T15:00:24.478 INFO:tasks.workunit.client.0.smithi152.stdout:9/211: dread d0/f8 [0,4194304] 0 2023-12-06T15:00:24.479 INFO:tasks.workunit.client.0.smithi152.stdout:9/212: stat d0/f24 0 2023-12-06T15:00:24.479 INFO:tasks.workunit.client.0.smithi152.stdout:9/213: read - d0/f34 zero size 2023-12-06T15:00:24.479 INFO:tasks.workunit.client.0.smithi152.stdout:9/214: chown d0/l1f 6287 1 2023-12-06T15:00:24.479 INFO:tasks.workunit.client.0.smithi152.stdout:9/215: stat d0/f1 0 2023-12-06T15:00:24.479 INFO:tasks.workunit.client.0.smithi152.stdout:7/147: rename cc to dd/df/d1b/c2e 0 2023-12-06T15:00:24.480 INFO:tasks.workunit.client.1.smithi190.stdout:0/328: dwrite d0/da/d3e/d2b/d3c/d46/f52 [0,4194304] 0 2023-12-06T15:00:24.480 INFO:tasks.workunit.client.1.smithi190.stdout:8/351: unlink d1/d37/f47 0 2023-12-06T15:00:24.480 INFO:tasks.workunit.client.0.smithi152.stdout:9/216: unlink d0/l12 0 2023-12-06T15:00:24.481 INFO:tasks.workunit.client.1.smithi190.stdout:6/475: write d4/d12/d1a/d44/f56 [4395945,9840] 0 2023-12-06T15:00:24.481 INFO:tasks.workunit.client.1.smithi190.stdout:6/476: fsync d4/d12/d1a/d44/f57 0 2023-12-06T15:00:24.481 INFO:tasks.workunit.client.1.smithi190.stdout:5/288: write d0/d1c/d2b/d2c/f43 [1997628,108471] 0 2023-12-06T15:00:24.481 INFO:tasks.workunit.client.1.smithi190.stdout:5/289: stat d0/d1c/d2b/f32 0 2023-12-06T15:00:24.482 INFO:tasks.workunit.client.1.smithi190.stdout:5/290: stat d0/d1c/d2b/f48 0 2023-12-06T15:00:24.483 INFO:tasks.workunit.client.0.smithi152.stdout:7/148: unlink dd/c16 0 2023-12-06T15:00:24.483 INFO:tasks.workunit.client.0.smithi152.stdout:7/149: fdatasync dd/df/d22/d29/f2a 0 2023-12-06T15:00:24.483 INFO:tasks.workunit.client.0.smithi152.stdout:3/260: dread d9/f2d [0,4194304] 0 2023-12-06T15:00:24.483 INFO:tasks.workunit.client.0.smithi152.stdout:3/261: dread - d9/d10/d12/f1e zero size 2023-12-06T15:00:24.483 INFO:tasks.workunit.client.0.smithi152.stdout:9/217: creat d0/d31/f3a x:0 0 0 2023-12-06T15:00:24.483 INFO:tasks.workunit.client.0.smithi152.stdout:9/218: fdatasync d0/f1 0 2023-12-06T15:00:24.483 INFO:tasks.workunit.client.0.smithi152.stdout:3/262: write d9/d10/d19/f33 [145742,94837] 0 2023-12-06T15:00:24.484 INFO:tasks.workunit.client.1.smithi190.stdout:0/329: symlink d0/da/d3e/d2b/d3c/d4c/l6d 0 2023-12-06T15:00:24.484 INFO:tasks.workunit.client.1.smithi190.stdout:0/330: truncate d0/da/d3e/d2b/d3c/f5f 911460 0 2023-12-06T15:00:24.484 INFO:tasks.workunit.client.1.smithi190.stdout:8/352: symlink d1/d20/d3b/d34/l69 0 2023-12-06T15:00:24.484 INFO:tasks.workunit.client.0.smithi152.stdout:7/150: creat dd/f2f x:0 0 0 2023-12-06T15:00:24.484 INFO:tasks.workunit.client.0.smithi152.stdout:7/151: dread - dd/f2f zero size 2023-12-06T15:00:24.484 INFO:tasks.workunit.client.0.smithi152.stdout:7/152: truncate f9 2231321 0 2023-12-06T15:00:24.485 INFO:tasks.workunit.client.1.smithi190.stdout:6/477: rmdir d4/d12/d1a/d32 39 2023-12-06T15:00:24.486 INFO:tasks.workunit.client.1.smithi190.stdout:5/291: stat d0/ca 0 2023-12-06T15:00:24.486 INFO:tasks.workunit.client.0.smithi152.stdout:9/219: write d0/f15 [48071,13142] 0 2023-12-06T15:00:24.486 INFO:tasks.workunit.client.0.smithi152.stdout:7/153: creat dd/df/d1b/d20/d28/f30 x:0 0 0 2023-12-06T15:00:24.486 INFO:tasks.workunit.client.0.smithi152.stdout:0/199: dwrite d8/d15/f26 [0,4194304] 0 2023-12-06T15:00:24.487 INFO:tasks.workunit.client.0.smithi152.stdout:0/200: fsync d8/d15/f18 0 2023-12-06T15:00:24.487 INFO:tasks.workunit.client.1.smithi190.stdout:0/331: link d0/da/d3e/d3a/d40/c27 d0/da/d3e/d2b/c6e 0 2023-12-06T15:00:24.488 INFO:tasks.workunit.client.0.smithi152.stdout:9/220: creat d0/dd/f3b x:0 0 0 2023-12-06T15:00:24.488 INFO:tasks.workunit.client.0.smithi152.stdout:9/221: dread - d0/d31/f3a zero size 2023-12-06T15:00:24.488 INFO:tasks.workunit.client.1.smithi190.stdout:8/353: mknod d1/d10/d1c/d4b/c6a 0 2023-12-06T15:00:24.488 INFO:tasks.workunit.client.0.smithi152.stdout:7/154: symlink dd/df/l31 0 2023-12-06T15:00:24.489 INFO:tasks.workunit.client.0.smithi152.stdout:0/201: symlink d8/l3c 0 2023-12-06T15:00:24.490 INFO:tasks.workunit.client.1.smithi190.stdout:5/292: dread d0/d1c/d2b/d2c/f45 [0,4194304] 0 2023-12-06T15:00:24.491 INFO:tasks.workunit.client.0.smithi152.stdout:9/222: creat d0/dd/d20/f3c x:0 0 0 2023-12-06T15:00:24.491 INFO:tasks.workunit.client.0.smithi152.stdout:9/223: chown d0/c4 1 1 2023-12-06T15:00:24.492 INFO:tasks.workunit.client.0.smithi152.stdout:9/224: read - d0/dd/f2f zero size 2023-12-06T15:00:24.492 INFO:tasks.workunit.client.0.smithi152.stdout:9/225: chown d0/dd/d20/l39 93031377 1 2023-12-06T15:00:24.492 INFO:tasks.workunit.client.0.smithi152.stdout:7/155: rmdir dd/df/d1b 39 2023-12-06T15:00:24.493 INFO:tasks.workunit.client.0.smithi152.stdout:7/156: truncate fa 1134059 0 2023-12-06T15:00:24.493 INFO:tasks.workunit.client.0.smithi152.stdout:7/157: readlink dd/df/l31 0 2023-12-06T15:00:24.493 INFO:tasks.workunit.client.0.smithi152.stdout:7/158: rename dd to dd/d17/d32 22 2023-12-06T15:00:24.494 INFO:tasks.workunit.client.0.smithi152.stdout:9/226: creat d0/dd/d20/d38/f3d x:0 0 0 2023-12-06T15:00:24.494 INFO:tasks.workunit.client.0.smithi152.stdout:9/227: write d0/dd/d20/f26 [487469,62330] 0 2023-12-06T15:00:24.494 INFO:tasks.workunit.client.0.smithi152.stdout:9/228: chown d0/f6 45 1 2023-12-06T15:00:24.495 INFO:tasks.workunit.client.0.smithi152.stdout:9/229: dread - d0/f1c zero size 2023-12-06T15:00:24.496 INFO:tasks.workunit.client.0.smithi152.stdout:2/149: dread f5 [0,4194304] 0 2023-12-06T15:00:24.496 INFO:tasks.workunit.client.0.smithi152.stdout:2/150: read - d6/d1e/f2e zero size 2023-12-06T15:00:24.501 INFO:tasks.workunit.client.1.smithi190.stdout:3/520: dwrite d4/d70/d53/d56/d8f/fa2 [0,4194304] 0 2023-12-06T15:00:24.503 INFO:tasks.workunit.client.1.smithi190.stdout:3/521: creat d4/fbb x:0 0 0 2023-12-06T15:00:24.505 INFO:tasks.workunit.client.0.smithi152.stdout:1/435: dwrite d3/da/d15/d17/d43/f9e [0,4194304] 0 2023-12-06T15:00:24.506 INFO:tasks.workunit.client.0.smithi152.stdout:2/151: write d6/f15 [2716724,84859] 0 2023-12-06T15:00:24.506 INFO:tasks.workunit.client.0.smithi152.stdout:2/152: stat d6/d18 0 2023-12-06T15:00:24.507 INFO:tasks.workunit.client.1.smithi190.stdout:3/522: mknod d4/d1b/d54/d9c/d68/d8a/cbc 0 2023-12-06T15:00:24.510 INFO:tasks.workunit.client.0.smithi152.stdout:8/119: dread d1/d6/d7/f1a [0,4194304] 0 2023-12-06T15:00:24.512 INFO:tasks.workunit.client.0.smithi152.stdout:2/153: mknod d6/d1e/d27/c31 0 2023-12-06T15:00:24.512 INFO:tasks.workunit.client.0.smithi152.stdout:2/154: stat d6/c9 0 2023-12-06T15:00:24.512 INFO:tasks.workunit.client.1.smithi190.stdout:1/597: fsync d6/dc/d29/f53 0 2023-12-06T15:00:24.512 INFO:tasks.workunit.client.1.smithi190.stdout:1/598: truncate d6/dc/d29/f83 4720223 0 2023-12-06T15:00:24.513 INFO:tasks.workunit.client.0.smithi152.stdout:5/216: dwrite d7/dd/d26/f2e [4194304,4194304] 0 2023-12-06T15:00:24.515 INFO:tasks.workunit.client.1.smithi190.stdout:2/370: dwrite d10/d26/d5c/d49/f55 [0,4194304] 0 2023-12-06T15:00:24.517 INFO:tasks.workunit.client.1.smithi190.stdout:4/315: dwrite d3/d35/d19/d30/f3a [4194304,4194304] 0 2023-12-06T15:00:24.518 INFO:tasks.workunit.client.1.smithi190.stdout:9/388: dwrite d4/f22 [0,4194304] 0 2023-12-06T15:00:24.523 INFO:tasks.workunit.client.0.smithi152.stdout:2/155: dread d6/db/d17/f1d [0,4194304] 0 2023-12-06T15:00:24.523 INFO:tasks.workunit.client.1.smithi190.stdout:2/371: mkdir d10/d26/d5b/d7f 0 2023-12-06T15:00:24.523 INFO:tasks.workunit.client.1.smithi190.stdout:8/354: rmdir d1/d37 39 2023-12-06T15:00:24.526 INFO:tasks.workunit.client.0.smithi152.stdout:8/120: rmdir d1/d6/d7 39 2023-12-06T15:00:24.529 INFO:tasks.workunit.client.0.smithi152.stdout:8/121: truncate d1/d6/db/f11 2163907 0 2023-12-06T15:00:24.529 INFO:tasks.workunit.client.0.smithi152.stdout:8/122: fdatasync d1/f1c 0 2023-12-06T15:00:24.533 INFO:tasks.workunit.client.0.smithi152.stdout:5/217: read d7/dd/d26/f2e [2904485,18186] 0 2023-12-06T15:00:24.533 INFO:tasks.workunit.client.0.smithi152.stdout:5/218: write d7/f38 [638391,43717] 0 2023-12-06T15:00:24.536 INFO:tasks.workunit.client.1.smithi190.stdout:4/316: rmdir d3/d10/d39/d54 39 2023-12-06T15:00:24.536 INFO:tasks.workunit.client.1.smithi190.stdout:4/317: dread - d3/d10/d39/f62 zero size 2023-12-06T15:00:24.536 INFO:tasks.workunit.client.1.smithi190.stdout:0/332: dwrite d0/da/d3e/d3a/d40/f28 [0,4194304] 0 2023-12-06T15:00:24.536 INFO:tasks.workunit.client.1.smithi190.stdout:2/372: unlink d10/d59/d5e/c1d 0 2023-12-06T15:00:24.539 INFO:tasks.workunit.client.0.smithi152.stdout:3/263: dwrite d9/d10/d19/f2c [8388608,4194304] 0 2023-12-06T15:00:24.539 INFO:tasks.workunit.client.0.smithi152.stdout:8/123: dread d1/d6/f22 [0,4194304] 0 2023-12-06T15:00:24.539 INFO:tasks.workunit.client.1.smithi190.stdout:0/333: mkdir d0/da/d3e/d3a/d40/d6f 0 2023-12-06T15:00:24.539 INFO:tasks.workunit.client.1.smithi190.stdout:0/334: write d0/da/d3e/d2b/d37/f39 [4200202,73709] 0 2023-12-06T15:00:24.542 INFO:tasks.workunit.client.1.smithi190.stdout:1/599: dread d6/f90 [0,4194304] 0 2023-12-06T15:00:24.544 INFO:tasks.workunit.client.0.smithi152.stdout:3/264: mknod d9/d18/d39/c4d 0 2023-12-06T15:00:24.544 INFO:tasks.workunit.client.0.smithi152.stdout:8/124: symlink d1/l23 0 2023-12-06T15:00:24.544 INFO:tasks.workunit.client.0.smithi152.stdout:8/125: write d1/d6/d7/f21 [615203,55556] 0 2023-12-06T15:00:24.545 INFO:tasks.workunit.client.1.smithi190.stdout:1/600: creat d6/d49/fc1 x:0 0 0 2023-12-06T15:00:24.547 INFO:tasks.workunit.client.0.smithi152.stdout:9/230: getdents d0/dd 0 2023-12-06T15:00:24.547 INFO:tasks.workunit.client.0.smithi152.stdout:9/231: write d0/f5 [4681505,30997] 0 2023-12-06T15:00:24.547 INFO:tasks.workunit.client.0.smithi152.stdout:9/232: dread - d0/d31/f37 zero size 2023-12-06T15:00:24.548 INFO:tasks.workunit.client.0.smithi152.stdout:7/159: dwrite f3 [0,4194304] 0 2023-12-06T15:00:24.549 INFO:tasks.workunit.client.0.smithi152.stdout:3/265: write d9/d10/d19/f2c [7736954,123690] 0 2023-12-06T15:00:24.551 INFO:tasks.workunit.client.0.smithi152.stdout:9/233: creat d0/dd/f3e x:0 0 0 2023-12-06T15:00:24.553 INFO:tasks.workunit.client.1.smithi190.stdout:0/335: dread d0/da/d3e/d3a/d40/f28 [0,4194304] 0 2023-12-06T15:00:24.554 INFO:tasks.workunit.client.0.smithi152.stdout:3/266: creat d9/d18/d1a/f4e x:0 0 0 2023-12-06T15:00:24.554 INFO:tasks.workunit.client.0.smithi152.stdout:9/234: mkdir d0/d3f 0 2023-12-06T15:00:24.555 INFO:tasks.workunit.client.1.smithi190.stdout:8/355: dread d1/f1b [0,4194304] 0 2023-12-06T15:00:24.555 INFO:tasks.workunit.client.1.smithi190.stdout:9/389: write d4/fa [297430,84067] 0 2023-12-06T15:00:24.555 INFO:tasks.workunit.client.1.smithi190.stdout:0/336: rmdir d0/da/d3e/d3a 39 2023-12-06T15:00:24.556 INFO:tasks.workunit.client.0.smithi152.stdout:3/267: dread d9/d10/d12/f3e [0,4194304] 0 2023-12-06T15:00:24.556 INFO:tasks.workunit.client.0.smithi152.stdout:9/235: rename d0/dd/d20/c2d to d0/d31/c40 0 2023-12-06T15:00:24.557 INFO:tasks.workunit.client.0.smithi152.stdout:9/236: chown d0/f23 16276350 1 2023-12-06T15:00:24.557 INFO:tasks.workunit.client.0.smithi152.stdout:9/237: chown d0/dd/d20/l39 11031 1 2023-12-06T15:00:24.557 INFO:tasks.workunit.client.1.smithi190.stdout:3/523: dwrite d4/d1b/d69/f90 [0,4194304] 0 2023-12-06T15:00:24.557 INFO:tasks.workunit.client.1.smithi190.stdout:3/524: truncate d4/d1b/d5d/faf 53330 0 2023-12-06T15:00:24.557 INFO:tasks.workunit.client.1.smithi190.stdout:3/525: write d4/d1b/d5d/faf [493709,104828] 0 2023-12-06T15:00:24.557 INFO:tasks.workunit.client.1.smithi190.stdout:3/526: stat d4/d70/d19/l52 0 2023-12-06T15:00:24.557 INFO:tasks.workunit.client.1.smithi190.stdout:3/527: write d4/d70/d53/d56/d94/f81 [770231,113241] 0 2023-12-06T15:00:24.557 INFO:tasks.workunit.client.1.smithi190.stdout:6/478: dwrite d4/d12/d1a/d59/f78 [0,4194304] 0 2023-12-06T15:00:24.558 INFO:tasks.workunit.client.0.smithi152.stdout:3/268: read d9/f38 [88847,99484] 0 2023-12-06T15:00:24.562 INFO:tasks.workunit.client.1.smithi190.stdout:7/423: write d0/f3 [2150755,30380] 0 2023-12-06T15:00:24.562 INFO:tasks.workunit.client.1.smithi190.stdout:0/337: creat d0/da/d3e/d2b/d3c/d65/f70 x:0 0 0 2023-12-06T15:00:24.562 INFO:tasks.workunit.client.1.smithi190.stdout:0/338: dread - d0/da/d3e/d2b/d3c/d65/f70 zero size 2023-12-06T15:00:24.565 INFO:tasks.workunit.client.1.smithi190.stdout:8/356: mknod d1/d20/d3b/d4c/d5a/c6b 0 2023-12-06T15:00:24.565 INFO:tasks.workunit.client.1.smithi190.stdout:8/357: truncate d1/d20/d3b/f53 717161 0 2023-12-06T15:00:24.566 INFO:tasks.workunit.client.1.smithi190.stdout:8/358: read d1/d20/d3b/d4c/d5a/f66 [449804,42605] 0 2023-12-06T15:00:24.566 INFO:tasks.workunit.client.1.smithi190.stdout:8/359: chown d1/d10/d1c/f4e 10734092 1 2023-12-06T15:00:24.567 INFO:tasks.workunit.client.1.smithi190.stdout:6/479: mkdir d4/d12/d9a 0 2023-12-06T15:00:24.568 INFO:tasks.workunit.client.1.smithi190.stdout:7/424: getdents d0/d5/d1b 0 2023-12-06T15:00:24.569 INFO:tasks.workunit.client.1.smithi190.stdout:0/339: creat d0/da/d3e/d2b/d3c/f71 x:0 0 0 2023-12-06T15:00:24.572 INFO:tasks.workunit.client.1.smithi190.stdout:8/360: creat d1/f6c x:0 0 0 2023-12-06T15:00:24.572 INFO:tasks.workunit.client.1.smithi190.stdout:7/425: write d0/df/d1f/f46 [600761,9290] 0 2023-12-06T15:00:24.572 INFO:tasks.workunit.client.1.smithi190.stdout:7/426: stat d0/d5/d63 0 2023-12-06T15:00:24.572 INFO:tasks.workunit.client.1.smithi190.stdout:7/427: write d0/d5/da/f48 [1046068,75361] 0 2023-12-06T15:00:24.573 INFO:tasks.workunit.client.1.smithi190.stdout:0/340: creat d0/da/d3e/d2b/d3c/d65/f72 x:0 0 0 2023-12-06T15:00:24.573 INFO:tasks.workunit.client.1.smithi190.stdout:0/341: truncate d0/da/d3e/d2b/d3c/f5f 1102555 0 2023-12-06T15:00:24.574 INFO:tasks.workunit.client.1.smithi190.stdout:7/428: creat d0/d35/f84 x:0 0 0 2023-12-06T15:00:24.575 INFO:tasks.workunit.client.1.smithi190.stdout:0/342: rename d0/da/d3e/d3a/d40/f24 to d0/da/d3e/d2b/d3c/d46/f73 0 2023-12-06T15:00:24.576 INFO:tasks.workunit.client.1.smithi190.stdout:7/429: truncate d0/f30 1842815 0 2023-12-06T15:00:24.576 INFO:tasks.workunit.client.1.smithi190.stdout:7/430: fsync d0/d5/da/f49 0 2023-12-06T15:00:24.578 INFO:tasks.workunit.client.1.smithi190.stdout:8/361: dread d1/f51 [0,4194304] 0 2023-12-06T15:00:24.578 INFO:tasks.workunit.client.1.smithi190.stdout:7/431: rename d0/d5/d1b/d1c/f71 to d0/d5/da/d56/f85 0 2023-12-06T15:00:24.578 INFO:tasks.workunit.client.1.smithi190.stdout:7/432: dread - d0/d5/f7f zero size 2023-12-06T15:00:24.579 INFO:tasks.workunit.client.1.smithi190.stdout:0/343: mkdir d0/da/d74 0 2023-12-06T15:00:24.580 INFO:tasks.workunit.client.1.smithi190.stdout:8/362: creat d1/d20/d3b/d36/d50/f6d x:0 0 0 2023-12-06T15:00:24.580 INFO:tasks.workunit.client.1.smithi190.stdout:8/363: chown d1/d10/f5e 2960263 1 2023-12-06T15:00:24.581 INFO:tasks.workunit.client.1.smithi190.stdout:8/364: chown d1/d20/l23 14217857 1 2023-12-06T15:00:24.581 INFO:tasks.workunit.client.1.smithi190.stdout:7/433: creat d0/d5/d1b/d33/d60/f86 x:0 0 0 2023-12-06T15:00:24.582 INFO:tasks.workunit.client.1.smithi190.stdout:0/344: creat d0/f75 x:0 0 0 2023-12-06T15:00:24.584 INFO:tasks.workunit.client.1.smithi190.stdout:0/345: unlink d0/da/d3e/l1c 0 2023-12-06T15:00:24.584 INFO:tasks.workunit.client.1.smithi190.stdout:0/346: readlink d0/da/d3e/d2b/d3c/d4c/l6d 0 2023-12-06T15:00:24.584 INFO:tasks.workunit.client.1.smithi190.stdout:8/365: symlink d1/d20/d3b/d4c/d5a/l6e 0 2023-12-06T15:00:24.597 INFO:tasks.workunit.client.1.smithi190.stdout:5/293: dwrite d0/d1c/d2b/d2c/f43 [0,4194304] 0 2023-12-06T15:00:24.597 INFO:tasks.workunit.client.1.smithi190.stdout:5/294: truncate d0/f44 647656 0 2023-12-06T15:00:24.597 INFO:tasks.workunit.client.0.smithi152.stdout:2/156: dwrite d6/db/d13/f14 [0,4194304] 0 2023-12-06T15:00:24.597 INFO:tasks.workunit.client.0.smithi152.stdout:0/202: dwrite d8/f17 [0,4194304] 0 2023-12-06T15:00:24.598 INFO:tasks.workunit.client.0.smithi152.stdout:0/203: write d8/d1b/f27 [128325,127349] 0 2023-12-06T15:00:24.598 INFO:tasks.workunit.client.0.smithi152.stdout:0/204: rmdir d8/d38 39 2023-12-06T15:00:24.598 INFO:tasks.workunit.client.0.smithi152.stdout:0/205: readlink d8/d1b/l35 0 2023-12-06T15:00:24.600 INFO:tasks.workunit.client.0.smithi152.stdout:0/206: mknod d8/d1b/c3d 0 2023-12-06T15:00:24.600 INFO:tasks.workunit.client.0.smithi152.stdout:0/207: truncate d8/f37 394807 0 2023-12-06T15:00:24.604 INFO:tasks.workunit.client.1.smithi190.stdout:2/373: dwrite d10/d26/d5c/f63 [0,4194304] 0 2023-12-06T15:00:24.608 INFO:tasks.workunit.client.1.smithi190.stdout:2/374: creat d10/d26/d5b/f80 x:0 0 0 2023-12-06T15:00:24.609 INFO:tasks.workunit.client.1.smithi190.stdout:4/318: dwrite d3/d35/d19/d41/d44/d5b/f61 [0,4194304] 0 2023-12-06T15:00:24.609 INFO:tasks.workunit.client.1.smithi190.stdout:3/528: dwrite d4/d70/f9b [0,4194304] 0 2023-12-06T15:00:24.609 INFO:tasks.workunit.client.1.smithi190.stdout:3/529: dread - d4/d1b/d54/d9c/fb2 zero size 2023-12-06T15:00:24.610 INFO:tasks.workunit.client.1.smithi190.stdout:1/601: dwrite d6/dc/d29/d38/fa5 [0,4194304] 0 2023-12-06T15:00:24.611 INFO:tasks.workunit.client.0.smithi152.stdout:1/436: dwrite d3/da/d15/f3f [0,4194304] 0 2023-12-06T15:00:24.612 INFO:tasks.workunit.client.0.smithi152.stdout:3/269: dwrite d9/f37 [0,4194304] 0 2023-12-06T15:00:24.612 INFO:tasks.workunit.client.0.smithi152.stdout:1/437: readlink d3/da/d15/d17/d1a/l71 0 2023-12-06T15:00:24.612 INFO:tasks.workunit.client.1.smithi190.stdout:2/375: unlink d10/d59/d5e/c17 0 2023-12-06T15:00:24.614 INFO:tasks.workunit.client.1.smithi190.stdout:9/390: dwrite d4/d27/d2f/d31/d3f/f69 [0,4194304] 0 2023-12-06T15:00:24.615 INFO:tasks.workunit.client.1.smithi190.stdout:1/602: write d6/f12 [187538,52984] 0 2023-12-06T15:00:24.616 INFO:tasks.workunit.client.1.smithi190.stdout:1/603: chown d6/dc/d29/d38/la2 0 1 2023-12-06T15:00:24.616 INFO:tasks.workunit.client.1.smithi190.stdout:1/604: chown d6/dc/d29/d38/fa5 33966802 1 2023-12-06T15:00:24.617 INFO:tasks.workunit.client.0.smithi152.stdout:1/438: write d3/da/d15/d17/d43/f9e [3847130,39228] 0 2023-12-06T15:00:24.617 INFO:tasks.workunit.client.1.smithi190.stdout:4/319: getdents d3/d35 0 2023-12-06T15:00:24.617 INFO:tasks.workunit.client.1.smithi190.stdout:4/320: fsync d3/fd 0 2023-12-06T15:00:24.617 INFO:tasks.workunit.client.1.smithi190.stdout:7/434: dwrite d0/d5/d1b/d1c/f4d [0,4194304] 0 2023-12-06T15:00:24.618 INFO:tasks.workunit.client.1.smithi190.stdout:6/480: rmdir d4 39 2023-12-06T15:00:24.620 INFO:tasks.workunit.client.1.smithi190.stdout:2/376: symlink d10/d26/l81 0 2023-12-06T15:00:24.620 INFO:tasks.workunit.client.1.smithi190.stdout:2/377: chown d10/d26/d5c/d49/l4a 7 1 2023-12-06T15:00:24.620 INFO:tasks.workunit.client.1.smithi190.stdout:2/378: truncate d10/d26/d5c/d37/f69 669911 0 2023-12-06T15:00:24.620 INFO:tasks.workunit.client.1.smithi190.stdout:2/379: getdents d10/d59/d5e/d71 0 2023-12-06T15:00:24.620 INFO:tasks.workunit.client.1.smithi190.stdout:2/380: write d10/f39 [4229659,9317] 0 2023-12-06T15:00:24.621 INFO:tasks.workunit.client.1.smithi190.stdout:8/366: dwrite d1/d37/f45 [0,4194304] 0 2023-12-06T15:00:24.623 INFO:tasks.workunit.client.1.smithi190.stdout:7/435: write d0/df/f45 [3175959,121213] 0 2023-12-06T15:00:24.623 INFO:tasks.workunit.client.1.smithi190.stdout:9/391: mknod d4/d27/d2f/d31/d3f/d58/d72/d7a/c88 0 2023-12-06T15:00:24.627 INFO:tasks.workunit.client.1.smithi190.stdout:1/605: symlink d6/dc/d6f/lc2 0 2023-12-06T15:00:24.627 INFO:tasks.workunit.client.1.smithi190.stdout:4/321: creat d3/d35/f6a x:0 0 0 2023-12-06T15:00:24.631 INFO:tasks.workunit.client.1.smithi190.stdout:7/436: mkdir d0/d5/d1b/d41/d87 0 2023-12-06T15:00:24.631 INFO:tasks.workunit.client.1.smithi190.stdout:7/437: fdatasync d0/d5/d1b/d33/f80 0 2023-12-06T15:00:24.632 INFO:tasks.workunit.client.1.smithi190.stdout:4/322: mknod d3/d4e/c6b 0 2023-12-06T15:00:24.634 INFO:tasks.workunit.client.0.smithi152.stdout:0/208: dwrite d8/d15/f2c [0,4194304] 0 2023-12-06T15:00:24.635 INFO:tasks.workunit.client.0.smithi152.stdout:2/157: dwrite d6/db/d17/f28 [0,4194304] 0 2023-12-06T15:00:24.635 INFO:tasks.workunit.client.0.smithi152.stdout:2/158: fdatasync d6/db/d17/f23 0 2023-12-06T15:00:24.635 INFO:tasks.workunit.client.0.smithi152.stdout:2/159: chown d6/d1e/c21 93214 1 2023-12-06T15:00:24.637 INFO:tasks.workunit.client.1.smithi190.stdout:2/381: dread d10/d26/f72 [0,4194304] 0 2023-12-06T15:00:24.637 INFO:tasks.workunit.client.1.smithi190.stdout:1/606: write d6/dc/d29/d38/d73/f41 [143510,21029] 0 2023-12-06T15:00:24.637 INFO:tasks.workunit.client.0.smithi152.stdout:0/209: dread d8/d1b/f27 [0,4194304] 0 2023-12-06T15:00:24.638 INFO:tasks.workunit.client.1.smithi190.stdout:4/323: mkdir d3/d35/d19/d6c 0 2023-12-06T15:00:24.638 INFO:tasks.workunit.client.1.smithi190.stdout:8/367: dread d1/d10/d1c/f64 [0,4194304] 0 2023-12-06T15:00:24.638 INFO:tasks.workunit.client.1.smithi190.stdout:0/347: getdents d0/da 0 2023-12-06T15:00:24.643 INFO:tasks.workunit.client.1.smithi190.stdout:0/348: write d0/da/d3e/d2b/d3c/d46/f52 [2748541,113999] 0 2023-12-06T15:00:24.643 INFO:tasks.workunit.client.1.smithi190.stdout:0/349: fdatasync d0/da/d3e/d2b/d3c/d65/f70 0 2023-12-06T15:00:24.643 INFO:tasks.workunit.client.1.smithi190.stdout:2/382: creat d10/d26/d5c/d35/f82 x:0 0 0 2023-12-06T15:00:24.645 INFO:tasks.workunit.client.1.smithi190.stdout:1/607: truncate d6/dc/d29/d38/d43/f61 2669228 0 2023-12-06T15:00:24.647 INFO:tasks.workunit.client.1.smithi190.stdout:4/324: creat d3/f6d x:0 0 0 2023-12-06T15:00:24.647 INFO:tasks.workunit.client.1.smithi190.stdout:8/368: symlink d1/d10/l6f 0 2023-12-06T15:00:24.647 INFO:tasks.workunit.client.1.smithi190.stdout:4/325: fsync d3/f9 0 2023-12-06T15:00:24.648 INFO:tasks.workunit.client.1.smithi190.stdout:0/350: unlink d0/da/l1d 0 2023-12-06T15:00:24.648 INFO:tasks.workunit.client.1.smithi190.stdout:8/369: symlink d1/d20/l70 0 2023-12-06T15:00:24.649 INFO:tasks.workunit.client.1.smithi190.stdout:8/370: read - d1/d20/f42 zero size 2023-12-06T15:00:24.650 INFO:tasks.workunit.client.0.smithi152.stdout:8/126: dwrite d1/d6/db/f11 [0,4194304] 0 2023-12-06T15:00:24.653 INFO:tasks.workunit.client.1.smithi190.stdout:4/326: symlink d3/d35/d19/d41/l6e 0 2023-12-06T15:00:24.653 INFO:tasks.workunit.client.1.smithi190.stdout:6/481: dwrite d4/d12/d1a/d32/f5d [0,4194304] 0 2023-12-06T15:00:24.653 INFO:tasks.workunit.client.1.smithi190.stdout:9/392: dwrite d4/d27/d2f/d5c/f6c [0,4194304] 0 2023-12-06T15:00:24.653 INFO:tasks.workunit.client.1.smithi190.stdout:0/351: creat d0/da/d3e/d2b/d37/f76 x:0 0 0 2023-12-06T15:00:24.655 INFO:tasks.workunit.client.1.smithi190.stdout:5/295: dwrite d0/d1c/d2b/d2c/f43 [0,4194304] 0 2023-12-06T15:00:24.656 INFO:tasks.workunit.client.1.smithi190.stdout:8/371: unlink d1/d20/d3b/d36/c44 0 2023-12-06T15:00:24.659 INFO:tasks.workunit.client.1.smithi190.stdout:6/482: read d4/d12/d1a/f1c [249836,5743] 0 2023-12-06T15:00:24.659 INFO:tasks.workunit.client.1.smithi190.stdout:5/296: dread d0/f44 [0,4194304] 0 2023-12-06T15:00:24.661 INFO:tasks.workunit.client.1.smithi190.stdout:8/372: symlink d1/l71 0 2023-12-06T15:00:24.663 INFO:tasks.workunit.client.1.smithi190.stdout:6/483: creat d4/d12/d40/d43/f9b x:0 0 0 2023-12-06T15:00:24.663 INFO:tasks.workunit.client.1.smithi190.stdout:6/484: chown d4/d12/d40/d43/d45/d4a/l75 2499 1 2023-12-06T15:00:24.665 INFO:tasks.workunit.client.1.smithi190.stdout:5/297: symlink d0/d1c/d2b/d2c/d5d/l5e 0 2023-12-06T15:00:24.667 INFO:tasks.workunit.client.1.smithi190.stdout:5/298: dread d0/f53 [0,4194304] 0 2023-12-06T15:00:24.668 INFO:tasks.workunit.client.1.smithi190.stdout:7/438: rename d0/d5/d1b to d0/d88 0 2023-12-06T15:00:24.668 INFO:tasks.workunit.client.1.smithi190.stdout:0/352: rename d0/da/d3e/d2b/d3c to d0/da/d3e/d2b/d3c/d46/d77 22 2023-12-06T15:00:24.668 INFO:tasks.workunit.client.1.smithi190.stdout:0/353: dread - d0/da/f5c zero size 2023-12-06T15:00:24.668 INFO:tasks.workunit.client.1.smithi190.stdout:6/485: mknod d4/d12/d1a/c9c 0 2023-12-06T15:00:24.669 INFO:tasks.workunit.client.1.smithi190.stdout:5/299: mkdir d0/d1c/d3e/d5a/d5f 0 2023-12-06T15:00:24.670 INFO:tasks.workunit.client.1.smithi190.stdout:7/439: symlink d0/d88/d41/d87/l89 0 2023-12-06T15:00:24.671 INFO:tasks.workunit.client.1.smithi190.stdout:0/354: rmdir d0/da 39 2023-12-06T15:00:24.671 INFO:tasks.workunit.client.1.smithi190.stdout:0/355: dread - d0/da/d3e/d2b/d3c/f71 zero size 2023-12-06T15:00:24.671 INFO:tasks.workunit.client.1.smithi190.stdout:0/356: write d0/da/d3e/d2b/f4d [27668,18611] 0 2023-12-06T15:00:24.673 INFO:tasks.workunit.client.1.smithi190.stdout:6/486: unlink d4/d12/d1a/d59/f78 0 2023-12-06T15:00:24.674 INFO:tasks.workunit.client.1.smithi190.stdout:5/300: dread d0/d1c/f36 [0,4194304] 0 2023-12-06T15:00:24.674 INFO:tasks.workunit.client.1.smithi190.stdout:5/301: write d0/d1c/f36 [310257,16648] 0 2023-12-06T15:00:24.675 INFO:tasks.workunit.client.1.smithi190.stdout:0/357: symlink d0/da/d3e/d2b/d3c/d46/d61/l78 0 2023-12-06T15:00:24.675 INFO:tasks.workunit.client.1.smithi190.stdout:0/358: dread - d0/f75 zero size 2023-12-06T15:00:24.675 INFO:tasks.workunit.client.1.smithi190.stdout:0/359: readlink d0/da/d3e/d3a/d40/l7 0 2023-12-06T15:00:24.676 INFO:tasks.workunit.client.1.smithi190.stdout:8/373: dread d1/f16 [0,4194304] 0 2023-12-06T15:00:24.676 INFO:tasks.workunit.client.1.smithi190.stdout:8/374: fsync d1/d20/d3b/d34/f40 0 2023-12-06T15:00:24.676 INFO:tasks.workunit.client.1.smithi190.stdout:8/375: write d1/d20/f42 [701291,124551] 0 2023-12-06T15:00:24.676 INFO:tasks.workunit.client.1.smithi190.stdout:6/487: creat d4/d12/d1a/d32/f9d x:0 0 0 2023-12-06T15:00:24.676 INFO:tasks.workunit.client.1.smithi190.stdout:6/488: readlink d4/d12/d40/d43/d45/d4a/l75 0 2023-12-06T15:00:24.677 INFO:tasks.workunit.client.1.smithi190.stdout:7/440: write d0/df/d1f/f58 [2639737,65825] 0 2023-12-06T15:00:24.677 INFO:tasks.workunit.client.1.smithi190.stdout:7/441: write d0/d88/d1c/f23 [1038820,40478] 0 2023-12-06T15:00:24.677 INFO:tasks.workunit.client.1.smithi190.stdout:7/442: truncate d0/f34 906633 0 2023-12-06T15:00:24.677 INFO:tasks.workunit.client.1.smithi190.stdout:5/302: creat d0/d1c/d3e/f60 x:0 0 0 2023-12-06T15:00:24.678 INFO:tasks.workunit.client.1.smithi190.stdout:0/360: symlink d0/da/d74/l79 0 2023-12-06T15:00:24.679 INFO:tasks.workunit.client.1.smithi190.stdout:2/383: dwrite d10/d26/d5c/d37/f3d [4194304,4194304] 0 2023-12-06T15:00:24.681 INFO:tasks.workunit.client.1.smithi190.stdout:1/608: dwrite d6/dc/d29/d38/d73/f91 [0,4194304] 0 2023-12-06T15:00:24.681 INFO:tasks.workunit.client.1.smithi190.stdout:8/376: unlink d1/d20/d3b/d4c/c5b 0 2023-12-06T15:00:24.681 INFO:tasks.workunit.client.0.smithi152.stdout:8/127: dwrite d1/d6/f1b [0,4194304] 0 2023-12-06T15:00:24.682 INFO:tasks.workunit.client.1.smithi190.stdout:9/393: dwrite d4/d27/d2f/d31/d3f/d58/d72/f80 [0,4194304] 0 2023-12-06T15:00:24.683 INFO:tasks.workunit.client.1.smithi190.stdout:5/303: truncate d0/d12/f13 3432435 0 2023-12-06T15:00:24.683 INFO:tasks.workunit.client.1.smithi190.stdout:6/489: rename d4/d12/d1a/f42 to d4/d12/d40/f9e 0 2023-12-06T15:00:24.684 INFO:tasks.workunit.client.1.smithi190.stdout:5/304: chown d0/df/d50/l5c 824188 1 2023-12-06T15:00:24.685 INFO:tasks.workunit.client.1.smithi190.stdout:0/361: creat d0/da/d3e/d2b/d37/f7a x:0 0 0 2023-12-06T15:00:24.692 INFO:tasks.workunit.client.1.smithi190.stdout:1/609: creat d6/dc/d29/d38/d73/d76/fc3 x:0 0 0 2023-12-06T15:00:24.692 INFO:tasks.workunit.client.1.smithi190.stdout:8/377: creat d1/d20/d3b/d34/d39/f72 x:0 0 0 2023-12-06T15:00:24.694 INFO:tasks.workunit.client.1.smithi190.stdout:9/394: mknod d4/d84/c89 0 2023-12-06T15:00:24.694 INFO:tasks.workunit.client.1.smithi190.stdout:6/490: truncate d4/d12/d40/d43/d45/d4a/d77/f85 423589 0 2023-12-06T15:00:24.698 INFO:tasks.workunit.client.1.smithi190.stdout:7/443: dread d0/df/f3f [0,4194304] 0 2023-12-06T15:00:24.698 INFO:tasks.workunit.client.1.smithi190.stdout:7/444: write d0/d5/da/f48 [1829782,61516] 0 2023-12-06T15:00:24.698 INFO:tasks.workunit.client.1.smithi190.stdout:9/395: write d4/d27/f49 [1921511,116164] 0 2023-12-06T15:00:24.698 INFO:tasks.workunit.client.1.smithi190.stdout:5/305: dread d0/d1c/d3e/f4c [0,4194304] 0 2023-12-06T15:00:24.698 INFO:tasks.workunit.client.1.smithi190.stdout:1/610: link d6/dc/d29/d38/d73/f91 d6/dc/d29/d38/d73/d76/d7e/fc4 0 2023-12-06T15:00:24.698 INFO:tasks.workunit.client.1.smithi190.stdout:1/611: chown d6/c77 821022410 1 2023-12-06T15:00:24.698 INFO:tasks.workunit.client.1.smithi190.stdout:8/378: creat d1/d37/f73 x:0 0 0 2023-12-06T15:00:24.699 INFO:tasks.workunit.client.1.smithi190.stdout:8/379: chown d1/d20/d3b/d34/d39/l63 0 1 2023-12-06T15:00:24.699 INFO:tasks.workunit.client.0.smithi152.stdout:8/128: dwrite d1/d6/db/f17 [0,4194304] 0 2023-12-06T15:00:24.700 INFO:tasks.workunit.client.1.smithi190.stdout:6/491: rename d4/d12/d1a/f39 to d4/d12/d1a/d8a/f9f 0 2023-12-06T15:00:24.700 INFO:tasks.workunit.client.1.smithi190.stdout:8/380: write d1/d10/d1c/f22 [3283234,42865] 0 2023-12-06T15:00:24.700 INFO:tasks.workunit.client.1.smithi190.stdout:0/362: dread d0/da/d3e/d2b/d3c/d4c/f59 [0,4194304] 0 2023-12-06T15:00:24.701 INFO:tasks.workunit.client.1.smithi190.stdout:9/396: truncate d4/f2d 2873012 0 2023-12-06T15:00:24.702 INFO:tasks.workunit.client.1.smithi190.stdout:5/306: symlink d0/d1c/d2b/l61 0 2023-12-06T15:00:24.703 INFO:tasks.workunit.client.1.smithi190.stdout:0/363: write d0/da/d3e/d3a/d40/f26 [213026,18602] 0 2023-12-06T15:00:24.703 INFO:tasks.workunit.client.1.smithi190.stdout:0/364: truncate d0/da/d3e/d2b/d3c/f5f 1116482 0 2023-12-06T15:00:24.707 INFO:tasks.workunit.client.1.smithi190.stdout:8/381: rmdir d1/d10/d25 39 2023-12-06T15:00:24.707 INFO:tasks.workunit.client.1.smithi190.stdout:8/382: readlink d1/l15 0 2023-12-06T15:00:24.707 INFO:tasks.workunit.client.1.smithi190.stdout:6/492: creat d4/d12/d1a/d8a/fa0 x:0 0 0 2023-12-06T15:00:24.708 INFO:tasks.workunit.client.1.smithi190.stdout:9/397: mkdir d4/d27/d8a 0 2023-12-06T15:00:24.708 INFO:tasks.workunit.client.1.smithi190.stdout:6/493: read d4/d15/f96 [896207,60891] 0 2023-12-06T15:00:24.708 INFO:tasks.workunit.client.1.smithi190.stdout:6/494: stat d4/d12/d1a/f20 0 2023-12-06T15:00:24.709 INFO:tasks.workunit.client.1.smithi190.stdout:8/383: mknod d1/d10/d1c/d4b/c74 0 2023-12-06T15:00:24.711 INFO:tasks.workunit.client.1.smithi190.stdout:9/398: creat d4/d84/f8b x:0 0 0 2023-12-06T15:00:24.711 INFO:tasks.workunit.client.1.smithi190.stdout:7/445: dread d0/df/d1f/f58 [0,4194304] 0 2023-12-06T15:00:24.711 INFO:tasks.workunit.client.1.smithi190.stdout:7/446: chown d0/d88/d32/l81 20707513 1 2023-12-06T15:00:24.712 INFO:tasks.workunit.client.1.smithi190.stdout:6/495: truncate d4/d12/f3f 1709944 0 2023-12-06T15:00:24.713 INFO:tasks.workunit.client.1.smithi190.stdout:1/612: dread d6/dc/d29/d38/fa5 [0,4194304] 0 2023-12-06T15:00:24.713 INFO:tasks.workunit.client.1.smithi190.stdout:1/613: chown d6/dc/d29/d38/d73/d5c/cb8 4343182 1 2023-12-06T15:00:24.713 INFO:tasks.workunit.client.0.smithi152.stdout:3/270: creat d9/d41/f4f x:0 0 0 2023-12-06T15:00:24.714 INFO:tasks.workunit.client.0.smithi152.stdout:3/271: read - d9/d10/d12/f1e zero size 2023-12-06T15:00:24.716 INFO:tasks.workunit.client.0.smithi152.stdout:1/439: symlink d3/da/d4c/d82/d75/la2 0 2023-12-06T15:00:24.716 INFO:tasks.workunit.client.1.smithi190.stdout:9/399: creat d4/d27/f8c x:0 0 0 2023-12-06T15:00:24.717 INFO:tasks.workunit.client.1.smithi190.stdout:7/447: getdents d0/d88/d41 0 2023-12-06T15:00:24.717 INFO:tasks.workunit.client.1.smithi190.stdout:7/448: fdatasync d0/f7b 0 2023-12-06T15:00:24.717 INFO:tasks.workunit.client.1.smithi190.stdout:7/449: fsync d0/d88/f57 0 2023-12-06T15:00:24.718 INFO:tasks.workunit.client.1.smithi190.stdout:7/450: fdatasync d0/d88/d7a/f69 0 2023-12-06T15:00:24.718 INFO:tasks.workunit.client.1.smithi190.stdout:7/451: stat d0/d88/d1c/f23 0 2023-12-06T15:00:24.719 INFO:tasks.workunit.client.1.smithi190.stdout:6/496: symlink d4/d12/d1a/d70/la1 0 2023-12-06T15:00:24.720 INFO:tasks.workunit.client.1.smithi190.stdout:7/452: creat d0/df/f8a x:0 0 0 2023-12-06T15:00:24.721 INFO:tasks.workunit.client.0.smithi152.stdout:2/160: creat d6/d18/f32 x:0 0 0 2023-12-06T15:00:24.723 INFO:tasks.workunit.client.1.smithi190.stdout:7/453: unlink d0/c62 0 2023-12-06T15:00:24.724 INFO:tasks.workunit.client.0.smithi152.stdout:0/210: mkdir d8/d3e 0 2023-12-06T15:00:24.726 INFO:tasks.workunit.client.1.smithi190.stdout:7/454: creat d0/d5/da/d56/f8b x:0 0 0 2023-12-06T15:00:24.732 INFO:tasks.workunit.client.1.smithi190.stdout:1/614: dread d6/dc/d29/d38/fa5 [0,4194304] 0 2023-12-06T15:00:24.732 INFO:tasks.workunit.client.1.smithi190.stdout:1/615: write d6/dc/d29/d38/d73/d76/fb3 [868437,9123] 0 2023-12-06T15:00:24.734 INFO:tasks.workunit.client.1.smithi190.stdout:1/616: creat d6/dc/d29/d38/d43/d7f/da7/fc5 x:0 0 0 2023-12-06T15:00:24.735 INFO:tasks.workunit.client.1.smithi190.stdout:5/307: dwrite d0/d12/f58 [0,4194304] 0 2023-12-06T15:00:24.735 INFO:tasks.workunit.client.1.smithi190.stdout:5/308: chown d0/df/f1a 95452 1 2023-12-06T15:00:24.736 INFO:tasks.workunit.client.1.smithi190.stdout:1/617: creat d6/dc/d29/d38/fc6 x:0 0 0 2023-12-06T15:00:24.736 INFO:tasks.workunit.client.1.smithi190.stdout:1/618: dread - d6/dc/d29/d38/d43/d7f/da7/fc5 zero size 2023-12-06T15:00:24.736 INFO:tasks.workunit.client.1.smithi190.stdout:1/619: chown d6/dc/d29/d38/d73/d5c/db5/fa8 212367764 1 2023-12-06T15:00:24.739 INFO:tasks.workunit.client.0.smithi152.stdout:8/129: truncate d1/d6/f22 2953473 0 2023-12-06T15:00:24.739 INFO:tasks.workunit.client.1.smithi190.stdout:5/309: creat d0/f62 x:0 0 0 2023-12-06T15:00:24.740 INFO:tasks.workunit.client.1.smithi190.stdout:5/310: read d0/d1c/f36 [762361,76546] 0 2023-12-06T15:00:24.743 INFO:tasks.workunit.client.1.smithi190.stdout:1/620: creat d6/dc/d6f/fc7 x:0 0 0 2023-12-06T15:00:24.743 INFO:tasks.workunit.client.1.smithi190.stdout:1/621: rename d6/dc to d6/dc/d6f/dc8 22 2023-12-06T15:00:24.743 INFO:tasks.workunit.client.0.smithi152.stdout:1/440: mkdir d3/da/d15/d17/d58/da3 0 2023-12-06T15:00:24.743 INFO:tasks.workunit.client.0.smithi152.stdout:2/161: symlink d6/db/l33 0 2023-12-06T15:00:24.744 INFO:tasks.workunit.client.0.smithi152.stdout:2/162: dread - d6/d1e/f2e zero size 2023-12-06T15:00:24.744 INFO:tasks.workunit.client.0.smithi152.stdout:2/163: write d6/d18/f32 [911939,23741] 0 2023-12-06T15:00:24.744 INFO:tasks.workunit.client.0.smithi152.stdout:2/164: fsync d6/db/d17/f1d 0 2023-12-06T15:00:24.744 INFO:tasks.workunit.client.0.smithi152.stdout:2/165: write d6/db/d17/f23 [402488,36540] 0 2023-12-06T15:00:24.744 INFO:tasks.workunit.client.0.smithi152.stdout:2/166: fdatasync d6/db/d17/f1d 0 2023-12-06T15:00:24.746 INFO:tasks.workunit.client.0.smithi152.stdout:0/211: creat d8/f3f x:0 0 0 2023-12-06T15:00:24.746 INFO:tasks.workunit.client.0.smithi152.stdout:0/212: chown d8/d1b/f34 1659 1 2023-12-06T15:00:24.747 INFO:tasks.workunit.client.0.smithi152.stdout:8/130: mknod d1/d6/d7/c24 0 2023-12-06T15:00:24.748 INFO:tasks.workunit.client.0.smithi152.stdout:8/131: fsync d1/f10 0 2023-12-06T15:00:24.748 INFO:tasks.workunit.client.0.smithi152.stdout:2/167: symlink d6/d1e/l34 0 2023-12-06T15:00:24.750 INFO:tasks.workunit.client.0.smithi152.stdout:0/213: creat d8/d3e/f40 x:0 0 0 2023-12-06T15:00:24.751 INFO:tasks.workunit.client.1.smithi190.stdout:1/622: write d6/dc/d29/d38/d39/f3f [2734498,57632] 0 2023-12-06T15:00:24.756 INFO:tasks.workunit.client.0.smithi152.stdout:1/441: dread d3/da/d15/d17/d43/f66 [0,4194304] 0 2023-12-06T15:00:24.758 INFO:tasks.workunit.client.0.smithi152.stdout:3/272: rename d9/d41 to d9/d10/d32/d50 0 2023-12-06T15:00:24.758 INFO:tasks.workunit.client.0.smithi152.stdout:3/273: write d9/d10/d32/f3d [1498,31364] 0 2023-12-06T15:00:24.761 INFO:tasks.workunit.client.0.smithi152.stdout:1/442: link d3/da/d4c/d82/d75/la2 d3/da/d15/d17/d43/la4 0 2023-12-06T15:00:24.763 INFO:tasks.workunit.client.0.smithi152.stdout:3/274: mkdir d9/d18/d51 0 2023-12-06T15:00:24.765 INFO:tasks.workunit.client.0.smithi152.stdout:2/168: dread d6/f15 [0,4194304] 0 2023-12-06T15:00:24.765 INFO:tasks.workunit.client.0.smithi152.stdout:2/169: chown d6/d1e/c21 64023 1 2023-12-06T15:00:24.767 INFO:tasks.workunit.client.1.smithi190.stdout:6/497: dwrite d4/d12/d40/d43/f7a [0,4194304] 0 2023-12-06T15:00:24.767 INFO:tasks.workunit.client.1.smithi190.stdout:7/455: dwrite d0/d88/d33/d60/f86 [0,4194304] 0 2023-12-06T15:00:24.767 INFO:tasks.workunit.client.1.smithi190.stdout:6/498: chown d4/d15/f26 10856 1 2023-12-06T15:00:24.767 INFO:tasks.workunit.client.1.smithi190.stdout:7/456: getdents d0/d88 0 2023-12-06T15:00:24.767 INFO:tasks.workunit.client.1.smithi190.stdout:9/400: dwrite d4/f13 [4194304,4194304] 0 2023-12-06T15:00:24.767 INFO:tasks.workunit.client.1.smithi190.stdout:9/401: fsync d4/f2d 0 2023-12-06T15:00:24.768 INFO:tasks.workunit.client.0.smithi152.stdout:1/443: rename d3/d44/f8d to d3/da/d4c/fa5 0 2023-12-06T15:00:24.770 INFO:tasks.workunit.client.0.smithi152.stdout:2/170: creat d6/db/f35 x:0 0 0 2023-12-06T15:00:24.771 INFO:tasks.workunit.client.1.smithi190.stdout:6/499: write d4/d12/d1a/f1c [2947272,87641] 0 2023-12-06T15:00:24.771 INFO:tasks.workunit.client.1.smithi190.stdout:9/402: mknod d4/d27/d2f/d31/d3f/d58/c8d 0 2023-12-06T15:00:24.772 INFO:tasks.workunit.client.1.smithi190.stdout:7/457: write d0/df/f42 [2158251,43277] 0 2023-12-06T15:00:24.773 INFO:tasks.workunit.client.0.smithi152.stdout:1/444: rename d3/da/f36 to d3/da/fa6 0 2023-12-06T15:00:24.773 INFO:tasks.workunit.client.0.smithi152.stdout:1/445: stat d3/da/d4c/d63 0 2023-12-06T15:00:24.773 INFO:tasks.workunit.client.0.smithi152.stdout:1/446: chown d3/da/d15/d17/f2d 8667504 1 2023-12-06T15:00:24.773 INFO:tasks.workunit.client.0.smithi152.stdout:1/447: mkdir d3/da/d15/d17/d4d/da7 0 2023-12-06T15:00:24.775 INFO:tasks.workunit.client.1.smithi190.stdout:8/384: dwrite d1/d20/d3b/f18 [4194304,4194304] 0 2023-12-06T15:00:24.775 INFO:tasks.workunit.client.1.smithi190.stdout:8/385: readlink d1/d20/d3b/d34/l3a 0 2023-12-06T15:00:24.775 INFO:tasks.workunit.client.1.smithi190.stdout:1/623: dwrite d6/d49/fc1 [0,4194304] 0 2023-12-06T15:00:24.776 INFO:tasks.workunit.client.1.smithi190.stdout:5/311: dwrite d0/d1c/d2b/d2c/f54 [0,4194304] 0 2023-12-06T15:00:24.781 INFO:tasks.workunit.client.0.smithi152.stdout:0/214: dwrite d8/d15/f2c [0,4194304] 0 2023-12-06T15:00:24.782 INFO:tasks.workunit.client.0.smithi152.stdout:0/215: chown d8/d1b/f34 380249275 1 2023-12-06T15:00:24.782 INFO:tasks.workunit.client.0.smithi152.stdout:0/216: write d8/f37 [1045006,1607] 0 2023-12-06T15:00:24.782 INFO:tasks.workunit.client.1.smithi190.stdout:8/386: write d1/d20/d3b/f18 [6805995,76036] 0 2023-12-06T15:00:24.791 INFO:tasks.workunit.client.0.smithi152.stdout:3/275: dwrite d9/d10/d19/f2c [0,4194304] 0 2023-12-06T15:00:24.791 INFO:tasks.workunit.client.0.smithi152.stdout:3/276: stat d9/d10/f2a 0 2023-12-06T15:00:24.802 INFO:tasks.workunit.client.1.smithi190.stdout:6/500: rmdir d4/d15 39 2023-12-06T15:00:24.802 INFO:tasks.workunit.client.1.smithi190.stdout:6/501: readlink d4/d12/d1a/l2c 0 2023-12-06T15:00:24.803 INFO:tasks.workunit.client.1.smithi190.stdout:6/502: read d4/d12/d1a/d32/f4c [757124,40079] 0 2023-12-06T15:00:24.803 INFO:tasks.workunit.client.1.smithi190.stdout:9/403: rmdir d4/d27/d2f/d31/d3f 39 2023-12-06T15:00:24.807 INFO:tasks.workunit.client.1.smithi190.stdout:7/458: rename d0/l31 to d0/l8c 0 2023-12-06T15:00:24.818 INFO:tasks.workunit.client.1.smithi190.stdout:5/312: dwrite d0/f18 [0,4194304] 0 2023-12-06T15:00:24.819 INFO:tasks.workunit.client.1.smithi190.stdout:1/624: rmdir d6/dc/d29/d38/d43/d7f/da7 39 2023-12-06T15:00:24.820 INFO:tasks.workunit.client.1.smithi190.stdout:1/625: write d6/dc/d3b/d78/fb0 [592147,9427] 0 2023-12-06T15:00:24.822 INFO:tasks.workunit.client.1.smithi190.stdout:8/387: link d1/d10/l6f d1/d10/d1c/d4b/l75 0 2023-12-06T15:00:24.822 INFO:tasks.workunit.client.1.smithi190.stdout:6/503: mknod d4/d12/d9a/ca2 0 2023-12-06T15:00:24.823 INFO:tasks.workunit.client.1.smithi190.stdout:9/404: getdents d4/d84 0 2023-12-06T15:00:24.824 INFO:tasks.workunit.client.0.smithi152.stdout:1/448: dwrite d3/da/d15/d17/d43/f9e [0,4194304] 0 2023-12-06T15:00:24.825 INFO:tasks.workunit.client.1.smithi190.stdout:7/459: creat d0/df/d53/d15/f8d x:0 0 0 2023-12-06T15:00:24.825 INFO:tasks.workunit.client.1.smithi190.stdout:7/460: write d0/d5/f78 [883110,27494] 0 2023-12-06T15:00:24.825 INFO:tasks.workunit.client.1.smithi190.stdout:7/461: chown d0/d88/d7a 506251 1 2023-12-06T15:00:24.825 INFO:tasks.workunit.client.1.smithi190.stdout:7/462: fdatasync d0/df/d1f/f58 0 2023-12-06T15:00:24.825 INFO:tasks.workunit.client.0.smithi152.stdout:1/449: dread d3/da/d15/d17/f42 [0,4194304] 0 2023-12-06T15:00:24.826 INFO:tasks.workunit.client.1.smithi190.stdout:9/405: read d4/fe [1780822,69894] 0 2023-12-06T15:00:24.826 INFO:tasks.workunit.client.1.smithi190.stdout:9/406: write d4/d27/d2f/d31/d3f/d58/d72/f80 [4657117,75038] 0 2023-12-06T15:00:24.827 INFO:tasks.workunit.client.1.smithi190.stdout:5/313: mknod d0/d1c/d2b/d2c/d5d/c63 0 2023-12-06T15:00:24.827 INFO:tasks.workunit.client.1.smithi190.stdout:1/626: mknod d6/dc/cc9 0 2023-12-06T15:00:24.832 INFO:tasks.workunit.client.1.smithi190.stdout:6/504: mkdir d4/d12/d1a/d8a/da3 0 2023-12-06T15:00:24.833 INFO:tasks.workunit.client.1.smithi190.stdout:7/463: mkdir d0/d35/d8e 0 2023-12-06T15:00:24.833 INFO:tasks.workunit.client.1.smithi190.stdout:7/464: readlink d0/df/d53/l20 0 2023-12-06T15:00:24.833 INFO:tasks.workunit.client.1.smithi190.stdout:5/314: rename d0/d1c/d2b/d2c/f54 to d0/d1c/d2b/d2c/f64 0 2023-12-06T15:00:24.833 INFO:tasks.workunit.client.1.smithi190.stdout:5/315: chown d0/df/d50/l5c 865817028 1 2023-12-06T15:00:24.835 INFO:tasks.workunit.client.1.smithi190.stdout:7/465: creat d0/df/d53/d2f/f8f x:0 0 0 2023-12-06T15:00:24.835 INFO:tasks.workunit.client.1.smithi190.stdout:7/466: readlink d0/d88/d7a/l3b 0 2023-12-06T15:00:24.836 INFO:tasks.workunit.client.0.smithi152.stdout:2/171: dwrite d6/db/d17/f23 [0,4194304] 0 2023-12-06T15:00:24.836 INFO:tasks.workunit.client.0.smithi152.stdout:2/172: readlink d6/db/d13/l25 0 2023-12-06T15:00:24.837 INFO:tasks.workunit.client.0.smithi152.stdout:3/277: dwrite d9/d10/f2f [0,4194304] 0 2023-12-06T15:00:24.837 INFO:tasks.workunit.client.0.smithi152.stdout:3/278: write d9/d10/d32/d50/f42 [1035079,24288] 0 2023-12-06T15:00:24.837 INFO:tasks.workunit.client.1.smithi190.stdout:5/316: rename d0/df/l3d to d0/df/d50/l65 0 2023-12-06T15:00:24.838 INFO:tasks.workunit.client.1.smithi190.stdout:7/467: creat d0/d5/d63/f90 x:0 0 0 2023-12-06T15:00:24.838 INFO:tasks.workunit.client.1.smithi190.stdout:7/468: chown d0/d88/d32/f5b 386082 1 2023-12-06T15:00:24.838 INFO:tasks.workunit.client.1.smithi190.stdout:7/469: chown d0/df/d53 0 1 2023-12-06T15:00:24.838 INFO:tasks.workunit.client.1.smithi190.stdout:7/470: stat d0/df/f3f 0 2023-12-06T15:00:24.838 INFO:tasks.workunit.client.1.smithi190.stdout:7/471: mknod d0/d35/d8e/c91 0 2023-12-06T15:00:24.843 INFO:tasks.workunit.client.1.smithi190.stdout:7/472: getdents d0/df/d53/d2f/d3e 0 2023-12-06T15:00:24.845 INFO:tasks.workunit.client.0.smithi152.stdout:0/217: dwrite d8/ff [0,4194304] 0 2023-12-06T15:00:24.845 INFO:tasks.workunit.client.0.smithi152.stdout:3/279: mkdir d9/d10/d12/d43/d52 0 2023-12-06T15:00:24.846 INFO:tasks.workunit.client.0.smithi152.stdout:3/280: write d9/d10/f2a [409537,25493] 0 2023-12-06T15:00:24.846 INFO:tasks.workunit.client.0.smithi152.stdout:2/173: creat d6/d18/f36 x:0 0 0 2023-12-06T15:00:24.846 INFO:tasks.workunit.client.0.smithi152.stdout:2/174: chown d6 5712329 1 2023-12-06T15:00:24.847 INFO:tasks.workunit.client.0.smithi152.stdout:0/218: link d8/fd d8/d1b/f41 0 2023-12-06T15:00:24.847 INFO:tasks.workunit.client.0.smithi152.stdout:0/219: dread - d8/d3e/f40 zero size 2023-12-06T15:00:24.848 INFO:tasks.workunit.client.0.smithi152.stdout:3/281: rename d9/d10/d12/f31 to d9/d45/f53 0 2023-12-06T15:00:24.848 INFO:tasks.workunit.client.0.smithi152.stdout:3/282: readlink d9/d18/d1a/l2b 0 2023-12-06T15:00:24.849 INFO:tasks.workunit.client.0.smithi152.stdout:2/175: truncate d6/db/d17/f1d 3933422 0 2023-12-06T15:00:24.849 INFO:tasks.workunit.client.1.smithi190.stdout:5/317: dread d0/d1c/d2b/f32 [0,4194304] 0 2023-12-06T15:00:24.855 INFO:tasks.workunit.client.1.smithi190.stdout:5/318: rmdir d0/d1c/d3e 39 2023-12-06T15:00:24.856 INFO:tasks.workunit.client.1.smithi190.stdout:5/319: write d0/f44 [437581,93179] 0 2023-12-06T15:00:24.858 INFO:tasks.workunit.client.1.smithi190.stdout:5/320: mknod d0/d1c/c66 0 2023-12-06T15:00:24.858 INFO:tasks.workunit.client.1.smithi190.stdout:5/321: write d0/d1c/f35 [8656793,42869] 0 2023-12-06T15:00:24.861 INFO:tasks.workunit.client.1.smithi190.stdout:5/322: creat d0/d1c/d2b/d2c/d5d/f67 x:0 0 0 2023-12-06T15:00:24.863 INFO:tasks.workunit.client.1.smithi190.stdout:5/323: rename d0/d1c/c29 to d0/d1c/c68 0 2023-12-06T15:00:24.863 INFO:tasks.workunit.client.1.smithi190.stdout:5/324: fdatasync d0/f28 0 2023-12-06T15:00:24.863 INFO:tasks.workunit.client.1.smithi190.stdout:5/325: readlink d0/d12/l34 0 2023-12-06T15:00:24.864 INFO:tasks.workunit.client.1.smithi190.stdout:5/326: mkdir d0/d1c/d2b/d69 0 2023-12-06T15:00:24.873 INFO:tasks.workunit.client.1.smithi190.stdout:6/505: dwrite d4/d15/f96 [0,4194304] 0 2023-12-06T15:00:24.875 INFO:tasks.workunit.client.1.smithi190.stdout:6/506: creat d4/d15/fa4 x:0 0 0 2023-12-06T15:00:24.876 INFO:tasks.workunit.client.1.smithi190.stdout:6/507: symlink d4/d12/d40/d43/d45/la5 0 2023-12-06T15:00:24.876 INFO:tasks.workunit.client.1.smithi190.stdout:6/508: fdatasync d4/d12/d1a/d44/f56 0 2023-12-06T15:00:24.877 INFO:tasks.workunit.client.1.smithi190.stdout:6/509: mkdir d4/d12/d1a/d8c/da6 0 2023-12-06T15:00:24.878 INFO:tasks.workunit.client.1.smithi190.stdout:6/510: creat d4/d12/d1a/d8a/fa7 x:0 0 0 2023-12-06T15:00:24.878 INFO:tasks.workunit.client.1.smithi190.stdout:6/511: mknod d4/d12/d40/ca8 0 2023-12-06T15:00:24.880 INFO:tasks.workunit.client.1.smithi190.stdout:6/512: unlink d4/d12/d1a/d59/c99 0 2023-12-06T15:00:24.880 INFO:tasks.workunit.client.1.smithi190.stdout:6/513: dread - d4/d15/fa4 zero size 2023-12-06T15:00:24.880 INFO:tasks.workunit.client.1.smithi190.stdout:8/388: dwrite d1/d20/d3b/d36/f3e [0,4194304] 0 2023-12-06T15:00:24.880 INFO:tasks.workunit.client.1.smithi190.stdout:8/389: write d1/d37/f45 [4900240,126493] 0 2023-12-06T15:00:24.880 INFO:tasks.workunit.client.1.smithi190.stdout:6/514: mkdir d4/d12/d1a/d70/da9 0 2023-12-06T15:00:24.881 INFO:tasks.workunit.client.0.smithi152.stdout:2/176: fsync d6/d18/f36 0 2023-12-06T15:00:24.882 INFO:tasks.workunit.client.0.smithi152.stdout:2/177: creat d6/d1e/f37 x:0 0 0 2023-12-06T15:00:24.883 INFO:tasks.workunit.client.1.smithi190.stdout:8/390: creat d1/d10/d25/f76 x:0 0 0 2023-12-06T15:00:24.883 INFO:tasks.workunit.client.1.smithi190.stdout:8/391: fsync d1/d20/d3b/f30 0 2023-12-06T15:00:24.883 INFO:tasks.workunit.client.1.smithi190.stdout:6/515: rename d4/d12/f1d to d4/d12/d1a/d70/da9/faa 0 2023-12-06T15:00:24.883 INFO:tasks.workunit.client.1.smithi190.stdout:6/516: write d4/d12/d1a/d8a/fa7 [823944,54498] 0 2023-12-06T15:00:24.884 INFO:tasks.workunit.client.0.smithi152.stdout:2/178: mknod d6/db/d13/c38 0 2023-12-06T15:00:24.884 INFO:tasks.workunit.client.1.smithi190.stdout:1/627: dwrite d6/f6c [0,4194304] 0 2023-12-06T15:00:24.885 INFO:tasks.workunit.client.1.smithi190.stdout:6/517: mkdir d4/d12/d1a/d32/dab 0 2023-12-06T15:00:24.885 INFO:tasks.workunit.client.1.smithi190.stdout:6/518: dread - d4/d12/d1a/d59/f65 zero size 2023-12-06T15:00:24.885 INFO:tasks.workunit.client.1.smithi190.stdout:9/407: dwrite d4/f6b [0,4194304] 0 2023-12-06T15:00:24.886 INFO:tasks.workunit.client.1.smithi190.stdout:8/392: getdents d1 0 2023-12-06T15:00:24.886 INFO:tasks.workunit.client.1.smithi190.stdout:8/393: write d1/f1b [2585806,43132] 0 2023-12-06T15:00:24.888 INFO:tasks.workunit.client.0.smithi152.stdout:1/450: dwrite d3/da/fa6 [0,4194304] 0 2023-12-06T15:00:24.889 INFO:tasks.workunit.client.1.smithi190.stdout:1/628: symlink d6/dc/d3b/d78/d94/lca 0 2023-12-06T15:00:24.889 INFO:tasks.workunit.client.1.smithi190.stdout:1/629: chown d6/dc/d29/d38/d73/c8c 232649 1 2023-12-06T15:00:24.889 INFO:tasks.workunit.client.1.smithi190.stdout:6/519: mknod d4/d12/d1a/d44/cac 0 2023-12-06T15:00:24.890 INFO:tasks.workunit.client.0.smithi152.stdout:1/451: link d3/da/d15/d17/f3d d3/da/d4c/d63/fa8 0 2023-12-06T15:00:24.891 INFO:tasks.workunit.client.1.smithi190.stdout:9/408: unlink d4/d27/f49 0 2023-12-06T15:00:24.892 INFO:tasks.workunit.client.0.smithi152.stdout:3/283: dwrite d9/ff [0,4194304] 0 2023-12-06T15:00:24.893 INFO:tasks.workunit.client.0.smithi152.stdout:3/284: readlink d9/d18/d1a/l2b 0 2023-12-06T15:00:24.893 INFO:tasks.workunit.client.0.smithi152.stdout:3/285: fsync d9/d10/d19/f2c 0 2023-12-06T15:00:24.893 INFO:tasks.workunit.client.0.smithi152.stdout:3/286: dread - d9/d10/d12/f1e zero size 2023-12-06T15:00:24.893 INFO:tasks.workunit.client.0.smithi152.stdout:0/220: dwrite d8/f13 [0,4194304] 0 2023-12-06T15:00:24.893 INFO:tasks.workunit.client.0.smithi152.stdout:0/221: truncate d8/d15/f33 221751 0 2023-12-06T15:00:24.893 INFO:tasks.workunit.client.0.smithi152.stdout:1/452: creat d3/d44/d84/fa9 x:0 0 0 2023-12-06T15:00:24.893 INFO:tasks.workunit.client.0.smithi152.stdout:1/453: write d3/da/d4c/d82/d52/d62/f7a [142999,112480] 0 2023-12-06T15:00:24.893 INFO:tasks.workunit.client.0.smithi152.stdout:1/454: truncate d3/da/d15/d17/f42 1768826 0 2023-12-06T15:00:24.893 INFO:tasks.workunit.client.0.smithi152.stdout:1/455: write d3/da/d15/d17/d4d/f8a [218750,33575] 0 2023-12-06T15:00:24.894 INFO:tasks.workunit.client.0.smithi152.stdout:3/287: creat d9/d18/d51/f54 x:0 0 0 2023-12-06T15:00:24.894 INFO:tasks.workunit.client.1.smithi190.stdout:8/394: creat d1/d10/d1c/f77 x:0 0 0 2023-12-06T15:00:24.894 INFO:tasks.workunit.client.1.smithi190.stdout:8/395: read - d1/d20/d3b/d36/f3c zero size 2023-12-06T15:00:24.894 INFO:tasks.workunit.client.1.smithi190.stdout:5/327: dwrite d0/df/f56 [0,4194304] 0 2023-12-06T15:00:24.895 INFO:tasks.workunit.client.1.smithi190.stdout:1/630: creat d6/dc/d29/d38/d73/d5c/fcb x:0 0 0 2023-12-06T15:00:24.895 INFO:tasks.workunit.client.1.smithi190.stdout:8/396: write d1/f35 [129793,76142] 0 2023-12-06T15:00:24.895 INFO:tasks.workunit.client.1.smithi190.stdout:6/520: rename d4/d15/l55 to d4/lad 0 2023-12-06T15:00:24.896 INFO:tasks.workunit.client.1.smithi190.stdout:6/521: chown d4/c31 8399602 1 2023-12-06T15:00:24.896 INFO:tasks.workunit.client.1.smithi190.stdout:6/522: chown d4/d12/d1a/c92 853915 1 2023-12-06T15:00:24.896 INFO:tasks.workunit.client.1.smithi190.stdout:6/523: fsync d4/d12/d1a/d44/f8f 0 2023-12-06T15:00:24.896 INFO:tasks.workunit.client.1.smithi190.stdout:1/631: write d6/f90 [2704733,94552] 0 2023-12-06T15:00:24.897 INFO:tasks.workunit.client.1.smithi190.stdout:1/632: truncate d6/dc/d6f/fc7 236535 0 2023-12-06T15:00:24.897 INFO:tasks.workunit.client.0.smithi152.stdout:4/375: sync 2023-12-06T15:00:24.897 INFO:tasks.workunit.client.0.smithi152.stdout:6/292: sync 2023-12-06T15:00:24.897 INFO:tasks.workunit.client.0.smithi152.stdout:9/238: sync 2023-12-06T15:00:24.897 INFO:tasks.workunit.client.0.smithi152.stdout:0/222: rename d8/d15/f26 to d8/d3e/f42 0 2023-12-06T15:00:24.897 INFO:tasks.workunit.client.0.smithi152.stdout:1/456: creat d3/da/d15/d17/d58/d9f/faa x:0 0 0 2023-12-06T15:00:24.897 INFO:tasks.workunit.client.0.smithi152.stdout:7/160: sync 2023-12-06T15:00:24.898 INFO:tasks.workunit.client.0.smithi152.stdout:5/219: sync 2023-12-06T15:00:24.901 INFO:tasks.workunit.client.0.smithi152.stdout:9/239: mknod d0/dd/d20/d38/c41 0 2023-12-06T15:00:24.901 INFO:tasks.workunit.client.0.smithi152.stdout:9/240: chown d0/c18 125 1 2023-12-06T15:00:24.904 INFO:tasks.workunit.client.1.smithi190.stdout:1/633: write d6/dc/f9b [3872660,101210] 0 2023-12-06T15:00:24.904 INFO:tasks.workunit.client.0.smithi152.stdout:1/457: getdents d3/da/d65 0 2023-12-06T15:00:24.904 INFO:tasks.workunit.client.0.smithi152.stdout:0/223: rename d8/d3e/f40 to d8/d3e/f43 0 2023-12-06T15:00:24.904 INFO:tasks.workunit.client.1.smithi190.stdout:7/473: dwrite d0/df/d53/d2f/d3e/f7e [0,4194304] 0 2023-12-06T15:00:24.905 INFO:tasks.workunit.client.1.smithi190.stdout:5/328: symlink d0/d1c/d2b/d2c/l6a 0 2023-12-06T15:00:24.909 INFO:tasks.workunit.client.1.smithi190.stdout:8/397: getdents d1/d10/d1c/d4b 0 2023-12-06T15:00:24.909 INFO:tasks.workunit.client.0.smithi152.stdout:9/241: link d0/f14 d0/dd/f42 0 2023-12-06T15:00:24.909 INFO:tasks.workunit.client.0.smithi152.stdout:1/458: creat d3/da/d4c/d63/d96/fab x:0 0 0 2023-12-06T15:00:24.910 INFO:tasks.workunit.client.0.smithi152.stdout:1/459: readlink d3/da/d4c/d82/d52/d55/l7b 0 2023-12-06T15:00:24.912 INFO:tasks.workunit.client.0.smithi152.stdout:0/224: mkdir d8/d44 0 2023-12-06T15:00:24.912 INFO:tasks.workunit.client.1.smithi190.stdout:1/634: creat d6/dc/d29/d38/d39/d63/d67/fcc x:0 0 0 2023-12-06T15:00:24.912 INFO:tasks.workunit.client.1.smithi190.stdout:1/635: dread - d6/dc/d29/d38/d73/d76/d7e/fbc zero size 2023-12-06T15:00:24.914 INFO:tasks.workunit.client.0.smithi152.stdout:2/179: dwrite f5 [0,4194304] 0 2023-12-06T15:00:24.915 INFO:tasks.workunit.client.0.smithi152.stdout:6/293: dread d1/d19/d1a/d30/d36/d26/f53 [0,4194304] 0 2023-12-06T15:00:24.916 INFO:tasks.workunit.client.0.smithi152.stdout:1/460: mkdir d3/da/d15/dac 0 2023-12-06T15:00:24.917 INFO:tasks.workunit.client.0.smithi152.stdout:0/225: dread d8/d15/f2e [0,4194304] 0 2023-12-06T15:00:24.920 INFO:tasks.workunit.client.0.smithi152.stdout:6/294: mkdir d1/d19/d1a/d30/d36/d35/d49/d6b 0 2023-12-06T15:00:24.922 INFO:tasks.workunit.client.0.smithi152.stdout:0/226: mkdir d8/d15/d45 0 2023-12-06T15:00:24.923 INFO:tasks.workunit.client.0.smithi152.stdout:0/227: chown d8 439 1 2023-12-06T15:00:24.925 INFO:tasks.workunit.client.0.smithi152.stdout:2/180: rename f4 to d6/db/f39 0 2023-12-06T15:00:24.925 INFO:tasks.workunit.client.0.smithi152.stdout:2/181: chown d6/d18/f32 333 1 2023-12-06T15:00:24.926 INFO:tasks.workunit.client.0.smithi152.stdout:6/295: rmdir d1/d1c 39 2023-12-06T15:00:24.926 INFO:tasks.workunit.client.1.smithi190.stdout:5/329: getdents d0/d1c 0 2023-12-06T15:00:24.927 INFO:tasks.workunit.client.1.smithi190.stdout:5/330: write d0/f62 [348492,117574] 0 2023-12-06T15:00:24.928 INFO:tasks.workunit.client.0.smithi152.stdout:1/461: rename d3/da/d4c/d63/f95 to d3/d44/fad 0 2023-12-06T15:00:24.928 INFO:tasks.workunit.client.0.smithi152.stdout:1/462: write d3/da/d4c/d63/d96/fab [418439,35065] 0 2023-12-06T15:00:24.929 INFO:tasks.workunit.client.1.smithi190.stdout:8/398: link d1/d20/d3b/f30 d1/d10/f78 0 2023-12-06T15:00:24.930 INFO:tasks.workunit.client.0.smithi152.stdout:6/296: creat d1/d19/d1a/d30/d36/d35/d63/f6c x:0 0 0 2023-12-06T15:00:24.930 INFO:tasks.workunit.client.0.smithi152.stdout:6/297: readlink d1/d19/d1a/d30/d18/l1b 0 2023-12-06T15:00:24.930 INFO:tasks.workunit.client.0.smithi152.stdout:6/298: truncate d1/d5/f44 742827 0 2023-12-06T15:00:24.930 INFO:tasks.workunit.client.0.smithi152.stdout:6/299: chown d1/d5/d15/l4c 1 1 2023-12-06T15:00:24.930 INFO:tasks.workunit.client.0.smithi152.stdout:1/463: mknod d3/da/d4c/d82/cae 0 2023-12-06T15:00:24.930 INFO:tasks.workunit.client.1.smithi190.stdout:1/636: creat d6/dc/d29/fcd x:0 0 0 2023-12-06T15:00:24.932 INFO:tasks.workunit.client.0.smithi152.stdout:1/464: rename d3/da/db/l10 to d3/da/d4c/d82/laf 0 2023-12-06T15:00:24.934 INFO:tasks.workunit.client.1.smithi190.stdout:8/399: symlink d1/d20/d3b/d36/l79 0 2023-12-06T15:00:24.934 INFO:tasks.workunit.client.1.smithi190.stdout:5/331: symlink d0/d1c/d3e/l6b 0 2023-12-06T15:00:24.935 INFO:tasks.workunit.client.0.smithi152.stdout:1/465: unlink d3/da/d15/f7e 0 2023-12-06T15:00:24.936 INFO:tasks.workunit.client.0.smithi152.stdout:1/466: creat d3/fb0 x:0 0 0 2023-12-06T15:00:24.937 INFO:tasks.workunit.client.0.smithi152.stdout:1/467: creat d3/da/d4c/d82/d52/fb1 x:0 0 0 2023-12-06T15:00:24.938 INFO:tasks.workunit.client.0.smithi152.stdout:1/468: mknod d3/da/d15/d17/d58/cb2 0 2023-12-06T15:00:24.940 INFO:tasks.workunit.client.0.smithi152.stdout:1/469: symlink d3/da/d4c/lb3 0 2023-12-06T15:00:24.940 INFO:tasks.workunit.client.1.smithi190.stdout:1/637: link d6/dc/d29/fb2 d6/dc/d29/d38/d73/d5c/db5/fce 0 2023-12-06T15:00:24.940 INFO:tasks.workunit.client.1.smithi190.stdout:1/638: chown d6/dc/d3b/c3d 1285 1 2023-12-06T15:00:24.940 INFO:tasks.workunit.client.1.smithi190.stdout:1/639: chown d6/dc/d29/d38/d73/d5c/fa3 2366009 1 2023-12-06T15:00:24.941 INFO:tasks.workunit.client.1.smithi190.stdout:8/400: creat d1/d20/d3b/d36/f7a x:0 0 0 2023-12-06T15:00:24.941 INFO:tasks.workunit.client.1.smithi190.stdout:8/401: stat d1/f16 0 2023-12-06T15:00:24.941 INFO:tasks.workunit.client.1.smithi190.stdout:5/332: truncate d0/d12/f13 678158 0 2023-12-06T15:00:24.941 INFO:tasks.workunit.client.1.smithi190.stdout:5/333: chown d0/d12/l3a 846131 1 2023-12-06T15:00:24.942 INFO:tasks.workunit.client.0.smithi152.stdout:3/288: dwrite d9/f38 [0,4194304] 0 2023-12-06T15:00:24.943 INFO:tasks.workunit.client.0.smithi152.stdout:3/289: stat d9/d10/d12/f1e 0 2023-12-06T15:00:24.943 INFO:tasks.workunit.client.0.smithi152.stdout:3/290: chown d9/d10/d19/l1b 607056 1 2023-12-06T15:00:24.944 INFO:tasks.workunit.client.1.smithi190.stdout:8/402: link d1/d20/d3b/d34/d39/l63 d1/d20/d3b/l7b 0 2023-12-06T15:00:24.944 INFO:tasks.workunit.client.1.smithi190.stdout:8/403: readlink d1/d20/d3b/d31/l54 0 2023-12-06T15:00:24.949 INFO:tasks.workunit.client.1.smithi190.stdout:5/334: write d0/df/f56 [3000759,92254] 0 2023-12-06T15:00:24.952 INFO:tasks.workunit.client.1.smithi190.stdout:5/335: unlink d0/f6 0 2023-12-06T15:00:24.952 INFO:tasks.workunit.client.1.smithi190.stdout:5/336: chown d0/d1c/d2b/d2c/f43 0 1 2023-12-06T15:00:24.953 INFO:tasks.workunit.client.1.smithi190.stdout:5/337: unlink d0/d12/l34 0 2023-12-06T15:00:24.953 INFO:tasks.workunit.client.1.smithi190.stdout:5/338: write d0/df/f20 [276244,45470] 0 2023-12-06T15:00:24.954 INFO:tasks.workunit.client.1.smithi190.stdout:5/339: write d0/d1c/d2b/d2c/f49 [2600769,130737] 0 2023-12-06T15:00:24.957 INFO:tasks.workunit.client.1.smithi190.stdout:5/340: stat d0/d1c/d3e/c59 0 2023-12-06T15:00:24.958 INFO:tasks.workunit.client.1.smithi190.stdout:5/341: mkdir d0/d6c 0 2023-12-06T15:00:24.958 INFO:tasks.workunit.client.1.smithi190.stdout:5/342: fdatasync d0/df/f1a 0 2023-12-06T15:00:24.961 INFO:tasks.workunit.client.0.smithi152.stdout:7/161: dwrite dd/df/d1b/d20/d28/f30 [0,4194304] 0 2023-12-06T15:00:24.968 INFO:tasks.workunit.client.0.smithi152.stdout:4/376: dwrite d2/d10/f17 [0,4194304] 0 2023-12-06T15:00:24.985 INFO:tasks.workunit.client.0.smithi152.stdout:9/242: dwrite d0/f15 [0,4194304] 0 2023-12-06T15:00:24.985 INFO:tasks.workunit.client.0.smithi152.stdout:5/220: dwrite d7/dd/f35 [0,4194304] 0 2023-12-06T15:00:24.987 INFO:tasks.workunit.client.0.smithi152.stdout:9/243: mkdir d0/d31/d43 0 2023-12-06T15:00:24.988 INFO:tasks.workunit.client.1.smithi190.stdout:9/409: dwrite d4/d84/f8b [0,4194304] 0 2023-12-06T15:00:24.990 INFO:tasks.workunit.client.0.smithi152.stdout:5/221: mkdir d7/d47 0 2023-12-06T15:00:24.995 INFO:tasks.workunit.client.0.smithi152.stdout:5/222: mkdir d7/dd/d26/d48 0 2023-12-06T15:00:24.995 INFO:tasks.workunit.client.0.smithi152.stdout:5/223: truncate d7/fb 863596 0 2023-12-06T15:00:24.998 INFO:tasks.workunit.client.1.smithi190.stdout:1/640: dwrite d6/dc/d29/d38/fa5 [0,4194304] 0 2023-12-06T15:00:24.998 INFO:tasks.workunit.client.1.smithi190.stdout:8/404: dwrite d1/f16 [0,4194304] 0 2023-12-06T15:00:24.998 INFO:tasks.workunit.client.1.smithi190.stdout:1/641: fsync d6/f5a 0 2023-12-06T15:00:24.998 INFO:tasks.workunit.client.1.smithi190.stdout:1/642: readlink d6/d49/d74/l8b 0 2023-12-06T15:00:24.999 INFO:tasks.workunit.client.1.smithi190.stdout:8/405: dread d1/d20/d3b/f30 [0,4194304] 0 2023-12-06T15:00:25.002 INFO:tasks.workunit.client.0.smithi152.stdout:9/244: dread d0/dd/fe [0,4194304] 0 2023-12-06T15:00:25.002 INFO:tasks.workunit.client.0.smithi152.stdout:2/182: dwrite d6/f15 [0,4194304] 0 2023-12-06T15:00:25.002 INFO:tasks.workunit.client.0.smithi152.stdout:2/183: truncate d6/d18/f32 1767901 0 2023-12-06T15:00:25.002 INFO:tasks.workunit.client.0.smithi152.stdout:2/184: fsync f5 0 2023-12-06T15:00:25.002 INFO:tasks.workunit.client.0.smithi152.stdout:6/300: dwrite d1/d5/d15/f1d [4194304,4194304] 0 2023-12-06T15:00:25.002 INFO:tasks.workunit.client.0.smithi152.stdout:6/301: write d1/d19/d1a/d30/d36/f64 [2013412,11346] 0 2023-12-06T15:00:25.002 INFO:tasks.workunit.client.0.smithi152.stdout:6/302: truncate d1/d19/d1a/d30/d36/d4e/f5e 369458 0 2023-12-06T15:00:25.003 INFO:tasks.workunit.client.1.smithi190.stdout:8/406: creat d1/d10/d1c/d4b/f7c x:0 0 0 2023-12-06T15:00:25.003 INFO:tasks.workunit.client.0.smithi152.stdout:5/224: dread d7/dd/f1c [0,4194304] 0 2023-12-06T15:00:25.003 INFO:tasks.workunit.client.0.smithi152.stdout:5/225: write d7/dd/d26/f33 [5028092,49237] 0 2023-12-06T15:00:25.003 INFO:tasks.workunit.client.0.smithi152.stdout:6/303: truncate d1/f7 1478883 0 2023-12-06T15:00:25.003 INFO:tasks.workunit.client.0.smithi152.stdout:6/304: fdatasync d1/d5/f46 0 2023-12-06T15:00:25.003 INFO:tasks.workunit.client.0.smithi152.stdout:6/305: dread - d1/d19/d1a/d30/f59 zero size 2023-12-06T15:00:25.004 INFO:tasks.workunit.client.0.smithi152.stdout:5/226: dread d7/f19 [0,4194304] 0 2023-12-06T15:00:25.004 INFO:tasks.workunit.client.0.smithi152.stdout:5/227: write d7/dd/f16 [2458122,44351] 0 2023-12-06T15:00:25.004 INFO:tasks.workunit.client.0.smithi152.stdout:5/228: readlink d7/l27 0 2023-12-06T15:00:25.005 INFO:tasks.workunit.client.0.smithi152.stdout:6/306: mkdir d1/d19/d6d 0 2023-12-06T15:00:25.005 INFO:tasks.workunit.client.0.smithi152.stdout:6/307: write d1/d19/d1a/d30/d36/d35/d63/f65 [359841,37830] 0 2023-12-06T15:00:25.009 INFO:tasks.workunit.client.0.smithi152.stdout:6/308: dread d1/d5/f14 [0,4194304] 0 2023-12-06T15:00:25.009 INFO:tasks.workunit.client.0.smithi152.stdout:6/309: write d1/f2c [369721,111541] 0 2023-12-06T15:00:25.010 INFO:tasks.workunit.client.0.smithi152.stdout:6/310: dread d1/d5/f44 [0,4194304] 0 2023-12-06T15:00:25.015 INFO:tasks.workunit.client.0.smithi152.stdout:7/162: dwrite dd/f24 [0,4194304] 0 2023-12-06T15:00:25.015 INFO:tasks.workunit.client.0.smithi152.stdout:0/228: dwrite d8/f37 [0,4194304] 0 2023-12-06T15:00:25.017 INFO:tasks.workunit.client.0.smithi152.stdout:4/377: dwrite d2/d22/f4d [0,4194304] 0 2023-12-06T15:00:25.018 INFO:tasks.workunit.client.0.smithi152.stdout:4/378: chown d2/d22/f4a 7226 1 2023-12-06T15:00:25.018 INFO:tasks.workunit.client.0.smithi152.stdout:4/379: write d2/d15/f64 [483732,70370] 0 2023-12-06T15:00:25.018 INFO:tasks.workunit.client.1.smithi190.stdout:9/410: dwrite d4/d27/d2f/d5c/f82 [0,4194304] 0 2023-12-06T15:00:25.020 INFO:tasks.workunit.client.0.smithi152.stdout:2/185: dread d6/db/d17/f28 [0,4194304] 0 2023-12-06T15:00:25.020 INFO:tasks.workunit.client.0.smithi152.stdout:2/186: fdatasync d6/f20 0 2023-12-06T15:00:25.020 INFO:tasks.workunit.client.0.smithi152.stdout:2/187: write d6/f15 [4727109,81419] 0 2023-12-06T15:00:25.020 INFO:tasks.workunit.client.0.smithi152.stdout:4/380: creat d2/f72 x:0 0 0 2023-12-06T15:00:25.021 INFO:tasks.workunit.client.0.smithi152.stdout:6/311: dread d1/d5/fb [0,4194304] 0 2023-12-06T15:00:25.021 INFO:tasks.workunit.client.0.smithi152.stdout:6/312: stat d1/d19/d1a/d30/d18/l1b 0 2023-12-06T15:00:25.021 INFO:tasks.workunit.client.0.smithi152.stdout:6/313: chown d1/d19/d1a/d30/d36/d35/d49 674770067 1 2023-12-06T15:00:25.025 INFO:tasks.workunit.client.1.smithi190.stdout:3/530: sync 2023-12-06T15:00:25.026 INFO:tasks.workunit.client.1.smithi190.stdout:3/531: dread - d4/d70/d19/d3a/f46 zero size 2023-12-06T15:00:25.026 INFO:tasks.workunit.client.1.smithi190.stdout:0/365: sync 2023-12-06T15:00:25.026 INFO:tasks.workunit.client.1.smithi190.stdout:2/384: sync 2023-12-06T15:00:25.027 INFO:tasks.workunit.client.1.smithi190.stdout:8/407: truncate d1/d20/d3b/f18 2589393 0 2023-12-06T15:00:25.027 INFO:tasks.workunit.client.1.smithi190.stdout:8/408: dread - d1/d20/d3b/d36/f68 zero size 2023-12-06T15:00:25.028 INFO:tasks.workunit.client.0.smithi152.stdout:2/188: symlink d6/d1e/l3a 0 2023-12-06T15:00:25.031 INFO:tasks.workunit.client.1.smithi190.stdout:2/385: mkdir d10/d26/d5c/d37/d83 0 2023-12-06T15:00:25.031 INFO:tasks.workunit.client.1.smithi190.stdout:2/386: chown d10/d26/c51 154172 1 2023-12-06T15:00:25.032 INFO:tasks.workunit.client.1.smithi190.stdout:4/327: sync 2023-12-06T15:00:25.032 INFO:tasks.workunit.client.1.smithi190.stdout:4/328: stat d3/f26 0 2023-12-06T15:00:25.034 INFO:tasks.workunit.client.0.smithi152.stdout:7/163: dread dd/f24 [0,4194304] 0 2023-12-06T15:00:25.035 INFO:tasks.workunit.client.0.smithi152.stdout:4/381: dread d2/d45/f4e [0,4194304] 0 2023-12-06T15:00:25.035 INFO:tasks.workunit.client.1.smithi190.stdout:8/409: mkdir d1/d20/d3b/d4c/d59/d7d 0 2023-12-06T15:00:25.035 INFO:tasks.workunit.client.1.smithi190.stdout:8/410: fdatasync d1/f41 0 2023-12-06T15:00:25.037 INFO:tasks.workunit.client.1.smithi190.stdout:1/643: dwrite d6/dc/d29/fcd [0,4194304] 0 2023-12-06T15:00:25.037 INFO:tasks.workunit.client.1.smithi190.stdout:1/644: chown d6/dc/d29/d38/d73/f91 31317 1 2023-12-06T15:00:25.039 INFO:tasks.workunit.client.1.smithi190.stdout:4/329: creat d3/d35/d19/d41/d44/d5b/f6f x:0 0 0 2023-12-06T15:00:25.041 INFO:tasks.workunit.client.0.smithi152.stdout:1/470: rmdir d3/da/d4c/d82/d52 39 2023-12-06T15:00:25.042 INFO:tasks.workunit.client.1.smithi190.stdout:9/411: dread d4/d27/d2f/d5c/f82 [0,4194304] 0 2023-12-06T15:00:25.042 INFO:tasks.workunit.client.1.smithi190.stdout:4/330: link d3/d10/d15/f2f d3/d35/d19/d41/d44/f70 0 2023-12-06T15:00:25.043 INFO:tasks.workunit.client.0.smithi152.stdout:1/471: write d3/da/d4c/d82/d75/f79 [1102819,35507] 0 2023-12-06T15:00:25.043 INFO:tasks.workunit.client.0.smithi152.stdout:1/472: stat d3/da/d4c/d82/f31 0 2023-12-06T15:00:25.046 INFO:tasks.workunit.client.1.smithi190.stdout:4/331: symlink d3/d10/d15/l71 0 2023-12-06T15:00:25.046 INFO:tasks.workunit.client.1.smithi190.stdout:9/412: link d4/d27/d2f/c4e d4/c8e 0 2023-12-06T15:00:25.049 INFO:tasks.workunit.client.1.smithi190.stdout:4/332: mkdir d3/d35/d19/d6c/d72 0 2023-12-06T15:00:25.049 INFO:tasks.workunit.client.1.smithi190.stdout:4/333: chown d3/d35/d19/d30/d3c/f45 760629658 1 2023-12-06T15:00:25.049 INFO:tasks.workunit.client.1.smithi190.stdout:9/413: unlink d4/fc 0 2023-12-06T15:00:25.050 INFO:tasks.workunit.client.0.smithi152.stdout:4/382: rmdir d2/d10/d52 39 2023-12-06T15:00:25.050 INFO:tasks.workunit.client.0.smithi152.stdout:7/164: symlink dd/df/d22/l33 0 2023-12-06T15:00:25.051 INFO:tasks.workunit.client.0.smithi152.stdout:1/473: rmdir d3/da/d4c 39 2023-12-06T15:00:25.055 INFO:tasks.workunit.client.1.smithi190.stdout:9/414: creat d4/d84/f8f x:0 0 0 2023-12-06T15:00:25.055 INFO:tasks.workunit.client.1.smithi190.stdout:9/415: dread - d4/d27/d2f/d66/f83 zero size 2023-12-06T15:00:25.056 INFO:tasks.workunit.client.0.smithi152.stdout:6/314: fdatasync d1/f2c 0 2023-12-06T15:00:25.057 INFO:tasks.workunit.client.1.smithi190.stdout:4/334: dread d3/f40 [0,4194304] 0 2023-12-06T15:00:25.057 INFO:tasks.workunit.client.0.smithi152.stdout:4/383: link d2/d10/d27/d29/f57 d2/d15/d32/d69/d6f/d6c/f73 0 2023-12-06T15:00:25.058 INFO:tasks.workunit.client.1.smithi190.stdout:4/335: write d3/d35/d19/d41/d44/f4c [1724024,115382] 0 2023-12-06T15:00:25.060 INFO:tasks.workunit.client.1.smithi190.stdout:9/416: read d4/f22 [2641027,30599] 0 2023-12-06T15:00:25.060 INFO:tasks.workunit.client.1.smithi190.stdout:4/336: creat d3/d4e/f73 x:0 0 0 2023-12-06T15:00:25.060 INFO:tasks.workunit.client.1.smithi190.stdout:4/337: fsync d3/d10/f2a 0 2023-12-06T15:00:25.060 INFO:tasks.workunit.client.1.smithi190.stdout:4/338: stat d3/d35/l5d 0 2023-12-06T15:00:25.060 INFO:tasks.workunit.client.1.smithi190.stdout:5/343: dwrite d0/df/f56 [0,4194304] 0 2023-12-06T15:00:25.061 INFO:tasks.workunit.client.0.smithi152.stdout:1/474: rmdir d3 39 2023-12-06T15:00:25.061 INFO:tasks.workunit.client.0.smithi152.stdout:1/475: readlink d3/da/d4c/lb3 0 2023-12-06T15:00:25.062 INFO:tasks.workunit.client.1.smithi190.stdout:5/344: symlink d0/l6d 0 2023-12-06T15:00:25.062 INFO:tasks.workunit.client.1.smithi190.stdout:5/345: stat d0/d1c/d2b/d2c/d5d 0 2023-12-06T15:00:25.063 INFO:tasks.workunit.client.0.smithi152.stdout:6/315: getdents d1/d19/d1a/d30/d36/d56 0 2023-12-06T15:00:25.063 INFO:tasks.workunit.client.0.smithi152.stdout:6/316: chown d1/d19/d1a/d30/d36/d4e/d55/c66 439702 1 2023-12-06T15:00:25.065 INFO:tasks.workunit.client.0.smithi152.stdout:4/384: mknod d2/d15/d32/d69/d6f/c74 0 2023-12-06T15:00:25.067 INFO:tasks.workunit.client.0.smithi152.stdout:1/476: mkdir d3/da/d4c/d82/db4 0 2023-12-06T15:00:25.067 INFO:tasks.workunit.client.0.smithi152.stdout:1/477: fsync d3/da/f35 0 2023-12-06T15:00:25.070 INFO:tasks.workunit.client.0.smithi152.stdout:6/317: rmdir d1/d19/d1a/d30/d36/d35 39 2023-12-06T15:00:25.076 INFO:tasks.workunit.client.0.smithi152.stdout:4/385: unlink d2/fc 0 2023-12-06T15:00:25.078 INFO:tasks.workunit.client.0.smithi152.stdout:5/229: dwrite d7/dd/f2a [0,4194304] 0 2023-12-06T15:00:25.078 INFO:tasks.workunit.client.0.smithi152.stdout:5/230: readlink d7/dd/d26/d3a/l45 0 2023-12-06T15:00:25.082 INFO:tasks.workunit.client.1.smithi190.stdout:4/339: dread d3/d35/d19/d41/d44/d5b/f61 [0,4194304] 0 2023-12-06T15:00:25.083 INFO:tasks.workunit.client.0.smithi152.stdout:4/386: read d2/d10/d27/f43 [1833345,127371] 0 2023-12-06T15:00:25.083 INFO:tasks.workunit.client.0.smithi152.stdout:4/387: readlink d2/d10/d27/d29/l4f 0 2023-12-06T15:00:25.085 INFO:tasks.workunit.client.0.smithi152.stdout:4/388: mkdir d2/d15/d23/d75 0 2023-12-06T15:00:25.086 INFO:tasks.workunit.client.0.smithi152.stdout:4/389: truncate d2/d15/f62 442707 0 2023-12-06T15:00:25.086 INFO:tasks.workunit.client.0.smithi152.stdout:4/390: creat d2/d22/f76 x:0 0 0 2023-12-06T15:00:25.086 INFO:tasks.workunit.client.0.smithi152.stdout:4/391: chown d2/d22/f18 3805 1 2023-12-06T15:00:25.086 INFO:tasks.workunit.client.0.smithi152.stdout:4/392: truncate d2/d10/d27/d3f/f56 4485004 0 2023-12-06T15:00:25.087 INFO:tasks.workunit.client.0.smithi152.stdout:4/393: getdents d2/d15/d23/d42 0 2023-12-06T15:00:25.087 INFO:tasks.workunit.client.0.smithi152.stdout:4/394: getdents d2/d10/d27/d29 0 2023-12-06T15:00:25.088 INFO:tasks.workunit.client.1.smithi190.stdout:1/645: dwrite d6/dc/d29/d38/d73/f91 [0,4194304] 0 2023-12-06T15:00:25.089 INFO:tasks.workunit.client.1.smithi190.stdout:0/366: dwrite d0/da/f44 [0,4194304] 0 2023-12-06T15:00:25.090 INFO:tasks.workunit.client.0.smithi152.stdout:4/395: rename d2/f1b to d2/d15/d32/d69/f77 0 2023-12-06T15:00:25.095 INFO:tasks.workunit.client.0.smithi152.stdout:0/229: dwrite d8/fa [8388608,4194304] 0 2023-12-06T15:00:25.095 INFO:tasks.workunit.client.0.smithi152.stdout:0/230: fdatasync d8/d1b/f36 0 2023-12-06T15:00:25.096 INFO:tasks.workunit.client.1.smithi190.stdout:3/532: dwrite d4/d1b/d54/fb1 [0,4194304] 0 2023-12-06T15:00:25.096 INFO:tasks.workunit.client.1.smithi190.stdout:3/533: write d4/d70/d33/d45/f98 [5013251,12968] 0 2023-12-06T15:00:25.099 INFO:tasks.workunit.client.1.smithi190.stdout:0/367: read d0/da/f49 [1296756,25925] 0 2023-12-06T15:00:25.101 INFO:tasks.workunit.client.1.smithi190.stdout:3/534: mknod d4/d70/d53/d56/d83/cbd 0 2023-12-06T15:00:25.102 INFO:tasks.workunit.client.0.smithi152.stdout:4/396: creat d2/d22/f78 x:0 0 0 2023-12-06T15:00:25.102 INFO:tasks.workunit.client.1.smithi190.stdout:4/340: fsync d3/d35/d19/d41/d44/d5b/f6f 0 2023-12-06T15:00:25.106 INFO:tasks.workunit.client.0.smithi152.stdout:0/231: dread d8/d1b/f34 [0,4194304] 0 2023-12-06T15:00:25.106 INFO:tasks.workunit.client.1.smithi190.stdout:4/341: write d3/d35/d19/f68 [946531,73794] 0 2023-12-06T15:00:25.106 INFO:tasks.workunit.client.1.smithi190.stdout:4/342: chown d3/d10/d15/f20 1413376 1 2023-12-06T15:00:25.106 INFO:tasks.workunit.client.1.smithi190.stdout:4/343: dread - d3/d10/f5f zero size 2023-12-06T15:00:25.107 INFO:tasks.workunit.client.1.smithi190.stdout:0/368: dread d0/da/d3e/d2b/d3c/d46/f73 [0,4194304] 0 2023-12-06T15:00:25.107 INFO:tasks.workunit.client.1.smithi190.stdout:0/369: chown d0/da/d3e/d2b/d3c 7 1 2023-12-06T15:00:25.107 INFO:tasks.workunit.client.1.smithi190.stdout:3/535: creat d4/d70/d33/fbe x:0 0 0 2023-12-06T15:00:25.108 INFO:tasks.workunit.client.0.smithi152.stdout:0/232: write d8/d1b/f41 [2227995,85123] 0 2023-12-06T15:00:25.108 INFO:tasks.workunit.client.0.smithi152.stdout:0/233: truncate d8/d3e/f43 70414 0 2023-12-06T15:00:25.111 INFO:tasks.workunit.client.0.smithi152.stdout:2/189: truncate d6/f15 1976175 0 2023-12-06T15:00:25.111 INFO:tasks.workunit.client.1.smithi190.stdout:5/346: dwrite d0/df/f17 [8388608,4194304] 0 2023-12-06T15:00:25.114 INFO:tasks.workunit.client.1.smithi190.stdout:5/347: read d0/f44 [262824,62251] 0 2023-12-06T15:00:25.114 INFO:tasks.workunit.client.1.smithi190.stdout:1/646: dwrite d6/f12 [0,4194304] 0 2023-12-06T15:00:25.115 INFO:tasks.workunit.client.1.smithi190.stdout:2/387: dwrite d10/d26/d5c/d35/f68 [0,4194304] 0 2023-12-06T15:00:25.115 INFO:tasks.workunit.client.1.smithi190.stdout:1/647: fdatasync d6/dc/d3b/d78/fb0 0 2023-12-06T15:00:25.115 INFO:tasks.workunit.client.1.smithi190.stdout:2/388: chown d10/f1f 1054539361 1 2023-12-06T15:00:25.116 INFO:tasks.workunit.client.1.smithi190.stdout:9/417: dwrite d4/d27/d2f/d31/f38 [8388608,4194304] 0 2023-12-06T15:00:25.117 INFO:tasks.workunit.client.0.smithi152.stdout:1/478: dwrite d3/da/d15/d17/d58/f64 [0,4194304] 0 2023-12-06T15:00:25.117 INFO:tasks.workunit.client.1.smithi190.stdout:2/389: creat d10/d26/d5b/d76/f84 x:0 0 0 2023-12-06T15:00:25.117 INFO:tasks.workunit.client.0.smithi152.stdout:6/318: dwrite d1/d5/f46 [0,4194304] 0 2023-12-06T15:00:25.118 INFO:tasks.workunit.client.0.smithi152.stdout:5/231: dread d7/dd/d26/f33 [0,4194304] 0 2023-12-06T15:00:25.118 INFO:tasks.workunit.client.1.smithi190.stdout:5/348: dread d0/df/f41 [0,4194304] 0 2023-12-06T15:00:25.118 INFO:tasks.workunit.client.1.smithi190.stdout:9/418: creat d4/d27/f90 x:0 0 0 2023-12-06T15:00:25.118 INFO:tasks.workunit.client.0.smithi152.stdout:4/397: rename d2/d10/d27/d29 to d2/d15/d32/d79 0 2023-12-06T15:00:25.119 INFO:tasks.workunit.client.1.smithi190.stdout:2/390: read d10/d26/d5c/d49/f55 [1775029,47661] 0 2023-12-06T15:00:25.119 INFO:tasks.workunit.client.1.smithi190.stdout:5/349: mknod d0/d1c/d2b/d2c/d5d/c6e 0 2023-12-06T15:00:25.120 INFO:tasks.workunit.client.1.smithi190.stdout:2/391: unlink d10/d26/f72 0 2023-12-06T15:00:25.120 INFO:tasks.workunit.client.1.smithi190.stdout:2/392: fsync d10/d26/d5c/d37/f3f 0 2023-12-06T15:00:25.120 INFO:tasks.workunit.client.1.smithi190.stdout:5/350: chown d0/d1c/d3e/c59 3344214 1 2023-12-06T15:00:25.121 INFO:tasks.workunit.client.1.smithi190.stdout:2/393: mknod d10/c85 0 2023-12-06T15:00:25.121 INFO:tasks.workunit.client.1.smithi190.stdout:2/394: fsync d10/d26/d5c/f63 0 2023-12-06T15:00:25.123 INFO:tasks.workunit.client.1.smithi190.stdout:5/351: mknod d0/d1c/d3e/d5a/d5f/c6f 0 2023-12-06T15:00:25.124 INFO:tasks.workunit.client.1.smithi190.stdout:2/395: truncate d10/d26/d5b/f6e 140950 0 2023-12-06T15:00:25.128 INFO:tasks.workunit.client.0.smithi152.stdout:0/234: creat d8/d44/f46 x:0 0 0 2023-12-06T15:00:25.128 INFO:tasks.workunit.client.0.smithi152.stdout:0/235: read - d8/f3f zero size 2023-12-06T15:00:25.128 INFO:tasks.workunit.client.1.smithi190.stdout:5/352: rename d0/df/l4b to d0/d1c/d2b/l70 0 2023-12-06T15:00:25.131 INFO:tasks.workunit.client.0.smithi152.stdout:6/319: mknod d1/c6e 0 2023-12-06T15:00:25.131 INFO:tasks.workunit.client.0.smithi152.stdout:6/320: write d1/d5/d15/f1d [13371677,68373] 0 2023-12-06T15:00:25.131 INFO:tasks.workunit.client.1.smithi190.stdout:5/353: getdents d0/d1c/d2b/d2c 0 2023-12-06T15:00:25.132 INFO:tasks.workunit.client.1.smithi190.stdout:1/648: dread d6/dc/ff [0,4194304] 0 2023-12-06T15:00:25.134 INFO:tasks.workunit.client.0.smithi152.stdout:5/232: symlink d7/dd/d26/d48/l49 0 2023-12-06T15:00:25.134 INFO:tasks.workunit.client.1.smithi190.stdout:1/649: mknod d6/dc/d6f/ccf 0 2023-12-06T15:00:25.136 INFO:tasks.workunit.client.0.smithi152.stdout:2/190: rename d6/db/d13/l30 to d6/db/d17/l3b 0 2023-12-06T15:00:25.137 INFO:tasks.workunit.client.1.smithi190.stdout:2/396: dread d10/f39 [0,4194304] 0 2023-12-06T15:00:25.137 INFO:tasks.workunit.client.1.smithi190.stdout:2/397: write d10/d26/f29 [419638,123662] 0 2023-12-06T15:00:25.138 INFO:tasks.workunit.client.1.smithi190.stdout:2/398: chown d10/d26/d5c/d37/c48 30825 1 2023-12-06T15:00:25.138 INFO:tasks.workunit.client.0.smithi152.stdout:1/479: dread d3/da/d15/d17/d58/f64 [0,4194304] 0 2023-12-06T15:00:25.139 INFO:tasks.workunit.client.0.smithi152.stdout:6/321: unlink d1/d19/d1a/d30/d36/d26/c27 0 2023-12-06T15:00:25.139 INFO:tasks.workunit.client.0.smithi152.stdout:6/322: write d1/d5/d15/f5c [573837,70189] 0 2023-12-06T15:00:25.139 INFO:tasks.workunit.client.0.smithi152.stdout:6/323: readlink d1/l1f 0 2023-12-06T15:00:25.140 INFO:tasks.workunit.client.0.smithi152.stdout:5/233: symlink d7/dd/d26/l4a 0 2023-12-06T15:00:25.141 INFO:tasks.workunit.client.0.smithi152.stdout:1/480: creat d3/da/db/d54/fb5 x:0 0 0 2023-12-06T15:00:25.141 INFO:tasks.workunit.client.0.smithi152.stdout:1/481: write d3/da/d15/d17/d1a/f5f [91608,19189] 0 2023-12-06T15:00:25.142 INFO:tasks.workunit.client.0.smithi152.stdout:1/482: write d3/da/d4c/d82/d52/d55/f9a [882718,71657] 0 2023-12-06T15:00:25.142 INFO:tasks.workunit.client.0.smithi152.stdout:6/324: creat d1/d19/d1a/d30/d36/d4e/d55/f6f x:0 0 0 2023-12-06T15:00:25.142 INFO:tasks.workunit.client.0.smithi152.stdout:6/325: write d1/d19/d1a/d30/d36/d35/d63/f65 [433586,24651] 0 2023-12-06T15:00:25.143 INFO:tasks.workunit.client.1.smithi190.stdout:5/354: dread d0/d1c/f33 [4194304,4194304] 0 2023-12-06T15:00:25.143 INFO:tasks.workunit.client.1.smithi190.stdout:5/355: truncate d0/d1c/d3e/f51 264490 0 2023-12-06T15:00:25.143 INFO:tasks.workunit.client.1.smithi190.stdout:5/356: chown d0/d1c/d3e/d5a/d5f 16533098 1 2023-12-06T15:00:25.143 INFO:tasks.workunit.client.0.smithi152.stdout:1/483: creat d3/da/d15/d17/d58/fb6 x:0 0 0 2023-12-06T15:00:25.146 INFO:tasks.workunit.client.0.smithi152.stdout:5/234: read d7/dd/d26/f3d [5028872,77693] 0 2023-12-06T15:00:25.150 INFO:tasks.workunit.client.1.smithi190.stdout:3/536: dwrite d4/fbb [0,4194304] 0 2023-12-06T15:00:25.151 INFO:tasks.workunit.client.1.smithi190.stdout:9/419: dwrite f1 [4194304,4194304] 0 2023-12-06T15:00:25.151 INFO:tasks.workunit.client.1.smithi190.stdout:9/420: stat d4/d27/d2f/d5c/f6c 0 2023-12-06T15:00:25.151 INFO:tasks.workunit.client.1.smithi190.stdout:4/344: dwrite d3/d10/f2a [4194304,4194304] 0 2023-12-06T15:00:25.156 INFO:tasks.workunit.client.0.smithi152.stdout:2/191: dread d6/db/d17/f23 [0,4194304] 0 2023-12-06T15:00:25.156 INFO:tasks.workunit.client.1.smithi190.stdout:0/370: dwrite d0/f41 [0,4194304] 0 2023-12-06T15:00:25.162 INFO:tasks.workunit.client.0.smithi152.stdout:4/398: dread d2/f26 [0,4194304] 0 2023-12-06T15:00:25.162 INFO:tasks.workunit.client.0.smithi152.stdout:4/399: chown d2/d15 0 1 2023-12-06T15:00:25.163 INFO:tasks.workunit.client.0.smithi152.stdout:4/400: mkdir d2/d10/d7a 0 2023-12-06T15:00:25.165 INFO:tasks.workunit.client.0.smithi152.stdout:4/401: symlink d2/d15/d23/l7b 0 2023-12-06T15:00:25.166 INFO:tasks.workunit.client.0.smithi152.stdout:4/402: creat d2/f7c x:0 0 0 2023-12-06T15:00:25.166 INFO:tasks.workunit.client.0.smithi152.stdout:4/403: fdatasync d2/d15/d32/f60 0 2023-12-06T15:00:25.167 INFO:tasks.workunit.client.0.smithi152.stdout:4/404: mknod d2/d22/c7d 0 2023-12-06T15:00:25.174 INFO:tasks.workunit.client.0.smithi152.stdout:2/192: dread f5 [0,4194304] 0 2023-12-06T15:00:25.174 INFO:tasks.workunit.client.0.smithi152.stdout:2/193: chown d6/d1e/c21 1026978 1 2023-12-06T15:00:25.176 INFO:tasks.workunit.client.0.smithi152.stdout:6/326: dwrite d1/d19/d1a/d30/d36/f24 [0,4194304] 0 2023-12-06T15:00:25.178 INFO:tasks.workunit.client.0.smithi152.stdout:1/484: dwrite d3/d44/d84/fa9 [0,4194304] 0 2023-12-06T15:00:25.178 INFO:tasks.workunit.client.0.smithi152.stdout:5/235: dwrite d7/dd/f20 [0,4194304] 0 2023-12-06T15:00:25.183 INFO:tasks.workunit.client.0.smithi152.stdout:5/236: dread d7/dd/f1c [0,4194304] 0 2023-12-06T15:00:25.183 INFO:tasks.workunit.client.0.smithi152.stdout:1/485: link d3/da/d4c/d82/d52/fb1 d3/da/d15/d17/d1a/fb7 0 2023-12-06T15:00:25.183 INFO:tasks.workunit.client.0.smithi152.stdout:6/327: dread d1/d19/d1a/d30/d36/f24 [0,4194304] 0 2023-12-06T15:00:25.188 INFO:tasks.workunit.client.0.smithi152.stdout:5/237: creat d7/d43/f4b x:0 0 0 2023-12-06T15:00:25.188 INFO:tasks.workunit.client.0.smithi152.stdout:5/238: chown d7/dd/l37 33408747 1 2023-12-06T15:00:25.188 INFO:tasks.workunit.client.0.smithi152.stdout:6/328: symlink d1/d5/l70 0 2023-12-06T15:00:25.189 INFO:tasks.workunit.client.0.smithi152.stdout:6/329: fdatasync d1/d19/d1a/d30/f22 0 2023-12-06T15:00:25.189 INFO:tasks.workunit.client.0.smithi152.stdout:1/486: link d3/da/d4c/d82/d75/f79 d3/da/d4c/d82/d52/d62/fb8 0 2023-12-06T15:00:25.189 INFO:tasks.workunit.client.0.smithi152.stdout:1/487: chown d3/da/d4c/d85/c99 2088765158 1 2023-12-06T15:00:25.189 INFO:tasks.workunit.client.0.smithi152.stdout:1/488: chown d3/da/d15/d17/d58/cb2 680609 1 2023-12-06T15:00:25.190 INFO:tasks.workunit.client.0.smithi152.stdout:4/405: getdents d2 0 2023-12-06T15:00:25.190 INFO:tasks.workunit.client.0.smithi152.stdout:4/406: readlink d2/d15/d32/d69/d6f/l51 0 2023-12-06T15:00:25.192 INFO:tasks.workunit.client.0.smithi152.stdout:5/239: getdents d7 0 2023-12-06T15:00:25.192 INFO:tasks.workunit.client.0.smithi152.stdout:2/194: dwrite d6/db/d17/f28 [0,4194304] 0 2023-12-06T15:00:25.193 INFO:tasks.workunit.client.0.smithi152.stdout:4/407: mknod d2/d15/d23/c7e 0 2023-12-06T15:00:25.193 INFO:tasks.workunit.client.0.smithi152.stdout:2/195: write d6/f20 [201289,40454] 0 2023-12-06T15:00:25.194 INFO:tasks.workunit.client.0.smithi152.stdout:2/196: dread - d6/d1e/f2e zero size 2023-12-06T15:00:25.194 INFO:tasks.workunit.client.0.smithi152.stdout:5/240: truncate d7/f38 385304 0 2023-12-06T15:00:25.194 INFO:tasks.workunit.client.0.smithi152.stdout:5/241: write d7/dd/d26/f32 [4668572,40228] 0 2023-12-06T15:00:25.194 INFO:tasks.workunit.client.0.smithi152.stdout:5/242: fdatasync d7/dd/f20 0 2023-12-06T15:00:25.195 INFO:tasks.workunit.client.0.smithi152.stdout:5/243: read d7/dd/f1c [1343499,50213] 0 2023-12-06T15:00:25.195 INFO:tasks.workunit.client.0.smithi152.stdout:6/330: dread d1/d19/d1a/d30/d36/f24 [0,4194304] 0 2023-12-06T15:00:25.198 INFO:tasks.workunit.client.0.smithi152.stdout:4/408: write d2/d22/f18 [464462,24263] 0 2023-12-06T15:00:25.201 INFO:tasks.workunit.client.0.smithi152.stdout:5/244: rename d7/c42 to d7/dd/d26/d3b/d46/c4c 0 2023-12-06T15:00:25.202 INFO:tasks.workunit.client.0.smithi152.stdout:4/409: truncate d2/d15/d32/d69/f77 248866 0 2023-12-06T15:00:25.205 INFO:tasks.workunit.client.0.smithi152.stdout:6/331: rename d1/d19/d1a/d30/d36/d4e/d55/f6f to d1/d19/f71 0 2023-12-06T15:00:25.206 INFO:tasks.workunit.client.0.smithi152.stdout:4/410: creat d2/d15/f7f x:0 0 0 2023-12-06T15:00:25.208 INFO:tasks.workunit.client.0.smithi152.stdout:4/411: rename d2/d15/d32/f55 to d2/d15/d23/f80 0 2023-12-06T15:00:25.208 INFO:tasks.workunit.client.0.smithi152.stdout:4/412: write d2/d15/d32/d79/f30 [1046119,13422] 0 2023-12-06T15:00:25.209 INFO:tasks.workunit.client.0.smithi152.stdout:6/332: write d1/f3d [3414742,12828] 0 2023-12-06T15:00:25.209 INFO:tasks.workunit.client.0.smithi152.stdout:6/333: write d1/d3c/f5f [690939,114656] 0 2023-12-06T15:00:25.209 INFO:tasks.workunit.client.0.smithi152.stdout:6/334: chown d1/d19/d1a/d30/d18 0 1 2023-12-06T15:00:25.209 INFO:tasks.workunit.client.0.smithi152.stdout:6/335: chown d1/d19/d1a/d30/d36/d4e/d55/c66 1 1 2023-12-06T15:00:25.209 INFO:tasks.workunit.client.0.smithi152.stdout:4/413: rename d2/d15/d23/l7b to d2/d15/d23/d75/l81 0 2023-12-06T15:00:25.210 INFO:tasks.workunit.client.0.smithi152.stdout:4/414: stat d2/d15/d32/d69/f77 0 2023-12-06T15:00:25.210 INFO:tasks.workunit.client.0.smithi152.stdout:6/336: symlink d1/d19/d6d/l72 0 2023-12-06T15:00:25.211 INFO:tasks.workunit.client.0.smithi152.stdout:6/337: creat d1/d5/f73 x:0 0 0 2023-12-06T15:00:25.211 INFO:tasks.workunit.client.0.smithi152.stdout:6/338: read - d1/d19/d1a/d30/d36/d4e/d55/f5d zero size 2023-12-06T15:00:25.212 INFO:tasks.workunit.client.0.smithi152.stdout:2/197: dwrite d6/db/d17/f1d [0,4194304] 0 2023-12-06T15:00:25.212 INFO:tasks.workunit.client.0.smithi152.stdout:5/245: dread d7/dd/f2d [0,4194304] 0 2023-12-06T15:00:25.212 INFO:tasks.workunit.client.0.smithi152.stdout:2/198: stat d6/db 0 2023-12-06T15:00:25.212 INFO:tasks.workunit.client.0.smithi152.stdout:6/339: mknod d1/d19/d1a/c74 0 2023-12-06T15:00:25.212 INFO:tasks.workunit.client.0.smithi152.stdout:6/340: read - d1/d19/d1a/f54 zero size 2023-12-06T15:00:25.213 INFO:tasks.workunit.client.0.smithi152.stdout:4/415: write d2/d15/d32/d79/f57 [3719383,66800] 0 2023-12-06T15:00:25.213 INFO:tasks.workunit.client.0.smithi152.stdout:6/341: dread d1/d19/f48 [0,4194304] 0 2023-12-06T15:00:25.213 INFO:tasks.workunit.client.0.smithi152.stdout:2/199: unlink d6/f20 0 2023-12-06T15:00:25.214 INFO:tasks.workunit.client.0.smithi152.stdout:5/246: creat d7/dd/d26/d3b/f4d x:0 0 0 2023-12-06T15:00:25.216 INFO:tasks.workunit.client.0.smithi152.stdout:4/416: truncate d2/d10/f17 814745 0 2023-12-06T15:00:25.218 INFO:tasks.workunit.client.0.smithi152.stdout:6/342: mkdir d1/d75 0 2023-12-06T15:00:25.219 INFO:tasks.workunit.client.0.smithi152.stdout:2/200: rmdir d6/d1e 39 2023-12-06T15:00:25.222 INFO:tasks.workunit.client.0.smithi152.stdout:5/247: mkdir d7/dd/d4e 0 2023-12-06T15:00:25.230 INFO:tasks.workunit.client.1.smithi190.stdout:1/650: mkdir d6/dc/d29/d38/d39/d63/d67/dd0 0 2023-12-06T15:00:25.231 INFO:tasks.workunit.client.1.smithi190.stdout:2/399: rename d10/d26/d5c/d49/l4a to d10/d26/d5c/d35/d77/l86 0 2023-12-06T15:00:25.232 INFO:tasks.workunit.client.1.smithi190.stdout:5/357: getdents d0/d1c/d3e 0 2023-12-06T15:00:25.235 INFO:tasks.workunit.client.0.smithi152.stdout:5/248: dread d7/f24 [0,4194304] 0 2023-12-06T15:00:25.236 INFO:tasks.workunit.client.0.smithi152.stdout:6/343: dread d1/f6 [0,4194304] 0 2023-12-06T15:00:25.236 INFO:tasks.workunit.client.0.smithi152.stdout:5/249: write d7/dd/f1c [779617,31868] 0 2023-12-06T15:00:25.236 INFO:tasks.workunit.client.1.smithi190.stdout:3/537: creat d4/d70/d53/d56/d94/d3d/fbf x:0 0 0 2023-12-06T15:00:25.237 INFO:tasks.workunit.client.0.smithi152.stdout:5/250: getdents d7/dd/d26/d3b 0 2023-12-06T15:00:25.237 INFO:tasks.workunit.client.0.smithi152.stdout:5/251: stat d7/d43 0 2023-12-06T15:00:25.241 INFO:tasks.workunit.client.0.smithi152.stdout:6/344: write d1/d5/f46 [1796280,51073] 0 2023-12-06T15:00:25.241 INFO:tasks.workunit.client.0.smithi152.stdout:6/345: chown d1/d19/d1a/f4a 7681 1 2023-12-06T15:00:25.241 INFO:tasks.workunit.client.0.smithi152.stdout:4/417: dwrite d2/d22/f4a [0,4194304] 0 2023-12-06T15:00:25.245 INFO:tasks.workunit.client.0.smithi152.stdout:4/418: creat d2/d15/d32/d79/f82 x:0 0 0 2023-12-06T15:00:25.245 INFO:tasks.workunit.client.0.smithi152.stdout:4/419: chown d2/d10/d52/l31 1335319 1 2023-12-06T15:00:25.249 INFO:tasks.workunit.client.0.smithi152.stdout:4/420: unlink d2/d10/f17 0 2023-12-06T15:00:25.255 INFO:tasks.workunit.client.0.smithi152.stdout:2/201: dwrite d6/db/f39 [0,4194304] 0 2023-12-06T15:00:25.255 INFO:tasks.workunit.client.0.smithi152.stdout:2/202: fdatasync d6/db/d13/f24 0 2023-12-06T15:00:25.255 INFO:tasks.workunit.client.0.smithi152.stdout:2/203: dread - d6/d1e/f37 zero size 2023-12-06T15:00:25.255 INFO:tasks.workunit.client.0.smithi152.stdout:2/204: dread - d6/d18/f36 zero size 2023-12-06T15:00:25.256 INFO:tasks.workunit.client.1.smithi190.stdout:0/371: creat d0/da/d3e/d3a/d40/f7b x:0 0 0 2023-12-06T15:00:25.256 INFO:tasks.workunit.client.1.smithi190.stdout:0/372: dread - d0/da/d3e/d2b/d3c/d65/f70 zero size 2023-12-06T15:00:25.256 INFO:tasks.workunit.client.1.smithi190.stdout:0/373: truncate d0/da/f25 953653 0 2023-12-06T15:00:25.256 INFO:tasks.workunit.client.1.smithi190.stdout:0/374: fdatasync d0/da/d3e/d3a/d40/f7b 0 2023-12-06T15:00:25.256 INFO:tasks.workunit.client.1.smithi190.stdout:0/375: stat d0/da/d3e/d2b/f45 0 2023-12-06T15:00:25.257 INFO:tasks.workunit.client.0.smithi152.stdout:2/205: unlink d6/d1e/l34 0 2023-12-06T15:00:25.257 INFO:tasks.workunit.client.1.smithi190.stdout:9/421: rename d4/d27/d2f/d31/d3f/d58/d72/f80 to d4/d27/d2f/d31/d3f/f91 0 2023-12-06T15:00:25.257 INFO:tasks.workunit.client.0.smithi152.stdout:2/206: read d6/db/d17/f23 [2710919,19276] 0 2023-12-06T15:00:25.258 INFO:tasks.workunit.client.1.smithi190.stdout:2/400: creat d10/d26/d5c/d35/f87 x:0 0 0 2023-12-06T15:00:25.258 INFO:tasks.workunit.client.1.smithi190.stdout:1/651: dwrite d6/dc/d3b/d78/fb0 [0,4194304] 0 2023-12-06T15:00:25.259 INFO:tasks.workunit.client.1.smithi190.stdout:5/358: symlink d0/d12/l71 0 2023-12-06T15:00:25.261 INFO:tasks.workunit.client.1.smithi190.stdout:0/376: creat d0/da/d3e/d2b/d3c/d65/f7c x:0 0 0 2023-12-06T15:00:25.261 INFO:tasks.workunit.client.1.smithi190.stdout:9/422: truncate d4/d27/d2f/d5c/f6c 4082135 0 2023-12-06T15:00:25.263 INFO:tasks.workunit.client.1.smithi190.stdout:3/538: rename d4/d1b/d54/d9c/f27 to d4/d1b/d5d/fc0 0 2023-12-06T15:00:25.263 INFO:tasks.workunit.client.1.smithi190.stdout:3/539: read - d4/d1b/d54/f9e zero size 2023-12-06T15:00:25.263 INFO:tasks.workunit.client.1.smithi190.stdout:3/540: truncate d4/d70/d33/d45/fac 766140 0 2023-12-06T15:00:25.264 INFO:tasks.workunit.client.1.smithi190.stdout:2/401: creat d10/d26/f88 x:0 0 0 2023-12-06T15:00:25.269 INFO:tasks.workunit.client.1.smithi190.stdout:1/652: rmdir d6/dc/d29/d38/d39/d63/d67/dd0 0 2023-12-06T15:00:25.269 INFO:tasks.workunit.client.1.smithi190.stdout:1/653: chown d6/dc/d29/c9d 0 1 2023-12-06T15:00:25.269 INFO:tasks.workunit.client.1.smithi190.stdout:1/654: write d6/dc/d3b/d78/f9a [3210315,76857] 0 2023-12-06T15:00:25.269 INFO:tasks.workunit.client.1.smithi190.stdout:1/655: write d6/f2f [2337900,52360] 0 2023-12-06T15:00:25.269 INFO:tasks.workunit.client.1.smithi190.stdout:1/656: rename d6/dc/d3b to d6/dc/d3b/dd1 22 2023-12-06T15:00:25.269 INFO:tasks.workunit.client.1.smithi190.stdout:1/657: write d6/dc/fa0 [3509,116268] 0 2023-12-06T15:00:25.270 INFO:tasks.workunit.client.1.smithi190.stdout:1/658: dread - d6/dc/d29/d38/d39/f9c zero size 2023-12-06T15:00:25.270 INFO:tasks.workunit.client.1.smithi190.stdout:1/659: write d6/dc/fa0 [430537,18818] 0 2023-12-06T15:00:25.270 INFO:tasks.workunit.client.1.smithi190.stdout:0/377: creat d0/da/d3e/d2b/d3c/f7d x:0 0 0 2023-12-06T15:00:25.271 INFO:tasks.workunit.client.1.smithi190.stdout:9/423: creat d4/d27/d8a/f92 x:0 0 0 2023-12-06T15:00:25.272 INFO:tasks.workunit.client.0.smithi152.stdout:2/207: dread d6/db/d13/f14 [0,4194304] 0 2023-12-06T15:00:25.272 INFO:tasks.workunit.client.0.smithi152.stdout:5/252: dwrite d7/f38 [0,4194304] 0 2023-12-06T15:00:25.272 INFO:tasks.workunit.client.0.smithi152.stdout:5/253: chown d7/dd/d26 0 1 2023-12-06T15:00:25.273 INFO:tasks.workunit.client.1.smithi190.stdout:3/541: rename d4/d70/d19/d3a/f80 to d4/d70/d19/d3a/fc1 0 2023-12-06T15:00:25.273 INFO:tasks.workunit.client.1.smithi190.stdout:1/660: mkdir d6/dc/d29/d38/d73/d5c/dd2 0 2023-12-06T15:00:25.273 INFO:tasks.workunit.client.0.smithi152.stdout:2/208: symlink d6/db/d13/l3c 0 2023-12-06T15:00:25.273 INFO:tasks.workunit.client.1.smithi190.stdout:0/378: symlink d0/da/d3e/d2b/d3c/d65/l7e 0 2023-12-06T15:00:25.273 INFO:tasks.workunit.client.1.smithi190.stdout:0/379: read - d0/da/f5c zero size 2023-12-06T15:00:25.275 INFO:tasks.workunit.client.1.smithi190.stdout:9/424: symlink d4/d27/d2f/l93 0 2023-12-06T15:00:25.275 INFO:tasks.workunit.client.0.smithi152.stdout:5/254: creat d7/dd/d26/d3a/f4f x:0 0 0 2023-12-06T15:00:25.276 INFO:tasks.workunit.client.0.smithi152.stdout:6/346: dwrite d1/d5/fb [0,4194304] 0 2023-12-06T15:00:25.277 INFO:tasks.workunit.client.1.smithi190.stdout:1/661: creat d6/dc/d29/d38/d39/d63/fd3 x:0 0 0 2023-12-06T15:00:25.277 INFO:tasks.workunit.client.1.smithi190.stdout:1/662: write d6/dc/d29/d38/d43/d7f/da7/fab [509675,126207] 0 2023-12-06T15:00:25.277 INFO:tasks.workunit.client.1.smithi190.stdout:1/663: fdatasync d6/dc/d29/d38/d39/f3f 0 2023-12-06T15:00:25.277 INFO:tasks.workunit.client.0.smithi152.stdout:5/255: symlink d7/d43/l50 0 2023-12-06T15:00:25.277 INFO:tasks.workunit.client.1.smithi190.stdout:2/402: dread d10/d59/d5e/f78 [4194304,4194304] 0 2023-12-06T15:00:25.278 INFO:tasks.workunit.client.1.smithi190.stdout:3/542: write d4/d70/d33/d45/f98 [2005851,94265] 0 2023-12-06T15:00:25.278 INFO:tasks.workunit.client.0.smithi152.stdout:5/256: write d7/dd/f35 [2817917,92830] 0 2023-12-06T15:00:25.278 INFO:tasks.workunit.client.0.smithi152.stdout:6/347: truncate d1/f8 6605299 0 2023-12-06T15:00:25.279 INFO:tasks.workunit.client.1.smithi190.stdout:1/664: mknod d6/dc/d6f/da4/cd4 0 2023-12-06T15:00:25.280 INFO:tasks.workunit.client.1.smithi190.stdout:2/403: link d10/d26/d5c/d49/d54/f5d d10/d26/d5b/f89 0 2023-12-06T15:00:25.281 INFO:tasks.workunit.client.1.smithi190.stdout:3/543: getdents d4/d70/d53/d56/d94 0 2023-12-06T15:00:25.282 INFO:tasks.workunit.client.0.smithi152.stdout:6/348: symlink d1/d19/d1a/d30/d36/d26/l76 0 2023-12-06T15:00:25.282 INFO:tasks.workunit.client.0.smithi152.stdout:4/421: dwrite d2/d15/d32/f5a [0,4194304] 0 2023-12-06T15:00:25.283 INFO:tasks.workunit.client.1.smithi190.stdout:2/404: unlink d10/d26/d5c/d37/c53 0 2023-12-06T15:00:25.283 INFO:tasks.workunit.client.1.smithi190.stdout:2/405: chown d10/d59/d5e 1546195 1 2023-12-06T15:00:25.285 INFO:tasks.workunit.client.0.smithi152.stdout:4/422: dread d2/d15/d32/d69/f77 [0,4194304] 0 2023-12-06T15:00:25.285 INFO:tasks.workunit.client.0.smithi152.stdout:4/423: chown d2/d45 102 1 2023-12-06T15:00:25.286 INFO:tasks.workunit.client.1.smithi190.stdout:5/359: dwrite d0/df/f20 [0,4194304] 0 2023-12-06T15:00:25.286 INFO:tasks.workunit.client.0.smithi152.stdout:6/349: rename d1/d5/f46 to d1/d19/d1a/d30/d36/d26/f77 0 2023-12-06T15:00:25.287 INFO:tasks.workunit.client.1.smithi190.stdout:3/544: creat d4/d70/d19/d3a/d3b/fc2 x:0 0 0 2023-12-06T15:00:25.287 INFO:tasks.workunit.client.1.smithi190.stdout:3/545: truncate d4/d1b/f62 404142 0 2023-12-06T15:00:25.289 INFO:tasks.workunit.client.0.smithi152.stdout:4/424: write d2/d10/f37 [2527104,50712] 0 2023-12-06T15:00:25.290 INFO:tasks.workunit.client.1.smithi190.stdout:0/380: write d0/f50 [3177887,95853] 0 2023-12-06T15:00:25.290 INFO:tasks.workunit.client.1.smithi190.stdout:0/381: chown d0/da/d3e/d2b/d3c/d46/d61/f63 989975 1 2023-12-06T15:00:25.290 INFO:tasks.workunit.client.1.smithi190.stdout:0/382: write d0/da/d3e/d2b/d3c/d65/f70 [761012,107408] 0 2023-12-06T15:00:25.296 INFO:tasks.workunit.client.1.smithi190.stdout:5/360: fdatasync d0/d1c/f36 0 2023-12-06T15:00:25.296 INFO:tasks.workunit.client.1.smithi190.stdout:5/361: chown d0/d1c/d3e 955928533 1 2023-12-06T15:00:25.297 INFO:tasks.workunit.client.1.smithi190.stdout:3/546: creat d4/d70/d53/d56/d94/d3d/fc3 x:0 0 0 2023-12-06T15:00:25.298 INFO:tasks.workunit.client.0.smithi152.stdout:2/209: rmdir d6/db 39 2023-12-06T15:00:25.298 INFO:tasks.workunit.client.0.smithi152.stdout:2/210: chown d6/d1e/d27 73 1 2023-12-06T15:00:25.298 INFO:tasks.workunit.client.1.smithi190.stdout:2/406: dread d10/d59/d5e/f3c [0,4194304] 0 2023-12-06T15:00:25.299 INFO:tasks.workunit.client.1.smithi190.stdout:3/547: rmdir d4/d70/d53/d56/d8f 39 2023-12-06T15:00:25.300 INFO:tasks.workunit.client.1.smithi190.stdout:2/407: mkdir d10/d26/d8a 0 2023-12-06T15:00:25.303 INFO:tasks.workunit.client.1.smithi190.stdout:2/408: rename d10/f40 to d10/d26/d5c/d49/d54/f8b 0 2023-12-06T15:00:25.303 INFO:tasks.workunit.client.0.smithi152.stdout:2/211: getdents d6/d18 0 2023-12-06T15:00:25.304 INFO:tasks.workunit.client.0.smithi152.stdout:2/212: creat d6/d18/f3d x:0 0 0 2023-12-06T15:00:25.307 INFO:tasks.workunit.client.0.smithi152.stdout:6/350: write d1/d19/d1a/d30/d36/d26/f77 [383879,1329] 0 2023-12-06T15:00:25.309 INFO:tasks.workunit.client.1.smithi190.stdout:6/524: sync 2023-12-06T15:00:25.309 INFO:tasks.workunit.client.1.smithi190.stdout:6/525: stat d4/d12/d40/l7b 0 2023-12-06T15:00:25.311 INFO:tasks.workunit.client.1.smithi190.stdout:9/425: dwrite d4/f6b [0,4194304] 0 2023-12-06T15:00:25.312 INFO:tasks.workunit.client.1.smithi190.stdout:9/426: read d4/d27/d2f/f5e [2566315,41187] 0 2023-12-06T15:00:25.312 INFO:tasks.workunit.client.1.smithi190.stdout:1/665: dwrite d6/dc/d3b/d78/d94/f87 [0,4194304] 0 2023-12-06T15:00:25.312 INFO:tasks.workunit.client.1.smithi190.stdout:1/666: write d6/d49/fc1 [5224278,49381] 0 2023-12-06T15:00:25.313 INFO:tasks.workunit.client.1.smithi190.stdout:6/526: rename d4/d15/l5a to d4/d12/d40/lae 0 2023-12-06T15:00:25.313 INFO:tasks.workunit.client.1.smithi190.stdout:6/527: readlink d4/d12/d40/d43/l8d 0 2023-12-06T15:00:25.313 INFO:tasks.workunit.client.0.smithi152.stdout:4/425: dwrite d2/d15/d32/f6a [0,4194304] 0 2023-12-06T15:00:25.314 INFO:tasks.workunit.client.1.smithi190.stdout:5/362: dread d0/fd [0,4194304] 0 2023-12-06T15:00:25.316 INFO:tasks.workunit.client.0.smithi152.stdout:6/351: dread d1/d19/d1a/d30/f22 [0,4194304] 0 2023-12-06T15:00:25.316 INFO:tasks.workunit.client.0.smithi152.stdout:6/352: fsync d1/d19/d1a/d30/f22 0 2023-12-06T15:00:25.316 INFO:tasks.workunit.client.0.smithi152.stdout:6/353: write d1/d19/d1a/d30/d36/f62 [488894,102547] 0 2023-12-06T15:00:25.317 INFO:tasks.workunit.client.1.smithi190.stdout:9/427: dread d4/d27/f53 [0,4194304] 0 2023-12-06T15:00:25.318 INFO:tasks.workunit.client.0.smithi152.stdout:4/426: unlink d2/d15/f64 0 2023-12-06T15:00:25.318 INFO:tasks.workunit.client.1.smithi190.stdout:1/667: mknod d6/dc/d29/cd5 0 2023-12-06T15:00:25.319 INFO:tasks.workunit.client.1.smithi190.stdout:5/363: symlink d0/d1c/d3e/d5a/l72 0 2023-12-06T15:00:25.319 INFO:tasks.workunit.client.1.smithi190.stdout:5/364: chown d0/l4f 3 1 2023-12-06T15:00:25.320 INFO:tasks.workunit.client.1.smithi190.stdout:3/548: write d4/d70/d33/d45/f98 [2682132,74938] 0 2023-12-06T15:00:25.320 INFO:tasks.workunit.client.1.smithi190.stdout:3/549: fdatasync d4/d1b/d54/d9c/fb2 0 2023-12-06T15:00:25.321 INFO:tasks.workunit.client.0.smithi152.stdout:6/354: unlink d1/d19/d1a/d30/d18/l1b 0 2023-12-06T15:00:25.322 INFO:tasks.workunit.client.1.smithi190.stdout:1/668: unlink d6/dc/d29/d38/d73/d5c/l8a 0 2023-12-06T15:00:25.322 INFO:tasks.workunit.client.1.smithi190.stdout:1/669: chown d6/dc/d29/d38/d73/c4c 1897 1 2023-12-06T15:00:25.322 INFO:tasks.workunit.client.1.smithi190.stdout:9/428: dread d4/d27/d2f/d66/f6e [0,4194304] 0 2023-12-06T15:00:25.323 INFO:tasks.workunit.client.0.smithi152.stdout:4/427: rename d2/d10/d27/d3f/f56 to d2/d10/d27/d3f/f83 0 2023-12-06T15:00:25.323 INFO:tasks.workunit.client.1.smithi190.stdout:5/365: rmdir d0/df 39 2023-12-06T15:00:25.324 INFO:tasks.workunit.client.0.smithi152.stdout:4/428: mkdir d2/d45/d84 0 2023-12-06T15:00:25.324 INFO:tasks.workunit.client.0.smithi152.stdout:4/429: dread - d2/d10/d27/f71 zero size 2023-12-06T15:00:25.325 INFO:tasks.workunit.client.1.smithi190.stdout:3/550: mkdir d4/d70/d53/dc4 0 2023-12-06T15:00:25.326 INFO:tasks.workunit.client.1.smithi190.stdout:9/429: getdents d4/d27/d2f/d66 0 2023-12-06T15:00:25.328 INFO:tasks.workunit.client.0.smithi152.stdout:2/213: rmdir d6/d18 39 2023-12-06T15:00:25.330 INFO:tasks.workunit.client.1.smithi190.stdout:5/366: rename d0/d12 to d0/d1c/d2b/d2c/d5d/d73 0 2023-12-06T15:00:25.330 INFO:tasks.workunit.client.1.smithi190.stdout:6/528: dread d4/d12/f53 [0,4194304] 0 2023-12-06T15:00:25.331 INFO:tasks.workunit.client.0.smithi152.stdout:2/214: symlink d6/db/d13/l3e 0 2023-12-06T15:00:25.331 INFO:tasks.workunit.client.1.smithi190.stdout:6/529: read d4/d12/d1a/d44/f47 [3947576,87814] 0 2023-12-06T15:00:25.333 INFO:tasks.workunit.client.0.smithi152.stdout:2/215: getdents d6/db/d17 0 2023-12-06T15:00:25.335 INFO:tasks.workunit.client.1.smithi190.stdout:3/551: symlink d4/d70/lc5 0 2023-12-06T15:00:25.335 INFO:tasks.workunit.client.1.smithi190.stdout:6/530: rename d4/d12/d1a/d70/c86 to d4/d12/d1a/d32/caf 0 2023-12-06T15:00:25.337 INFO:tasks.workunit.client.0.smithi152.stdout:2/216: mknod d6/d1e/c3f 0 2023-12-06T15:00:25.338 INFO:tasks.workunit.client.1.smithi190.stdout:1/670: dread d6/dc/d3b/d78/d94/f87 [0,4194304] 0 2023-12-06T15:00:25.338 INFO:tasks.workunit.client.1.smithi190.stdout:1/671: chown d6/dc/d29/d38/d73/d5c/cb8 0 1 2023-12-06T15:00:25.338 INFO:tasks.workunit.client.1.smithi190.stdout:1/672: chown d6/f25 16056 1 2023-12-06T15:00:25.339 INFO:tasks.workunit.client.1.smithi190.stdout:5/367: creat d0/d1c/d2b/d69/f74 x:0 0 0 2023-12-06T15:00:25.339 INFO:tasks.workunit.client.0.smithi152.stdout:2/217: truncate d6/db/d17/f1d 2166129 0 2023-12-06T15:00:25.339 INFO:tasks.workunit.client.1.smithi190.stdout:6/531: mknod d4/d12/d1a/d32/dab/cb0 0 2023-12-06T15:00:25.339 INFO:tasks.workunit.client.1.smithi190.stdout:2/409: dwrite d10/d26/d5b/f89 [0,4194304] 0 2023-12-06T15:00:25.340 INFO:tasks.workunit.client.1.smithi190.stdout:3/552: write d4/d1b/f37 [939198,7859] 0 2023-12-06T15:00:25.340 INFO:tasks.workunit.client.0.smithi152.stdout:6/355: dread d1/f13 [0,4194304] 0 2023-12-06T15:00:25.341 INFO:tasks.workunit.client.1.smithi190.stdout:7/474: sync 2023-12-06T15:00:25.343 INFO:tasks.workunit.client.0.smithi152.stdout:6/356: mknod d1/d19/d1a/d30/d36/d35/d49/d57/c78 0 2023-12-06T15:00:25.343 INFO:tasks.workunit.client.1.smithi190.stdout:1/673: creat d6/dc/d29/d38/d73/d76/d7e/fd6 x:0 0 0 2023-12-06T15:00:25.344 INFO:tasks.workunit.client.1.smithi190.stdout:6/532: mknod d4/d12/d40/d43/d45/d4a/d77/cb1 0 2023-12-06T15:00:25.344 INFO:tasks.workunit.client.1.smithi190.stdout:6/533: stat d4/d12/d9a/ca2 0 2023-12-06T15:00:25.344 INFO:tasks.workunit.client.1.smithi190.stdout:1/674: dread - d6/dc/d29/d38/d73/d76/fc3 zero size 2023-12-06T15:00:25.344 INFO:tasks.workunit.client.1.smithi190.stdout:6/534: readlink d4/d12/d40/d43/d45/l6d 0 2023-12-06T15:00:25.344 INFO:tasks.workunit.client.1.smithi190.stdout:6/535: fsync d4/d12/d1a/d44/f56 0 2023-12-06T15:00:25.344 INFO:tasks.workunit.client.1.smithi190.stdout:5/368: dread d0/f7 [4194304,4194304] 0 2023-12-06T15:00:25.345 INFO:tasks.workunit.client.0.smithi152.stdout:2/218: write d6/db/d17/f23 [3340576,68911] 0 2023-12-06T15:00:25.345 INFO:tasks.workunit.client.0.smithi152.stdout:2/219: fsync d6/db/f2b 0 2023-12-06T15:00:25.345 INFO:tasks.workunit.client.0.smithi152.stdout:2/220: readlink d6/db/d13/l25 0 2023-12-06T15:00:25.345 INFO:tasks.workunit.client.0.smithi152.stdout:2/221: chown d6/db/d13/f24 9909925 1 2023-12-06T15:00:25.345 INFO:tasks.workunit.client.0.smithi152.stdout:2/222: fdatasync d6/d18/f32 0 2023-12-06T15:00:25.345 INFO:tasks.workunit.client.1.smithi190.stdout:6/536: truncate d4/f30 4223470 0 2023-12-06T15:00:25.346 INFO:tasks.workunit.client.1.smithi190.stdout:8/411: sync 2023-12-06T15:00:25.346 INFO:tasks.workunit.client.1.smithi190.stdout:4/345: sync 2023-12-06T15:00:25.347 INFO:tasks.workunit.client.1.smithi190.stdout:5/369: rmdir d0/d1c 39 2023-12-06T15:00:25.347 INFO:tasks.workunit.client.1.smithi190.stdout:9/430: dwrite d4/d27/d2f/d5c/f6c [0,4194304] 0 2023-12-06T15:00:25.347 INFO:tasks.workunit.client.1.smithi190.stdout:9/431: chown d4/d27/d2f/d31/d3f/d58/f59 726 1 2023-12-06T15:00:25.348 INFO:tasks.workunit.client.1.smithi190.stdout:8/412: read d1/d20/d3b/d36/f3e [781506,86253] 0 2023-12-06T15:00:25.350 INFO:tasks.workunit.client.1.smithi190.stdout:9/432: read d4/f17 [2802901,117070] 0 2023-12-06T15:00:25.352 INFO:tasks.workunit.client.1.smithi190.stdout:3/553: dread d4/d70/d53/d56/d94/d3d/f5c [0,4194304] 0 2023-12-06T15:00:25.353 INFO:tasks.workunit.client.1.smithi190.stdout:6/537: link d4/d12/d1a/d44/f47 d4/d12/d1a/d8a/fb2 0 2023-12-06T15:00:25.353 INFO:tasks.workunit.client.1.smithi190.stdout:4/346: mknod d3/d35/d19/d30/d3c/c74 0 2023-12-06T15:00:25.355 INFO:tasks.workunit.client.1.smithi190.stdout:9/433: write d4/f6b [3253961,36231] 0 2023-12-06T15:00:25.355 INFO:tasks.workunit.client.1.smithi190.stdout:8/413: mkdir d1/d20/d3b/d7e 0 2023-12-06T15:00:25.355 INFO:tasks.workunit.client.1.smithi190.stdout:8/414: fsync d1/d20/d3b/d34/f40 0 2023-12-06T15:00:25.356 INFO:tasks.workunit.client.0.smithi152.stdout:2/223: write f5 [2214311,47593] 0 2023-12-06T15:00:25.356 INFO:tasks.workunit.client.0.smithi152.stdout:2/224: stat d6/db/f39 0 2023-12-06T15:00:25.357 INFO:tasks.workunit.client.0.smithi152.stdout:6/357: rename d1/d19 to d1/d1c/d79 0 2023-12-06T15:00:25.358 INFO:tasks.workunit.client.1.smithi190.stdout:3/554: mknod d4/d1b/cc6 0 2023-12-06T15:00:25.358 INFO:tasks.workunit.client.1.smithi190.stdout:6/538: rmdir d4/d12/d1a/d8c 39 2023-12-06T15:00:25.358 INFO:tasks.workunit.client.0.smithi152.stdout:2/225: creat d6/f40 x:0 0 0 2023-12-06T15:00:25.359 INFO:tasks.workunit.client.1.smithi190.stdout:1/675: dread d6/dc/fa0 [0,4194304] 0 2023-12-06T15:00:25.361 INFO:tasks.workunit.client.0.smithi152.stdout:6/358: mknod d1/d1c/d79/d1a/d30/d18/c7a 0 2023-12-06T15:00:25.361 INFO:tasks.workunit.client.0.smithi152.stdout:2/226: unlink d6/d1e/d27/c31 0 2023-12-06T15:00:25.362 INFO:tasks.workunit.client.0.smithi152.stdout:2/227: readlink d6/db/d13/l22 0 2023-12-06T15:00:25.362 INFO:tasks.workunit.client.1.smithi190.stdout:3/555: creat d4/d70/d53/fc7 x:0 0 0 2023-12-06T15:00:25.362 INFO:tasks.workunit.client.0.smithi152.stdout:6/359: symlink d1/d1c/d79/d1a/d30/d36/d35/d49/d57/l7b 0 2023-12-06T15:00:25.364 INFO:tasks.workunit.client.0.smithi152.stdout:2/228: mkdir d6/d1e/d41 0 2023-12-06T15:00:25.364 INFO:tasks.workunit.client.1.smithi190.stdout:9/434: dread d4/f6 [4194304,4194304] 0 2023-12-06T15:00:25.364 INFO:tasks.workunit.client.1.smithi190.stdout:6/539: creat d4/d12/d1a/d44/fb3 x:0 0 0 2023-12-06T15:00:25.365 INFO:tasks.workunit.client.1.smithi190.stdout:1/676: creat d6/dc/d29/d38/d73/fd7 x:0 0 0 2023-12-06T15:00:25.365 INFO:tasks.workunit.client.1.smithi190.stdout:1/677: dread - d6/dc/d29/d38/d73/d5c/db5/fa8 zero size 2023-12-06T15:00:25.367 INFO:tasks.workunit.client.1.smithi190.stdout:9/435: rmdir d4/d27/d2f/d5c 39 2023-12-06T15:00:25.368 INFO:tasks.workunit.client.1.smithi190.stdout:6/540: truncate d4/d15/f26 6137778 0 2023-12-06T15:00:25.368 INFO:tasks.workunit.client.1.smithi190.stdout:7/475: dread d0/d88/d32/f59 [0,4194304] 0 2023-12-06T15:00:25.370 INFO:tasks.workunit.client.1.smithi190.stdout:1/678: rename d6/dc/d29/d38/d39/f3e to d6/dc/d29/d38/d73/d5c/dd2/fd8 0 2023-12-06T15:00:25.373 INFO:tasks.workunit.client.1.smithi190.stdout:1/679: rename d6/dc/c16 to d6/dc/d3b/cd9 0 2023-12-06T15:00:25.377 INFO:tasks.workunit.client.1.smithi190.stdout:9/436: rename d4/f1f to d4/d27/d8a/f94 0 2023-12-06T15:00:25.377 INFO:tasks.workunit.client.1.smithi190.stdout:1/680: mkdir d6/dc/d29/d38/d39/dda 0 2023-12-06T15:00:25.379 INFO:tasks.workunit.client.1.smithi190.stdout:9/437: truncate d4/f22 202498 0 2023-12-06T15:00:25.379 INFO:tasks.workunit.client.1.smithi190.stdout:3/556: dread d4/d1b/d69/f6f [0,4194304] 0 2023-12-06T15:00:25.379 INFO:tasks.workunit.client.1.smithi190.stdout:3/557: write d4/d1b/d54/d9c/fb2 [232411,113166] 0 2023-12-06T15:00:25.381 INFO:tasks.workunit.client.1.smithi190.stdout:8/415: dread d1/d20/d3b/d31/f57 [0,4194304] 0 2023-12-06T15:00:25.381 INFO:tasks.workunit.client.1.smithi190.stdout:1/681: rename d6/f69 to d6/dc/d29/d38/d39/dda/fdb 0 2023-12-06T15:00:25.381 INFO:tasks.workunit.client.1.smithi190.stdout:1/682: read d6/dc/d29/d38/d39/dda/fdb [1503701,24602] 0 2023-12-06T15:00:25.382 INFO:tasks.workunit.client.1.smithi190.stdout:6/541: getdents d4/d12/d1a/d8a 0 2023-12-06T15:00:25.382 INFO:tasks.workunit.client.1.smithi190.stdout:6/542: fdatasync d4/d12/d40/d43/f4d 0 2023-12-06T15:00:25.382 INFO:tasks.workunit.client.1.smithi190.stdout:2/410: dwrite d10/f39 [0,4194304] 0 2023-12-06T15:00:25.383 INFO:tasks.workunit.client.1.smithi190.stdout:3/558: symlink d4/d1b/d77/lc8 0 2023-12-06T15:00:25.383 INFO:tasks.workunit.client.1.smithi190.stdout:3/559: chown d4/d1b/d54/f9e 10375 1 2023-12-06T15:00:25.384 INFO:tasks.workunit.client.0.smithi152.stdout:8/132: sync 2023-12-06T15:00:25.384 INFO:tasks.workunit.client.1.smithi190.stdout:3/560: read d4/d1b/d54/d9c/f99 [110374,4424] 0 2023-12-06T15:00:25.384 INFO:tasks.workunit.client.1.smithi190.stdout:8/416: rmdir d1/d20/d3b 39 2023-12-06T15:00:25.384 INFO:tasks.workunit.client.1.smithi190.stdout:8/417: write d1/d20/d3b/d36/f3c [317447,126818] 0 2023-12-06T15:00:25.385 INFO:tasks.workunit.client.0.smithi152.stdout:3/291: sync 2023-12-06T15:00:25.385 INFO:tasks.workunit.client.0.smithi152.stdout:9/245: sync 2023-12-06T15:00:25.386 INFO:tasks.workunit.client.0.smithi152.stdout:3/292: fdatasync d9/d10/f2e 0 2023-12-06T15:00:25.386 INFO:tasks.workunit.client.0.smithi152.stdout:9/246: chown d0/dd/f2f 1780 1 2023-12-06T15:00:25.386 INFO:tasks.workunit.client.0.smithi152.stdout:3/293: dread - d9/d10/d32/d50/f4f zero size 2023-12-06T15:00:25.386 INFO:tasks.workunit.client.0.smithi152.stdout:7/165: sync 2023-12-06T15:00:25.386 INFO:tasks.workunit.client.0.smithi152.stdout:8/133: unlink d1/f2 0 2023-12-06T15:00:25.387 INFO:tasks.workunit.client.0.smithi152.stdout:8/134: fsync d1/d6/d7/f21 0 2023-12-06T15:00:25.387 INFO:tasks.workunit.client.1.smithi190.stdout:9/438: rename d4/d27/f90 to d4/d27/d8a/f95 0 2023-12-06T15:00:25.387 INFO:tasks.workunit.client.1.smithi190.stdout:4/347: dwrite d3/d10/d39/f62 [0,4194304] 0 2023-12-06T15:00:25.387 INFO:tasks.workunit.client.1.smithi190.stdout:5/370: dwrite d0/f24 [0,4194304] 0 2023-12-06T15:00:25.387 INFO:tasks.workunit.client.1.smithi190.stdout:5/371: stat d0/d1c/d2b/d2c/d5d/d73/l3a 0 2023-12-06T15:00:25.387 INFO:tasks.workunit.client.1.smithi190.stdout:4/348: fsync d3/d35/d19/d30/f3a 0 2023-12-06T15:00:25.388 INFO:tasks.workunit.client.1.smithi190.stdout:1/683: symlink d6/dc/d3b/ldc 0 2023-12-06T15:00:25.388 INFO:tasks.workunit.client.0.smithi152.stdout:4/430: dwrite d2/f72 [0,4194304] 0 2023-12-06T15:00:25.389 INFO:tasks.workunit.client.0.smithi152.stdout:3/294: unlink d9/d10/f16 0 2023-12-06T15:00:25.389 INFO:tasks.workunit.client.0.smithi152.stdout:7/166: truncate dd/f13 109422 0 2023-12-06T15:00:25.391 INFO:tasks.workunit.client.1.smithi190.stdout:8/418: creat d1/d20/d3b/d4c/f7f x:0 0 0 2023-12-06T15:00:25.391 INFO:tasks.workunit.client.1.smithi190.stdout:8/419: stat d1/c11 0 2023-12-06T15:00:25.392 INFO:tasks.workunit.client.0.smithi152.stdout:4/431: mkdir d2/d15/d32/d54/d85 0 2023-12-06T15:00:25.392 INFO:tasks.workunit.client.0.smithi152.stdout:4/432: chown d2/d15/f7f 1518 1 2023-12-06T15:00:25.392 INFO:tasks.workunit.client.0.smithi152.stdout:4/433: fdatasync d2/d15/f7f 0 2023-12-06T15:00:25.393 INFO:tasks.workunit.client.1.smithi190.stdout:2/411: rename d10/d26/c51 to d10/d26/d5c/d35/d77/c8c 0 2023-12-06T15:00:25.393 INFO:tasks.workunit.client.1.smithi190.stdout:1/684: rename d6/dc/d29/d38 to d6/dc/d29/d38/d73/d5c/ddd 22 2023-12-06T15:00:25.393 INFO:tasks.workunit.client.0.smithi152.stdout:7/167: mkdir dd/df/d34 0 2023-12-06T15:00:25.394 INFO:tasks.workunit.client.1.smithi190.stdout:9/439: link d4/d27/d2f/d31/d3f/c57 d4/d27/d2f/d5c/c96 0 2023-12-06T15:00:25.394 INFO:tasks.workunit.client.0.smithi152.stdout:8/135: rename d1/d6/c1f to d1/c25 0 2023-12-06T15:00:25.398 INFO:tasks.workunit.client.1.smithi190.stdout:5/372: creat d0/df/d50/f75 x:0 0 0 2023-12-06T15:00:25.400 INFO:tasks.workunit.client.0.smithi152.stdout:8/136: creat d1/d6/db/f26 x:0 0 0 2023-12-06T15:00:25.401 INFO:tasks.workunit.client.1.smithi190.stdout:6/543: mkdir d4/d12/d1a/db4 0 2023-12-06T15:00:25.401 INFO:tasks.workunit.client.1.smithi190.stdout:6/544: fdatasync d4/d12/d1a/d70/f82 0 2023-12-06T15:00:25.402 INFO:tasks.workunit.client.1.smithi190.stdout:1/685: rename d6/dc/d29/d38/d43/f7b to d6/dc/d29/d38/d73/fde 0 2023-12-06T15:00:25.402 INFO:tasks.workunit.client.1.smithi190.stdout:1/686: read - d6/dc/d3b/d78/d94/f96 zero size 2023-12-06T15:00:25.403 INFO:tasks.workunit.client.1.smithi190.stdout:9/440: getdents d4/d84 0 2023-12-06T15:00:25.407 INFO:tasks.workunit.client.1.smithi190.stdout:8/420: creat d1/d10/f80 x:0 0 0 2023-12-06T15:00:25.409 INFO:tasks.workunit.client.1.smithi190.stdout:8/421: truncate d1/d20/d3b/d4c/d5a/f66 810097 0 2023-12-06T15:00:25.409 INFO:tasks.workunit.client.1.smithi190.stdout:6/545: dread d4/d12/d1a/d8a/fa7 [0,4194304] 0 2023-12-06T15:00:25.409 INFO:tasks.workunit.client.1.smithi190.stdout:4/349: dread d3/d10/d15/f34 [0,4194304] 0 2023-12-06T15:00:25.409 INFO:tasks.workunit.client.1.smithi190.stdout:4/350: dread - d3/d10/f5f zero size 2023-12-06T15:00:25.409 INFO:tasks.workunit.client.1.smithi190.stdout:4/351: stat d3/d35/d19/d41/d44/d5b/f61 0 2023-12-06T15:00:25.413 INFO:tasks.workunit.client.1.smithi190.stdout:4/352: rmdir d3/d35/d19/d41/d44 39 2023-12-06T15:00:25.413 INFO:tasks.workunit.client.1.smithi190.stdout:4/353: fdatasync d3/f12 0 2023-12-06T15:00:25.413 INFO:tasks.workunit.client.1.smithi190.stdout:6/546: rmdir d4/d12/d40/d43 39 2023-12-06T15:00:25.417 INFO:tasks.workunit.client.0.smithi152.stdout:8/137: write d1/d6/db/f11 [66446,52778] 0 2023-12-06T15:00:25.420 INFO:tasks.workunit.client.0.smithi152.stdout:8/138: symlink d1/d6/l27 0 2023-12-06T15:00:25.420 INFO:tasks.workunit.client.0.smithi152.stdout:8/139: write d1/d6/d7/f1e [4433675,1089] 0 2023-12-06T15:00:25.424 INFO:tasks.workunit.client.1.smithi190.stdout:6/547: write d4/d12/d1a/f97 [2565032,49819] 0 2023-12-06T15:00:25.426 INFO:tasks.workunit.client.0.smithi152.stdout:8/140: dread d1/d6/db/f14 [0,4194304] 0 2023-12-06T15:00:25.427 INFO:tasks.workunit.client.1.smithi190.stdout:9/441: dread d4/d27/d2f/f5e [0,4194304] 0 2023-12-06T15:00:25.427 INFO:tasks.workunit.client.0.smithi152.stdout:6/360: dwrite d1/d5/fb [4194304,4194304] 0 2023-12-06T15:00:25.429 INFO:tasks.workunit.client.1.smithi190.stdout:7/476: dwrite d0/d5/f7f [0,4194304] 0 2023-12-06T15:00:25.429 INFO:tasks.workunit.client.1.smithi190.stdout:7/477: chown d0/df/d53/f3c 1 1 2023-12-06T15:00:25.430 INFO:tasks.workunit.client.0.smithi152.stdout:6/361: symlink d1/d69/l7c 0 2023-12-06T15:00:25.430 INFO:tasks.workunit.client.0.smithi152.stdout:6/362: chown d1/d1c/d79/d1a/d30/f34 933152 1 2023-12-06T15:00:25.431 INFO:tasks.workunit.client.0.smithi152.stdout:6/363: fsync d1/d1c/d79/d1a/d30/d36/f4f 0 2023-12-06T15:00:25.432 INFO:tasks.workunit.client.0.smithi152.stdout:8/141: dread d1/d6/ff [0,4194304] 0 2023-12-06T15:00:25.435 INFO:tasks.workunit.client.0.smithi152.stdout:6/364: unlink d1/f6 0 2023-12-06T15:00:25.435 INFO:tasks.workunit.client.0.smithi152.stdout:6/365: write d1/d5/f73 [830229,12487] 0 2023-12-06T15:00:25.435 INFO:tasks.workunit.client.0.smithi152.stdout:6/366: readlink d1/d1c/d79/d1a/d30/d36/d4e/l58 0 2023-12-06T15:00:25.435 INFO:tasks.workunit.client.0.smithi152.stdout:6/367: readlink d1/d1c/d79/d1a/d30/d36/d4e/l58 0 2023-12-06T15:00:25.437 INFO:tasks.workunit.client.0.smithi152.stdout:6/368: link d1/d1c/d79/d1a/d30/f59 d1/d75/f7d 0 2023-12-06T15:00:25.437 INFO:tasks.workunit.client.0.smithi152.stdout:6/369: write d1/d1c/d79/d1a/d30/d36/d35/d63/f6c [209374,32843] 0 2023-12-06T15:00:25.437 INFO:tasks.workunit.client.1.smithi190.stdout:7/478: write d0/d88/d1c/f4d [4026559,11324] 0 2023-12-06T15:00:25.438 INFO:tasks.workunit.client.0.smithi152.stdout:8/142: write d1/d6/f1b [1037681,53139] 0 2023-12-06T15:00:25.438 INFO:tasks.workunit.client.0.smithi152.stdout:8/143: write d1/d6/d7/f21 [952524,90408] 0 2023-12-06T15:00:25.438 INFO:tasks.workunit.client.0.smithi152.stdout:6/370: creat d1/d1c/d79/d1a/d30/d36/f7e x:0 0 0 2023-12-06T15:00:25.439 INFO:tasks.workunit.client.0.smithi152.stdout:8/144: stat d1/d6/fd 0 2023-12-06T15:00:25.440 INFO:tasks.workunit.client.1.smithi190.stdout:7/479: mkdir d0/d88/d41/d92 0 2023-12-06T15:00:25.440 INFO:tasks.workunit.client.1.smithi190.stdout:7/480: write d0/f30 [2200943,67138] 0 2023-12-06T15:00:25.440 INFO:tasks.workunit.client.1.smithi190.stdout:7/481: read d0/df/d1f/f46 [252846,11995] 0 2023-12-06T15:00:25.441 INFO:tasks.workunit.client.0.smithi152.stdout:6/371: creat d1/d1c/d79/d6d/f7f x:0 0 0 2023-12-06T15:00:25.442 INFO:tasks.workunit.client.1.smithi190.stdout:7/482: link d0/d5/l6a d0/d88/d7a/l93 0 2023-12-06T15:00:25.444 INFO:tasks.workunit.client.0.smithi152.stdout:6/372: truncate d1/f2c 437966 0 2023-12-06T15:00:25.444 INFO:tasks.workunit.client.0.smithi152.stdout:6/373: read d1/d1c/d79/d1a/d30/d36/d35/d63/f65 [368564,123957] 0 2023-12-06T15:00:25.445 INFO:tasks.workunit.client.0.smithi152.stdout:6/374: read - d1/d1c/d79/d1a/d30/d18/f2a zero size 2023-12-06T15:00:25.445 INFO:tasks.workunit.client.0.smithi152.stdout:6/375: dread - d1/d1c/d79/d1a/d30/f59 zero size 2023-12-06T15:00:25.447 INFO:tasks.workunit.client.0.smithi152.stdout:6/376: link d1/d1c/d79/d1a/d30/d18/f2a d1/d1c/d79/d6d/f80 0 2023-12-06T15:00:25.447 INFO:tasks.workunit.client.0.smithi152.stdout:8/145: symlink d1/l28 0 2023-12-06T15:00:25.447 INFO:tasks.workunit.client.0.smithi152.stdout:6/377: chown d1/d1c/d79/d1a/d30/d36/d26/f2d 3457 1 2023-12-06T15:00:25.448 INFO:tasks.workunit.client.1.smithi190.stdout:7/483: write d0/df/f45 [2316854,113702] 0 2023-12-06T15:00:25.450 INFO:tasks.workunit.client.0.smithi152.stdout:6/378: creat d1/d75/f81 x:0 0 0 2023-12-06T15:00:25.451 INFO:tasks.workunit.client.1.smithi190.stdout:7/484: getdents d0/df 0 2023-12-06T15:00:25.458 INFO:tasks.workunit.client.1.smithi190.stdout:6/548: dwrite d4/d12/d40/d43/d45/f5f [0,4194304] 0 2023-12-06T15:00:25.461 INFO:tasks.workunit.client.1.smithi190.stdout:6/549: creat d4/d12/d40/d43/d45/d4a/d77/fb5 x:0 0 0 2023-12-06T15:00:25.461 INFO:tasks.workunit.client.1.smithi190.stdout:6/550: chown d4/d12/d1a/d8a/l91 3 1 2023-12-06T15:00:25.462 INFO:tasks.workunit.client.1.smithi190.stdout:6/551: symlink d4/d12/d1a/d70/da9/lb6 0 2023-12-06T15:00:25.462 INFO:tasks.workunit.client.1.smithi190.stdout:6/552: truncate d4/fe 2225005 0 2023-12-06T15:00:25.462 INFO:tasks.workunit.client.1.smithi190.stdout:8/422: dwrite d1/d10/f5e [0,4194304] 0 2023-12-06T15:00:25.462 INFO:tasks.workunit.client.1.smithi190.stdout:8/423: fdatasync d1/f41 0 2023-12-06T15:00:25.465 INFO:tasks.workunit.client.0.smithi152.stdout:6/379: dread d1/d5/f9 [0,4194304] 0 2023-12-06T15:00:25.466 INFO:tasks.workunit.client.0.smithi152.stdout:2/229: dwrite d6/db/d17/f23 [0,4194304] 0 2023-12-06T15:00:25.466 INFO:tasks.workunit.client.0.smithi152.stdout:6/380: read d1/d1c/d79/d1a/d30/d36/d26/f2d [600450,77872] 0 2023-12-06T15:00:25.466 INFO:tasks.workunit.client.0.smithi152.stdout:6/381: chown d1/d1c/d79/d1a/d30/d36/d35/d49/d57/l7b 50 1 2023-12-06T15:00:25.466 INFO:tasks.workunit.client.0.smithi152.stdout:6/382: chown d1/d1c/d79 10070 1 2023-12-06T15:00:25.466 INFO:tasks.workunit.client.1.smithi190.stdout:8/424: creat d1/d20/d3b/d4c/d59/f81 x:0 0 0 2023-12-06T15:00:25.466 INFO:tasks.workunit.client.1.smithi190.stdout:2/412: dwrite d10/f62 [0,4194304] 0 2023-12-06T15:00:25.466 INFO:tasks.workunit.client.1.smithi190.stdout:3/561: dwrite d4/d1b/d54/fb1 [0,4194304] 0 2023-12-06T15:00:25.466 INFO:tasks.workunit.client.1.smithi190.stdout:3/562: fsync d4/d1b/d54/d9c/fb6 0 2023-12-06T15:00:25.466 INFO:tasks.workunit.client.1.smithi190.stdout:3/563: dread - d4/d70/d53/f9a zero size 2023-12-06T15:00:25.467 INFO:tasks.workunit.client.0.smithi152.stdout:9/247: dwrite d0/dd/f3e [0,4194304] 0 2023-12-06T15:00:25.469 INFO:tasks.workunit.client.0.smithi152.stdout:7/168: dwrite dd/df/d22/d29/f2a [4194304,4194304] 0 2023-12-06T15:00:25.469 INFO:tasks.workunit.client.0.smithi152.stdout:3/295: dwrite d9/d10/d12/f30 [0,4194304] 0 2023-12-06T15:00:25.470 INFO:tasks.workunit.client.0.smithi152.stdout:2/230: rmdir d6/d1e 39 2023-12-06T15:00:25.471 INFO:tasks.workunit.client.1.smithi190.stdout:9/442: dwrite d4/d27/d2f/f37 [0,4194304] 0 2023-12-06T15:00:25.471 INFO:tasks.workunit.client.1.smithi190.stdout:8/425: dread d1/f35 [0,4194304] 0 2023-12-06T15:00:25.473 INFO:tasks.workunit.client.1.smithi190.stdout:4/354: dwrite d3/f3f [0,4194304] 0 2023-12-06T15:00:25.475 INFO:tasks.workunit.client.0.smithi152.stdout:4/434: rmdir d2/d15 39 2023-12-06T15:00:25.476 INFO:tasks.workunit.client.1.smithi190.stdout:3/564: dread d4/d70/d53/d56/d94/d3d/f40 [0,4194304] 0 2023-12-06T15:00:25.477 INFO:tasks.workunit.client.0.smithi152.stdout:9/248: mkdir d0/dd/d20/d38/d44 0 2023-12-06T15:00:25.478 INFO:tasks.workunit.client.1.smithi190.stdout:4/355: dread d3/f40 [0,4194304] 0 2023-12-06T15:00:25.480 INFO:tasks.workunit.client.0.smithi152.stdout:3/296: mkdir d9/d45/d55 0 2023-12-06T15:00:25.481 INFO:tasks.workunit.client.0.smithi152.stdout:9/249: dread d0/dd/d20/f29 [0,4194304] 0 2023-12-06T15:00:25.483 INFO:tasks.workunit.client.1.smithi190.stdout:3/565: write d4/d70/d53/d56/d94/d3d/f40 [952512,71816] 0 2023-12-06T15:00:25.483 INFO:tasks.workunit.client.1.smithi190.stdout:3/566: fsync d4/d70/d33/d45/f85 0 2023-12-06T15:00:25.483 INFO:tasks.workunit.client.1.smithi190.stdout:3/567: chown d4/d70/d19/d3a/d3b/f55 322 1 2023-12-06T15:00:25.484 INFO:tasks.workunit.client.0.smithi152.stdout:4/435: creat d2/d15/d32/d54/d85/f86 x:0 0 0 2023-12-06T15:00:25.484 INFO:tasks.workunit.client.0.smithi152.stdout:2/231: rename d6/db/l33 to d6/l42 0 2023-12-06T15:00:25.484 INFO:tasks.workunit.client.1.smithi190.stdout:9/443: mknod d4/d27/d2f/d31/d3f/d58/d72/d7a/c97 0 2023-12-06T15:00:25.484 INFO:tasks.workunit.client.1.smithi190.stdout:7/485: dwrite d0/d5/f83 [0,4194304] 0 2023-12-06T15:00:25.486 INFO:tasks.workunit.client.0.smithi152.stdout:3/297: symlink d9/d10/d12/d44/l56 0 2023-12-06T15:00:25.488 INFO:tasks.workunit.client.1.smithi190.stdout:3/568: symlink d4/d70/d19/d3a/lc9 0 2023-12-06T15:00:25.488 INFO:tasks.workunit.client.1.smithi190.stdout:3/569: readlink d4/d70/l58 0 2023-12-06T15:00:25.489 INFO:tasks.workunit.client.1.smithi190.stdout:9/444: mknod d4/d27/d2f/c98 0 2023-12-06T15:00:25.492 INFO:tasks.workunit.client.1.smithi190.stdout:4/356: mknod d3/d35/d19/c75 0 2023-12-06T15:00:25.492 INFO:tasks.workunit.client.1.smithi190.stdout:4/357: write d3/d35/f6a [365945,100365] 0 2023-12-06T15:00:25.493 INFO:tasks.workunit.client.0.smithi152.stdout:9/250: rename d0/d31 to d0/dd/d20/d38/d45 0 2023-12-06T15:00:25.493 INFO:tasks.workunit.client.0.smithi152.stdout:9/251: chown d0/dd/f42 3495482 1 2023-12-06T15:00:25.494 INFO:tasks.workunit.client.1.smithi190.stdout:3/570: rename d4/l2e to d4/d70/d33/d45/lca 0 2023-12-06T15:00:25.496 INFO:tasks.workunit.client.1.smithi190.stdout:4/358: getdents d3/d10/d39 0 2023-12-06T15:00:25.496 INFO:tasks.workunit.client.0.smithi152.stdout:4/436: dread d2/d22/f4a [0,4194304] 0 2023-12-06T15:00:25.498 INFO:tasks.workunit.client.1.smithi190.stdout:3/571: mkdir d4/d70/dcb 0 2023-12-06T15:00:25.498 INFO:tasks.workunit.client.1.smithi190.stdout:4/359: mkdir d3/d76 0 2023-12-06T15:00:25.499 INFO:tasks.workunit.client.1.smithi190.stdout:4/360: dread - d3/d35/d19/d30/d3c/d4d/f55 zero size 2023-12-06T15:00:25.499 INFO:tasks.workunit.client.1.smithi190.stdout:4/361: fdatasync d3/d10/f2a 0 2023-12-06T15:00:25.499 INFO:tasks.workunit.client.0.smithi152.stdout:3/298: truncate d9/d10/d12/f3e 723262 0 2023-12-06T15:00:25.499 INFO:tasks.workunit.client.1.smithi190.stdout:2/413: dread d10/d59/d5e/f16 [0,4194304] 0 2023-12-06T15:00:25.499 INFO:tasks.workunit.client.1.smithi190.stdout:2/414: chown d10/d26/d5c/d35/f68 199470324 1 2023-12-06T15:00:25.500 INFO:tasks.workunit.client.1.smithi190.stdout:3/572: creat d4/d70/d19/d51/fcc x:0 0 0 2023-12-06T15:00:25.502 INFO:tasks.workunit.client.1.smithi190.stdout:4/362: unlink d3/d35/d19/d30/d3c/d4d/l58 0 2023-12-06T15:00:25.502 INFO:tasks.workunit.client.1.smithi190.stdout:7/486: dread d0/d88/d1c/f28 [4194304,4194304] 0 2023-12-06T15:00:25.503 INFO:tasks.workunit.client.0.smithi152.stdout:7/169: dwrite dd/df/f1f [4194304,4194304] 0 2023-12-06T15:00:25.503 INFO:tasks.workunit.client.1.smithi190.stdout:9/445: dread d4/d27/d2f/d5c/f6c [0,4194304] 0 2023-12-06T15:00:25.503 INFO:tasks.workunit.client.1.smithi190.stdout:2/415: mkdir d10/d26/d5c/d8d 0 2023-12-06T15:00:25.504 INFO:tasks.workunit.client.0.smithi152.stdout:9/252: getdents d0/dd/d20/d38/d45 0 2023-12-06T15:00:25.504 INFO:tasks.workunit.client.1.smithi190.stdout:7/487: read d0/df/d1f/f58 [2980567,110683] 0 2023-12-06T15:00:25.504 INFO:tasks.workunit.client.0.smithi152.stdout:6/383: dwrite d1/d1c/d79/d1a/f54 [0,4194304] 0 2023-12-06T15:00:25.505 INFO:tasks.workunit.client.1.smithi190.stdout:3/573: mknod d4/ccd 0 2023-12-06T15:00:25.505 INFO:tasks.workunit.client.1.smithi190.stdout:6/553: dwrite d4/d12/d1a/d70/da9/faa [8388608,4194304] 0 2023-12-06T15:00:25.506 INFO:tasks.workunit.client.0.smithi152.stdout:4/437: creat d2/d15/d32/d54/d85/f87 x:0 0 0 2023-12-06T15:00:25.506 INFO:tasks.workunit.client.1.smithi190.stdout:4/363: rename d3/d35/d19/d41/l57 to d3/d35/d19/d6c/l77 0 2023-12-06T15:00:25.506 INFO:tasks.workunit.client.1.smithi190.stdout:4/364: chown d3/fd 1207205328 1 2023-12-06T15:00:25.507 INFO:tasks.workunit.client.1.smithi190.stdout:2/416: unlink d10/d26/d5c/d35/l4d 0 2023-12-06T15:00:25.507 INFO:tasks.workunit.client.1.smithi190.stdout:2/417: dread - d10/d59/d5e/f6a zero size 2023-12-06T15:00:25.507 INFO:tasks.workunit.client.1.smithi190.stdout:7/488: dread d0/d88/d7a/f69 [0,4194304] 0 2023-12-06T15:00:25.508 INFO:tasks.workunit.client.0.smithi152.stdout:3/299: unlink l4 0 2023-12-06T15:00:25.508 INFO:tasks.workunit.client.0.smithi152.stdout:3/300: chown d9/f2d 6 1 2023-12-06T15:00:25.508 INFO:tasks.workunit.client.0.smithi152.stdout:3/301: chown d9/d10/d19 435734873 1 2023-12-06T15:00:25.508 INFO:tasks.workunit.client.0.smithi152.stdout:3/302: chown d9/d10/d19/f33 7752460 1 2023-12-06T15:00:25.508 INFO:tasks.workunit.client.0.smithi152.stdout:3/303: stat d9/d18/d1a/f4e 0 2023-12-06T15:00:25.508 INFO:tasks.workunit.client.0.smithi152.stdout:3/304: dread - d9/d18/f3c zero size 2023-12-06T15:00:25.508 INFO:tasks.workunit.client.0.smithi152.stdout:3/305: write d9/d10/d32/f3d [619925,59270] 0 2023-12-06T15:00:25.509 INFO:tasks.workunit.client.1.smithi190.stdout:3/574: mkdir d4/d70/d53/dc4/dce 0 2023-12-06T15:00:25.510 INFO:tasks.workunit.client.1.smithi190.stdout:6/554: creat d4/d12/d1a/d8a/da3/fb7 x:0 0 0 2023-12-06T15:00:25.511 INFO:tasks.workunit.client.0.smithi152.stdout:9/253: creat d0/dd/d20/d38/f46 x:0 0 0 2023-12-06T15:00:25.511 INFO:tasks.workunit.client.0.smithi152.stdout:9/254: readlink d0/dd/d20/l22 0 2023-12-06T15:00:25.511 INFO:tasks.workunit.client.0.smithi152.stdout:9/255: chown d0 6676 1 2023-12-06T15:00:25.512 INFO:tasks.workunit.client.1.smithi190.stdout:4/365: rename d3/d10/f1e to d3/f78 0 2023-12-06T15:00:25.513 INFO:tasks.workunit.client.1.smithi190.stdout:2/418: getdents d10 0 2023-12-06T15:00:25.515 INFO:tasks.workunit.client.0.smithi152.stdout:6/384: link d1/d1c/d79/d1a/d30/l2b d1/d1c/d79/d4b/l82 0 2023-12-06T15:00:25.516 INFO:tasks.workunit.client.1.smithi190.stdout:7/489: rename d0/d88/d1c/d17/d6e to d0/d88/d1c/d17/d94 0 2023-12-06T15:00:25.516 INFO:tasks.workunit.client.0.smithi152.stdout:4/438: rmdir d2/d15/d32/d69/d6f/d6c 39 2023-12-06T15:00:25.517 INFO:tasks.workunit.client.0.smithi152.stdout:2/232: rmdir d6 39 2023-12-06T15:00:25.518 INFO:tasks.workunit.client.1.smithi190.stdout:3/575: mknod d4/d70/d7f/ccf 0 2023-12-06T15:00:25.518 INFO:tasks.workunit.client.0.smithi152.stdout:7/170: dread f8 [0,4194304] 0 2023-12-06T15:00:25.518 INFO:tasks.workunit.client.0.smithi152.stdout:3/306: creat d9/d10/d19/f57 x:0 0 0 2023-12-06T15:00:25.518 INFO:tasks.workunit.client.0.smithi152.stdout:3/307: chown d9/l35 0 1 2023-12-06T15:00:25.519 INFO:tasks.workunit.client.1.smithi190.stdout:6/555: symlink d4/d12/d40/d43/lb8 0 2023-12-06T15:00:25.520 INFO:tasks.workunit.client.1.smithi190.stdout:9/446: dwrite d4/f6b [0,4194304] 0 2023-12-06T15:00:25.520 INFO:tasks.workunit.client.1.smithi190.stdout:9/447: dread - d4/d27/d2f/d31/d3f/d58/d72/d7a/f7f zero size 2023-12-06T15:00:25.520 INFO:tasks.workunit.client.1.smithi190.stdout:0/383: sync 2023-12-06T15:00:25.520 INFO:tasks.workunit.client.0.smithi152.stdout:9/256: link d0/dd/l2c d0/dd/d20/d38/l47 0 2023-12-06T15:00:25.521 INFO:tasks.workunit.client.1.smithi190.stdout:2/419: mkdir d10/d26/d5b/d7f/d8e 0 2023-12-06T15:00:25.522 INFO:tasks.workunit.client.0.smithi152.stdout:6/385: symlink d1/d1c/d79/d1a/d30/d36/d35/d49/l83 0 2023-12-06T15:00:25.522 INFO:tasks.workunit.client.0.smithi152.stdout:6/386: write d1/d1c/d79/f48 [419599,105494] 0 2023-12-06T15:00:25.523 INFO:tasks.workunit.client.1.smithi190.stdout:7/490: rename d0/d88/d41/d87 to d0/d88/d1c/d17/d94/d95 0 2023-12-06T15:00:25.524 INFO:tasks.workunit.client.1.smithi190.stdout:3/576: creat d4/d70/d53/d56/d94/d3d/fd0 x:0 0 0 2023-12-06T15:00:25.524 INFO:tasks.workunit.client.1.smithi190.stdout:3/577: getdents d4/d70/d19/d51/dab 0 2023-12-06T15:00:25.524 INFO:tasks.workunit.client.1.smithi190.stdout:3/578: stat d4/d70/d19/d51/l7a 0 2023-12-06T15:00:25.526 INFO:tasks.workunit.client.1.smithi190.stdout:6/556: unlink d4/d12/f3f 0 2023-12-06T15:00:25.529 INFO:tasks.workunit.client.1.smithi190.stdout:4/366: link d3/d10/d39/f62 d3/d35/d19/f79 0 2023-12-06T15:00:25.530 INFO:tasks.workunit.client.0.smithi152.stdout:7/171: truncate fa 448384 0 2023-12-06T15:00:25.530 INFO:tasks.workunit.client.0.smithi152.stdout:6/387: creat d1/d1c/d79/d1a/d30/f84 x:0 0 0 2023-12-06T15:00:25.530 INFO:tasks.workunit.client.0.smithi152.stdout:3/308: rmdir d9/d10/d12 39 2023-12-06T15:00:25.530 INFO:tasks.workunit.client.0.smithi152.stdout:3/309: fsync d9/d10/f28 0 2023-12-06T15:00:25.531 INFO:tasks.workunit.client.1.smithi190.stdout:9/448: creat d4/d84/f99 x:0 0 0 2023-12-06T15:00:25.531 INFO:tasks.workunit.client.1.smithi190.stdout:9/449: stat d4 0 2023-12-06T15:00:25.531 INFO:tasks.workunit.client.0.smithi152.stdout:7/172: getdents dd/df/d1b/d20/d28 0 2023-12-06T15:00:25.532 INFO:tasks.workunit.client.1.smithi190.stdout:0/384: truncate d0/da/d3e/d2b/d3c/d46/f73 3893774 0 2023-12-06T15:00:25.534 INFO:tasks.workunit.client.0.smithi152.stdout:7/173: creat dd/df/d1b/d20/f35 x:0 0 0 2023-12-06T15:00:25.534 INFO:tasks.workunit.client.0.smithi152.stdout:7/174: dread - dd/df/d1b/d20/f35 zero size 2023-12-06T15:00:25.534 INFO:tasks.workunit.client.0.smithi152.stdout:3/310: write d9/d10/d19/f2c [402269,29520] 0 2023-12-06T15:00:25.535 INFO:tasks.workunit.client.1.smithi190.stdout:2/420: mkdir d10/d26/d8a/d8f 0 2023-12-06T15:00:25.535 INFO:tasks.workunit.client.1.smithi190.stdout:2/421: dread - d10/f4f zero size 2023-12-06T15:00:25.535 INFO:tasks.workunit.client.1.smithi190.stdout:2/422: stat d10/d26/d5c/d49/d54/f6d 0 2023-12-06T15:00:25.536 INFO:tasks.workunit.client.0.smithi152.stdout:7/175: rmdir dd/d17 39 2023-12-06T15:00:25.536 INFO:tasks.workunit.client.1.smithi190.stdout:3/579: mknod d4/d1b/d5d/cd1 0 2023-12-06T15:00:25.537 INFO:tasks.workunit.client.1.smithi190.stdout:6/557: symlink d4/d15/lb9 0 2023-12-06T15:00:25.538 INFO:tasks.workunit.client.0.smithi152.stdout:3/311: rename d9/d10/d32/d50 to d9/d10/d12/d43/d52/d58 0 2023-12-06T15:00:25.539 INFO:tasks.workunit.client.1.smithi190.stdout:4/367: mkdir d3/d10/d7a 0 2023-12-06T15:00:25.539 INFO:tasks.workunit.client.1.smithi190.stdout:4/368: chown d3/d35/d19/d41/d44/d5b/f61 5998 1 2023-12-06T15:00:25.539 INFO:tasks.workunit.client.1.smithi190.stdout:4/369: write d3/d4e/f73 [134416,25460] 0 2023-12-06T15:00:25.539 INFO:tasks.workunit.client.1.smithi190.stdout:4/370: write d3/d10/d15/f34 [4468028,126268] 0 2023-12-06T15:00:25.540 INFO:tasks.workunit.client.0.smithi152.stdout:7/176: symlink dd/df/d1b/l36 0 2023-12-06T15:00:25.540 INFO:tasks.workunit.client.0.smithi152.stdout:9/257: dwrite d0/f15 [0,4194304] 0 2023-12-06T15:00:25.540 INFO:tasks.workunit.client.1.smithi190.stdout:0/385: creat d0/da/d3e/d3a/f7f x:0 0 0 2023-12-06T15:00:25.542 INFO:tasks.workunit.client.0.smithi152.stdout:3/312: rename d9/d10/d12/l34 to d9/d18/d39/l59 0 2023-12-06T15:00:25.542 INFO:tasks.workunit.client.0.smithi152.stdout:3/313: readlink d9/d18/l25 0 2023-12-06T15:00:25.542 INFO:tasks.workunit.client.0.smithi152.stdout:3/314: chown d9/d18/d1a/l48 395589 1 2023-12-06T15:00:25.542 INFO:tasks.workunit.client.0.smithi152.stdout:4/439: dwrite d2/d22/f76 [0,4194304] 0 2023-12-06T15:00:25.542 INFO:tasks.workunit.client.0.smithi152.stdout:4/440: stat d2/d15/f62 0 2023-12-06T15:00:25.542 INFO:tasks.workunit.client.0.smithi152.stdout:4/441: truncate d2/d15/f7f 279262 0 2023-12-06T15:00:25.543 INFO:tasks.workunit.client.1.smithi190.stdout:7/491: rename d0/d5/f83 to d0/d5/d63/f96 0 2023-12-06T15:00:25.543 INFO:tasks.workunit.client.1.smithi190.stdout:7/492: truncate d0/df/d1f/f46 984257 0 2023-12-06T15:00:25.543 INFO:tasks.workunit.client.0.smithi152.stdout:9/258: mkdir d0/dd/d20/d38/d48 0 2023-12-06T15:00:25.545 INFO:tasks.workunit.client.1.smithi190.stdout:6/558: getdents d4/d12/d1a/d70/da9 0 2023-12-06T15:00:25.547 INFO:tasks.workunit.client.0.smithi152.stdout:4/442: symlink d2/d15/d23/d42/l88 0 2023-12-06T15:00:25.549 INFO:tasks.workunit.client.0.smithi152.stdout:9/259: mknod d0/dd/d20/d38/d44/c49 0 2023-12-06T15:00:25.550 INFO:tasks.workunit.client.1.smithi190.stdout:4/371: creat d3/d10/f7b x:0 0 0 2023-12-06T15:00:25.550 INFO:tasks.workunit.client.1.smithi190.stdout:0/386: mkdir d0/da/d5a/d80 0 2023-12-06T15:00:25.551 INFO:tasks.workunit.client.1.smithi190.stdout:9/450: rename d4/d27/d2f/d31/d3f/c57 to d4/d27/c9a 0 2023-12-06T15:00:25.551 INFO:tasks.workunit.client.1.smithi190.stdout:9/451: chown d4/d27/d2f/l32 14 1 2023-12-06T15:00:25.551 INFO:tasks.workunit.client.1.smithi190.stdout:9/452: chown d4/d27/f53 7421898 1 2023-12-06T15:00:25.553 INFO:tasks.workunit.client.1.smithi190.stdout:4/372: mkdir d3/d76/d7c 0 2023-12-06T15:00:25.553 INFO:tasks.workunit.client.1.smithi190.stdout:4/373: chown d3/d35/d19/d30/d3c/f45 106371 1 2023-12-06T15:00:25.554 INFO:tasks.workunit.client.1.smithi190.stdout:6/559: dread d4/d12/f2d [0,4194304] 0 2023-12-06T15:00:25.554 INFO:tasks.workunit.client.1.smithi190.stdout:6/560: chown d4/d12/d1a/d59/l6e 1845320 1 2023-12-06T15:00:25.555 INFO:tasks.workunit.client.1.smithi190.stdout:0/387: rename d0/da/d3e/d2b/d3c/d46/d61 to d0/da/d3e/d3a/d40/d81 0 2023-12-06T15:00:25.555 INFO:tasks.workunit.client.1.smithi190.stdout:0/388: stat d0/da/d3e/d2b/d37/c4b 0 2023-12-06T15:00:25.555 INFO:tasks.workunit.client.1.smithi190.stdout:0/389: stat d0/f41 0 2023-12-06T15:00:25.555 INFO:tasks.workunit.client.0.smithi152.stdout:9/260: mkdir d0/dd/d20/d4a 0 2023-12-06T15:00:25.555 INFO:tasks.workunit.client.0.smithi152.stdout:4/443: rename d2/d10/d27/d3f to d2/d89 0 2023-12-06T15:00:25.556 INFO:tasks.workunit.client.1.smithi190.stdout:9/453: creat d4/d27/d2f/d5c/f9b x:0 0 0 2023-12-06T15:00:25.556 INFO:tasks.workunit.client.1.smithi190.stdout:7/493: dread d0/df/d53/f3c [0,4194304] 0 2023-12-06T15:00:25.556 INFO:tasks.workunit.client.1.smithi190.stdout:7/494: write d0/d5/d63/f90 [678794,130496] 0 2023-12-06T15:00:25.557 INFO:tasks.workunit.client.0.smithi152.stdout:4/444: mknod d2/d15/d32/c8a 0 2023-12-06T15:00:25.557 INFO:tasks.workunit.client.0.smithi152.stdout:4/445: readlink d2/d15/d23/d75/l81 0 2023-12-06T15:00:25.558 INFO:tasks.workunit.client.1.smithi190.stdout:6/561: mkdir d4/d12/d40/d43/dba 0 2023-12-06T15:00:25.559 INFO:tasks.workunit.client.0.smithi152.stdout:6/388: dwrite d1/d3c/f5f [0,4194304] 0 2023-12-06T15:00:25.562 INFO:tasks.workunit.client.0.smithi152.stdout:6/389: creat d1/d1c/d79/d1a/d30/d36/d35/d61/f85 x:0 0 0 2023-12-06T15:00:25.564 INFO:tasks.workunit.client.1.smithi190.stdout:0/390: unlink d0/da/d3e/d2b/d3c/f7d 0 2023-12-06T15:00:25.564 INFO:tasks.workunit.client.1.smithi190.stdout:0/391: stat d0/da/d3e/d2b/d3c/d65/f7c 0 2023-12-06T15:00:25.564 INFO:tasks.workunit.client.1.smithi190.stdout:7/495: mknod d0/df/d5f/c97 0 2023-12-06T15:00:25.564 INFO:tasks.workunit.client.1.smithi190.stdout:4/374: dread d3/d35/d19/d41/d44/d5b/f61 [0,4194304] 0 2023-12-06T15:00:25.564 INFO:tasks.workunit.client.1.smithi190.stdout:9/454: truncate d4/d27/d2f/d66/f6e 86687 0 2023-12-06T15:00:25.565 INFO:tasks.workunit.client.0.smithi152.stdout:4/446: write d2/d15/d23/f80 [3243996,55456] 0 2023-12-06T15:00:25.565 INFO:tasks.workunit.client.0.smithi152.stdout:6/390: mkdir d1/d1c/d79/d1a/d30/d36/d35/d63/d86 0 2023-12-06T15:00:25.565 INFO:tasks.workunit.client.0.smithi152.stdout:6/391: read - d1/d1c/d79/f71 zero size 2023-12-06T15:00:25.565 INFO:tasks.workunit.client.0.smithi152.stdout:6/392: readlink l0 0 2023-12-06T15:00:25.568 INFO:tasks.workunit.client.0.smithi152.stdout:9/261: dread d0/dd/f42 [0,4194304] 0 2023-12-06T15:00:25.572 INFO:tasks.workunit.client.1.smithi190.stdout:7/496: rename d0/d88/d32/l66 to d0/df/d53/d2f/l98 0 2023-12-06T15:00:25.572 INFO:tasks.workunit.client.0.smithi152.stdout:7/177: dwrite dd/f2f [0,4194304] 0 2023-12-06T15:00:25.572 INFO:tasks.workunit.client.0.smithi152.stdout:7/178: chown dd/d17 54 1 2023-12-06T15:00:25.572 INFO:tasks.workunit.client.0.smithi152.stdout:7/179: chown f8 562494 1 2023-12-06T15:00:25.584 INFO:tasks.workunit.client.1.smithi190.stdout:2/423: dwrite d10/d26/f29 [0,4194304] 0 2023-12-06T15:00:25.584 INFO:tasks.workunit.client.0.smithi152.stdout:9/262: dread d0/f36 [0,4194304] 0 2023-12-06T15:00:25.584 INFO:tasks.workunit.client.0.smithi152.stdout:9/263: write d0/f8 [2473476,117598] 0 2023-12-06T15:00:25.586 INFO:tasks.workunit.client.0.smithi152.stdout:4/447: dread d2/d22/f4d [0,4194304] 0 2023-12-06T15:00:25.590 INFO:tasks.workunit.client.0.smithi152.stdout:4/448: rename d2/d10/d27/l2d to d2/d15/d32/d79/l8b 0 2023-12-06T15:00:25.591 INFO:tasks.workunit.client.0.smithi152.stdout:3/315: dwrite d9/d10/f28 [0,4194304] 0 2023-12-06T15:00:25.591 INFO:tasks.workunit.client.0.smithi152.stdout:7/180: dread dd/df/d1b/d20/d28/f30 [0,4194304] 0 2023-12-06T15:00:25.593 INFO:tasks.workunit.client.0.smithi152.stdout:3/316: rmdir d9/d45/d55 0 2023-12-06T15:00:25.593 INFO:tasks.workunit.client.0.smithi152.stdout:9/264: dread d0/dd/fe [0,4194304] 0 2023-12-06T15:00:25.593 INFO:tasks.workunit.client.0.smithi152.stdout:7/181: symlink dd/df/d22/d29/l37 0 2023-12-06T15:00:25.594 INFO:tasks.workunit.client.0.smithi152.stdout:4/449: dread d2/d45/f4e [0,4194304] 0 2023-12-06T15:00:25.594 INFO:tasks.workunit.client.0.smithi152.stdout:4/450: write d2/d15/d32/d79/f30 [1846853,85098] 0 2023-12-06T15:00:25.594 INFO:tasks.workunit.client.0.smithi152.stdout:4/451: readlink d2/d15/d32/d79/l8b 0 2023-12-06T15:00:25.594 INFO:tasks.workunit.client.0.smithi152.stdout:4/452: fsync d2/d15/f58 0 2023-12-06T15:00:25.594 INFO:tasks.workunit.client.0.smithi152.stdout:4/453: fsync d2/d15/d23/f41 0 2023-12-06T15:00:25.596 INFO:tasks.workunit.client.0.smithi152.stdout:7/182: unlink dd/l23 0 2023-12-06T15:00:25.596 INFO:tasks.workunit.client.0.smithi152.stdout:9/265: symlink d0/dd/d20/d38/l4b 0 2023-12-06T15:00:25.599 INFO:tasks.workunit.client.0.smithi152.stdout:9/266: mknod d0/dd/d20/d4a/c4c 0 2023-12-06T15:00:25.600 INFO:tasks.workunit.client.0.smithi152.stdout:9/267: write d0/dd/f42 [1320672,69062] 0 2023-12-06T15:00:25.600 INFO:tasks.workunit.client.0.smithi152.stdout:9/268: fsync d0/dd/d20/d38/d45/f3a 0 2023-12-06T15:00:25.600 INFO:tasks.workunit.client.0.smithi152.stdout:9/269: fsync d0/dd/d20/f21 0 2023-12-06T15:00:25.601 INFO:tasks.workunit.client.0.smithi152.stdout:9/270: write d0/dd/fe [772401,125343] 0 2023-12-06T15:00:25.603 INFO:tasks.workunit.client.0.smithi152.stdout:9/271: rmdir d0/dd/d20/d4a 39 2023-12-06T15:00:25.603 INFO:tasks.workunit.client.0.smithi152.stdout:9/272: write d0/dd/d20/d38/d45/f37 [385462,18138] 0 2023-12-06T15:00:25.615 INFO:tasks.workunit.client.1.smithi190.stdout:9/455: dwrite d4/f5b [0,4194304] 0 2023-12-06T15:00:25.625 INFO:tasks.workunit.client.0.smithi152.stdout:6/393: dwrite d1/d1c/d79/d1a/f54 [0,4194304] 0 2023-12-06T15:00:25.626 INFO:tasks.workunit.client.1.smithi190.stdout:2/424: dwrite d10/d26/d5c/d42/f44 [0,4194304] 0 2023-12-06T15:00:25.626 INFO:tasks.workunit.client.1.smithi190.stdout:0/392: dwrite d0/da/d3e/d2b/f4d [0,4194304] 0 2023-12-06T15:00:25.626 INFO:tasks.workunit.client.1.smithi190.stdout:0/393: stat d0/da/d3e/d2b/d3c/d46/f52 0 2023-12-06T15:00:25.626 INFO:tasks.workunit.client.1.smithi190.stdout:0/394: readlink d0/da/d3e/d3a/d40/l17 0 2023-12-06T15:00:25.626 INFO:tasks.workunit.client.1.smithi190.stdout:6/562: dwrite d4/d12/d40/d43/d45/d4a/f7e [0,4194304] 0 2023-12-06T15:00:25.626 INFO:tasks.workunit.client.1.smithi190.stdout:6/563: write d4/d12/d40/d43/d45/f5f [4742483,89042] 0 2023-12-06T15:00:25.626 INFO:tasks.workunit.client.1.smithi190.stdout:6/564: write d4/d12/d1a/d32/f9d [202602,50646] 0 2023-12-06T15:00:25.626 INFO:tasks.workunit.client.1.smithi190.stdout:6/565: fsync d4/d12/d1a/f97 0 2023-12-06T15:00:25.627 INFO:tasks.workunit.client.0.smithi152.stdout:6/394: read d1/d5/f9 [2706760,120908] 0 2023-12-06T15:00:25.628 INFO:tasks.workunit.client.1.smithi190.stdout:2/425: rename d10/d26/d5c/d49/d54/l7d to d10/d26/d5c/d42/l90 0 2023-12-06T15:00:25.628 INFO:tasks.workunit.client.1.smithi190.stdout:2/426: write d10/d26/f27 [1018150,78711] 0 2023-12-06T15:00:25.629 INFO:tasks.workunit.client.0.smithi152.stdout:3/317: dwrite d9/d10/f28 [0,4194304] 0 2023-12-06T15:00:25.630 INFO:tasks.workunit.client.1.smithi190.stdout:0/395: symlink d0/da/d3e/d2b/d37/l82 0 2023-12-06T15:00:25.632 INFO:tasks.workunit.client.0.smithi152.stdout:4/454: dwrite d2/d15/f62 [0,4194304] 0 2023-12-06T15:00:25.633 INFO:tasks.workunit.client.1.smithi190.stdout:9/456: dwrite d4/f11 [0,4194304] 0 2023-12-06T15:00:25.638 INFO:tasks.workunit.client.1.smithi190.stdout:6/566: unlink d4/d12/d40/d43/d45/d4a/d77/f85 0 2023-12-06T15:00:25.638 INFO:tasks.workunit.client.1.smithi190.stdout:2/427: rename d10/d26/l75 to d10/d59/l91 0 2023-12-06T15:00:25.639 INFO:tasks.workunit.client.1.smithi190.stdout:6/567: stat d4/d12/d1a/d8a/f9f 0 2023-12-06T15:00:25.639 INFO:tasks.workunit.client.1.smithi190.stdout:9/457: creat d4/d27/d2f/d31/d3f/d58/d72/d7a/f9c x:0 0 0 2023-12-06T15:00:25.639 INFO:tasks.workunit.client.0.smithi152.stdout:7/183: rename dd/df/d22 to dd/df/d1b/d20/d28/d38 0 2023-12-06T15:00:25.642 INFO:tasks.workunit.client.0.smithi152.stdout:9/273: rmdir d0 39 2023-12-06T15:00:25.642 INFO:tasks.workunit.client.1.smithi190.stdout:2/428: creat d10/d26/d5c/d49/f92 x:0 0 0 2023-12-06T15:00:25.642 INFO:tasks.workunit.client.1.smithi190.stdout:2/429: truncate d10/d26/d5c/d49/d54/f5d 5009266 0 2023-12-06T15:00:25.643 INFO:tasks.workunit.client.1.smithi190.stdout:2/430: truncate d10/f4f 494303 0 2023-12-06T15:00:25.644 INFO:tasks.workunit.client.1.smithi190.stdout:6/568: creat d4/d12/d9a/fbb x:0 0 0 2023-12-06T15:00:25.644 INFO:tasks.workunit.client.1.smithi190.stdout:6/569: stat d4/d12/d1a/d44/fb3 0 2023-12-06T15:00:25.645 INFO:tasks.workunit.client.1.smithi190.stdout:9/458: mkdir d4/d27/d2f/d5c/d9d 0 2023-12-06T15:00:25.645 INFO:tasks.workunit.client.0.smithi152.stdout:9/274: read d0/f5 [541585,58458] 0 2023-12-06T15:00:25.645 INFO:tasks.workunit.client.0.smithi152.stdout:9/275: chown d0/dd/l2e 114246 1 2023-12-06T15:00:25.646 INFO:tasks.workunit.client.0.smithi152.stdout:9/276: chown d0/dd/d20/f26 3 1 2023-12-06T15:00:25.646 INFO:tasks.workunit.client.0.smithi152.stdout:9/277: getdents d0/d3f 0 2023-12-06T15:00:25.646 INFO:tasks.workunit.client.0.smithi152.stdout:9/278: chown d0/f30 0 1 2023-12-06T15:00:25.646 INFO:tasks.workunit.client.0.smithi152.stdout:4/455: getdents d2/d10/d27 0 2023-12-06T15:00:25.646 INFO:tasks.workunit.client.1.smithi190.stdout:8/426: sync 2023-12-06T15:00:25.646 INFO:tasks.workunit.client.1.smithi190.stdout:5/373: sync 2023-12-06T15:00:25.647 INFO:tasks.workunit.client.1.smithi190.stdout:1/687: sync 2023-12-06T15:00:25.647 INFO:tasks.workunit.client.1.smithi190.stdout:8/427: readlink d1/d10/d1c/l49 0 2023-12-06T15:00:25.647 INFO:tasks.workunit.client.1.smithi190.stdout:8/428: readlink d1/d10/d1c/l33 0 2023-12-06T15:00:25.647 INFO:tasks.workunit.client.1.smithi190.stdout:8/429: truncate d1/d20/f42 1045250 0 2023-12-06T15:00:25.649 INFO:tasks.workunit.client.0.smithi152.stdout:6/395: rename d1/d5 to d1/d3c/d87 0 2023-12-06T15:00:25.649 INFO:tasks.workunit.client.1.smithi190.stdout:2/431: link d10/d26/d5c/d42/f6c d10/d59/f93 0 2023-12-06T15:00:25.649 INFO:tasks.workunit.client.1.smithi190.stdout:5/374: creat d0/d1c/d3e/f76 x:0 0 0 2023-12-06T15:00:25.651 INFO:tasks.workunit.client.0.smithi152.stdout:9/279: mkdir d0/dd/d20/d4a/d4d 0 2023-12-06T15:00:25.651 INFO:tasks.workunit.client.0.smithi152.stdout:9/280: readlink d0/l11 0 2023-12-06T15:00:25.651 INFO:tasks.workunit.client.0.smithi152.stdout:4/456: rmdir d2/d15/d32/d69/d6f 39 2023-12-06T15:00:25.652 INFO:tasks.workunit.client.1.smithi190.stdout:2/432: creat d10/d26/d5c/f94 x:0 0 0 2023-12-06T15:00:25.652 INFO:tasks.workunit.client.1.smithi190.stdout:5/375: read d0/f18 [731711,58662] 0 2023-12-06T15:00:25.653 INFO:tasks.workunit.client.0.smithi152.stdout:4/457: creat d2/f8c x:0 0 0 2023-12-06T15:00:25.653 INFO:tasks.workunit.client.0.smithi152.stdout:4/458: read - d2/d15/d32/d54/d85/f86 zero size 2023-12-06T15:00:25.653 INFO:tasks.workunit.client.1.smithi190.stdout:2/433: symlink d10/d26/d5c/d8d/l95 0 2023-12-06T15:00:25.656 INFO:tasks.workunit.client.0.smithi152.stdout:9/281: creat d0/dd/d20/d38/d44/f4e x:0 0 0 2023-12-06T15:00:25.656 INFO:tasks.workunit.client.0.smithi152.stdout:9/282: dread - d0/dd/d20/d38/d44/f4e zero size 2023-12-06T15:00:25.656 INFO:tasks.workunit.client.0.smithi152.stdout:9/283: read d0/dd/f42 [2374304,28358] 0 2023-12-06T15:00:25.657 INFO:tasks.workunit.client.1.smithi190.stdout:2/434: dread d10/f1f [0,4194304] 0 2023-12-06T15:00:25.659 INFO:tasks.workunit.client.0.smithi152.stdout:6/396: dread d1/d1c/d79/d1a/d30/fe [12582912,4194304] 0 2023-12-06T15:00:25.665 INFO:tasks.workunit.client.1.smithi190.stdout:9/459: dread d4/d27/d2f/d31/d3f/d58/f59 [0,4194304] 0 2023-12-06T15:00:25.665 INFO:tasks.workunit.client.1.smithi190.stdout:9/460: chown d4/d27/d2f/c98 14027 1 2023-12-06T15:00:25.668 INFO:tasks.workunit.client.0.smithi152.stdout:6/397: creat d1/d1c/d79/d4b/f88 x:0 0 0 2023-12-06T15:00:25.672 INFO:tasks.workunit.client.1.smithi190.stdout:8/430: dread d1/d20/d3b/f18 [0,4194304] 0 2023-12-06T15:00:25.672 INFO:tasks.workunit.client.1.smithi190.stdout:8/431: readlink d1/d37/l62 0 2023-12-06T15:00:25.677 INFO:tasks.workunit.client.1.smithi190.stdout:0/396: dwrite d0/f11 [0,4194304] 0 2023-12-06T15:00:25.677 INFO:tasks.workunit.client.1.smithi190.stdout:9/461: write d4/f2e [2567952,52006] 0 2023-12-06T15:00:25.677 INFO:tasks.workunit.client.1.smithi190.stdout:9/462: fsync d4/d27/d8a/f92 0 2023-12-06T15:00:25.677 INFO:tasks.workunit.client.1.smithi190.stdout:9/463: chown d4/d27/d2f/d31/d3f/l62 869 1 2023-12-06T15:00:25.680 INFO:tasks.workunit.client.1.smithi190.stdout:9/464: unlink d4/d27/d2f/d66/f83 0 2023-12-06T15:00:25.683 INFO:tasks.workunit.client.1.smithi190.stdout:9/465: creat d4/f9e x:0 0 0 2023-12-06T15:00:25.683 INFO:tasks.workunit.client.1.smithi190.stdout:9/466: chown d4/d27/f53 303948892 1 2023-12-06T15:00:25.683 INFO:tasks.workunit.client.1.smithi190.stdout:9/467: write d4/d27/f6a [251050,9400] 0 2023-12-06T15:00:25.683 INFO:tasks.workunit.client.1.smithi190.stdout:9/468: chown d4/d27 4 1 2023-12-06T15:00:25.686 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:25 smithi152 ceph-mon[111954]: pgmap v24: 65 pgs: 65 active+clean; 1.3 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 86 MiB/s rd, 168 MiB/s wr, 309 op/s 2023-12-06T15:00:25.694 INFO:tasks.workunit.client.1.smithi190.stdout:0/397: dread d0/f41 [0,4194304] 0 2023-12-06T15:00:25.694 INFO:tasks.workunit.client.1.smithi190.stdout:0/398: stat d0/da/l13 0 2023-12-06T15:00:25.695 INFO:tasks.workunit.client.1.smithi190.stdout:0/399: link d0/da/d3e/d2b/c6e d0/da/d3e/d3a/d40/d81/c83 0 2023-12-06T15:00:25.698 INFO:tasks.workunit.client.0.smithi152.stdout:9/284: fsync d0/dd/f25 0 2023-12-06T15:00:25.698 INFO:tasks.workunit.client.0.smithi152.stdout:3/318: dwrite d9/d10/d32/f3d [0,4194304] 0 2023-12-06T15:00:25.700 INFO:tasks.workunit.client.1.smithi190.stdout:6/570: dwrite d4/d12/d1a/d44/f8f [0,4194304] 0 2023-12-06T15:00:25.700 INFO:tasks.workunit.client.1.smithi190.stdout:6/571: read d4/fe [1551573,6781] 0 2023-12-06T15:00:25.702 INFO:tasks.workunit.client.1.smithi190.stdout:1/688: dwrite d6/dc/d29/fcd [0,4194304] 0 2023-12-06T15:00:25.703 INFO:tasks.workunit.client.1.smithi190.stdout:1/689: fsync d6/dc/d29/d38/d73/d5c/f70 0 2023-12-06T15:00:25.703 INFO:tasks.workunit.client.1.smithi190.stdout:1/690: chown d6/dc/d29/d38/d73/d5c/db5/lba 371580 1 2023-12-06T15:00:25.703 INFO:tasks.workunit.client.1.smithi190.stdout:2/435: dwrite d10/d59/f70 [0,4194304] 0 2023-12-06T15:00:25.703 INFO:tasks.workunit.client.1.smithi190.stdout:1/691: write d6/dc/d29/d38/d39/d63/fd3 [706988,59552] 0 2023-12-06T15:00:25.705 INFO:tasks.workunit.client.1.smithi190.stdout:2/436: creat d10/d26/d5c/f96 x:0 0 0 2023-12-06T15:00:25.707 INFO:tasks.workunit.client.0.smithi152.stdout:4/459: dwrite d2/d10/d27/f71 [0,4194304] 0 2023-12-06T15:00:25.707 INFO:tasks.workunit.client.0.smithi152.stdout:7/184: dwrite dd/df/f2c [0,4194304] 0 2023-12-06T15:00:25.707 INFO:tasks.workunit.client.0.smithi152.stdout:3/319: dread d9/d10/d19/f33 [0,4194304] 0 2023-12-06T15:00:25.707 INFO:tasks.workunit.client.1.smithi190.stdout:2/437: rename d10/d26/d5b/c66 to d10/d26/d5c/d49/d54/c97 0 2023-12-06T15:00:25.708 INFO:tasks.workunit.client.1.smithi190.stdout:6/572: mknod d4/d12/d1a/cbc 0 2023-12-06T15:00:25.708 INFO:tasks.workunit.client.1.smithi190.stdout:6/573: write d4/d12/d9a/fbb [101079,130242] 0 2023-12-06T15:00:25.709 INFO:tasks.workunit.client.1.smithi190.stdout:8/432: dwrite d1/d20/d3b/d34/d39/f72 [0,4194304] 0 2023-12-06T15:00:25.709 INFO:tasks.workunit.client.1.smithi190.stdout:2/438: mkdir d10/d26/d5c/d35/d77/d98 0 2023-12-06T15:00:25.709 INFO:tasks.workunit.client.1.smithi190.stdout:2/439: fdatasync d10/d59/d5e/f16 0 2023-12-06T15:00:25.709 INFO:tasks.workunit.client.1.smithi190.stdout:2/440: fsync d10/d26/d5c/d49/f6f 0 2023-12-06T15:00:25.711 INFO:tasks.workunit.client.0.smithi152.stdout:3/320: link d9/c15 d9/d18/d39/c5a 0 2023-12-06T15:00:25.711 INFO:tasks.workunit.client.1.smithi190.stdout:8/433: write d1/d20/d3b/d36/f48 [1575337,39543] 0 2023-12-06T15:00:25.712 INFO:tasks.workunit.client.0.smithi152.stdout:6/398: dwrite d1/d75/f81 [0,4194304] 0 2023-12-06T15:00:25.712 INFO:tasks.workunit.client.1.smithi190.stdout:2/441: symlink d10/d26/d5c/d49/d54/l99 0 2023-12-06T15:00:25.714 INFO:tasks.workunit.client.1.smithi190.stdout:0/400: dwrite d0/da/d3e/d2b/d37/f76 [0,4194304] 0 2023-12-06T15:00:25.714 INFO:tasks.workunit.client.1.smithi190.stdout:0/401: stat d0/da/d3e/c1f 0 2023-12-06T15:00:25.715 INFO:tasks.workunit.client.1.smithi190.stdout:2/442: truncate d10/d26/d5c/f5a 4596877 0 2023-12-06T15:00:25.715 INFO:tasks.workunit.client.1.smithi190.stdout:2/443: stat d10/d26/d5c/f94 0 2023-12-06T15:00:25.715 INFO:tasks.workunit.client.1.smithi190.stdout:2/444: write d10/d59/f93 [799331,126461] 0 2023-12-06T15:00:25.715 INFO:tasks.workunit.client.0.smithi152.stdout:4/460: mknod d2/d22/d6e/c8d 0 2023-12-06T15:00:25.715 INFO:tasks.workunit.client.0.smithi152.stdout:7/185: creat dd/df/d1b/d20/d28/d38/f39 x:0 0 0 2023-12-06T15:00:25.715 INFO:tasks.workunit.client.0.smithi152.stdout:4/461: fdatasync d2/d10/f37 0 2023-12-06T15:00:25.715 INFO:tasks.workunit.client.0.smithi152.stdout:6/399: mkdir d1/d89 0 2023-12-06T15:00:25.715 INFO:tasks.workunit.client.0.smithi152.stdout:4/462: chown d2/d15/d32/c65 6067 1 2023-12-06T15:00:25.717 INFO:tasks.workunit.client.0.smithi152.stdout:7/186: truncate dd/f2f 2764983 0 2023-12-06T15:00:25.719 INFO:tasks.workunit.client.1.smithi190.stdout:0/402: symlink d0/da/d5a/l84 0 2023-12-06T15:00:25.721 INFO:tasks.workunit.client.0.smithi152.stdout:6/400: mkdir d1/d1c/d79/d8a 0 2023-12-06T15:00:25.721 INFO:tasks.workunit.client.0.smithi152.stdout:4/463: symlink d2/d15/d23/d42/l8e 0 2023-12-06T15:00:25.721 INFO:tasks.workunit.client.0.smithi152.stdout:7/187: mkdir dd/df/d34/d3a 0 2023-12-06T15:00:25.722 INFO:tasks.workunit.client.0.smithi152.stdout:6/401: stat d1/d1c/d79/d4b/l82 0 2023-12-06T15:00:25.723 INFO:tasks.workunit.client.1.smithi190.stdout:0/403: symlink d0/da/d3e/d2b/l85 0 2023-12-06T15:00:25.723 INFO:tasks.workunit.client.1.smithi190.stdout:0/404: dread - d0/da/f5c zero size 2023-12-06T15:00:25.729 INFO:tasks.workunit.client.0.smithi152.stdout:4/464: unlink d2/d15/d32/d79/f30 0 2023-12-06T15:00:25.729 INFO:tasks.workunit.client.0.smithi152.stdout:4/465: truncate d2/d22/f78 559392 0 2023-12-06T15:00:25.729 INFO:tasks.workunit.client.0.smithi152.stdout:6/402: mknod d1/d1c/d79/d1a/d30/d36/d26/c8b 0 2023-12-06T15:00:25.730 INFO:tasks.workunit.client.1.smithi190.stdout:0/405: write d0/f50 [1194188,100055] 0 2023-12-06T15:00:25.731 INFO:tasks.workunit.client.1.smithi190.stdout:1/692: dwrite d6/dc/d29/d38/d73/f4e [0,4194304] 0 2023-12-06T15:00:25.735 INFO:tasks.workunit.client.1.smithi190.stdout:0/406: rename d0/da/d3e/d3a/d40/f7b to d0/f86 0 2023-12-06T15:00:25.736 INFO:tasks.workunit.client.0.smithi152.stdout:6/403: dread d1/d1c/d79/d1a/d30/d36/d35/d63/f6c [0,4194304] 0 2023-12-06T15:00:25.738 INFO:tasks.workunit.client.0.smithi152.stdout:6/404: getdents d1/d1c/d79/d1a/d30/d36/d35/d63 0 2023-12-06T15:00:25.740 INFO:tasks.workunit.client.0.smithi152.stdout:6/405: mknod d1/d89/c8c 0 2023-12-06T15:00:25.741 INFO:tasks.workunit.client.1.smithi190.stdout:1/693: write d6/dc/d3b/d78/d94/f54 [1841463,57740] 0 2023-12-06T15:00:25.741 INFO:tasks.workunit.client.1.smithi190.stdout:1/694: truncate d6/dc/d29/d38/d73/fd7 1048016 0 2023-12-06T15:00:25.741 INFO:tasks.workunit.client.0.smithi152.stdout:7/188: dread dd/f15 [0,4194304] 0 2023-12-06T15:00:25.741 INFO:tasks.workunit.client.1.smithi190.stdout:1/695: write d6/dc/d29/d38/d73/d5c/fa3 [231734,28128] 0 2023-12-06T15:00:25.743 INFO:tasks.workunit.client.0.smithi152.stdout:7/189: creat dd/df/f3b x:0 0 0 2023-12-06T15:00:25.744 INFO:tasks.workunit.client.0.smithi152.stdout:7/190: readlink dd/df/d1b/l36 0 2023-12-06T15:00:25.744 INFO:tasks.workunit.client.0.smithi152.stdout:7/191: dread - dd/df/d1b/d20/d28/d38/f39 zero size 2023-12-06T15:00:25.744 INFO:tasks.workunit.client.1.smithi190.stdout:1/696: mknod d6/dc/d3b/d78/d94/cdf 0 2023-12-06T15:00:25.745 INFO:tasks.workunit.client.1.smithi190.stdout:1/697: creat d6/d49/fe0 x:0 0 0 2023-12-06T15:00:25.745 INFO:tasks.workunit.client.1.smithi190.stdout:6/574: dwrite d4/d12/d1a/f97 [4194304,4194304] 0 2023-12-06T15:00:25.747 INFO:tasks.workunit.client.0.smithi152.stdout:7/192: dread dd/f13 [0,4194304] 0 2023-12-06T15:00:25.749 INFO:tasks.workunit.client.0.smithi152.stdout:7/193: symlink dd/df/l3c 0 2023-12-06T15:00:25.749 INFO:tasks.workunit.client.0.smithi152.stdout:7/194: readlink dd/d17/l26 0 2023-12-06T15:00:25.749 INFO:tasks.workunit.client.1.smithi190.stdout:6/575: creat d4/d12/d1a/d44/fbd x:0 0 0 2023-12-06T15:00:25.749 INFO:tasks.workunit.client.1.smithi190.stdout:6/576: fdatasync d4/d12/d1a/d44/f47 0 2023-12-06T15:00:25.750 INFO:tasks.workunit.client.1.smithi190.stdout:6/577: dread d4/d12/d1a/f28 [0,4194304] 0 2023-12-06T15:00:25.751 INFO:tasks.workunit.client.0.smithi152.stdout:7/195: creat dd/df/d1b/d20/d28/d38/d29/f3d x:0 0 0 2023-12-06T15:00:25.751 INFO:tasks.workunit.client.0.smithi152.stdout:7/196: chown dd/f11 17 1 2023-12-06T15:00:25.751 INFO:tasks.workunit.client.1.smithi190.stdout:6/578: mknod d4/d12/d9a/cbe 0 2023-12-06T15:00:25.752 INFO:tasks.workunit.client.0.smithi152.stdout:7/197: creat dd/df/d1b/d20/d28/f3e x:0 0 0 2023-12-06T15:00:25.752 INFO:tasks.workunit.client.0.smithi152.stdout:7/198: fdatasync dd/df/d1b/d20/d28/f30 0 2023-12-06T15:00:25.753 INFO:tasks.workunit.client.0.smithi152.stdout:7/199: rename dd/f15 to dd/df/d34/d3a/f3f 0 2023-12-06T15:00:25.754 INFO:tasks.workunit.client.0.smithi152.stdout:7/200: mknod dd/df/c40 0 2023-12-06T15:00:25.756 INFO:tasks.workunit.client.1.smithi190.stdout:6/579: read d4/d12/d1a/d8a/fb2 [4016897,88789] 0 2023-12-06T15:00:25.756 INFO:tasks.workunit.client.1.smithi190.stdout:6/580: chown d4/d15/f98 30032 1 2023-12-06T15:00:25.761 INFO:tasks.workunit.client.1.smithi190.stdout:6/581: dread d4/fe [0,4194304] 0 2023-12-06T15:00:25.761 INFO:tasks.workunit.client.1.smithi190.stdout:9/469: dwrite d4/d27/f6a [0,4194304] 0 2023-12-06T15:00:25.763 INFO:tasks.workunit.client.1.smithi190.stdout:6/582: dread d4/fe [0,4194304] 0 2023-12-06T15:00:25.763 INFO:tasks.workunit.client.1.smithi190.stdout:8/434: dwrite d1/d20/d3b/f18 [0,4194304] 0 2023-12-06T15:00:25.764 INFO:tasks.workunit.client.1.smithi190.stdout:2/445: dwrite d10/f4f [0,4194304] 0 2023-12-06T15:00:25.764 INFO:tasks.workunit.client.1.smithi190.stdout:2/446: chown d10/d59/d5e/f2b 6 1 2023-12-06T15:00:25.764 INFO:tasks.workunit.client.1.smithi190.stdout:9/470: creat d4/d27/d2f/d31/d3f/d58/d7d/f9f x:0 0 0 2023-12-06T15:00:25.764 INFO:tasks.workunit.client.0.smithi152.stdout:4/466: dwrite f1 [0,4194304] 0 2023-12-06T15:00:25.765 INFO:tasks.workunit.client.1.smithi190.stdout:6/583: stat d4/d12/d1a/l2c 0 2023-12-06T15:00:25.765 INFO:tasks.workunit.client.1.smithi190.stdout:6/584: chown d4/d12/d1a/d32/c68 10 1 2023-12-06T15:00:25.765 INFO:tasks.workunit.client.1.smithi190.stdout:6/585: chown d4/d12/d1a/d59/l6a 1 1 2023-12-06T15:00:25.766 INFO:tasks.workunit.client.0.smithi152.stdout:4/467: mknod d2/d15/c8f 0 2023-12-06T15:00:25.766 INFO:tasks.workunit.client.0.smithi152.stdout:4/468: fdatasync d2/d10/d27/f48 0 2023-12-06T15:00:25.767 INFO:tasks.workunit.client.1.smithi190.stdout:8/435: symlink d1/d20/d3b/l82 0 2023-12-06T15:00:25.767 INFO:tasks.workunit.client.0.smithi152.stdout:4/469: getdents d2/d45 0 2023-12-06T15:00:25.768 INFO:tasks.workunit.client.1.smithi190.stdout:9/471: write d4/d27/d2f/d31/d3f/f69 [3742811,41498] 0 2023-12-06T15:00:25.769 INFO:tasks.workunit.client.0.smithi152.stdout:4/470: link d2/d15/l47 d2/d22/l90 0 2023-12-06T15:00:25.769 INFO:tasks.workunit.client.0.smithi152.stdout:4/471: chown d2/c21 4556 1 2023-12-06T15:00:25.770 INFO:tasks.workunit.client.0.smithi152.stdout:4/472: rmdir d2/d10/d52 39 2023-12-06T15:00:25.771 INFO:tasks.workunit.client.0.smithi152.stdout:4/473: write d2/d22/f4a [2677834,104062] 0 2023-12-06T15:00:25.771 INFO:tasks.workunit.client.0.smithi152.stdout:4/474: stat d2/d15/l5f 0 2023-12-06T15:00:25.771 INFO:tasks.workunit.client.1.smithi190.stdout:2/447: creat d10/d26/d5c/d37/f9a x:0 0 0 2023-12-06T15:00:25.772 INFO:tasks.workunit.client.1.smithi190.stdout:6/586: mknod d4/d12/d40/d43/cbf 0 2023-12-06T15:00:25.772 INFO:tasks.workunit.client.1.smithi190.stdout:6/587: write d4/d12/d1a/d59/f65 [446809,13095] 0 2023-12-06T15:00:25.772 INFO:tasks.workunit.client.1.smithi190.stdout:8/436: creat d1/d20/d3b/d36/d50/f83 x:0 0 0 2023-12-06T15:00:25.772 INFO:tasks.workunit.client.1.smithi190.stdout:2/448: write d10/d26/d5c/d37/f3d [8133600,74505] 0 2023-12-06T15:00:25.774 INFO:tasks.workunit.client.1.smithi190.stdout:8/437: rmdir d1/d20/d3b/d4c 39 2023-12-06T15:00:25.775 INFO:tasks.workunit.client.1.smithi190.stdout:2/449: mknod d10/d26/d5c/d49/c9b 0 2023-12-06T15:00:25.775 INFO:tasks.workunit.client.1.smithi190.stdout:2/450: readlink d10/d26/d5c/d35/l5f 0 2023-12-06T15:00:25.775 INFO:tasks.workunit.client.1.smithi190.stdout:8/438: mknod d1/d20/c84 0 2023-12-06T15:00:25.776 INFO:tasks.workunit.client.1.smithi190.stdout:2/451: creat d10/d26/d5c/d49/f9c x:0 0 0 2023-12-06T15:00:25.781 INFO:tasks.workunit.client.1.smithi190.stdout:8/439: link d1/d20/d3b/f18 d1/d37/f85 0 2023-12-06T15:00:25.786 INFO:tasks.workunit.client.1.smithi190.stdout:0/407: dwrite d0/da/d3e/d2b/d37/f76 [0,4194304] 0 2023-12-06T15:00:25.786 INFO:tasks.workunit.client.1.smithi190.stdout:0/408: dread - d0/da/f5c zero size 2023-12-06T15:00:25.787 INFO:tasks.workunit.client.1.smithi190.stdout:0/409: write d0/f41 [4709436,56588] 0 2023-12-06T15:00:25.787 INFO:tasks.workunit.client.0.smithi152.stdout:6/406: dwrite d1/d1c/d79/d1a/d30/f34 [0,4194304] 0 2023-12-06T15:00:25.792 INFO:tasks.workunit.client.1.smithi190.stdout:0/410: mkdir d0/da/d3e/d87 0 2023-12-06T15:00:25.792 INFO:tasks.workunit.client.1.smithi190.stdout:9/472: dread d4/d27/d2f/d31/f38 [4194304,4194304] 0 2023-12-06T15:00:25.792 INFO:tasks.workunit.client.1.smithi190.stdout:9/473: dread - d4/d27/d2f/d31/d3f/d58/d72/f76 zero size 2023-12-06T15:00:25.792 INFO:tasks.workunit.client.1.smithi190.stdout:8/440: dread d1/d20/d3b/f18 [0,4194304] 0 2023-12-06T15:00:25.794 INFO:tasks.workunit.client.1.smithi190.stdout:0/411: unlink d0/da/d3e/d3a/d40/d81/c83 0 2023-12-06T15:00:25.794 INFO:tasks.workunit.client.1.smithi190.stdout:0/412: getdents d0/da/d3e/d3a/d40/d6f 0 2023-12-06T15:00:25.795 INFO:tasks.workunit.client.1.smithi190.stdout:9/474: write d4/f13 [3257402,118608] 0 2023-12-06T15:00:25.796 INFO:tasks.workunit.client.1.smithi190.stdout:8/441: symlink d1/d20/d3b/d36/l86 0 2023-12-06T15:00:25.796 INFO:tasks.workunit.client.1.smithi190.stdout:8/442: dread - d1/d20/d3b/d36/d50/f83 zero size 2023-12-06T15:00:25.796 INFO:tasks.workunit.client.0.smithi152.stdout:6/407: symlink d1/d1c/d79/l8d 0 2023-12-06T15:00:25.797 INFO:tasks.workunit.client.1.smithi190.stdout:0/413: symlink d0/da/d3e/d2b/d37/l88 0 2023-12-06T15:00:25.797 INFO:tasks.workunit.client.1.smithi190.stdout:0/414: write d0/da/d3e/d2b/d3c/d65/f72 [928144,96132] 0 2023-12-06T15:00:25.797 INFO:tasks.workunit.client.1.smithi190.stdout:0/415: chown d0/da/lc 456060884 1 2023-12-06T15:00:25.797 INFO:tasks.workunit.client.1.smithi190.stdout:0/416: fdatasync d0/da/d3e/d2b/d3c/d65/f70 0 2023-12-06T15:00:25.798 INFO:tasks.workunit.client.0.smithi152.stdout:6/408: creat d1/d3c/d87/d15/f8e x:0 0 0 2023-12-06T15:00:25.798 INFO:tasks.workunit.client.1.smithi190.stdout:9/475: symlink d4/d27/d2f/la0 0 2023-12-06T15:00:25.800 INFO:tasks.workunit.client.0.smithi152.stdout:4/475: dwrite d2/d45/f6b [0,4194304] 0 2023-12-06T15:00:25.800 INFO:tasks.workunit.client.0.smithi152.stdout:4/476: stat d2/f7c 0 2023-12-06T15:00:25.800 INFO:tasks.workunit.client.0.smithi152.stdout:6/409: creat d1/d3c/d87/f8f x:0 0 0 2023-12-06T15:00:25.800 INFO:tasks.workunit.client.0.smithi152.stdout:7/201: dwrite dd/df/d1b/d20/d28/d38/d29/f2a [0,4194304] 0 2023-12-06T15:00:25.800 INFO:tasks.workunit.client.0.smithi152.stdout:7/202: fsync dd/df/d1b/d20/d28/d38/d29/f2a 0 2023-12-06T15:00:25.801 INFO:tasks.workunit.client.1.smithi190.stdout:0/417: creat d0/da/d3e/d3a/d40/d81/f89 x:0 0 0 2023-12-06T15:00:25.803 INFO:tasks.workunit.client.0.smithi152.stdout:4/477: mkdir d2/d15/d32/d91 0 2023-12-06T15:00:25.803 INFO:tasks.workunit.client.1.smithi190.stdout:0/418: truncate d0/da/d3e/d2b/d3c/f60 1533665 0 2023-12-06T15:00:25.803 INFO:tasks.workunit.client.1.smithi190.stdout:0/419: write d0/f2e [4402920,126777] 0 2023-12-06T15:00:25.804 INFO:tasks.workunit.client.1.smithi190.stdout:9/476: symlink d4/d27/d2f/d31/la1 0 2023-12-06T15:00:25.808 INFO:tasks.workunit.client.0.smithi152.stdout:7/203: creat dd/df/d1b/f41 x:0 0 0 2023-12-06T15:00:25.808 INFO:tasks.workunit.client.0.smithi152.stdout:4/478: unlink d2/d15/d23/f80 0 2023-12-06T15:00:25.808 INFO:tasks.workunit.client.0.smithi152.stdout:6/410: mknod d1/d3c/c90 0 2023-12-06T15:00:25.808 INFO:tasks.workunit.client.0.smithi152.stdout:4/479: readlink d2/d15/d32/d79/l3d 0 2023-12-06T15:00:25.808 INFO:tasks.workunit.client.1.smithi190.stdout:0/420: creat d0/da/d3e/d3a/d40/d6f/f8a x:0 0 0 2023-12-06T15:00:25.809 INFO:tasks.workunit.client.1.smithi190.stdout:6/588: dwrite d4/d12/d9a/fbb [0,4194304] 0 2023-12-06T15:00:25.809 INFO:tasks.workunit.client.0.smithi152.stdout:7/204: rmdir dd/df/d1b/d20/d28/d38/d29 39 2023-12-06T15:00:25.811 INFO:tasks.workunit.client.1.smithi190.stdout:0/421: rename d0/da/d3e/d2b/f4d to d0/da/d3e/d2b/d3c/d4c/f8b 0 2023-12-06T15:00:25.811 INFO:tasks.workunit.client.1.smithi190.stdout:0/422: write d0/f86 [160581,127435] 0 2023-12-06T15:00:25.811 INFO:tasks.workunit.client.1.smithi190.stdout:0/423: write d0/da/d3e/d3a/d40/d6f/f8a [695908,29797] 0 2023-12-06T15:00:25.811 INFO:tasks.workunit.client.1.smithi190.stdout:8/443: dwrite d1/d37/f45 [4194304,4194304] 0 2023-12-06T15:00:25.811 INFO:tasks.workunit.client.1.smithi190.stdout:0/424: read d0/da/d3e/d3a/d40/d6f/f8a [604887,4970] 0 2023-12-06T15:00:25.812 INFO:tasks.workunit.client.0.smithi152.stdout:4/480: truncate d2/f8 3731594 0 2023-12-06T15:00:25.812 INFO:tasks.workunit.client.0.smithi152.stdout:4/481: read - d2/d15/d32/d79/f82 zero size 2023-12-06T15:00:25.814 INFO:tasks.workunit.client.0.smithi152.stdout:1/489: sync 2023-12-06T15:00:25.814 INFO:tasks.workunit.client.0.smithi152.stdout:0/236: sync 2023-12-06T15:00:25.815 INFO:tasks.workunit.client.0.smithi152.stdout:7/205: truncate dd/df/d34/d3a/f3f 154628 0 2023-12-06T15:00:25.815 INFO:tasks.workunit.client.0.smithi152.stdout:7/206: write dd/df/d1b/f41 [160388,110297] 0 2023-12-06T15:00:25.815 INFO:tasks.workunit.client.0.smithi152.stdout:7/207: chown dd/c10 711267 1 2023-12-06T15:00:25.817 INFO:tasks.workunit.client.1.smithi190.stdout:6/589: creat d4/d12/d1a/db4/fc0 x:0 0 0 2023-12-06T15:00:25.818 INFO:tasks.workunit.client.1.smithi190.stdout:6/590: fsync d4/fd 0 2023-12-06T15:00:25.818 INFO:tasks.workunit.client.0.smithi152.stdout:1/490: mknod d3/d44/d84/cb9 0 2023-12-06T15:00:25.818 INFO:tasks.workunit.client.0.smithi152.stdout:1/491: chown d3/da/d15/d17/d43/f9e 27172 1 2023-12-06T15:00:25.826 INFO:tasks.workunit.client.1.smithi190.stdout:8/444: truncate d1/d20/d3b/d31/f57 2252784 0 2023-12-06T15:00:25.826 INFO:tasks.workunit.client.1.smithi190.stdout:0/425: unlink d0/da/d3e/d2b/d37/c4b 0 2023-12-06T15:00:25.826 INFO:tasks.workunit.client.1.smithi190.stdout:0/426: readlink d0/da/d3e/d2b/d37/l88 0 2023-12-06T15:00:25.826 INFO:tasks.workunit.client.1.smithi190.stdout:0/427: chown d0/da/d3e/d2b/d3c/f71 19099 1 2023-12-06T15:00:25.826 INFO:tasks.workunit.client.1.smithi190.stdout:3/580: sync 2023-12-06T15:00:25.826 INFO:tasks.workunit.client.1.smithi190.stdout:3/581: dread - d4/d70/d19/d51/fcc zero size 2023-12-06T15:00:25.830 INFO:tasks.workunit.client.1.smithi190.stdout:6/591: mknod d4/d12/d1a/d8a/cc1 0 2023-12-06T15:00:25.831 INFO:tasks.workunit.client.0.smithi152.stdout:7/208: dread dd/df/d34/d3a/f3f [0,4194304] 0 2023-12-06T15:00:25.832 INFO:tasks.workunit.client.1.smithi190.stdout:8/445: unlink d1/d20/d3b/d31/l52 0 2023-12-06T15:00:25.832 INFO:tasks.workunit.client.1.smithi190.stdout:6/592: read d4/d12/d40/f9e [3821801,20798] 0 2023-12-06T15:00:25.833 INFO:tasks.workunit.client.1.smithi190.stdout:0/428: write d0/da/d3e/d3a/d40/f48 [3772018,17814] 0 2023-12-06T15:00:25.834 INFO:tasks.workunit.client.1.smithi190.stdout:8/446: mkdir d1/d20/d3b/d31/d87 0 2023-12-06T15:00:25.835 INFO:tasks.workunit.client.1.smithi190.stdout:8/447: dread d1/d20/d3b/f30 [0,4194304] 0 2023-12-06T15:00:25.835 INFO:tasks.workunit.client.1.smithi190.stdout:8/448: stat d1/d10/d25/c2f 0 2023-12-06T15:00:25.836 INFO:tasks.workunit.client.1.smithi190.stdout:6/593: symlink d4/d12/d40/d43/dba/lc2 0 2023-12-06T15:00:25.836 INFO:tasks.workunit.client.1.smithi190.stdout:6/594: stat d4/d12/d40/d43/d45/d4a/f7e 0 2023-12-06T15:00:25.840 INFO:tasks.workunit.client.0.smithi152.stdout:6/411: dwrite d1/d1c/d79/d1a/d30/d36/f64 [0,4194304] 0 2023-12-06T15:00:25.842 INFO:tasks.workunit.client.1.smithi190.stdout:0/429: write d0/da/d3e/d3a/d40/f26 [2495301,38730] 0 2023-12-06T15:00:25.844 INFO:tasks.workunit.client.1.smithi190.stdout:6/595: write d4/d15/f26 [3069420,5590] 0 2023-12-06T15:00:25.844 INFO:tasks.workunit.client.1.smithi190.stdout:6/596: chown d4/d12/d1a/d59/c5e 28640582 1 2023-12-06T15:00:25.848 INFO:tasks.workunit.client.1.smithi190.stdout:6/597: rmdir d4/d12/d1a/d8a/da3 39 2023-12-06T15:00:25.851 INFO:tasks.workunit.client.0.smithi152.stdout:4/482: dwrite d2/d10/d27/f43 [0,4194304] 0 2023-12-06T15:00:25.851 INFO:tasks.workunit.client.1.smithi190.stdout:6/598: dread d4/d12/d1a/d32/f9d [0,4194304] 0 2023-12-06T15:00:25.851 INFO:tasks.workunit.client.1.smithi190.stdout:6/599: dread - d4/d12/d1a/f7c zero size 2023-12-06T15:00:25.853 INFO:tasks.workunit.client.1.smithi190.stdout:6/600: unlink d4/d12/c62 0 2023-12-06T15:00:25.856 INFO:tasks.workunit.client.0.smithi152.stdout:4/483: write d2/d15/f58 [1613098,77069] 0 2023-12-06T15:00:25.856 INFO:tasks.workunit.client.1.smithi190.stdout:0/430: dread d0/da/d3e/d2b/d3c/d4c/f59 [0,4194304] 0 2023-12-06T15:00:25.857 INFO:tasks.workunit.client.0.smithi152.stdout:4/484: creat d2/d15/d32/f92 x:0 0 0 2023-12-06T15:00:25.858 INFO:tasks.workunit.client.1.smithi190.stdout:6/601: write d4/d12/d1a/d70/f7f [7531848,110475] 0 2023-12-06T15:00:25.859 INFO:tasks.workunit.client.1.smithi190.stdout:6/602: unlink d4/d12/d40/d43/d45/d4a/d77/cb1 0 2023-12-06T15:00:25.860 INFO:tasks.workunit.client.1.smithi190.stdout:6/603: creat d4/d12/fc3 x:0 0 0 2023-12-06T15:00:25.861 INFO:tasks.workunit.client.1.smithi190.stdout:6/604: getdents d4/d12/d1a/d32 0 2023-12-06T15:00:25.862 INFO:tasks.workunit.client.1.smithi190.stdout:6/605: getdents d4 0 2023-12-06T15:00:25.863 INFO:tasks.workunit.client.1.smithi190.stdout:6/606: mknod d4/d12/cc4 0 2023-12-06T15:00:25.864 INFO:tasks.workunit.client.0.smithi152.stdout:0/237: dwrite d8/d3e/f43 [0,4194304] 0 2023-12-06T15:00:25.864 INFO:tasks.workunit.client.0.smithi152.stdout:1/492: dwrite d3/da/d4c/d82/d52/d62/f72 [0,4194304] 0 2023-12-06T15:00:25.865 INFO:tasks.workunit.client.0.smithi152.stdout:0/238: rmdir d8/d1b 39 2023-12-06T15:00:25.868 INFO:tasks.workunit.client.0.smithi152.stdout:1/493: creat d3/d44/d84/fba x:0 0 0 2023-12-06T15:00:25.868 INFO:tasks.workunit.client.0.smithi152.stdout:1/494: chown d3/da/d15/d17/f60 0 1 2023-12-06T15:00:25.869 INFO:tasks.workunit.client.0.smithi152.stdout:0/239: mknod d8/c47 0 2023-12-06T15:00:25.871 INFO:tasks.workunit.client.1.smithi190.stdout:3/582: dwrite d4/d70/d53/fad [0,4194304] 0 2023-12-06T15:00:25.871 INFO:tasks.workunit.client.1.smithi190.stdout:8/449: dwrite d1/d20/d3b/d36/f68 [0,4194304] 0 2023-12-06T15:00:25.871 INFO:tasks.workunit.client.0.smithi152.stdout:1/495: mknod d3/da/d15/d17/d4d/cbb 0 2023-12-06T15:00:25.871 INFO:tasks.workunit.client.0.smithi152.stdout:6/412: dwrite d1/d1c/d79/d1a/d30/d36/f7e [0,4194304] 0 2023-12-06T15:00:25.874 INFO:tasks.workunit.client.0.smithi152.stdout:7/209: dwrite dd/df/f1a [4194304,4194304] 0 2023-12-06T15:00:25.879 INFO:tasks.workunit.client.0.smithi152.stdout:1/496: creat d3/da/db/fbc x:0 0 0 2023-12-06T15:00:25.882 INFO:tasks.workunit.client.0.smithi152.stdout:6/413: link d1/d3c/d87/f44 d1/d1c/d79/d1a/d30/d36/d35/d49/d6b/f91 0 2023-12-06T15:00:25.882 INFO:tasks.workunit.client.0.smithi152.stdout:6/414: readlink d1/d1c/d79/d1a/d30/d36/d4e/l5a 0 2023-12-06T15:00:25.882 INFO:tasks.workunit.client.0.smithi152.stdout:6/415: fdatasync d1/d1c/d79/d1a/d30/d36/d35/d61/f85 0 2023-12-06T15:00:25.886 INFO:tasks.workunit.client.0.smithi152.stdout:6/416: mknod d1/d1c/c92 0 2023-12-06T15:00:25.894 INFO:tasks.workunit.client.0.smithi152.stdout:6/417: write d1/d3c/d87/f17 [547395,57526] 0 2023-12-06T15:00:25.910 INFO:tasks.workunit.client.0.smithi152.stdout:0/240: dwrite d8/d15/f2c [0,4194304] 0 2023-12-06T15:00:25.910 INFO:tasks.workunit.client.0.smithi152.stdout:0/241: dread - d8/f20 zero size 2023-12-06T15:00:25.910 INFO:tasks.workunit.client.1.smithi190.stdout:6/607: dwrite d4/d12/d1a/d32/f5d [0,4194304] 0 2023-12-06T15:00:25.910 INFO:tasks.workunit.client.1.smithi190.stdout:6/608: write d4/d12/d1a/d8a/fa0 [587893,68] 0 2023-12-06T15:00:25.910 INFO:tasks.workunit.client.1.smithi190.stdout:8/450: dwrite d1/d20/d3b/d36/f48 [0,4194304] 0 2023-12-06T15:00:25.911 INFO:tasks.workunit.client.0.smithi152.stdout:0/242: creat d8/d44/f48 x:0 0 0 2023-12-06T15:00:25.911 INFO:tasks.workunit.client.1.smithi190.stdout:6/609: mkdir d4/d12/d40/d43/d45/d4a/dc5 0 2023-12-06T15:00:25.913 INFO:tasks.workunit.client.1.smithi190.stdout:8/451: write d1/d20/d3b/d34/f40 [1653246,81900] 0 2023-12-06T15:00:25.913 INFO:tasks.workunit.client.1.smithi190.stdout:8/452: readlink d1/d20/d3b/d36/l58 0 2023-12-06T15:00:25.914 INFO:tasks.workunit.client.0.smithi152.stdout:7/210: dwrite dd/df/f3b [0,4194304] 0 2023-12-06T15:00:25.915 INFO:tasks.workunit.client.0.smithi152.stdout:1/497: dwrite d3/da/d4c/d63/fa8 [0,4194304] 0 2023-12-06T15:00:25.919 INFO:tasks.workunit.client.0.smithi152.stdout:6/418: dwrite d1/d1c/d79/d1a/d30/d36/d35/f47 [0,4194304] 0 2023-12-06T15:00:25.919 INFO:tasks.workunit.client.0.smithi152.stdout:1/498: getdents d3/da/d4c/d82/d52/d62 0 2023-12-06T15:00:25.924 INFO:tasks.workunit.client.0.smithi152.stdout:6/419: mknod d1/d1c/d79/d6d/c93 0 2023-12-06T15:00:25.925 INFO:tasks.workunit.client.0.smithi152.stdout:1/499: creat d3/da/d4c/d82/d52/d55/fbd x:0 0 0 2023-12-06T15:00:25.926 INFO:tasks.workunit.client.0.smithi152.stdout:6/420: rename d1/f8 to d1/d1c/d79/d8a/f94 0 2023-12-06T15:00:25.927 INFO:tasks.workunit.client.0.smithi152.stdout:1/500: creat d3/da/db/da0/fbe x:0 0 0 2023-12-06T15:00:25.928 INFO:tasks.workunit.client.0.smithi152.stdout:6/421: creat d1/d1c/d79/d1a/d30/d36/d35/d49/d6b/f95 x:0 0 0 2023-12-06T15:00:25.929 INFO:tasks.workunit.client.0.smithi152.stdout:1/501: creat d3/da/db/fbf x:0 0 0 2023-12-06T15:00:25.930 INFO:tasks.workunit.client.0.smithi152.stdout:6/422: symlink d1/d3c/d87/d15/l96 0 2023-12-06T15:00:25.931 INFO:tasks.workunit.client.0.smithi152.stdout:6/423: creat d1/d1c/d79/d6d/f97 x:0 0 0 2023-12-06T15:00:25.932 INFO:tasks.workunit.client.0.smithi152.stdout:6/424: link d1/d1c/d79/d1a/d30/d36/d35/d49/d57/l5b d1/d1c/d79/d1a/d30/d36/l98 0 2023-12-06T15:00:25.933 INFO:tasks.workunit.client.0.smithi152.stdout:6/425: creat d1/d1c/d79/d1a/d30/d36/d35/d49/d57/f99 x:0 0 0 2023-12-06T15:00:25.933 INFO:tasks.workunit.client.0.smithi152.stdout:6/426: chown d1/l29 5760 1 2023-12-06T15:00:25.934 INFO:tasks.workunit.client.0.smithi152.stdout:6/427: unlink d1/d1c/d79/d6d/f97 0 2023-12-06T15:00:25.935 INFO:tasks.workunit.client.0.smithi152.stdout:6/428: mknod d1/d1c/d79/d1a/d30/d36/d35/d49/c9a 0 2023-12-06T15:00:25.949 INFO:tasks.workunit.client.1.smithi190.stdout:0/431: truncate d0/da/d3e/d2b/d3c/f60 643360 0 2023-12-06T15:00:25.952 INFO:tasks.workunit.client.0.smithi152.stdout:6/429: write d1/d3c/d87/f17 [7298087,91975] 0 2023-12-06T15:00:25.953 INFO:tasks.workunit.client.1.smithi190.stdout:4/375: sync 2023-12-06T15:00:25.953 INFO:tasks.workunit.client.1.smithi190.stdout:7/497: sync 2023-12-06T15:00:25.953 INFO:tasks.workunit.client.1.smithi190.stdout:7/498: write d0/d5/d63/f96 [5060425,29086] 0 2023-12-06T15:00:25.953 INFO:tasks.workunit.client.1.smithi190.stdout:4/376: write d3/d35/d19/d30/d3c/f5a [113655,54106] 0 2023-12-06T15:00:25.954 INFO:tasks.workunit.client.1.smithi190.stdout:4/377: fdatasync d3/d35/d19/d41/d44/d5b/f61 0 2023-12-06T15:00:25.955 INFO:tasks.workunit.client.1.smithi190.stdout:7/499: getdents d0/d5/da 0 2023-12-06T15:00:25.956 INFO:tasks.workunit.client.1.smithi190.stdout:7/500: mkdir d0/df/d53/d99 0 2023-12-06T15:00:25.957 INFO:tasks.workunit.client.0.smithi152.stdout:6/430: creat d1/d1c/d79/d1a/d30/d36/d35/d63/f9b x:0 0 0 2023-12-06T15:00:25.958 INFO:tasks.workunit.client.1.smithi190.stdout:7/501: creat d0/d35/d8e/f9a x:0 0 0 2023-12-06T15:00:25.959 INFO:tasks.workunit.client.0.smithi152.stdout:6/431: link d1/d1c/d79/d1a/d30/d36/d4e/f5e d1/d1c/d79/d1a/d30/d36/d35/d61/f9c 0 2023-12-06T15:00:25.960 INFO:tasks.workunit.client.0.smithi152.stdout:6/432: unlink d1/ff 0 2023-12-06T15:00:25.960 INFO:tasks.workunit.client.0.smithi152.stdout:6/433: chown d1/d1c 1236259 1 2023-12-06T15:00:25.960 INFO:tasks.workunit.client.1.smithi190.stdout:7/502: getdents d0/d35 0 2023-12-06T15:00:25.961 INFO:tasks.workunit.client.1.smithi190.stdout:7/503: dread - d0/f7b zero size 2023-12-06T15:00:25.961 INFO:tasks.workunit.client.1.smithi190.stdout:7/504: write d0/d35/f84 [561152,30720] 0 2023-12-06T15:00:25.962 INFO:tasks.workunit.client.1.smithi190.stdout:7/505: link d0/d5/da/l3d d0/d35/l9b 0 2023-12-06T15:00:25.962 INFO:tasks.workunit.client.1.smithi190.stdout:7/506: write d0/f34 [762854,40017] 0 2023-12-06T15:00:25.963 INFO:tasks.workunit.client.1.smithi190.stdout:7/507: mknod d0/df/d53/d2f/c9c 0 2023-12-06T15:00:25.968 INFO:tasks.workunit.client.0.smithi152.stdout:6/434: dread d1/d1c/d79/d1a/d30/d18/f28 [0,4194304] 0 2023-12-06T15:00:25.968 INFO:tasks.workunit.client.0.smithi152.stdout:6/435: read d1/d1c/d79/d1a/d30/d36/d35/d61/f9c [215402,81146] 0 2023-12-06T15:00:25.975 INFO:tasks.workunit.client.1.smithi190.stdout:4/378: dread d3/d10/d15/f16 [0,4194304] 0 2023-12-06T15:00:25.975 INFO:tasks.workunit.client.1.smithi190.stdout:4/379: write d3/f40 [630376,68089] 0 2023-12-06T15:00:25.977 INFO:tasks.workunit.client.0.smithi152.stdout:0/243: dwrite d8/d15/f2c [0,4194304] 0 2023-12-06T15:00:25.977 INFO:tasks.workunit.client.0.smithi152.stdout:7/211: dwrite f9 [0,4194304] 0 2023-12-06T15:00:25.977 INFO:tasks.workunit.client.1.smithi190.stdout:6/610: dwrite d4/d12/d1a/d44/f47 [0,4194304] 0 2023-12-06T15:00:25.977 INFO:tasks.workunit.client.1.smithi190.stdout:6/611: chown d4/d12/d40/d43/cbf 0 1 2023-12-06T15:00:25.977 INFO:tasks.workunit.client.1.smithi190.stdout:6/612: dread - d4/d12/d40/d43/f9b zero size 2023-12-06T15:00:25.978 INFO:tasks.workunit.client.1.smithi190.stdout:4/380: rename d3/d35/d19/d6c/l77 to d3/d10/l7d 0 2023-12-06T15:00:25.978 INFO:tasks.workunit.client.1.smithi190.stdout:4/381: fsync d3/f78 0 2023-12-06T15:00:25.978 INFO:tasks.workunit.client.1.smithi190.stdout:0/432: dwrite d0/da/d3e/d3a/f7f [0,4194304] 0 2023-12-06T15:00:25.978 INFO:tasks.workunit.client.1.smithi190.stdout:0/433: stat d0/da/d3e/d3a/d40/d81/l78 0 2023-12-06T15:00:25.979 INFO:tasks.workunit.client.1.smithi190.stdout:7/508: fdatasync d0/f34 0 2023-12-06T15:00:25.979 INFO:tasks.workunit.client.1.smithi190.stdout:4/382: write d3/d10/d39/f25 [494796,36812] 0 2023-12-06T15:00:25.981 INFO:tasks.workunit.client.1.smithi190.stdout:4/383: write d3/d10/d39/f25 [1056974,61300] 0 2023-12-06T15:00:25.986 INFO:tasks.workunit.client.1.smithi190.stdout:0/434: creat d0/da/d5a/d80/f8c x:0 0 0 2023-12-06T15:00:25.986 INFO:tasks.workunit.client.1.smithi190.stdout:6/613: creat d4/d12/d1a/d32/dab/fc6 x:0 0 0 2023-12-06T15:00:25.987 INFO:tasks.workunit.client.1.smithi190.stdout:7/509: mknod d0/d88/d32/c9d 0 2023-12-06T15:00:25.987 INFO:tasks.workunit.client.1.smithi190.stdout:0/435: mkdir d0/da/d3e/d3a/d40/d81/d8d 0 2023-12-06T15:00:25.987 INFO:tasks.workunit.client.1.smithi190.stdout:0/436: write d0/da/f5b [330100,43852] 0 2023-12-06T15:00:25.988 INFO:tasks.workunit.client.1.smithi190.stdout:6/614: mkdir d4/d12/d1a/d32/dc7 0 2023-12-06T15:00:25.988 INFO:tasks.workunit.client.1.smithi190.stdout:7/510: symlink d0/d88/l9e 0 2023-12-06T15:00:25.989 INFO:tasks.workunit.client.1.smithi190.stdout:0/437: mkdir d0/da/d3e/d2b/d3c/d46/d8e 0 2023-12-06T15:00:25.991 INFO:tasks.workunit.client.0.smithi152.stdout:6/436: getdents d1 0 2023-12-06T15:00:25.991 INFO:tasks.workunit.client.0.smithi152.stdout:6/437: chown d1/d1c/c4d 37620 1 2023-12-06T15:00:25.991 INFO:tasks.workunit.client.0.smithi152.stdout:6/438: read d1/d1c/d79/d1a/d30/d36/d26/f2d [724194,14775] 0 2023-12-06T15:00:25.993 INFO:tasks.workunit.client.1.smithi190.stdout:6/615: unlink d4/d12/d1a/d44/fb3 0 2023-12-06T15:00:25.993 INFO:tasks.workunit.client.1.smithi190.stdout:6/616: write d4/d15/fa4 [1040083,70458] 0 2023-12-06T15:00:25.994 INFO:tasks.workunit.client.1.smithi190.stdout:7/511: mknod d0/d88/d1c/c9f 0 2023-12-06T15:00:25.995 INFO:tasks.workunit.client.1.smithi190.stdout:7/512: write d0/f6 [633590,39855] 0 2023-12-06T15:00:25.996 INFO:tasks.workunit.client.1.smithi190.stdout:0/438: mknod d0/da/d3e/d3a/d40/d81/d8d/c8f 0 2023-12-06T15:00:25.996 INFO:tasks.workunit.client.1.smithi190.stdout:0/439: chown d0/da/d3e/d3a/d40 162 1 2023-12-06T15:00:25.997 INFO:tasks.workunit.client.0.smithi152.stdout:0/244: dread d8/d1b/f41 [8388608,4194304] 0 2023-12-06T15:00:25.997 INFO:tasks.workunit.client.1.smithi190.stdout:6/617: symlink d4/d12/d40/lc8 0 2023-12-06T15:00:26.000 INFO:tasks.workunit.client.1.smithi190.stdout:7/513: rename d0/d88/d1c/f4d to d0/d5/da/d56/fa0 0 2023-12-06T15:00:26.000 INFO:tasks.workunit.client.0.smithi152.stdout:0/245: mknod d8/d3e/c49 0 2023-12-06T15:00:26.000 INFO:tasks.workunit.client.0.smithi152.stdout:0/246: dread - d8/f3f zero size 2023-12-06T15:00:26.001 INFO:tasks.workunit.client.0.smithi152.stdout:0/247: creat d8/d3e/f4a x:0 0 0 2023-12-06T15:00:26.002 INFO:tasks.workunit.client.1.smithi190.stdout:0/440: mkdir d0/da/d3e/d2b/d3c/d46/d8e/d90 0 2023-12-06T15:00:26.002 INFO:tasks.workunit.client.1.smithi190.stdout:0/441: chown d0/da/d3e/d3a/d40/f5e 120 1 2023-12-06T15:00:26.002 INFO:tasks.workunit.client.1.smithi190.stdout:0/442: write d0/da/d3e/d3a/d40/f5e [859917,33165] 0 2023-12-06T15:00:26.002 INFO:tasks.workunit.client.1.smithi190.stdout:7/514: creat d0/d88/d41/fa1 x:0 0 0 2023-12-06T15:00:26.004 INFO:tasks.workunit.client.1.smithi190.stdout:0/443: stat d0/da/d3e/d3a/d40/l54 0 2023-12-06T15:00:26.004 INFO:tasks.workunit.client.1.smithi190.stdout:0/444: chown d0/da/d3e/d2b/d3c/l6b 6849 1 2023-12-06T15:00:26.004 INFO:tasks.workunit.client.0.smithi152.stdout:0/248: mkdir d8/d4b 0 2023-12-06T15:00:26.004 INFO:tasks.workunit.client.0.smithi152.stdout:0/249: chown d8/c14 21 1 2023-12-06T15:00:26.005 INFO:tasks.workunit.client.1.smithi190.stdout:5/376: sync 2023-12-06T15:00:26.005 INFO:tasks.workunit.client.1.smithi190.stdout:7/515: creat d0/d88/d33/d4c/fa2 x:0 0 0 2023-12-06T15:00:26.008 INFO:tasks.workunit.client.1.smithi190.stdout:5/377: unlink d0/d1c/d2b/c57 0 2023-12-06T15:00:26.008 INFO:tasks.workunit.client.1.smithi190.stdout:5/378: readlink d0/d1c/d2b/d2c/d5d/l5e 0 2023-12-06T15:00:26.009 INFO:tasks.workunit.client.0.smithi152.stdout:7/212: dwrite dd/f2f [0,4194304] 0 2023-12-06T15:00:26.011 INFO:tasks.workunit.client.1.smithi190.stdout:5/379: rename d0/df/f1a to d0/d1c/d3e/f77 0 2023-12-06T15:00:26.011 INFO:tasks.workunit.client.1.smithi190.stdout:5/380: chown d0/df/f20 358 1 2023-12-06T15:00:26.013 INFO:tasks.workunit.client.0.smithi152.stdout:7/213: truncate dd/df/f1f 323243 0 2023-12-06T15:00:26.013 INFO:tasks.workunit.client.0.smithi152.stdout:7/214: fdatasync dd/df/f1f 0 2023-12-06T15:00:26.013 INFO:tasks.workunit.client.0.smithi152.stdout:7/215: readlink dd/df/d1b/d20/d28/d38/d29/l37 0 2023-12-06T15:00:26.013 INFO:tasks.workunit.client.1.smithi190.stdout:5/381: rename d0/df/c2f to d0/d1c/d2b/d69/c78 0 2023-12-06T15:00:26.017 INFO:tasks.workunit.client.0.smithi152.stdout:7/216: unlink dd/f13 0 2023-12-06T15:00:26.017 INFO:tasks.workunit.client.0.smithi152.stdout:7/217: fsync dd/df/d1b/f41 0 2023-12-06T15:00:26.017 INFO:tasks.workunit.client.1.smithi190.stdout:5/382: link d0/d1c/d2b/d69/f74 d0/d6c/f79 0 2023-12-06T15:00:26.021 INFO:tasks.workunit.client.0.smithi152.stdout:5/257: sync 2023-12-06T15:00:26.022 INFO:tasks.workunit.client.1.smithi190.stdout:6/618: dread d4/d12/d1a/d70/f7f [4194304,4194304] 0 2023-12-06T15:00:26.022 INFO:tasks.workunit.client.1.smithi190.stdout:6/619: truncate d4/d12/d1a/d32/f4c 4450972 0 2023-12-06T15:00:26.022 INFO:tasks.workunit.client.0.smithi152.stdout:5/258: mknod d7/d43/c51 0 2023-12-06T15:00:26.024 INFO:tasks.workunit.client.1.smithi190.stdout:6/620: creat d4/d12/d1a/fc9 x:0 0 0 2023-12-06T15:00:26.024 INFO:tasks.workunit.client.0.smithi152.stdout:5/259: symlink d7/dd/d26/d48/l52 0 2023-12-06T15:00:26.024 INFO:tasks.workunit.client.0.smithi152.stdout:5/260: fsync d7/f38 0 2023-12-06T15:00:26.024 INFO:tasks.workunit.client.0.smithi152.stdout:5/261: readlink d7/dd/l37 0 2023-12-06T15:00:26.024 INFO:tasks.workunit.client.0.smithi152.stdout:5/262: write d7/fc [3164548,78750] 0 2023-12-06T15:00:26.025 INFO:tasks.workunit.client.1.smithi190.stdout:6/621: rename d4/d15 to d4/d12/d40/d43/d45/d4a/d77/dca 0 2023-12-06T15:00:26.026 INFO:tasks.workunit.client.0.smithi152.stdout:5/263: creat d7/d47/f53 x:0 0 0 2023-12-06T15:00:26.027 INFO:tasks.workunit.client.0.smithi152.stdout:5/264: mknod d7/dd/d26/d3b/d46/c54 0 2023-12-06T15:00:26.027 INFO:tasks.workunit.client.1.smithi190.stdout:6/622: rename d4/d12/d1a/d32/c68 to d4/d12/ccb 0 2023-12-06T15:00:26.028 INFO:tasks.workunit.client.1.smithi190.stdout:6/623: symlink d4/d12/d1a/lcc 0 2023-12-06T15:00:26.029 INFO:tasks.workunit.client.1.smithi190.stdout:6/624: creat d4/d12/d1a/d70/fcd x:0 0 0 2023-12-06T15:00:26.030 INFO:tasks.workunit.client.1.smithi190.stdout:6/625: creat d4/d12/d1a/d44/fce x:0 0 0 2023-12-06T15:00:26.032 INFO:tasks.workunit.client.1.smithi190.stdout:4/384: dwrite d3/f3f [0,4194304] 0 2023-12-06T15:00:26.032 INFO:tasks.workunit.client.1.smithi190.stdout:6/626: mknod d4/d12/d1a/d8c/ccf 0 2023-12-06T15:00:26.032 INFO:tasks.workunit.client.1.smithi190.stdout:6/627: write d4/d12/d40/d43/d45/d4a/d77/dca/f26 [6635885,69741] 0 2023-12-06T15:00:26.037 INFO:tasks.workunit.client.1.smithi190.stdout:4/385: unlink d3/d35/d19/d30/f3a 0 2023-12-06T15:00:26.038 INFO:tasks.workunit.client.0.smithi152.stdout:7/218: dread dd/df/f3b [0,4194304] 0 2023-12-06T15:00:26.038 INFO:tasks.workunit.client.0.smithi152.stdout:7/219: chown f3 927026967 1 2023-12-06T15:00:26.039 INFO:tasks.workunit.client.1.smithi190.stdout:4/386: read d3/d35/d19/d41/d44/f4c [980992,63933] 0 2023-12-06T15:00:26.048 INFO:tasks.workunit.client.0.smithi152.stdout:6/439: dwrite d1/d1c/d79/d1a/d30/d36/f4f [0,4194304] 0 2023-12-06T15:00:26.048 INFO:tasks.workunit.client.0.smithi152.stdout:0/250: dwrite d8/f9 [4194304,4194304] 0 2023-12-06T15:00:26.049 INFO:tasks.workunit.client.1.smithi190.stdout:0/445: dwrite d0/da/d3e/d2b/d3c/d46/f73 [0,4194304] 0 2023-12-06T15:00:26.049 INFO:tasks.workunit.client.1.smithi190.stdout:7/516: dwrite d0/df/d53/d2f/d3e/f7e [0,4194304] 0 2023-12-06T15:00:26.050 INFO:tasks.workunit.client.0.smithi152.stdout:6/440: mknod d1/d1c/d79/d1a/d30/c9d 0 2023-12-06T15:00:26.051 INFO:tasks.workunit.client.0.smithi152.stdout:0/251: symlink d8/d1b/l4c 0 2023-12-06T15:00:26.051 INFO:tasks.workunit.client.0.smithi152.stdout:0/252: stat d8/d1b/f27 0 2023-12-06T15:00:26.051 INFO:tasks.workunit.client.0.smithi152.stdout:6/441: creat d1/d3c/f9e x:0 0 0 2023-12-06T15:00:26.052 INFO:tasks.workunit.client.1.smithi190.stdout:0/446: rename d0/da/d5a/l84 to d0/da/d5a/d80/l91 0 2023-12-06T15:00:26.052 INFO:tasks.workunit.client.1.smithi190.stdout:7/517: creat d0/df/d5f/fa3 x:0 0 0 2023-12-06T15:00:26.053 INFO:tasks.workunit.client.0.smithi152.stdout:0/253: symlink d8/d44/l4d 0 2023-12-06T15:00:26.054 INFO:tasks.workunit.client.0.smithi152.stdout:6/442: mkdir d1/d1c/d79/d1a/d30/d36/d4e/d55/d9f 0 2023-12-06T15:00:26.055 INFO:tasks.workunit.client.1.smithi190.stdout:0/447: write d0/da/d3e/d3a/f7f [1119078,55597] 0 2023-12-06T15:00:26.056 INFO:tasks.workunit.client.0.smithi152.stdout:0/254: creat d8/d4b/f4e x:0 0 0 2023-12-06T15:00:26.057 INFO:tasks.workunit.client.1.smithi190.stdout:9/477: sync 2023-12-06T15:00:26.057 INFO:tasks.workunit.client.1.smithi190.stdout:2/452: sync 2023-12-06T15:00:26.057 INFO:tasks.workunit.client.1.smithi190.stdout:7/518: dread d0/d88/d33/f80 [0,4194304] 0 2023-12-06T15:00:26.057 INFO:tasks.workunit.client.1.smithi190.stdout:3/583: sync 2023-12-06T15:00:26.057 INFO:tasks.workunit.client.1.smithi190.stdout:1/698: sync 2023-12-06T15:00:26.058 INFO:tasks.workunit.client.0.smithi152.stdout:6/443: link d1/d1c/d79/d1a/d30/d36/d35/d63/f9b d1/d69/fa0 0 2023-12-06T15:00:26.058 INFO:tasks.workunit.client.0.smithi152.stdout:5/265: dwrite d7/dd/ff [0,4194304] 0 2023-12-06T15:00:26.058 INFO:tasks.workunit.client.0.smithi152.stdout:6/444: write d1/d3c/d87/fb [2349511,31010] 0 2023-12-06T15:00:26.059 INFO:tasks.workunit.client.1.smithi190.stdout:1/699: write d6/dc/f9b [3063301,19429] 0 2023-12-06T15:00:26.059 INFO:tasks.workunit.client.1.smithi190.stdout:0/448: link d0/da/d3e/d2b/d3c/d4c/f53 d0/da/d3e/d3a/d40/d81/f92 0 2023-12-06T15:00:26.059 INFO:tasks.workunit.client.1.smithi190.stdout:0/449: dread - d0/da/d3e/d2b/f69 zero size 2023-12-06T15:00:26.059 INFO:tasks.workunit.client.1.smithi190.stdout:9/478: chown d4/d27/d2f/d31/c3b 267 1 2023-12-06T15:00:26.060 INFO:tasks.workunit.client.0.smithi152.stdout:5/266: creat d7/dd/d4e/f55 x:0 0 0 2023-12-06T15:00:26.062 INFO:tasks.workunit.client.1.smithi190.stdout:1/700: symlink d6/dc/d29/d38/d39/d63/le1 0 2023-12-06T15:00:26.062 INFO:tasks.workunit.client.1.smithi190.stdout:1/701: chown d6/d49 1061 1 2023-12-06T15:00:26.063 INFO:tasks.workunit.client.1.smithi190.stdout:7/519: creat d0/d88/fa4 x:0 0 0 2023-12-06T15:00:26.064 INFO:tasks.workunit.client.1.smithi190.stdout:0/450: creat d0/da/d3e/d3a/d40/d6f/f93 x:0 0 0 2023-12-06T15:00:26.064 INFO:tasks.workunit.client.1.smithi190.stdout:0/451: chown d0/da/f25 72480055 1 2023-12-06T15:00:26.064 INFO:tasks.workunit.client.0.smithi152.stdout:5/267: mknod d7/d43/c56 0 2023-12-06T15:00:26.065 INFO:tasks.workunit.client.1.smithi190.stdout:1/702: mkdir d6/dc/d29/d38/d43/db7/de2 0 2023-12-06T15:00:26.069 INFO:tasks.workunit.client.1.smithi190.stdout:1/703: write d6/dc/f15 [3320755,8290] 0 2023-12-06T15:00:26.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:25 smithi190 ceph-mon[121340]: pgmap v24: 65 pgs: 65 active+clean; 1.3 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 86 MiB/s rd, 168 MiB/s wr, 309 op/s 2023-12-06T15:00:26.073 INFO:tasks.workunit.client.1.smithi190.stdout:4/387: dwrite d3/d10/d15/f16 [0,4194304] 0 2023-12-06T15:00:26.073 INFO:tasks.workunit.client.1.smithi190.stdout:7/520: rename d0/d88/c2c to d0/df/d53/d2f/ca5 0 2023-12-06T15:00:26.079 INFO:tasks.workunit.client.1.smithi190.stdout:0/452: getdents d0/da/d3e/d2b/d37 0 2023-12-06T15:00:26.080 INFO:tasks.workunit.client.0.smithi152.stdout:6/445: dread d1/d1c/d79/d8a/f94 [0,4194304] 0 2023-12-06T15:00:26.080 INFO:tasks.workunit.client.0.smithi152.stdout:6/446: fsync d1/d1c/d79/d1a/d30/d36/f7e 0 2023-12-06T15:00:26.087 INFO:tasks.workunit.client.1.smithi190.stdout:4/388: unlink d3/d10/c4a 0 2023-12-06T15:00:26.088 INFO:tasks.workunit.client.1.smithi190.stdout:7/521: dread - d0/d35/d8e/f9a zero size 2023-12-06T15:00:26.088 INFO:tasks.workunit.client.1.smithi190.stdout:7/522: chown d0/df/d53/f3c 451955128 1 2023-12-06T15:00:26.089 INFO:tasks.workunit.client.1.smithi190.stdout:0/453: symlink d0/da/d3e/d2b/d3c/d46/l94 0 2023-12-06T15:00:26.090 INFO:tasks.workunit.client.1.smithi190.stdout:7/523: creat d0/df/d5f/fa6 x:0 0 0 2023-12-06T15:00:26.090 INFO:tasks.workunit.client.1.smithi190.stdout:7/524: chown d0/d88/d1c/d17/d94/d95 4332 1 2023-12-06T15:00:26.092 INFO:tasks.workunit.client.1.smithi190.stdout:7/525: rename d0/d88/d33/d60 to d0/df/d5f/da7 0 2023-12-06T15:00:26.096 INFO:tasks.workunit.client.1.smithi190.stdout:7/526: dread d0/f6 [0,4194304] 0 2023-12-06T15:00:26.096 INFO:tasks.workunit.client.1.smithi190.stdout:7/527: dread d0/df/d53/d2f/f70 [0,4194304] 0 2023-12-06T15:00:26.103 INFO:tasks.workunit.client.1.smithi190.stdout:8/453: sync 2023-12-06T15:00:26.106 INFO:tasks.workunit.client.1.smithi190.stdout:8/454: unlink d1/d10/d1c/d4b/l75 0 2023-12-06T15:00:26.106 INFO:tasks.workunit.client.1.smithi190.stdout:8/455: stat d1/d20/d3b/d34/f40 0 2023-12-06T15:00:26.106 INFO:tasks.workunit.client.1.smithi190.stdout:8/456: fdatasync d1/d10/d1c/d4b/f7c 0 2023-12-06T15:00:26.107 INFO:tasks.workunit.client.1.smithi190.stdout:8/457: chown d1/d10/d25/c2b 116721224 1 2023-12-06T15:00:26.107 INFO:tasks.workunit.client.0.smithi152.stdout:6/447: rename d1/d3c to d1/d69/da1 0 2023-12-06T15:00:26.108 INFO:tasks.workunit.client.1.smithi190.stdout:8/458: creat d1/d20/d3b/d36/d50/f88 x:0 0 0 2023-12-06T15:00:26.109 INFO:tasks.workunit.client.0.smithi152.stdout:6/448: mknod d1/d69/da1/d87/ca2 0 2023-12-06T15:00:26.110 INFO:tasks.workunit.client.1.smithi190.stdout:7/528: dread d0/d5/f8 [0,4194304] 0 2023-12-06T15:00:26.112 INFO:tasks.workunit.client.1.smithi190.stdout:7/529: creat d0/d88/d7a/fa8 x:0 0 0 2023-12-06T15:00:26.112 INFO:tasks.workunit.client.1.smithi190.stdout:7/530: write d0/d88/d33/d4c/fa2 [862785,104348] 0 2023-12-06T15:00:26.113 INFO:tasks.workunit.client.1.smithi190.stdout:8/459: write d1/f16 [1211236,72201] 0 2023-12-06T15:00:26.113 INFO:tasks.workunit.client.1.smithi190.stdout:0/454: dread d0/da/d3e/d2b/f33 [0,4194304] 0 2023-12-06T15:00:26.115 INFO:tasks.workunit.client.1.smithi190.stdout:4/389: dread d3/d10/d15/f2f [0,4194304] 0 2023-12-06T15:00:26.115 INFO:tasks.workunit.client.1.smithi190.stdout:8/460: mknod d1/d20/d3b/d31/c89 0 2023-12-06T15:00:26.118 INFO:tasks.workunit.client.1.smithi190.stdout:3/584: dwrite d4/d1b/d5d/f71 [0,4194304] 0 2023-12-06T15:00:26.118 INFO:tasks.workunit.client.1.smithi190.stdout:3/585: readlink d4/d70/d19/d3a/l74 0 2023-12-06T15:00:26.118 INFO:tasks.workunit.client.1.smithi190.stdout:2/453: dwrite d10/d59/d5e/f1b [0,4194304] 0 2023-12-06T15:00:26.118 INFO:tasks.workunit.client.1.smithi190.stdout:2/454: truncate d10/d26/d5c/d49/d54/f8b 835143 0 2023-12-06T15:00:26.119 INFO:tasks.workunit.client.0.smithi152.stdout:0/255: dwrite d8/fa [0,4194304] 0 2023-12-06T15:00:26.119 INFO:tasks.workunit.client.0.smithi152.stdout:0/256: stat d8/d15/l2d 0 2023-12-06T15:00:26.120 INFO:tasks.workunit.client.0.smithi152.stdout:5/268: dwrite d7/f15 [0,4194304] 0 2023-12-06T15:00:26.120 INFO:tasks.workunit.client.0.smithi152.stdout:6/449: dread d1/d1c/d79/d1a/d30/d36/d35/f47 [0,4194304] 0 2023-12-06T15:00:26.120 INFO:tasks.workunit.client.0.smithi152.stdout:5/269: write d7/d43/f4b [421890,16465] 0 2023-12-06T15:00:26.121 INFO:tasks.workunit.client.1.smithi190.stdout:9/479: dwrite f1 [8388608,4194304] 0 2023-12-06T15:00:26.122 INFO:tasks.workunit.client.1.smithi190.stdout:3/586: rmdir d4/d1b/d77/da8 39 2023-12-06T15:00:26.122 INFO:tasks.workunit.client.1.smithi190.stdout:3/587: fsync d4/d1b/d69/f90 0 2023-12-06T15:00:26.123 INFO:tasks.workunit.client.1.smithi190.stdout:3/588: readlink d4/d1b/d54/l7e 0 2023-12-06T15:00:26.124 INFO:tasks.workunit.client.0.smithi152.stdout:0/257: rename d8/d3e/f4a to d8/d15/d45/f4f 0 2023-12-06T15:00:26.125 INFO:tasks.workunit.client.0.smithi152.stdout:0/258: truncate d8/d1b/f1f 511788 0 2023-12-06T15:00:26.125 INFO:tasks.workunit.client.0.smithi152.stdout:0/259: dread - d8/d44/f48 zero size 2023-12-06T15:00:26.125 INFO:tasks.workunit.client.0.smithi152.stdout:0/260: chown d8/d15/l19 35809583 1 2023-12-06T15:00:26.127 INFO:tasks.workunit.client.1.smithi190.stdout:2/455: mkdir d10/d26/d5c/d42/d9d 0 2023-12-06T15:00:26.127 INFO:tasks.workunit.client.1.smithi190.stdout:4/390: dread d3/fd [4194304,4194304] 0 2023-12-06T15:00:26.128 INFO:tasks.workunit.client.0.smithi152.stdout:5/270: symlink d7/l57 0 2023-12-06T15:00:26.128 INFO:tasks.workunit.client.0.smithi152.stdout:0/261: creat d8/d15/f50 x:0 0 0 2023-12-06T15:00:26.129 INFO:tasks.workunit.client.0.smithi152.stdout:5/271: getdents d7/dd/d4e 0 2023-12-06T15:00:26.129 INFO:tasks.workunit.client.1.smithi190.stdout:7/531: dread d0/df/d53/f72 [0,4194304] 0 2023-12-06T15:00:26.129 INFO:tasks.workunit.client.1.smithi190.stdout:7/532: dread - d0/f7b zero size 2023-12-06T15:00:26.131 INFO:tasks.workunit.client.0.smithi152.stdout:5/272: symlink d7/l58 0 2023-12-06T15:00:26.132 INFO:tasks.workunit.client.1.smithi190.stdout:9/480: rename d4/d27/d2f/d5c/c77 to d4/d27/d2f/d31/d3f/d58/d72/d7a/ca2 0 2023-12-06T15:00:26.132 INFO:tasks.workunit.client.1.smithi190.stdout:4/391: link d3/c42 d3/d10/c7e 0 2023-12-06T15:00:26.132 INFO:tasks.workunit.client.1.smithi190.stdout:4/392: stat d3/f78 0 2023-12-06T15:00:26.133 INFO:tasks.workunit.client.1.smithi190.stdout:4/393: write d3/d35/f6a [915538,59481] 0 2023-12-06T15:00:26.133 INFO:tasks.workunit.client.0.smithi152.stdout:5/273: mknod d7/dd/d4e/c59 0 2023-12-06T15:00:26.134 INFO:tasks.workunit.client.1.smithi190.stdout:1/704: dwrite d6/dc/d29/d38/d73/d5c/f70 [4194304,4194304] 0 2023-12-06T15:00:26.134 INFO:tasks.workunit.client.1.smithi190.stdout:8/461: dread d1/d10/d1c/f4e [0,4194304] 0 2023-12-06T15:00:26.135 INFO:tasks.workunit.client.0.smithi152.stdout:5/274: rmdir d7 39 2023-12-06T15:00:26.137 INFO:tasks.workunit.client.1.smithi190.stdout:9/481: fsync d4/d27/d2f/d31/f50 0 2023-12-06T15:00:26.137 INFO:tasks.workunit.client.1.smithi190.stdout:9/482: fsync d4/d84/f8f 0 2023-12-06T15:00:26.137 INFO:tasks.workunit.client.1.smithi190.stdout:0/455: dwrite d0/da/d3e/d2b/d37/f7a [0,4194304] 0 2023-12-06T15:00:26.138 INFO:tasks.workunit.client.0.smithi152.stdout:5/275: creat d7/dd/d26/d3b/f5a x:0 0 0 2023-12-06T15:00:26.138 INFO:tasks.workunit.client.0.smithi152.stdout:5/276: fdatasync d7/f19 0 2023-12-06T15:00:26.138 INFO:tasks.workunit.client.0.smithi152.stdout:0/262: write d8/d1b/f41 [6223923,42341] 0 2023-12-06T15:00:26.141 INFO:tasks.workunit.client.1.smithi190.stdout:1/705: getdents d6/dc/d29/d38/d73/d76/d7e 0 2023-12-06T15:00:26.141 INFO:tasks.workunit.client.1.smithi190.stdout:8/462: mkdir d1/d20/d3b/d4d/d8a 0 2023-12-06T15:00:26.141 INFO:tasks.workunit.client.0.smithi152.stdout:0/263: creat d8/d4b/f51 x:0 0 0 2023-12-06T15:00:26.141 INFO:tasks.workunit.client.0.smithi152.stdout:0/264: stat d8/fd 0 2023-12-06T15:00:26.141 INFO:tasks.workunit.client.0.smithi152.stdout:0/265: chown d8/d15/f2c 1626 1 2023-12-06T15:00:26.141 INFO:tasks.workunit.client.0.smithi152.stdout:0/266: chown d8/d38/l3b 97477 1 2023-12-06T15:00:26.150 INFO:tasks.workunit.client.1.smithi190.stdout:4/394: dread d3/f12 [0,4194304] 0 2023-12-06T15:00:26.150 INFO:tasks.workunit.client.1.smithi190.stdout:4/395: truncate d3/d10/f5f 688256 0 2023-12-06T15:00:26.150 INFO:tasks.workunit.client.1.smithi190.stdout:4/396: readlink d3/d10/d15/l43 0 2023-12-06T15:00:26.150 INFO:tasks.workunit.client.1.smithi190.stdout:0/456: rename d0/f41 to d0/da/d5a/f95 0 2023-12-06T15:00:26.153 INFO:tasks.workunit.client.1.smithi190.stdout:0/457: getdents d0/da/d3e/d2b/d3c/d65 0 2023-12-06T15:00:26.156 INFO:tasks.workunit.client.0.smithi152.stdout:0/267: dread d8/f13 [4194304,4194304] 0 2023-12-06T15:00:26.156 INFO:tasks.workunit.client.0.smithi152.stdout:0/268: write d8/f37 [4434745,11738] 0 2023-12-06T15:00:26.156 INFO:tasks.workunit.client.0.smithi152.stdout:6/450: dwrite d1/f3d [0,4194304] 0 2023-12-06T15:00:26.156 INFO:tasks.workunit.client.1.smithi190.stdout:4/397: rename d3/d35/d19/d6c to d3/d10/d7f 0 2023-12-06T15:00:26.157 INFO:tasks.workunit.client.1.smithi190.stdout:0/458: mknod d0/da/d3e/d2b/d3c/d46/d8e/c96 0 2023-12-06T15:00:26.158 INFO:tasks.workunit.client.0.smithi152.stdout:0/269: creat d8/d3e/f52 x:0 0 0 2023-12-06T15:00:26.158 INFO:tasks.workunit.client.0.smithi152.stdout:0/270: readlink d8/d15/l2d 0 2023-12-06T15:00:26.158 INFO:tasks.workunit.client.0.smithi152.stdout:0/271: dread - d8/f3a zero size 2023-12-06T15:00:26.159 INFO:tasks.workunit.client.1.smithi190.stdout:4/398: mknod d3/d35/d19/d41/d44/c80 0 2023-12-06T15:00:26.159 INFO:tasks.workunit.client.1.smithi190.stdout:4/399: chown d3/d35/d19/d41/d44/d5b/f61 91275500 1 2023-12-06T15:00:26.159 INFO:tasks.workunit.client.1.smithi190.stdout:4/400: chown d3/c2e 2044 1 2023-12-06T15:00:26.161 INFO:tasks.workunit.client.1.smithi190.stdout:4/401: symlink d3/d35/d19/d30/l81 0 2023-12-06T15:00:26.161 INFO:tasks.workunit.client.1.smithi190.stdout:4/402: read d3/d35/d19/f5e [330442,41428] 0 2023-12-06T15:00:26.161 INFO:tasks.workunit.client.1.smithi190.stdout:4/403: chown d3/d35/d19/d41/d44/d5b/f61 1852956 1 2023-12-06T15:00:26.163 INFO:tasks.workunit.client.0.smithi152.stdout:0/272: write d8/f9 [4058131,128675] 0 2023-12-06T15:00:26.163 INFO:tasks.workunit.client.0.smithi152.stdout:8/146: sync 2023-12-06T15:00:26.163 INFO:tasks.workunit.client.0.smithi152.stdout:3/321: sync 2023-12-06T15:00:26.163 INFO:tasks.workunit.client.0.smithi152.stdout:3/322: fdatasync d9/f1d 0 2023-12-06T15:00:26.163 INFO:tasks.workunit.client.0.smithi152.stdout:3/323: chown d9/d18/d39 11 1 2023-12-06T15:00:26.164 INFO:tasks.workunit.client.1.smithi190.stdout:4/404: dread d3/d10/f5f [0,4194304] 0 2023-12-06T15:00:26.164 INFO:tasks.workunit.client.1.smithi190.stdout:4/405: truncate d3/d35/d19/d30/d3c/f4f 831957 0 2023-12-06T15:00:26.164 INFO:tasks.workunit.client.1.smithi190.stdout:4/406: truncate d3/d35/d19/d41/d44/d5b/f6f 579201 0 2023-12-06T15:00:26.165 INFO:tasks.workunit.client.1.smithi190.stdout:4/407: mknod d3/d35/d19/c82 0 2023-12-06T15:00:26.166 INFO:tasks.workunit.client.0.smithi152.stdout:0/273: creat d8/d38/f53 x:0 0 0 2023-12-06T15:00:26.166 INFO:tasks.workunit.client.0.smithi152.stdout:8/147: fdatasync d1/d6/d7/fa 0 2023-12-06T15:00:26.166 INFO:tasks.workunit.client.0.smithi152.stdout:8/148: chown d1/d6/db/f26 12870604 1 2023-12-06T15:00:26.167 INFO:tasks.workunit.client.1.smithi190.stdout:4/408: creat d3/d35/d19/d41/d44/f83 x:0 0 0 2023-12-06T15:00:26.167 INFO:tasks.workunit.client.1.smithi190.stdout:4/409: chown d3/d10/l7d 6 1 2023-12-06T15:00:26.168 INFO:tasks.workunit.client.1.smithi190.stdout:4/410: write d3/d35/d19/d41/d44/f4c [2277828,107868] 0 2023-12-06T15:00:26.168 INFO:tasks.workunit.client.1.smithi190.stdout:4/411: fdatasync d3/d35/d19/d41/d44/d5b/f61 0 2023-12-06T15:00:26.168 INFO:tasks.workunit.client.1.smithi190.stdout:2/456: dwrite d10/d26/d5c/d35/f87 [0,4194304] 0 2023-12-06T15:00:26.168 INFO:tasks.workunit.client.0.smithi152.stdout:3/324: link d9/c15 d9/d10/d12/d43/d52/d58/c5b 0 2023-12-06T15:00:26.169 INFO:tasks.workunit.client.0.smithi152.stdout:0/274: link f5 d8/d15/d45/f54 0 2023-12-06T15:00:26.169 INFO:tasks.workunit.client.0.smithi152.stdout:6/451: dread d1/f3d [0,4194304] 0 2023-12-06T15:00:26.169 INFO:tasks.workunit.client.1.smithi190.stdout:4/412: creat d3/d10/d39/d54/f84 x:0 0 0 2023-12-06T15:00:26.169 INFO:tasks.workunit.client.1.smithi190.stdout:0/459: dread d0/da/d3e/d2b/d3c/d46/f52 [0,4194304] 0 2023-12-06T15:00:26.169 INFO:tasks.workunit.client.1.smithi190.stdout:0/460: truncate d0/da/d3e/d2b/d3c/f60 770622 0 2023-12-06T15:00:26.170 INFO:tasks.workunit.client.0.smithi152.stdout:8/149: truncate d1/d6/fd 1357985 0 2023-12-06T15:00:26.171 INFO:tasks.workunit.client.1.smithi190.stdout:2/457: symlink d10/d59/d5e/l9e 0 2023-12-06T15:00:26.171 INFO:tasks.workunit.client.1.smithi190.stdout:4/413: write d3/d10/d39/f5c [287223,87849] 0 2023-12-06T15:00:26.171 INFO:tasks.workunit.client.0.smithi152.stdout:3/325: creat d9/d18/d51/f5c x:0 0 0 2023-12-06T15:00:26.171 INFO:tasks.workunit.client.0.smithi152.stdout:9/285: sync 2023-12-06T15:00:26.172 INFO:tasks.workunit.client.0.smithi152.stdout:2/233: sync 2023-12-06T15:00:26.172 INFO:tasks.workunit.client.1.smithi190.stdout:4/414: creat d3/d35/d19/d30/f85 x:0 0 0 2023-12-06T15:00:26.172 INFO:tasks.workunit.client.1.smithi190.stdout:4/415: truncate d3/f78 326915 0 2023-12-06T15:00:26.174 INFO:tasks.workunit.client.0.smithi152.stdout:3/326: creat d9/d10/f5d x:0 0 0 2023-12-06T15:00:26.175 INFO:tasks.workunit.client.0.smithi152.stdout:6/452: write d1/d1c/d79/d1a/d30/f34 [184144,123788] 0 2023-12-06T15:00:26.175 INFO:tasks.workunit.client.1.smithi190.stdout:4/416: unlink d3/d10/d15/f51 0 2023-12-06T15:00:26.176 INFO:tasks.workunit.client.0.smithi152.stdout:9/286: creat d0/dd/d20/d38/d48/f4f x:0 0 0 2023-12-06T15:00:26.177 INFO:tasks.workunit.client.0.smithi152.stdout:3/327: mknod d9/d10/d12/d43/c5e 0 2023-12-06T15:00:26.179 INFO:tasks.workunit.client.0.smithi152.stdout:2/234: mkdir d6/d18/d43 0 2023-12-06T15:00:26.179 INFO:tasks.workunit.client.0.smithi152.stdout:9/287: truncate d0/f6 801344 0 2023-12-06T15:00:26.182 INFO:tasks.workunit.client.0.smithi152.stdout:2/235: rename d6/d1e/d27/c2a to d6/d1e/c44 0 2023-12-06T15:00:26.183 INFO:tasks.workunit.client.1.smithi190.stdout:4/417: getdents d3/d35/d19/d30/d3c/d4d 0 2023-12-06T15:00:26.185 INFO:tasks.workunit.client.1.smithi190.stdout:7/533: dwrite d0/d5/f8 [0,4194304] 0 2023-12-06T15:00:26.185 INFO:tasks.workunit.client.1.smithi190.stdout:4/418: truncate d3/d10/d15/f16 234505 0 2023-12-06T15:00:26.186 INFO:tasks.workunit.client.1.smithi190.stdout:4/419: chown d3/d10/f7b 492 1 2023-12-06T15:00:26.189 INFO:tasks.workunit.client.0.smithi152.stdout:9/288: dread d0/dd/f25 [0,4194304] 0 2023-12-06T15:00:26.189 INFO:tasks.workunit.client.1.smithi190.stdout:7/534: dread d0/f6 [0,4194304] 0 2023-12-06T15:00:26.189 INFO:tasks.workunit.client.1.smithi190.stdout:2/458: dread d10/d59/d5e/f13 [0,4194304] 0 2023-12-06T15:00:26.192 INFO:tasks.workunit.client.1.smithi190.stdout:7/535: getdents d0/d5/da/d56 0 2023-12-06T15:00:26.194 INFO:tasks.workunit.client.1.smithi190.stdout:8/463: dwrite d1/f7 [4194304,4194304] 0 2023-12-06T15:00:26.195 INFO:tasks.workunit.client.1.smithi190.stdout:9/483: dwrite d4/d27/d2f/d31/f4b [0,4194304] 0 2023-12-06T15:00:26.195 INFO:tasks.workunit.client.1.smithi190.stdout:5/383: sync 2023-12-06T15:00:26.196 INFO:tasks.workunit.client.0.smithi152.stdout:5/277: dwrite d7/dd/f1c [0,4194304] 0 2023-12-06T15:00:26.204 INFO:tasks.workunit.client.1.smithi190.stdout:9/484: creat d4/d27/d2f/d31/d3f/d58/fa3 x:0 0 0 2023-12-06T15:00:26.204 INFO:tasks.workunit.client.1.smithi190.stdout:1/706: dwrite d6/f90 [0,4194304] 0 2023-12-06T15:00:26.204 INFO:tasks.workunit.client.1.smithi190.stdout:1/707: rename d6/dc/d29/d38/d43/d7f/da7/fab to d6/d49/d74/fe3 0 2023-12-06T15:00:26.204 INFO:tasks.workunit.client.0.smithi152.stdout:2/236: write d6/db/f39 [2527073,1944] 0 2023-12-06T15:00:26.205 INFO:tasks.workunit.client.0.smithi152.stdout:9/289: write d0/dd/f3e [50694,73733] 0 2023-12-06T15:00:26.209 INFO:tasks.workunit.client.1.smithi190.stdout:5/384: write d0/df/f17 [7115618,108758] 0 2023-12-06T15:00:26.210 INFO:tasks.workunit.client.1.smithi190.stdout:5/385: chown d0/d1c/c66 1172 1 2023-12-06T15:00:26.211 INFO:tasks.workunit.client.1.smithi190.stdout:5/386: rmdir d0/df 39 2023-12-06T15:00:26.212 INFO:tasks.workunit.client.0.smithi152.stdout:0/275: truncate d8/fd 3745043 0 2023-12-06T15:00:26.212 INFO:tasks.workunit.client.0.smithi152.stdout:0/276: dread - d8/d4b/f51 zero size 2023-12-06T15:00:26.217 INFO:tasks.workunit.client.0.smithi152.stdout:5/278: link d7/c9 d7/d47/c5b 0 2023-12-06T15:00:26.218 INFO:tasks.workunit.client.0.smithi152.stdout:2/237: symlink d6/d18/d43/l45 0 2023-12-06T15:00:26.218 INFO:tasks.workunit.client.1.smithi190.stdout:0/461: dwrite d0/f11 [0,4194304] 0 2023-12-06T15:00:26.218 INFO:tasks.workunit.client.1.smithi190.stdout:0/462: chown d0/da/d3e/d3a/d40/d81/d8d/c8f 3301 1 2023-12-06T15:00:26.221 INFO:tasks.workunit.client.1.smithi190.stdout:0/463: unlink d0/da/d3e/d2b/l85 0 2023-12-06T15:00:26.222 INFO:tasks.workunit.client.1.smithi190.stdout:0/464: symlink d0/da/d5a/l97 0 2023-12-06T15:00:26.223 INFO:tasks.workunit.client.0.smithi152.stdout:0/277: symlink d8/d3e/l55 0 2023-12-06T15:00:26.224 INFO:tasks.workunit.client.0.smithi152.stdout:5/279: creat d7/dd/d4e/f5c x:0 0 0 2023-12-06T15:00:26.225 INFO:tasks.workunit.client.0.smithi152.stdout:2/238: creat d6/db/d17/f46 x:0 0 0 2023-12-06T15:00:26.225 INFO:tasks.workunit.client.0.smithi152.stdout:2/239: write d6/d1e/f2f [1029174,114166] 0 2023-12-06T15:00:26.225 INFO:tasks.workunit.client.0.smithi152.stdout:2/240: dread - d6/d18/f36 zero size 2023-12-06T15:00:26.226 INFO:tasks.workunit.client.0.smithi152.stdout:2/241: truncate d6/d1e/f2e 838007 0 2023-12-06T15:00:26.226 INFO:tasks.workunit.client.0.smithi152.stdout:2/242: write d6/d18/f3d [763919,97475] 0 2023-12-06T15:00:26.226 INFO:tasks.workunit.client.0.smithi152.stdout:5/280: truncate d7/dd/f2c 2672623 0 2023-12-06T15:00:26.228 INFO:tasks.workunit.client.0.smithi152.stdout:2/243: link d6/db/f2b d6/db/f47 0 2023-12-06T15:00:26.229 INFO:tasks.workunit.client.0.smithi152.stdout:2/244: write d6/d18/f32 [603089,56451] 0 2023-12-06T15:00:26.232 INFO:tasks.workunit.client.0.smithi152.stdout:5/281: rename d7/dd/d26/d48/l52 to d7/dd/l5d 0 2023-12-06T15:00:26.232 INFO:tasks.workunit.client.0.smithi152.stdout:5/282: chown d7/dd/c30 1376 1 2023-12-06T15:00:26.237 INFO:tasks.workunit.client.0.smithi152.stdout:8/150: dwrite d1/d6/d7/f1e [0,4194304] 0 2023-12-06T15:00:26.238 INFO:tasks.workunit.client.1.smithi190.stdout:2/459: dwrite d10/f2d [4194304,4194304] 0 2023-12-06T15:00:26.239 INFO:tasks.workunit.client.1.smithi190.stdout:2/460: readlink d10/d59/d5e/l9e 0 2023-12-06T15:00:26.239 INFO:tasks.workunit.client.1.smithi190.stdout:2/461: chown d10/d26/d5c/d49/d54/f8b 1127 1 2023-12-06T15:00:26.239 INFO:tasks.workunit.client.1.smithi190.stdout:5/387: dread d0/d1c/d2b/d2c/f49 [0,4194304] 0 2023-12-06T15:00:26.239 INFO:tasks.workunit.client.0.smithi152.stdout:8/151: read d1/d6/db/f17 [2721267,127637] 0 2023-12-06T15:00:26.241 INFO:tasks.workunit.client.0.smithi152.stdout:8/152: mkdir d1/d6/d29 0 2023-12-06T15:00:26.241 INFO:tasks.workunit.client.1.smithi190.stdout:2/462: symlink d10/d26/d5c/d35/l9f 0 2023-12-06T15:00:26.241 INFO:tasks.workunit.client.1.smithi190.stdout:2/463: read d10/f1f [544414,5034] 0 2023-12-06T15:00:26.242 INFO:tasks.workunit.client.1.smithi190.stdout:5/388: link d0/d1c/d3e/l52 d0/l7a 0 2023-12-06T15:00:26.242 INFO:tasks.workunit.client.1.smithi190.stdout:5/389: mkdir d0/d1c/d2b/d69/d7b 0 2023-12-06T15:00:26.244 INFO:tasks.workunit.client.1.smithi190.stdout:2/464: read d10/d26/d5c/f63 [2556700,127597] 0 2023-12-06T15:00:26.252 INFO:tasks.workunit.client.1.smithi190.stdout:5/390: read d0/d1c/d2b/d2c/d5d/d73/f13 [351298,110930] 0 2023-12-06T15:00:26.259 INFO:tasks.workunit.client.0.smithi152.stdout:6/453: dwrite d1/d1c/d79/f48 [0,4194304] 0 2023-12-06T15:00:26.259 INFO:tasks.workunit.client.0.smithi152.stdout:3/328: dwrite f2 [8388608,4194304] 0 2023-12-06T15:00:26.261 INFO:tasks.workunit.client.1.smithi190.stdout:4/420: truncate d3/d35/d19/d41/d44/f4c 439833 0 2023-12-06T15:00:26.261 INFO:tasks.workunit.client.0.smithi152.stdout:8/153: dread d1/d6/d7/f1a [0,4194304] 0 2023-12-06T15:00:26.261 INFO:tasks.workunit.client.0.smithi152.stdout:8/154: fdatasync d1/d6/db/f11 0 2023-12-06T15:00:26.262 INFO:tasks.workunit.client.0.smithi152.stdout:8/155: dread - d1/d6/db/f26 zero size 2023-12-06T15:00:26.263 INFO:tasks.workunit.client.1.smithi190.stdout:7/536: dwrite d0/d88/d32/f59 [0,4194304] 0 2023-12-06T15:00:26.263 INFO:tasks.workunit.client.1.smithi190.stdout:1/708: dwrite d6/d49/f68 [0,4194304] 0 2023-12-06T15:00:26.263 INFO:tasks.workunit.client.1.smithi190.stdout:8/464: dwrite d1/d20/d3b/d36/d50/f6d [0,4194304] 0 2023-12-06T15:00:26.263 INFO:tasks.workunit.client.1.smithi190.stdout:8/465: chown d1/d20/d3b/d4c/d5a 31492 1 2023-12-06T15:00:26.264 INFO:tasks.workunit.client.0.smithi152.stdout:5/283: dwrite d7/dd/d26/d3b/f5a [0,4194304] 0 2023-12-06T15:00:26.264 INFO:tasks.workunit.client.0.smithi152.stdout:0/278: dwrite d8/d1b/f36 [0,4194304] 0 2023-12-06T15:00:26.264 INFO:tasks.workunit.client.0.smithi152.stdout:0/279: fdatasync d8/d1b/f39 0 2023-12-06T15:00:26.264 INFO:tasks.workunit.client.0.smithi152.stdout:0/280: fdatasync d8/d38/f53 0 2023-12-06T15:00:26.264 INFO:tasks.workunit.client.0.smithi152.stdout:0/281: chown d8/d1b/c3d 0 1 2023-12-06T15:00:26.264 INFO:tasks.workunit.client.0.smithi152.stdout:6/454: creat d1/fa3 x:0 0 0 2023-12-06T15:00:26.264 INFO:tasks.workunit.client.1.smithi190.stdout:4/421: read d3/d10/d15/f20 [684051,78745] 0 2023-12-06T15:00:26.265 INFO:tasks.workunit.client.1.smithi190.stdout:9/485: rmdir d4/d27/d2f 39 2023-12-06T15:00:26.271 INFO:tasks.workunit.client.1.smithi190.stdout:1/709: creat d6/dc/d29/d38/d43/db7/fe4 x:0 0 0 2023-12-06T15:00:26.274 INFO:tasks.workunit.client.1.smithi190.stdout:8/466: truncate d1/d20/d3b/f18 750204 0 2023-12-06T15:00:26.276 INFO:tasks.workunit.client.1.smithi190.stdout:1/710: creat d6/dc/d29/d38/d43/db7/fe5 x:0 0 0 2023-12-06T15:00:26.280 INFO:tasks.workunit.client.0.smithi152.stdout:8/156: rmdir d1/d6/db 39 2023-12-06T15:00:26.281 INFO:tasks.workunit.client.1.smithi190.stdout:1/711: rename d6/d49/fc1 to d6/dc/d29/d38/d73/d5c/db5/fe6 0 2023-12-06T15:00:26.284 INFO:tasks.workunit.client.1.smithi190.stdout:0/465: dwrite d0/da/d3e/d2b/d37/f76 [0,4194304] 0 2023-12-06T15:00:26.284 INFO:tasks.workunit.client.1.smithi190.stdout:0/466: fdatasync d0/da/d3e/d3a/d40/d6f/f93 0 2023-12-06T15:00:26.286 INFO:tasks.workunit.client.0.smithi152.stdout:5/284: symlink d7/d43/l5e 0 2023-12-06T15:00:26.286 INFO:tasks.workunit.client.0.smithi152.stdout:5/285: dread - d7/f18 zero size 2023-12-06T15:00:26.290 INFO:tasks.workunit.client.1.smithi190.stdout:9/486: dread d4/d27/d8a/f94 [0,4194304] 0 2023-12-06T15:00:26.290 INFO:tasks.workunit.client.0.smithi152.stdout:0/282: symlink d8/l56 0 2023-12-06T15:00:26.291 INFO:tasks.workunit.client.0.smithi152.stdout:6/455: mkdir d1/d1c/d79/d1a/d30/da4 0 2023-12-06T15:00:26.292 INFO:tasks.workunit.client.1.smithi190.stdout:9/487: creat d4/d27/d2f/d5c/fa4 x:0 0 0 2023-12-06T15:00:26.293 INFO:tasks.workunit.client.0.smithi152.stdout:8/157: mknod d1/d6/c2a 0 2023-12-06T15:00:26.293 INFO:tasks.workunit.client.1.smithi190.stdout:0/467: dread d0/da/d5a/f95 [0,4194304] 0 2023-12-06T15:00:26.294 INFO:tasks.workunit.client.0.smithi152.stdout:5/286: creat d7/dd/f5f x:0 0 0 2023-12-06T15:00:26.296 INFO:tasks.workunit.client.0.smithi152.stdout:0/283: dread d8/d15/f2e [0,4194304] 0 2023-12-06T15:00:26.296 INFO:tasks.workunit.client.0.smithi152.stdout:8/158: chown d1/d6/d7/l16 82 1 2023-12-06T15:00:26.296 INFO:tasks.workunit.client.0.smithi152.stdout:5/287: link d7/d43/l50 d7/dd/d26/d48/l60 0 2023-12-06T15:00:26.297 INFO:tasks.workunit.client.1.smithi190.stdout:1/712: write d6/dc/d29/d38/d73/f91 [498167,110605] 0 2023-12-06T15:00:26.297 INFO:tasks.workunit.client.0.smithi152.stdout:0/284: getdents d8/d1b 0 2023-12-06T15:00:26.299 INFO:tasks.workunit.client.0.smithi152.stdout:8/159: read d1/d6/db/f17 [673764,40417] 0 2023-12-06T15:00:26.299 INFO:tasks.workunit.client.0.smithi152.stdout:8/160: chown d1/d6/l27 5184 1 2023-12-06T15:00:26.299 INFO:tasks.workunit.client.0.smithi152.stdout:8/161: chown d1/f1c 61953 1 2023-12-06T15:00:26.299 INFO:tasks.workunit.client.1.smithi190.stdout:1/713: truncate d6/dc/d29/d38/d39/f3f 593818 0 2023-12-06T15:00:26.301 INFO:tasks.workunit.client.1.smithi190.stdout:1/714: symlink d6/dc/d29/d38/d43/db7/de2/le7 0 2023-12-06T15:00:26.301 INFO:tasks.workunit.client.1.smithi190.stdout:1/715: chown d6/dc/d29/d38/d73/d76/d7e/fc4 452434 1 2023-12-06T15:00:26.301 INFO:tasks.workunit.client.0.smithi152.stdout:8/162: dread d1/d6/ff [0,4194304] 0 2023-12-06T15:00:26.303 INFO:tasks.workunit.client.0.smithi152.stdout:5/288: rename d7/dd/d26/c2f to d7/d47/c61 0 2023-12-06T15:00:26.303 INFO:tasks.workunit.client.0.smithi152.stdout:0/285: creat d8/d3e/f57 x:0 0 0 2023-12-06T15:00:26.303 INFO:tasks.workunit.client.0.smithi152.stdout:0/286: read - d8/d15/f50 zero size 2023-12-06T15:00:26.303 INFO:tasks.workunit.client.1.smithi190.stdout:1/716: mkdir d6/dc/d29/d38/d39/d63/de8 0 2023-12-06T15:00:26.305 INFO:tasks.workunit.client.0.smithi152.stdout:3/329: dwrite d9/d18/f3c [0,4194304] 0 2023-12-06T15:00:26.306 INFO:tasks.workunit.client.0.smithi152.stdout:3/330: chown d9/d10/d32/l3f 0 1 2023-12-06T15:00:26.306 INFO:tasks.workunit.client.0.smithi152.stdout:5/289: symlink d7/dd/d4e/l62 0 2023-12-06T15:00:26.306 INFO:tasks.workunit.client.0.smithi152.stdout:0/287: creat d8/d3e/f58 x:0 0 0 2023-12-06T15:00:26.309 INFO:tasks.workunit.client.0.smithi152.stdout:0/288: creat d8/d38/f59 x:0 0 0 2023-12-06T15:00:26.312 INFO:tasks.workunit.client.0.smithi152.stdout:0/289: creat d8/d44/f5a x:0 0 0 2023-12-06T15:00:26.313 INFO:tasks.workunit.client.0.smithi152.stdout:0/290: creat d8/d1b/f5b x:0 0 0 2023-12-06T15:00:26.313 INFO:tasks.workunit.client.0.smithi152.stdout:0/291: chown d8/c11 698 1 2023-12-06T15:00:26.313 INFO:tasks.workunit.client.0.smithi152.stdout:0/292: write d8/d3e/f57 [932569,100506] 0 2023-12-06T15:00:26.314 INFO:tasks.workunit.client.1.smithi190.stdout:9/488: dread d4/d27/d2f/d31/f50 [0,4194304] 0 2023-12-06T15:00:26.314 INFO:tasks.workunit.client.1.smithi190.stdout:9/489: write d4/d27/d2f/d31/d3f/d58/d7d/f9f [894010,6687] 0 2023-12-06T15:00:26.315 INFO:tasks.workunit.client.1.smithi190.stdout:4/422: dwrite d3/d10/d39/f48 [0,4194304] 0 2023-12-06T15:00:26.315 INFO:tasks.workunit.client.1.smithi190.stdout:6/628: sync 2023-12-06T15:00:26.327 INFO:tasks.workunit.client.1.smithi190.stdout:9/490: symlink d4/d27/d2f/d31/la5 0 2023-12-06T15:00:26.333 INFO:tasks.workunit.client.1.smithi190.stdout:6/629: dread d4/d12/f53 [0,4194304] 0 2023-12-06T15:00:26.334 INFO:tasks.workunit.client.1.smithi190.stdout:7/537: dwrite d0/d88/d33/d4c/f75 [0,4194304] 0 2023-12-06T15:00:26.334 INFO:tasks.workunit.client.1.smithi190.stdout:7/538: mkdir d0/df/d53/d99/da9 0 2023-12-06T15:00:26.335 INFO:tasks.workunit.client.1.smithi190.stdout:7/539: mknod d0/df/d1f/caa 0 2023-12-06T15:00:26.336 INFO:tasks.workunit.client.1.smithi190.stdout:7/540: write d0/d88/d7a/f5e [325426,22510] 0 2023-12-06T15:00:26.338 INFO:tasks.workunit.client.1.smithi190.stdout:7/541: mkdir d0/d88/d7a/d7c/dab 0 2023-12-06T15:00:26.339 INFO:tasks.workunit.client.1.smithi190.stdout:8/467: dwrite d1/d20/d3b/d34/f40 [4194304,4194304] 0 2023-12-06T15:00:26.340 INFO:tasks.workunit.client.0.smithi152.stdout:6/456: dwrite d1/d1c/d79/d1a/d30/d36/f64 [0,4194304] 0 2023-12-06T15:00:26.340 INFO:tasks.workunit.client.1.smithi190.stdout:8/468: read d1/f1e [112267,13036] 0 2023-12-06T15:00:26.340 INFO:tasks.workunit.client.1.smithi190.stdout:9/491: dread d4/d27/d2f/d31/d3f/f91 [0,4194304] 0 2023-12-06T15:00:26.341 INFO:tasks.workunit.client.0.smithi152.stdout:6/457: symlink d1/d1c/d79/d1a/d30/da4/la5 0 2023-12-06T15:00:26.342 INFO:tasks.workunit.client.1.smithi190.stdout:6/630: dread d4/d12/d1a/d8a/fa0 [0,4194304] 0 2023-12-06T15:00:26.342 INFO:tasks.workunit.client.1.smithi190.stdout:9/492: mkdir d4/d27/d2f/d31/da6 0 2023-12-06T15:00:26.343 INFO:tasks.workunit.client.1.smithi190.stdout:9/493: creat d4/d27/d2f/d31/d3f/d58/d72/fa7 x:0 0 0 2023-12-06T15:00:26.344 INFO:tasks.workunit.client.1.smithi190.stdout:9/494: symlink d4/d27/d2f/d31/d3f/d58/d7d/la8 0 2023-12-06T15:00:26.344 INFO:tasks.workunit.client.1.smithi190.stdout:9/495: write d4/d27/d2f/d31/d3f/d58/d72/d7a/f9c [228394,130037] 0 2023-12-06T15:00:26.344 INFO:tasks.workunit.client.1.smithi190.stdout:9/496: write d4/d27/f53 [1405543,102789] 0 2023-12-06T15:00:26.345 INFO:tasks.workunit.client.0.smithi152.stdout:6/458: write d1/d69/da1/d87/fb [5392026,16784] 0 2023-12-06T15:00:26.345 INFO:tasks.workunit.client.0.smithi152.stdout:6/459: stat d1/d69/da1/d87/f14 0 2023-12-06T15:00:26.346 INFO:tasks.workunit.client.1.smithi190.stdout:9/497: rename d4/d27/d2f/d31/l79 to d4/d27/d8a/la9 0 2023-12-06T15:00:26.346 INFO:tasks.workunit.client.0.smithi152.stdout:6/460: mkdir d1/d1c/d79/d1a/d30/d36/d35/d49/da6 0 2023-12-06T15:00:26.347 INFO:tasks.workunit.client.1.smithi190.stdout:9/498: symlink d4/d27/d2f/laa 0 2023-12-06T15:00:26.347 INFO:tasks.workunit.client.0.smithi152.stdout:6/461: symlink d1/d1c/d79/d1a/d30/d36/d35/d49/d50/la7 0 2023-12-06T15:00:26.347 INFO:tasks.workunit.client.0.smithi152.stdout:6/462: chown d1/d1c/d79/l3f 6 1 2023-12-06T15:00:26.348 INFO:tasks.workunit.client.1.smithi190.stdout:9/499: mknod d4/d27/d2f/d31/cab 0 2023-12-06T15:00:26.349 INFO:tasks.workunit.client.0.smithi152.stdout:6/463: symlink d1/d69/da1/d87/la8 0 2023-12-06T15:00:26.349 INFO:tasks.workunit.client.0.smithi152.stdout:6/464: readlink d1/d69/da1/d87/d15/l96 0 2023-12-06T15:00:26.350 INFO:tasks.workunit.client.0.smithi152.stdout:6/465: rmdir d1/d89 39 2023-12-06T15:00:26.352 INFO:tasks.workunit.client.1.smithi190.stdout:8/469: dread d1/d20/d3b/d36/f3e [0,4194304] 0 2023-12-06T15:00:26.354 INFO:tasks.workunit.client.1.smithi190.stdout:8/470: rename d1/f1e to d1/d20/f8b 0 2023-12-06T15:00:26.355 INFO:tasks.workunit.client.1.smithi190.stdout:8/471: rmdir d1/d20/d3b/d4c/d5a 39 2023-12-06T15:00:26.355 INFO:tasks.workunit.client.1.smithi190.stdout:8/472: dread - d1/d10/d1c/f4f zero size 2023-12-06T15:00:26.355 INFO:tasks.workunit.client.1.smithi190.stdout:8/473: getdents d1/d20/d3b/d4d/d8a 0 2023-12-06T15:00:26.356 INFO:tasks.workunit.client.1.smithi190.stdout:8/474: symlink d1/d20/d3b/d7e/l8c 0 2023-12-06T15:00:26.356 INFO:tasks.workunit.client.1.smithi190.stdout:8/475: readlink d1/d20/d3b/d36/l58 0 2023-12-06T15:00:26.356 INFO:tasks.workunit.client.1.smithi190.stdout:8/476: fsync d1/d10/d1c/f77 0 2023-12-06T15:00:26.358 INFO:tasks.workunit.client.1.smithi190.stdout:4/423: dwrite d3/f12 [0,4194304] 0 2023-12-06T15:00:26.358 INFO:tasks.workunit.client.0.smithi152.stdout:5/290: dwrite d7/dd/ff [0,4194304] 0 2023-12-06T15:00:26.358 INFO:tasks.workunit.client.0.smithi152.stdout:8/163: dwrite d1/d6/d7/f1e [0,4194304] 0 2023-12-06T15:00:26.359 INFO:tasks.workunit.client.1.smithi190.stdout:0/468: dwrite d0/da/d3e/d3a/d40/d81/f89 [0,4194304] 0 2023-12-06T15:00:26.359 INFO:tasks.workunit.client.1.smithi190.stdout:1/717: dwrite d6/dc/d29/d38/d43/db7/fe4 [0,4194304] 0 2023-12-06T15:00:26.359 INFO:tasks.workunit.client.1.smithi190.stdout:1/718: chown d6/dc/f2e 226392877 1 2023-12-06T15:00:26.360 INFO:tasks.workunit.client.0.smithi152.stdout:0/293: dwrite d8/f17 [0,4194304] 0 2023-12-06T15:00:26.364 INFO:tasks.workunit.client.0.smithi152.stdout:6/466: dread d1/d1c/d79/d1a/d30/d36/f24 [0,4194304] 0 2023-12-06T15:00:26.365 INFO:tasks.workunit.client.0.smithi152.stdout:4/485: sync 2023-12-06T15:00:26.365 INFO:tasks.workunit.client.0.smithi152.stdout:1/502: sync 2023-12-06T15:00:26.365 INFO:tasks.workunit.client.1.smithi190.stdout:1/719: write d6/f6c [5342302,54569] 0 2023-12-06T15:00:26.365 INFO:tasks.workunit.client.1.smithi190.stdout:9/500: getdents d4/d27/d2f/d31/d3f/d58/d7d 0 2023-12-06T15:00:26.367 INFO:tasks.workunit.client.0.smithi152.stdout:8/164: creat d1/d6/db/f2b x:0 0 0 2023-12-06T15:00:26.367 INFO:tasks.workunit.client.0.smithi152.stdout:8/165: chown d1/d6/d7/fa 94 1 2023-12-06T15:00:26.367 INFO:tasks.workunit.client.0.smithi152.stdout:8/166: write d1/f10 [2496480,50284] 0 2023-12-06T15:00:26.367 INFO:tasks.workunit.client.0.smithi152.stdout:8/167: stat d1/d6/l27 0 2023-12-06T15:00:26.369 INFO:tasks.workunit.client.0.smithi152.stdout:8/168: write d1/d6/f22 [366748,85201] 0 2023-12-06T15:00:26.373 INFO:tasks.workunit.client.1.smithi190.stdout:1/720: link d6/dc/d3b/d78/d94/f96 d6/dc/d3b/d78/d94/fe9 0 2023-12-06T15:00:26.373 INFO:tasks.workunit.client.1.smithi190.stdout:7/542: dread d0/d88/d7a/f5e [0,4194304] 0 2023-12-06T15:00:26.374 INFO:tasks.workunit.client.0.smithi152.stdout:0/294: symlink d8/d4b/l5c 0 2023-12-06T15:00:26.374 INFO:tasks.workunit.client.1.smithi190.stdout:0/469: dread d0/f2e [0,4194304] 0 2023-12-06T15:00:26.374 INFO:tasks.workunit.client.0.smithi152.stdout:5/291: getdents d7/dd 0 2023-12-06T15:00:26.375 INFO:tasks.workunit.client.0.smithi152.stdout:0/295: write d8/d38/f59 [506557,100592] 0 2023-12-06T15:00:26.376 INFO:tasks.workunit.client.1.smithi190.stdout:7/543: mkdir d0/d88/d41/dac 0 2023-12-06T15:00:26.377 INFO:tasks.workunit.client.0.smithi152.stdout:8/169: rename d1/d6/db/l12 to d1/d6/db/l2c 0 2023-12-06T15:00:26.377 INFO:tasks.workunit.client.0.smithi152.stdout:6/467: mkdir d1/d1c/d79/d1a/d30/d36/d35/d49/da6/da9 0 2023-12-06T15:00:26.378 INFO:tasks.workunit.client.1.smithi190.stdout:0/470: mknod d0/da/d3e/d3a/c98 0 2023-12-06T15:00:26.378 INFO:tasks.workunit.client.0.smithi152.stdout:8/170: read d1/d6/db/f14 [293516,112400] 0 2023-12-06T15:00:26.378 INFO:tasks.workunit.client.0.smithi152.stdout:8/171: fdatasync d1/d6/db/f14 0 2023-12-06T15:00:26.379 INFO:tasks.workunit.client.1.smithi190.stdout:7/544: creat d0/df/d53/d15/fad x:0 0 0 2023-12-06T15:00:26.379 INFO:tasks.workunit.client.1.smithi190.stdout:7/545: chown d0/d88/d1c/d17/f64 631 1 2023-12-06T15:00:26.379 INFO:tasks.workunit.client.0.smithi152.stdout:6/468: dread d1/d1c/d79/d1a/f4a [0,4194304] 0 2023-12-06T15:00:26.380 INFO:tasks.workunit.client.0.smithi152.stdout:0/296: mknod d8/d44/c5d 0 2023-12-06T15:00:26.381 INFO:tasks.workunit.client.0.smithi152.stdout:6/469: mkdir d1/d1c/d79/d1a/d30/daa 0 2023-12-06T15:00:26.383 INFO:tasks.workunit.client.0.smithi152.stdout:5/292: dread d7/fc [0,4194304] 0 2023-12-06T15:00:26.383 INFO:tasks.workunit.client.0.smithi152.stdout:6/470: symlink d1/d1c/d79/d1a/d30/d18/d3b/lab 0 2023-12-06T15:00:26.383 INFO:tasks.workunit.client.0.smithi152.stdout:6/471: dread - d1/d1c/d79/d6d/f7f zero size 2023-12-06T15:00:26.384 INFO:tasks.workunit.client.1.smithi190.stdout:7/546: creat d0/d5/fae x:0 0 0 2023-12-06T15:00:26.389 INFO:tasks.workunit.client.1.smithi190.stdout:7/547: rename d0/f34 to d0/d88/d41/d92/faf 0 2023-12-06T15:00:26.393 INFO:tasks.workunit.client.1.smithi190.stdout:8/477: dwrite d1/d20/d3b/d36/f7a [0,4194304] 0 2023-12-06T15:00:26.393 INFO:tasks.workunit.client.1.smithi190.stdout:7/548: unlink d0/d5/da/l3d 0 2023-12-06T15:00:26.393 INFO:tasks.workunit.client.1.smithi190.stdout:7/549: write d0/df/d53/f72 [4406656,126192] 0 2023-12-06T15:00:26.393 INFO:tasks.workunit.client.1.smithi190.stdout:7/550: write d0/d5/da/f54 [816900,14092] 0 2023-12-06T15:00:26.394 INFO:tasks.workunit.client.0.smithi152.stdout:6/472: read d1/d1c/d79/d1a/d30/d36/d26/f2d [471358,12248] 0 2023-12-06T15:00:26.394 INFO:tasks.workunit.client.0.smithi152.stdout:7/220: sync 2023-12-06T15:00:26.394 INFO:tasks.workunit.client.0.smithi152.stdout:6/473: creat d1/d1c/d79/d1a/d30/d36/d35/d49/da6/da9/fac x:0 0 0 2023-12-06T15:00:26.396 INFO:tasks.workunit.client.0.smithi152.stdout:7/221: getdents dd 0 2023-12-06T15:00:26.396 INFO:tasks.workunit.client.1.smithi190.stdout:8/478: creat d1/d20/d3b/d4c/d59/d7d/f8d x:0 0 0 2023-12-06T15:00:26.397 INFO:tasks.workunit.client.0.smithi152.stdout:6/474: mkdir d1/d1c/d79/d1a/d30/d36/d56/dad 0 2023-12-06T15:00:26.397 INFO:tasks.workunit.client.1.smithi190.stdout:7/551: creat d0/d88/d7a/d7c/fb0 x:0 0 0 2023-12-06T15:00:26.398 INFO:tasks.workunit.client.1.smithi190.stdout:4/424: dwrite d3/f3f [4194304,4194304] 0 2023-12-06T15:00:26.398 INFO:tasks.workunit.client.1.smithi190.stdout:8/479: mkdir d1/d20/d3b/d4c/d8e 0 2023-12-06T15:00:26.399 INFO:tasks.workunit.client.0.smithi152.stdout:7/222: rename dd/df/d1b/d20/d28/d38/d29 to dd/df/d1b/d20/d28/d38/d42 0 2023-12-06T15:00:26.399 INFO:tasks.workunit.client.0.smithi152.stdout:7/223: truncate fa 1216444 0 2023-12-06T15:00:26.399 INFO:tasks.workunit.client.1.smithi190.stdout:7/552: truncate d0/d88/d1c/d17/f4a 1056836 0 2023-12-06T15:00:26.400 INFO:tasks.workunit.client.0.smithi152.stdout:6/475: creat d1/d1c/d79/d1a/d30/d36/d35/d49/d50/fae x:0 0 0 2023-12-06T15:00:26.401 INFO:tasks.workunit.client.1.smithi190.stdout:4/425: truncate d3/d10/d15/f2f 3616983 0 2023-12-06T15:00:26.402 INFO:tasks.workunit.client.1.smithi190.stdout:4/426: creat d3/d35/d19/d30/f86 x:0 0 0 2023-12-06T15:00:26.405 INFO:tasks.workunit.client.0.smithi152.stdout:7/224: write dd/df/f1f [161127,51454] 0 2023-12-06T15:00:26.405 INFO:tasks.workunit.client.1.smithi190.stdout:4/427: dread d3/d35/d19/d30/d3c/d4d/f55 [0,4194304] 0 2023-12-06T15:00:26.406 INFO:tasks.workunit.client.0.smithi152.stdout:7/225: getdents dd/df/d1b 0 2023-12-06T15:00:26.408 INFO:tasks.workunit.client.0.smithi152.stdout:7/226: rename dd/df/f1f to dd/df/f43 0 2023-12-06T15:00:26.411 INFO:tasks.workunit.client.1.smithi190.stdout:9/501: dwrite d4/f2d [0,4194304] 0 2023-12-06T15:00:26.411 INFO:tasks.workunit.client.0.smithi152.stdout:7/227: read f8 [4143761,26157] 0 2023-12-06T15:00:26.413 INFO:tasks.workunit.client.0.smithi152.stdout:0/297: dread d8/d38/f59 [0,4194304] 0 2023-12-06T15:00:26.414 INFO:tasks.workunit.client.1.smithi190.stdout:9/502: write d4/f13 [3849134,2402] 0 2023-12-06T15:00:26.415 INFO:tasks.workunit.client.1.smithi190.stdout:9/503: mknod d4/d27/d2f/cac 0 2023-12-06T15:00:26.415 INFO:tasks.workunit.client.0.smithi152.stdout:0/298: mknod d8/d44/c5e 0 2023-12-06T15:00:26.416 INFO:tasks.workunit.client.1.smithi190.stdout:9/504: creat d4/d27/d2f/d31/fad x:0 0 0 2023-12-06T15:00:26.417 INFO:tasks.workunit.client.1.smithi190.stdout:9/505: creat d4/d27/d8a/fae x:0 0 0 2023-12-06T15:00:26.419 INFO:tasks.workunit.client.1.smithi190.stdout:9/506: symlink d4/d27/d2f/d31/laf 0 2023-12-06T15:00:26.421 INFO:tasks.workunit.client.1.smithi190.stdout:9/507: link d4/d27/d2f/d31/d3f/f55 d4/d27/d2f/d31/d3f/fb0 0 2023-12-06T15:00:26.422 INFO:tasks.workunit.client.1.smithi190.stdout:9/508: fsync d4/d27/d2f/d5c/f9b 0 2023-12-06T15:00:26.422 INFO:tasks.workunit.client.1.smithi190.stdout:9/509: chown d4/d27/d2f/d31/d3f/c86 3 1 2023-12-06T15:00:26.422 INFO:tasks.workunit.client.1.smithi190.stdout:9/510: dread - d4/d27/d2f/d31/d3f/d58/d72/f76 zero size 2023-12-06T15:00:26.422 INFO:tasks.workunit.client.1.smithi190.stdout:9/511: truncate d4/fa 2920944 0 2023-12-06T15:00:26.424 INFO:tasks.workunit.client.0.smithi152.stdout:1/503: dwrite d3/da/d15/f57 [0,4194304] 0 2023-12-06T15:00:26.428 INFO:tasks.workunit.client.0.smithi152.stdout:1/504: creat d3/da/db/da0/fc0 x:0 0 0 2023-12-06T15:00:26.430 INFO:tasks.workunit.client.1.smithi190.stdout:1/721: dwrite d6/f21 [0,4194304] 0 2023-12-06T15:00:26.430 INFO:tasks.workunit.client.1.smithi190.stdout:1/722: dread - d6/dc/d29/d38/d43/db7/fe5 zero size 2023-12-06T15:00:26.433 INFO:tasks.workunit.client.1.smithi190.stdout:1/723: read d6/dc/d29/d38/d73/d5c/db5/fe6 [4925244,42903] 0 2023-12-06T15:00:26.433 INFO:tasks.workunit.client.1.smithi190.stdout:0/471: dwrite d0/f2e [0,4194304] 0 2023-12-06T15:00:26.433 INFO:tasks.workunit.client.1.smithi190.stdout:0/472: stat d0/da/d3e/d2b/d3c/l6b 0 2023-12-06T15:00:26.433 INFO:tasks.workunit.client.0.smithi152.stdout:5/293: dwrite d7/dd/f16 [0,4194304] 0 2023-12-06T15:00:26.434 INFO:tasks.workunit.client.0.smithi152.stdout:5/294: chown d7/dd/d26/d3b/c3f 15 1 2023-12-06T15:00:26.436 INFO:tasks.workunit.client.0.smithi152.stdout:5/295: creat d7/dd/d26/d3b/f63 x:0 0 0 2023-12-06T15:00:26.436 INFO:tasks.workunit.client.0.smithi152.stdout:5/296: write d7/dd/d26/d3b/f4d [336841,95401] 0 2023-12-06T15:00:26.436 INFO:tasks.workunit.client.0.smithi152.stdout:5/297: chown d7/d43/f4b 5883254 1 2023-12-06T15:00:26.437 INFO:tasks.workunit.client.0.smithi152.stdout:5/298: symlink d7/d47/l64 0 2023-12-06T15:00:26.438 INFO:tasks.workunit.client.1.smithi190.stdout:9/512: dread f2 [0,4194304] 0 2023-12-06T15:00:26.438 INFO:tasks.workunit.client.1.smithi190.stdout:9/513: readlink d4/d27/d2f/la0 0 2023-12-06T15:00:26.440 INFO:tasks.workunit.client.0.smithi152.stdout:5/299: getdents d7/dd/d4e 0 2023-12-06T15:00:26.440 INFO:tasks.workunit.client.0.smithi152.stdout:5/300: readlink d7/l58 0 2023-12-06T15:00:26.441 INFO:tasks.workunit.client.1.smithi190.stdout:9/514: creat d4/d27/d8a/fb1 x:0 0 0 2023-12-06T15:00:26.441 INFO:tasks.workunit.client.1.smithi190.stdout:9/515: chown d4/d27/d2f/l93 36823 1 2023-12-06T15:00:26.443 INFO:tasks.workunit.client.0.smithi152.stdout:5/301: creat d7/dd/d26/d3a/f65 x:0 0 0 2023-12-06T15:00:26.443 INFO:tasks.workunit.client.1.smithi190.stdout:0/473: write d0/da/d3e/d2b/d3c/f5f [3912,23545] 0 2023-12-06T15:00:26.448 INFO:tasks.workunit.client.0.smithi152.stdout:6/476: dwrite d1/d75/f7d [0,4194304] 0 2023-12-06T15:00:26.448 INFO:tasks.workunit.client.1.smithi190.stdout:7/553: dwrite d0/d88/d33/d4c/fa2 [0,4194304] 0 2023-12-06T15:00:26.449 INFO:tasks.workunit.client.1.smithi190.stdout:7/554: write d0/df/d53/f72 [4143833,43866] 0 2023-12-06T15:00:26.449 INFO:tasks.workunit.client.1.smithi190.stdout:7/555: chown d0/df/d5f/fa3 2277486 1 2023-12-06T15:00:26.450 INFO:tasks.workunit.client.0.smithi152.stdout:0/299: dwrite d8/f9 [8388608,4194304] 0 2023-12-06T15:00:26.451 INFO:tasks.workunit.client.1.smithi190.stdout:0/474: link d0/da/d3e/d3a/d40/d81/c62 d0/da/d3e/d2b/d3c/d46/d8e/c99 0 2023-12-06T15:00:26.454 INFO:tasks.workunit.client.0.smithi152.stdout:8/172: dwrite d1/f10 [0,4194304] 0 2023-12-06T15:00:26.455 INFO:tasks.workunit.client.0.smithi152.stdout:5/302: dread d7/dd/f2a [0,4194304] 0 2023-12-06T15:00:26.456 INFO:tasks.workunit.client.1.smithi190.stdout:1/724: dwrite d6/dc/d6f/fc7 [0,4194304] 0 2023-12-06T15:00:26.456 INFO:tasks.workunit.client.1.smithi190.stdout:7/556: mkdir d0/d88/d1c/d17/d94/d95/db1 0 2023-12-06T15:00:26.456 INFO:tasks.workunit.client.1.smithi190.stdout:0/475: symlink d0/l9a 0 2023-12-06T15:00:26.456 INFO:tasks.workunit.client.0.smithi152.stdout:6/477: getdents d1/d1c/d79/d1a/d30/d36/d35/d61 0 2023-12-06T15:00:26.459 INFO:tasks.workunit.client.1.smithi190.stdout:9/516: dread d4/f13 [0,4194304] 0 2023-12-06T15:00:26.459 INFO:tasks.workunit.client.1.smithi190.stdout:4/428: write d3/d35/d19/d41/d44/f70 [3506901,76006] 0 2023-12-06T15:00:26.463 INFO:tasks.workunit.client.0.smithi152.stdout:0/300: link d8/ff d8/d38/f5f 0 2023-12-06T15:00:26.463 INFO:tasks.workunit.client.0.smithi152.stdout:0/301: chown d8/d4b/l5c 2055956509 1 2023-12-06T15:00:26.463 INFO:tasks.workunit.client.0.smithi152.stdout:0/302: write d8/d15/f2e [1639309,5513] 0 2023-12-06T15:00:26.465 INFO:tasks.workunit.client.1.smithi190.stdout:7/557: rmdir d0/d88/d41/dac 0 2023-12-06T15:00:26.465 INFO:tasks.workunit.client.1.smithi190.stdout:0/476: symlink d0/da/d3e/d2b/d3c/d46/l9b 0 2023-12-06T15:00:26.465 INFO:tasks.workunit.client.1.smithi190.stdout:7/558: write d0/d5/da/d56/f85 [905883,86464] 0 2023-12-06T15:00:26.466 INFO:tasks.workunit.client.1.smithi190.stdout:4/429: rename d3/d35/d19/d41/d44/d5b/l69 to d3/d10/d39/d54/l87 0 2023-12-06T15:00:26.466 INFO:tasks.workunit.client.1.smithi190.stdout:4/430: read - d3/d10/d39/d54/f84 zero size 2023-12-06T15:00:26.469 INFO:tasks.workunit.client.0.smithi152.stdout:5/303: rename d7/dd/l37 to d7/dd/d4e/l66 0 2023-12-06T15:00:26.469 INFO:tasks.workunit.client.0.smithi152.stdout:6/478: mknod d1/d1c/d79/d1a/d30/d36/d35/d49/caf 0 2023-12-06T15:00:26.470 INFO:tasks.workunit.client.1.smithi190.stdout:7/559: symlink d0/d88/lb2 0 2023-12-06T15:00:26.472 INFO:tasks.workunit.client.0.smithi152.stdout:6/479: rmdir d1/d1c/d79/d1a/d30/d36/d56/dad 0 2023-12-06T15:00:26.473 INFO:tasks.workunit.client.1.smithi190.stdout:0/477: write d0/da/f44 [3372870,105159] 0 2023-12-06T15:00:26.474 INFO:tasks.workunit.client.0.smithi152.stdout:6/480: write d1/d1c/d79/d8a/f94 [3220253,121110] 0 2023-12-06T15:00:26.476 INFO:tasks.workunit.client.1.smithi190.stdout:7/560: rename d0/d88/d7a/fa8 to d0/d88/d41/fb3 0 2023-12-06T15:00:26.476 INFO:tasks.workunit.client.0.smithi152.stdout:6/481: symlink d1/d1c/d79/d6d/lb0 0 2023-12-06T15:00:26.481 INFO:tasks.workunit.client.0.smithi152.stdout:6/482: dread d1/d1c/d79/d1a/d30/d36/d26/f2d [0,4194304] 0 2023-12-06T15:00:26.482 INFO:tasks.workunit.client.0.smithi152.stdout:6/483: creat d1/d1c/d79/d4b/fb1 x:0 0 0 2023-12-06T15:00:26.482 INFO:tasks.workunit.client.0.smithi152.stdout:6/484: readlink d1/d69/da1/d87/l1e 0 2023-12-06T15:00:26.482 INFO:tasks.workunit.client.1.smithi190.stdout:0/478: link d0/da/d3e/d3a/d40/d81/c62 d0/da/d3e/d3a/d40/d6f/c9c 0 2023-12-06T15:00:26.482 INFO:tasks.workunit.client.1.smithi190.stdout:0/479: chown d0/l6 1722506 1 2023-12-06T15:00:26.483 INFO:tasks.workunit.client.1.smithi190.stdout:7/561: link d0/d5/da/f77 d0/d88/fb4 0 2023-12-06T15:00:26.483 INFO:tasks.workunit.client.0.smithi152.stdout:6/485: creat d1/d1c/d79/d1a/d30/d36/d4e/fb2 x:0 0 0 2023-12-06T15:00:26.485 INFO:tasks.workunit.client.0.smithi152.stdout:6/486: mknod d1/d1c/cb3 0 2023-12-06T15:00:26.485 INFO:tasks.workunit.client.1.smithi190.stdout:0/480: dread d0/da/f25 [0,4194304] 0 2023-12-06T15:00:26.487 INFO:tasks.workunit.client.1.smithi190.stdout:0/481: getdents d0/da/d5a 0 2023-12-06T15:00:26.487 INFO:tasks.workunit.client.1.smithi190.stdout:0/482: fdatasync d0/da/d3e/d2b/f69 0 2023-12-06T15:00:26.487 INFO:tasks.workunit.client.1.smithi190.stdout:0/483: dread - d0/da/d3e/d2b/d3c/d65/f7c zero size 2023-12-06T15:00:26.493 INFO:tasks.workunit.client.1.smithi190.stdout:0/484: write d0/da/d3e/d2b/d3c/d46/f73 [1541920,52839] 0 2023-12-06T15:00:26.499 INFO:tasks.workunit.client.1.smithi190.stdout:3/589: sync 2023-12-06T15:00:26.499 INFO:tasks.workunit.client.1.smithi190.stdout:3/590: stat d4/d70/d19/d3a/f7b 0 2023-12-06T15:00:26.499 INFO:tasks.workunit.client.1.smithi190.stdout:1/725: dwrite d6/d49/fe0 [0,4194304] 0 2023-12-06T15:00:26.501 INFO:tasks.workunit.client.1.smithi190.stdout:3/591: mkdir d4/d1b/d77/da8/db7/dd2 0 2023-12-06T15:00:26.502 INFO:tasks.workunit.client.1.smithi190.stdout:1/726: creat d6/dc/d29/fea x:0 0 0 2023-12-06T15:00:26.503 INFO:tasks.workunit.client.1.smithi190.stdout:1/727: stat d6/dc/d29/d38/d73/d76/fb3 0 2023-12-06T15:00:26.503 INFO:tasks.workunit.client.0.smithi152.stdout:5/304: dwrite d7/dd/d26/d3b/f5a [0,4194304] 0 2023-12-06T15:00:26.503 INFO:tasks.workunit.client.0.smithi152.stdout:8/173: dwrite d1/f10 [0,4194304] 0 2023-12-06T15:00:26.504 INFO:tasks.workunit.client.1.smithi190.stdout:9/517: dwrite d4/d27/d2f/d31/d3f/fb0 [0,4194304] 0 2023-12-06T15:00:26.504 INFO:tasks.workunit.client.1.smithi190.stdout:9/518: write d4/d27/f8c [1006351,82674] 0 2023-12-06T15:00:26.504 INFO:tasks.workunit.client.0.smithi152.stdout:8/174: write d1/d6/d7/f1a [402909,55753] 0 2023-12-06T15:00:26.504 INFO:tasks.workunit.client.0.smithi152.stdout:8/175: fdatasync d1/f1c 0 2023-12-06T15:00:26.505 INFO:tasks.workunit.client.0.smithi152.stdout:5/305: creat d7/dd/f67 x:0 0 0 2023-12-06T15:00:26.507 INFO:tasks.workunit.client.1.smithi190.stdout:4/431: dwrite d3/d35/d19/f5e [0,4194304] 0 2023-12-06T15:00:26.509 INFO:tasks.workunit.client.0.smithi152.stdout:6/487: truncate d1/d1c/d79/d8a/f94 3862202 0 2023-12-06T15:00:26.511 INFO:tasks.workunit.client.0.smithi152.stdout:5/306: symlink d7/dd/d26/d3b/l68 0 2023-12-06T15:00:26.513 INFO:tasks.workunit.client.0.smithi152.stdout:6/488: creat d1/d1c/d79/d1a/d30/d36/d35/d61/fb4 x:0 0 0 2023-12-06T15:00:26.514 INFO:tasks.workunit.client.0.smithi152.stdout:6/489: write d1/d1c/d79/d1a/d30/d36/d35/f47 [953616,32065] 0 2023-12-06T15:00:26.514 INFO:tasks.workunit.client.0.smithi152.stdout:6/490: write d1/d1c/d79/d1a/f4a [459056,118100] 0 2023-12-06T15:00:26.515 INFO:tasks.workunit.client.0.smithi152.stdout:6/491: write d1/d69/da1/d87/d15/f5c [580185,19065] 0 2023-12-06T15:00:26.515 INFO:tasks.workunit.client.0.smithi152.stdout:6/492: stat d1/d1c/d79/d8a 0 2023-12-06T15:00:26.515 INFO:tasks.workunit.client.0.smithi152.stdout:8/176: rename d1/d6/d7/f1e to d1/f2d 0 2023-12-06T15:00:26.515 INFO:tasks.workunit.client.0.smithi152.stdout:8/177: truncate d1/f1c 1308044 0 2023-12-06T15:00:26.516 INFO:tasks.workunit.client.1.smithi190.stdout:0/485: dwrite d0/da/d3e/d3a/d40/d6f/f93 [0,4194304] 0 2023-12-06T15:00:26.516 INFO:tasks.workunit.client.0.smithi152.stdout:5/307: symlink d7/dd/d26/d3a/l69 0 2023-12-06T15:00:26.516 INFO:tasks.workunit.client.0.smithi152.stdout:5/308: chown d7/dd/l5d 2 1 2023-12-06T15:00:26.516 INFO:tasks.workunit.client.0.smithi152.stdout:5/309: chown d7/dd/d26/d3a 3566608 1 2023-12-06T15:00:26.517 INFO:tasks.workunit.client.0.smithi152.stdout:5/310: chown d7/l57 2126 1 2023-12-06T15:00:26.518 INFO:tasks.workunit.client.0.smithi152.stdout:6/493: mknod d1/d1c/cb5 0 2023-12-06T15:00:26.519 INFO:tasks.workunit.client.0.smithi152.stdout:5/311: link d7/dd/d26/d3a/l69 d7/dd/d26/l6a 0 2023-12-06T15:00:26.521 INFO:tasks.workunit.client.0.smithi152.stdout:6/494: getdents d1/d1c/d79/d1a/d30/d18 0 2023-12-06T15:00:26.521 INFO:tasks.workunit.client.0.smithi152.stdout:6/495: write d1/d69/da1/d87/f8f [450744,87902] 0 2023-12-06T15:00:26.523 INFO:tasks.workunit.client.0.smithi152.stdout:5/312: creat d7/dd/d26/d3a/f6b x:0 0 0 2023-12-06T15:00:26.524 INFO:tasks.workunit.client.0.smithi152.stdout:6/496: mknod d1/d1c/d79/d4b/cb6 0 2023-12-06T15:00:26.525 INFO:tasks.workunit.client.0.smithi152.stdout:6/497: creat d1/d1c/d79/d1a/d30/d36/d35/d49/d57/fb7 x:0 0 0 2023-12-06T15:00:26.527 INFO:tasks.workunit.client.0.smithi152.stdout:6/498: mknod d1/d1c/d79/d1a/d30/d18/cb8 0 2023-12-06T15:00:26.527 INFO:tasks.workunit.client.0.smithi152.stdout:6/499: truncate d1/f2c 4997219 0 2023-12-06T15:00:26.528 INFO:tasks.workunit.client.0.smithi152.stdout:6/500: symlink d1/d1c/d79/d1a/d30/d36/d4e/lb9 0 2023-12-06T15:00:26.529 INFO:tasks.workunit.client.0.smithi152.stdout:8/178: dwrite d1/d6/db/f17 [0,4194304] 0 2023-12-06T15:00:26.529 INFO:tasks.workunit.client.0.smithi152.stdout:8/179: chown d1/l28 13 1 2023-12-06T15:00:26.529 INFO:tasks.workunit.client.0.smithi152.stdout:8/180: write d1/d6/db/f14 [142872,79428] 0 2023-12-06T15:00:26.532 INFO:tasks.workunit.client.0.smithi152.stdout:8/181: creat d1/d6/db/f2e x:0 0 0 2023-12-06T15:00:26.532 INFO:tasks.workunit.client.0.smithi152.stdout:8/182: chown d1/d6/db/f26 8323674 1 2023-12-06T15:00:26.536 INFO:tasks.workunit.client.0.smithi152.stdout:6/501: dread d1/d1c/d79/d1a/d30/d36/d35/f47 [0,4194304] 0 2023-12-06T15:00:26.537 INFO:tasks.workunit.client.0.smithi152.stdout:8/183: dread d1/f1c [0,4194304] 0 2023-12-06T15:00:26.537 INFO:tasks.workunit.client.0.smithi152.stdout:6/502: mknod d1/d1c/d79/d1a/d30/d36/d26/cba 0 2023-12-06T15:00:26.537 INFO:tasks.workunit.client.0.smithi152.stdout:6/503: readlink d1/d1c/d79/d1a/d30/d36/d35/d49/d57/l7b 0 2023-12-06T15:00:26.539 INFO:tasks.workunit.client.0.smithi152.stdout:6/504: unlink d1/d1c/d79/d1a/d30/d18/f2a 0 2023-12-06T15:00:26.540 INFO:tasks.workunit.client.0.smithi152.stdout:8/184: mknod d1/c2f 0 2023-12-06T15:00:26.540 INFO:tasks.workunit.client.0.smithi152.stdout:8/185: fsync d1/d6/db/f26 0 2023-12-06T15:00:26.540 INFO:tasks.workunit.client.0.smithi152.stdout:8/186: chown d1/f1c 3 1 2023-12-06T15:00:26.540 INFO:tasks.workunit.client.0.smithi152.stdout:6/505: mknod d1/d1c/d79/d1a/d30/da4/cbb 0 2023-12-06T15:00:26.540 INFO:tasks.workunit.client.0.smithi152.stdout:6/506: chown d1/d1c/d79/d1a/d30/d36/f24 297723 1 2023-12-06T15:00:26.541 INFO:tasks.workunit.client.0.smithi152.stdout:8/187: rename d1/f10 to d1/d6/f30 0 2023-12-06T15:00:26.542 INFO:tasks.workunit.client.0.smithi152.stdout:8/188: fsync d1/d6/db/f17 0 2023-12-06T15:00:26.543 INFO:tasks.workunit.client.0.smithi152.stdout:6/507: rename d1/d1c/d79/d1a/d30/c9d to d1/d69/da1/cbc 0 2023-12-06T15:00:26.543 INFO:tasks.workunit.client.0.smithi152.stdout:6/508: mknod d1/d1c/d79/d1a/d30/d36/d4e/d55/cbd 0 2023-12-06T15:00:26.545 INFO:tasks.workunit.client.0.smithi152.stdout:6/509: rename d1/d1c/d79/d1a/d30/d36/d35/d61/f9c to d1/fbe 0 2023-12-06T15:00:26.546 INFO:tasks.workunit.client.0.smithi152.stdout:6/510: mkdir d1/d1c/d79/d1a/d30/d36/d4e/d55/dbf 0 2023-12-06T15:00:26.546 INFO:tasks.workunit.client.0.smithi152.stdout:6/511: write d1/f7 [2438210,60924] 0 2023-12-06T15:00:26.548 INFO:tasks.workunit.client.0.smithi152.stdout:6/512: write d1/d75/f7d [1538828,125284] 0 2023-12-06T15:00:26.551 INFO:tasks.workunit.client.0.smithi152.stdout:6/513: creat d1/d1c/d79/d1a/d30/d36/d4e/d55/fc0 x:0 0 0 2023-12-06T15:00:26.551 INFO:tasks.workunit.client.0.smithi152.stdout:6/514: write d1/d69/da1/d87/d15/f8e [599150,92553] 0 2023-12-06T15:00:26.552 INFO:tasks.workunit.client.0.smithi152.stdout:6/515: rename d1/d1c/d79/d1a/d30/d36/d35/d61/fb4 to d1/d69/da1/d87/d15/fc1 0 2023-12-06T15:00:26.553 INFO:tasks.workunit.client.0.smithi152.stdout:6/516: creat d1/fc2 x:0 0 0 2023-12-06T15:00:26.554 INFO:tasks.workunit.client.0.smithi152.stdout:6/517: mknod d1/d1c/d79/d1a/d30/d36/d35/cc3 0 2023-12-06T15:00:26.554 INFO:tasks.workunit.client.0.smithi152.stdout:6/518: readlink d1/d1c/d79/d1a/d30/d36/d4e/l58 0 2023-12-06T15:00:26.555 INFO:tasks.workunit.client.0.smithi152.stdout:6/519: write d1/d69/da1/f9e [369344,110012] 0 2023-12-06T15:00:26.556 INFO:tasks.workunit.client.0.smithi152.stdout:6/520: unlink d1/d1c/d79/d1a/d30/d36/f4f 0 2023-12-06T15:00:26.556 INFO:tasks.workunit.client.0.smithi152.stdout:6/521: mknod d1/d1c/d79/d1a/d30/d36/d56/cc4 0 2023-12-06T15:00:26.557 INFO:tasks.workunit.client.1.smithi190.stdout:3/592: rename d4/d70/d19/d3a/fc1 to d4/d1b/d77/fd3 0 2023-12-06T15:00:26.557 INFO:tasks.workunit.client.1.smithi190.stdout:3/593: readlink d4/d1b/d54/d9c/d68/d8a/l93 0 2023-12-06T15:00:26.558 INFO:tasks.workunit.client.0.smithi152.stdout:6/522: mkdir d1/d1c/d79/d1a/d30/d18/dc5 0 2023-12-06T15:00:26.559 INFO:tasks.workunit.client.0.smithi152.stdout:6/523: stat d1/d1c/l60 0 2023-12-06T15:00:26.560 INFO:tasks.workunit.client.0.smithi152.stdout:6/524: creat d1/d1c/d79/d8a/fc6 x:0 0 0 2023-12-06T15:00:26.560 INFO:tasks.workunit.client.0.smithi152.stdout:6/525: chown d1/d69/da1/d87/f8f 16002639 1 2023-12-06T15:00:26.560 INFO:tasks.workunit.client.0.smithi152.stdout:6/526: write d1/d1c/d79/d1a/d30/d36/d4e/d55/f5d [897895,67830] 0 2023-12-06T15:00:26.561 INFO:tasks.workunit.client.0.smithi152.stdout:6/527: creat d1/d1c/d79/fc7 x:0 0 0 2023-12-06T15:00:26.561 INFO:tasks.workunit.client.0.smithi152.stdout:8/189: dwrite d1/d6/db/f26 [0,4194304] 0 2023-12-06T15:00:26.562 INFO:tasks.workunit.client.0.smithi152.stdout:6/528: mknod d1/d1c/d79/d8a/cc8 0 2023-12-06T15:00:26.569 INFO:tasks.workunit.client.0.smithi152.stdout:8/190: creat d1/d6/f31 x:0 0 0 2023-12-06T15:00:26.576 INFO:tasks.workunit.client.0.smithi152.stdout:8/191: rename d1/d6/db to d1/d6/d29/d32 0 2023-12-06T15:00:26.578 INFO:tasks.workunit.client.0.smithi152.stdout:8/192: creat d1/d6/d29/f33 x:0 0 0 2023-12-06T15:00:26.578 INFO:tasks.workunit.client.0.smithi152.stdout:8/193: write d1/d6/d29/d32/f2b [577893,71747] 0 2023-12-06T15:00:26.589 INFO:tasks.workunit.client.1.smithi190.stdout:1/728: mkdir d6/dc/d29/d38/d39/deb 0 2023-12-06T15:00:26.590 INFO:tasks.workunit.client.0.smithi152.stdout:8/194: dread d1/f2d [0,4194304] 0 2023-12-06T15:00:26.590 INFO:tasks.workunit.client.1.smithi190.stdout:1/729: write d6/f90 [4180274,128444] 0 2023-12-06T15:00:26.591 INFO:tasks.workunit.client.0.smithi152.stdout:8/195: rename d1/d6/d7 to d1/d6/d34 0 2023-12-06T15:00:26.593 INFO:tasks.workunit.client.0.smithi152.stdout:8/196: mkdir d1/d6/d34/d35 0 2023-12-06T15:00:26.597 INFO:tasks.workunit.client.0.smithi152.stdout:8/197: rename d1/d6/d29/d32 to d1/d6/d34/d36 0 2023-12-06T15:00:26.597 INFO:tasks.workunit.client.0.smithi152.stdout:8/198: creat d1/d6/f37 x:0 0 0 2023-12-06T15:00:26.597 INFO:tasks.workunit.client.0.smithi152.stdout:8/199: mkdir d1/d6/d34/d35/d38 0 2023-12-06T15:00:26.598 INFO:tasks.workunit.client.0.smithi152.stdout:8/200: link d1/d6/c2a d1/d6/d34/d35/d38/c39 0 2023-12-06T15:00:26.613 INFO:tasks.workunit.client.1.smithi190.stdout:7/562: getdents d0/d88/d41 0 2023-12-06T15:00:26.614 INFO:tasks.workunit.client.1.smithi190.stdout:7/563: dread - d0/df/d53/d2f/f8f zero size 2023-12-06T15:00:26.614 INFO:tasks.workunit.client.1.smithi190.stdout:4/432: truncate d3/f26 565671 0 2023-12-06T15:00:26.614 INFO:tasks.workunit.client.1.smithi190.stdout:4/433: chown d3/d35 2010009380 1 2023-12-06T15:00:26.614 INFO:tasks.workunit.client.0.smithi152.stdout:8/201: dread d1/d6/d34/d36/f17 [0,4194304] 0 2023-12-06T15:00:26.614 INFO:tasks.workunit.client.0.smithi152.stdout:8/202: chown d1/d6/l27 1132 1 2023-12-06T15:00:26.615 INFO:tasks.workunit.client.0.smithi152.stdout:8/203: mkdir d1/d6/d34/d3a 0 2023-12-06T15:00:26.615 INFO:tasks.workunit.client.0.smithi152.stdout:8/204: mkdir d1/d6/d29/d3b 0 2023-12-06T15:00:26.615 INFO:tasks.workunit.client.0.smithi152.stdout:8/205: chown d1/d6/d34/f1a 1 1 2023-12-06T15:00:26.615 INFO:tasks.workunit.client.0.smithi152.stdout:8/206: dread - d1/d6/f37 zero size 2023-12-06T15:00:26.615 INFO:tasks.workunit.client.0.smithi152.stdout:8/207: rename d1/f1c to d1/f3c 0 2023-12-06T15:00:26.615 INFO:tasks.workunit.client.0.smithi152.stdout:8/208: fsync d1/d6/f30 0 2023-12-06T15:00:26.615 INFO:tasks.workunit.client.0.smithi152.stdout:8/209: dread - d1/d6/f31 zero size 2023-12-06T15:00:26.628 INFO:tasks.workunit.client.1.smithi190.stdout:4/434: dread d3/f33 [4194304,4194304] 0 2023-12-06T15:00:26.628 INFO:tasks.workunit.client.1.smithi190.stdout:4/435: stat d3/d35/d19/d30/d3c/d4d/f55 0 2023-12-06T15:00:26.638 INFO:tasks.workunit.client.1.smithi190.stdout:7/564: link d0/d5/da/f49 d0/df/d5f/fb5 0 2023-12-06T15:00:26.638 INFO:tasks.workunit.client.1.smithi190.stdout:1/730: creat d6/dc/d29/d38/d73/d5c/dd2/fec x:0 0 0 2023-12-06T15:00:26.639 INFO:tasks.workunit.client.1.smithi190.stdout:7/565: dread d0/df/d53/d2f/f70 [0,4194304] 0 2023-12-06T15:00:26.639 INFO:tasks.workunit.client.1.smithi190.stdout:7/566: truncate d0/d5/da/f48 2708635 0 2023-12-06T15:00:26.646 INFO:tasks.workunit.client.1.smithi190.stdout:4/436: dwrite d3/d10/d15/f16 [0,4194304] 0 2023-12-06T15:00:26.646 INFO:tasks.workunit.client.0.smithi152.stdout:8/210: dwrite d1/d6/d34/f21 [0,4194304] 0 2023-12-06T15:00:26.646 INFO:tasks.workunit.client.0.smithi152.stdout:8/211: write d1/d6/d34/d36/f2e [777978,92679] 0 2023-12-06T15:00:26.647 INFO:tasks.workunit.client.0.smithi152.stdout:8/212: truncate d1/d6/f31 171843 0 2023-12-06T15:00:26.647 INFO:tasks.workunit.client.0.smithi152.stdout:8/213: rename d1/d6 to d1/d6/d34/d35/d3d 22 2023-12-06T15:00:26.670 INFO:tasks.workunit.client.0.smithi152.stdout:8/214: dwrite d1/d6/d34/d36/f17 [4194304,4194304] 0 2023-12-06T15:00:26.670 INFO:tasks.workunit.client.0.smithi152.stdout:8/215: fdatasync d1/d6/f31 0 2023-12-06T15:00:26.670 INFO:tasks.workunit.client.1.smithi190.stdout:4/437: dwrite d3/d35/d19/d30/d3c/f5a [0,4194304] 0 2023-12-06T15:00:26.672 INFO:tasks.workunit.client.0.smithi152.stdout:8/216: unlink d1/d6/l27 0 2023-12-06T15:00:26.672 INFO:tasks.workunit.client.0.smithi152.stdout:8/217: chown d1/c25 387768 1 2023-12-06T15:00:26.672 INFO:tasks.workunit.client.0.smithi152.stdout:8/218: mknod d1/d6/c3e 0 2023-12-06T15:00:26.689 INFO:tasks.workunit.client.0.smithi152.stdout:8/219: dwrite d1/d6/d34/d36/f2e [0,4194304] 0 2023-12-06T15:00:26.692 INFO:tasks.workunit.client.0.smithi152.stdout:2/245: sync 2023-12-06T15:00:26.692 INFO:tasks.workunit.client.0.smithi152.stdout:9/290: sync 2023-12-06T15:00:26.696 INFO:tasks.workunit.client.0.smithi152.stdout:9/291: mkdir d0/d50 0 2023-12-06T15:00:26.697 INFO:tasks.workunit.client.0.smithi152.stdout:2/246: mknod d6/c48 0 2023-12-06T15:00:26.698 INFO:tasks.workunit.client.0.smithi152.stdout:2/247: mknod d6/d1e/c49 0 2023-12-06T15:00:26.698 INFO:tasks.workunit.client.0.smithi152.stdout:2/248: truncate d6/db/d17/f28 4784272 0 2023-12-06T15:00:26.700 INFO:tasks.workunit.client.0.smithi152.stdout:8/220: dread d1/d6/d34/d36/f26 [0,4194304] 0 2023-12-06T15:00:26.700 INFO:tasks.workunit.client.0.smithi152.stdout:8/221: fdatasync d1/d6/f1b 0 2023-12-06T15:00:26.709 INFO:tasks.workunit.client.1.smithi190.stdout:4/438: creat d3/d76/f88 x:0 0 0 2023-12-06T15:00:26.721 INFO:tasks.workunit.client.0.smithi152.stdout:9/292: dwrite d0/f8 [0,4194304] 0 2023-12-06T15:00:26.722 INFO:tasks.workunit.client.0.smithi152.stdout:9/293: chown d0/f30 4002 1 2023-12-06T15:00:26.723 INFO:tasks.workunit.client.0.smithi152.stdout:2/249: dwrite d6/f15 [0,4194304] 0 2023-12-06T15:00:26.723 INFO:tasks.workunit.client.0.smithi152.stdout:9/294: creat d0/dd/d20/f51 x:0 0 0 2023-12-06T15:00:26.725 INFO:tasks.workunit.client.0.smithi152.stdout:9/295: creat d0/dd/d20/d38/d45/d43/f52 x:0 0 0 2023-12-06T15:00:26.725 INFO:tasks.workunit.client.0.smithi152.stdout:9/296: getdents d0/d3f 0 2023-12-06T15:00:26.725 INFO:tasks.workunit.client.0.smithi152.stdout:9/297: fdatasync d0/dd/f3e 0 2023-12-06T15:00:26.725 INFO:tasks.workunit.client.0.smithi152.stdout:9/298: creat d0/d3f/f53 x:0 0 0 2023-12-06T15:00:26.726 INFO:tasks.workunit.client.0.smithi152.stdout:9/299: read d0/dd/d20/f21 [4670706,22716] 0 2023-12-06T15:00:26.727 INFO:tasks.workunit.client.0.smithi152.stdout:2/250: dread d6/d18/f3d [0,4194304] 0 2023-12-06T15:00:26.728 INFO:tasks.workunit.client.0.smithi152.stdout:2/251: unlink d6/db/d13/f24 0 2023-12-06T15:00:26.728 INFO:tasks.workunit.client.0.smithi152.stdout:2/252: rmdir d6/d18/d43 39 2023-12-06T15:00:26.730 INFO:tasks.workunit.client.0.smithi152.stdout:2/253: creat d6/d1e/f4a x:0 0 0 2023-12-06T15:00:26.730 INFO:tasks.workunit.client.0.smithi152.stdout:2/254: write d6/db/f35 [729286,51150] 0 2023-12-06T15:00:26.732 INFO:tasks.workunit.client.0.smithi152.stdout:2/255: creat d6/db/d13/f4b x:0 0 0 2023-12-06T15:00:26.734 INFO:tasks.workunit.client.0.smithi152.stdout:2/256: dread d6/d18/f32 [0,4194304] 0 2023-12-06T15:00:26.735 INFO:tasks.workunit.client.0.smithi152.stdout:2/257: mknod d6/db/c4c 0 2023-12-06T15:00:26.736 INFO:tasks.workunit.client.0.smithi152.stdout:2/258: getdents d6/d1e/d27 0 2023-12-06T15:00:26.736 INFO:tasks.workunit.client.0.smithi152.stdout:2/259: chown d6/d18/d43/l45 38 1 2023-12-06T15:00:26.737 INFO:tasks.workunit.client.0.smithi152.stdout:2/260: getdents d6/db/d17 0 2023-12-06T15:00:26.739 INFO:tasks.workunit.client.0.smithi152.stdout:9/300: dwrite d0/f1c [0,4194304] 0 2023-12-06T15:00:26.739 INFO:tasks.workunit.client.0.smithi152.stdout:9/301: chown d0/f23 1693087421 1 2023-12-06T15:00:26.739 INFO:tasks.workunit.client.0.smithi152.stdout:9/302: chown d0/f1c 6372753 1 2023-12-06T15:00:26.740 INFO:tasks.workunit.client.0.smithi152.stdout:2/261: rename d6/d1e/f37 to d6/f4d 0 2023-12-06T15:00:26.743 INFO:tasks.workunit.client.0.smithi152.stdout:2/262: mknod d6/db/c4e 0 2023-12-06T15:00:26.744 INFO:tasks.workunit.client.0.smithi152.stdout:2/263: unlink d6/d18/l2c 0 2023-12-06T15:00:26.749 INFO:tasks.workunit.client.1.smithi190.stdout:5/391: sync 2023-12-06T15:00:26.749 INFO:tasks.workunit.client.1.smithi190.stdout:2/465: sync 2023-12-06T15:00:26.749 INFO:tasks.workunit.client.1.smithi190.stdout:5/392: fsync d0/f44 0 2023-12-06T15:00:26.752 INFO:tasks.workunit.client.1.smithi190.stdout:5/393: mknod d0/d1c/d3e/d5a/d5f/c7c 0 2023-12-06T15:00:26.754 INFO:tasks.workunit.client.1.smithi190.stdout:5/394: rename d0/d1c/d2b/d2c/c31 to d0/d1c/d2b/d2c/c7d 0 2023-12-06T15:00:26.756 INFO:tasks.workunit.client.1.smithi190.stdout:5/395: mkdir d0/d1c/d3e/d7e 0 2023-12-06T15:00:26.757 INFO:tasks.workunit.client.1.smithi190.stdout:5/396: creat d0/d1c/d2b/f7f x:0 0 0 2023-12-06T15:00:26.766 INFO:tasks.workunit.client.1.smithi190.stdout:4/439: rmdir d3 39 2023-12-06T15:00:26.767 INFO:tasks.workunit.client.1.smithi190.stdout:7/567: mknod d0/df/cb6 0 2023-12-06T15:00:26.768 INFO:tasks.workunit.client.1.smithi190.stdout:7/568: write d0/d5/da/f54 [1434418,102371] 0 2023-12-06T15:00:26.768 INFO:tasks.workunit.client.1.smithi190.stdout:7/569: getdents d0/d88/d7a 0 2023-12-06T15:00:26.769 INFO:tasks.workunit.client.1.smithi190.stdout:7/570: read - d0/d88/d32/f7d zero size 2023-12-06T15:00:26.770 INFO:tasks.workunit.client.1.smithi190.stdout:5/397: mknod d0/d1c/c80 0 2023-12-06T15:00:26.772 INFO:tasks.workunit.client.1.smithi190.stdout:5/398: unlink d0/d1c/f33 0 2023-12-06T15:00:26.772 INFO:tasks.workunit.client.1.smithi190.stdout:5/399: mknod d0/d1c/d2b/d2c/c81 0 2023-12-06T15:00:26.773 INFO:tasks.workunit.client.1.smithi190.stdout:5/400: rmdir d0/d1c/d2b/d2c/d5d 39 2023-12-06T15:00:26.775 INFO:tasks.workunit.client.1.smithi190.stdout:5/401: unlink d0/df/c3f 0 2023-12-06T15:00:26.776 INFO:tasks.workunit.client.1.smithi190.stdout:5/402: creat d0/f82 x:0 0 0 2023-12-06T15:00:26.778 INFO:tasks.workunit.client.1.smithi190.stdout:9/519: rename d4/d27/d2f/d31/f4b to d4/d27/d2f/d5c/fb2 0 2023-12-06T15:00:26.780 INFO:tasks.workunit.client.1.smithi190.stdout:3/594: rename d4/d70/d53/d56/d94/d3d/f40 to d4/d70/d19/d3a/d3b/fd4 0 2023-12-06T15:00:26.780 INFO:tasks.workunit.client.1.smithi190.stdout:0/486: mkdir d0/d9d 0 2023-12-06T15:00:26.780 INFO:tasks.workunit.client.1.smithi190.stdout:0/487: fdatasync d0/da/d3e/d2b/d3c/d4c/f53 0 2023-12-06T15:00:26.782 INFO:tasks.workunit.client.1.smithi190.stdout:9/520: unlink d4/f9e 0 2023-12-06T15:00:26.782 INFO:tasks.workunit.client.1.smithi190.stdout:9/521: fdatasync d4/f33 0 2023-12-06T15:00:26.784 INFO:tasks.workunit.client.1.smithi190.stdout:4/440: rename d3/d10/d39/l1f to d3/d35/d19/d41/d44/l89 0 2023-12-06T15:00:26.785 INFO:tasks.workunit.client.1.smithi190.stdout:3/595: creat d4/d1b/d77/da8/db7/dd2/fd5 x:0 0 0 2023-12-06T15:00:26.787 INFO:tasks.workunit.client.1.smithi190.stdout:7/571: rename d0/l8c to d0/d5/d63/lb7 0 2023-12-06T15:00:26.787 INFO:tasks.workunit.client.1.smithi190.stdout:7/572: write d0/d5/da/d56/f82 [152395,56608] 0 2023-12-06T15:00:26.787 INFO:tasks.workunit.client.1.smithi190.stdout:7/573: truncate d0/df/d53/d15/f8d 730193 0 2023-12-06T15:00:26.787 INFO:tasks.workunit.client.1.smithi190.stdout:7/574: write d0/d88/d1c/f23 [213009,65940] 0 2023-12-06T15:00:26.787 INFO:tasks.workunit.client.1.smithi190.stdout:7/575: chown d0/d5/d63/lb7 138709767 1 2023-12-06T15:00:26.788 INFO:tasks.workunit.client.1.smithi190.stdout:4/441: mkdir d3/d76/d7c/d8a 0 2023-12-06T15:00:26.789 INFO:tasks.workunit.client.1.smithi190.stdout:3/596: creat d4/d1b/d77/da8/db7/dd2/fd6 x:0 0 0 2023-12-06T15:00:26.790 INFO:tasks.workunit.client.1.smithi190.stdout:1/731: mkdir d6/dc/d29/ded 0 2023-12-06T15:00:26.790 INFO:tasks.workunit.client.1.smithi190.stdout:5/403: dwrite d0/df/f2e [4194304,4194304] 0 2023-12-06T15:00:26.793 INFO:tasks.workunit.client.1.smithi190.stdout:7/576: rename d0/d5/d63/f90 to d0/df/d53/d2f/fb8 0 2023-12-06T15:00:26.793 INFO:tasks.workunit.client.1.smithi190.stdout:9/522: dread d4/d27/d2f/d5c/fb2 [0,4194304] 0 2023-12-06T15:00:26.794 INFO:tasks.workunit.client.1.smithi190.stdout:3/597: symlink d4/d70/d7f/db5/ld7 0 2023-12-06T15:00:26.794 INFO:tasks.workunit.client.1.smithi190.stdout:4/442: write d3/f12 [3303972,32969] 0 2023-12-06T15:00:26.795 INFO:tasks.workunit.client.1.smithi190.stdout:1/732: unlink d6/d49/d74/fe3 0 2023-12-06T15:00:26.797 INFO:tasks.workunit.client.1.smithi190.stdout:5/404: symlink d0/d1c/d3e/d5a/l83 0 2023-12-06T15:00:26.800 INFO:tasks.workunit.client.1.smithi190.stdout:7/577: unlink d0/d88/d32/l38 0 2023-12-06T15:00:26.801 INFO:tasks.workunit.client.1.smithi190.stdout:3/598: creat d4/d70/d53/d56/d94/fd8 x:0 0 0 2023-12-06T15:00:26.803 INFO:tasks.workunit.client.1.smithi190.stdout:7/578: rmdir d0/df/d5f/da7 39 2023-12-06T15:00:26.803 INFO:tasks.workunit.client.1.smithi190.stdout:1/733: dread d6/d49/fe0 [0,4194304] 0 2023-12-06T15:00:26.804 INFO:tasks.workunit.client.1.smithi190.stdout:1/734: write d6/dc/fa0 [545857,41510] 0 2023-12-06T15:00:26.806 INFO:tasks.workunit.client.1.smithi190.stdout:7/579: creat d0/d88/d7a/d7c/fb9 x:0 0 0 2023-12-06T15:00:26.806 INFO:tasks.workunit.client.1.smithi190.stdout:5/405: dread d0/d1c/d2b/d2c/f49 [0,4194304] 0 2023-12-06T15:00:26.808 INFO:tasks.workunit.client.1.smithi190.stdout:1/735: mknod d6/dc/d29/d38/d73/d76/d7e/cee 0 2023-12-06T15:00:26.808 INFO:tasks.workunit.client.1.smithi190.stdout:1/736: fdatasync d6/dc/d29/d38/d43/f61 0 2023-12-06T15:00:26.808 INFO:tasks.workunit.client.1.smithi190.stdout:1/737: write d6/dc/d29/d38/d73/d76/d7e/fbc [375809,76617] 0 2023-12-06T15:00:26.809 INFO:tasks.workunit.client.1.smithi190.stdout:1/738: chown d6/dc/f9 14 1 2023-12-06T15:00:26.809 INFO:tasks.workunit.client.1.smithi190.stdout:1/739: fsync d6/dc/d29/d38/d73/f41 0 2023-12-06T15:00:26.809 INFO:tasks.workunit.client.1.smithi190.stdout:9/523: dread d4/f2e [4194304,4194304] 0 2023-12-06T15:00:26.809 INFO:tasks.workunit.client.1.smithi190.stdout:9/524: chown d4/d27/d2f/c42 9271 1 2023-12-06T15:00:26.811 INFO:tasks.workunit.client.1.smithi190.stdout:6/631: sync 2023-12-06T15:00:26.811 INFO:tasks.workunit.client.1.smithi190.stdout:8/480: sync 2023-12-06T15:00:26.811 INFO:tasks.workunit.client.1.smithi190.stdout:8/481: fdatasync d1/d20/f42 0 2023-12-06T15:00:26.811 INFO:tasks.workunit.client.1.smithi190.stdout:6/632: fsync d4/d12/d1a/f20 0 2023-12-06T15:00:26.813 INFO:tasks.workunit.client.1.smithi190.stdout:7/580: mkdir d0/d5/dba 0 2023-12-06T15:00:26.815 INFO:tasks.workunit.client.1.smithi190.stdout:1/740: mknod d6/dc/d29/d38/d73/d76/cef 0 2023-12-06T15:00:26.820 INFO:tasks.workunit.client.1.smithi190.stdout:8/482: truncate d1/d20/d3b/d36/f7a 4033856 0 2023-12-06T15:00:26.820 INFO:tasks.workunit.client.1.smithi190.stdout:8/483: write d1/d20/d3b/d4c/f7f [678063,117062] 0 2023-12-06T15:00:26.821 INFO:tasks.workunit.client.1.smithi190.stdout:7/581: creat d0/fbb x:0 0 0 2023-12-06T15:00:26.822 INFO:tasks.workunit.client.1.smithi190.stdout:8/484: truncate d1/f16 3388561 0 2023-12-06T15:00:26.824 INFO:tasks.workunit.client.1.smithi190.stdout:7/582: symlink d0/d88/d33/d4c/lbc 0 2023-12-06T15:00:26.824 INFO:tasks.workunit.client.1.smithi190.stdout:7/583: read - d0/fbb zero size 2023-12-06T15:00:26.825 INFO:tasks.workunit.client.1.smithi190.stdout:7/584: stat d0/d88/d32/f7d 0 2023-12-06T15:00:26.835 INFO:tasks.workunit.client.1.smithi190.stdout:8/485: dread d1/d20/d3b/f2d [0,4194304] 0 2023-12-06T15:00:26.835 INFO:tasks.workunit.client.1.smithi190.stdout:8/486: chown d1/d20/d3b/d31/l54 2 1 2023-12-06T15:00:26.835 INFO:tasks.workunit.client.1.smithi190.stdout:4/443: dwrite d3/d10/d15/f20 [0,4194304] 0 2023-12-06T15:00:26.836 INFO:tasks.workunit.client.1.smithi190.stdout:5/406: symlink d0/d1c/l84 0 2023-12-06T15:00:26.838 INFO:tasks.workunit.client.0.smithi152.stdout:3/331: sync 2023-12-06T15:00:26.838 INFO:tasks.workunit.client.0.smithi152.stdout:4/486: sync 2023-12-06T15:00:26.838 INFO:tasks.workunit.client.0.smithi152.stdout:3/332: stat d9/d18/d1a/l48 0 2023-12-06T15:00:26.838 INFO:tasks.workunit.client.1.smithi190.stdout:8/487: symlink d1/l8f 0 2023-12-06T15:00:26.839 INFO:tasks.workunit.client.1.smithi190.stdout:8/488: write d1/d10/d1c/f22 [810321,2556] 0 2023-12-06T15:00:26.839 INFO:tasks.workunit.client.1.smithi190.stdout:4/444: mkdir d3/d76/d8b 0 2023-12-06T15:00:26.839 INFO:tasks.workunit.client.1.smithi190.stdout:4/445: chown d3/d35/d19/l24 2118293457 1 2023-12-06T15:00:26.839 INFO:tasks.workunit.client.0.smithi152.stdout:4/487: rename d2/d15/d32/d79/f53 to d2/d15/d32/d69/f93 0 2023-12-06T15:00:26.840 INFO:tasks.workunit.client.1.smithi190.stdout:8/489: symlink d1/d10/d1c/d4b/l90 0 2023-12-06T15:00:26.841 INFO:tasks.workunit.client.1.smithi190.stdout:4/446: mknod d3/d76/d8b/c8c 0 2023-12-06T15:00:26.841 INFO:tasks.workunit.client.0.smithi152.stdout:3/333: getdents d9/d18/d1a 0 2023-12-06T15:00:26.842 INFO:tasks.workunit.client.0.smithi152.stdout:4/488: write d2/f8 [132308,75416] 0 2023-12-06T15:00:26.844 INFO:tasks.workunit.client.0.smithi152.stdout:4/489: dread d2/d15/d32/d69/f93 [0,4194304] 0 2023-12-06T15:00:26.845 INFO:tasks.workunit.client.0.smithi152.stdout:4/490: mknod d2/d10/d52/c94 0 2023-12-06T15:00:26.848 INFO:tasks.workunit.client.1.smithi190.stdout:8/490: unlink d1/d20/d3b/d34/d39/f72 0 2023-12-06T15:00:26.849 INFO:tasks.workunit.client.1.smithi190.stdout:4/447: rename d3/d10/d39/f62 to d3/d35/d19/d30/d3c/f8d 0 2023-12-06T15:00:26.850 INFO:tasks.workunit.client.1.smithi190.stdout:9/525: dwrite d4/f24 [0,4194304] 0 2023-12-06T15:00:26.851 INFO:tasks.workunit.client.1.smithi190.stdout:1/741: dwrite d6/dc/d29/d38/d73/fd7 [0,4194304] 0 2023-12-06T15:00:26.853 INFO:tasks.workunit.client.1.smithi190.stdout:7/585: dwrite d0/d5/da/d56/fa0 [0,4194304] 0 2023-12-06T15:00:26.854 INFO:tasks.workunit.client.1.smithi190.stdout:9/526: truncate d4/d84/f8b 1427641 0 2023-12-06T15:00:26.856 INFO:tasks.workunit.client.1.smithi190.stdout:6/633: dwrite d4/d12/d1a/d44/f8f [0,4194304] 0 2023-12-06T15:00:26.856 INFO:tasks.workunit.client.1.smithi190.stdout:6/634: fsync d4/d12/d1a/d44/f79 0 2023-12-06T15:00:26.856 INFO:tasks.workunit.client.0.smithi152.stdout:3/334: dread d9/d10/f2f [0,4194304] 0 2023-12-06T15:00:26.858 INFO:tasks.workunit.client.0.smithi152.stdout:3/335: truncate d9/d10/f2e 440038 0 2023-12-06T15:00:26.858 INFO:tasks.workunit.client.0.smithi152.stdout:3/336: chown d9/d10/d12/d44 21318858 1 2023-12-06T15:00:26.860 INFO:tasks.workunit.client.0.smithi152.stdout:3/337: symlink d9/d10/d19/l5f 0 2023-12-06T15:00:26.864 INFO:tasks.workunit.client.1.smithi190.stdout:5/407: mkdir d0/d1c/d85 0 2023-12-06T15:00:26.866 INFO:tasks.workunit.client.0.smithi152.stdout:4/491: dread d2/d22/f76 [0,4194304] 0 2023-12-06T15:00:26.866 INFO:tasks.workunit.client.0.smithi152.stdout:4/492: readlink d2/d15/d32/d79/l44 0 2023-12-06T15:00:26.868 INFO:tasks.workunit.client.0.smithi152.stdout:4/493: mknod d2/d45/c95 0 2023-12-06T15:00:26.868 INFO:tasks.workunit.client.0.smithi152.stdout:4/494: dread - d2/d15/d32/d54/d85/f87 zero size 2023-12-06T15:00:26.868 INFO:tasks.workunit.client.0.smithi152.stdout:4/495: truncate d2/d15/d32/d54/d85/f86 676435 0 2023-12-06T15:00:26.869 INFO:tasks.workunit.client.0.smithi152.stdout:4/496: creat d2/d15/f96 x:0 0 0 2023-12-06T15:00:26.870 INFO:tasks.workunit.client.1.smithi190.stdout:7/586: mkdir d0/df/d1f/dbd 0 2023-12-06T15:00:26.870 INFO:tasks.workunit.client.1.smithi190.stdout:7/587: stat d0/d88/d1c/d17/f64 0 2023-12-06T15:00:26.870 INFO:tasks.workunit.client.0.smithi152.stdout:4/497: mknod d2/c97 0 2023-12-06T15:00:26.871 INFO:tasks.workunit.client.0.smithi152.stdout:4/498: creat d2/d15/d23/d75/f98 x:0 0 0 2023-12-06T15:00:26.871 INFO:tasks.workunit.client.1.smithi190.stdout:8/491: rmdir d1/d20/d3b/d4d/d8a 0 2023-12-06T15:00:26.871 INFO:tasks.workunit.client.1.smithi190.stdout:8/492: dread - d1/f6c zero size 2023-12-06T15:00:26.872 INFO:tasks.workunit.client.0.smithi152.stdout:4/499: creat d2/d15/f99 x:0 0 0 2023-12-06T15:00:26.872 INFO:tasks.workunit.client.0.smithi152.stdout:4/500: fdatasync d2/f7c 0 2023-12-06T15:00:26.872 INFO:tasks.workunit.client.0.smithi152.stdout:4/501: mknod d2/d22/c9a 0 2023-12-06T15:00:26.872 INFO:tasks.workunit.client.0.smithi152.stdout:4/502: chown d2/d15/l5f 913983 1 2023-12-06T15:00:26.873 INFO:tasks.workunit.client.1.smithi190.stdout:9/527: mkdir d4/d27/d2f/d31/d3f/d58/d72/db3 0 2023-12-06T15:00:26.876 INFO:tasks.workunit.client.1.smithi190.stdout:6/635: mkdir d4/d12/d1a/d32/dc7/dd0 0 2023-12-06T15:00:26.876 INFO:tasks.workunit.client.1.smithi190.stdout:6/636: read - d4/d12/d1a/d44/fbd zero size 2023-12-06T15:00:26.878 INFO:tasks.workunit.client.1.smithi190.stdout:5/408: creat d0/df/d50/f86 x:0 0 0 2023-12-06T15:00:26.880 INFO:tasks.workunit.client.1.smithi190.stdout:1/742: dwrite d6/dc/d29/d38/d73/fde [0,4194304] 0 2023-12-06T15:00:26.882 INFO:tasks.workunit.client.1.smithi190.stdout:7/588: creat d0/d88/d7a/fbe x:0 0 0 2023-12-06T15:00:26.882 INFO:tasks.workunit.client.1.smithi190.stdout:8/493: truncate d1/d20/d3b/d36/f48 1475622 0 2023-12-06T15:00:26.882 INFO:tasks.workunit.client.1.smithi190.stdout:4/448: dwrite d3/d10/d39/d54/f84 [0,4194304] 0 2023-12-06T15:00:26.882 INFO:tasks.workunit.client.1.smithi190.stdout:8/494: chown d1/d20/d3b/d31/c89 103 1 2023-12-06T15:00:26.883 INFO:tasks.workunit.client.1.smithi190.stdout:8/495: write d1/d20/d3b/d36/d50/f6d [4579906,122034] 0 2023-12-06T15:00:26.884 INFO:tasks.workunit.client.1.smithi190.stdout:9/528: rename d4/f18 to d4/d27/d2f/d66/fb4 0 2023-12-06T15:00:26.884 INFO:tasks.workunit.client.1.smithi190.stdout:9/529: write d4/d27/f6a [4484880,101912] 0 2023-12-06T15:00:26.885 INFO:tasks.workunit.client.1.smithi190.stdout:6/637: creat d4/d12/d1a/d32/fd1 x:0 0 0 2023-12-06T15:00:26.885 INFO:tasks.workunit.client.1.smithi190.stdout:6/638: truncate d4/d12/d1a/d32/f9d 1043510 0 2023-12-06T15:00:26.885 INFO:tasks.workunit.client.1.smithi190.stdout:6/639: chown d4/d12/d40 3912893 1 2023-12-06T15:00:26.885 INFO:tasks.workunit.client.1.smithi190.stdout:6/640: getdents d4/d12/d1a/d70/da9 0 2023-12-06T15:00:26.886 INFO:tasks.workunit.client.1.smithi190.stdout:5/409: creat d0/df/d50/f87 x:0 0 0 2023-12-06T15:00:26.887 INFO:tasks.workunit.client.1.smithi190.stdout:1/743: getdents d6/d49 0 2023-12-06T15:00:26.890 INFO:tasks.workunit.client.1.smithi190.stdout:7/589: mknod d0/d88/d1c/d17/d94/d95/cbf 0 2023-12-06T15:00:26.891 INFO:tasks.workunit.client.1.smithi190.stdout:4/449: symlink d3/d35/d19/d41/d44/l8e 0 2023-12-06T15:00:26.893 INFO:tasks.workunit.client.1.smithi190.stdout:8/496: stat d1/d20/d3b/d34/d39/l63 0 2023-12-06T15:00:26.896 INFO:tasks.workunit.client.1.smithi190.stdout:9/530: symlink d4/d27/d2f/d31/d3f/d58/d7d/lb5 0 2023-12-06T15:00:26.896 INFO:tasks.workunit.client.1.smithi190.stdout:9/531: chown d4/d27/d2f/d31/d3f/l64 252 1 2023-12-06T15:00:26.896 INFO:tasks.workunit.client.1.smithi190.stdout:9/532: readlink d4/d27/d2f/l93 0 2023-12-06T15:00:26.897 INFO:tasks.workunit.client.0.smithi152.stdout:4/503: dwrite d2/d15/f58 [0,4194304] 0 2023-12-06T15:00:26.899 INFO:tasks.workunit.client.1.smithi190.stdout:6/641: link d4/d12/d1a/d44/f47 d4/d12/d9a/fd2 0 2023-12-06T15:00:26.900 INFO:tasks.workunit.client.1.smithi190.stdout:5/410: mknod d0/df/c88 0 2023-12-06T15:00:26.901 INFO:tasks.workunit.client.1.smithi190.stdout:1/744: mknod d6/d49/cf0 0 2023-12-06T15:00:26.903 INFO:tasks.workunit.client.1.smithi190.stdout:7/590: mkdir d0/d88/d7a/d7c/dab/dc0 0 2023-12-06T15:00:26.905 INFO:tasks.workunit.client.1.smithi190.stdout:8/497: creat d1/d20/d3b/d4d/f91 x:0 0 0 2023-12-06T15:00:26.907 INFO:tasks.workunit.client.1.smithi190.stdout:9/533: unlink d4/d27/d2f/cac 0 2023-12-06T15:00:26.907 INFO:tasks.workunit.client.1.smithi190.stdout:9/534: fdatasync d4/d84/f8b 0 2023-12-06T15:00:26.908 INFO:tasks.workunit.client.0.smithi152.stdout:4/504: dread d2/d10/f24 [0,4194304] 0 2023-12-06T15:00:26.909 INFO:tasks.workunit.client.0.smithi152.stdout:4/505: mknod d2/d45/d84/c9b 0 2023-12-06T15:00:26.910 INFO:tasks.workunit.client.1.smithi190.stdout:6/642: dread d4/d12/d1a/d70/da9/faa [8388608,4194304] 0 2023-12-06T15:00:26.910 INFO:tasks.workunit.client.1.smithi190.stdout:5/411: creat d0/f89 x:0 0 0 2023-12-06T15:00:26.911 INFO:tasks.workunit.client.1.smithi190.stdout:9/535: creat d4/d84/fb6 x:0 0 0 2023-12-06T15:00:26.913 INFO:tasks.workunit.client.1.smithi190.stdout:8/498: write d1/d20/d3b/d34/f40 [6198667,90304] 0 2023-12-06T15:00:26.913 INFO:tasks.workunit.client.1.smithi190.stdout:8/499: truncate d1/d37/f73 395591 0 2023-12-06T15:00:26.914 INFO:tasks.workunit.client.1.smithi190.stdout:5/412: symlink d0/d1c/d2b/d2c/d5d/l8a 0 2023-12-06T15:00:26.914 INFO:tasks.workunit.client.1.smithi190.stdout:5/413: truncate d0/d6c/f79 974729 0 2023-12-06T15:00:26.914 INFO:tasks.workunit.client.1.smithi190.stdout:5/414: readlink d0/l7a 0 2023-12-06T15:00:26.915 INFO:tasks.workunit.client.1.smithi190.stdout:9/536: creat d4/d27/d2f/d5c/d9d/fb7 x:0 0 0 2023-12-06T15:00:26.918 INFO:tasks.workunit.client.1.smithi190.stdout:5/415: stat d0/d1c/d3e 0 2023-12-06T15:00:26.920 INFO:tasks.workunit.client.1.smithi190.stdout:9/537: write d4/d27/d2f/d31/d3f/f69 [419247,14637] 0 2023-12-06T15:00:26.920 INFO:tasks.workunit.client.1.smithi190.stdout:9/538: write d4/d27/d2f/d31/d3f/f69 [4677545,74988] 0 2023-12-06T15:00:26.928 INFO:tasks.workunit.client.1.smithi190.stdout:5/416: write d0/d1c/d2b/f32 [3724132,31217] 0 2023-12-06T15:00:26.931 INFO:tasks.workunit.client.1.smithi190.stdout:5/417: write d0/d1c/d3e/f77 [1839915,98504] 0 2023-12-06T15:00:26.932 INFO:tasks.workunit.client.1.smithi190.stdout:1/745: dwrite d6/dc/d29/d38/d73/d76/d7e/fd6 [0,4194304] 0 2023-12-06T15:00:26.934 INFO:tasks.workunit.client.1.smithi190.stdout:5/418: write d0/f18 [7528617,74419] 0 2023-12-06T15:00:26.934 INFO:tasks.workunit.client.1.smithi190.stdout:4/450: dwrite d3/d10/d39/f48 [0,4194304] 0 2023-12-06T15:00:26.937 INFO:tasks.workunit.client.1.smithi190.stdout:4/451: symlink d3/d76/d7c/d8a/l8f 0 2023-12-06T15:00:26.938 INFO:tasks.workunit.client.1.smithi190.stdout:4/452: truncate d3/f12 522467 0 2023-12-06T15:00:26.938 INFO:tasks.workunit.client.0.smithi152.stdout:4/506: dwrite d2/d15/f7f [0,4194304] 0 2023-12-06T15:00:26.938 INFO:tasks.workunit.client.0.smithi152.stdout:4/507: write d2/d22/f76 [5088148,120948] 0 2023-12-06T15:00:26.939 INFO:tasks.workunit.client.1.smithi190.stdout:4/453: creat d3/f90 x:0 0 0 2023-12-06T15:00:26.939 INFO:tasks.workunit.client.1.smithi190.stdout:5/419: dread d0/df/f41 [0,4194304] 0 2023-12-06T15:00:26.939 INFO:tasks.workunit.client.1.smithi190.stdout:6/643: dwrite d4/d12/d40/d43/d45/d4a/f8b [4194304,4194304] 0 2023-12-06T15:00:26.939 INFO:tasks.workunit.client.1.smithi190.stdout:5/420: fsync d0/f2a 0 2023-12-06T15:00:26.940 INFO:tasks.workunit.client.1.smithi190.stdout:6/644: stat d4/d12/d1a/d59/l5c 0 2023-12-06T15:00:26.941 INFO:tasks.workunit.client.0.smithi152.stdout:4/508: link d2/d10/d52/l36 d2/d10/d27/l9c 0 2023-12-06T15:00:26.942 INFO:tasks.workunit.client.1.smithi190.stdout:5/421: dread d0/d1c/d3e/f51 [0,4194304] 0 2023-12-06T15:00:26.942 INFO:tasks.workunit.client.1.smithi190.stdout:6/645: mkdir d4/d12/d1a/d32/dab/dd3 0 2023-12-06T15:00:26.943 INFO:tasks.workunit.client.0.smithi152.stdout:4/509: symlink d2/l9d 0 2023-12-06T15:00:26.943 INFO:tasks.workunit.client.1.smithi190.stdout:9/539: dwrite d4/f2e [4194304,4194304] 0 2023-12-06T15:00:26.943 INFO:tasks.workunit.client.1.smithi190.stdout:9/540: read d4/d27/d2f/f5e [1065525,118484] 0 2023-12-06T15:00:26.944 INFO:tasks.workunit.client.1.smithi190.stdout:5/422: mkdir d0/d1c/d2b/d8b 0 2023-12-06T15:00:26.944 INFO:tasks.workunit.client.0.smithi152.stdout:4/510: unlink d2/d15/d32/d69/d6f/l51 0 2023-12-06T15:00:26.945 INFO:tasks.workunit.client.1.smithi190.stdout:6/646: creat d4/d12/d1a/d8a/fd4 x:0 0 0 2023-12-06T15:00:26.947 INFO:tasks.workunit.client.1.smithi190.stdout:1/746: dwrite d6/dc/d29/d38/d73/f41 [0,4194304] 0 2023-12-06T15:00:26.947 INFO:tasks.workunit.client.1.smithi190.stdout:1/747: truncate d6/dc/d29/d38/d39/d63/d67/f7d 1209497 0 2023-12-06T15:00:26.948 INFO:tasks.workunit.client.1.smithi190.stdout:9/541: symlink d4/d27/d2f/d5c/d9d/lb8 0 2023-12-06T15:00:26.948 INFO:tasks.workunit.client.1.smithi190.stdout:1/748: write d6/dc/fa0 [328789,30683] 0 2023-12-06T15:00:26.949 INFO:tasks.workunit.client.1.smithi190.stdout:5/423: getdents d0/d1c/d3e/d5a 0 2023-12-06T15:00:26.949 INFO:tasks.workunit.client.1.smithi190.stdout:5/424: chown d0/fd 325 1 2023-12-06T15:00:26.951 INFO:tasks.workunit.client.1.smithi190.stdout:6/647: mkdir d4/d12/d40/d43/d45/d4a/d77/dd5 0 2023-12-06T15:00:26.951 INFO:tasks.workunit.client.1.smithi190.stdout:6/648: dread - d4/d12/d1a/f7c zero size 2023-12-06T15:00:26.952 INFO:tasks.workunit.client.1.smithi190.stdout:9/542: rename d4/d27/d2f/d31/d3f/d58/d72/d7a/c88 to d4/d27/d2f/d31/d3f/d58/d72/d7a/cb9 0 2023-12-06T15:00:26.954 INFO:tasks.workunit.client.1.smithi190.stdout:5/425: creat d0/d6c/f8c x:0 0 0 2023-12-06T15:00:26.955 INFO:tasks.workunit.client.1.smithi190.stdout:5/426: rmdir d0/d1c/d2b/d2c/d5d 39 2023-12-06T15:00:26.958 INFO:tasks.workunit.client.1.smithi190.stdout:5/427: symlink d0/d1c/d3e/d7e/l8d 0 2023-12-06T15:00:26.958 INFO:tasks.workunit.client.1.smithi190.stdout:1/749: dread d6/f6c [0,4194304] 0 2023-12-06T15:00:26.958 INFO:tasks.workunit.client.0.smithi152.stdout:4/511: dwrite d2/d15/d32/f66 [4194304,4194304] 0 2023-12-06T15:00:26.959 INFO:tasks.workunit.client.1.smithi190.stdout:9/543: read d4/d27/d2f/d31/d3f/d58/f59 [2692076,66327] 0 2023-12-06T15:00:26.960 INFO:tasks.workunit.client.1.smithi190.stdout:9/544: write d4/d27/d2f/d31/d3f/d58/d7d/f9f [3904,76956] 0 2023-12-06T15:00:26.960 INFO:tasks.workunit.client.1.smithi190.stdout:9/545: stat d4/f13 0 2023-12-06T15:00:26.960 INFO:tasks.workunit.client.1.smithi190.stdout:5/428: write d0/d1c/d2b/f32 [2473665,62108] 0 2023-12-06T15:00:26.961 INFO:tasks.workunit.client.0.smithi152.stdout:4/512: mkdir d2/d89/d9e 0 2023-12-06T15:00:26.961 INFO:tasks.workunit.client.1.smithi190.stdout:1/750: link d6/dc/d29/d38/d73/d5c/fa3 d6/dc/d29/d38/d73/d5c/ff1 0 2023-12-06T15:00:26.962 INFO:tasks.workunit.client.1.smithi190.stdout:1/751: write d6/dc/d29/d38/d73/d76/fc3 [565106,2839] 0 2023-12-06T15:00:26.962 INFO:tasks.workunit.client.1.smithi190.stdout:1/752: fsync d6/dc/f33 0 2023-12-06T15:00:26.963 INFO:tasks.workunit.client.1.smithi190.stdout:9/546: rmdir d4/d27/d2f/d66 39 2023-12-06T15:00:26.963 INFO:tasks.workunit.client.1.smithi190.stdout:9/547: truncate f1 13345156 0 2023-12-06T15:00:26.964 INFO:tasks.workunit.client.1.smithi190.stdout:5/429: creat d0/d1c/d2b/d69/f8e x:0 0 0 2023-12-06T15:00:26.966 INFO:tasks.workunit.client.1.smithi190.stdout:5/430: symlink d0/l8f 0 2023-12-06T15:00:26.966 INFO:tasks.workunit.client.1.smithi190.stdout:5/431: truncate d0/f28 874951 0 2023-12-06T15:00:26.968 INFO:tasks.workunit.client.1.smithi190.stdout:5/432: rename d0/d1c/d2b/d69/d7b to d0/d1c/d85/d90 0 2023-12-06T15:00:26.971 INFO:tasks.workunit.client.1.smithi190.stdout:4/454: dread d3/f12 [0,4194304] 0 2023-12-06T15:00:26.973 INFO:tasks.workunit.client.0.smithi152.stdout:4/513: dread d2/d15/d32/f5a [0,4194304] 0 2023-12-06T15:00:26.978 INFO:tasks.workunit.client.0.smithi152.stdout:4/514: write d2/d15/f58 [3606292,86338] 0 2023-12-06T15:00:26.978 INFO:tasks.workunit.client.1.smithi190.stdout:4/455: mknod d3/d10/c91 0 2023-12-06T15:00:26.979 INFO:tasks.workunit.client.1.smithi190.stdout:6/649: dwrite d4/d12/d1a/d32/f5d [0,4194304] 0 2023-12-06T15:00:26.980 INFO:tasks.workunit.client.0.smithi152.stdout:4/515: rename d2/d22/c7d to d2/d10/c9f 0 2023-12-06T15:00:26.981 INFO:tasks.workunit.client.0.smithi152.stdout:4/516: rename d2/d15/d23/d42/l8e to d2/d15/d23/d42/la0 0 2023-12-06T15:00:26.982 INFO:tasks.workunit.client.0.smithi152.stdout:4/517: creat d2/d89/fa1 x:0 0 0 2023-12-06T15:00:26.984 INFO:tasks.workunit.client.1.smithi190.stdout:6/650: getdents d4/d12/d1a/d8c 0 2023-12-06T15:00:26.985 INFO:tasks.workunit.client.1.smithi190.stdout:6/651: creat d4/d12/d1a/d32/dc7/dd0/fd6 x:0 0 0 2023-12-06T15:00:26.985 INFO:tasks.workunit.client.0.smithi152.stdout:4/518: write d2/d22/f4d [1463279,42391] 0 2023-12-06T15:00:26.985 INFO:tasks.workunit.client.0.smithi152.stdout:4/519: write d2/d22/f78 [146435,52125] 0 2023-12-06T15:00:26.986 INFO:tasks.workunit.client.0.smithi152.stdout:4/520: fdatasync d2/d15/f99 0 2023-12-06T15:00:26.986 INFO:tasks.workunit.client.1.smithi190.stdout:6/652: symlink d4/d12/d40/ld7 0 2023-12-06T15:00:26.986 INFO:tasks.workunit.client.0.smithi152.stdout:4/521: creat d2/d15/d32/d54/fa2 x:0 0 0 2023-12-06T15:00:26.987 INFO:tasks.workunit.client.1.smithi190.stdout:6/653: creat d4/d12/d1a/d32/dab/dd3/fd8 x:0 0 0 2023-12-06T15:00:26.987 INFO:tasks.workunit.client.1.smithi190.stdout:6/654: write d4/d12/d1a/d32/dab/fc6 [994908,30132] 0 2023-12-06T15:00:26.987 INFO:tasks.workunit.client.0.smithi152.stdout:4/522: creat d2/d89/fa3 x:0 0 0 2023-12-06T15:00:26.988 INFO:tasks.workunit.client.1.smithi190.stdout:6/655: link d4/d12/d40/d43/d45/d4a/d77/dca/c64 d4/d12/d1a/d8a/cd9 0 2023-12-06T15:00:26.988 INFO:tasks.workunit.client.0.smithi152.stdout:4/523: mkdir d2/d45/d84/da4 0 2023-12-06T15:00:26.991 INFO:tasks.workunit.client.1.smithi190.stdout:4/456: dread d3/fa [0,4194304] 0 2023-12-06T15:00:26.992 INFO:tasks.workunit.client.1.smithi190.stdout:1/753: dwrite d6/dc/d3b/d78/fb0 [0,4194304] 0 2023-12-06T15:00:26.992 INFO:tasks.workunit.client.1.smithi190.stdout:1/754: stat d6/dc/f15 0 2023-12-06T15:00:26.993 INFO:tasks.workunit.client.1.smithi190.stdout:4/457: rename d3/f12 to d3/d76/d7c/d8a/f92 0 2023-12-06T15:00:26.994 INFO:tasks.workunit.client.1.smithi190.stdout:6/656: write d4/d12/d1a/d8a/f9f [2385543,123816] 0 2023-12-06T15:00:26.995 INFO:tasks.workunit.client.1.smithi190.stdout:4/458: write d3/d10/d39/f25 [1028180,44228] 0 2023-12-06T15:00:26.996 INFO:tasks.workunit.client.1.smithi190.stdout:9/548: dwrite d4/f33 [0,4194304] 0 2023-12-06T15:00:26.996 INFO:tasks.workunit.client.1.smithi190.stdout:4/459: dread d3/d35/d19/d30/d3c/f4f [0,4194304] 0 2023-12-06T15:00:26.997 INFO:tasks.workunit.client.1.smithi190.stdout:6/657: rename d4/d12/d40/d43/d45/d4a/d77/c94 to d4/d12/d1a/db4/cda 0 2023-12-06T15:00:27.001 INFO:tasks.workunit.client.1.smithi190.stdout:1/755: dread d6/dc/f2e [0,4194304] 0 2023-12-06T15:00:27.004 INFO:tasks.workunit.client.1.smithi190.stdout:9/549: getdents d4/d84 0 2023-12-06T15:00:27.005 INFO:tasks.workunit.client.1.smithi190.stdout:4/460: creat d3/d4e/f93 x:0 0 0 2023-12-06T15:00:27.006 INFO:tasks.workunit.client.1.smithi190.stdout:1/756: creat d6/dc/ff2 x:0 0 0 2023-12-06T15:00:27.007 INFO:tasks.workunit.client.1.smithi190.stdout:4/461: creat d3/d35/d19/d30/f94 x:0 0 0 2023-12-06T15:00:27.007 INFO:tasks.workunit.client.1.smithi190.stdout:4/462: fdatasync d3/f3f 0 2023-12-06T15:00:27.008 INFO:tasks.workunit.client.0.smithi152.stdout:4/524: dwrite d2/d10/d27/f48 [0,4194304] 0 2023-12-06T15:00:27.008 INFO:tasks.workunit.client.0.smithi152.stdout:4/525: truncate d2/d15/d32/d69/f93 655873 0 2023-12-06T15:00:27.009 INFO:tasks.workunit.client.1.smithi190.stdout:9/550: write d4/f6b [915536,105385] 0 2023-12-06T15:00:27.009 INFO:tasks.workunit.client.1.smithi190.stdout:1/757: creat d6/dc/d29/d38/d43/d7f/ff3 x:0 0 0 2023-12-06T15:00:27.009 INFO:tasks.workunit.client.1.smithi190.stdout:1/758: getdents d6/dc/d29/ded 0 2023-12-06T15:00:27.009 INFO:tasks.workunit.client.1.smithi190.stdout:1/759: fsync d6/dc/d29/d38/d39/f9c 0 2023-12-06T15:00:27.013 INFO:tasks.workunit.client.1.smithi190.stdout:9/551: creat d4/d27/d2f/d31/fba x:0 0 0 2023-12-06T15:00:27.013 INFO:tasks.workunit.client.1.smithi190.stdout:9/552: chown d4/d27/d2f/c98 96 1 2023-12-06T15:00:27.014 INFO:tasks.workunit.client.1.smithi190.stdout:1/760: mknod d6/dc/d29/ded/cf4 0 2023-12-06T15:00:27.015 INFO:tasks.workunit.client.1.smithi190.stdout:9/553: symlink d4/d27/d2f/d31/d3f/d58/d72/db3/lbb 0 2023-12-06T15:00:27.015 INFO:tasks.workunit.client.1.smithi190.stdout:9/554: stat d4/d27/d2f/d31/d3f/d58/d7d 0 2023-12-06T15:00:27.015 INFO:tasks.workunit.client.1.smithi190.stdout:9/555: chown d4/d27/d2f/d31/d3f/l47 9580386 1 2023-12-06T15:00:27.016 INFO:tasks.workunit.client.1.smithi190.stdout:6/658: dwrite d4/d12/d1a/d44/fce [0,4194304] 0 2023-12-06T15:00:27.017 INFO:tasks.workunit.client.1.smithi190.stdout:1/761: unlink d6/dc/d29/d38/d73/d76/d7e/l9e 0 2023-12-06T15:00:27.018 INFO:tasks.workunit.client.1.smithi190.stdout:6/659: write d4/d12/f53 [2226428,114260] 0 2023-12-06T15:00:27.021 INFO:tasks.workunit.client.1.smithi190.stdout:9/556: write d4/f13 [4703960,16079] 0 2023-12-06T15:00:27.022 INFO:tasks.workunit.client.1.smithi190.stdout:1/762: dread d6/dc/fa0 [0,4194304] 0 2023-12-06T15:00:27.023 INFO:tasks.workunit.client.1.smithi190.stdout:4/463: rmdir d3/d76 39 2023-12-06T15:00:27.025 INFO:tasks.workunit.client.0.smithi152.stdout:4/526: dwrite d2/d15/f7f [0,4194304] 0 2023-12-06T15:00:27.026 INFO:tasks.workunit.client.0.smithi152.stdout:4/527: chown d2/d15/d32/f92 262201 1 2023-12-06T15:00:27.026 INFO:tasks.workunit.client.1.smithi190.stdout:1/763: mknod d6/dc/d29/d38/d43/d7f/cf5 0 2023-12-06T15:00:27.029 INFO:tasks.workunit.client.1.smithi190.stdout:4/464: truncate d3/f26 290625 0 2023-12-06T15:00:27.029 INFO:tasks.workunit.client.1.smithi190.stdout:4/465: stat d3/d35/d19/d30/d3c/f8d 0 2023-12-06T15:00:27.029 INFO:tasks.workunit.client.1.smithi190.stdout:6/660: dread d4/d12/d40/d43/d45/d4a/f8b [4194304,4194304] 0 2023-12-06T15:00:27.029 INFO:tasks.workunit.client.1.smithi190.stdout:4/466: dread - d3/d4e/f93 zero size 2023-12-06T15:00:27.029 INFO:tasks.workunit.client.1.smithi190.stdout:4/467: fdatasync d3/d10/d39/f25 0 2023-12-06T15:00:27.030 INFO:tasks.workunit.client.1.smithi190.stdout:1/764: rmdir d6/dc/d3b 39 2023-12-06T15:00:27.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:26 smithi190 ceph-mon[121340]: pgmap v25: 65 pgs: 65 active+clean; 1.3 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 69 MiB/s rd, 143 MiB/s wr, 237 op/s 2023-12-06T15:00:27.074 INFO:tasks.workunit.client.0.smithi152.stdout:7/228: sync 2023-12-06T15:00:27.074 INFO:tasks.workunit.client.0.smithi152.stdout:0/303: sync 2023-12-06T15:00:27.074 INFO:tasks.workunit.client.0.smithi152.stdout:1/505: sync 2023-12-06T15:00:27.074 INFO:tasks.workunit.client.0.smithi152.stdout:0/304: chown d8/d4b/f51 175723862 1 2023-12-06T15:00:27.074 INFO:tasks.workunit.client.0.smithi152.stdout:1/506: dread - d3/da/d4c/d82/d52/f9c zero size 2023-12-06T15:00:27.074 INFO:tasks.workunit.client.0.smithi152.stdout:1/507: dread - d3/fb0 zero size 2023-12-06T15:00:27.074 INFO:tasks.workunit.client.0.smithi152.stdout:0/305: truncate d8/f13 9146624 0 2023-12-06T15:00:27.075 INFO:tasks.workunit.client.1.smithi190.stdout:6/661: rename d4/c3e to d4/d12/d1a/d8c/da6/cdb 0 2023-12-06T15:00:27.075 INFO:tasks.workunit.client.0.smithi152.stdout:7/229: mkdir dd/df/d34/d44 0 2023-12-06T15:00:27.075 INFO:tasks.workunit.client.0.smithi152.stdout:7/230: fdatasync f7 0 2023-12-06T15:00:27.076 INFO:tasks.workunit.client.1.smithi190.stdout:4/468: creat d3/d35/f95 x:0 0 0 2023-12-06T15:00:27.077 INFO:tasks.workunit.client.1.smithi190.stdout:1/765: mkdir d6/dc/d29/d38/d73/d5c/df6 0 2023-12-06T15:00:27.077 INFO:tasks.workunit.client.1.smithi190.stdout:1/766: chown d6/dc/c32 0 1 2023-12-06T15:00:27.079 INFO:tasks.workunit.client.1.smithi190.stdout:6/662: mknod d4/d12/d1a/d59/cdc 0 2023-12-06T15:00:27.080 INFO:tasks.workunit.client.1.smithi190.stdout:1/767: mkdir d6/dc/d29/d38/d73/d76/df7 0 2023-12-06T15:00:27.081 INFO:tasks.workunit.client.0.smithi152.stdout:4/528: dwrite d2/d15/d32/f66 [4194304,4194304] 0 2023-12-06T15:00:27.081 INFO:tasks.workunit.client.0.smithi152.stdout:0/306: dread d8/d15/f2e [0,4194304] 0 2023-12-06T15:00:27.081 INFO:tasks.workunit.client.0.smithi152.stdout:0/307: readlink d8/d4b/l5c 0 2023-12-06T15:00:27.081 INFO:tasks.workunit.client.0.smithi152.stdout:0/308: readlink d8/l28 0 2023-12-06T15:00:27.082 INFO:tasks.workunit.client.1.smithi190.stdout:6/663: creat d4/d12/d9a/fdd x:0 0 0 2023-12-06T15:00:27.082 INFO:tasks.workunit.client.1.smithi190.stdout:6/664: write d4/d12/d1a/d44/f79 [887623,83970] 0 2023-12-06T15:00:27.086 INFO:tasks.workunit.client.0.smithi152.stdout:7/231: dread dd/df/d1b/d20/d28/f30 [0,4194304] 0 2023-12-06T15:00:27.087 INFO:tasks.workunit.client.0.smithi152.stdout:7/232: mknod dd/df/d34/d44/c45 0 2023-12-06T15:00:27.092 INFO:tasks.workunit.client.1.smithi190.stdout:9/557: rmdir d4/d27/d2f 39 2023-12-06T15:00:27.093 INFO:tasks.workunit.client.1.smithi190.stdout:3/599: sync 2023-12-06T15:00:27.093 INFO:tasks.workunit.client.1.smithi190.stdout:0/488: sync 2023-12-06T15:00:27.093 INFO:tasks.workunit.client.1.smithi190.stdout:2/466: sync 2023-12-06T15:00:27.093 INFO:tasks.workunit.client.1.smithi190.stdout:2/467: dread - d10/d26/d5c/d37/f9a zero size 2023-12-06T15:00:27.093 INFO:tasks.workunit.client.1.smithi190.stdout:3/600: write d4/d70/d19/d3a/d3b/f55 [895032,85329] 0 2023-12-06T15:00:27.094 INFO:tasks.workunit.client.1.smithi190.stdout:3/601: write d4/d70/d19/d3a/f73 [691259,4585] 0 2023-12-06T15:00:27.094 INFO:tasks.workunit.client.1.smithi190.stdout:3/602: truncate d4/d70/d53/d56/d94/fd8 737818 0 2023-12-06T15:00:27.094 INFO:tasks.workunit.client.1.smithi190.stdout:3/603: write d4/d70/d33/fbe [116480,130383] 0 2023-12-06T15:00:27.094 INFO:tasks.workunit.client.1.smithi190.stdout:0/489: getdents d0/da/d3e/d3a/d40/d6f 0 2023-12-06T15:00:27.094 INFO:tasks.workunit.client.1.smithi190.stdout:0/490: readlink d0/da/d3e/d3a/d40/l55 0 2023-12-06T15:00:27.095 INFO:tasks.workunit.client.1.smithi190.stdout:1/768: getdents d6/dc/d29/d38/d43/d7f 0 2023-12-06T15:00:27.098 INFO:tasks.workunit.client.1.smithi190.stdout:2/468: creat d10/d26/d5c/d37/d83/fa0 x:0 0 0 2023-12-06T15:00:27.100 INFO:tasks.workunit.client.1.smithi190.stdout:3/604: creat d4/d1b/fd9 x:0 0 0 2023-12-06T15:00:27.100 INFO:tasks.workunit.client.1.smithi190.stdout:3/605: dread - d4/d70/d19/d3a/f67 zero size 2023-12-06T15:00:27.100 INFO:tasks.workunit.client.1.smithi190.stdout:0/491: write d0/da/d3e/d2b/d37/f76 [1302218,86142] 0 2023-12-06T15:00:27.100 INFO:tasks.workunit.client.1.smithi190.stdout:0/492: write d0/da/d5a/d80/f8c [820328,22856] 0 2023-12-06T15:00:27.100 INFO:tasks.workunit.client.0.smithi152.stdout:1/508: dwrite d3/da/d15/f57 [0,4194304] 0 2023-12-06T15:00:27.101 INFO:tasks.workunit.client.0.smithi152.stdout:1/509: mknod d3/da/d15/d17/d58/da3/cc1 0 2023-12-06T15:00:27.102 INFO:tasks.workunit.client.1.smithi190.stdout:2/469: rename d10/d26/f34 to d10/d26/d5c/d37/d83/fa1 0 2023-12-06T15:00:27.103 INFO:tasks.workunit.client.1.smithi190.stdout:9/558: dread d4/f14 [0,4194304] 0 2023-12-06T15:00:27.103 INFO:tasks.workunit.client.1.smithi190.stdout:3/606: mknod d4/d1b/d54/d9c/d68/cda 0 2023-12-06T15:00:27.104 INFO:tasks.workunit.client.1.smithi190.stdout:3/607: dread d4/d70/d19/d3a/d3b/d72/f86 [0,4194304] 0 2023-12-06T15:00:27.104 INFO:tasks.workunit.client.1.smithi190.stdout:3/608: truncate d4/d1b/d77/fd3 618873 0 2023-12-06T15:00:27.106 INFO:tasks.workunit.client.1.smithi190.stdout:0/493: mkdir d0/da/d3e/d3a/d40/d6f/d9e 0 2023-12-06T15:00:27.106 INFO:tasks.workunit.client.0.smithi152.stdout:1/510: write d3/d44/fad [3561567,2506] 0 2023-12-06T15:00:27.107 INFO:tasks.workunit.client.1.smithi190.stdout:2/470: creat d10/d26/d5b/d7f/d8e/fa2 x:0 0 0 2023-12-06T15:00:27.107 INFO:tasks.workunit.client.1.smithi190.stdout:2/471: truncate d10/d26/d5c/d35/f50 681213 0 2023-12-06T15:00:27.108 INFO:tasks.workunit.client.1.smithi190.stdout:3/609: read d4/fbb [3217723,130582] 0 2023-12-06T15:00:27.109 INFO:tasks.workunit.client.1.smithi190.stdout:9/559: mkdir d4/d27/d8a/dbc 0 2023-12-06T15:00:27.111 INFO:tasks.workunit.client.1.smithi190.stdout:3/610: write d4/d70/d53/fad [3705942,76892] 0 2023-12-06T15:00:27.111 INFO:tasks.workunit.client.1.smithi190.stdout:3/611: stat d4/d70/d53/d56/d94/d3d/fc3 0 2023-12-06T15:00:27.111 INFO:tasks.workunit.client.1.smithi190.stdout:3/612: dread - d4/d70/d53/fc7 zero size 2023-12-06T15:00:27.111 INFO:tasks.workunit.client.1.smithi190.stdout:3/613: truncate d4/d1b/d54/f9e 143342 0 2023-12-06T15:00:27.111 INFO:tasks.workunit.client.1.smithi190.stdout:3/614: write d4/d70/d53/d56/d83/f88 [286617,80386] 0 2023-12-06T15:00:27.111 INFO:tasks.workunit.client.0.smithi152.stdout:1/511: write d3/d44/d84/fa9 [2339332,82495] 0 2023-12-06T15:00:27.112 INFO:tasks.workunit.client.0.smithi152.stdout:0/309: dwrite d8/d15/f2c [0,4194304] 0 2023-12-06T15:00:27.112 INFO:tasks.workunit.client.0.smithi152.stdout:0/310: fdatasync d8/d1b/f36 0 2023-12-06T15:00:27.113 INFO:tasks.workunit.client.1.smithi190.stdout:9/560: link d4/l5a d4/d27/d2f/d5c/d9d/lbd 0 2023-12-06T15:00:27.113 INFO:tasks.workunit.client.0.smithi152.stdout:1/512: symlink d3/da/db/lc2 0 2023-12-06T15:00:27.113 INFO:tasks.workunit.client.1.smithi190.stdout:7/591: sync 2023-12-06T15:00:27.113 INFO:tasks.workunit.client.1.smithi190.stdout:9/561: symlink d4/d27/d2f/d5c/lbe 0 2023-12-06T15:00:27.114 INFO:tasks.workunit.client.0.smithi152.stdout:0/311: rmdir d8/d38 39 2023-12-06T15:00:27.114 INFO:tasks.workunit.client.1.smithi190.stdout:7/592: mkdir d0/d88/d41/d92/dc1 0 2023-12-06T15:00:27.114 INFO:tasks.workunit.client.1.smithi190.stdout:9/562: truncate d4/d27/d2f/d31/d3f/d58/d7d/f9f 134440 0 2023-12-06T15:00:27.117 INFO:tasks.workunit.client.0.smithi152.stdout:1/513: creat d3/da/d4c/d82/d75/fc3 x:0 0 0 2023-12-06T15:00:27.117 INFO:tasks.workunit.client.0.smithi152.stdout:1/514: truncate d3/da/d15/d17/d58/fb6 94407 0 2023-12-06T15:00:27.117 INFO:tasks.workunit.client.0.smithi152.stdout:4/529: dwrite d2/d15/d32/d79/f82 [0,4194304] 0 2023-12-06T15:00:27.118 INFO:tasks.workunit.client.0.smithi152.stdout:7/233: dwrite dd/df/d1b/d20/d28/d38/d42/f2a [8388608,4194304] 0 2023-12-06T15:00:27.120 INFO:tasks.workunit.client.1.smithi190.stdout:9/563: write d4/f67 [2447237,49480] 0 2023-12-06T15:00:27.120 INFO:tasks.workunit.client.1.smithi190.stdout:9/564: fdatasync d4/d27/d2f/d31/d3f/f91 0 2023-12-06T15:00:27.123 INFO:tasks.workunit.client.0.smithi152.stdout:7/234: write f3 [3237809,40891] 0 2023-12-06T15:00:27.123 INFO:tasks.workunit.client.0.smithi152.stdout:4/530: dread d2/d15/f58 [0,4194304] 0 2023-12-06T15:00:27.125 INFO:tasks.workunit.client.1.smithi190.stdout:9/565: mknod d4/d27/d2f/d31/da6/cbf 0 2023-12-06T15:00:27.125 INFO:tasks.workunit.client.1.smithi190.stdout:9/566: write d4/d27/d2f/d31/d3f/d58/d72/f75 [26042,124822] 0 2023-12-06T15:00:27.125 INFO:tasks.workunit.client.1.smithi190.stdout:7/593: dread d0/d88/d33/d4c/f75 [0,4194304] 0 2023-12-06T15:00:27.125 INFO:tasks.workunit.client.0.smithi152.stdout:7/235: mknod dd/df/d1b/d20/d28/d38/c46 0 2023-12-06T15:00:27.125 INFO:tasks.workunit.client.0.smithi152.stdout:7/236: readlink dd/l19 0 2023-12-06T15:00:27.126 INFO:tasks.workunit.client.0.smithi152.stdout:7/237: fsync dd/df/d1b/d20/d28/f3e 0 2023-12-06T15:00:27.126 INFO:tasks.workunit.client.1.smithi190.stdout:9/567: write d4/fa [1789154,89037] 0 2023-12-06T15:00:27.127 INFO:tasks.workunit.client.0.smithi152.stdout:7/238: unlink dd/df/c14 0 2023-12-06T15:00:27.127 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:26 smithi152 ceph-mon[111954]: pgmap v25: 65 pgs: 65 active+clean; 1.3 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 69 MiB/s rd, 143 MiB/s wr, 237 op/s 2023-12-06T15:00:27.128 INFO:tasks.workunit.client.0.smithi152.stdout:1/515: write d3/da/db/f11 [214688,129490] 0 2023-12-06T15:00:27.128 INFO:tasks.workunit.client.1.smithi190.stdout:9/568: creat d4/d27/fc0 x:0 0 0 2023-12-06T15:00:27.129 INFO:tasks.workunit.client.0.smithi152.stdout:7/239: link dd/l1d dd/df/d1b/d20/d28/l47 0 2023-12-06T15:00:27.130 INFO:tasks.workunit.client.1.smithi190.stdout:0/494: rmdir d0/da/d3e/d3a 39 2023-12-06T15:00:27.130 INFO:tasks.workunit.client.0.smithi152.stdout:1/516: creat d3/d73/fc4 x:0 0 0 2023-12-06T15:00:27.130 INFO:tasks.workunit.client.0.smithi152.stdout:1/517: read d3/da/d15/d17/d1a/f5f [4440,78783] 0 2023-12-06T15:00:27.131 INFO:tasks.workunit.client.1.smithi190.stdout:0/495: getdents d0 0 2023-12-06T15:00:27.133 INFO:tasks.workunit.client.0.smithi152.stdout:1/518: link d3/da/db/l51 d3/da/d4c/d82/d75/lc5 0 2023-12-06T15:00:27.133 INFO:tasks.workunit.client.0.smithi152.stdout:1/519: dread - d3/da/d15/d17/d4d/f7f zero size 2023-12-06T15:00:27.134 INFO:tasks.workunit.client.0.smithi152.stdout:1/520: creat d3/da/d4c/d82/d52/d62/fc6 x:0 0 0 2023-12-06T15:00:27.134 INFO:tasks.workunit.client.1.smithi190.stdout:0/496: unlink d0/da/d3e/d2b/d3c/d4c/l6d 0 2023-12-06T15:00:27.134 INFO:tasks.workunit.client.1.smithi190.stdout:0/497: fdatasync d0/da/d3e/d2b/d37/f76 0 2023-12-06T15:00:27.135 INFO:tasks.workunit.client.1.smithi190.stdout:0/498: read d0/da/d3e/d2b/d3c/d46/f52 [2268728,22289] 0 2023-12-06T15:00:27.135 INFO:tasks.workunit.client.0.smithi152.stdout:1/521: symlink d3/lc7 0 2023-12-06T15:00:27.146 INFO:tasks.workunit.client.0.smithi152.stdout:7/240: dread f9 [0,4194304] 0 2023-12-06T15:00:27.147 INFO:tasks.workunit.client.1.smithi190.stdout:9/569: dread d4/f33 [0,4194304] 0 2023-12-06T15:00:27.147 INFO:tasks.workunit.client.0.smithi152.stdout:1/522: dread d3/da/d4c/d63/fa8 [0,4194304] 0 2023-12-06T15:00:27.147 INFO:tasks.workunit.client.0.smithi152.stdout:1/523: fdatasync d3/da/d15/d17/d43/f83 0 2023-12-06T15:00:27.149 INFO:tasks.workunit.client.1.smithi190.stdout:3/615: dwrite d4/d70/d33/d45/f76 [0,4194304] 0 2023-12-06T15:00:27.149 INFO:tasks.workunit.client.0.smithi152.stdout:1/524: creat d3/da/d4c/d82/db4/fc8 x:0 0 0 2023-12-06T15:00:27.149 INFO:tasks.workunit.client.0.smithi152.stdout:0/312: dwrite d8/d38/f5f [0,4194304] 0 2023-12-06T15:00:27.152 INFO:tasks.workunit.client.1.smithi190.stdout:7/594: dwrite d0/fbb [0,4194304] 0 2023-12-06T15:00:27.152 INFO:tasks.workunit.client.0.smithi152.stdout:0/313: symlink d8/d15/d45/l60 0 2023-12-06T15:00:27.152 INFO:tasks.workunit.client.0.smithi152.stdout:0/314: chown d8/d44/f5a 47 1 2023-12-06T15:00:27.152 INFO:tasks.workunit.client.0.smithi152.stdout:1/525: creat d3/da/d4c/fc9 x:0 0 0 2023-12-06T15:00:27.152 INFO:tasks.workunit.client.0.smithi152.stdout:7/241: write f8 [1588546,85048] 0 2023-12-06T15:00:27.154 INFO:tasks.workunit.client.1.smithi190.stdout:3/616: rename d4/d70/d53/d56/d8f/fa2 to d4/d70/d19/fdb 0 2023-12-06T15:00:27.155 INFO:tasks.workunit.client.1.smithi190.stdout:7/595: creat d0/d88/d33/fc2 x:0 0 0 2023-12-06T15:00:27.157 INFO:tasks.workunit.client.0.smithi152.stdout:1/526: truncate d3/da/d4c/d82/d52/d62/f72 2615844 0 2023-12-06T15:00:27.157 INFO:tasks.workunit.client.1.smithi190.stdout:7/596: rename d0/d5/da/d56/f8b to d0/d5/d63/fc3 0 2023-12-06T15:00:27.158 INFO:tasks.workunit.client.1.smithi190.stdout:0/499: dwrite d0/da/d3e/d3a/d40/f5e [0,4194304] 0 2023-12-06T15:00:27.159 INFO:tasks.workunit.client.1.smithi190.stdout:7/597: creat d0/d5/d63/fc4 x:0 0 0 2023-12-06T15:00:27.163 INFO:tasks.workunit.client.0.smithi152.stdout:7/242: rmdir dd/df/d1b/d20/d28/d38 39 2023-12-06T15:00:27.163 INFO:tasks.workunit.client.0.smithi152.stdout:0/315: dread d8/d15/f2c [0,4194304] 0 2023-12-06T15:00:27.163 INFO:tasks.workunit.client.0.smithi152.stdout:0/316: readlink d8/d1b/l35 0 2023-12-06T15:00:27.164 INFO:tasks.workunit.client.0.smithi152.stdout:0/317: fsync d8/f20 0 2023-12-06T15:00:27.164 INFO:tasks.workunit.client.0.smithi152.stdout:0/318: dread - d8/d15/d45/f4f zero size 2023-12-06T15:00:27.167 INFO:tasks.workunit.client.0.smithi152.stdout:7/243: link dd/df/d1b/d20/f35 dd/df/d1b/d20/d28/d38/d42/f48 0 2023-12-06T15:00:27.167 INFO:tasks.workunit.client.0.smithi152.stdout:7/244: fdatasync dd/df/d1b/f41 0 2023-12-06T15:00:27.167 INFO:tasks.workunit.client.0.smithi152.stdout:7/245: write f1 [1210948,28621] 0 2023-12-06T15:00:27.172 INFO:tasks.workunit.client.1.smithi190.stdout:9/570: dwrite d4/d27/d2f/d31/d3f/d58/d72/f75 [0,4194304] 0 2023-12-06T15:00:27.178 INFO:tasks.workunit.client.0.smithi152.stdout:7/246: dread f3 [0,4194304] 0 2023-12-06T15:00:27.178 INFO:tasks.workunit.client.0.smithi152.stdout:7/247: getdents dd 0 2023-12-06T15:00:27.179 INFO:tasks.workunit.client.0.smithi152.stdout:1/527: write d3/da/db/ff [256465,58447] 0 2023-12-06T15:00:27.179 INFO:tasks.workunit.client.1.smithi190.stdout:9/571: mknod d4/d27/d2f/d31/cc1 0 2023-12-06T15:00:27.180 INFO:tasks.workunit.client.1.smithi190.stdout:8/500: sync 2023-12-06T15:00:27.180 INFO:tasks.workunit.client.1.smithi190.stdout:5/433: sync 2023-12-06T15:00:27.180 INFO:tasks.workunit.client.1.smithi190.stdout:8/501: write d1/d10/d1c/f64 [8403824,39698] 0 2023-12-06T15:00:27.180 INFO:tasks.workunit.client.1.smithi190.stdout:8/502: stat d1/d20/d3b/d34/f40 0 2023-12-06T15:00:27.180 INFO:tasks.workunit.client.0.smithi152.stdout:1/528: symlink d3/da/d15/d17/d58/lca 0 2023-12-06T15:00:27.181 INFO:tasks.workunit.client.0.smithi152.stdout:1/529: chown d3/da/db/c5a 76828694 1 2023-12-06T15:00:27.181 INFO:tasks.workunit.client.0.smithi152.stdout:1/530: write d3/da/d4c/d82/d52/f8e [510916,45857] 0 2023-12-06T15:00:27.181 INFO:tasks.workunit.client.0.smithi152.stdout:1/531: write d3/da/d4c/d82/d52/d55/fbd [662546,97228] 0 2023-12-06T15:00:27.181 INFO:tasks.workunit.client.0.smithi152.stdout:1/532: creat d3/d73/fcb x:0 0 0 2023-12-06T15:00:27.181 INFO:tasks.workunit.client.0.smithi152.stdout:1/533: write d3/da/db/da0/fbe [681008,123548] 0 2023-12-06T15:00:27.182 INFO:tasks.workunit.client.1.smithi190.stdout:9/572: mknod d4/cc2 0 2023-12-06T15:00:27.182 INFO:tasks.workunit.client.1.smithi190.stdout:9/573: rmdir d4/d27/d2f/d5c/d9d 39 2023-12-06T15:00:27.184 INFO:tasks.workunit.client.1.smithi190.stdout:9/574: link d4/d27/d2f/d31/f50 d4/d27/d2f/d31/d3f/d58/d7d/fc3 0 2023-12-06T15:00:27.185 INFO:tasks.workunit.client.1.smithi190.stdout:9/575: fsync d4/f14 0 2023-12-06T15:00:27.185 INFO:tasks.workunit.client.1.smithi190.stdout:9/576: write d4/d27/d2f/d31/d3f/d58/d72/fa7 [332651,65305] 0 2023-12-06T15:00:27.185 INFO:tasks.workunit.client.1.smithi190.stdout:9/577: read d4/d27/d2f/d31/d3f/d58/d72/fa7 [102376,91438] 0 2023-12-06T15:00:27.189 INFO:tasks.workunit.client.0.smithi152.stdout:0/319: dwrite d8/fd [0,4194304] 0 2023-12-06T15:00:27.189 INFO:tasks.workunit.client.0.smithi152.stdout:0/320: dread - d8/d1b/f39 zero size 2023-12-06T15:00:27.189 INFO:tasks.workunit.client.0.smithi152.stdout:0/321: fsync d8/f20 0 2023-12-06T15:00:27.191 INFO:tasks.workunit.client.1.smithi190.stdout:3/617: dwrite d4/d70/d53/d56/d83/f88 [0,4194304] 0 2023-12-06T15:00:27.194 INFO:tasks.workunit.client.0.smithi152.stdout:0/322: link d8/f17 d8/d15/d45/f61 0 2023-12-06T15:00:27.194 INFO:tasks.workunit.client.0.smithi152.stdout:0/323: truncate d8/d3e/f52 269182 0 2023-12-06T15:00:27.195 INFO:tasks.workunit.client.0.smithi152.stdout:0/324: write d8/d3e/f57 [53776,20039] 0 2023-12-06T15:00:27.196 INFO:tasks.workunit.client.0.smithi152.stdout:0/325: mknod d8/d15/c62 0 2023-12-06T15:00:27.196 INFO:tasks.workunit.client.0.smithi152.stdout:0/326: chown d8/d38 2 1 2023-12-06T15:00:27.198 INFO:tasks.workunit.client.1.smithi190.stdout:3/618: creat d4/d1b/d77/fdc x:0 0 0 2023-12-06T15:00:27.198 INFO:tasks.workunit.client.1.smithi190.stdout:3/619: read d4/d70/d19/d3a/d3b/f55 [961176,56337] 0 2023-12-06T15:00:27.198 INFO:tasks.workunit.client.1.smithi190.stdout:3/620: chown d4/d70/d33/d45/f98 5912540 1 2023-12-06T15:00:27.198 INFO:tasks.workunit.client.0.smithi152.stdout:0/327: mknod d8/c63 0 2023-12-06T15:00:27.199 INFO:tasks.workunit.client.1.smithi190.stdout:3/621: creat d4/d70/d33/d45/fdd x:0 0 0 2023-12-06T15:00:27.199 INFO:tasks.workunit.client.1.smithi190.stdout:9/578: write d4/d27/d2f/d31/d3f/d58/f59 [3954577,115506] 0 2023-12-06T15:00:27.201 INFO:tasks.workunit.client.1.smithi190.stdout:3/622: link d4/d70/d7f/lb0 d4/d1b/d77/da8/db7/lde 0 2023-12-06T15:00:27.201 INFO:tasks.workunit.client.1.smithi190.stdout:3/623: truncate d4/d70/d19/d3a/f7b 104594 0 2023-12-06T15:00:27.201 INFO:tasks.workunit.client.0.smithi152.stdout:0/328: dread d8/d38/f59 [0,4194304] 0 2023-12-06T15:00:27.202 INFO:tasks.workunit.client.0.smithi152.stdout:0/329: mkdir d8/d44/d64 0 2023-12-06T15:00:27.203 INFO:tasks.workunit.client.0.smithi152.stdout:0/330: rename d8/f9 to d8/d4b/f65 0 2023-12-06T15:00:27.204 INFO:tasks.workunit.client.0.smithi152.stdout:0/331: write d8/d38/f59 [879375,4021] 0 2023-12-06T15:00:27.204 INFO:tasks.workunit.client.1.smithi190.stdout:3/624: read d4/d1b/f38 [2231741,70564] 0 2023-12-06T15:00:27.204 INFO:tasks.workunit.client.1.smithi190.stdout:3/625: fdatasync d4/d70/d19/d3a/d3b/fc2 0 2023-12-06T15:00:27.204 INFO:tasks.workunit.client.1.smithi190.stdout:3/626: read - d4/d70/d53/d56/d83/f87 zero size 2023-12-06T15:00:27.205 INFO:tasks.workunit.client.0.smithi152.stdout:0/332: rename d8/d4b/l5c to d8/d15/d45/l66 0 2023-12-06T15:00:27.205 INFO:tasks.workunit.client.1.smithi190.stdout:3/627: rename d4/d70/d53/d56/d8f to d4/d70/d19/d3a/ddf 0 2023-12-06T15:00:27.206 INFO:tasks.workunit.client.1.smithi190.stdout:5/434: dwrite d0/df/f20 [0,4194304] 0 2023-12-06T15:00:27.207 INFO:tasks.workunit.client.1.smithi190.stdout:3/628: creat d4/d70/d53/d56/fe0 x:0 0 0 2023-12-06T15:00:27.209 INFO:tasks.workunit.client.1.smithi190.stdout:5/435: rename d0/f89 to d0/d1c/d85/f91 0 2023-12-06T15:00:27.209 INFO:tasks.workunit.client.1.smithi190.stdout:5/436: dread - d0/f82 zero size 2023-12-06T15:00:27.209 INFO:tasks.workunit.client.1.smithi190.stdout:3/629: mknod d4/d70/d19/ce1 0 2023-12-06T15:00:27.209 INFO:tasks.workunit.client.1.smithi190.stdout:3/630: stat d4/d70/d19/d3a 0 2023-12-06T15:00:27.210 INFO:tasks.workunit.client.1.smithi190.stdout:3/631: chown d4/d1b/d77/da8 2977401 1 2023-12-06T15:00:27.210 INFO:tasks.workunit.client.1.smithi190.stdout:5/437: creat d0/d1c/d3e/d7e/f92 x:0 0 0 2023-12-06T15:00:27.212 INFO:tasks.workunit.client.0.smithi152.stdout:1/534: dwrite d3/fd [0,4194304] 0 2023-12-06T15:00:27.212 INFO:tasks.workunit.client.0.smithi152.stdout:1/535: truncate d3/da/d15/d17/d4d/f8a 355425 0 2023-12-06T15:00:27.212 INFO:tasks.workunit.client.0.smithi152.stdout:0/333: read d8/ff [593327,76337] 0 2023-12-06T15:00:27.214 INFO:tasks.workunit.client.0.smithi152.stdout:1/536: unlink d3/da/d4c/d82/d75/f79 0 2023-12-06T15:00:27.215 INFO:tasks.workunit.client.0.smithi152.stdout:0/334: rename d8/d1b/f2f to d8/f67 0 2023-12-06T15:00:27.216 INFO:tasks.workunit.client.0.smithi152.stdout:1/537: mkdir d3/da/d4c/d82/d52/d62/dcc 0 2023-12-06T15:00:27.216 INFO:tasks.workunit.client.0.smithi152.stdout:1/538: write d3/da/d15/d17/d43/f66 [1185685,78931] 0 2023-12-06T15:00:27.217 INFO:tasks.workunit.client.0.smithi152.stdout:0/335: mkdir d8/d44/d64/d68 0 2023-12-06T15:00:27.218 INFO:tasks.workunit.client.0.smithi152.stdout:0/336: creat d8/d3e/f69 x:0 0 0 2023-12-06T15:00:27.218 INFO:tasks.workunit.client.0.smithi152.stdout:1/539: write d3/fd [1916727,24110] 0 2023-12-06T15:00:27.218 INFO:tasks.workunit.client.0.smithi152.stdout:1/540: write d3/da/d4c/d82/d52/f9c [202876,12211] 0 2023-12-06T15:00:27.222 INFO:tasks.workunit.client.1.smithi190.stdout:3/632: dread d4/d70/d53/d56/fa7 [0,4194304] 0 2023-12-06T15:00:27.223 INFO:tasks.workunit.client.1.smithi190.stdout:3/633: mkdir d4/d70/d53/d56/d83/de2 0 2023-12-06T15:00:27.223 INFO:tasks.workunit.client.1.smithi190.stdout:3/634: rmdir d4 39 2023-12-06T15:00:27.225 INFO:tasks.workunit.client.1.smithi190.stdout:3/635: creat d4/d1b/d5d/fe3 x:0 0 0 2023-12-06T15:00:27.225 INFO:tasks.workunit.client.1.smithi190.stdout:3/636: fdatasync d4/d1b/d54/f60 0 2023-12-06T15:00:27.225 INFO:tasks.workunit.client.1.smithi190.stdout:9/579: dwrite d4/d27/d8a/f94 [0,4194304] 0 2023-12-06T15:00:27.225 INFO:tasks.workunit.client.1.smithi190.stdout:9/580: chown d4/d27/d2f/d31/f50 162 1 2023-12-06T15:00:27.225 INFO:tasks.workunit.client.1.smithi190.stdout:9/581: read d4/f67 [2324206,29273] 0 2023-12-06T15:00:27.225 INFO:tasks.workunit.client.1.smithi190.stdout:9/582: truncate d4/d27/d8a/fae 582844 0 2023-12-06T15:00:27.226 INFO:tasks.workunit.client.1.smithi190.stdout:3/637: unlink d4/d70/la4 0 2023-12-06T15:00:27.226 INFO:tasks.workunit.client.1.smithi190.stdout:9/583: write d4/d27/d2f/d5c/f82 [1443978,94861] 0 2023-12-06T15:00:27.226 INFO:tasks.workunit.client.1.smithi190.stdout:9/584: fsync d4/d27/d2f/d31/d3f/d58/d72/d7a/f7f 0 2023-12-06T15:00:27.227 INFO:tasks.workunit.client.1.smithi190.stdout:3/638: rmdir d4/d1b/d54/d9c/d68 39 2023-12-06T15:00:27.227 INFO:tasks.workunit.client.0.smithi152.stdout:7/248: dwrite dd/df/d1b/d20/d28/f30 [0,4194304] 0 2023-12-06T15:00:27.227 INFO:tasks.workunit.client.0.smithi152.stdout:1/541: dread d3/da/d4c/d63/fa8 [0,4194304] 0 2023-12-06T15:00:27.227 INFO:tasks.workunit.client.0.smithi152.stdout:7/249: fsync dd/df/d1b/d20/f35 0 2023-12-06T15:00:27.227 INFO:tasks.workunit.client.0.smithi152.stdout:7/250: chown dd/df/f3b 1 1 2023-12-06T15:00:27.228 INFO:tasks.workunit.client.1.smithi190.stdout:3/639: truncate d4/d1b/d54/d9c/fb2 75359 0 2023-12-06T15:00:27.230 INFO:tasks.workunit.client.1.smithi190.stdout:9/585: write d4/d27/f6a [1909326,41691] 0 2023-12-06T15:00:27.233 INFO:tasks.workunit.client.1.smithi190.stdout:9/586: dread d4/f22 [0,4194304] 0 2023-12-06T15:00:27.235 INFO:tasks.workunit.client.1.smithi190.stdout:9/587: write d4/d27/d8a/f94 [881982,32579] 0 2023-12-06T15:00:27.235 INFO:tasks.workunit.client.1.smithi190.stdout:9/588: read - d4/d27/d8a/f95 zero size 2023-12-06T15:00:27.236 INFO:tasks.workunit.client.1.smithi190.stdout:9/589: mknod d4/d27/d2f/d31/d3f/d58/d72/cc4 0 2023-12-06T15:00:27.237 INFO:tasks.workunit.client.1.smithi190.stdout:9/590: mkdir d4/d27/d2f/d31/d3f/d58/dc5 0 2023-12-06T15:00:27.237 INFO:tasks.workunit.client.1.smithi190.stdout:9/591: readlink d4/d27/d2f/d31/la5 0 2023-12-06T15:00:27.249 INFO:tasks.workunit.client.0.smithi152.stdout:0/337: mknod d8/d15/d45/c6a 0 2023-12-06T15:00:27.249 INFO:tasks.workunit.client.0.smithi152.stdout:0/338: stat d8/d38/f59 0 2023-12-06T15:00:27.263 INFO:tasks.workunit.client.0.smithi152.stdout:1/542: mkdir d3/da/dcd 0 2023-12-06T15:00:27.264 INFO:tasks.workunit.client.1.smithi190.stdout:3/640: dread d4/d70/d53/fad [0,4194304] 0 2023-12-06T15:00:27.265 INFO:tasks.workunit.client.0.smithi152.stdout:1/543: creat d3/da/db/d54/fce x:0 0 0 2023-12-06T15:00:27.266 INFO:tasks.workunit.client.0.smithi152.stdout:1/544: mknod d3/da/d15/dac/ccf 0 2023-12-06T15:00:27.266 INFO:tasks.workunit.client.1.smithi190.stdout:3/641: rmdir d4/d70/d7f 39 2023-12-06T15:00:27.266 INFO:tasks.workunit.client.0.smithi152.stdout:1/545: dread d3/da/d65/f77 [0,4194304] 0 2023-12-06T15:00:27.268 INFO:tasks.workunit.client.1.smithi190.stdout:3/642: unlink d4/d70/d19/d3a/f67 0 2023-12-06T15:00:27.268 INFO:tasks.workunit.client.1.smithi190.stdout:3/643: fsync d4/d70/d33/d45/f76 0 2023-12-06T15:00:27.268 INFO:tasks.workunit.client.0.smithi152.stdout:0/339: dwrite d8/fd [0,4194304] 0 2023-12-06T15:00:27.268 INFO:tasks.workunit.client.0.smithi152.stdout:0/340: readlink d8/d1b/l1d 0 2023-12-06T15:00:27.268 INFO:tasks.workunit.client.0.smithi152.stdout:0/341: fsync d8/d38/f53 0 2023-12-06T15:00:27.268 INFO:tasks.workunit.client.0.smithi152.stdout:0/342: chown d8/fa 12732137 1 2023-12-06T15:00:27.268 INFO:tasks.workunit.client.0.smithi152.stdout:1/546: mknod d3/da/d4c/d82/d52/d62/cd0 0 2023-12-06T15:00:27.272 INFO:tasks.workunit.client.0.smithi152.stdout:0/343: creat d8/d4b/f6b x:0 0 0 2023-12-06T15:00:27.272 INFO:tasks.workunit.client.0.smithi152.stdout:0/344: dread - d8/f20 zero size 2023-12-06T15:00:27.276 INFO:tasks.workunit.client.0.smithi152.stdout:0/345: mknod d8/d4b/c6c 0 2023-12-06T15:00:27.276 INFO:tasks.workunit.client.0.smithi152.stdout:1/547: rename d3/d44/f46 to d3/da/fd1 0 2023-12-06T15:00:27.285 INFO:tasks.workunit.client.1.smithi190.stdout:3/644: dwrite d4/d1b/d54/f9e [0,4194304] 0 2023-12-06T15:00:27.290 INFO:tasks.workunit.client.0.smithi152.stdout:8/222: sync 2023-12-06T15:00:27.290 INFO:tasks.workunit.client.0.smithi152.stdout:5/313: sync 2023-12-06T15:00:27.290 INFO:tasks.workunit.client.0.smithi152.stdout:6/529: sync 2023-12-06T15:00:27.294 INFO:tasks.workunit.client.0.smithi152.stdout:0/346: dwrite d8/d3e/f69 [0,4194304] 0 2023-12-06T15:00:27.295 INFO:tasks.workunit.client.0.smithi152.stdout:6/530: creat d1/d1c/d79/d1a/d30/d36/d35/d61/fc9 x:0 0 0 2023-12-06T15:00:27.296 INFO:tasks.workunit.client.0.smithi152.stdout:5/314: read d7/dd/f1c [791595,78618] 0 2023-12-06T15:00:27.296 INFO:tasks.workunit.client.0.smithi152.stdout:5/315: truncate d7/dd/d26/d3b/f63 97737 0 2023-12-06T15:00:27.296 INFO:tasks.workunit.client.0.smithi152.stdout:5/316: chown d7/dd/ff 49815 1 2023-12-06T15:00:27.296 INFO:tasks.workunit.client.0.smithi152.stdout:8/223: mknod d1/d6/d34/c3f 0 2023-12-06T15:00:27.300 INFO:tasks.workunit.client.0.smithi152.stdout:6/531: mknod d1/d1c/d79/d1a/d30/d36/d35/d49/d57/cca 0 2023-12-06T15:00:27.301 INFO:tasks.workunit.client.0.smithi152.stdout:5/317: mkdir d7/d43/d6c 0 2023-12-06T15:00:27.301 INFO:tasks.workunit.client.0.smithi152.stdout:5/318: truncate d7/dd/f2c 2704578 0 2023-12-06T15:00:27.301 INFO:tasks.workunit.client.0.smithi152.stdout:5/319: readlink d7/dd/l5d 0 2023-12-06T15:00:27.302 INFO:tasks.workunit.client.0.smithi152.stdout:6/532: symlink d1/d1c/d79/d1a/d30/d36/d35/d49/da6/da9/lcb 0 2023-12-06T15:00:27.307 INFO:tasks.workunit.client.0.smithi152.stdout:6/533: dread d1/d1c/d79/d1a/d30/d36/d35/f47 [0,4194304] 0 2023-12-06T15:00:27.309 INFO:tasks.workunit.client.0.smithi152.stdout:6/534: truncate d1/d1c/d79/d1a/d30/d36/f24 759054 0 2023-12-06T15:00:27.311 INFO:tasks.workunit.client.0.smithi152.stdout:6/535: unlink d1/d69/da1/d87/f17 0 2023-12-06T15:00:27.311 INFO:tasks.workunit.client.0.smithi152.stdout:6/536: write d1/d1c/d79/d6d/f80 [857626,67887] 0 2023-12-06T15:00:27.312 INFO:tasks.workunit.client.0.smithi152.stdout:6/537: symlink d1/d1c/d79/d1a/d30/d36/d35/d61/lcc 0 2023-12-06T15:00:27.318 INFO:tasks.workunit.client.0.smithi152.stdout:6/538: write d1/d1c/d79/d1a/d30/f34 [2604812,36129] 0 2023-12-06T15:00:27.318 INFO:tasks.workunit.client.0.smithi152.stdout:6/539: truncate d1/fbe 1355478 0 2023-12-06T15:00:27.318 INFO:tasks.workunit.client.0.smithi152.stdout:1/548: dwrite d3/f1c [0,4194304] 0 2023-12-06T15:00:27.319 INFO:tasks.workunit.client.0.smithi152.stdout:6/540: symlink d1/d1c/d79/d1a/d30/d36/d35/lcd 0 2023-12-06T15:00:27.320 INFO:tasks.workunit.client.0.smithi152.stdout:1/549: symlink d3/da/d4c/d82/db4/ld2 0 2023-12-06T15:00:27.320 INFO:tasks.workunit.client.0.smithi152.stdout:6/541: symlink d1/d1c/d79/d1a/d30/d18/dc5/lce 0 2023-12-06T15:00:27.325 INFO:tasks.workunit.client.1.smithi190.stdout:3/645: dwrite d4/d70/d19/d3a/d3b/d72/f86 [0,4194304] 0 2023-12-06T15:00:27.326 INFO:tasks.workunit.client.0.smithi152.stdout:8/224: dwrite d1/d6/d34/d36/f11 [0,4194304] 0 2023-12-06T15:00:27.327 INFO:tasks.workunit.client.1.smithi190.stdout:3/646: rmdir d4/d70/d19/d3a/d3b/d72 39 2023-12-06T15:00:27.328 INFO:tasks.workunit.client.1.smithi190.stdout:3/647: write d4/d70/f9b [2943830,98128] 0 2023-12-06T15:00:27.329 INFO:tasks.workunit.client.0.smithi152.stdout:8/225: mkdir d1/d6/d34/d40 0 2023-12-06T15:00:27.330 INFO:tasks.workunit.client.0.smithi152.stdout:8/226: creat d1/d6/d34/d35/d38/f41 x:0 0 0 2023-12-06T15:00:27.330 INFO:tasks.workunit.client.1.smithi190.stdout:3/648: creat d4/d1b/d54/d9c/d68/d8a/fe4 x:0 0 0 2023-12-06T15:00:27.330 INFO:tasks.workunit.client.1.smithi190.stdout:3/649: write d4/d1b/d54/f60 [1305178,89184] 0 2023-12-06T15:00:27.331 INFO:tasks.workunit.client.0.smithi152.stdout:8/227: write d1/d6/d34/d36/f11 [1569407,66757] 0 2023-12-06T15:00:27.332 INFO:tasks.workunit.client.1.smithi190.stdout:3/650: write d4/d70/d33/d45/f98 [732020,97577] 0 2023-12-06T15:00:27.333 INFO:tasks.workunit.client.0.smithi152.stdout:8/228: getdents d1/d6/d34/d36 0 2023-12-06T15:00:27.333 INFO:tasks.workunit.client.0.smithi152.stdout:8/229: write d1/d6/d34/d36/f2b [1654222,60584] 0 2023-12-06T15:00:27.333 INFO:tasks.workunit.client.0.smithi152.stdout:8/230: readlink d1/l23 0 2023-12-06T15:00:27.333 INFO:tasks.workunit.client.0.smithi152.stdout:8/231: rmdir d1/d6/d34/d35 39 2023-12-06T15:00:27.333 INFO:tasks.workunit.client.0.smithi152.stdout:8/232: readlink d1/d6/d34/d36/l2c 0 2023-12-06T15:00:27.333 INFO:tasks.workunit.client.0.smithi152.stdout:8/233: creat d1/f42 x:0 0 0 2023-12-06T15:00:27.335 INFO:tasks.workunit.client.1.smithi190.stdout:3/651: write d4/d1b/d54/fb1 [2751093,115677] 0 2023-12-06T15:00:27.336 INFO:tasks.workunit.client.1.smithi190.stdout:3/652: symlink d4/d70/d53/dc4/le5 0 2023-12-06T15:00:27.336 INFO:tasks.workunit.client.1.smithi190.stdout:3/653: write d4/d70/d53/d56/d94/d3d/fc3 [715705,32768] 0 2023-12-06T15:00:27.337 INFO:tasks.workunit.client.1.smithi190.stdout:3/654: rmdir d4/d70/d19/d3a/d3b 39 2023-12-06T15:00:27.340 INFO:tasks.workunit.client.0.smithi152.stdout:8/234: dread d1/f2d [0,4194304] 0 2023-12-06T15:00:27.340 INFO:tasks.workunit.client.0.smithi152.stdout:8/235: rename d1/d6 to d1/d6/d34/d40/d43 22 2023-12-06T15:00:27.341 INFO:tasks.workunit.client.0.smithi152.stdout:8/236: mknod d1/d6/d29/c44 0 2023-12-06T15:00:27.342 INFO:tasks.workunit.client.0.smithi152.stdout:8/237: creat d1/d6/d34/d35/d38/f45 x:0 0 0 2023-12-06T15:00:27.343 INFO:tasks.workunit.client.0.smithi152.stdout:8/238: mknod d1/d6/d34/d35/c46 0 2023-12-06T15:00:27.343 INFO:tasks.workunit.client.0.smithi152.stdout:8/239: chown d1/l20 7 1 2023-12-06T15:00:27.350 INFO:tasks.workunit.client.0.smithi152.stdout:8/240: write d1/d6/d34/fa [1150453,1287] 0 2023-12-06T15:00:27.350 INFO:tasks.workunit.client.1.smithi190.stdout:3/655: dwrite d4/d70/d53/d56/d94/f81 [0,4194304] 0 2023-12-06T15:00:27.351 INFO:tasks.workunit.client.0.smithi152.stdout:8/241: symlink d1/d6/d34/d3a/l47 0 2023-12-06T15:00:27.354 INFO:tasks.workunit.client.1.smithi190.stdout:3/656: rename d4/d70/d33/l35 to d4/d1b/d54/d9c/d68/le6 0 2023-12-06T15:00:27.408 INFO:tasks.workunit.client.0.smithi152.stdout:6/542: dread d1/d69/da1/d87/fb [0,4194304] 0 2023-12-06T15:00:27.409 INFO:tasks.workunit.client.0.smithi152.stdout:6/543: mkdir d1/dcf 0 2023-12-06T15:00:27.410 INFO:tasks.workunit.client.0.smithi152.stdout:6/544: symlink d1/d69/da1/d87/ld0 0 2023-12-06T15:00:27.411 INFO:tasks.workunit.client.0.smithi152.stdout:6/545: mkdir d1/d1c/d79/d1a/d30/d36/d35/dd1 0 2023-12-06T15:00:27.411 INFO:tasks.workunit.client.0.smithi152.stdout:6/546: chown d1/d1c/d79/d1a/d30/d36/d35/d63/f9b 1861 1 2023-12-06T15:00:27.412 INFO:tasks.workunit.client.0.smithi152.stdout:6/547: write d1/d1c/d79/d1a/d30/d36/f64 [2311433,43980] 0 2023-12-06T15:00:27.414 INFO:tasks.workunit.client.0.smithi152.stdout:6/548: symlink d1/d1c/d79/d1a/d30/daa/ld2 0 2023-12-06T15:00:27.414 INFO:tasks.workunit.client.0.smithi152.stdout:0/347: dwrite d8/f3f [0,4194304] 0 2023-12-06T15:00:27.416 INFO:tasks.workunit.client.0.smithi152.stdout:8/242: dwrite d1/d6/d34/d36/f14 [0,4194304] 0 2023-12-06T15:00:27.416 INFO:tasks.workunit.client.0.smithi152.stdout:1/550: dwrite d3/da/d4c/d63/fa8 [0,4194304] 0 2023-12-06T15:00:27.416 INFO:tasks.workunit.client.1.smithi190.stdout:4/469: sync 2023-12-06T15:00:27.417 INFO:tasks.workunit.client.1.smithi190.stdout:0/500: sync 2023-12-06T15:00:27.417 INFO:tasks.workunit.client.1.smithi190.stdout:7/598: sync 2023-12-06T15:00:27.417 INFO:tasks.workunit.client.1.smithi190.stdout:6/665: sync 2023-12-06T15:00:27.417 INFO:tasks.workunit.client.1.smithi190.stdout:6/666: readlink d4/d12/d40/d43/d45/la5 0 2023-12-06T15:00:27.417 INFO:tasks.workunit.client.1.smithi190.stdout:0/501: chown d0/da/d3e/d2b/f69 167 1 2023-12-06T15:00:27.417 INFO:tasks.workunit.client.1.smithi190.stdout:2/472: sync 2023-12-06T15:00:27.417 INFO:tasks.workunit.client.1.smithi190.stdout:1/769: sync 2023-12-06T15:00:27.418 INFO:tasks.workunit.client.1.smithi190.stdout:0/502: write d0/f50 [1613230,7165] 0 2023-12-06T15:00:27.419 INFO:tasks.workunit.client.1.smithi190.stdout:0/503: fsync d0/da/d3e/d2b/d3c/f71 0 2023-12-06T15:00:27.419 INFO:tasks.workunit.client.1.smithi190.stdout:4/470: truncate d3/d35/d19/f79 2389503 0 2023-12-06T15:00:27.419 INFO:tasks.workunit.client.1.smithi190.stdout:7/599: symlink d0/d88/d33/lc5 0 2023-12-06T15:00:27.419 INFO:tasks.workunit.client.1.smithi190.stdout:6/667: symlink d4/d12/d1a/d32/dc7/dd0/lde 0 2023-12-06T15:00:27.422 INFO:tasks.workunit.client.1.smithi190.stdout:0/504: mknod d0/da/d3e/d2b/d3c/d46/d8e/d90/c9f 0 2023-12-06T15:00:27.422 INFO:tasks.workunit.client.1.smithi190.stdout:0/505: truncate d0/f86 1062182 0 2023-12-06T15:00:27.426 INFO:tasks.workunit.client.1.smithi190.stdout:4/471: rename d3/d10 to d3/d76/d7c/d96 0 2023-12-06T15:00:27.427 INFO:tasks.workunit.client.0.smithi152.stdout:8/243: rename d1/d6/d34/d36/f14 to d1/d6/d34/d3a/f48 0 2023-12-06T15:00:27.431 INFO:tasks.workunit.client.0.smithi152.stdout:8/244: unlink d1/d6/f22 0 2023-12-06T15:00:27.431 INFO:tasks.workunit.client.0.smithi152.stdout:8/245: write d1/d6/d29/f33 [395894,34379] 0 2023-12-06T15:00:27.431 INFO:tasks.workunit.client.1.smithi190.stdout:7/600: symlink d0/d5/da/lc6 0 2023-12-06T15:00:27.431 INFO:tasks.workunit.client.1.smithi190.stdout:7/601: chown d0/d88/c24 327034080 1 2023-12-06T15:00:27.434 INFO:tasks.workunit.client.1.smithi190.stdout:6/668: link d4/d12/d1a/f1c d4/d12/d1a/d8a/fdf 0 2023-12-06T15:00:27.434 INFO:tasks.workunit.client.1.smithi190.stdout:5/438: sync 2023-12-06T15:00:27.435 INFO:tasks.workunit.client.1.smithi190.stdout:8/503: sync 2023-12-06T15:00:27.435 INFO:tasks.workunit.client.1.smithi190.stdout:1/770: mknod d6/d49/cf8 0 2023-12-06T15:00:27.436 INFO:tasks.workunit.client.1.smithi190.stdout:9/592: sync 2023-12-06T15:00:27.442 INFO:tasks.workunit.client.1.smithi190.stdout:4/472: mkdir d3/d35/d97 0 2023-12-06T15:00:27.442 INFO:tasks.workunit.client.1.smithi190.stdout:1/771: creat d6/dc/ff9 x:0 0 0 2023-12-06T15:00:27.444 INFO:tasks.workunit.client.0.smithi152.stdout:6/549: dwrite d1/d1c/d79/d1a/d30/f84 [0,4194304] 0 2023-12-06T15:00:27.445 INFO:tasks.workunit.client.1.smithi190.stdout:9/593: rename d4/d27/d2f/d5c/lbe to d4/d27/d2f/d31/d3f/d58/lc6 0 2023-12-06T15:00:27.449 INFO:tasks.workunit.client.0.smithi152.stdout:6/550: mknod d1/d1c/d79/d1a/cd3 0 2023-12-06T15:00:27.449 INFO:tasks.workunit.client.0.smithi152.stdout:6/551: read - d1/d1c/d79/d1a/d30/d36/d35/d49/d57/f68 zero size 2023-12-06T15:00:27.449 INFO:tasks.workunit.client.1.smithi190.stdout:1/772: symlink d6/d49/lfa 0 2023-12-06T15:00:27.449 INFO:tasks.workunit.client.1.smithi190.stdout:0/506: dread d0/da/d3e/d2b/d3c/f60 [0,4194304] 0 2023-12-06T15:00:27.449 INFO:tasks.workunit.client.1.smithi190.stdout:0/507: creat d0/da/d3e/d2b/d3c/d46/d8e/fa0 x:0 0 0 2023-12-06T15:00:27.450 INFO:tasks.workunit.client.1.smithi190.stdout:9/594: creat d4/d27/d2f/d31/d3f/d58/d72/db3/fc7 x:0 0 0 2023-12-06T15:00:27.451 INFO:tasks.workunit.client.1.smithi190.stdout:0/508: mknod d0/d9d/ca1 0 2023-12-06T15:00:27.451 INFO:tasks.workunit.client.1.smithi190.stdout:0/509: fdatasync d0/da/d3e/d3a/f7f 0 2023-12-06T15:00:27.452 INFO:tasks.workunit.client.0.smithi152.stdout:0/348: dwrite d8/d3e/f43 [0,4194304] 0 2023-12-06T15:00:27.453 INFO:tasks.workunit.client.0.smithi152.stdout:0/349: truncate d8/d4b/f6b 224745 0 2023-12-06T15:00:27.454 INFO:tasks.workunit.client.1.smithi190.stdout:9/595: read d4/d27/d2f/d31/f50 [2163643,27180] 0 2023-12-06T15:00:27.456 INFO:tasks.workunit.client.0.smithi152.stdout:0/350: creat d8/f6d x:0 0 0 2023-12-06T15:00:27.456 INFO:tasks.workunit.client.1.smithi190.stdout:0/510: mkdir d0/da/d74/da2 0 2023-12-06T15:00:27.460 INFO:tasks.workunit.client.0.smithi152.stdout:6/552: write d1/d69/da1/d87/f9 [952638,121417] 0 2023-12-06T15:00:27.460 INFO:tasks.workunit.client.0.smithi152.stdout:0/351: mkdir d8/d44/d64/d6e 0 2023-12-06T15:00:27.460 INFO:tasks.workunit.client.0.smithi152.stdout:0/352: write d8/d44/f46 [130757,118596] 0 2023-12-06T15:00:27.460 INFO:tasks.workunit.client.0.smithi152.stdout:0/353: fdatasync d8/d4b/f51 0 2023-12-06T15:00:27.461 INFO:tasks.workunit.client.0.smithi152.stdout:6/553: rmdir d1/d69/da1 39 2023-12-06T15:00:27.462 INFO:tasks.workunit.client.1.smithi190.stdout:9/596: truncate d4/d27/d2f/d66/fb4 2836382 0 2023-12-06T15:00:27.462 INFO:tasks.workunit.client.1.smithi190.stdout:9/597: fdatasync d4/fe 0 2023-12-06T15:00:27.463 INFO:tasks.workunit.client.1.smithi190.stdout:0/511: creat d0/da/fa3 x:0 0 0 2023-12-06T15:00:27.463 INFO:tasks.workunit.client.0.smithi152.stdout:0/354: mkdir d8/d3e/d6f 0 2023-12-06T15:00:27.463 INFO:tasks.workunit.client.0.smithi152.stdout:0/355: write d8/d1b/f39 [71366,25037] 0 2023-12-06T15:00:27.463 INFO:tasks.workunit.client.0.smithi152.stdout:6/554: link d1/d1c/d79/d1a/l51 d1/d1c/d79/d1a/d30/d36/d35/dd1/ld4 0 2023-12-06T15:00:27.465 INFO:tasks.workunit.client.1.smithi190.stdout:9/598: link d4/d27/d2f/d31/cab d4/d27/d2f/d5c/cc8 0 2023-12-06T15:00:27.467 INFO:tasks.workunit.client.1.smithi190.stdout:9/599: creat d4/d27/d2f/d31/fc9 x:0 0 0 2023-12-06T15:00:27.483 INFO:tasks.workunit.client.0.smithi152.stdout:6/555: dread d1/d75/f7d [0,4194304] 0 2023-12-06T15:00:27.483 INFO:tasks.workunit.client.1.smithi190.stdout:0/512: write d0/da/d3e/d3a/f7f [3719410,72160] 0 2023-12-06T15:00:27.485 INFO:tasks.workunit.client.0.smithi152.stdout:6/556: mknod d1/d89/cd5 0 2023-12-06T15:00:27.485 INFO:tasks.workunit.client.0.smithi152.stdout:6/557: write d1/d69/da1/d87/d15/f8e [107409,85103] 0 2023-12-06T15:00:27.485 INFO:tasks.workunit.client.0.smithi152.stdout:6/558: truncate d1/d1c/d79/d4b/fb1 283500 0 2023-12-06T15:00:27.487 INFO:tasks.workunit.client.1.smithi190.stdout:2/473: dwrite d10/d26/d5c/d37/f38 [0,4194304] 0 2023-12-06T15:00:27.487 INFO:tasks.workunit.client.0.smithi152.stdout:6/559: rmdir d1/d1c/d79/d1a/d30/d36/d4e/d55/d9f 0 2023-12-06T15:00:27.488 INFO:tasks.workunit.client.1.smithi190.stdout:7/602: dwrite d0/d5/f7f [0,4194304] 0 2023-12-06T15:00:27.489 INFO:tasks.workunit.client.0.smithi152.stdout:6/560: truncate d1/f13 4707795 0 2023-12-06T15:00:27.489 INFO:tasks.workunit.client.0.smithi152.stdout:6/561: write d1/d1c/d79/d1a/d30/d36/d35/d61/f85 [782317,56120] 0 2023-12-06T15:00:27.491 INFO:tasks.workunit.client.1.smithi190.stdout:7/603: creat d0/d88/d32/fc7 x:0 0 0 2023-12-06T15:00:27.491 INFO:tasks.workunit.client.1.smithi190.stdout:7/604: chown d0/d88/d1c/d17/f64 13 1 2023-12-06T15:00:27.491 INFO:tasks.workunit.client.1.smithi190.stdout:7/605: chown d0/d88/d1c/l73 704 1 2023-12-06T15:00:27.491 INFO:tasks.workunit.client.1.smithi190.stdout:6/669: dwrite d4/d12/d40/d43/d45/d4a/f7e [4194304,4194304] 0 2023-12-06T15:00:27.491 INFO:tasks.workunit.client.0.smithi152.stdout:1/551: dwrite d3/da/d15/d17/d58/f93 [0,4194304] 0 2023-12-06T15:00:27.492 INFO:tasks.workunit.client.1.smithi190.stdout:2/474: write d10/d26/d5c/d49/f55 [3119422,7836] 0 2023-12-06T15:00:27.493 INFO:tasks.workunit.client.1.smithi190.stdout:2/475: write d10/d59/d5e/f13 [3279878,59506] 0 2023-12-06T15:00:27.493 INFO:tasks.workunit.client.1.smithi190.stdout:2/476: fdatasync d10/d26/d5c/d49/f9c 0 2023-12-06T15:00:27.493 INFO:tasks.workunit.client.1.smithi190.stdout:2/477: stat d10/d26/d5c/d49/c7b 0 2023-12-06T15:00:27.494 INFO:tasks.workunit.client.0.smithi152.stdout:6/562: rmdir d1/d1c/d79/d1a/d30/d36/d35/d49/d6b 39 2023-12-06T15:00:27.494 INFO:tasks.workunit.client.1.smithi190.stdout:7/606: rename d0/df/d5f/da7 to d0/df/d53/d99/da9/dc8 0 2023-12-06T15:00:27.495 INFO:tasks.workunit.client.1.smithi190.stdout:2/478: creat d10/d26/d5c/d35/d77/fa3 x:0 0 0 2023-12-06T15:00:27.496 INFO:tasks.workunit.client.1.smithi190.stdout:7/607: rmdir d0/d5/d63 39 2023-12-06T15:00:27.496 INFO:tasks.workunit.client.1.smithi190.stdout:7/608: write d0/d88/d41/fa1 [358145,66436] 0 2023-12-06T15:00:27.498 INFO:tasks.workunit.client.1.smithi190.stdout:6/670: rename d4/d12/d1a/d32/dab/fc6 to d4/d12/d1a/d32/dab/dd3/fe0 0 2023-12-06T15:00:27.498 INFO:tasks.workunit.client.1.smithi190.stdout:2/479: mknod d10/ca4 0 2023-12-06T15:00:27.499 INFO:tasks.workunit.client.1.smithi190.stdout:7/609: mkdir d0/d88/d7a/dc9 0 2023-12-06T15:00:27.499 INFO:tasks.workunit.client.1.smithi190.stdout:2/480: mkdir d10/d26/d5c/da5 0 2023-12-06T15:00:27.500 INFO:tasks.workunit.client.1.smithi190.stdout:7/610: write d0/d5/da/f77 [447297,52124] 0 2023-12-06T15:00:27.500 INFO:tasks.workunit.client.1.smithi190.stdout:2/481: rename d10/d26/d5b/d76/f84 to d10/d26/d5b/d76/fa6 0 2023-12-06T15:00:27.500 INFO:tasks.workunit.client.1.smithi190.stdout:2/482: chown d10/d59/d5e/c4e 200587454 1 2023-12-06T15:00:27.501 INFO:tasks.workunit.client.1.smithi190.stdout:7/611: unlink d0/d5/da/f54 0 2023-12-06T15:00:27.502 INFO:tasks.workunit.client.1.smithi190.stdout:2/483: creat d10/d26/d8a/d8f/fa7 x:0 0 0 2023-12-06T15:00:27.512 INFO:tasks.workunit.client.1.smithi190.stdout:2/484: dread d10/d59/d5e/f16 [0,4194304] 0 2023-12-06T15:00:27.514 INFO:tasks.workunit.client.1.smithi190.stdout:2/485: rename d10/d59/d5e/f3c to d10/d26/d5c/d35/d77/d98/fa8 0 2023-12-06T15:00:27.514 INFO:tasks.workunit.client.1.smithi190.stdout:2/486: chown d10/d59/d5e/c7c 0 1 2023-12-06T15:00:27.515 INFO:tasks.workunit.client.1.smithi190.stdout:2/487: creat d10/d26/d5c/d37/fa9 x:0 0 0 2023-12-06T15:00:27.518 INFO:tasks.workunit.client.1.smithi190.stdout:2/488: dread d10/d26/d5c/d37/f3f [0,4194304] 0 2023-12-06T15:00:27.519 INFO:tasks.workunit.client.1.smithi190.stdout:2/489: rename d10/d26/d5b/f6e to d10/d26/d5c/d8d/faa 0 2023-12-06T15:00:27.519 INFO:tasks.workunit.client.1.smithi190.stdout:2/490: chown d10/d26 2623 1 2023-12-06T15:00:27.519 INFO:tasks.workunit.client.1.smithi190.stdout:2/491: fdatasync d10/f58 0 2023-12-06T15:00:27.521 INFO:tasks.workunit.client.0.smithi152.stdout:8/246: dwrite d1/d6/d34/f21 [0,4194304] 0 2023-12-06T15:00:27.522 INFO:tasks.workunit.client.1.smithi190.stdout:2/492: dread d10/d59/d5e/f16 [0,4194304] 0 2023-12-06T15:00:27.522 INFO:tasks.workunit.client.0.smithi152.stdout:8/247: mknod d1/d6/c49 0 2023-12-06T15:00:27.522 INFO:tasks.workunit.client.0.smithi152.stdout:8/248: chown d1/d6/d34/d35/d38/c39 0 1 2023-12-06T15:00:27.523 INFO:tasks.workunit.client.0.smithi152.stdout:8/249: fsync d1/d6/d34/d35/d38/f45 0 2023-12-06T15:00:27.523 INFO:tasks.workunit.client.1.smithi190.stdout:2/493: creat d10/d59/d5e/d71/fab x:0 0 0 2023-12-06T15:00:27.523 INFO:tasks.workunit.client.0.smithi152.stdout:8/250: write d1/f2d [2908371,66881] 0 2023-12-06T15:00:27.526 INFO:tasks.workunit.client.1.smithi190.stdout:8/504: dwrite d1/f16 [0,4194304] 0 2023-12-06T15:00:27.526 INFO:tasks.workunit.client.1.smithi190.stdout:4/473: dwrite d3/d76/d7c/d96/d39/f48 [0,4194304] 0 2023-12-06T15:00:27.527 INFO:tasks.workunit.client.1.smithi190.stdout:6/671: dwrite d4/d12/d1a/d32/fd1 [0,4194304] 0 2023-12-06T15:00:27.527 INFO:tasks.workunit.client.1.smithi190.stdout:5/439: dwrite d0/fd [0,4194304] 0 2023-12-06T15:00:27.528 INFO:tasks.workunit.client.0.smithi152.stdout:0/356: dwrite d8/d15/f18 [0,4194304] 0 2023-12-06T15:00:27.528 INFO:tasks.workunit.client.0.smithi152.stdout:0/357: readlink d8/d1b/l35 0 2023-12-06T15:00:27.528 INFO:tasks.workunit.client.1.smithi190.stdout:1/773: dwrite d6/dc/d29/d38/d73/f4e [0,4194304] 0 2023-12-06T15:00:27.528 INFO:tasks.workunit.client.1.smithi190.stdout:9/600: dwrite d4/d27/d2f/d31/d3f/d58/d72/fa7 [0,4194304] 0 2023-12-06T15:00:27.528 INFO:tasks.workunit.client.1.smithi190.stdout:9/601: stat d4/d27/d2f/d5c/f9b 0 2023-12-06T15:00:27.530 INFO:tasks.workunit.client.1.smithi190.stdout:4/474: creat d3/d76/d7c/d96/f98 x:0 0 0 2023-12-06T15:00:27.530 INFO:tasks.workunit.client.1.smithi190.stdout:1/774: dread d6/dc/d29/d38/d73/d76/fb3 [0,4194304] 0 2023-12-06T15:00:27.532 INFO:tasks.workunit.client.1.smithi190.stdout:4/475: write d3/d76/d7c/d96/d39/d54/f84 [220292,12572] 0 2023-12-06T15:00:27.532 INFO:tasks.workunit.client.1.smithi190.stdout:8/505: write d1/d10/d1c/f4e [3347561,88199] 0 2023-12-06T15:00:27.532 INFO:tasks.workunit.client.1.smithi190.stdout:8/506: dread - d1/d20/d3b/d34/f38 zero size 2023-12-06T15:00:27.532 INFO:tasks.workunit.client.1.smithi190.stdout:8/507: chown d1/d20/d3b/d31/f57 55 1 2023-12-06T15:00:27.536 INFO:tasks.workunit.client.1.smithi190.stdout:4/476: read d3/d35/d19/f47 [1797810,96072] 0 2023-12-06T15:00:27.541 INFO:tasks.workunit.client.1.smithi190.stdout:8/508: dread d1/d20/d3b/d4c/d5a/f66 [0,4194304] 0 2023-12-06T15:00:27.547 INFO:tasks.workunit.client.1.smithi190.stdout:5/440: creat d0/d1c/d85/d90/f93 x:0 0 0 2023-12-06T15:00:27.547 INFO:tasks.workunit.client.1.smithi190.stdout:5/441: stat d0/df/d50 0 2023-12-06T15:00:27.550 INFO:tasks.workunit.client.1.smithi190.stdout:1/775: getdents d6/dc/d6f/da4/db9 0 2023-12-06T15:00:27.552 INFO:tasks.workunit.client.1.smithi190.stdout:4/477: creat d3/d76/d7c/d8a/f99 x:0 0 0 2023-12-06T15:00:27.554 INFO:tasks.workunit.client.0.smithi152.stdout:0/358: dwrite d8/d1b/f5b [0,4194304] 0 2023-12-06T15:00:27.554 INFO:tasks.workunit.client.1.smithi190.stdout:9/602: dwrite d4/d27/d2f/f37 [0,4194304] 0 2023-12-06T15:00:27.555 INFO:tasks.workunit.client.1.smithi190.stdout:9/603: truncate d4/d27/d2f/d66/f6e 935844 0 2023-12-06T15:00:27.555 INFO:tasks.workunit.client.0.smithi152.stdout:8/251: dwrite d1/d6/d34/fa [0,4194304] 0 2023-12-06T15:00:27.555 INFO:tasks.workunit.client.0.smithi152.stdout:0/359: dread d8/d3e/f52 [0,4194304] 0 2023-12-06T15:00:27.556 INFO:tasks.workunit.client.1.smithi190.stdout:8/509: rename d1/d20/d3b/d34/d39/l63 to d1/d10/d25/l92 0 2023-12-06T15:00:27.556 INFO:tasks.workunit.client.1.smithi190.stdout:8/510: chown d1/c3 199727 1 2023-12-06T15:00:27.557 INFO:tasks.workunit.client.0.smithi152.stdout:8/252: mknod d1/d6/d29/c4a 0 2023-12-06T15:00:27.557 INFO:tasks.workunit.client.0.smithi152.stdout:0/360: creat d8/d15/d45/f70 x:0 0 0 2023-12-06T15:00:27.558 INFO:tasks.workunit.client.1.smithi190.stdout:1/776: symlink d6/dc/d6f/da4/db9/lfb 0 2023-12-06T15:00:27.558 INFO:tasks.workunit.client.1.smithi190.stdout:4/478: rmdir d3/d76/d8b 39 2023-12-06T15:00:27.558 INFO:tasks.workunit.client.0.smithi152.stdout:0/361: read f5 [499088,17126] 0 2023-12-06T15:00:27.558 INFO:tasks.workunit.client.1.smithi190.stdout:2/494: getdents d10 0 2023-12-06T15:00:27.559 INFO:tasks.workunit.client.0.smithi152.stdout:8/253: write d1/d6/d34/d36/f2e [4010301,78421] 0 2023-12-06T15:00:27.559 INFO:tasks.workunit.client.0.smithi152.stdout:8/254: chown d1/d6/f37 17422238 1 2023-12-06T15:00:27.560 INFO:tasks.workunit.client.0.smithi152.stdout:8/255: chown d1/d6/f1b 536628126 1 2023-12-06T15:00:27.560 INFO:tasks.workunit.client.0.smithi152.stdout:8/256: stat d1/d6/d34/d35/d38 0 2023-12-06T15:00:27.560 INFO:tasks.workunit.client.0.smithi152.stdout:8/257: rename d1 to d1/d6/d34/d36/d4b 22 2023-12-06T15:00:27.560 INFO:tasks.workunit.client.0.smithi152.stdout:8/258: write d1/f42 [288723,98529] 0 2023-12-06T15:00:27.560 INFO:tasks.workunit.client.1.smithi190.stdout:5/442: dread d0/d1c/d2b/d2c/f49 [0,4194304] 0 2023-12-06T15:00:27.560 INFO:tasks.workunit.client.1.smithi190.stdout:4/479: write d3/fd [667117,38010] 0 2023-12-06T15:00:27.561 INFO:tasks.workunit.client.1.smithi190.stdout:4/480: chown d3/d35/d97 422568670 1 2023-12-06T15:00:27.561 INFO:tasks.workunit.client.1.smithi190.stdout:8/511: rename d1/d10/d1c/d4b/f7c to d1/d20/d3b/d4c/d59/f93 0 2023-12-06T15:00:27.561 INFO:tasks.workunit.client.0.smithi152.stdout:0/362: write d8/ff [2756789,41125] 0 2023-12-06T15:00:27.561 INFO:tasks.workunit.client.0.smithi152.stdout:0/363: fdatasync d8/d44/f48 0 2023-12-06T15:00:27.562 INFO:tasks.workunit.client.1.smithi190.stdout:1/777: rmdir d6/dc/d29/d38/d43/db7/de2 39 2023-12-06T15:00:27.564 INFO:tasks.workunit.client.1.smithi190.stdout:2/495: getdents d10/d26 0 2023-12-06T15:00:27.570 INFO:tasks.workunit.client.1.smithi190.stdout:9/604: rename d4/d27/d2f/d31/d3f/d58/d72/f76 to d4/fca 0 2023-12-06T15:00:27.570 INFO:tasks.workunit.client.1.smithi190.stdout:2/496: mknod d10/d26/d5b/cac 0 2023-12-06T15:00:27.570 INFO:tasks.workunit.client.1.smithi190.stdout:8/512: write d1/d10/f80 [144984,29489] 0 2023-12-06T15:00:27.570 INFO:tasks.workunit.client.1.smithi190.stdout:8/513: readlink d1/d20/d3b/d34/l69 0 2023-12-06T15:00:27.570 INFO:tasks.workunit.client.1.smithi190.stdout:1/778: dread d6/dc/d29/d38/d39/dda/fdb [0,4194304] 0 2023-12-06T15:00:27.571 INFO:tasks.workunit.client.1.smithi190.stdout:9/605: creat d4/d27/d2f/d31/d3f/fcb x:0 0 0 2023-12-06T15:00:27.573 INFO:tasks.workunit.client.1.smithi190.stdout:2/497: mkdir d10/d59/d5e/d71/dad 0 2023-12-06T15:00:27.573 INFO:tasks.workunit.client.1.smithi190.stdout:2/498: dread - d10/d26/d5b/d76/fa6 zero size 2023-12-06T15:00:27.573 INFO:tasks.workunit.client.1.smithi190.stdout:5/443: mkdir d0/d1c/d94 0 2023-12-06T15:00:27.575 INFO:tasks.workunit.client.1.smithi190.stdout:1/779: creat d6/dc/d29/d38/d39/d63/d67/ffc x:0 0 0 2023-12-06T15:00:27.575 INFO:tasks.workunit.client.1.smithi190.stdout:1/780: write d6/dc/d29/d38/d73/fad [221938,55871] 0 2023-12-06T15:00:27.575 INFO:tasks.workunit.client.1.smithi190.stdout:9/606: truncate d4/d84/f8b 354118 0 2023-12-06T15:00:27.576 INFO:tasks.workunit.client.1.smithi190.stdout:9/607: chown d4/d27/d2f/d31/d3f/c68 393 1 2023-12-06T15:00:27.577 INFO:tasks.workunit.client.1.smithi190.stdout:9/608: write d4/f17 [3370278,35666] 0 2023-12-06T15:00:27.577 INFO:tasks.workunit.client.1.smithi190.stdout:2/499: rename d10/d26/f29 to d10/d26/d5c/d42/d9d/fae 0 2023-12-06T15:00:27.577 INFO:tasks.workunit.client.1.smithi190.stdout:2/500: chown d10/d59/c6b 36 1 2023-12-06T15:00:27.577 INFO:tasks.workunit.client.1.smithi190.stdout:2/501: fdatasync d10/d59/d5e/f6a 0 2023-12-06T15:00:27.577 INFO:tasks.workunit.client.1.smithi190.stdout:5/444: chown d0/d1c/d3e/l6b 1784801 1 2023-12-06T15:00:27.578 INFO:tasks.workunit.client.1.smithi190.stdout:5/445: chown d0/d1c/d2b/d2c/f45 7 1 2023-12-06T15:00:27.578 INFO:tasks.workunit.client.1.smithi190.stdout:1/781: dread d6/dc/f33 [0,4194304] 0 2023-12-06T15:00:27.579 INFO:tasks.workunit.client.1.smithi190.stdout:1/782: readlink d6/dc/d6f/lc2 0 2023-12-06T15:00:27.579 INFO:tasks.workunit.client.1.smithi190.stdout:2/502: creat d10/d26/d5c/d49/d7e/faf x:0 0 0 2023-12-06T15:00:27.581 INFO:tasks.workunit.client.1.smithi190.stdout:2/503: symlink d10/d26/d5c/d35/d77/lb0 0 2023-12-06T15:00:27.582 INFO:tasks.workunit.client.1.smithi190.stdout:2/504: write d10/d59/d5e/f6a [47633,101907] 0 2023-12-06T15:00:27.582 INFO:tasks.workunit.client.1.smithi190.stdout:2/505: mkdir d10/d26/d5b/d76/db1 0 2023-12-06T15:00:27.583 INFO:tasks.workunit.client.1.smithi190.stdout:2/506: mknod d10/d26/d5b/d7f/cb2 0 2023-12-06T15:00:27.583 INFO:tasks.workunit.client.1.smithi190.stdout:2/507: stat d10/c21 0 2023-12-06T15:00:27.593 INFO:tasks.workunit.client.0.smithi152.stdout:2/264: sync 2023-12-06T15:00:27.593 INFO:tasks.workunit.client.0.smithi152.stdout:9/303: sync 2023-12-06T15:00:27.594 INFO:tasks.workunit.client.0.smithi152.stdout:3/338: sync 2023-12-06T15:00:27.594 INFO:tasks.workunit.client.0.smithi152.stdout:3/339: write d9/f2d [4753882,19769] 0 2023-12-06T15:00:27.594 INFO:tasks.workunit.client.0.smithi152.stdout:3/340: read - d9/d10/d12/f1e zero size 2023-12-06T15:00:27.594 INFO:tasks.workunit.client.0.smithi152.stdout:9/304: symlink d0/dd/d20/d38/l54 0 2023-12-06T15:00:27.595 INFO:tasks.workunit.client.0.smithi152.stdout:9/305: mknod d0/d50/c55 0 2023-12-06T15:00:27.596 INFO:tasks.workunit.client.0.smithi152.stdout:9/306: truncate d0/dd/fe 5029284 0 2023-12-06T15:00:27.596 INFO:tasks.workunit.client.0.smithi152.stdout:0/364: write d8/f17 [1095850,129950] 0 2023-12-06T15:00:27.597 INFO:tasks.workunit.client.0.smithi152.stdout:0/365: link d8/d1b/f41 d8/d15/d45/f71 0 2023-12-06T15:00:27.597 INFO:tasks.workunit.client.0.smithi152.stdout:0/366: stat d8/d15/d45/f70 0 2023-12-06T15:00:27.598 INFO:tasks.workunit.client.1.smithi190.stdout:1/783: read d6/dc/d29/d38/d39/d63/d67/f7d [1103097,71989] 0 2023-12-06T15:00:27.598 INFO:tasks.workunit.client.1.smithi190.stdout:1/784: readlink d6/dc/l19 0 2023-12-06T15:00:27.598 INFO:tasks.workunit.client.1.smithi190.stdout:1/785: chown d6/dc/f9 1254975 1 2023-12-06T15:00:27.601 INFO:tasks.workunit.client.0.smithi152.stdout:0/367: write d8/d1b/f5b [3256638,8292] 0 2023-12-06T15:00:27.601 INFO:tasks.workunit.client.0.smithi152.stdout:0/368: chown d8/f13 1 1 2023-12-06T15:00:27.601 INFO:tasks.workunit.client.1.smithi190.stdout:5/446: dwrite d0/f24 [0,4194304] 0 2023-12-06T15:00:27.601 INFO:tasks.workunit.client.1.smithi190.stdout:5/447: truncate d0/df/f41 912820 0 2023-12-06T15:00:27.602 INFO:tasks.workunit.client.1.smithi190.stdout:1/786: getdents d6/dc 0 2023-12-06T15:00:27.606 INFO:tasks.workunit.client.1.smithi190.stdout:5/448: creat d0/d1c/d2b/d2c/d5d/f95 x:0 0 0 2023-12-06T15:00:27.608 INFO:tasks.workunit.client.0.smithi152.stdout:0/369: write d8/d15/d45/f61 [2987865,59085] 0 2023-12-06T15:00:27.608 INFO:tasks.workunit.client.1.smithi190.stdout:1/787: rename d6/dc/d29/d38/d73/d76/d7e/fd6 to d6/dc/d29/d38/d43/d7f/da7/ffd 0 2023-12-06T15:00:27.608 INFO:tasks.workunit.client.1.smithi190.stdout:1/788: chown d6/dc/d3b/d78/fb0 162 1 2023-12-06T15:00:27.609 INFO:tasks.workunit.client.1.smithi190.stdout:1/789: fdatasync d6/dc/d3b/d78/d94/f96 0 2023-12-06T15:00:27.609 INFO:tasks.workunit.client.1.smithi190.stdout:1/790: fdatasync d6/dc/d29/d38/d73/fde 0 2023-12-06T15:00:27.609 INFO:tasks.workunit.client.1.smithi190.stdout:9/609: dwrite d4/f6 [0,4194304] 0 2023-12-06T15:00:27.609 INFO:tasks.workunit.client.0.smithi152.stdout:3/341: dread d9/f1d [0,4194304] 0 2023-12-06T15:00:27.611 INFO:tasks.workunit.client.0.smithi152.stdout:2/265: dread d6/db/f39 [0,4194304] 0 2023-12-06T15:00:27.611 INFO:tasks.workunit.client.0.smithi152.stdout:2/266: chown d6/d1e/c49 33697950 1 2023-12-06T15:00:27.611 INFO:tasks.workunit.client.0.smithi152.stdout:2/267: chown d6/d1e 1 1 2023-12-06T15:00:27.611 INFO:tasks.workunit.client.1.smithi190.stdout:9/610: mknod d4/d27/d2f/d31/d3f/d58/ccc 0 2023-12-06T15:00:27.612 INFO:tasks.workunit.client.1.smithi190.stdout:2/508: dwrite d10/d26/d5c/d49/d54/f6d [0,4194304] 0 2023-12-06T15:00:27.613 INFO:tasks.workunit.client.1.smithi190.stdout:9/611: mkdir d4/d27/d2f/d31/da6/dcd 0 2023-12-06T15:00:27.613 INFO:tasks.workunit.client.1.smithi190.stdout:1/791: write d6/f12 [3391682,88185] 0 2023-12-06T15:00:27.614 INFO:tasks.workunit.client.0.smithi152.stdout:0/370: unlink d8/d15/f50 0 2023-12-06T15:00:27.614 INFO:tasks.workunit.client.0.smithi152.stdout:3/342: symlink d9/d45/l60 0 2023-12-06T15:00:27.615 INFO:tasks.workunit.client.0.smithi152.stdout:3/343: getdents d9/d18/d1a 0 2023-12-06T15:00:27.615 INFO:tasks.workunit.client.0.smithi152.stdout:2/268: creat d6/db/d17/f4f x:0 0 0 2023-12-06T15:00:27.616 INFO:tasks.workunit.client.1.smithi190.stdout:3/657: sync 2023-12-06T15:00:27.616 INFO:tasks.workunit.client.1.smithi190.stdout:3/658: write d4/d70/d33/fa9 [343626,32504] 0 2023-12-06T15:00:27.616 INFO:tasks.workunit.client.0.smithi152.stdout:3/344: creat d9/d10/d12/d43/d52/f61 x:0 0 0 2023-12-06T15:00:27.617 INFO:tasks.workunit.client.0.smithi152.stdout:2/269: creat d6/d18/d43/f50 x:0 0 0 2023-12-06T15:00:27.617 INFO:tasks.workunit.client.1.smithi190.stdout:2/509: write d10/d26/d5c/f63 [730211,64787] 0 2023-12-06T15:00:27.617 INFO:tasks.workunit.client.1.smithi190.stdout:1/792: read d6/f5a [6074907,3626] 0 2023-12-06T15:00:27.618 INFO:tasks.workunit.client.1.smithi190.stdout:9/612: rename d4/d27/d2f/l61 to d4/d27/d8a/dbc/lce 0 2023-12-06T15:00:27.618 INFO:tasks.workunit.client.0.smithi152.stdout:3/345: creat d9/d18/d39/f62 x:0 0 0 2023-12-06T15:00:27.619 INFO:tasks.workunit.client.0.smithi152.stdout:3/346: symlink d9/d10/l63 0 2023-12-06T15:00:27.620 INFO:tasks.workunit.client.0.smithi152.stdout:3/347: creat d9/d18/f64 x:0 0 0 2023-12-06T15:00:27.623 INFO:tasks.workunit.client.1.smithi190.stdout:1/793: creat d6/dc/d29/d38/d73/d76/ffe x:0 0 0 2023-12-06T15:00:27.623 INFO:tasks.workunit.client.1.smithi190.stdout:2/510: creat d10/d26/d5c/fb3 x:0 0 0 2023-12-06T15:00:27.624 INFO:tasks.workunit.client.1.smithi190.stdout:3/659: rename d4/d1b/d54/d9c/d68/f92 to d4/d70/d7f/fe7 0 2023-12-06T15:00:27.625 INFO:tasks.workunit.client.0.smithi152.stdout:8/259: dwrite d1/d6/f30 [0,4194304] 0 2023-12-06T15:00:27.625 INFO:tasks.workunit.client.0.smithi152.stdout:8/260: readlink d1/l20 0 2023-12-06T15:00:27.625 INFO:tasks.workunit.client.0.smithi152.stdout:8/261: stat d1/d6/c3e 0 2023-12-06T15:00:27.626 INFO:tasks.workunit.client.1.smithi190.stdout:8/514: dread d1/d10/d1c/f4e [0,4194304] 0 2023-12-06T15:00:27.627 INFO:tasks.workunit.client.1.smithi190.stdout:9/613: symlink d4/d27/d2f/d66/lcf 0 2023-12-06T15:00:27.630 INFO:tasks.workunit.client.0.smithi152.stdout:8/262: creat d1/d6/d34/d36/f4c x:0 0 0 2023-12-06T15:00:27.630 INFO:tasks.workunit.client.0.smithi152.stdout:8/263: chown d1/d6/d34/d36/f4c 6222992 1 2023-12-06T15:00:27.630 INFO:tasks.workunit.client.0.smithi152.stdout:8/264: truncate d1/d6/d34/fa 5079384 0 2023-12-06T15:00:27.635 INFO:tasks.workunit.client.1.smithi190.stdout:8/515: rename d1/d10 to d1/d20/d3b/d4c/d8e/d94 0 2023-12-06T15:00:27.635 INFO:tasks.workunit.client.1.smithi190.stdout:8/516: chown d1/d20/d3b/d4c/d8e/d94/d1c 960335736 1 2023-12-06T15:00:27.636 INFO:tasks.workunit.client.0.smithi152.stdout:2/270: dread d6/db/d17/f23 [0,4194304] 0 2023-12-06T15:00:27.637 INFO:tasks.workunit.client.1.smithi190.stdout:1/794: dread d6/dc/d3b/d78/fb0 [0,4194304] 0 2023-12-06T15:00:27.638 INFO:tasks.workunit.client.1.smithi190.stdout:4/481: dwrite d3/d35/d19/d30/f94 [0,4194304] 0 2023-12-06T15:00:27.644 INFO:tasks.workunit.client.1.smithi190.stdout:9/614: rename d4/d27/d2f to d4/d27/d2f/d31/dd0 22 2023-12-06T15:00:27.645 INFO:tasks.workunit.client.1.smithi190.stdout:8/517: symlink d1/l95 0 2023-12-06T15:00:27.645 INFO:tasks.workunit.client.1.smithi190.stdout:8/518: chown d1/d20/d3b/d4c/d8e/d94/d25/c2f 28746 1 2023-12-06T15:00:27.646 INFO:tasks.workunit.client.1.smithi190.stdout:1/795: creat d6/dc/d6f/fff x:0 0 0 2023-12-06T15:00:27.646 INFO:tasks.workunit.client.1.smithi190.stdout:1/796: write d6/dc/d29/d38/d39/d63/d67/ffc [410084,42933] 0 2023-12-06T15:00:27.646 INFO:tasks.workunit.client.0.smithi152.stdout:8/265: dread d1/d6/fd [0,4194304] 0 2023-12-06T15:00:27.648 INFO:tasks.workunit.client.0.smithi152.stdout:8/266: creat d1/d6/d29/f4d x:0 0 0 2023-12-06T15:00:27.648 INFO:tasks.workunit.client.1.smithi190.stdout:8/519: unlink d1/d20/d3b/d36/f7a 0 2023-12-06T15:00:27.648 INFO:tasks.workunit.client.1.smithi190.stdout:8/520: fdatasync d1/d20/d3b/d34/f40 0 2023-12-06T15:00:27.649 INFO:tasks.workunit.client.1.smithi190.stdout:1/797: mknod d6/dc/d3b/c100 0 2023-12-06T15:00:27.651 INFO:tasks.workunit.client.1.smithi190.stdout:8/521: getdents d1/d37 0 2023-12-06T15:00:27.652 INFO:tasks.workunit.client.1.smithi190.stdout:8/522: chown d1/d20/l61 26518 1 2023-12-06T15:00:27.652 INFO:tasks.workunit.client.1.smithi190.stdout:1/798: creat d6/dc/d29/f101 x:0 0 0 2023-12-06T15:00:27.653 INFO:tasks.workunit.client.0.smithi152.stdout:9/307: dwrite d0/dd/d20/d38/f46 [0,4194304] 0 2023-12-06T15:00:27.653 INFO:tasks.workunit.client.0.smithi152.stdout:9/308: stat d0/f1c 0 2023-12-06T15:00:27.653 INFO:tasks.workunit.client.0.smithi152.stdout:9/309: readlink d0/dd/l1b 0 2023-12-06T15:00:27.653 INFO:tasks.workunit.client.0.smithi152.stdout:9/310: write d0/dd/f3e [4794397,14386] 0 2023-12-06T15:00:27.653 INFO:tasks.workunit.client.1.smithi190.stdout:8/523: symlink d1/d20/d3b/d4c/d8e/d94/d1c/d4b/l96 0 2023-12-06T15:00:27.653 INFO:tasks.workunit.client.1.smithi190.stdout:8/524: chown d1/d20/d3b/l82 1 1 2023-12-06T15:00:27.653 INFO:tasks.workunit.client.1.smithi190.stdout:8/525: fdatasync d1/d20/d3b/d36/f3c 0 2023-12-06T15:00:27.655 INFO:tasks.workunit.client.1.smithi190.stdout:8/526: unlink d1/d20/d3b/d4c/d59/d7d/f8d 0 2023-12-06T15:00:27.655 INFO:tasks.workunit.client.1.smithi190.stdout:8/527: chown d1/d20 152662 1 2023-12-06T15:00:27.656 INFO:tasks.workunit.client.0.smithi152.stdout:9/311: mknod d0/dd/d20/d38/d48/c56 0 2023-12-06T15:00:27.656 INFO:tasks.workunit.client.1.smithi190.stdout:8/528: chown d1/d20/d3b/d4c/d8e/d94/f78 49 1 2023-12-06T15:00:27.657 INFO:tasks.workunit.client.1.smithi190.stdout:9/615: dread d4/d27/d2f/d5c/fb2 [0,4194304] 0 2023-12-06T15:00:27.657 INFO:tasks.workunit.client.1.smithi190.stdout:9/616: write d4/d27/d2f/d31/d3f/d58/d72/fa7 [4730514,104773] 0 2023-12-06T15:00:27.657 INFO:tasks.workunit.client.1.smithi190.stdout:9/617: readlink d4/d27/d2f/d31/d3f/l47 0 2023-12-06T15:00:27.657 INFO:tasks.workunit.client.1.smithi190.stdout:8/529: symlink d1/d37/l97 0 2023-12-06T15:00:27.657 INFO:tasks.workunit.client.0.smithi152.stdout:9/312: creat d0/dd/d20/d38/f57 x:0 0 0 2023-12-06T15:00:27.658 INFO:tasks.workunit.client.0.smithi152.stdout:9/313: chown d0/dd/d20/d38/d45/f37 0 1 2023-12-06T15:00:27.658 INFO:tasks.workunit.client.1.smithi190.stdout:5/449: dwrite d0/f44 [0,4194304] 0 2023-12-06T15:00:27.659 INFO:tasks.workunit.client.1.smithi190.stdout:9/618: creat d4/d27/d2f/d66/fd1 x:0 0 0 2023-12-06T15:00:27.660 INFO:tasks.workunit.client.0.smithi152.stdout:0/371: dwrite d8/d38/f53 [0,4194304] 0 2023-12-06T15:00:27.660 INFO:tasks.workunit.client.1.smithi190.stdout:3/660: dwrite d4/d70/d19/d3a/f73 [0,4194304] 0 2023-12-06T15:00:27.661 INFO:tasks.workunit.client.0.smithi152.stdout:2/271: dwrite d6/d1e/f4a [0,4194304] 0 2023-12-06T15:00:27.662 INFO:tasks.workunit.client.1.smithi190.stdout:8/530: rename d1/d20/d3b/d36/l79 to d1/d20/d3b/d31/d87/l98 0 2023-12-06T15:00:27.663 INFO:tasks.workunit.client.1.smithi190.stdout:3/661: dread d4/d70/d33/fa9 [0,4194304] 0 2023-12-06T15:00:27.665 INFO:tasks.workunit.client.1.smithi190.stdout:3/662: write d4/d70/d53/d56/d94/f42 [730785,27534] 0 2023-12-06T15:00:27.666 INFO:tasks.workunit.client.1.smithi190.stdout:3/663: write d4/d70/d33/fbe [1064557,34077] 0 2023-12-06T15:00:27.666 INFO:tasks.workunit.client.0.smithi152.stdout:0/372: creat d8/d44/f72 x:0 0 0 2023-12-06T15:00:27.668 INFO:tasks.workunit.client.1.smithi190.stdout:5/450: mkdir d0/d96 0 2023-12-06T15:00:27.670 INFO:tasks.workunit.client.1.smithi190.stdout:9/619: creat d4/d27/d8a/dbc/fd2 x:0 0 0 2023-12-06T15:00:27.676 INFO:tasks.workunit.client.0.smithi152.stdout:2/272: fsync d6/db/d17/f4f 0 2023-12-06T15:00:27.680 INFO:tasks.workunit.client.0.smithi152.stdout:3/348: truncate d9/f2d 1877316 0 2023-12-06T15:00:27.681 INFO:tasks.workunit.client.0.smithi152.stdout:2/273: write d6/d1e/f4a [3081564,123509] 0 2023-12-06T15:00:27.688 INFO:tasks.workunit.client.0.smithi152.stdout:2/274: dread d6/db/d17/f1d [0,4194304] 0 2023-12-06T15:00:27.692 INFO:tasks.workunit.client.0.smithi152.stdout:3/349: dread f2 [8388608,4194304] 0 2023-12-06T15:00:27.694 INFO:tasks.workunit.client.0.smithi152.stdout:2/275: dread d6/d18/f3d [0,4194304] 0 2023-12-06T15:00:27.698 INFO:tasks.workunit.client.1.smithi190.stdout:1/799: dwrite d6/dc/d29/f83 [4194304,4194304] 0 2023-12-06T15:00:27.698 INFO:tasks.workunit.client.1.smithi190.stdout:1/800: stat d6/dc/le 0 2023-12-06T15:00:27.701 INFO:tasks.workunit.client.0.smithi152.stdout:9/314: dwrite d0/f6 [0,4194304] 0 2023-12-06T15:00:27.701 INFO:tasks.workunit.client.0.smithi152.stdout:9/315: chown d0/dd/d20/d38/l54 1 1 2023-12-06T15:00:27.701 INFO:tasks.workunit.client.0.smithi152.stdout:9/316: truncate d0/d3f/f53 169369 0 2023-12-06T15:00:27.701 INFO:tasks.workunit.client.1.smithi190.stdout:9/620: dwrite d4/f11 [0,4194304] 0 2023-12-06T15:00:27.702 INFO:tasks.workunit.client.0.smithi152.stdout:0/373: dwrite d8/d15/d45/f61 [0,4194304] 0 2023-12-06T15:00:27.705 INFO:tasks.workunit.client.0.smithi152.stdout:0/374: truncate d8/fd 3667331 0 2023-12-06T15:00:27.707 INFO:tasks.workunit.client.0.smithi152.stdout:0/375: mkdir d8/d15/d45/d73 0 2023-12-06T15:00:27.707 INFO:tasks.workunit.client.0.smithi152.stdout:0/376: chown d8/d15/f2e 17 1 2023-12-06T15:00:27.707 INFO:tasks.workunit.client.1.smithi190.stdout:3/664: dwrite d4/fbb [4194304,4194304] 0 2023-12-06T15:00:27.708 INFO:tasks.workunit.client.1.smithi190.stdout:9/621: dread d4/d27/d2f/d31/d3f/d58/d72/d7a/f9c [0,4194304] 0 2023-12-06T15:00:27.710 INFO:tasks.workunit.client.0.smithi152.stdout:9/317: dread d0/dd/f25 [0,4194304] 0 2023-12-06T15:00:27.711 INFO:tasks.workunit.client.0.smithi152.stdout:9/318: creat d0/dd/d20/d38/d44/f58 x:0 0 0 2023-12-06T15:00:27.712 INFO:tasks.workunit.client.0.smithi152.stdout:9/319: mknod d0/dd/d20/d38/d45/d43/c59 0 2023-12-06T15:00:27.713 INFO:tasks.workunit.client.0.smithi152.stdout:9/320: creat d0/dd/d20/f5a x:0 0 0 2023-12-06T15:00:27.713 INFO:tasks.workunit.client.0.smithi152.stdout:9/321: chown d0/dd/d20/d4a/d4d 36247034 1 2023-12-06T15:00:27.714 INFO:tasks.workunit.client.0.smithi152.stdout:9/322: truncate d0/dd/f17 6082217 0 2023-12-06T15:00:27.716 INFO:tasks.workunit.client.0.smithi152.stdout:9/323: creat d0/dd/d20/d38/d45/f5b x:0 0 0 2023-12-06T15:00:27.718 INFO:tasks.workunit.client.0.smithi152.stdout:9/324: symlink d0/dd/d20/l5c 0 2023-12-06T15:00:27.718 INFO:tasks.workunit.client.1.smithi190.stdout:1/801: creat d6/dc/d29/d38/d73/d5c/dd2/f102 x:0 0 0 2023-12-06T15:00:27.720 INFO:tasks.workunit.client.0.smithi152.stdout:9/325: mknod d0/dd/d20/d38/d45/c5d 0 2023-12-06T15:00:27.720 INFO:tasks.workunit.client.0.smithi152.stdout:9/326: chown d0/c13 3882807 1 2023-12-06T15:00:27.720 INFO:tasks.workunit.client.0.smithi152.stdout:9/327: dread - d0/dd/d20/d38/d48/f4f zero size 2023-12-06T15:00:27.720 INFO:tasks.workunit.client.0.smithi152.stdout:9/328: chown d0/c13 696 1 2023-12-06T15:00:27.721 INFO:tasks.workunit.client.1.smithi190.stdout:3/665: symlink d4/d70/d53/d56/d83/de2/le8 0 2023-12-06T15:00:27.723 INFO:tasks.workunit.client.0.smithi152.stdout:3/350: dwrite f7 [0,4194304] 0 2023-12-06T15:00:27.723 INFO:tasks.workunit.client.0.smithi152.stdout:3/351: chown d9/d10/f2e 320 1 2023-12-06T15:00:27.724 INFO:tasks.workunit.client.1.smithi190.stdout:9/622: rename d4/d27/d2f/d31/d3f/d58/d72/d7a/f9c to d4/d27/d2f/fd3 0 2023-12-06T15:00:27.724 INFO:tasks.workunit.client.1.smithi190.stdout:9/623: chown d4/d27/d8a/dbc 397 1 2023-12-06T15:00:27.724 INFO:tasks.workunit.client.0.smithi152.stdout:3/352: mkdir d9/d18/d1a/d65 0 2023-12-06T15:00:27.725 INFO:tasks.workunit.client.1.smithi190.stdout:5/451: link d0/d1c/f35 d0/d1c/d85/d90/f97 0 2023-12-06T15:00:27.726 INFO:tasks.workunit.client.0.smithi152.stdout:2/276: dwrite d6/d18/d43/f50 [0,4194304] 0 2023-12-06T15:00:27.727 INFO:tasks.workunit.client.0.smithi152.stdout:3/353: write d9/d10/d12/f3e [454370,4648] 0 2023-12-06T15:00:27.728 INFO:tasks.workunit.client.1.smithi190.stdout:1/802: symlink d6/l103 0 2023-12-06T15:00:27.729 INFO:tasks.workunit.client.0.smithi152.stdout:0/377: dwrite d8/d4b/f65 [0,4194304] 0 2023-12-06T15:00:27.730 INFO:tasks.workunit.client.0.smithi152.stdout:2/277: rename d6/db/l26 to d6/d18/d43/l51 0 2023-12-06T15:00:27.730 INFO:tasks.workunit.client.0.smithi152.stdout:2/278: chown d6/db/d13/l22 717 1 2023-12-06T15:00:27.732 INFO:tasks.workunit.client.0.smithi152.stdout:0/378: read d8/f13 [2886965,72787] 0 2023-12-06T15:00:27.733 INFO:tasks.workunit.client.0.smithi152.stdout:3/354: rmdir d9/d10/d32 39 2023-12-06T15:00:27.735 INFO:tasks.workunit.client.1.smithi190.stdout:3/666: creat d4/d1b/d54/d9c/fe9 x:0 0 0 2023-12-06T15:00:27.735 INFO:tasks.workunit.client.1.smithi190.stdout:9/624: creat d4/d27/d2f/d31/d3f/d58/d72/d7a/fd4 x:0 0 0 2023-12-06T15:00:27.735 INFO:tasks.workunit.client.1.smithi190.stdout:9/625: truncate d4/d84/fb6 1017716 0 2023-12-06T15:00:27.736 INFO:tasks.workunit.client.1.smithi190.stdout:7/612: sync 2023-12-06T15:00:27.736 INFO:tasks.workunit.client.1.smithi190.stdout:0/513: sync 2023-12-06T15:00:27.736 INFO:tasks.workunit.client.1.smithi190.stdout:7/613: write d0/f30 [2879719,127636] 0 2023-12-06T15:00:27.736 INFO:tasks.workunit.client.0.smithi152.stdout:2/279: mknod d6/db/c52 0 2023-12-06T15:00:27.736 INFO:tasks.workunit.client.0.smithi152.stdout:2/280: stat d6/cd 0 2023-12-06T15:00:27.738 INFO:tasks.workunit.client.0.smithi152.stdout:3/355: mknod d9/d10/d12/d43/d52/d58/c66 0 2023-12-06T15:00:27.740 INFO:tasks.workunit.client.0.smithi152.stdout:0/379: write f5 [2306951,32266] 0 2023-12-06T15:00:27.741 INFO:tasks.workunit.client.0.smithi152.stdout:2/281: rename d6/d18/f3d to d6/d1e/f53 0 2023-12-06T15:00:27.741 INFO:tasks.workunit.client.0.smithi152.stdout:2/282: stat d6/d1e/f2f 0 2023-12-06T15:00:27.741 INFO:tasks.workunit.client.1.smithi190.stdout:3/667: mkdir d4/d1b/d54/d9c/dea 0 2023-12-06T15:00:27.742 INFO:tasks.workunit.client.1.smithi190.stdout:5/452: rename d0/d1c/d85/d90/f93 to d0/d1c/f98 0 2023-12-06T15:00:27.742 INFO:tasks.workunit.client.0.smithi152.stdout:3/356: mknod d9/d10/d19/c67 0 2023-12-06T15:00:27.743 INFO:tasks.workunit.client.0.smithi152.stdout:0/380: creat d8/d44/d64/f74 x:0 0 0 2023-12-06T15:00:27.746 INFO:tasks.workunit.client.1.smithi190.stdout:0/514: mkdir d0/da/da4 0 2023-12-06T15:00:27.746 INFO:tasks.workunit.client.1.smithi190.stdout:0/515: write d0/da/f5b [1000364,46542] 0 2023-12-06T15:00:27.747 INFO:tasks.workunit.client.0.smithi152.stdout:0/381: link d8/d44/c5e d8/d44/c75 0 2023-12-06T15:00:27.748 INFO:tasks.workunit.client.0.smithi152.stdout:9/329: dwrite d0/dd/d20/f3c [0,4194304] 0 2023-12-06T15:00:27.748 INFO:tasks.workunit.client.0.smithi152.stdout:9/330: truncate d0/dd/d20/f5a 102013 0 2023-12-06T15:00:27.749 INFO:tasks.workunit.client.1.smithi190.stdout:3/668: symlink d4/d70/d53/d56/d94/leb 0 2023-12-06T15:00:27.750 INFO:tasks.workunit.client.1.smithi190.stdout:0/516: write d0/da/d3e/d3a/d40/d6f/f93 [3974483,125066] 0 2023-12-06T15:00:27.752 INFO:tasks.workunit.client.0.smithi152.stdout:9/331: getdents d0/dd 0 2023-12-06T15:00:27.754 INFO:tasks.workunit.client.0.smithi152.stdout:9/332: truncate d0/f23 6079798 0 2023-12-06T15:00:27.754 INFO:tasks.workunit.client.0.smithi152.stdout:9/333: readlink d0/dd/d20/l5c 0 2023-12-06T15:00:27.757 INFO:tasks.workunit.client.0.smithi152.stdout:9/334: truncate d0/f6 1651316 0 2023-12-06T15:00:27.757 INFO:tasks.workunit.client.1.smithi190.stdout:5/453: mkdir d0/d1c/d85/d90/d99 0 2023-12-06T15:00:27.757 INFO:tasks.workunit.client.1.smithi190.stdout:3/669: creat d4/d1b/d54/d9c/d68/fec x:0 0 0 2023-12-06T15:00:27.757 INFO:tasks.workunit.client.1.smithi190.stdout:3/670: truncate d4/d70/d53/d56/d94/d3d/fc3 967030 0 2023-12-06T15:00:27.757 INFO:tasks.workunit.client.1.smithi190.stdout:3/671: write d4/d70/d33/d45/f85 [228639,63339] 0 2023-12-06T15:00:27.758 INFO:tasks.workunit.client.1.smithi190.stdout:0/517: mknod d0/da/d3e/d3a/d40/d81/d8d/ca5 0 2023-12-06T15:00:27.758 INFO:tasks.workunit.client.1.smithi190.stdout:0/518: write d0/da/d5a/d80/f8c [1026283,76109] 0 2023-12-06T15:00:27.758 INFO:tasks.workunit.client.1.smithi190.stdout:5/454: creat d0/d1c/d2b/f9a x:0 0 0 2023-12-06T15:00:27.761 INFO:tasks.workunit.client.0.smithi152.stdout:9/335: dread d0/dd/fe [4194304,4194304] 0 2023-12-06T15:00:27.762 INFO:tasks.workunit.client.1.smithi190.stdout:3/672: creat d4/d1b/d54/d9c/d68/fed x:0 0 0 2023-12-06T15:00:27.762 INFO:tasks.workunit.client.1.smithi190.stdout:0/519: getdents d0/da/d3e/d2b 0 2023-12-06T15:00:27.763 INFO:tasks.workunit.client.1.smithi190.stdout:5/455: creat d0/df/f9b x:0 0 0 2023-12-06T15:00:27.764 INFO:tasks.workunit.client.1.smithi190.stdout:5/456: getdents d0/d1c/d2b/d2c 0 2023-12-06T15:00:27.764 INFO:tasks.workunit.client.0.smithi152.stdout:9/336: creat d0/dd/d20/d4a/d4d/f5e x:0 0 0 2023-12-06T15:00:27.765 INFO:tasks.workunit.client.0.smithi152.stdout:9/337: mkdir d0/d3f/d5f 0 2023-12-06T15:00:27.767 INFO:tasks.workunit.client.1.smithi190.stdout:0/520: write d0/da/d3e/d2b/d3c/d4c/f8b [3377763,5431] 0 2023-12-06T15:00:27.767 INFO:tasks.workunit.client.0.smithi152.stdout:9/338: rmdir d0/dd/d20/d38/d45 39 2023-12-06T15:00:27.768 INFO:tasks.workunit.client.1.smithi190.stdout:0/521: symlink d0/da/d3e/d3a/la6 0 2023-12-06T15:00:27.769 INFO:tasks.workunit.client.1.smithi190.stdout:0/522: mknod d0/da/d74/ca7 0 2023-12-06T15:00:27.772 INFO:tasks.workunit.client.1.smithi190.stdout:0/523: mkdir d0/da/d3e/d2b/d3c/d4c/da8 0 2023-12-06T15:00:27.772 INFO:tasks.workunit.client.1.smithi190.stdout:0/524: fdatasync d0/da/d3e/d2b/d3c/d4c/f53 0 2023-12-06T15:00:27.776 INFO:tasks.workunit.client.1.smithi190.stdout:1/803: dwrite d6/dc/d29/d38/d39/d63/d67/ffc [0,4194304] 0 2023-12-06T15:00:27.776 INFO:tasks.workunit.client.1.smithi190.stdout:1/804: chown d6/dc/d29/d38/d43/l4a 1 1 2023-12-06T15:00:27.776 INFO:tasks.workunit.client.1.smithi190.stdout:1/805: write d6/dc/d29/fb2 [4704192,65763] 0 2023-12-06T15:00:27.779 INFO:tasks.workunit.client.1.smithi190.stdout:1/806: symlink d6/dc/d29/d38/d73/d76/l104 0 2023-12-06T15:00:27.779 INFO:tasks.workunit.client.1.smithi190.stdout:1/807: write d6/dc/d29/d38/d43/d7f/da7/ffd [4720007,53029] 0 2023-12-06T15:00:27.780 INFO:tasks.workunit.client.1.smithi190.stdout:3/673: dread d4/d70/d53/d56/fa7 [0,4194304] 0 2023-12-06T15:00:27.781 INFO:tasks.workunit.client.1.smithi190.stdout:1/808: unlink d6/dc/d29/l65 0 2023-12-06T15:00:27.781 INFO:tasks.workunit.client.1.smithi190.stdout:1/809: readlink d6/dc/d29/d38/la2 0 2023-12-06T15:00:27.783 INFO:tasks.workunit.client.1.smithi190.stdout:3/674: creat d4/d70/d53/d56/d83/de2/fee x:0 0 0 2023-12-06T15:00:27.786 INFO:tasks.workunit.client.1.smithi190.stdout:3/675: unlink d4/d70/d53/d56/d94/f42 0 2023-12-06T15:00:27.787 INFO:tasks.workunit.client.1.smithi190.stdout:3/676: creat d4/d70/d33/d45/fef x:0 0 0 2023-12-06T15:00:27.788 INFO:tasks.workunit.client.1.smithi190.stdout:3/677: creat d4/d1b/d54/d9c/d68/ff0 x:0 0 0 2023-12-06T15:00:27.788 INFO:tasks.workunit.client.1.smithi190.stdout:3/678: chown d4/d1b/d54/d9c/fb6 5 1 2023-12-06T15:00:27.788 INFO:tasks.workunit.client.1.smithi190.stdout:3/679: fdatasync d4/d1b/d54/d9c/d68/d8a/fe4 0 2023-12-06T15:00:27.796 INFO:tasks.workunit.client.0.smithi152.stdout:3/357: dwrite d9/d18/f64 [0,4194304] 0 2023-12-06T15:00:27.796 INFO:tasks.workunit.client.0.smithi152.stdout:3/358: dread - d9/d18/d39/f62 zero size 2023-12-06T15:00:27.796 INFO:tasks.workunit.client.0.smithi152.stdout:2/283: dwrite f5 [4194304,4194304] 0 2023-12-06T15:00:27.800 INFO:tasks.workunit.client.0.smithi152.stdout:2/284: mknod d6/d1e/c54 0 2023-12-06T15:00:27.800 INFO:tasks.workunit.client.1.smithi190.stdout:1/810: dread d6/dc/d29/d38/fa5 [0,4194304] 0 2023-12-06T15:00:27.801 INFO:tasks.workunit.client.1.smithi190.stdout:9/626: dwrite d4/f2e [0,4194304] 0 2023-12-06T15:00:27.801 INFO:tasks.workunit.client.1.smithi190.stdout:1/811: stat d6/dc/d29/d38/d43/db7/de2 0 2023-12-06T15:00:27.801 INFO:tasks.workunit.client.1.smithi190.stdout:9/627: chown d4/d27/d2f/d31/cc1 2939963 1 2023-12-06T15:00:27.801 INFO:tasks.workunit.client.1.smithi190.stdout:1/812: fdatasync d6/dc/d29/d38/d39/dda/fdb 0 2023-12-06T15:00:27.801 INFO:tasks.workunit.client.1.smithi190.stdout:1/813: stat d6/dc/d29/d38/d43/c88 0 2023-12-06T15:00:27.801 INFO:tasks.workunit.client.1.smithi190.stdout:1/814: read d6/dc/d29/d38/d73/d76/fb3 [848531,83640] 0 2023-12-06T15:00:27.803 INFO:tasks.workunit.client.1.smithi190.stdout:7/614: dwrite d0/d35/f84 [0,4194304] 0 2023-12-06T15:00:27.804 INFO:tasks.workunit.client.0.smithi152.stdout:0/382: rename d8/d44/d64 to d8/d38/d76 0 2023-12-06T15:00:27.804 INFO:tasks.workunit.client.0.smithi152.stdout:0/383: chown d8/d15/d45/f70 588023368 1 2023-12-06T15:00:27.804 INFO:tasks.workunit.client.1.smithi190.stdout:7/615: read d0/f6 [127716,7144] 0 2023-12-06T15:00:27.804 INFO:tasks.workunit.client.1.smithi190.stdout:5/457: dwrite d0/f28 [0,4194304] 0 2023-12-06T15:00:27.804 INFO:tasks.workunit.client.1.smithi190.stdout:5/458: getdents d0/d1c/d94 0 2023-12-06T15:00:27.804 INFO:tasks.workunit.client.1.smithi190.stdout:5/459: write d0/d1c/f98 [451845,48217] 0 2023-12-06T15:00:27.805 INFO:tasks.workunit.client.0.smithi152.stdout:0/384: rename d8/d44/c5e to d8/d44/c77 0 2023-12-06T15:00:27.805 INFO:tasks.workunit.client.0.smithi152.stdout:0/385: stat d8/d38/d76/d6e 0 2023-12-06T15:00:27.806 INFO:tasks.workunit.client.0.smithi152.stdout:9/339: dwrite d0/dd/d20/f51 [0,4194304] 0 2023-12-06T15:00:27.806 INFO:tasks.workunit.client.0.smithi152.stdout:9/340: chown d0/d50/c55 29 1 2023-12-06T15:00:27.806 INFO:tasks.workunit.client.1.smithi190.stdout:0/525: dwrite d0/da/d3e/d2b/d3c/f60 [0,4194304] 0 2023-12-06T15:00:27.807 INFO:tasks.workunit.client.1.smithi190.stdout:0/526: dread d0/da/f25 [0,4194304] 0 2023-12-06T15:00:27.808 INFO:tasks.workunit.client.1.smithi190.stdout:7/616: write d0/df/f45 [2621844,14263] 0 2023-12-06T15:00:27.810 INFO:tasks.workunit.client.0.smithi152.stdout:0/386: write d8/d3e/f42 [3602609,45560] 0 2023-12-06T15:00:27.810 INFO:tasks.workunit.client.0.smithi152.stdout:9/341: mkdir d0/d3f/d5f/d60 0 2023-12-06T15:00:27.810 INFO:tasks.workunit.client.0.smithi152.stdout:9/342: write d0/d3f/f53 [817184,119234] 0 2023-12-06T15:00:27.811 INFO:tasks.workunit.client.0.smithi152.stdout:9/343: dread - d0/dd/d20/d38/f3d zero size 2023-12-06T15:00:27.811 INFO:tasks.workunit.client.0.smithi152.stdout:9/344: fdatasync d0/f5 0 2023-12-06T15:00:27.811 INFO:tasks.workunit.client.0.smithi152.stdout:9/345: write d0/d3f/f53 [969853,111604] 0 2023-12-06T15:00:27.812 INFO:tasks.workunit.client.0.smithi152.stdout:0/387: rename d8/d15/d45/f61 to d8/d44/f78 0 2023-12-06T15:00:27.813 INFO:tasks.workunit.client.0.smithi152.stdout:0/388: fdatasync d8/d38/f59 0 2023-12-06T15:00:27.813 INFO:tasks.workunit.client.1.smithi190.stdout:1/815: mknod d6/dc/d29/d38/d39/d63/c105 0 2023-12-06T15:00:27.813 INFO:tasks.workunit.client.1.smithi190.stdout:1/816: chown d6/dc/c32 3 1 2023-12-06T15:00:27.814 INFO:tasks.workunit.client.1.smithi190.stdout:9/628: dread d4/f11 [0,4194304] 0 2023-12-06T15:00:27.814 INFO:tasks.workunit.client.1.smithi190.stdout:9/629: rename d4/d27/d2f/d31 to d4/d27/d2f/d31/d3f/d58/dd5 22 2023-12-06T15:00:27.814 INFO:tasks.workunit.client.0.smithi152.stdout:0/389: creat d8/d38/d76/d6e/f79 x:0 0 0 2023-12-06T15:00:27.814 INFO:tasks.workunit.client.0.smithi152.stdout:0/390: truncate d8/d44/f46 292383 0 2023-12-06T15:00:27.815 INFO:tasks.workunit.client.1.smithi190.stdout:5/460: mkdir d0/df/d50/d9c 0 2023-12-06T15:00:27.816 INFO:tasks.workunit.client.1.smithi190.stdout:1/817: write d6/dc/f33 [837240,10930] 0 2023-12-06T15:00:27.816 INFO:tasks.workunit.client.0.smithi152.stdout:9/346: write d0/f1 [6149975,110991] 0 2023-12-06T15:00:27.816 INFO:tasks.workunit.client.0.smithi152.stdout:9/347: fsync d0/f36 0 2023-12-06T15:00:27.816 INFO:tasks.workunit.client.0.smithi152.stdout:0/391: rename d8/d1b to d8/d15/d45/d73/d7a 0 2023-12-06T15:00:27.817 INFO:tasks.workunit.client.1.smithi190.stdout:9/630: write d4/d27/d2f/d31/d3f/f55 [2726086,78536] 0 2023-12-06T15:00:27.817 INFO:tasks.workunit.client.1.smithi190.stdout:5/461: write d0/f7 [2917519,77202] 0 2023-12-06T15:00:27.817 INFO:tasks.workunit.client.1.smithi190.stdout:5/462: readlink d0/d1c/d2b/d2c/d5d/d73/l3a 0 2023-12-06T15:00:27.817 INFO:tasks.workunit.client.1.smithi190.stdout:5/463: write d0/d1c/d3e/f51 [1193171,94667] 0 2023-12-06T15:00:27.817 INFO:tasks.workunit.client.1.smithi190.stdout:0/527: creat d0/da/fa9 x:0 0 0 2023-12-06T15:00:27.819 INFO:tasks.workunit.client.1.smithi190.stdout:7/617: creat d0/d88/d1c/d17/fca x:0 0 0 2023-12-06T15:00:27.819 INFO:tasks.workunit.client.1.smithi190.stdout:7/618: fdatasync d0/df/d1f/f46 0 2023-12-06T15:00:27.820 INFO:tasks.workunit.client.1.smithi190.stdout:1/818: mkdir d6/dc/d3b/d78/d106 0 2023-12-06T15:00:27.822 INFO:tasks.workunit.client.1.smithi190.stdout:9/631: symlink d4/d27/d2f/d31/d3f/d58/d7d/ld6 0 2023-12-06T15:00:27.822 INFO:tasks.workunit.client.1.smithi190.stdout:9/632: truncate d4/d27/d2f/d31/d3f/f69 5099065 0 2023-12-06T15:00:27.822 INFO:tasks.workunit.client.1.smithi190.stdout:9/633: fsync d4/f2d 0 2023-12-06T15:00:27.822 INFO:tasks.workunit.client.1.smithi190.stdout:9/634: read - d4/d27/d8a/fb1 zero size 2023-12-06T15:00:27.823 INFO:tasks.workunit.client.1.smithi190.stdout:9/635: read d4/d27/f8c [867064,96571] 0 2023-12-06T15:00:27.824 INFO:tasks.workunit.client.1.smithi190.stdout:0/528: mkdir d0/da/d3e/d3a/d40/d81/daa 0 2023-12-06T15:00:27.824 INFO:tasks.workunit.client.1.smithi190.stdout:0/529: stat d0/da/d3e/d2b/d3c/l6b 0 2023-12-06T15:00:27.825 INFO:tasks.workunit.client.1.smithi190.stdout:0/530: creat d0/da/d3e/d3a/d40/d6f/fab x:0 0 0 2023-12-06T15:00:27.825 INFO:tasks.workunit.client.1.smithi190.stdout:9/636: dread d4/d27/f53 [0,4194304] 0 2023-12-06T15:00:27.828 INFO:tasks.workunit.client.1.smithi190.stdout:0/531: rename d0/da/d3e/d3a/d40/f26 to d0/da/d5a/fac 0 2023-12-06T15:00:27.828 INFO:tasks.workunit.client.1.smithi190.stdout:0/532: chown d0/da/d3e/d2b/d3c/d65 82498 1 2023-12-06T15:00:27.828 INFO:tasks.workunit.client.1.smithi190.stdout:0/533: write d0/da/d3e/d3a/d40/f5e [4290670,102660] 0 2023-12-06T15:00:27.828 INFO:tasks.workunit.client.1.smithi190.stdout:0/534: chown d0/da/d3e/d2b/d3c/l6a 1266297 1 2023-12-06T15:00:27.828 INFO:tasks.workunit.client.1.smithi190.stdout:0/535: stat d0/da/d3e/d2b/d3c/d4c 0 2023-12-06T15:00:27.828 INFO:tasks.workunit.client.1.smithi190.stdout:0/536: truncate d0/da/d3e/d2b/d3c/d46/d8e/fa0 69222 0 2023-12-06T15:00:27.828 INFO:tasks.workunit.client.1.smithi190.stdout:0/537: stat d0/da/d3e/d2b/d37/f76 0 2023-12-06T15:00:27.849 INFO:tasks.workunit.client.1.smithi190.stdout:7/619: dwrite d0/d88/d32/f7d [0,4194304] 0 2023-12-06T15:00:27.849 INFO:tasks.workunit.client.1.smithi190.stdout:9/637: dwrite d4/f24 [0,4194304] 0 2023-12-06T15:00:27.851 INFO:tasks.workunit.client.1.smithi190.stdout:7/620: rmdir d0/df/d5f 39 2023-12-06T15:00:27.851 INFO:tasks.workunit.client.0.smithi152.stdout:4/531: sync 2023-12-06T15:00:27.852 INFO:tasks.workunit.client.0.smithi152.stdout:4/532: rmdir d2/d89 39 2023-12-06T15:00:27.853 INFO:tasks.workunit.client.1.smithi190.stdout:7/621: rmdir d0/d5/d63 39 2023-12-06T15:00:27.853 INFO:tasks.workunit.client.1.smithi190.stdout:9/638: rename d4/d27/f8c to d4/d27/d2f/d31/d3f/d58/d72/db3/fd7 0 2023-12-06T15:00:27.853 INFO:tasks.workunit.client.1.smithi190.stdout:9/639: write d4/d27/d2f/d31/d3f/d58/d72/db3/fc7 [567270,54804] 0 2023-12-06T15:00:27.853 INFO:tasks.workunit.client.0.smithi152.stdout:4/533: creat d2/d10/fa5 x:0 0 0 2023-12-06T15:00:27.854 INFO:tasks.workunit.client.0.smithi152.stdout:4/534: readlink d2/d10/d27/l9c 0 2023-12-06T15:00:27.855 INFO:tasks.workunit.client.1.smithi190.stdout:7/622: rename d0/df/f42 to d0/df/d53/d99/fcb 0 2023-12-06T15:00:27.855 INFO:tasks.workunit.client.1.smithi190.stdout:7/623: chown d0/d5/da/f49 113911347 1 2023-12-06T15:00:27.856 INFO:tasks.workunit.client.1.smithi190.stdout:9/640: creat d4/d84/fd8 x:0 0 0 2023-12-06T15:00:27.856 INFO:tasks.workunit.client.1.smithi190.stdout:1/819: dwrite d6/dc/d29/d38/d43/d7f/da7/fc5 [0,4194304] 0 2023-12-06T15:00:27.859 INFO:tasks.workunit.client.1.smithi190.stdout:1/820: symlink d6/dc/d29/d38/d73/l107 0 2023-12-06T15:00:27.860 INFO:tasks.workunit.client.1.smithi190.stdout:1/821: chown d6/dc/cc9 52570 1 2023-12-06T15:00:27.860 INFO:tasks.workunit.client.1.smithi190.stdout:1/822: write d6/f21 [1308826,63682] 0 2023-12-06T15:00:27.866 INFO:tasks.workunit.client.0.smithi152.stdout:4/535: dread d2/d10/f24 [0,4194304] 0 2023-12-06T15:00:27.867 INFO:tasks.workunit.client.1.smithi190.stdout:1/823: link d6/dc/d29/d38/d73/f41 d6/dc/d29/d38/d43/f108 0 2023-12-06T15:00:27.867 INFO:tasks.workunit.client.1.smithi190.stdout:9/641: dread d4/f25 [0,4194304] 0 2023-12-06T15:00:27.867 INFO:tasks.workunit.client.0.smithi152.stdout:3/359: dwrite d9/d45/f53 [0,4194304] 0 2023-12-06T15:00:27.867 INFO:tasks.workunit.client.0.smithi152.stdout:3/360: write d9/d10/f2f [4965400,50925] 0 2023-12-06T15:00:27.870 INFO:tasks.workunit.client.0.smithi152.stdout:9/348: dread d0/dd/d20/f51 [0,4194304] 0 2023-12-06T15:00:27.870 INFO:tasks.workunit.client.0.smithi152.stdout:9/349: chown d0/l11 114777 1 2023-12-06T15:00:27.870 INFO:tasks.workunit.client.0.smithi152.stdout:9/350: chown d0/dd/d20/d38/d45/c5d 3 1 2023-12-06T15:00:27.870 INFO:tasks.workunit.client.0.smithi152.stdout:9/351: truncate d0/dd/f2f 889231 0 2023-12-06T15:00:27.872 INFO:tasks.workunit.client.0.smithi152.stdout:4/536: mknod d2/d45/d84/da4/ca6 0 2023-12-06T15:00:27.873 INFO:tasks.workunit.client.0.smithi152.stdout:4/537: dread - d2/d89/fa1 zero size 2023-12-06T15:00:27.873 INFO:tasks.workunit.client.0.smithi152.stdout:3/361: creat d9/d10/f68 x:0 0 0 2023-12-06T15:00:27.873 INFO:tasks.workunit.client.0.smithi152.stdout:4/538: dread - d2/d15/d32/d54/d85/f87 zero size 2023-12-06T15:00:27.876 INFO:tasks.workunit.client.0.smithi152.stdout:3/362: mknod d9/d10/d19/c69 0 2023-12-06T15:00:27.877 INFO:tasks.workunit.client.0.smithi152.stdout:4/539: mknod d2/d22/d6e/ca7 0 2023-12-06T15:00:27.877 INFO:tasks.workunit.client.1.smithi190.stdout:1/824: mkdir d6/dc/d3b/d78/d94/d109 0 2023-12-06T15:00:27.877 INFO:tasks.workunit.client.1.smithi190.stdout:1/825: chown d6/dc/d29/d38/d73/d5c/dd2/fd8 40886 1 2023-12-06T15:00:27.877 INFO:tasks.workunit.client.1.smithi190.stdout:1/826: fsync d6/dc/d29/f83 0 2023-12-06T15:00:27.877 INFO:tasks.workunit.client.1.smithi190.stdout:9/642: creat d4/d27/d2f/d31/da6/dcd/fd9 x:0 0 0 2023-12-06T15:00:27.878 INFO:tasks.workunit.client.0.smithi152.stdout:4/540: mkdir d2/d22/d6e/da8 0 2023-12-06T15:00:27.878 INFO:tasks.workunit.client.1.smithi190.stdout:6/672: sync 2023-12-06T15:00:27.878 INFO:tasks.workunit.client.1.smithi190.stdout:6/673: chown d4/d12/d40/d43/c67 1 1 2023-12-06T15:00:27.880 INFO:tasks.workunit.client.1.smithi190.stdout:9/643: truncate d4/d27/d2f/d5c/fb2 492090 0 2023-12-06T15:00:27.880 INFO:tasks.workunit.client.0.smithi152.stdout:4/541: mknod d2/ca9 0 2023-12-06T15:00:27.880 INFO:tasks.workunit.client.0.smithi152.stdout:4/542: chown d2/d22/d6e/c8d 1500 1 2023-12-06T15:00:27.880 INFO:tasks.workunit.client.0.smithi152.stdout:4/543: write d2/d15/d23/d75/f98 [1025593,4272] 0 2023-12-06T15:00:27.881 INFO:tasks.workunit.client.1.smithi190.stdout:6/674: mkdir d4/d12/d1a/d32/dab/de1 0 2023-12-06T15:00:27.882 INFO:tasks.workunit.client.1.smithi190.stdout:9/644: mkdir d4/d84/dda 0 2023-12-06T15:00:27.882 INFO:tasks.workunit.client.1.smithi190.stdout:9/645: readlink d4/d27/l6d 0 2023-12-06T15:00:27.885 INFO:tasks.workunit.client.1.smithi190.stdout:5/464: dwrite d0/fd [0,4194304] 0 2023-12-06T15:00:27.885 INFO:tasks.workunit.client.1.smithi190.stdout:5/465: rename d0 to d0/d1c/d2b/d8b/d9d 22 2023-12-06T15:00:27.886 INFO:tasks.workunit.client.1.smithi190.stdout:7/624: dwrite d0/d35/d8e/f9a [0,4194304] 0 2023-12-06T15:00:27.886 INFO:tasks.workunit.client.0.smithi152.stdout:0/392: dwrite d8/d15/d45/d73/d7a/f36 [0,4194304] 0 2023-12-06T15:00:27.887 INFO:tasks.workunit.client.0.smithi152.stdout:0/393: dread d8/d15/d45/d73/d7a/f1f [0,4194304] 0 2023-12-06T15:00:27.888 INFO:tasks.workunit.client.1.smithi190.stdout:5/466: unlink d0/f53 0 2023-12-06T15:00:27.891 INFO:tasks.workunit.client.0.smithi152.stdout:0/394: creat d8/d38/d76/d68/f7b x:0 0 0 2023-12-06T15:00:27.893 INFO:tasks.workunit.client.1.smithi190.stdout:7/625: creat d0/d88/d41/d92/fcc x:0 0 0 2023-12-06T15:00:27.893 INFO:tasks.workunit.client.1.smithi190.stdout:7/626: fsync d0/d88/d32/f7d 0 2023-12-06T15:00:27.893 INFO:tasks.workunit.client.1.smithi190.stdout:7/627: chown d0/d5/d63/f96 656 1 2023-12-06T15:00:27.896 INFO:tasks.workunit.client.1.smithi190.stdout:5/467: creat d0/d1c/d2b/f9e x:0 0 0 2023-12-06T15:00:27.897 INFO:tasks.workunit.client.0.smithi152.stdout:5/320: sync 2023-12-06T15:00:27.898 INFO:tasks.workunit.client.0.smithi152.stdout:7/251: sync 2023-12-06T15:00:27.898 INFO:tasks.workunit.client.0.smithi152.stdout:5/321: fdatasync d7/dd/d26/f44 0 2023-12-06T15:00:27.898 INFO:tasks.workunit.client.0.smithi152.stdout:4/544: dread d2/d45/f6b [0,4194304] 0 2023-12-06T15:00:27.898 INFO:tasks.workunit.client.0.smithi152.stdout:0/395: dread d8/d44/f46 [0,4194304] 0 2023-12-06T15:00:27.898 INFO:tasks.workunit.client.0.smithi152.stdout:5/322: mknod d7/c6d 0 2023-12-06T15:00:27.899 INFO:tasks.workunit.client.0.smithi152.stdout:4/545: mknod d2/d15/d23/d42/caa 0 2023-12-06T15:00:27.899 INFO:tasks.workunit.client.0.smithi152.stdout:0/396: symlink d8/d38/d76/d6e/l7c 0 2023-12-06T15:00:27.900 INFO:tasks.workunit.client.0.smithi152.stdout:5/323: creat d7/dd/d26/d3b/f6e x:0 0 0 2023-12-06T15:00:27.902 INFO:tasks.workunit.client.0.smithi152.stdout:0/397: unlink d8/f3a 0 2023-12-06T15:00:27.902 INFO:tasks.workunit.client.1.smithi190.stdout:7/628: dread d0/d88/d41/fa1 [0,4194304] 0 2023-12-06T15:00:27.903 INFO:tasks.workunit.client.0.smithi152.stdout:5/324: symlink d7/dd/d26/d3b/d46/l6f 0 2023-12-06T15:00:27.904 INFO:tasks.workunit.client.0.smithi152.stdout:5/325: rename d7/d47/f53 to d7/dd/d4e/f70 0 2023-12-06T15:00:27.905 INFO:tasks.workunit.client.0.smithi152.stdout:5/326: fsync d7/f1f 0 2023-12-06T15:00:27.906 INFO:tasks.workunit.client.0.smithi152.stdout:5/327: symlink d7/dd/d26/l71 0 2023-12-06T15:00:27.907 INFO:tasks.workunit.client.0.smithi152.stdout:5/328: mknod d7/d43/d6c/c72 0 2023-12-06T15:00:27.907 INFO:tasks.workunit.client.0.smithi152.stdout:5/329: write d7/dd/d26/f44 [440917,119030] 0 2023-12-06T15:00:27.908 INFO:tasks.workunit.client.0.smithi152.stdout:5/330: creat d7/dd/d4e/f73 x:0 0 0 2023-12-06T15:00:27.908 INFO:tasks.workunit.client.0.smithi152.stdout:7/252: dread f8 [0,4194304] 0 2023-12-06T15:00:27.908 INFO:tasks.workunit.client.0.smithi152.stdout:7/253: dread - dd/df/d1b/d20/d28/f3e zero size 2023-12-06T15:00:27.909 INFO:tasks.workunit.client.0.smithi152.stdout:5/331: truncate d7/dd/f20 657455 0 2023-12-06T15:00:27.909 INFO:tasks.workunit.client.0.smithi152.stdout:7/254: truncate f9 1068900 0 2023-12-06T15:00:27.911 INFO:tasks.workunit.client.0.smithi152.stdout:5/332: creat d7/d47/f74 x:0 0 0 2023-12-06T15:00:27.911 INFO:tasks.workunit.client.1.smithi190.stdout:4/482: sync 2023-12-06T15:00:27.911 INFO:tasks.workunit.client.1.smithi190.stdout:2/511: sync 2023-12-06T15:00:27.911 INFO:tasks.workunit.client.1.smithi190.stdout:4/483: chown d3/d76/d8b 4 1 2023-12-06T15:00:27.913 INFO:tasks.workunit.client.1.smithi190.stdout:2/512: symlink d10/d26/d5b/d76/lb4 0 2023-12-06T15:00:27.914 INFO:tasks.workunit.client.1.smithi190.stdout:4/484: creat d3/d76/d7c/d96/d7a/f9a x:0 0 0 2023-12-06T15:00:27.914 INFO:tasks.workunit.client.1.smithi190.stdout:4/485: write d3/d76/d7c/d96/d15/f23 [1745196,51185] 0 2023-12-06T15:00:27.916 INFO:tasks.workunit.client.1.smithi190.stdout:4/486: rmdir d3/d35/d19/d30 39 2023-12-06T15:00:27.917 INFO:tasks.workunit.client.0.smithi152.stdout:3/363: dwrite d9/d10/d32/f3d [0,4194304] 0 2023-12-06T15:00:27.919 INFO:tasks.workunit.client.1.smithi190.stdout:4/487: creat d3/d35/d19/d41/d44/f9b x:0 0 0 2023-12-06T15:00:27.919 INFO:tasks.workunit.client.1.smithi190.stdout:4/488: fsync d3/d35/d19/d41/d44/f70 0 2023-12-06T15:00:27.920 INFO:tasks.workunit.client.0.smithi152.stdout:0/398: dread d8/d3e/f43 [0,4194304] 0 2023-12-06T15:00:27.921 INFO:tasks.workunit.client.0.smithi152.stdout:0/399: truncate d8/d15/d45/d73/d7a/f1f 498061 0 2023-12-06T15:00:27.922 INFO:tasks.workunit.client.1.smithi190.stdout:4/489: rename d3/d76/d7c/d96/d7f to d3/d35/d19/d41/d44/d9c 0 2023-12-06T15:00:27.922 INFO:tasks.workunit.client.1.smithi190.stdout:4/490: stat d3/l11 0 2023-12-06T15:00:27.923 INFO:tasks.workunit.client.0.smithi152.stdout:0/400: creat d8/d38/d76/d68/f7d x:0 0 0 2023-12-06T15:00:27.924 INFO:tasks.workunit.client.1.smithi190.stdout:9/646: dwrite d4/d27/d2f/d31/d3f/d58/fa3 [0,4194304] 0 2023-12-06T15:00:27.924 INFO:tasks.workunit.client.1.smithi190.stdout:4/491: dread - d3/d35/d19/d30/f86 zero size 2023-12-06T15:00:27.925 INFO:tasks.workunit.client.0.smithi152.stdout:4/546: dwrite d2/d15/f58 [4194304,4194304] 0 2023-12-06T15:00:27.925 INFO:tasks.workunit.client.0.smithi152.stdout:0/401: creat d8/d3e/f7e x:0 0 0 2023-12-06T15:00:27.925 INFO:tasks.workunit.client.0.smithi152.stdout:0/402: fdatasync d8/f20 0 2023-12-06T15:00:27.925 INFO:tasks.workunit.client.1.smithi190.stdout:9/647: creat d4/d27/d8a/fdb x:0 0 0 2023-12-06T15:00:27.926 INFO:tasks.workunit.client.0.smithi152.stdout:0/403: read d8/d38/f59 [614856,109584] 0 2023-12-06T15:00:27.926 INFO:tasks.workunit.client.1.smithi190.stdout:2/513: dread d10/d26/d5b/f89 [0,4194304] 0 2023-12-06T15:00:27.926 INFO:tasks.workunit.client.1.smithi190.stdout:4/492: truncate d3/d35/d19/f5e 3323403 0 2023-12-06T15:00:27.927 INFO:tasks.workunit.client.1.smithi190.stdout:2/514: truncate d10/d26/d5c/f43 443297 0 2023-12-06T15:00:27.927 INFO:tasks.workunit.client.1.smithi190.stdout:2/515: dread - d10/d26/d5c/d49/f9c zero size 2023-12-06T15:00:27.927 INFO:tasks.workunit.client.1.smithi190.stdout:2/516: truncate d10/d26/d5b/d7f/d8e/fa2 116705 0 2023-12-06T15:00:27.928 INFO:tasks.workunit.client.1.smithi190.stdout:4/493: truncate d3/f26 7217 0 2023-12-06T15:00:27.928 INFO:tasks.workunit.client.1.smithi190.stdout:4/494: stat d3/d35/f95 0 2023-12-06T15:00:27.928 INFO:tasks.workunit.client.0.smithi152.stdout:0/404: getdents d8/d4b 0 2023-12-06T15:00:27.928 INFO:tasks.workunit.client.0.smithi152.stdout:4/547: write d2/d15/f62 [834103,103541] 0 2023-12-06T15:00:27.929 INFO:tasks.workunit.client.1.smithi190.stdout:4/495: creat d3/d35/d19/d41/d44/d9c/d72/f9d x:0 0 0 2023-12-06T15:00:27.930 INFO:tasks.workunit.client.1.smithi190.stdout:4/496: symlink d3/d76/d7c/d96/l9e 0 2023-12-06T15:00:27.930 INFO:tasks.workunit.client.0.smithi152.stdout:0/405: unlink d8/d15/f2c 0 2023-12-06T15:00:27.931 INFO:tasks.workunit.client.1.smithi190.stdout:4/497: creat d3/d35/d19/d41/d44/f9f x:0 0 0 2023-12-06T15:00:27.932 INFO:tasks.workunit.client.0.smithi152.stdout:4/548: rename d2/d10/d7a to d2/d10/dab 0 2023-12-06T15:00:27.932 INFO:tasks.workunit.client.0.smithi152.stdout:4/549: write d2/d15/d23/d75/f98 [1199951,11007] 0 2023-12-06T15:00:27.932 INFO:tasks.workunit.client.0.smithi152.stdout:4/550: stat d2/l9d 0 2023-12-06T15:00:27.933 INFO:tasks.workunit.client.1.smithi190.stdout:4/498: dread d3/d76/d7c/d96/d39/d54/f60 [0,4194304] 0 2023-12-06T15:00:27.933 INFO:tasks.workunit.client.1.smithi190.stdout:4/499: write d3/d76/d7c/d8a/f99 [247921,46848] 0 2023-12-06T15:00:27.933 INFO:tasks.workunit.client.1.smithi190.stdout:4/500: write d3/d35/d19/d41/d44/f9b [921927,71078] 0 2023-12-06T15:00:27.933 INFO:tasks.workunit.client.1.smithi190.stdout:4/501: fsync d3/d35/d19/d30/d3c/d4d/f55 0 2023-12-06T15:00:27.933 INFO:tasks.workunit.client.1.smithi190.stdout:4/502: readlink d3/d76/d7c/d96/l2b 0 2023-12-06T15:00:27.935 INFO:tasks.workunit.client.0.smithi152.stdout:0/406: creat d8/d15/d45/f7f x:0 0 0 2023-12-06T15:00:27.935 INFO:tasks.workunit.client.0.smithi152.stdout:5/333: dwrite d7/d47/f74 [0,4194304] 0 2023-12-06T15:00:27.935 INFO:tasks.workunit.client.0.smithi152.stdout:7/255: dwrite dd/df/f43 [0,4194304] 0 2023-12-06T15:00:27.936 INFO:tasks.workunit.client.1.smithi190.stdout:7/629: rmdir d0 39 2023-12-06T15:00:27.939 INFO:tasks.workunit.client.1.smithi190.stdout:2/517: dread d10/d26/d5c/d37/f3d [0,4194304] 0 2023-12-06T15:00:27.939 INFO:tasks.workunit.client.0.smithi152.stdout:5/334: mknod d7/dd/d4e/c75 0 2023-12-06T15:00:27.939 INFO:tasks.workunit.client.1.smithi190.stdout:7/630: creat d0/d88/d41/d92/fcd x:0 0 0 2023-12-06T15:00:27.944 INFO:tasks.workunit.client.1.smithi190.stdout:7/631: rmdir d0 39 2023-12-06T15:00:27.945 INFO:tasks.workunit.client.0.smithi152.stdout:5/335: read d7/f28 [3590043,93885] 0 2023-12-06T15:00:27.948 INFO:tasks.workunit.client.1.smithi190.stdout:7/632: rename d0/d5/da/d56/f82 to d0/df/d53/d99/fce 0 2023-12-06T15:00:27.948 INFO:tasks.workunit.client.1.smithi190.stdout:7/633: fsync d0/df/d53/d2f/d3e/f7e 0 2023-12-06T15:00:27.948 INFO:tasks.workunit.client.1.smithi190.stdout:7/634: dread - d0/d88/d7a/fbe zero size 2023-12-06T15:00:27.948 INFO:tasks.workunit.client.1.smithi190.stdout:7/635: chown d0/d88/d33 115760553 1 2023-12-06T15:00:27.954 INFO:tasks.workunit.client.1.smithi190.stdout:7/636: creat d0/d5/da/d56/fcf x:0 0 0 2023-12-06T15:00:27.956 INFO:tasks.workunit.client.1.smithi190.stdout:7/637: creat d0/d88/d1c/fd0 x:0 0 0 2023-12-06T15:00:27.956 INFO:tasks.workunit.client.1.smithi190.stdout:7/638: truncate d0/d5/da/f49 347096 0 2023-12-06T15:00:27.958 INFO:tasks.workunit.client.1.smithi190.stdout:7/639: rename d0/df/d53/d2f/d3e to d0/d88/d7a/d7c/dab/dc0/dd1 0 2023-12-06T15:00:27.959 INFO:tasks.workunit.client.0.smithi152.stdout:5/336: dread d7/f28 [0,4194304] 0 2023-12-06T15:00:27.961 INFO:tasks.workunit.client.1.smithi190.stdout:7/640: creat d0/d88/d7a/fd2 x:0 0 0 2023-12-06T15:00:27.962 INFO:tasks.workunit.client.1.smithi190.stdout:7/641: unlink d0/d88/d32/f5b 0 2023-12-06T15:00:27.963 INFO:tasks.workunit.client.1.smithi190.stdout:7/642: write d0/df/d53/d2f/f70 [625758,111482] 0 2023-12-06T15:00:27.966 INFO:tasks.workunit.client.0.smithi152.stdout:4/551: dwrite d2/d22/f4a [0,4194304] 0 2023-12-06T15:00:27.968 INFO:tasks.workunit.client.1.smithi190.stdout:7/643: write d0/d5/f8 [406273,15302] 0 2023-12-06T15:00:27.968 INFO:tasks.workunit.client.1.smithi190.stdout:7/644: truncate d0/df/d5f/fa3 384828 0 2023-12-06T15:00:27.969 INFO:tasks.workunit.client.0.smithi152.stdout:4/552: getdents d2/d45/d84 0 2023-12-06T15:00:27.969 INFO:tasks.workunit.client.0.smithi152.stdout:4/553: dread - d2/d89/fa1 zero size 2023-12-06T15:00:27.969 INFO:tasks.workunit.client.1.smithi190.stdout:7/645: symlink d0/d88/d7a/dc9/ld3 0 2023-12-06T15:00:27.969 INFO:tasks.workunit.client.1.smithi190.stdout:7/646: chown d0/d88/d1c/d17/d94 19 1 2023-12-06T15:00:27.970 INFO:tasks.workunit.client.1.smithi190.stdout:7/647: fdatasync d0/d35/f84 0 2023-12-06T15:00:27.970 INFO:tasks.workunit.client.1.smithi190.stdout:4/503: dwrite d3/d76/d7c/d96/d39/f48 [0,4194304] 0 2023-12-06T15:00:27.970 INFO:tasks.workunit.client.1.smithi190.stdout:4/504: write d3/d35/f6a [1152389,65646] 0 2023-12-06T15:00:27.971 INFO:tasks.workunit.client.0.smithi152.stdout:0/407: dwrite d8/d3e/f69 [0,4194304] 0 2023-12-06T15:00:27.971 INFO:tasks.workunit.client.0.smithi152.stdout:0/408: dread - d8/d15/d45/f70 zero size 2023-12-06T15:00:27.971 INFO:tasks.workunit.client.0.smithi152.stdout:7/256: dwrite f3 [0,4194304] 0 2023-12-06T15:00:27.972 INFO:tasks.workunit.client.1.smithi190.stdout:7/648: link d0/df/d53/d99/fcb d0/fd4 0 2023-12-06T15:00:27.972 INFO:tasks.workunit.client.0.smithi152.stdout:4/554: read d2/d15/d32/f6a [861691,121978] 0 2023-12-06T15:00:27.972 INFO:tasks.workunit.client.0.smithi152.stdout:4/555: readlink d2/l9d 0 2023-12-06T15:00:27.973 INFO:tasks.workunit.client.0.smithi152.stdout:0/409: mknod d8/d3e/d6f/c80 0 2023-12-06T15:00:27.973 INFO:tasks.workunit.client.0.smithi152.stdout:0/410: chown d8/f3f 1545 1 2023-12-06T15:00:27.973 INFO:tasks.workunit.client.1.smithi190.stdout:7/649: write d0/d5/f78 [68189,125437] 0 2023-12-06T15:00:27.974 INFO:tasks.workunit.client.1.smithi190.stdout:4/505: creat d3/d35/d19/d30/d3c/d4d/fa0 x:0 0 0 2023-12-06T15:00:27.975 INFO:tasks.workunit.client.1.smithi190.stdout:4/506: readlink d3/d35/d19/d30/l81 0 2023-12-06T15:00:27.975 INFO:tasks.workunit.client.1.smithi190.stdout:7/650: getdents d0/d88/d1c/d17/d94/d95 0 2023-12-06T15:00:27.975 INFO:tasks.workunit.client.0.smithi152.stdout:7/257: mkdir dd/df/d34/d44/d49 0 2023-12-06T15:00:27.975 INFO:tasks.workunit.client.0.smithi152.stdout:7/258: fsync dd/f24 0 2023-12-06T15:00:27.975 INFO:tasks.workunit.client.0.smithi152.stdout:4/556: creat d2/d22/d6e/fac x:0 0 0 2023-12-06T15:00:27.976 INFO:tasks.workunit.client.1.smithi190.stdout:7/651: rename d0/d88/c24 to d0/df/d5f/cd5 0 2023-12-06T15:00:27.976 INFO:tasks.workunit.client.1.smithi190.stdout:7/652: read - d0/df/d53/d15/fad zero size 2023-12-06T15:00:27.977 INFO:tasks.workunit.client.0.smithi152.stdout:7/259: mknod dd/c4a 0 2023-12-06T15:00:27.977 INFO:tasks.workunit.client.0.smithi152.stdout:4/557: rename d2/d10/d27/l9c to d2/d22/d6e/lad 0 2023-12-06T15:00:27.977 INFO:tasks.workunit.client.0.smithi152.stdout:4/558: chown d2/d15/d23/d42/caa 6 1 2023-12-06T15:00:27.977 INFO:tasks.workunit.client.0.smithi152.stdout:4/559: truncate d2/d15/d32/f92 905355 0 2023-12-06T15:00:27.978 INFO:tasks.workunit.client.0.smithi152.stdout:0/411: write d8/d4b/f65 [7379315,38402] 0 2023-12-06T15:00:27.978 INFO:tasks.workunit.client.0.smithi152.stdout:4/560: mknod d2/d45/d84/cae 0 2023-12-06T15:00:27.980 INFO:tasks.workunit.client.0.smithi152.stdout:0/412: mkdir d8/d4b/d81 0 2023-12-06T15:00:27.980 INFO:tasks.workunit.client.0.smithi152.stdout:0/413: write d8/d38/f59 [1209375,38370] 0 2023-12-06T15:00:27.981 INFO:tasks.workunit.client.0.smithi152.stdout:4/561: mkdir d2/d15/d32/d69/d6f/daf 0 2023-12-06T15:00:27.981 INFO:tasks.workunit.client.0.smithi152.stdout:4/562: chown d2/d15/d32/d69/d6f 3 1 2023-12-06T15:00:27.981 INFO:tasks.workunit.client.1.smithi190.stdout:4/507: write d3/fa [2387467,8325] 0 2023-12-06T15:00:27.981 INFO:tasks.workunit.client.1.smithi190.stdout:4/508: chown d3/d76/d7c/d96/d39/d54/f84 18012035 1 2023-12-06T15:00:27.982 INFO:tasks.workunit.client.0.smithi152.stdout:0/414: mknod d8/d38/d76/d6e/c82 0 2023-12-06T15:00:27.983 INFO:tasks.workunit.client.0.smithi152.stdout:4/563: dread d2/d15/d32/f92 [0,4194304] 0 2023-12-06T15:00:27.983 INFO:tasks.workunit.client.0.smithi152.stdout:4/564: dread - d2/f7c zero size 2023-12-06T15:00:27.983 INFO:tasks.workunit.client.0.smithi152.stdout:0/415: mkdir d8/d15/d45/d83 0 2023-12-06T15:00:27.983 INFO:tasks.workunit.client.0.smithi152.stdout:5/337: dwrite d7/dd/d26/d3a/f4f [0,4194304] 0 2023-12-06T15:00:27.984 INFO:tasks.workunit.client.0.smithi152.stdout:4/565: mknod d2/d89/d9e/cb0 0 2023-12-06T15:00:27.984 INFO:tasks.workunit.client.0.smithi152.stdout:4/566: fdatasync d2/d15/f7f 0 2023-12-06T15:00:27.984 INFO:tasks.workunit.client.0.smithi152.stdout:0/416: dread d8/d44/f46 [0,4194304] 0 2023-12-06T15:00:27.987 INFO:tasks.workunit.client.0.smithi152.stdout:5/338: creat d7/dd/d26/d3b/d46/f76 x:0 0 0 2023-12-06T15:00:27.988 INFO:tasks.workunit.client.0.smithi152.stdout:0/417: creat d8/d15/d45/f84 x:0 0 0 2023-12-06T15:00:27.989 INFO:tasks.workunit.client.0.smithi152.stdout:0/418: read d8/d3e/f69 [2588489,43006] 0 2023-12-06T15:00:28.000 INFO:tasks.workunit.client.0.smithi152.stdout:5/339: rmdir d7/dd/d26/d3b 39 2023-12-06T15:00:28.012 INFO:tasks.workunit.client.0.smithi152.stdout:5/340: dread d7/dd/f35 [0,4194304] 0 2023-12-06T15:00:28.016 INFO:tasks.workunit.client.0.smithi152.stdout:7/260: dwrite f9 [0,4194304] 0 2023-12-06T15:00:28.016 INFO:tasks.workunit.client.0.smithi152.stdout:0/419: dwrite d8/d15/f2e [0,4194304] 0 2023-12-06T15:00:28.016 INFO:tasks.workunit.client.0.smithi152.stdout:7/261: chown dd/df/d34 0 1 2023-12-06T15:00:28.018 INFO:tasks.workunit.client.0.smithi152.stdout:7/262: write dd/f2f [2930381,44050] 0 2023-12-06T15:00:28.019 INFO:tasks.workunit.client.0.smithi152.stdout:0/420: mknod d8/c85 0 2023-12-06T15:00:28.020 INFO:tasks.workunit.client.0.smithi152.stdout:7/263: symlink dd/l4b 0 2023-12-06T15:00:28.021 INFO:tasks.workunit.client.0.smithi152.stdout:7/264: mknod dd/df/d34/d3a/c4c 0 2023-12-06T15:00:28.021 INFO:tasks.workunit.client.0.smithi152.stdout:7/265: fdatasync dd/df/f1a 0 2023-12-06T15:00:28.022 INFO:tasks.workunit.client.0.smithi152.stdout:7/266: creat dd/df/d1b/d20/f4d x:0 0 0 2023-12-06T15:00:28.022 INFO:tasks.workunit.client.0.smithi152.stdout:7/267: readlink dd/df/d1b/d20/d28/d38/l25 0 2023-12-06T15:00:28.022 INFO:tasks.workunit.client.0.smithi152.stdout:7/268: chown dd/df/l3c 1 1 2023-12-06T15:00:28.023 INFO:tasks.workunit.client.0.smithi152.stdout:7/269: rmdir dd/df/d34/d44 39 2023-12-06T15:00:28.023 INFO:tasks.workunit.client.0.smithi152.stdout:7/270: chown f9 3550 1 2023-12-06T15:00:28.023 INFO:tasks.workunit.client.0.smithi152.stdout:7/271: mkdir dd/df/d1b/d4e 0 2023-12-06T15:00:28.025 INFO:tasks.workunit.client.0.smithi152.stdout:7/272: write f3 [540612,115583] 0 2023-12-06T15:00:28.025 INFO:tasks.workunit.client.0.smithi152.stdout:7/273: chown dd/df/d34 892628879 1 2023-12-06T15:00:28.026 INFO:tasks.workunit.client.0.smithi152.stdout:5/341: dwrite d7/dd/d4e/f55 [0,4194304] 0 2023-12-06T15:00:28.027 INFO:tasks.workunit.client.0.smithi152.stdout:7/274: mknod dd/df/d34/d44/c4f 0 2023-12-06T15:00:28.027 INFO:tasks.workunit.client.0.smithi152.stdout:7/275: chown dd/df/d1b/d20/d28/d38/l25 30321 1 2023-12-06T15:00:28.029 INFO:tasks.workunit.client.0.smithi152.stdout:5/342: symlink d7/d43/d6c/l77 0 2023-12-06T15:00:28.030 INFO:tasks.workunit.client.0.smithi152.stdout:7/276: symlink dd/df/d1b/d20/d28/l50 0 2023-12-06T15:00:28.032 INFO:tasks.workunit.client.0.smithi152.stdout:5/343: link d7/f24 d7/d47/f78 0 2023-12-06T15:00:28.032 INFO:tasks.workunit.client.0.smithi152.stdout:5/344: read - d7/dd/d4e/f5c zero size 2023-12-06T15:00:28.033 INFO:tasks.workunit.client.0.smithi152.stdout:7/277: truncate dd/df/f1a 8069070 0 2023-12-06T15:00:28.033 INFO:tasks.workunit.client.0.smithi152.stdout:7/278: dread - dd/df/d1b/d20/d28/d38/d42/f48 zero size 2023-12-06T15:00:28.033 INFO:tasks.workunit.client.0.smithi152.stdout:7/279: readlink dd/df/l31 0 2023-12-06T15:00:28.033 INFO:tasks.workunit.client.0.smithi152.stdout:7/280: fdatasync dd/f2f 0 2023-12-06T15:00:28.033 INFO:tasks.workunit.client.0.smithi152.stdout:5/345: symlink d7/dd/d4e/l79 0 2023-12-06T15:00:28.038 INFO:tasks.workunit.client.1.smithi190.stdout:3/680: sync 2023-12-06T15:00:28.038 INFO:tasks.workunit.client.1.smithi190.stdout:8/531: sync 2023-12-06T15:00:28.039 INFO:tasks.workunit.client.1.smithi190.stdout:8/532: write d1/f41 [1424668,65878] 0 2023-12-06T15:00:28.039 INFO:tasks.workunit.client.1.smithi190.stdout:8/533: dread - d1/d20/d3b/d4c/d8e/d94/d1c/f77 zero size 2023-12-06T15:00:28.040 INFO:tasks.workunit.client.1.smithi190.stdout:8/534: creat d1/d20/f99 x:0 0 0 2023-12-06T15:00:28.041 INFO:tasks.workunit.client.1.smithi190.stdout:8/535: rename d1/d20/d3b/d4c/d8e/d94/d1c/l33 to d1/d20/d3b/d4c/d8e/d94/d1c/l9a 0 2023-12-06T15:00:28.043 INFO:tasks.workunit.client.1.smithi190.stdout:8/536: dread d1/d37/f73 [0,4194304] 0 2023-12-06T15:00:28.044 INFO:tasks.workunit.client.0.smithi152.stdout:7/281: link dd/d17/c1e dd/df/d1b/d20/d28/d38/c51 0 2023-12-06T15:00:28.044 INFO:tasks.workunit.client.0.smithi152.stdout:7/282: fsync fa 0 2023-12-06T15:00:28.044 INFO:tasks.workunit.client.0.smithi152.stdout:7/283: read f7 [630465,83352] 0 2023-12-06T15:00:28.044 INFO:tasks.workunit.client.0.smithi152.stdout:7/284: fdatasync dd/df/d1b/d20/d28/d38/d42/f48 0 2023-12-06T15:00:28.047 INFO:tasks.workunit.client.0.smithi152.stdout:7/285: write dd/df/f1a [6422273,129662] 0 2023-12-06T15:00:28.049 INFO:tasks.workunit.client.1.smithi190.stdout:3/681: dread d4/d70/d19/d3a/d3b/d72/f86 [0,4194304] 0 2023-12-06T15:00:28.049 INFO:tasks.workunit.client.1.smithi190.stdout:8/537: dread d1/d20/f42 [0,4194304] 0 2023-12-06T15:00:28.049 INFO:tasks.workunit.client.1.smithi190.stdout:8/538: read - d1/d20/d3b/d4c/d8e/d94/d1c/f77 zero size 2023-12-06T15:00:28.050 INFO:tasks.workunit.client.1.smithi190.stdout:3/682: rename d4/d70/d7f to d4/d1b/d5d/df1 0 2023-12-06T15:00:28.052 INFO:tasks.workunit.client.1.smithi190.stdout:8/539: rename d1/d20/d3b/d4c/d5a/f66 to d1/d20/d3b/d4c/d8e/d94/d1c/f9b 0 2023-12-06T15:00:28.053 INFO:tasks.workunit.client.1.smithi190.stdout:3/683: symlink d4/d70/d53/dc4/dce/lf2 0 2023-12-06T15:00:28.054 INFO:tasks.workunit.client.1.smithi190.stdout:3/684: unlink d4/d1b/d54/d9c/f4f 0 2023-12-06T15:00:28.055 INFO:tasks.workunit.client.1.smithi190.stdout:3/685: symlink d4/d70/dcb/lf3 0 2023-12-06T15:00:28.056 INFO:tasks.workunit.client.1.smithi190.stdout:3/686: dread - d4/d1b/d54/d9c/d68/ff0 zero size 2023-12-06T15:00:28.056 INFO:tasks.workunit.client.0.smithi152.stdout:5/346: dwrite d7/f1e [0,4194304] 0 2023-12-06T15:00:28.056 INFO:tasks.workunit.client.0.smithi152.stdout:5/347: chown d7/d43/l5e 1817 1 2023-12-06T15:00:28.056 INFO:tasks.workunit.client.0.smithi152.stdout:5/348: chown d7/d47/c5b 5903479 1 2023-12-06T15:00:28.056 INFO:tasks.workunit.client.0.smithi152.stdout:5/349: write d7/dd/f3c [721859,46046] 0 2023-12-06T15:00:28.057 INFO:tasks.workunit.client.0.smithi152.stdout:5/350: fdatasync d7/f1f 0 2023-12-06T15:00:28.057 INFO:tasks.workunit.client.1.smithi190.stdout:3/687: symlink d4/d1b/d5d/df1/db5/lf4 0 2023-12-06T15:00:28.058 INFO:tasks.workunit.client.1.smithi190.stdout:3/688: truncate d4/d70/d19/f57 1172966 0 2023-12-06T15:00:28.058 INFO:tasks.workunit.client.1.smithi190.stdout:3/689: truncate d4/d1b/d54/d9c/d68/fec 342440 0 2023-12-06T15:00:28.058 INFO:tasks.workunit.client.1.smithi190.stdout:3/690: chown d4/d1b/d54/f9e 6 1 2023-12-06T15:00:28.058 INFO:tasks.workunit.client.1.smithi190.stdout:3/691: stat d4/d70/d33/fa9 0 2023-12-06T15:00:28.058 INFO:tasks.workunit.client.1.smithi190.stdout:3/692: mkdir d4/d70/d19/d3a/d3b/d72/df5 0 2023-12-06T15:00:28.058 INFO:tasks.workunit.client.1.smithi190.stdout:3/693: write d4/d1b/d5d/df1/fe7 [952014,87562] 0 2023-12-06T15:00:28.059 INFO:tasks.workunit.client.0.smithi152.stdout:5/351: mknod d7/dd/d26/d48/c7a 0 2023-12-06T15:00:28.059 INFO:tasks.workunit.client.1.smithi190.stdout:3/694: getdents d4/d70/d53/d56/d94 0 2023-12-06T15:00:28.060 INFO:tasks.workunit.client.1.smithi190.stdout:3/695: dread d4/d1b/d54/d9c/d68/fec [0,4194304] 0 2023-12-06T15:00:28.061 INFO:tasks.workunit.client.1.smithi190.stdout:3/696: mknod d4/d70/d19/d3a/cf6 0 2023-12-06T15:00:28.061 INFO:tasks.workunit.client.1.smithi190.stdout:3/697: chown d4/d1b/d5d 67650214 1 2023-12-06T15:00:28.061 INFO:tasks.workunit.client.1.smithi190.stdout:3/698: chown d4/d70/d19/d3a/f7b 23030 1 2023-12-06T15:00:28.062 INFO:tasks.workunit.client.1.smithi190.stdout:3/699: creat d4/d70/d19/d51/dab/ff7 x:0 0 0 2023-12-06T15:00:28.066 INFO:tasks.workunit.client.1.smithi190.stdout:3/700: mknod d4/d70/dcb/cf8 0 2023-12-06T15:00:28.067 INFO:tasks.workunit.client.1.smithi190.stdout:3/701: creat d4/d70/d19/d3a/d3b/d72/df5/ff9 x:0 0 0 2023-12-06T15:00:28.069 INFO:tasks.workunit.client.0.smithi152.stdout:5/352: creat d7/dd/d26/d3a/f7b x:0 0 0 2023-12-06T15:00:28.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:27 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:00:28.074 INFO:tasks.workunit.client.0.smithi152.stdout:5/353: creat d7/dd/f7c x:0 0 0 2023-12-06T15:00:28.074 INFO:tasks.workunit.client.0.smithi152.stdout:5/354: readlink d7/d43/l5e 0 2023-12-06T15:00:28.074 INFO:tasks.workunit.client.0.smithi152.stdout:5/355: fsync d7/f38 0 2023-12-06T15:00:28.074 INFO:tasks.workunit.client.0.smithi152.stdout:5/356: mknod d7/dd/d26/c7d 0 2023-12-06T15:00:28.075 INFO:tasks.workunit.client.0.smithi152.stdout:5/357: fdatasync d7/dd/d26/d3a/f65 0 2023-12-06T15:00:28.076 INFO:tasks.workunit.client.0.smithi152.stdout:5/358: write d7/f15 [3507568,91055] 0 2023-12-06T15:00:28.076 INFO:tasks.workunit.client.0.smithi152.stdout:5/359: chown d7/l58 113 1 2023-12-06T15:00:28.076 INFO:tasks.workunit.client.0.smithi152.stdout:5/360: chown d7/dd 14695355 1 2023-12-06T15:00:28.077 INFO:tasks.workunit.client.0.smithi152.stdout:5/361: mkdir d7/dd/d26/d3b/d46/d7e 0 2023-12-06T15:00:28.078 INFO:tasks.workunit.client.0.smithi152.stdout:5/362: creat d7/d43/f7f x:0 0 0 2023-12-06T15:00:28.078 INFO:tasks.workunit.client.0.smithi152.stdout:5/363: mknod d7/dd/d26/d3b/d46/d7e/c80 0 2023-12-06T15:00:28.079 INFO:tasks.workunit.client.1.smithi190.stdout:3/702: dwrite d4/d1b/d54/fb1 [4194304,4194304] 0 2023-12-06T15:00:28.082 INFO:tasks.workunit.client.1.smithi190.stdout:3/703: rename d4/d1b/c31 to d4/d70/d53/dc4/cfa 0 2023-12-06T15:00:28.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:27 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:00:28.193 INFO:tasks.workunit.client.1.smithi190.stdout:1/827: sync 2023-12-06T15:00:28.194 INFO:tasks.workunit.client.1.smithi190.stdout:6/675: sync 2023-12-06T15:00:28.194 INFO:tasks.workunit.client.1.smithi190.stdout:0/538: sync 2023-12-06T15:00:28.194 INFO:tasks.workunit.client.1.smithi190.stdout:0/539: write d0/da/f25 [810333,25929] 0 2023-12-06T15:00:28.197 INFO:tasks.workunit.client.1.smithi190.stdout:6/676: unlink d4/fe 0 2023-12-06T15:00:28.199 INFO:tasks.workunit.client.1.smithi190.stdout:6/677: symlink d4/d12/d1a/d70/le2 0 2023-12-06T15:00:28.199 INFO:tasks.workunit.client.1.smithi190.stdout:6/678: write d4/d12/d1a/d44/f79 [1014665,49108] 0 2023-12-06T15:00:28.201 INFO:tasks.workunit.client.1.smithi190.stdout:6/679: creat d4/d12/d40/d43/d45/d4a/dc5/fe3 x:0 0 0 2023-12-06T15:00:28.203 INFO:tasks.workunit.client.1.smithi190.stdout:0/540: dread d0/f11 [0,4194304] 0 2023-12-06T15:00:28.204 INFO:tasks.workunit.client.1.smithi190.stdout:6/680: rename d4/d12/d40/d43/l74 to d4/d12/d1a/d32/le4 0 2023-12-06T15:00:28.204 INFO:tasks.workunit.client.1.smithi190.stdout:0/541: truncate d0/da/d5a/fac 2998768 0 2023-12-06T15:00:28.205 INFO:tasks.workunit.client.1.smithi190.stdout:6/681: symlink d4/d12/d1a/d8a/da3/le5 0 2023-12-06T15:00:28.205 INFO:tasks.workunit.client.1.smithi190.stdout:6/682: chown d4 22449803 1 2023-12-06T15:00:28.206 INFO:tasks.workunit.client.1.smithi190.stdout:6/683: getdents d4/d12/d1a/d32/dab/dd3 0 2023-12-06T15:00:28.207 INFO:tasks.workunit.client.1.smithi190.stdout:1/828: dwrite d6/dc/d29/d38/d73/d5c/fa3 [0,4194304] 0 2023-12-06T15:00:28.207 INFO:tasks.workunit.client.1.smithi190.stdout:0/542: write d0/da/d3e/d3a/d40/f48 [2617982,128872] 0 2023-12-06T15:00:28.207 INFO:tasks.workunit.client.1.smithi190.stdout:0/543: fsync d0/da/d3e/d2b/f33 0 2023-12-06T15:00:28.208 INFO:tasks.workunit.client.1.smithi190.stdout:6/684: symlink d4/d12/d1a/d32/le6 0 2023-12-06T15:00:28.208 INFO:tasks.workunit.client.1.smithi190.stdout:6/685: chown d4/d12/d40/d43/d45/f5f 1666756 1 2023-12-06T15:00:28.209 INFO:tasks.workunit.client.1.smithi190.stdout:6/686: write d4/d12/d1a/d32/fd1 [2807664,101742] 0 2023-12-06T15:00:28.209 INFO:tasks.workunit.client.1.smithi190.stdout:6/687: dread - d4/d12/d40/d43/d45/d4a/d77/dca/f4e zero size 2023-12-06T15:00:28.212 INFO:tasks.workunit.client.1.smithi190.stdout:1/829: mkdir d6/dc/d29/d38/d73/d5c/d10a 0 2023-12-06T15:00:28.214 INFO:tasks.workunit.client.1.smithi190.stdout:0/544: link d0/da/d3e/d3a/d40/l55 d0/da/d3e/d2b/d3c/lad 0 2023-12-06T15:00:28.215 INFO:tasks.workunit.client.1.smithi190.stdout:0/545: read d0/da/d3e/d2b/d3c/f5f [135082,89277] 0 2023-12-06T15:00:28.215 INFO:tasks.workunit.client.1.smithi190.stdout:0/546: write d0/da/d3e/d2b/d3c/d65/f7c [493323,21030] 0 2023-12-06T15:00:28.218 INFO:tasks.workunit.client.1.smithi190.stdout:1/830: rename d6/dc/d29/d38/d73/d76/d7e/fbf to d6/dc/d29/d38/d43/f10b 0 2023-12-06T15:00:28.218 INFO:tasks.workunit.client.1.smithi190.stdout:0/547: mkdir d0/da/d3e/d3a/d40/d6f/d9e/dae 0 2023-12-06T15:00:28.221 INFO:tasks.workunit.client.1.smithi190.stdout:0/548: symlink d0/da/d3e/d2b/laf 0 2023-12-06T15:00:28.223 INFO:tasks.workunit.client.1.smithi190.stdout:0/549: symlink d0/da/d3e/d3a/d40/d6f/lb0 0 2023-12-06T15:00:28.224 INFO:tasks.workunit.client.1.smithi190.stdout:0/550: read d0/da/d3e/d2b/d3c/d4c/f59 [1319059,118669] 0 2023-12-06T15:00:28.227 INFO:tasks.workunit.client.1.smithi190.stdout:0/551: rename d0/da/d3e/d3a/d40/d81/d8d to d0/da/da4/db1 0 2023-12-06T15:00:28.228 INFO:tasks.workunit.client.1.smithi190.stdout:0/552: symlink d0/da/d3e/d2b/d37/lb2 0 2023-12-06T15:00:28.229 INFO:tasks.workunit.client.1.smithi190.stdout:1/831: dread d6/f5a [0,4194304] 0 2023-12-06T15:00:28.232 INFO:tasks.workunit.client.1.smithi190.stdout:1/832: rmdir d6/dc/d29/d38/d73 39 2023-12-06T15:00:28.233 INFO:tasks.workunit.client.1.smithi190.stdout:1/833: mkdir d6/dc/d29/d38/d73/d76/d10c 0 2023-12-06T15:00:28.235 INFO:tasks.workunit.client.1.smithi190.stdout:1/834: rmdir d6/dc/d29/d38/d73/d76 39 2023-12-06T15:00:28.238 INFO:tasks.workunit.client.1.smithi190.stdout:1/835: rename d6/dc/d29/d38/d73/d76/d7e/fc4 to d6/dc/d29/d38/d73/d76/f10d 0 2023-12-06T15:00:28.240 INFO:tasks.workunit.client.1.smithi190.stdout:1/836: creat d6/dc/d3b/d78/d94/f10e x:0 0 0 2023-12-06T15:00:28.247 INFO:tasks.workunit.client.1.smithi190.stdout:0/553: dwrite d0/da/d3e/d2b/d3c/d46/f73 [0,4194304] 0 2023-12-06T15:00:28.249 INFO:tasks.workunit.client.1.smithi190.stdout:0/554: write d0/da/d3e/d2b/d3c/d46/f73 [3592824,24662] 0 2023-12-06T15:00:28.250 INFO:tasks.workunit.client.1.smithi190.stdout:0/555: truncate d0/da/d3e/d3a/d40/d81/f92 1526409 0 2023-12-06T15:00:28.259 INFO:tasks.workunit.client.1.smithi190.stdout:1/837: dwrite d6/dc/d29/d38/fc6 [0,4194304] 0 2023-12-06T15:00:28.264 INFO:tasks.workunit.client.1.smithi190.stdout:9/648: sync 2023-12-06T15:00:28.264 INFO:tasks.workunit.client.1.smithi190.stdout:9/649: write d4/d27/d2f/d5c/fa4 [1037328,56309] 0 2023-12-06T15:00:28.265 INFO:tasks.workunit.client.1.smithi190.stdout:0/556: dread d0/da/d3e/d2b/d37/f39 [0,4194304] 0 2023-12-06T15:00:28.265 INFO:tasks.workunit.client.1.smithi190.stdout:0/557: stat d0/da/d3e/d2b/d3c/d65/f72 0 2023-12-06T15:00:28.267 INFO:tasks.workunit.client.1.smithi190.stdout:0/558: truncate d0/da/d3e/d2b/d3c/d4c/f59 1049093 0 2023-12-06T15:00:28.268 INFO:tasks.workunit.client.1.smithi190.stdout:9/650: creat d4/d27/d2f/d5c/fdc x:0 0 0 2023-12-06T15:00:28.268 INFO:tasks.workunit.client.1.smithi190.stdout:9/651: fsync d4/d84/fb6 0 2023-12-06T15:00:28.271 INFO:tasks.workunit.client.1.smithi190.stdout:0/559: rmdir d0/da/d3e/d3a/d40/d81/daa 0 2023-12-06T15:00:28.273 INFO:tasks.workunit.client.0.smithi152.stdout:6/563: sync 2023-12-06T15:00:28.273 INFO:tasks.workunit.client.0.smithi152.stdout:1/552: sync 2023-12-06T15:00:28.273 INFO:tasks.workunit.client.0.smithi152.stdout:6/564: chown d1/d1c/d79/d1a/d30/da4/la5 3 1 2023-12-06T15:00:28.273 INFO:tasks.workunit.client.1.smithi190.stdout:5/468: sync 2023-12-06T15:00:28.274 INFO:tasks.workunit.client.1.smithi190.stdout:2/518: sync 2023-12-06T15:00:28.274 INFO:tasks.workunit.client.1.smithi190.stdout:2/519: stat d10/d59 0 2023-12-06T15:00:28.274 INFO:tasks.workunit.client.1.smithi190.stdout:2/520: fsync d10/d26/d5c/f33 0 2023-12-06T15:00:28.274 INFO:tasks.workunit.client.1.smithi190.stdout:2/521: truncate d10/d26/f88 206626 0 2023-12-06T15:00:28.274 INFO:tasks.workunit.client.1.smithi190.stdout:0/560: creat d0/da/d3e/d2b/d3c/d46/d8e/d90/fb3 x:0 0 0 2023-12-06T15:00:28.274 INFO:tasks.workunit.client.1.smithi190.stdout:0/561: write d0/da/d3e/d2b/f69 [633560,119085] 0 2023-12-06T15:00:28.286 INFO:tasks.workunit.client.1.smithi190.stdout:1/838: dwrite d6/d49/fe0 [0,4194304] 0 2023-12-06T15:00:28.289 INFO:tasks.workunit.client.0.smithi152.stdout:4/567: sync 2023-12-06T15:00:28.289 INFO:tasks.workunit.client.0.smithi152.stdout:3/364: sync 2023-12-06T15:00:28.289 INFO:tasks.workunit.client.0.smithi152.stdout:8/267: sync 2023-12-06T15:00:28.289 INFO:tasks.workunit.client.0.smithi152.stdout:9/352: sync 2023-12-06T15:00:28.290 INFO:tasks.workunit.client.1.smithi190.stdout:2/522: write d10/d59/d5e/f78 [3092215,16768] 0 2023-12-06T15:00:28.292 INFO:tasks.workunit.client.0.smithi152.stdout:8/268: fsync d1/f3c 0 2023-12-06T15:00:28.292 INFO:tasks.workunit.client.0.smithi152.stdout:2/285: sync 2023-12-06T15:00:28.292 INFO:tasks.workunit.client.0.smithi152.stdout:2/286: read - d6/db/d17/f4f zero size 2023-12-06T15:00:28.292 INFO:tasks.workunit.client.0.smithi152.stdout:6/565: dread d1/d1c/d79/d1a/d30/f84 [0,4194304] 0 2023-12-06T15:00:28.294 INFO:tasks.workunit.client.0.smithi152.stdout:6/566: read d1/d1c/d79/d1a/d30/fe [203554,3432] 0 2023-12-06T15:00:28.295 INFO:tasks.workunit.client.0.smithi152.stdout:6/567: write d1/d1c/d79/fc7 [888602,91324] 0 2023-12-06T15:00:28.295 INFO:tasks.workunit.client.0.smithi152.stdout:6/568: stat d1/d69/l7c 0 2023-12-06T15:00:28.295 INFO:tasks.workunit.client.1.smithi190.stdout:1/839: creat d6/dc/d29/d38/d39/d63/de8/f10f x:0 0 0 2023-12-06T15:00:28.295 INFO:tasks.workunit.client.1.smithi190.stdout:2/523: dread d10/d59/d5e/f6a [0,4194304] 0 2023-12-06T15:00:28.297 INFO:tasks.workunit.client.1.smithi190.stdout:9/652: dwrite d4/d84/f8b [0,4194304] 0 2023-12-06T15:00:28.298 INFO:tasks.workunit.client.1.smithi190.stdout:5/469: dread d0/d1c/d2b/d2c/f64 [0,4194304] 0 2023-12-06T15:00:28.298 INFO:tasks.workunit.client.1.smithi190.stdout:2/524: rename d10/d59/d5e/f78 to d10/d59/d5e/d71/dad/fb5 0 2023-12-06T15:00:28.298 INFO:tasks.workunit.client.1.smithi190.stdout:2/525: chown d10/c21 485 1 2023-12-06T15:00:28.301 INFO:tasks.workunit.client.1.smithi190.stdout:2/526: truncate d10/d26/d5c/d35/d77/d98/fa8 2718519 0 2023-12-06T15:00:28.301 INFO:tasks.workunit.client.1.smithi190.stdout:2/527: chown d10/d26/d5c/d35/f68 1560272 1 2023-12-06T15:00:28.301 INFO:tasks.workunit.client.1.smithi190.stdout:9/653: rename d4/d27/d2f/d5c/f9b to d4/d27/d2f/d31/d3f/d58/d72/fdd 0 2023-12-06T15:00:28.303 INFO:tasks.workunit.client.1.smithi190.stdout:9/654: creat d4/d84/dda/fde x:0 0 0 2023-12-06T15:00:28.303 INFO:tasks.workunit.client.1.smithi190.stdout:9/655: chown d4/d27/d2f/d31/d3f/d58/d72/c78 4 1 2023-12-06T15:00:28.303 INFO:tasks.workunit.client.1.smithi190.stdout:9/656: fdatasync d4/d27/d2f/d31/d3f/d58/d72/d7a/f7f 0 2023-12-06T15:00:28.303 INFO:tasks.workunit.client.1.smithi190.stdout:5/470: rename d0/d1c/d2b/d2c/l3c to d0/d1c/d85/l9f 0 2023-12-06T15:00:28.313 INFO:tasks.workunit.client.1.smithi190.stdout:2/528: write d10/f4f [1847419,7806] 0 2023-12-06T15:00:28.315 INFO:tasks.workunit.client.0.smithi152.stdout:8/269: creat d1/d6/d34/d35/d38/f4e x:0 0 0 2023-12-06T15:00:28.316 INFO:tasks.workunit.client.1.smithi190.stdout:2/529: creat d10/d59/d5e/fb6 x:0 0 0 2023-12-06T15:00:28.316 INFO:tasks.workunit.client.1.smithi190.stdout:2/530: unlink d10/d59/d5e/c1e 0 2023-12-06T15:00:28.316 INFO:tasks.workunit.client.1.smithi190.stdout:2/531: truncate d10/d26/d5c/d37/f9a 221963 0 2023-12-06T15:00:28.317 INFO:tasks.workunit.client.1.smithi190.stdout:2/532: chown d10/d59/d5e/c18 738878010 1 2023-12-06T15:00:28.317 INFO:tasks.workunit.client.1.smithi190.stdout:2/533: truncate d10/d26/d5b/f80 685590 0 2023-12-06T15:00:28.318 INFO:tasks.workunit.client.0.smithi152.stdout:6/569: unlink d1/d1c/d79/d1a/d30/d36/d26/l40 0 2023-12-06T15:00:28.318 INFO:tasks.workunit.client.0.smithi152.stdout:6/570: readlink d1/d1c/d79/l8d 0 2023-12-06T15:00:28.322 INFO:tasks.workunit.client.1.smithi190.stdout:2/534: unlink d10/d26/d5c/d35/d77/c8c 0 2023-12-06T15:00:28.322 INFO:tasks.workunit.client.1.smithi190.stdout:2/535: chown d10/d26/d5c/d35/d77/d98/fa8 3171 1 2023-12-06T15:00:28.322 INFO:tasks.workunit.client.1.smithi190.stdout:2/536: dread - d10/d59/d5e/d71/fab zero size 2023-12-06T15:00:28.323 INFO:tasks.workunit.client.1.smithi190.stdout:2/537: mknod d10/d59/d5e/cb7 0 2023-12-06T15:00:28.323 INFO:tasks.workunit.client.1.smithi190.stdout:2/538: chown d10/d26/d5c/d49/d54/f8b 849 1 2023-12-06T15:00:28.323 INFO:tasks.workunit.client.1.smithi190.stdout:2/539: stat d10/d26/d5c/d37/d83 0 2023-12-06T15:00:28.325 INFO:tasks.workunit.client.1.smithi190.stdout:2/540: unlink f3 0 2023-12-06T15:00:28.326 INFO:tasks.workunit.client.1.smithi190.stdout:2/541: creat d10/d26/d5c/d49/d7e/fb8 x:0 0 0 2023-12-06T15:00:28.329 INFO:tasks.workunit.client.1.smithi190.stdout:2/542: rename d10/d59/d5e/f2b to d10/d59/d5e/d71/dad/fb9 0 2023-12-06T15:00:28.329 INFO:tasks.workunit.client.1.smithi190.stdout:2/543: stat d10/d59/d5e/f1b 0 2023-12-06T15:00:28.337 INFO:tasks.workunit.client.1.smithi190.stdout:2/544: write fa [2697043,67346] 0 2023-12-06T15:00:28.338 INFO:tasks.workunit.client.1.smithi190.stdout:2/545: symlink d10/d59/lba 0 2023-12-06T15:00:28.340 INFO:tasks.workunit.client.1.smithi190.stdout:2/546: symlink d10/d26/d5c/d49/d7e/lbb 0 2023-12-06T15:00:28.341 INFO:tasks.workunit.client.0.smithi152.stdout:3/365: dwrite d9/d18/d51/f5c [0,4194304] 0 2023-12-06T15:00:28.341 INFO:tasks.workunit.client.0.smithi152.stdout:9/353: dwrite d0/f30 [0,4194304] 0 2023-12-06T15:00:28.342 INFO:tasks.workunit.client.1.smithi190.stdout:2/547: symlink d10/d26/d5c/d35/d77/d98/lbc 0 2023-12-06T15:00:28.342 INFO:tasks.workunit.client.1.smithi190.stdout:3/704: sync 2023-12-06T15:00:28.343 INFO:tasks.workunit.client.1.smithi190.stdout:1/840: dwrite d6/f2f [0,4194304] 0 2023-12-06T15:00:28.343 INFO:tasks.workunit.client.1.smithi190.stdout:1/841: write d6/dc/fbb [245828,72882] 0 2023-12-06T15:00:28.343 INFO:tasks.workunit.client.0.smithi152.stdout:6/571: dwrite d1/d75/f7d [0,4194304] 0 2023-12-06T15:00:28.344 INFO:tasks.workunit.client.0.smithi152.stdout:6/572: chown d1/d1c/d79/d4b/cb6 153591 1 2023-12-06T15:00:28.344 INFO:tasks.workunit.client.1.smithi190.stdout:3/705: link d4/d70/d53/d56/d94/f91 d4/d1b/d54/d9c/d68/d8a/ffb 0 2023-12-06T15:00:28.346 INFO:tasks.workunit.client.1.smithi190.stdout:1/842: read d6/f13 [1300406,82614] 0 2023-12-06T15:00:28.346 INFO:tasks.workunit.client.1.smithi190.stdout:9/657: dwrite d4/d84/f99 [0,4194304] 0 2023-12-06T15:00:28.348 INFO:tasks.workunit.client.1.smithi190.stdout:8/540: sync 2023-12-06T15:00:28.348 INFO:tasks.workunit.client.1.smithi190.stdout:8/541: chown d1/d20/d3b/d4c/d8e/d94/d1c/l21 2 1 2023-12-06T15:00:28.349 INFO:tasks.workunit.client.1.smithi190.stdout:7/653: sync 2023-12-06T15:00:28.349 INFO:tasks.workunit.client.1.smithi190.stdout:7/654: dread - d0/df/d53/d2f/f8f zero size 2023-12-06T15:00:28.350 INFO:tasks.workunit.client.1.smithi190.stdout:7/655: dread - d0/d88/d41/fb3 zero size 2023-12-06T15:00:28.351 INFO:tasks.workunit.client.0.smithi152.stdout:9/354: creat d0/d50/f61 x:0 0 0 2023-12-06T15:00:28.351 INFO:tasks.workunit.client.1.smithi190.stdout:4/509: sync 2023-12-06T15:00:28.353 INFO:tasks.workunit.client.1.smithi190.stdout:1/843: mknod d6/dc/d29/d38/d73/d5c/db5/c110 0 2023-12-06T15:00:28.356 INFO:tasks.workunit.client.1.smithi190.stdout:4/510: getdents d3/d76/d7c/d96/d39/d54 0 2023-12-06T15:00:28.356 INFO:tasks.workunit.client.1.smithi190.stdout:8/542: creat d1/d20/d3b/d4d/f9c x:0 0 0 2023-12-06T15:00:28.356 INFO:tasks.workunit.client.1.smithi190.stdout:8/543: chown d1/d20/l61 22118 1 2023-12-06T15:00:28.356 INFO:tasks.workunit.client.1.smithi190.stdout:8/544: chown d1/f1a 865802 1 2023-12-06T15:00:28.356 INFO:tasks.workunit.client.1.smithi190.stdout:9/658: mknod d4/d27/d2f/d31/d3f/cdf 0 2023-12-06T15:00:28.357 INFO:tasks.workunit.client.0.smithi152.stdout:6/573: creat d1/d69/da1/d87/fd6 x:0 0 0 2023-12-06T15:00:28.357 INFO:tasks.workunit.client.1.smithi190.stdout:1/844: symlink d6/dc/d6f/l111 0 2023-12-06T15:00:28.358 INFO:tasks.workunit.client.1.smithi190.stdout:1/845: chown d6/dc/d29/d38/d73/d5c/ff1 7466627 1 2023-12-06T15:00:28.358 INFO:tasks.workunit.client.1.smithi190.stdout:9/659: symlink d4/d27/d8a/dbc/le0 0 2023-12-06T15:00:28.360 INFO:tasks.workunit.client.1.smithi190.stdout:1/846: link d6/dc/d29/d38/d43/d7f/cf5 d6/dc/d6f/da4/c112 0 2023-12-06T15:00:28.360 INFO:tasks.workunit.client.1.smithi190.stdout:1/847: write d6/dc/d29/d38/d39/d63/d67/fcc [395150,51810] 0 2023-12-06T15:00:28.360 INFO:tasks.workunit.client.1.smithi190.stdout:1/848: fdatasync d6/dc/d29/d38/d73/fde 0 2023-12-06T15:00:28.363 INFO:tasks.workunit.client.1.smithi190.stdout:9/660: write d4/d84/f8b [400829,60336] 0 2023-12-06T15:00:28.365 INFO:tasks.workunit.client.1.smithi190.stdout:1/849: unlink d6/dc/d29/d38/d73/d76/fb3 0 2023-12-06T15:00:28.365 INFO:tasks.workunit.client.1.smithi190.stdout:1/850: write d6/dc/d29/d38/d73/d5c/fcb [447447,76347] 0 2023-12-06T15:00:28.366 INFO:tasks.workunit.client.1.smithi190.stdout:1/851: write d6/dc/fa0 [87209,73453] 0 2023-12-06T15:00:28.366 INFO:tasks.workunit.client.1.smithi190.stdout:1/852: chown d6/dc/d29/d38/d73/d5c/fa3 3 1 2023-12-06T15:00:28.368 INFO:tasks.workunit.client.0.smithi152.stdout:9/355: dread d0/dd/f3e [0,4194304] 0 2023-12-06T15:00:28.370 INFO:tasks.workunit.client.0.smithi152.stdout:6/574: read d1/d1c/d79/d1a/d30/f59 [2163505,25155] 0 2023-12-06T15:00:28.371 INFO:tasks.workunit.client.1.smithi190.stdout:2/548: dwrite d10/d26/f88 [0,4194304] 0 2023-12-06T15:00:28.373 INFO:tasks.workunit.client.0.smithi152.stdout:6/575: creat d1/d1c/d79/d1a/d30/d36/d35/d49/d6b/fd7 x:0 0 0 2023-12-06T15:00:28.374 INFO:tasks.workunit.client.0.smithi152.stdout:6/576: rmdir d1/d69/da1/d87/d15 39 2023-12-06T15:00:28.375 INFO:tasks.workunit.client.1.smithi190.stdout:1/853: creat d6/dc/d29/d38/d73/d5c/db5/f113 x:0 0 0 2023-12-06T15:00:28.375 INFO:tasks.workunit.client.1.smithi190.stdout:1/854: write d6/dc/d29/d38/d73/d5c/fcb [639339,112781] 0 2023-12-06T15:00:28.375 INFO:tasks.workunit.client.1.smithi190.stdout:8/545: dread d1/d20/d3b/d31/f57 [0,4194304] 0 2023-12-06T15:00:28.380 INFO:tasks.workunit.client.0.smithi152.stdout:1/553: rename d3/da/d4c/d82/d52/d62/f6b to d3/da/d15/fd3 0 2023-12-06T15:00:28.380 INFO:tasks.workunit.client.0.smithi152.stdout:1/554: chown d3/d73/fc4 1 1 2023-12-06T15:00:28.380 INFO:tasks.workunit.client.0.smithi152.stdout:1/555: write d3/da/d4c/fa5 [660684,37026] 0 2023-12-06T15:00:28.381 INFO:tasks.workunit.client.0.smithi152.stdout:9/356: dread d0/f19 [0,4194304] 0 2023-12-06T15:00:28.381 INFO:tasks.workunit.client.0.smithi152.stdout:9/357: fdatasync d0/dd/d20/d38/d45/f37 0 2023-12-06T15:00:28.381 INFO:tasks.workunit.client.0.smithi152.stdout:9/358: fdatasync d0/dd/d20/d4a/d4d/f5e 0 2023-12-06T15:00:28.382 INFO:tasks.workunit.client.1.smithi190.stdout:2/549: rmdir d10/d26/d5c/d37 39 2023-12-06T15:00:28.383 INFO:tasks.workunit.client.0.smithi152.stdout:2/287: rename d6/db/d13 to d6/d1e/d41/d55 0 2023-12-06T15:00:28.383 INFO:tasks.workunit.client.0.smithi152.stdout:9/359: mknod d0/dd/d20/c62 0 2023-12-06T15:00:28.383 INFO:tasks.workunit.client.0.smithi152.stdout:9/360: fsync d0/f1 0 2023-12-06T15:00:28.383 INFO:tasks.workunit.client.0.smithi152.stdout:9/361: dread - d0/dd/d20/d38/d45/d43/f52 zero size 2023-12-06T15:00:28.383 INFO:tasks.workunit.client.1.smithi190.stdout:3/706: dwrite d4/d1b/d5d/faf [0,4194304] 0 2023-12-06T15:00:28.386 INFO:tasks.workunit.client.0.smithi152.stdout:6/577: rename d1/d1c/d79/d1a/d30/d36/d35/d49/c9a to d1/d1c/d79/d1a/d30/da4/cd8 0 2023-12-06T15:00:28.390 INFO:tasks.workunit.client.0.smithi152.stdout:6/578: symlink d1/d1c/d79/d1a/d30/d36/d35/d61/ld9 0 2023-12-06T15:00:28.390 INFO:tasks.workunit.client.1.smithi190.stdout:1/855: creat d6/dc/d29/d38/d73/d76/d7e/f114 x:0 0 0 2023-12-06T15:00:28.392 INFO:tasks.workunit.client.0.smithi152.stdout:6/579: creat d1/d1c/d79/d1a/d30/d18/dc5/fda x:0 0 0 2023-12-06T15:00:28.392 INFO:tasks.workunit.client.0.smithi152.stdout:6/580: stat d1/d1c/d79/l3f 0 2023-12-06T15:00:28.392 INFO:tasks.workunit.client.1.smithi190.stdout:8/546: read d1/d20/d3b/d4c/d8e/d94/f5e [2837820,66107] 0 2023-12-06T15:00:28.392 INFO:tasks.workunit.client.1.smithi190.stdout:8/547: dread - d1/d20/d3b/d34/f38 zero size 2023-12-06T15:00:28.392 INFO:tasks.workunit.client.1.smithi190.stdout:8/548: chown d1/d20/d3b/d4c/d8e/d94/d25/c28 9363918 1 2023-12-06T15:00:28.395 INFO:tasks.workunit.client.0.smithi152.stdout:6/581: getdents d1/d1c/d79/d8a 0 2023-12-06T15:00:28.395 INFO:tasks.workunit.client.0.smithi152.stdout:6/582: chown d1/d1c/d79/d1a/l51 7 1 2023-12-06T15:00:28.395 INFO:tasks.workunit.client.1.smithi190.stdout:3/707: rename d4/d70/d53 to d4/d1b/d54/d9c/d68/dfc 0 2023-12-06T15:00:28.396 INFO:tasks.workunit.client.1.smithi190.stdout:3/708: fsync d4/d1b/d54/d9c/fe9 0 2023-12-06T15:00:28.396 INFO:tasks.workunit.client.1.smithi190.stdout:4/511: dwrite d3/d4e/f93 [0,4194304] 0 2023-12-06T15:00:28.396 INFO:tasks.workunit.client.1.smithi190.stdout:3/709: dread d4/d1b/d54/d9c/d68/fec [0,4194304] 0 2023-12-06T15:00:28.397 INFO:tasks.workunit.client.0.smithi152.stdout:2/288: dread d6/db/f39 [0,4194304] 0 2023-12-06T15:00:28.397 INFO:tasks.workunit.client.0.smithi152.stdout:6/583: creat d1/d1c/d79/d1a/d30/d36/d4e/d55/dbf/fdb x:0 0 0 2023-12-06T15:00:28.397 INFO:tasks.workunit.client.0.smithi152.stdout:6/584: dread - d1/d1c/d79/d1a/d30/d36/d35/d49/da6/da9/fac zero size 2023-12-06T15:00:28.397 INFO:tasks.workunit.client.0.smithi152.stdout:6/585: getdents d1/d1c/d79/d8a 0 2023-12-06T15:00:28.400 INFO:tasks.workunit.client.0.smithi152.stdout:2/289: mknod d6/d18/c56 0 2023-12-06T15:00:28.400 INFO:tasks.workunit.client.0.smithi152.stdout:2/290: stat d6/c2d 0 2023-12-06T15:00:28.400 INFO:tasks.workunit.client.1.smithi190.stdout:4/512: mknod d3/d35/d19/d41/d44/d5b/ca1 0 2023-12-06T15:00:28.400 INFO:tasks.workunit.client.1.smithi190.stdout:3/710: mknod d4/d1b/d54/d9c/d68/d8a/cfd 0 2023-12-06T15:00:28.400 INFO:tasks.workunit.client.1.smithi190.stdout:4/513: fsync d3/fa 0 2023-12-06T15:00:28.400 INFO:tasks.workunit.client.1.smithi190.stdout:3/711: stat d4/d1b/d77/da8/db7/dd2/fd5 0 2023-12-06T15:00:28.401 INFO:tasks.workunit.client.0.smithi152.stdout:2/291: mknod d6/d1e/d41/c57 0 2023-12-06T15:00:28.402 INFO:tasks.workunit.client.1.smithi190.stdout:4/514: link d3/d76/d7c/d96/c91 d3/d76/d7c/d96/d7a/ca2 0 2023-12-06T15:00:28.402 INFO:tasks.workunit.client.1.smithi190.stdout:8/549: dread d1/d37/f45 [0,4194304] 0 2023-12-06T15:00:28.402 INFO:tasks.workunit.client.1.smithi190.stdout:7/656: dwrite d0/d5/f78 [0,4194304] 0 2023-12-06T15:00:28.404 INFO:tasks.workunit.client.0.smithi152.stdout:3/366: link d9/d10/d12/d43/c4b d9/c6a 0 2023-12-06T15:00:28.406 INFO:tasks.workunit.client.0.smithi152.stdout:3/367: rename d9/d10/f2f to d9/d18/f6b 0 2023-12-06T15:00:28.406 INFO:tasks.workunit.client.0.smithi152.stdout:3/368: chown d9/d10/d12/d43 19994094 1 2023-12-06T15:00:28.406 INFO:tasks.workunit.client.0.smithi152.stdout:3/369: fdatasync d9/d10/d12/d43/d52/d58/f42 0 2023-12-06T15:00:28.406 INFO:tasks.workunit.client.0.smithi152.stdout:3/370: write d9/d10/d19/f49 [17966,74539] 0 2023-12-06T15:00:28.407 INFO:tasks.workunit.client.0.smithi152.stdout:3/371: creat d9/d18/d51/f6c x:0 0 0 2023-12-06T15:00:28.408 INFO:tasks.workunit.client.1.smithi190.stdout:8/550: rename d1/f1a to d1/d20/d3b/d4c/d59/f9d 0 2023-12-06T15:00:28.408 INFO:tasks.workunit.client.1.smithi190.stdout:8/551: chown d1/d20/d3b/d34/l3a 46546 1 2023-12-06T15:00:28.408 INFO:tasks.workunit.client.0.smithi152.stdout:3/372: creat d9/d10/d12/d43/f6d x:0 0 0 2023-12-06T15:00:28.410 INFO:tasks.workunit.client.1.smithi190.stdout:7/657: chown d0/d35/l9b 16 1 2023-12-06T15:00:28.411 INFO:tasks.workunit.client.0.smithi152.stdout:3/373: mknod d9/d45/c6e 0 2023-12-06T15:00:28.412 INFO:tasks.workunit.client.1.smithi190.stdout:9/661: dwrite d4/d27/d2f/d66/f6e [0,4194304] 0 2023-12-06T15:00:28.413 INFO:tasks.workunit.client.1.smithi190.stdout:8/552: mkdir d1/d20/d3b/d4c/d9e 0 2023-12-06T15:00:28.413 INFO:tasks.workunit.client.1.smithi190.stdout:8/553: write d1/d37/f45 [3869226,108437] 0 2023-12-06T15:00:28.414 INFO:tasks.workunit.client.0.smithi152.stdout:3/374: rename d9/d18/d51/f5c to d9/f6f 0 2023-12-06T15:00:28.414 INFO:tasks.workunit.client.0.smithi152.stdout:3/375: chown d9/d10/d19 108 1 2023-12-06T15:00:28.415 INFO:tasks.workunit.client.1.smithi190.stdout:2/550: dwrite d10/d26/d5c/d42/d9d/fae [0,4194304] 0 2023-12-06T15:00:28.416 INFO:tasks.workunit.client.1.smithi190.stdout:4/515: dread d3/f40 [0,4194304] 0 2023-12-06T15:00:28.416 INFO:tasks.workunit.client.1.smithi190.stdout:9/662: truncate d4/d27/d2f/d31/d3f/d58/fa3 2561480 0 2023-12-06T15:00:28.417 INFO:tasks.workunit.client.0.smithi152.stdout:1/556: dwrite d3/da/f35 [0,4194304] 0 2023-12-06T15:00:28.419 INFO:tasks.workunit.client.1.smithi190.stdout:8/554: link d1/d20/d3b/d36/d50/f83 d1/d20/d3b/d31/f9f 0 2023-12-06T15:00:28.419 INFO:tasks.workunit.client.1.smithi190.stdout:8/555: chown d1/f51 2376 1 2023-12-06T15:00:28.419 INFO:tasks.workunit.client.1.smithi190.stdout:8/556: write d1/d20/d3b/d36/d50/f88 [282943,127071] 0 2023-12-06T15:00:28.419 INFO:tasks.workunit.client.1.smithi190.stdout:8/557: stat d1/d20/l61 0 2023-12-06T15:00:28.419 INFO:tasks.workunit.client.1.smithi190.stdout:8/558: fsync d1/d20/d3b/d4c/f7f 0 2023-12-06T15:00:28.421 INFO:tasks.workunit.client.0.smithi152.stdout:1/557: creat d3/d73/fd4 x:0 0 0 2023-12-06T15:00:28.422 INFO:tasks.workunit.client.1.smithi190.stdout:8/559: write d1/d20/d3b/d36/d50/f6d [1096487,92436] 0 2023-12-06T15:00:28.422 INFO:tasks.workunit.client.1.smithi190.stdout:8/560: write d1/f6c [568264,122887] 0 2023-12-06T15:00:28.422 INFO:tasks.workunit.client.1.smithi190.stdout:8/561: readlink d1/d37/l62 0 2023-12-06T15:00:28.422 INFO:tasks.workunit.client.1.smithi190.stdout:8/562: dread - d1/d20/d3b/d4d/f9c zero size 2023-12-06T15:00:28.424 INFO:tasks.workunit.client.1.smithi190.stdout:2/551: creat d10/d26/d5b/d7f/d8e/fbd x:0 0 0 2023-12-06T15:00:28.426 INFO:tasks.workunit.client.1.smithi190.stdout:9/663: rename d4/d27/d2f/d31/d3f/d58/d7d/ld6 to d4/d84/le1 0 2023-12-06T15:00:28.426 INFO:tasks.workunit.client.1.smithi190.stdout:9/664: fdatasync d4/d84/dda/fde 0 2023-12-06T15:00:28.426 INFO:tasks.workunit.client.1.smithi190.stdout:9/665: truncate d4/d27/d2f/d66/fd1 760885 0 2023-12-06T15:00:28.427 INFO:tasks.workunit.client.1.smithi190.stdout:8/563: creat d1/d20/d3b/d4c/d5a/fa0 x:0 0 0 2023-12-06T15:00:28.429 INFO:tasks.workunit.client.0.smithi152.stdout:1/558: dread d3/da/db/da0/fbe [0,4194304] 0 2023-12-06T15:00:28.430 INFO:tasks.workunit.client.1.smithi190.stdout:2/552: rename d10/d26/l81 to d10/d26/d5c/d35/d77/lbe 0 2023-12-06T15:00:28.431 INFO:tasks.workunit.client.1.smithi190.stdout:9/666: creat d4/d27/d8a/dbc/fe2 x:0 0 0 2023-12-06T15:00:28.435 INFO:tasks.workunit.client.1.smithi190.stdout:2/553: rename d10/d26/d5c/d37/d83/fa1 to d10/d59/d5e/d71/dad/fbf 0 2023-12-06T15:00:28.435 INFO:tasks.workunit.client.1.smithi190.stdout:9/667: truncate d4/d27/f4d 227133 0 2023-12-06T15:00:28.435 INFO:tasks.workunit.client.1.smithi190.stdout:2/554: fdatasync d10/d26/d5c/d49/d54/f61 0 2023-12-06T15:00:28.435 INFO:tasks.workunit.client.1.smithi190.stdout:9/668: dread - d4/d27/d2f/d5c/d9d/fb7 zero size 2023-12-06T15:00:28.435 INFO:tasks.workunit.client.1.smithi190.stdout:9/669: dread - d4/d27/d8a/fdb zero size 2023-12-06T15:00:28.436 INFO:tasks.workunit.client.1.smithi190.stdout:9/670: write f2 [2475376,93333] 0 2023-12-06T15:00:28.436 INFO:tasks.workunit.client.1.smithi190.stdout:9/671: fdatasync d4/f2e 0 2023-12-06T15:00:28.437 INFO:tasks.workunit.client.1.smithi190.stdout:2/555: creat d10/d59/d5e/d71/dad/fc0 x:0 0 0 2023-12-06T15:00:28.438 INFO:tasks.workunit.client.1.smithi190.stdout:2/556: chown d10/d59/d5e/f47 244494 1 2023-12-06T15:00:28.439 INFO:tasks.workunit.client.1.smithi190.stdout:9/672: rename d4/d27/d2f/d31/d3f/f69 to d4/d27/d2f/d31/da6/dcd/fe3 0 2023-12-06T15:00:28.440 INFO:tasks.workunit.client.1.smithi190.stdout:9/673: truncate d4/f6 1995179 0 2023-12-06T15:00:28.440 INFO:tasks.workunit.client.1.smithi190.stdout:9/674: readlink d4/d27/d2f/laa 0 2023-12-06T15:00:28.441 INFO:tasks.workunit.client.0.smithi152.stdout:6/586: dwrite d1/d69/da1/f5f [4194304,4194304] 0 2023-12-06T15:00:28.444 INFO:tasks.workunit.client.1.smithi190.stdout:9/675: rename d4/d27/d8a/f94 to d4/fe4 0 2023-12-06T15:00:28.444 INFO:tasks.workunit.client.1.smithi190.stdout:9/676: write d4/d27/d8a/dbc/fd2 [171698,114200] 0 2023-12-06T15:00:28.446 INFO:tasks.workunit.client.1.smithi190.stdout:9/677: dread d4/d27/d2f/fd3 [0,4194304] 0 2023-12-06T15:00:28.446 INFO:tasks.workunit.client.1.smithi190.stdout:9/678: rename d4/d27/d2f to d4/d27/d2f/d31/da6/dcd/de5 22 2023-12-06T15:00:28.446 INFO:tasks.workunit.client.1.smithi190.stdout:9/679: readlink d4/d27/d8a/dbc/lce 0 2023-12-06T15:00:28.446 INFO:tasks.workunit.client.1.smithi190.stdout:6/688: sync 2023-12-06T15:00:28.448 INFO:tasks.workunit.client.1.smithi190.stdout:6/689: mknod d4/d12/d1a/d32/ce7 0 2023-12-06T15:00:28.452 INFO:tasks.workunit.client.0.smithi152.stdout:9/362: dwrite d0/d3f/f53 [0,4194304] 0 2023-12-06T15:00:28.456 INFO:tasks.workunit.client.0.smithi152.stdout:9/363: creat d0/dd/d20/d38/d45/f63 x:0 0 0 2023-12-06T15:00:28.456 INFO:tasks.workunit.client.0.smithi152.stdout:9/364: getdents d0/d3f/d5f/d60 0 2023-12-06T15:00:28.457 INFO:tasks.workunit.client.0.smithi152.stdout:9/365: truncate d0/dd/f42 1359740 0 2023-12-06T15:00:28.457 INFO:tasks.workunit.client.0.smithi152.stdout:9/366: truncate d0/dd/f3b 420008 0 2023-12-06T15:00:28.457 INFO:tasks.workunit.client.0.smithi152.stdout:9/367: chown d0/dd/d20/d38/d44/f4e 69 1 2023-12-06T15:00:28.458 INFO:tasks.workunit.client.0.smithi152.stdout:9/368: rename d0/dd/d20/d38/d48/f4f to d0/dd/d20/d38/d45/f64 0 2023-12-06T15:00:28.463 INFO:tasks.workunit.client.0.smithi152.stdout:2/292: dwrite d6/d1e/d41/d55/f4b [0,4194304] 0 2023-12-06T15:00:28.465 INFO:tasks.workunit.client.1.smithi190.stdout:4/516: rmdir d3/d35/d19/d41/d44 39 2023-12-06T15:00:28.465 INFO:tasks.workunit.client.1.smithi190.stdout:4/517: readlink d3/d35/d19/d41/l66 0 2023-12-06T15:00:28.466 INFO:tasks.workunit.client.1.smithi190.stdout:4/518: chown d3/d35/d19/l3d 3850 1 2023-12-06T15:00:28.466 INFO:tasks.workunit.client.1.smithi190.stdout:4/519: readlink d3/d35/d19/d41/d44/l8e 0 2023-12-06T15:00:28.468 INFO:tasks.workunit.client.1.smithi190.stdout:3/712: dwrite d4/d1b/d5d/fe3 [0,4194304] 0 2023-12-06T15:00:28.469 INFO:tasks.workunit.client.1.smithi190.stdout:4/520: link d3/d35/d19/l24 d3/d35/d19/d41/la3 0 2023-12-06T15:00:28.469 INFO:tasks.workunit.client.1.smithi190.stdout:4/521: stat d3/d35/d19/d41/d44/c80 0 2023-12-06T15:00:28.471 INFO:tasks.workunit.client.1.smithi190.stdout:7/658: dwrite d0/d5/da/f49 [0,4194304] 0 2023-12-06T15:00:28.471 INFO:tasks.workunit.client.1.smithi190.stdout:7/659: chown d0/df/d1f/c36 277490 1 2023-12-06T15:00:28.471 INFO:tasks.workunit.client.1.smithi190.stdout:7/660: fsync d0/d88/d7a/f69 0 2023-12-06T15:00:28.471 INFO:tasks.workunit.client.1.smithi190.stdout:2/557: dwrite d10/d26/d5c/d37/f69 [0,4194304] 0 2023-12-06T15:00:28.472 INFO:tasks.workunit.client.1.smithi190.stdout:2/558: chown d10/d26/d5c/f4b 340652 1 2023-12-06T15:00:28.472 INFO:tasks.workunit.client.1.smithi190.stdout:2/559: readlink d10/d26/d5c/d49/d54/l99 0 2023-12-06T15:00:28.472 INFO:tasks.workunit.client.1.smithi190.stdout:2/560: chown d10/d26/d5c/d42/d9d 48812669 1 2023-12-06T15:00:28.472 INFO:tasks.workunit.client.1.smithi190.stdout:3/713: link d4/d1b/d54/d9c/d68/dfc/d56/d83/de2/fee d4/d1b/d54/ffe 0 2023-12-06T15:00:28.473 INFO:tasks.workunit.client.0.smithi152.stdout:1/559: dwrite d3/da/d15/d17/d43/d7d/f98 [0,4194304] 0 2023-12-06T15:00:28.474 INFO:tasks.workunit.client.1.smithi190.stdout:4/522: mkdir d3/da4 0 2023-12-06T15:00:28.479 INFO:tasks.workunit.client.0.smithi152.stdout:3/376: unlink d9/f6f 0 2023-12-06T15:00:28.479 INFO:tasks.workunit.client.0.smithi152.stdout:3/377: chown d9/d10/d12/d43/d52/d58/f42 3178 1 2023-12-06T15:00:28.479 INFO:tasks.workunit.client.0.smithi152.stdout:3/378: chown d9/d18/f3c 3221 1 2023-12-06T15:00:28.479 INFO:tasks.workunit.client.1.smithi190.stdout:7/661: unlink d0/d88/d32/l81 0 2023-12-06T15:00:28.481 INFO:tasks.workunit.client.0.smithi152.stdout:1/560: creat d3/da/d15/d17/fd5 x:0 0 0 2023-12-06T15:00:28.482 INFO:tasks.workunit.client.0.smithi152.stdout:6/587: dwrite d1/d1c/d79/d1a/d30/d36/f24 [0,4194304] 0 2023-12-06T15:00:28.484 INFO:tasks.workunit.client.0.smithi152.stdout:3/379: link d9/lb d9/d10/d12/d44/l70 0 2023-12-06T15:00:28.485 INFO:tasks.workunit.client.1.smithi190.stdout:4/523: mkdir d3/d35/da5 0 2023-12-06T15:00:28.487 INFO:tasks.workunit.client.1.smithi190.stdout:9/680: dwrite d4/d27/d8a/f95 [0,4194304] 0 2023-12-06T15:00:28.487 INFO:tasks.workunit.client.1.smithi190.stdout:9/681: write d4/f22 [349943,53426] 0 2023-12-06T15:00:28.487 INFO:tasks.workunit.client.1.smithi190.stdout:6/690: dwrite d4/d12/d1a/d70/f7f [0,4194304] 0 2023-12-06T15:00:28.487 INFO:tasks.workunit.client.1.smithi190.stdout:7/662: rename d0/df/d53/d99/fcb to d0/df/d53/d2f/fd6 0 2023-12-06T15:00:28.488 INFO:tasks.workunit.client.1.smithi190.stdout:4/524: unlink d3/d76/d7c/d96/d15/f16 0 2023-12-06T15:00:28.490 INFO:tasks.workunit.client.0.smithi152.stdout:6/588: rename d1/d1c/d79 to d1/dcf/ddc 0 2023-12-06T15:00:28.490 INFO:tasks.workunit.client.1.smithi190.stdout:9/682: unlink d4/d27/d2f/d31/d3f/d58/d72/fa7 0 2023-12-06T15:00:28.491 INFO:tasks.workunit.client.1.smithi190.stdout:6/691: symlink d4/d12/d40/d43/le8 0 2023-12-06T15:00:28.493 INFO:tasks.workunit.client.0.smithi152.stdout:3/380: creat d9/d10/d12/d43/d52/f71 x:0 0 0 2023-12-06T15:00:28.495 INFO:tasks.workunit.client.1.smithi190.stdout:7/663: link d0/d5/da/f48 d0/d88/d41/d92/fd7 0 2023-12-06T15:00:28.495 INFO:tasks.workunit.client.1.smithi190.stdout:9/683: truncate d4/f6b 1728575 0 2023-12-06T15:00:28.497 INFO:tasks.workunit.client.1.smithi190.stdout:7/664: mknod d0/d88/d1c/d17/d94/d95/db1/cd8 0 2023-12-06T15:00:28.499 INFO:tasks.workunit.client.0.smithi152.stdout:1/561: dread d3/da/fa6 [0,4194304] 0 2023-12-06T15:00:28.503 INFO:tasks.workunit.client.1.smithi190.stdout:4/525: dread d3/fd [0,4194304] 0 2023-12-06T15:00:28.503 INFO:tasks.workunit.client.1.smithi190.stdout:4/526: stat d3/d35/d19/d30 0 2023-12-06T15:00:28.505 INFO:tasks.workunit.client.1.smithi190.stdout:4/527: mkdir d3/d35/da6 0 2023-12-06T15:00:28.505 INFO:tasks.workunit.client.1.smithi190.stdout:4/528: chown d3/d76/d7c/d96/d39/f25 174 1 2023-12-06T15:00:28.505 INFO:tasks.workunit.client.1.smithi190.stdout:7/665: dread d0/d88/d1c/d17/f4a [0,4194304] 0 2023-12-06T15:00:28.509 INFO:tasks.workunit.client.1.smithi190.stdout:4/529: creat d3/d35/da5/fa7 x:0 0 0 2023-12-06T15:00:28.510 INFO:tasks.workunit.client.1.smithi190.stdout:7/666: creat d0/df/d53/d15/fd9 x:0 0 0 2023-12-06T15:00:28.510 INFO:tasks.workunit.client.1.smithi190.stdout:7/667: fsync d0/d88/fb4 0 2023-12-06T15:00:28.513 INFO:tasks.workunit.client.1.smithi190.stdout:4/530: truncate d3/d35/d19/d41/d44/f4c 27942 0 2023-12-06T15:00:28.518 INFO:tasks.workunit.client.1.smithi190.stdout:4/531: rename d3/d76/d7c/d96/l9e to d3/d35/d19/d41/d44/d9c/d72/la8 0 2023-12-06T15:00:28.519 INFO:tasks.workunit.client.1.smithi190.stdout:4/532: read d3/d76/d7c/d96/f5f [202761,37259] 0 2023-12-06T15:00:28.520 INFO:tasks.workunit.client.0.smithi152.stdout:6/589: dwrite d1/dcf/ddc/d1a/d30/d36/d35/d49/d57/f99 [0,4194304] 0 2023-12-06T15:00:28.520 INFO:tasks.workunit.client.0.smithi152.stdout:9/369: dwrite d0/dd/fe [0,4194304] 0 2023-12-06T15:00:28.521 INFO:tasks.workunit.client.0.smithi152.stdout:2/293: dwrite d6/d18/d43/f50 [4194304,4194304] 0 2023-12-06T15:00:28.522 INFO:tasks.workunit.client.0.smithi152.stdout:2/294: write d6/db/d17/f46 [624328,28070] 0 2023-12-06T15:00:28.523 INFO:tasks.workunit.client.1.smithi190.stdout:2/561: dwrite d10/d59/d5e/f1b [0,4194304] 0 2023-12-06T15:00:28.524 INFO:tasks.workunit.client.0.smithi152.stdout:1/562: dwrite d3/da/d15/f5e [0,4194304] 0 2023-12-06T15:00:28.524 INFO:tasks.workunit.client.1.smithi190.stdout:9/684: getdents d4/d27/d2f/d31/d3f 0 2023-12-06T15:00:28.524 INFO:tasks.workunit.client.1.smithi190.stdout:6/692: dwrite d4/d12/d1a/fc9 [0,4194304] 0 2023-12-06T15:00:28.525 INFO:tasks.workunit.client.0.smithi152.stdout:9/370: mknod d0/dd/d20/d38/c65 0 2023-12-06T15:00:28.529 INFO:tasks.workunit.client.0.smithi152.stdout:2/295: truncate d6/d1e/f53 302399 0 2023-12-06T15:00:28.533 INFO:tasks.workunit.client.1.smithi190.stdout:3/714: rmdir d4/d1b/d54/d9c/d68 39 2023-12-06T15:00:28.534 INFO:tasks.workunit.client.1.smithi190.stdout:7/668: dwrite d0/d88/d32/f7d [0,4194304] 0 2023-12-06T15:00:28.538 INFO:tasks.workunit.client.0.smithi152.stdout:5/364: sync 2023-12-06T15:00:28.538 INFO:tasks.workunit.client.0.smithi152.stdout:1/563: creat d3/da/d15/fd6 x:0 0 0 2023-12-06T15:00:28.538 INFO:tasks.workunit.client.0.smithi152.stdout:0/421: sync 2023-12-06T15:00:28.539 INFO:tasks.workunit.client.0.smithi152.stdout:7/286: sync 2023-12-06T15:00:28.539 INFO:tasks.workunit.client.0.smithi152.stdout:9/371: creat d0/dd/d20/d38/d45/f66 x:0 0 0 2023-12-06T15:00:28.539 INFO:tasks.workunit.client.1.smithi190.stdout:6/693: mkdir d4/d12/d1a/d32/dab/de9 0 2023-12-06T15:00:28.540 INFO:tasks.workunit.client.0.smithi152.stdout:2/296: rmdir d6/d1e/d41/d55 39 2023-12-06T15:00:28.540 INFO:tasks.workunit.client.0.smithi152.stdout:2/297: write d6/db/d17/f4f [261563,123483] 0 2023-12-06T15:00:28.540 INFO:tasks.workunit.client.1.smithi190.stdout:4/533: dread d3/d35/d19/d41/d44/d5b/f61 [0,4194304] 0 2023-12-06T15:00:28.541 INFO:tasks.workunit.client.0.smithi152.stdout:5/365: truncate d7/dd/d26/f44 463572 0 2023-12-06T15:00:28.544 INFO:tasks.workunit.client.0.smithi152.stdout:1/564: rename d3/da/d4c/d82/d52/fb1 to d3/da/d4c/d82/d52/fd7 0 2023-12-06T15:00:28.549 INFO:tasks.workunit.client.0.smithi152.stdout:5/366: mknod d7/dd/d4e/c81 0 2023-12-06T15:00:28.549 INFO:tasks.workunit.client.0.smithi152.stdout:2/298: creat d6/d18/f58 x:0 0 0 2023-12-06T15:00:28.549 INFO:tasks.workunit.client.0.smithi152.stdout:7/287: read dd/df/f3b [1180433,126592] 0 2023-12-06T15:00:28.549 INFO:tasks.workunit.client.0.smithi152.stdout:7/288: chown dd/df/d1b/d20/d28/f30 502 1 2023-12-06T15:00:28.549 INFO:tasks.workunit.client.0.smithi152.stdout:7/289: chown dd/df/d1b/d20/d28/d38/l25 290853 1 2023-12-06T15:00:28.549 INFO:tasks.workunit.client.0.smithi152.stdout:7/290: dread - dd/df/d1b/d20/d28/d38/f39 zero size 2023-12-06T15:00:28.551 INFO:tasks.workunit.client.1.smithi190.stdout:4/534: mkdir d3/d35/da9 0 2023-12-06T15:00:28.551 INFO:tasks.workunit.client.1.smithi190.stdout:4/535: fsync d3/d35/d19/f47 0 2023-12-06T15:00:28.551 INFO:tasks.workunit.client.0.smithi152.stdout:5/367: mknod d7/dd/d26/d3b/d46/d7e/c82 0 2023-12-06T15:00:28.551 INFO:tasks.workunit.client.0.smithi152.stdout:2/299: creat d6/db/d17/f59 x:0 0 0 2023-12-06T15:00:28.553 INFO:tasks.workunit.client.0.smithi152.stdout:7/291: rename dd/df/d1b/d20/d28/d38/c46 to dd/df/d1b/d20/d28/c52 0 2023-12-06T15:00:28.553 INFO:tasks.workunit.client.0.smithi152.stdout:5/368: mknod d7/dd/c83 0 2023-12-06T15:00:28.554 INFO:tasks.workunit.client.0.smithi152.stdout:5/369: write d7/dd/d26/d3b/f6e [763421,55529] 0 2023-12-06T15:00:28.554 INFO:tasks.workunit.client.0.smithi152.stdout:0/422: write d8/d3e/f69 [1575531,117266] 0 2023-12-06T15:00:28.554 INFO:tasks.workunit.client.0.smithi152.stdout:2/300: rmdir d6/d18/d43 39 2023-12-06T15:00:28.555 INFO:tasks.workunit.client.0.smithi152.stdout:6/590: dwrite d1/d69/da1/d87/d15/f8e [0,4194304] 0 2023-12-06T15:00:28.560 INFO:tasks.workunit.client.0.smithi152.stdout:5/370: truncate d7/d47/f74 658448 0 2023-12-06T15:00:28.561 INFO:tasks.workunit.client.0.smithi152.stdout:7/292: rename dd/df/d34/d3a to dd/df/d1b/d20/d28/d53 0 2023-12-06T15:00:28.561 INFO:tasks.workunit.client.0.smithi152.stdout:0/423: symlink d8/d38/d76/d68/l86 0 2023-12-06T15:00:28.566 INFO:tasks.workunit.client.0.smithi152.stdout:5/371: symlink d7/dd/d26/l84 0 2023-12-06T15:00:28.566 INFO:tasks.workunit.client.0.smithi152.stdout:6/591: creat d1/dcf/ddc/d1a/d30/d36/d35/d61/fdd x:0 0 0 2023-12-06T15:00:28.566 INFO:tasks.workunit.client.0.smithi152.stdout:6/592: truncate d1/d69/da1/d87/f44 821882 0 2023-12-06T15:00:28.566 INFO:tasks.workunit.client.0.smithi152.stdout:7/293: creat dd/df/d34/d44/d49/f54 x:0 0 0 2023-12-06T15:00:28.568 INFO:tasks.workunit.client.0.smithi152.stdout:5/372: link d7/f18 d7/dd/d26/d48/f85 0 2023-12-06T15:00:28.568 INFO:tasks.workunit.client.0.smithi152.stdout:5/373: read - d7/dd/d4e/f70 zero size 2023-12-06T15:00:28.569 INFO:tasks.workunit.client.1.smithi190.stdout:9/685: dwrite d4/d27/d2f/d31/d3f/d58/d7d/f9f [0,4194304] 0 2023-12-06T15:00:28.569 INFO:tasks.workunit.client.0.smithi152.stdout:6/593: creat d1/dcf/ddc/d1a/d30/d36/d35/dd1/fde x:0 0 0 2023-12-06T15:00:28.570 INFO:tasks.workunit.client.0.smithi152.stdout:6/594: truncate d1/d69/da1/d87/f42 736790 0 2023-12-06T15:00:28.573 INFO:tasks.workunit.client.0.smithi152.stdout:5/374: rename d7/dd/d26/d3b/f4d to d7/dd/d26/d48/f86 0 2023-12-06T15:00:28.573 INFO:tasks.workunit.client.0.smithi152.stdout:5/375: write d7/dd/d26/d3b/f5a [4690793,126569] 0 2023-12-06T15:00:28.573 INFO:tasks.workunit.client.1.smithi190.stdout:4/536: dread d3/d35/d19/d30/d3c/f8d [0,4194304] 0 2023-12-06T15:00:28.575 INFO:tasks.workunit.client.0.smithi152.stdout:6/595: write d1/dcf/ddc/d1a/d30/d36/f24 [1469187,9930] 0 2023-12-06T15:00:28.575 INFO:tasks.workunit.client.0.smithi152.stdout:6/596: readlink d1/dcf/ddc/d1a/d30/d36/d26/l76 0 2023-12-06T15:00:28.575 INFO:tasks.workunit.client.0.smithi152.stdout:6/597: chown d1/dcf/ddc/d1a/d30/d36/d4e/d55/f5d 6 1 2023-12-06T15:00:28.575 INFO:tasks.workunit.client.0.smithi152.stdout:6/598: dread - d1/d69/fa0 zero size 2023-12-06T15:00:28.575 INFO:tasks.workunit.client.0.smithi152.stdout:5/376: mkdir d7/dd/d26/d87 0 2023-12-06T15:00:28.575 INFO:tasks.workunit.client.0.smithi152.stdout:5/377: fdatasync d7/f1f 0 2023-12-06T15:00:28.578 INFO:tasks.workunit.client.0.smithi152.stdout:6/599: creat d1/dcf/ddc/d1a/d30/d36/d35/d49/d57/fdf x:0 0 0 2023-12-06T15:00:28.578 INFO:tasks.workunit.client.0.smithi152.stdout:6/600: write d1/d69/da1/d87/f44 [1656146,48279] 0 2023-12-06T15:00:28.578 INFO:tasks.workunit.client.1.smithi190.stdout:4/537: mkdir d3/d35/d19/d30/daa 0 2023-12-06T15:00:28.578 INFO:tasks.workunit.client.1.smithi190.stdout:5/471: sync 2023-12-06T15:00:28.579 INFO:tasks.workunit.client.1.smithi190.stdout:5/472: write d0/d1c/d2b/d69/f8e [814101,99690] 0 2023-12-06T15:00:28.579 INFO:tasks.workunit.client.1.smithi190.stdout:0/562: sync 2023-12-06T15:00:28.579 INFO:tasks.workunit.client.1.smithi190.stdout:0/563: chown d0/da/c67 838371 1 2023-12-06T15:00:28.579 INFO:tasks.workunit.client.1.smithi190.stdout:5/473: mknod d0/d1c/d2b/d69/ca0 0 2023-12-06T15:00:28.580 INFO:tasks.workunit.client.1.smithi190.stdout:5/474: readlink d0/d1c/d2b/d2c/d5d/d73/l71 0 2023-12-06T15:00:28.580 INFO:tasks.workunit.client.1.smithi190.stdout:0/564: mknod d0/da/d3e/d2b/d37/cb4 0 2023-12-06T15:00:28.581 INFO:tasks.workunit.client.1.smithi190.stdout:0/565: write d0/da/d3e/d2b/d3c/d46/d8e/d90/fb3 [148280,62914] 0 2023-12-06T15:00:28.581 INFO:tasks.workunit.client.0.smithi152.stdout:6/601: link d1/d69/da1/d87/f9 d1/dcf/ddc/d1a/d30/daa/fe0 0 2023-12-06T15:00:28.581 INFO:tasks.workunit.client.0.smithi152.stdout:6/602: dread - d1/dcf/ddc/d1a/d30/d36/d35/d63/f9b zero size 2023-12-06T15:00:28.581 INFO:tasks.workunit.client.0.smithi152.stdout:0/424: dread d8/d15/d45/d73/d7a/f34 [0,4194304] 0 2023-12-06T15:00:28.583 INFO:tasks.workunit.client.1.smithi190.stdout:0/566: rmdir d0/da/d3e/d3a 39 2023-12-06T15:00:28.583 INFO:tasks.workunit.client.1.smithi190.stdout:5/475: creat d0/d6c/fa1 x:0 0 0 2023-12-06T15:00:28.583 INFO:tasks.workunit.client.1.smithi190.stdout:5/476: dread - d0/df/d50/f87 zero size 2023-12-06T15:00:28.584 INFO:tasks.workunit.client.1.smithi190.stdout:5/477: write d0/d1c/d2b/f7f [980712,76954] 0 2023-12-06T15:00:28.584 INFO:tasks.workunit.client.1.smithi190.stdout:5/478: fdatasync d0/d1c/d85/f91 0 2023-12-06T15:00:28.584 INFO:tasks.workunit.client.1.smithi190.stdout:5/479: chown d0/d1c/d2b/d2c/c81 333744 1 2023-12-06T15:00:28.584 INFO:tasks.workunit.client.1.smithi190.stdout:5/480: truncate d0/df/d50/f75 824125 0 2023-12-06T15:00:28.587 INFO:tasks.workunit.client.1.smithi190.stdout:5/481: symlink d0/la2 0 2023-12-06T15:00:28.588 INFO:tasks.workunit.client.0.smithi152.stdout:6/603: write d1/dcf/ddc/d1a/d30/d36/d35/d49/d57/f99 [826920,11289] 0 2023-12-06T15:00:28.588 INFO:tasks.workunit.client.0.smithi152.stdout:6/604: chown d1/dcf/ddc/d1a/d30/d36/d35/d49 284181153 1 2023-12-06T15:00:28.589 INFO:tasks.workunit.client.1.smithi190.stdout:0/567: link d0/f11 d0/da/d3e/d2b/d3c/d46/d8e/fb5 0 2023-12-06T15:00:28.589 INFO:tasks.workunit.client.1.smithi190.stdout:7/669: dwrite d0/d88/d32/f59 [0,4194304] 0 2023-12-06T15:00:28.589 INFO:tasks.workunit.client.1.smithi190.stdout:7/670: fdatasync d0/d88/d41/fb3 0 2023-12-06T15:00:28.590 INFO:tasks.workunit.client.1.smithi190.stdout:5/482: link d0/d1c/d2b/f32 d0/d1c/d85/d90/d99/fa3 0 2023-12-06T15:00:28.595 INFO:tasks.workunit.client.0.smithi152.stdout:1/565: dwrite d3/da/db/da0/fc0 [0,4194304] 0 2023-12-06T15:00:28.604 INFO:tasks.workunit.client.0.smithi152.stdout:1/566: mkdir d3/da/d4c/d63/d96/dd8 0 2023-12-06T15:00:28.606 INFO:tasks.workunit.client.0.smithi152.stdout:2/301: dwrite d6/db/f47 [0,4194304] 0 2023-12-06T15:00:28.608 INFO:tasks.workunit.client.0.smithi152.stdout:1/567: mkdir d3/da/dcd/dd9 0 2023-12-06T15:00:28.611 INFO:tasks.workunit.client.0.smithi152.stdout:9/372: dwrite d0/dd/d20/d38/d45/f64 [0,4194304] 0 2023-12-06T15:00:28.612 INFO:tasks.workunit.client.1.smithi190.stdout:6/694: dwrite d4/d12/d1a/d44/f56 [0,4194304] 0 2023-12-06T15:00:28.612 INFO:tasks.workunit.client.0.smithi152.stdout:2/302: dread d6/d1e/f2f [0,4194304] 0 2023-12-06T15:00:28.613 INFO:tasks.workunit.client.1.smithi190.stdout:6/695: mkdir d4/d12/d1a/d32/dc7/dea 0 2023-12-06T15:00:28.614 INFO:tasks.workunit.client.0.smithi152.stdout:9/373: creat d0/dd/d20/d38/f67 x:0 0 0 2023-12-06T15:00:28.614 INFO:tasks.workunit.client.0.smithi152.stdout:9/374: readlink d0/dd/d20/d38/l47 0 2023-12-06T15:00:28.614 INFO:tasks.workunit.client.0.smithi152.stdout:9/375: chown d0/dd/d20/d4a/d4d/f5e 663059 1 2023-12-06T15:00:28.614 INFO:tasks.workunit.client.1.smithi190.stdout:6/696: symlink d4/d12/d40/d43/d45/leb 0 2023-12-06T15:00:28.615 INFO:tasks.workunit.client.1.smithi190.stdout:6/697: rename d4/d12/c22 to d4/d12/d1a/d32/dc7/dd0/cec 0 2023-12-06T15:00:28.618 INFO:tasks.workunit.client.0.smithi152.stdout:2/303: creat d6/d1e/f5a x:0 0 0 2023-12-06T15:00:28.618 INFO:tasks.workunit.client.0.smithi152.stdout:2/304: chown d6/d1e/d41 955253 1 2023-12-06T15:00:28.618 INFO:tasks.workunit.client.0.smithi152.stdout:2/305: dread - d6/d18/f58 zero size 2023-12-06T15:00:28.618 INFO:tasks.workunit.client.0.smithi152.stdout:9/376: mkdir d0/d3f/d68 0 2023-12-06T15:00:28.618 INFO:tasks.workunit.client.0.smithi152.stdout:9/377: readlink d0/dd/l2e 0 2023-12-06T15:00:28.619 INFO:tasks.workunit.client.0.smithi152.stdout:9/378: mkdir d0/dd/d20/d4a/d4d/d69 0 2023-12-06T15:00:28.620 INFO:tasks.workunit.client.0.smithi152.stdout:9/379: creat d0/d3f/d68/f6a x:0 0 0 2023-12-06T15:00:28.620 INFO:tasks.workunit.client.0.smithi152.stdout:2/306: rmdir d6/d1e/d27 0 2023-12-06T15:00:28.640 INFO:tasks.workunit.client.1.smithi190.stdout:0/568: dwrite d0/da/d5a/fac [0,4194304] 0 2023-12-06T15:00:28.642 INFO:tasks.workunit.client.1.smithi190.stdout:0/569: write d0/da/d3e/d3a/d40/d81/f92 [741277,96731] 0 2023-12-06T15:00:28.642 INFO:tasks.workunit.client.1.smithi190.stdout:9/686: dwrite d4/d27/d8a/dbc/fd2 [0,4194304] 0 2023-12-06T15:00:28.643 INFO:tasks.workunit.client.1.smithi190.stdout:4/538: dwrite d3/d76/d7c/d96/d39/f48 [4194304,4194304] 0 2023-12-06T15:00:28.643 INFO:tasks.workunit.client.0.smithi152.stdout:2/307: dwrite d6/db/d17/f28 [4194304,4194304] 0 2023-12-06T15:00:28.643 INFO:tasks.workunit.client.0.smithi152.stdout:2/308: write d6/d18/f58 [587905,38531] 0 2023-12-06T15:00:28.644 INFO:tasks.workunit.client.1.smithi190.stdout:0/570: creat d0/da/d3e/d2b/d3c/d4c/da8/fb6 x:0 0 0 2023-12-06T15:00:28.644 INFO:tasks.workunit.client.0.smithi152.stdout:7/294: dwrite dd/f11 [0,4194304] 0 2023-12-06T15:00:28.645 INFO:tasks.workunit.client.0.smithi152.stdout:6/605: dwrite d1/dcf/ddc/d8a/fc6 [0,4194304] 0 2023-12-06T15:00:28.646 INFO:tasks.workunit.client.1.smithi190.stdout:5/483: dwrite d0/d1c/f98 [0,4194304] 0 2023-12-06T15:00:28.646 INFO:tasks.workunit.client.1.smithi190.stdout:7/671: dwrite d0/df/d53/d15/f8d [0,4194304] 0 2023-12-06T15:00:28.646 INFO:tasks.workunit.client.1.smithi190.stdout:7/672: chown d0/df/d53 12245 1 2023-12-06T15:00:28.646 INFO:tasks.workunit.client.0.smithi152.stdout:0/425: rename d8/d38 to d8/d3e/d87 0 2023-12-06T15:00:28.647 INFO:tasks.workunit.client.1.smithi190.stdout:0/571: write d0/da/f49 [1721579,38806] 0 2023-12-06T15:00:28.647 INFO:tasks.workunit.client.1.smithi190.stdout:0/572: write d0/da/d3e/d2b/d3c/f71 [993640,122601] 0 2023-12-06T15:00:28.647 INFO:tasks.workunit.client.1.smithi190.stdout:0/573: chown d0/da/da4 544 1 2023-12-06T15:00:28.648 INFO:tasks.workunit.client.0.smithi152.stdout:5/378: dwrite d7/f24 [8388608,4194304] 0 2023-12-06T15:00:28.649 INFO:tasks.workunit.client.0.smithi152.stdout:7/295: symlink dd/l55 0 2023-12-06T15:00:28.650 INFO:tasks.workunit.client.0.smithi152.stdout:7/296: chown dd/df/d1b/d20/d28/d38/d42/f48 450184758 1 2023-12-06T15:00:28.652 INFO:tasks.workunit.client.1.smithi190.stdout:9/687: creat d4/d27/d2f/d31/d3f/d58/d72/fe6 x:0 0 0 2023-12-06T15:00:28.654 INFO:tasks.workunit.client.0.smithi152.stdout:6/606: creat d1/dcf/ddc/d6d/fe1 x:0 0 0 2023-12-06T15:00:28.654 INFO:tasks.workunit.client.1.smithi190.stdout:4/539: link d3/f6d d3/d35/d97/fab 0 2023-12-06T15:00:28.659 INFO:tasks.workunit.client.0.smithi152.stdout:9/380: rename d0/dd/d20/d38/d45/f5b to d0/d3f/d5f/d60/f6b 0 2023-12-06T15:00:28.659 INFO:tasks.workunit.client.0.smithi152.stdout:9/381: stat d0/c33 0 2023-12-06T15:00:28.660 INFO:tasks.workunit.client.0.smithi152.stdout:9/382: dread d0/dd/f2f [0,4194304] 0 2023-12-06T15:00:28.663 INFO:tasks.workunit.client.1.smithi190.stdout:5/484: rename d0/d1c/d2b/d2c/f64 to d0/df/d50/fa4 0 2023-12-06T15:00:28.667 INFO:tasks.workunit.client.0.smithi152.stdout:5/379: link d7/f21 d7/dd/d26/d3b/d46/d7e/f88 0 2023-12-06T15:00:28.667 INFO:tasks.workunit.client.0.smithi152.stdout:5/380: dread d7/dd/d26/d3b/f63 [0,4194304] 0 2023-12-06T15:00:28.667 INFO:tasks.workunit.client.0.smithi152.stdout:9/383: write d0/dd/fe [2707775,9029] 0 2023-12-06T15:00:28.669 INFO:tasks.workunit.client.0.smithi152.stdout:7/297: creat dd/df/d1b/d20/d28/d38/f56 x:0 0 0 2023-12-06T15:00:28.670 INFO:tasks.workunit.client.1.smithi190.stdout:0/574: mkdir d0/da/db7 0 2023-12-06T15:00:28.670 INFO:tasks.workunit.client.1.smithi190.stdout:0/575: write d0/f2e [5174009,102661] 0 2023-12-06T15:00:28.671 INFO:tasks.workunit.client.0.smithi152.stdout:6/607: link d1/d69/da1/cbc d1/dcf/ddc/d1a/d30/d36/ce2 0 2023-12-06T15:00:28.671 INFO:tasks.workunit.client.0.smithi152.stdout:5/381: mknod d7/dd/d26/d3a/c89 0 2023-12-06T15:00:28.672 INFO:tasks.workunit.client.1.smithi190.stdout:4/540: rename d3/d35/d19/d41/d44/l8e to d3/lac 0 2023-12-06T15:00:28.673 INFO:tasks.workunit.client.1.smithi190.stdout:4/541: truncate d3/f14 1969242 0 2023-12-06T15:00:28.673 INFO:tasks.workunit.client.1.smithi190.stdout:4/542: chown d3/d35/d19/d41/l52 571327 1 2023-12-06T15:00:28.673 INFO:tasks.workunit.client.1.smithi190.stdout:5/485: truncate d0/df/f41 456060 0 2023-12-06T15:00:28.674 INFO:tasks.workunit.client.1.smithi190.stdout:0/576: write d0/da/d3e/d2b/d3c/d4c/f53 [98481,54349] 0 2023-12-06T15:00:28.675 INFO:tasks.workunit.client.1.smithi190.stdout:4/543: mkdir d3/d35/d19/d30/d3c/dad 0 2023-12-06T15:00:28.676 INFO:tasks.workunit.client.0.smithi152.stdout:7/298: symlink dd/df/d34/d44/d49/l57 0 2023-12-06T15:00:28.677 INFO:tasks.workunit.client.1.smithi190.stdout:5/486: rmdir d0/d1c/d2b/d2c/d5d 39 2023-12-06T15:00:28.678 INFO:tasks.workunit.client.1.smithi190.stdout:0/577: rmdir d0/da/d5a 39 2023-12-06T15:00:28.679 INFO:tasks.workunit.client.1.smithi190.stdout:4/544: link d3/d76/d7c/d96/d15/l71 d3/da4/lae 0 2023-12-06T15:00:28.680 INFO:tasks.workunit.client.1.smithi190.stdout:5/487: symlink d0/d1c/d85/d90/la5 0 2023-12-06T15:00:28.683 INFO:tasks.workunit.client.1.smithi190.stdout:0/578: mkdir d0/da/d3e/db8 0 2023-12-06T15:00:28.685 INFO:tasks.workunit.client.1.smithi190.stdout:0/579: creat d0/da/d3e/d2b/d3c/d4c/da8/fb9 x:0 0 0 2023-12-06T15:00:28.691 INFO:tasks.workunit.client.0.smithi152.stdout:0/426: dwrite d8/f6d [0,4194304] 0 2023-12-06T15:00:28.691 INFO:tasks.workunit.client.0.smithi152.stdout:0/427: truncate d8/d15/d45/d73/d7a/f39 1026077 0 2023-12-06T15:00:28.693 INFO:tasks.workunit.client.0.smithi152.stdout:0/428: mknod d8/d3e/d87/c88 0 2023-12-06T15:00:28.694 INFO:tasks.workunit.client.0.smithi152.stdout:0/429: dread d8/d15/d45/d73/d7a/f1f [0,4194304] 0 2023-12-06T15:00:28.695 INFO:tasks.workunit.client.0.smithi152.stdout:0/430: symlink d8/d3e/l89 0 2023-12-06T15:00:28.696 INFO:tasks.workunit.client.1.smithi190.stdout:9/688: dwrite d4/d27/d8a/fb1 [0,4194304] 0 2023-12-06T15:00:28.699 INFO:tasks.workunit.client.1.smithi190.stdout:9/689: truncate d4/f2e 5285794 0 2023-12-06T15:00:28.699 INFO:tasks.workunit.client.1.smithi190.stdout:7/673: dwrite d0/d5/f8 [0,4194304] 0 2023-12-06T15:00:28.699 INFO:tasks.workunit.client.1.smithi190.stdout:7/674: stat d0/d88/d32/f7d 0 2023-12-06T15:00:28.700 INFO:tasks.workunit.client.0.smithi152.stdout:2/309: dwrite d6/f4d [0,4194304] 0 2023-12-06T15:00:28.701 INFO:tasks.workunit.client.1.smithi190.stdout:7/675: getdents d0/df/d53/d99 0 2023-12-06T15:00:28.701 INFO:tasks.workunit.client.1.smithi190.stdout:7/676: chown d0/df/d5f/c97 57 1 2023-12-06T15:00:28.701 INFO:tasks.workunit.client.1.smithi190.stdout:7/677: rename d0/d88 to d0/d88/d1c/d17/d94/d95/dda 22 2023-12-06T15:00:28.701 INFO:tasks.workunit.client.1.smithi190.stdout:7/678: write d0/d88/d1c/d17/f64 [1034494,21570] 0 2023-12-06T15:00:28.702 INFO:tasks.workunit.client.1.smithi190.stdout:7/679: mkdir d0/df/d53/d99/ddb 0 2023-12-06T15:00:28.702 INFO:tasks.workunit.client.1.smithi190.stdout:0/580: dread d0/da/d3e/d2b/d37/f39 [0,4194304] 0 2023-12-06T15:00:28.703 INFO:tasks.workunit.client.0.smithi152.stdout:2/310: creat d6/d1e/f5b x:0 0 0 2023-12-06T15:00:28.706 INFO:tasks.workunit.client.1.smithi190.stdout:0/581: rename d0/da/d3e/d3a/d40/d6f/f8a to d0/da/d3e/d3a/d40/d6f/fba 0 2023-12-06T15:00:28.706 INFO:tasks.workunit.client.0.smithi152.stdout:2/311: unlink d6/db/f35 0 2023-12-06T15:00:28.707 INFO:tasks.workunit.client.0.smithi152.stdout:5/382: dwrite d7/dd/f67 [0,4194304] 0 2023-12-06T15:00:28.707 INFO:tasks.workunit.client.0.smithi152.stdout:5/383: chown d7/dd/d4e/c59 116164 1 2023-12-06T15:00:28.707 INFO:tasks.workunit.client.0.smithi152.stdout:6/608: dwrite d1/d69/da1/d87/d15/f8e [0,4194304] 0 2023-12-06T15:00:28.712 INFO:tasks.workunit.client.0.smithi152.stdout:9/384: rename d0/dd to d0/d3f/d68/d6c 0 2023-12-06T15:00:28.712 INFO:tasks.workunit.client.0.smithi152.stdout:9/385: readlink d0/l28 0 2023-12-06T15:00:28.712 INFO:tasks.workunit.client.0.smithi152.stdout:2/312: write f5 [3201992,84341] 0 2023-12-06T15:00:28.716 INFO:tasks.workunit.client.0.smithi152.stdout:9/386: rename d0/d3f/d68/d6c/f3e to d0/d50/f6d 0 2023-12-06T15:00:28.716 INFO:tasks.workunit.client.0.smithi152.stdout:5/384: write d7/f1e [739741,4129] 0 2023-12-06T15:00:28.717 INFO:tasks.workunit.client.0.smithi152.stdout:4/568: sync 2023-12-06T15:00:28.717 INFO:tasks.workunit.client.0.smithi152.stdout:8/270: sync 2023-12-06T15:00:28.717 INFO:tasks.workunit.client.0.smithi152.stdout:8/271: chown d1/d6/d34/d36/f2e 29195 1 2023-12-06T15:00:28.719 INFO:tasks.workunit.client.1.smithi190.stdout:4/545: dwrite d3/d76/f88 [0,4194304] 0 2023-12-06T15:00:28.720 INFO:tasks.workunit.client.0.smithi152.stdout:9/387: creat d0/d3f/d68/d6c/d20/d38/f6e x:0 0 0 2023-12-06T15:00:28.722 INFO:tasks.workunit.client.0.smithi152.stdout:5/385: creat d7/dd/f8a x:0 0 0 2023-12-06T15:00:28.722 INFO:tasks.workunit.client.0.smithi152.stdout:5/386: write d7/f18 [631943,25957] 0 2023-12-06T15:00:28.722 INFO:tasks.workunit.client.0.smithi152.stdout:4/569: mknod d2/d45/cb1 0 2023-12-06T15:00:28.725 INFO:tasks.workunit.client.0.smithi152.stdout:8/272: write d1/d6/d34/f1a [3684032,116822] 0 2023-12-06T15:00:28.725 INFO:tasks.workunit.client.0.smithi152.stdout:8/273: chown d1/d6/d34/d3a/l47 173196 1 2023-12-06T15:00:28.725 INFO:tasks.workunit.client.1.smithi190.stdout:4/546: write d3/d35/d19/f5e [2648066,66204] 0 2023-12-06T15:00:28.727 INFO:tasks.workunit.client.0.smithi152.stdout:9/388: mknod d0/d3f/d68/d6c/d20/c6f 0 2023-12-06T15:00:28.729 INFO:tasks.workunit.client.1.smithi190.stdout:0/582: rmdir d0/da/d3e/d2b/d3c 39 2023-12-06T15:00:28.731 INFO:tasks.workunit.client.0.smithi152.stdout:5/387: rename d7/dd/d26/d3a/f65 to d7/dd/d26/d3b/f8b 0 2023-12-06T15:00:28.731 INFO:tasks.workunit.client.0.smithi152.stdout:5/388: read - d7/dd/d26/f36 zero size 2023-12-06T15:00:28.732 INFO:tasks.workunit.client.0.smithi152.stdout:8/274: chown d1/d6/d34/l18 3 1 2023-12-06T15:00:28.734 INFO:tasks.workunit.client.0.smithi152.stdout:9/389: write d0/d3f/d68/d6c/d20/d38/d45/f64 [1367987,72573] 0 2023-12-06T15:00:28.734 INFO:tasks.workunit.client.0.smithi152.stdout:9/390: write d0/f14 [2023809,97924] 0 2023-12-06T15:00:28.734 INFO:tasks.workunit.client.0.smithi152.stdout:9/391: chown d0/d3f/d68/d6c/d20/d4a 2391213 1 2023-12-06T15:00:28.734 INFO:tasks.workunit.client.1.smithi190.stdout:4/547: mkdir d3/d76/d7c/d96/d39/daf 0 2023-12-06T15:00:28.735 INFO:tasks.workunit.client.0.smithi152.stdout:5/389: write d7/dd/d4e/f55 [1030542,118745] 0 2023-12-06T15:00:28.735 INFO:tasks.workunit.client.0.smithi152.stdout:5/390: write d7/f18 [1582171,73652] 0 2023-12-06T15:00:28.737 INFO:tasks.workunit.client.0.smithi152.stdout:9/392: link d0/d3f/d68/d6c/d20/d38/d44/f4e d0/d3f/d68/d6c/d20/d38/d48/f70 0 2023-12-06T15:00:28.737 INFO:tasks.workunit.client.0.smithi152.stdout:4/570: dread d2/d15/d32/d69/d6f/d6c/f73 [0,4194304] 0 2023-12-06T15:00:28.738 INFO:tasks.workunit.client.1.smithi190.stdout:0/583: mkdir d0/da/d3e/d3a/d40/d6f/d9e/dbb 0 2023-12-06T15:00:28.738 INFO:tasks.workunit.client.0.smithi152.stdout:8/275: dread d1/d6/d29/f33 [0,4194304] 0 2023-12-06T15:00:28.738 INFO:tasks.workunit.client.1.smithi190.stdout:4/548: mknod d3/d35/d97/cb0 0 2023-12-06T15:00:28.739 INFO:tasks.workunit.client.0.smithi152.stdout:9/393: mkdir d0/d3f/d68/d6c/d20/d4a/d71 0 2023-12-06T15:00:28.739 INFO:tasks.workunit.client.0.smithi152.stdout:9/394: stat d0/f6 0 2023-12-06T15:00:28.739 INFO:tasks.workunit.client.0.smithi152.stdout:9/395: dread - d0/d3f/d68/d6c/d20/d4a/d4d/f5e zero size 2023-12-06T15:00:28.739 INFO:tasks.workunit.client.0.smithi152.stdout:8/276: truncate d1/f3c 3545988 0 2023-12-06T15:00:28.739 INFO:tasks.workunit.client.0.smithi152.stdout:8/277: truncate d1/d6/f31 258768 0 2023-12-06T15:00:28.739 INFO:tasks.workunit.client.0.smithi152.stdout:8/278: fsync d1/d6/d29/f4d 0 2023-12-06T15:00:28.739 INFO:tasks.workunit.client.0.smithi152.stdout:8/279: readlink d1/d6/d34/l16 0 2023-12-06T15:00:28.740 INFO:tasks.workunit.client.0.smithi152.stdout:9/396: mknod d0/d3f/d68/d6c/d20/d38/d45/c72 0 2023-12-06T15:00:28.741 INFO:tasks.workunit.client.0.smithi152.stdout:8/280: link d1/d6/d34/d36/f26 d1/d6/d34/d36/f4f 0 2023-12-06T15:00:28.742 INFO:tasks.workunit.client.0.smithi152.stdout:4/571: write d2/d15/d32/d79/f82 [272046,96319] 0 2023-12-06T15:00:28.745 INFO:tasks.workunit.client.0.smithi152.stdout:4/572: getdents d2/d15/d32/d69/d6f 0 2023-12-06T15:00:28.745 INFO:tasks.workunit.client.0.smithi152.stdout:4/573: truncate d2/f7c 502429 0 2023-12-06T15:00:28.746 INFO:tasks.workunit.client.0.smithi152.stdout:4/574: creat d2/d15/d32/d91/fb2 x:0 0 0 2023-12-06T15:00:28.747 INFO:tasks.workunit.client.0.smithi152.stdout:4/575: symlink d2/d15/d32/d79/lb3 0 2023-12-06T15:00:28.747 INFO:tasks.workunit.client.0.smithi152.stdout:4/576: chown d2/d22/c9a 0 1 2023-12-06T15:00:28.749 INFO:tasks.workunit.client.0.smithi152.stdout:4/577: mknod d2/d15/d32/d69/d6f/d6c/cb4 0 2023-12-06T15:00:28.750 INFO:tasks.workunit.client.1.smithi190.stdout:0/584: dread d0/f50 [0,4194304] 0 2023-12-06T15:00:28.750 INFO:tasks.workunit.client.0.smithi152.stdout:4/578: write d2/d15/d23/d75/f98 [554202,67411] 0 2023-12-06T15:00:28.750 INFO:tasks.workunit.client.0.smithi152.stdout:4/579: write d2/d15/f62 [4334372,95122] 0 2023-12-06T15:00:28.750 INFO:tasks.workunit.client.0.smithi152.stdout:4/580: write d2/d15/d32/d54/d85/f87 [796239,93994] 0 2023-12-06T15:00:28.751 INFO:tasks.workunit.client.0.smithi152.stdout:9/397: dread d0/d3f/d68/d6c/f17 [0,4194304] 0 2023-12-06T15:00:28.751 INFO:tasks.workunit.client.0.smithi152.stdout:9/398: readlink d0/d3f/d68/d6c/l2c 0 2023-12-06T15:00:28.751 INFO:tasks.workunit.client.0.smithi152.stdout:4/581: mknod d2/d22/d6e/da8/cb5 0 2023-12-06T15:00:28.752 INFO:tasks.workunit.client.0.smithi152.stdout:5/391: dread d7/d47/f78 [8388608,4194304] 0 2023-12-06T15:00:28.753 INFO:tasks.workunit.client.0.smithi152.stdout:6/609: dwrite d1/d69/da1/d87/f14 [0,4194304] 0 2023-12-06T15:00:28.753 INFO:tasks.workunit.client.0.smithi152.stdout:6/610: fdatasync d1/dcf/ddc/d1a/d30/d36/d35/d63/f65 0 2023-12-06T15:00:28.753 INFO:tasks.workunit.client.1.smithi190.stdout:0/585: dread d0/da/d3e/d2b/d3c/d65/f72 [0,4194304] 0 2023-12-06T15:00:28.753 INFO:tasks.workunit.client.1.smithi190.stdout:9/690: dwrite d4/f2d [0,4194304] 0 2023-12-06T15:00:28.753 INFO:tasks.workunit.client.1.smithi190.stdout:9/691: fsync d4/d27/d8a/f92 0 2023-12-06T15:00:28.754 INFO:tasks.workunit.client.0.smithi152.stdout:9/399: rename d0/f19 to d0/d3f/d68/d6c/d20/d38/d45/d43/f73 0 2023-12-06T15:00:28.754 INFO:tasks.workunit.client.1.smithi190.stdout:7/680: dwrite d0/df/d53/d2f/f8f [0,4194304] 0 2023-12-06T15:00:28.756 INFO:tasks.workunit.client.0.smithi152.stdout:5/392: mknod d7/d43/c8c 0 2023-12-06T15:00:28.757 INFO:tasks.workunit.client.1.smithi190.stdout:7/681: symlink d0/d35/ldc 0 2023-12-06T15:00:28.758 INFO:tasks.workunit.client.1.smithi190.stdout:0/586: dread d0/da/d3e/d2b/d3c/d4c/f59 [0,4194304] 0 2023-12-06T15:00:28.758 INFO:tasks.workunit.client.0.smithi152.stdout:0/431: dwrite d8/d15/d45/f71 [0,4194304] 0 2023-12-06T15:00:28.758 INFO:tasks.workunit.client.0.smithi152.stdout:2/313: dwrite d6/db/d17/f28 [0,4194304] 0 2023-12-06T15:00:28.759 INFO:tasks.workunit.client.0.smithi152.stdout:6/611: unlink d1/dcf/ddc/d1a/d30/d36/d26/f77 0 2023-12-06T15:00:28.760 INFO:tasks.workunit.client.1.smithi190.stdout:7/682: symlink d0/df/ldd 0 2023-12-06T15:00:28.762 INFO:tasks.workunit.client.1.smithi190.stdout:0/587: link d0/da/d3e/d3a/d40/d6f/c9c d0/da/d3e/d2b/cbc 0 2023-12-06T15:00:28.762 INFO:tasks.workunit.client.1.smithi190.stdout:0/588: readlink d0/da/d3e/d2b/laf 0 2023-12-06T15:00:28.763 INFO:tasks.workunit.client.0.smithi152.stdout:5/393: link d7/dd/f7c d7/d43/d6c/f8d 0 2023-12-06T15:00:28.763 INFO:tasks.workunit.client.1.smithi190.stdout:0/589: symlink d0/da/d5a/d80/lbd 0 2023-12-06T15:00:28.765 INFO:tasks.workunit.client.1.smithi190.stdout:4/549: dwrite d3/d76/d7c/d96/d15/f34 [0,4194304] 0 2023-12-06T15:00:28.765 INFO:tasks.workunit.client.1.smithi190.stdout:4/550: rename d3/d76 to d3/d76/d7c/d8a/db1 22 2023-12-06T15:00:28.766 INFO:tasks.workunit.client.1.smithi190.stdout:0/590: dread d0/da/d3e/d2b/d3c/f5f [0,4194304] 0 2023-12-06T15:00:28.767 INFO:tasks.workunit.client.0.smithi152.stdout:4/582: dread d2/d15/d23/d75/f98 [0,4194304] 0 2023-12-06T15:00:28.767 INFO:tasks.workunit.client.0.smithi152.stdout:0/432: truncate d8/ff 1286975 0 2023-12-06T15:00:28.770 INFO:tasks.workunit.client.0.smithi152.stdout:2/314: mknod d6/d1e/d41/c5c 0 2023-12-06T15:00:28.771 INFO:tasks.workunit.client.1.smithi190.stdout:0/591: dread d0/da/d3e/d2b/d3c/d46/d8e/d90/fb3 [0,4194304] 0 2023-12-06T15:00:28.772 INFO:tasks.workunit.client.1.smithi190.stdout:0/592: dread - d0/da/fa3 zero size 2023-12-06T15:00:28.773 INFO:tasks.workunit.client.1.smithi190.stdout:4/551: rmdir d3/d35/d19/d30/d3c/dad 0 2023-12-06T15:00:28.775 INFO:tasks.workunit.client.0.smithi152.stdout:6/612: dread d1/dcf/ddc/d1a/f31 [0,4194304] 0 2023-12-06T15:00:28.776 INFO:tasks.workunit.client.0.smithi152.stdout:0/433: rmdir d8/d3e/d87/d76 39 2023-12-06T15:00:28.779 INFO:tasks.workunit.client.1.smithi190.stdout:0/593: write d0/da/f44 [553443,102372] 0 2023-12-06T15:00:28.779 INFO:tasks.workunit.client.0.smithi152.stdout:2/315: creat d6/d1e/d41/f5d x:0 0 0 2023-12-06T15:00:28.782 INFO:tasks.workunit.client.0.smithi152.stdout:5/394: dread d7/dd/d26/f32 [0,4194304] 0 2023-12-06T15:00:28.782 INFO:tasks.workunit.client.0.smithi152.stdout:9/400: dread d0/d3f/d68/d6c/d20/d38/d45/f64 [0,4194304] 0 2023-12-06T15:00:28.782 INFO:tasks.workunit.client.0.smithi152.stdout:9/401: fsync d0/f8 0 2023-12-06T15:00:28.782 INFO:tasks.workunit.client.0.smithi152.stdout:9/402: fsync d0/f15 0 2023-12-06T15:00:28.782 INFO:tasks.workunit.client.0.smithi152.stdout:9/403: dread - d0/d50/f61 zero size 2023-12-06T15:00:28.782 INFO:tasks.workunit.client.0.smithi152.stdout:9/404: dread - d0/d3f/d68/d6c/d20/d4a/d4d/f5e zero size 2023-12-06T15:00:28.782 INFO:tasks.workunit.client.0.smithi152.stdout:9/405: truncate d0/d3f/d68/d6c/d20/f29 928502 0 2023-12-06T15:00:28.782 INFO:tasks.workunit.client.0.smithi152.stdout:9/406: rename d0/d3f/d68/d6c/d20/d38 to d0/d3f/d68/d6c/d20/d38/d44/d74 22 2023-12-06T15:00:28.782 INFO:tasks.workunit.client.0.smithi152.stdout:9/407: dread - d0/d3f/d68/d6c/d20/d38/d45/d43/f52 zero size 2023-12-06T15:00:28.782 INFO:tasks.workunit.client.0.smithi152.stdout:9/408: truncate d0/d3f/d68/d6c/d20/f5a 619649 0 2023-12-06T15:00:28.782 INFO:tasks.workunit.client.0.smithi152.stdout:9/409: readlink d0/d3f/d68/d6c/d20/l5c 0 2023-12-06T15:00:28.782 INFO:tasks.workunit.client.0.smithi152.stdout:9/410: chown d0/f15 2080700 1 2023-12-06T15:00:28.783 INFO:tasks.workunit.client.0.smithi152.stdout:9/411: chown d0/d50 3 1 2023-12-06T15:00:28.784 INFO:tasks.workunit.client.1.smithi190.stdout:2/562: sync 2023-12-06T15:00:28.784 INFO:tasks.workunit.client.1.smithi190.stdout:2/563: write d10/d26/d5c/d37/d83/fa0 [130372,96718] 0 2023-12-06T15:00:28.784 INFO:tasks.workunit.client.1.smithi190.stdout:2/564: readlink d10/d26/d5c/d35/d77/l7a 0 2023-12-06T15:00:28.784 INFO:tasks.workunit.client.1.smithi190.stdout:2/565: write d10/d59/d5e/fb6 [1022016,35001] 0 2023-12-06T15:00:28.784 INFO:tasks.workunit.client.1.smithi190.stdout:2/566: truncate d10/f1f 2312902 0 2023-12-06T15:00:28.784 INFO:tasks.workunit.client.1.smithi190.stdout:2/567: readlink d10/d26/d5c/d35/d77/l7a 0 2023-12-06T15:00:28.786 INFO:tasks.workunit.client.1.smithi190.stdout:1/856: sync 2023-12-06T15:00:28.787 INFO:tasks.workunit.client.1.smithi190.stdout:3/715: sync 2023-12-06T15:00:28.787 INFO:tasks.workunit.client.1.smithi190.stdout:8/564: sync 2023-12-06T15:00:28.787 INFO:tasks.workunit.client.1.smithi190.stdout:2/568: read d10/d59/d5e/f47 [1008376,12515] 0 2023-12-06T15:00:28.787 INFO:tasks.workunit.client.1.smithi190.stdout:0/594: creat d0/da/d3e/d3a/d40/d6f/fbe x:0 0 0 2023-12-06T15:00:28.788 INFO:tasks.workunit.client.0.smithi152.stdout:8/281: dread d1/d6/d34/f1a [0,4194304] 0 2023-12-06T15:00:28.788 INFO:tasks.workunit.client.0.smithi152.stdout:8/282: truncate d1/d6/f37 166185 0 2023-12-06T15:00:28.788 INFO:tasks.workunit.client.0.smithi152.stdout:9/412: read d0/f23 [499755,93728] 0 2023-12-06T15:00:28.789 INFO:tasks.workunit.client.0.smithi152.stdout:0/434: rmdir d8/d4b/d81 0 2023-12-06T15:00:28.789 INFO:tasks.workunit.client.1.smithi190.stdout:0/595: read d0/da/f29 [1549257,9706] 0 2023-12-06T15:00:28.789 INFO:tasks.workunit.client.1.smithi190.stdout:1/857: link d6/d49/lfa d6/dc/d29/d38/d39/d63/de8/l115 0 2023-12-06T15:00:28.789 INFO:tasks.workunit.client.1.smithi190.stdout:4/552: dread d3/d35/d19/d30/d3c/f8d [0,4194304] 0 2023-12-06T15:00:28.789 INFO:tasks.workunit.client.1.smithi190.stdout:3/716: truncate d4/d70/d33/d45/f76 3203795 0 2023-12-06T15:00:28.790 INFO:tasks.workunit.client.1.smithi190.stdout:4/553: dread d3/d76/d7c/d96/f5f [0,4194304] 0 2023-12-06T15:00:28.791 INFO:tasks.workunit.client.1.smithi190.stdout:8/565: mkdir d1/d20/d3b/d31/d87/da1 0 2023-12-06T15:00:28.794 INFO:tasks.workunit.client.1.smithi190.stdout:2/569: mknod d10/d26/d5c/d49/d7e/cc1 0 2023-12-06T15:00:28.796 INFO:tasks.workunit.client.1.smithi190.stdout:0/596: write d0/da/d3e/d2b/d3c/f60 [979319,33773] 0 2023-12-06T15:00:28.797 INFO:tasks.workunit.client.1.smithi190.stdout:1/858: mkdir d6/dc/d29/ded/d116 0 2023-12-06T15:00:28.799 INFO:tasks.workunit.client.1.smithi190.stdout:3/717: rmdir d4/d1b/d77/da8 39 2023-12-06T15:00:28.799 INFO:tasks.workunit.client.1.smithi190.stdout:3/718: readlink d4/d1b/d54/d9c/d68/dfc/dc4/le5 0 2023-12-06T15:00:28.799 INFO:tasks.workunit.client.1.smithi190.stdout:3/719: chown d4/d1b/d54/d9c/d68/dfc/d56/d94/d3d/f43 480506756 1 2023-12-06T15:00:28.800 INFO:tasks.workunit.client.0.smithi152.stdout:2/316: creat d6/db/d17/f5e x:0 0 0 2023-12-06T15:00:28.800 INFO:tasks.workunit.client.1.smithi190.stdout:3/720: write d4/d70/d19/d3a/f7b [82506,124848] 0 2023-12-06T15:00:28.801 INFO:tasks.workunit.client.1.smithi190.stdout:3/721: write d4/d1b/d69/f6f [2785601,21913] 0 2023-12-06T15:00:28.801 INFO:tasks.workunit.client.1.smithi190.stdout:3/722: readlink d4/d1b/d77/lb3 0 2023-12-06T15:00:28.801 INFO:tasks.workunit.client.0.smithi152.stdout:5/395: creat d7/d43/f8e x:0 0 0 2023-12-06T15:00:28.801 INFO:tasks.workunit.client.0.smithi152.stdout:5/396: readlink d7/dd/d26/d48/l60 0 2023-12-06T15:00:28.802 INFO:tasks.workunit.client.0.smithi152.stdout:5/397: chown d7/dd/d26/d3b/d46/f76 401 1 2023-12-06T15:00:28.802 INFO:tasks.workunit.client.0.smithi152.stdout:5/398: truncate d7/d43/f4b 1398061 0 2023-12-06T15:00:28.802 INFO:tasks.workunit.client.1.smithi190.stdout:8/566: creat d1/d37/fa2 x:0 0 0 2023-12-06T15:00:28.803 INFO:tasks.workunit.client.1.smithi190.stdout:2/570: link d10/d26/d5c/d37/fa9 d10/d26/d5c/d49/d54/fc2 0 2023-12-06T15:00:28.803 INFO:tasks.workunit.client.1.smithi190.stdout:9/692: dwrite d4/d27/d2f/d31/f50 [0,4194304] 0 2023-12-06T15:00:28.804 INFO:tasks.workunit.client.1.smithi190.stdout:1/859: mknod d6/dc/d29/d38/d73/d5c/d10a/c117 0 2023-12-06T15:00:28.804 INFO:tasks.workunit.client.0.smithi152.stdout:2/317: creat d6/d18/d43/f5f x:0 0 0 2023-12-06T15:00:28.806 INFO:tasks.workunit.client.1.smithi190.stdout:1/860: write d6/dc/d29/d38/d43/f61 [2847304,72818] 0 2023-12-06T15:00:28.806 INFO:tasks.workunit.client.1.smithi190.stdout:1/861: write d6/dc/d29/d38/d73/d5c/db5/fce [5421688,36573] 0 2023-12-06T15:00:28.806 INFO:tasks.workunit.client.1.smithi190.stdout:1/862: stat d6/dc/d29/d38/d73/d5c/dd2 0 2023-12-06T15:00:28.808 INFO:tasks.workunit.client.1.smithi190.stdout:3/723: truncate d4/d1b/d5d/df1/f8e 899999 0 2023-12-06T15:00:28.808 INFO:tasks.workunit.client.1.smithi190.stdout:2/571: symlink d10/d26/d5c/d42/d9d/lc3 0 2023-12-06T15:00:28.808 INFO:tasks.workunit.client.1.smithi190.stdout:2/572: fdatasync d10/d26/d5c/d37/f69 0 2023-12-06T15:00:28.809 INFO:tasks.workunit.client.1.smithi190.stdout:9/693: rename d4/d27/f53 to d4/d27/d8a/dbc/fe7 0 2023-12-06T15:00:28.811 INFO:tasks.workunit.client.1.smithi190.stdout:9/694: rename d4/d27/d2f/d5c/fdc to d4/d84/fe8 0 2023-12-06T15:00:28.817 INFO:tasks.workunit.client.0.smithi152.stdout:5/399: write d7/d47/f74 [43094,38849] 0 2023-12-06T15:00:28.817 INFO:tasks.workunit.client.0.smithi152.stdout:5/400: chown d7/dd/d4e/f73 423139687 1 2023-12-06T15:00:28.820 INFO:tasks.workunit.client.1.smithi190.stdout:8/567: dread d1/f7 [0,4194304] 0 2023-12-06T15:00:28.821 INFO:tasks.workunit.client.1.smithi190.stdout:8/568: rmdir d1/d20/d3b/d4c/d8e/d94/d25 39 2023-12-06T15:00:28.821 INFO:tasks.workunit.client.1.smithi190.stdout:8/569: dread - d1/d20/d3b/d31/f9f zero size 2023-12-06T15:00:28.823 INFO:tasks.workunit.client.1.smithi190.stdout:8/570: rename d1/f41 to d1/d20/d3b/d34/d39/fa3 0 2023-12-06T15:00:28.823 INFO:tasks.workunit.client.1.smithi190.stdout:8/571: write d1/f35 [576608,21250] 0 2023-12-06T15:00:28.823 INFO:tasks.workunit.client.1.smithi190.stdout:8/572: chown d1/d20/d3b/d36/l65 11402 1 2023-12-06T15:00:28.832 INFO:tasks.workunit.client.0.smithi152.stdout:6/613: dwrite d1/dcf/ddc/d1a/d30/d36/d35/d61/fc9 [0,4194304] 0 2023-12-06T15:00:28.833 INFO:tasks.workunit.client.0.smithi152.stdout:0/435: dwrite d8/d15/d45/d73/d7a/f27 [0,4194304] 0 2023-12-06T15:00:28.833 INFO:tasks.workunit.client.0.smithi152.stdout:0/436: truncate d8/f3f 4210678 0 2023-12-06T15:00:28.835 INFO:tasks.workunit.client.0.smithi152.stdout:6/614: creat d1/d69/fe3 x:0 0 0 2023-12-06T15:00:28.836 INFO:tasks.workunit.client.1.smithi190.stdout:1/863: dwrite d6/dc/d29/d38/d39/f3f [0,4194304] 0 2023-12-06T15:00:28.836 INFO:tasks.workunit.client.1.smithi190.stdout:1/864: truncate d6/dc/d29/d38/d73/d5c/dd2/f102 792561 0 2023-12-06T15:00:28.837 INFO:tasks.workunit.client.0.smithi152.stdout:9/413: dwrite d0/d3f/d68/d6c/d20/d4a/d4d/f5e [0,4194304] 0 2023-12-06T15:00:28.837 INFO:tasks.workunit.client.0.smithi152.stdout:9/414: dread - d0/d3f/d68/d6c/d20/d38/f3d zero size 2023-12-06T15:00:28.837 INFO:tasks.workunit.client.0.smithi152.stdout:9/415: chown d0/d3f/d68/d6c/f17 1049 1 2023-12-06T15:00:28.840 INFO:tasks.workunit.client.1.smithi190.stdout:1/865: creat d6/dc/d29/d38/d43/d7f/da7/f118 x:0 0 0 2023-12-06T15:00:28.841 INFO:tasks.workunit.client.1.smithi190.stdout:7/683: dwrite d0/df/d53/d2f/f70 [0,4194304] 0 2023-12-06T15:00:28.842 INFO:tasks.workunit.client.1.smithi190.stdout:1/866: mknod d6/dc/c119 0 2023-12-06T15:00:28.843 INFO:tasks.workunit.client.0.smithi152.stdout:0/437: link d8/fd d8/d4b/f8a 0 2023-12-06T15:00:28.843 INFO:tasks.workunit.client.0.smithi152.stdout:6/615: creat d1/d69/da1/d87/fe4 x:0 0 0 2023-12-06T15:00:28.843 INFO:tasks.workunit.client.0.smithi152.stdout:6/616: stat d1/fbe 0 2023-12-06T15:00:28.846 INFO:tasks.workunit.client.1.smithi190.stdout:7/684: truncate d0/d5/f7f 731812 0 2023-12-06T15:00:28.850 INFO:tasks.workunit.client.0.smithi152.stdout:8/283: dwrite d1/d6/f30 [4194304,4194304] 0 2023-12-06T15:00:28.850 INFO:tasks.workunit.client.1.smithi190.stdout:1/867: creat d6/dc/d29/d38/d73/d5c/f11a x:0 0 0 2023-12-06T15:00:28.850 INFO:tasks.workunit.client.1.smithi190.stdout:7/685: getdents d0/d88/d7a/d7c/dab/dc0 0 2023-12-06T15:00:28.850 INFO:tasks.workunit.client.1.smithi190.stdout:7/686: chown d0/d88/d33/d4c 0 1 2023-12-06T15:00:28.852 INFO:tasks.workunit.client.1.smithi190.stdout:1/868: symlink d6/dc/d29/d38/d39/d63/d67/l11b 0 2023-12-06T15:00:28.852 INFO:tasks.workunit.client.1.smithi190.stdout:1/869: readlink d6/dc/d3b/l5e 0 2023-12-06T15:00:28.854 INFO:tasks.workunit.client.0.smithi152.stdout:4/583: dwrite d2/d10/d27/f71 [4194304,4194304] 0 2023-12-06T15:00:28.854 INFO:tasks.workunit.client.1.smithi190.stdout:7/687: symlink d0/d88/lde 0 2023-12-06T15:00:28.856 INFO:tasks.workunit.client.1.smithi190.stdout:1/870: symlink d6/dc/d29/d38/d39/d63/de8/l11c 0 2023-12-06T15:00:28.858 INFO:tasks.workunit.client.1.smithi190.stdout:1/871: rename d6/l103 to d6/dc/d3b/l11d 0 2023-12-06T15:00:28.859 INFO:tasks.workunit.client.0.smithi152.stdout:4/584: read d2/d15/d32/d79/f82 [2891069,120940] 0 2023-12-06T15:00:28.859 INFO:tasks.workunit.client.0.smithi152.stdout:8/284: dread d1/d6/d34/f1a [0,4194304] 0 2023-12-06T15:00:28.860 INFO:tasks.workunit.client.0.smithi152.stdout:8/285: rename d1 to d1/d6/d29/d50 22 2023-12-06T15:00:28.861 INFO:tasks.workunit.client.1.smithi190.stdout:1/872: creat d6/dc/d29/d38/d43/d7f/f11e x:0 0 0 2023-12-06T15:00:28.864 INFO:tasks.workunit.client.0.smithi152.stdout:8/286: creat d1/d6/d29/f51 x:0 0 0 2023-12-06T15:00:28.864 INFO:tasks.workunit.client.0.smithi152.stdout:8/287: stat d1/d6/d29/d3b 0 2023-12-06T15:00:28.864 INFO:tasks.workunit.client.0.smithi152.stdout:8/288: read - d1/d6/d34/d35/d38/f41 zero size 2023-12-06T15:00:28.867 INFO:tasks.workunit.client.0.smithi152.stdout:8/289: creat d1/d6/d34/d40/f52 x:0 0 0 2023-12-06T15:00:28.869 INFO:tasks.workunit.client.0.smithi152.stdout:8/290: unlink d1/d6/f37 0 2023-12-06T15:00:28.874 INFO:tasks.workunit.client.0.smithi152.stdout:8/291: dread d1/d6/d34/d36/f2b [0,4194304] 0 2023-12-06T15:00:28.874 INFO:tasks.workunit.client.1.smithi190.stdout:7/688: dread d0/d35/f84 [0,4194304] 0 2023-12-06T15:00:28.887 INFO:tasks.workunit.client.1.smithi190.stdout:7/689: dread d0/df/d53/f72 [0,4194304] 0 2023-12-06T15:00:28.887 INFO:tasks.workunit.client.1.smithi190.stdout:7/690: rmdir d0/df/d53/d99 39 2023-12-06T15:00:28.894 INFO:tasks.workunit.client.1.smithi190.stdout:3/724: dwrite d4/d1b/d54/d9c/d68/dfc/d56/d94/d3d/fbf [0,4194304] 0 2023-12-06T15:00:28.894 INFO:tasks.workunit.client.1.smithi190.stdout:3/725: write d4/d1b/d54/d9c/d68/fec [579898,14819] 0 2023-12-06T15:00:28.894 INFO:tasks.workunit.client.1.smithi190.stdout:3/726: rename d4 to d4/d1b/d77/da8/db7/dd2/dff 22 2023-12-06T15:00:28.896 INFO:tasks.workunit.client.1.smithi190.stdout:3/727: mknod d4/d70/d19/d3a/ddf/c100 0 2023-12-06T15:00:28.896 INFO:tasks.workunit.client.1.smithi190.stdout:3/728: dread - d4/d1b/d54/d9c/d68/d8a/fe4 zero size 2023-12-06T15:00:28.896 INFO:tasks.workunit.client.1.smithi190.stdout:3/729: truncate d4/d1b/d54/d9c/f99 956063 0 2023-12-06T15:00:28.896 INFO:tasks.workunit.client.1.smithi190.stdout:3/730: write d4/d1b/d54/d9c/d68/dfc/d56/d83/f87 [923666,27775] 0 2023-12-06T15:00:28.904 INFO:tasks.workunit.client.1.smithi190.stdout:3/731: dread d4/d1b/d5d/fc0 [0,4194304] 0 2023-12-06T15:00:28.904 INFO:tasks.workunit.client.1.smithi190.stdout:3/732: stat d4/d70/d33/fbe 0 2023-12-06T15:00:28.905 INFO:tasks.workunit.client.1.smithi190.stdout:3/733: unlink d4/d1b/d77/lb3 0 2023-12-06T15:00:28.906 INFO:tasks.workunit.client.1.smithi190.stdout:3/734: mknod d4/d70/d19/d3a/d3b/d72/c101 0 2023-12-06T15:00:28.906 INFO:tasks.workunit.client.1.smithi190.stdout:3/735: fsync d4/d70/d19/f57 0 2023-12-06T15:00:28.914 INFO:tasks.workunit.client.1.smithi190.stdout:7/691: dread d0/d5/f78 [0,4194304] 0 2023-12-06T15:00:28.914 INFO:tasks.workunit.client.1.smithi190.stdout:7/692: stat d0/df/d53/d15/fad 0 2023-12-06T15:00:28.915 INFO:tasks.workunit.client.1.smithi190.stdout:7/693: mkdir d0/d88/d7a/d7c/dab/ddf 0 2023-12-06T15:00:28.920 INFO:tasks.workunit.client.1.smithi190.stdout:9/695: dwrite d4/d84/f8f [0,4194304] 0 2023-12-06T15:00:28.920 INFO:tasks.workunit.client.1.smithi190.stdout:9/696: chown d4/d27/d2f/d31/d3f/d58/d72/db3/lbb 14603 1 2023-12-06T15:00:28.920 INFO:tasks.workunit.client.1.smithi190.stdout:9/697: readlink d4/l4a 0 2023-12-06T15:00:28.923 INFO:tasks.workunit.client.1.smithi190.stdout:4/554: dwrite d3/f40 [0,4194304] 0 2023-12-06T15:00:28.923 INFO:tasks.workunit.client.1.smithi190.stdout:4/555: fdatasync d3/d35/f46 0 2023-12-06T15:00:28.923 INFO:tasks.workunit.client.1.smithi190.stdout:1/873: dwrite d6/dc/ff9 [0,4194304] 0 2023-12-06T15:00:28.923 INFO:tasks.workunit.client.1.smithi190.stdout:1/874: dread - d6/dc/d29/d38/d43/f10b zero size 2023-12-06T15:00:28.923 INFO:tasks.workunit.client.0.smithi152.stdout:6/617: dwrite d1/d69/da1/d87/d15/f8e [0,4194304] 0 2023-12-06T15:00:28.924 INFO:tasks.workunit.client.0.smithi152.stdout:5/401: dwrite d7/d43/f8e [0,4194304] 0 2023-12-06T15:00:28.924 INFO:tasks.workunit.client.0.smithi152.stdout:5/402: fsync d7/dd/d26/d3a/f4f 0 2023-12-06T15:00:28.924 INFO:tasks.workunit.client.0.smithi152.stdout:9/416: dwrite d0/d3f/d68/d6c/d20/f26 [0,4194304] 0 2023-12-06T15:00:28.924 INFO:tasks.workunit.client.0.smithi152.stdout:4/585: dwrite d2/d15/d23/f41 [0,4194304] 0 2023-12-06T15:00:28.924 INFO:tasks.workunit.client.0.smithi152.stdout:9/417: write d0/d3f/d68/d6c/d20/d38/f57 [655712,81706] 0 2023-12-06T15:00:28.924 INFO:tasks.workunit.client.1.smithi190.stdout:7/694: dread d0/d88/d32/f59 [0,4194304] 0 2023-12-06T15:00:28.924 INFO:tasks.workunit.client.0.smithi152.stdout:8/292: dwrite d1/d6/d34/d35/d38/f41 [0,4194304] 0 2023-12-06T15:00:28.925 INFO:tasks.workunit.client.1.smithi190.stdout:8/573: dread d1/f35 [0,4194304] 0 2023-12-06T15:00:28.926 INFO:tasks.workunit.client.1.smithi190.stdout:9/698: dread f1 [0,4194304] 0 2023-12-06T15:00:28.926 INFO:tasks.workunit.client.1.smithi190.stdout:8/574: read d1/d37/f85 [604581,18936] 0 2023-12-06T15:00:28.928 INFO:tasks.workunit.client.1.smithi190.stdout:4/556: creat d3/d76/fb2 x:0 0 0 2023-12-06T15:00:28.930 INFO:tasks.workunit.client.0.smithi152.stdout:5/403: getdents d7/dd/d26/d3b/d46 0 2023-12-06T15:00:28.931 INFO:tasks.workunit.client.0.smithi152.stdout:6/618: dread d1/d69/da1/d87/d15/f8e [0,4194304] 0 2023-12-06T15:00:28.933 INFO:tasks.workunit.client.0.smithi152.stdout:4/586: rename d2/d15/d23/f41 to d2/d22/fb6 0 2023-12-06T15:00:28.933 INFO:tasks.workunit.client.0.smithi152.stdout:4/587: write d2/d15/f99 [545263,104869] 0 2023-12-06T15:00:28.933 INFO:tasks.workunit.client.0.smithi152.stdout:4/588: read - d2/d10/fa5 zero size 2023-12-06T15:00:28.933 INFO:tasks.workunit.client.0.smithi152.stdout:4/589: truncate d2/d15/f99 1054003 0 2023-12-06T15:00:28.934 INFO:tasks.workunit.client.0.smithi152.stdout:4/590: write d2/d22/f59 [392110,114645] 0 2023-12-06T15:00:28.934 INFO:tasks.workunit.client.0.smithi152.stdout:9/418: mknod d0/d3f/d68/d6c/d20/d4a/d71/c75 0 2023-12-06T15:00:28.934 INFO:tasks.workunit.client.0.smithi152.stdout:9/419: chown d0/d3f/d68/d6c/d20/d4a/d4d 9 1 2023-12-06T15:00:28.934 INFO:tasks.workunit.client.0.smithi152.stdout:9/420: write d0/d3f/d68/d6c/d20/d38/f67 [360508,104076] 0 2023-12-06T15:00:28.934 INFO:tasks.workunit.client.0.smithi152.stdout:9/421: write d0/d3f/d68/d6c/d20/d38/d45/f37 [1349580,8427] 0 2023-12-06T15:00:28.934 INFO:tasks.workunit.client.0.smithi152.stdout:4/591: write d2/d22/fb6 [2590803,94806] 0 2023-12-06T15:00:28.935 INFO:tasks.workunit.client.0.smithi152.stdout:4/592: read d2/d15/d23/d75/f98 [94494,62794] 0 2023-12-06T15:00:28.935 INFO:tasks.workunit.client.0.smithi152.stdout:4/593: write d2/d15/d32/d91/fb2 [847297,32718] 0 2023-12-06T15:00:28.935 INFO:tasks.workunit.client.0.smithi152.stdout:4/594: chown d2/d45/d84/da4 42 1 2023-12-06T15:00:28.936 INFO:tasks.workunit.client.0.smithi152.stdout:4/595: write d2/d10/fa5 [411887,40625] 0 2023-12-06T15:00:28.937 INFO:tasks.workunit.client.0.smithi152.stdout:4/596: fdatasync d2/d15/d32/d91/fb2 0 2023-12-06T15:00:28.939 INFO:tasks.workunit.client.0.smithi152.stdout:5/404: dread d7/f1e [0,4194304] 0 2023-12-06T15:00:28.940 INFO:tasks.workunit.client.1.smithi190.stdout:1/875: link d6/dc/d29/d38/d73/f4e d6/dc/d29/d38/d73/d5c/dd2/f11f 0 2023-12-06T15:00:28.941 INFO:tasks.workunit.client.0.smithi152.stdout:6/619: rename d1/dcf/ddc/d1a/d30/d36/d4e/l5a to d1/dcf/ddc/d1a/d30/d36/d35/d49/da6/da9/le5 0 2023-12-06T15:00:28.942 INFO:tasks.workunit.client.1.smithi190.stdout:7/695: getdents d0/d88/d33 0 2023-12-06T15:00:28.942 INFO:tasks.workunit.client.1.smithi190.stdout:7/696: write d0/d5/d63/fc4 [170446,13874] 0 2023-12-06T15:00:28.943 INFO:tasks.workunit.client.1.smithi190.stdout:8/575: rename d1/d20/d3b/d4c/d8e/d94/d25/c2f to d1/d20/d3b/d4c/ca4 0 2023-12-06T15:00:28.943 INFO:tasks.workunit.client.0.smithi152.stdout:3/381: sync 2023-12-06T15:00:28.944 INFO:tasks.workunit.client.1.smithi190.stdout:9/699: creat d4/d27/d2f/d31/d3f/d58/fe9 x:0 0 0 2023-12-06T15:00:28.945 INFO:tasks.workunit.client.0.smithi152.stdout:8/293: mknod d1/d6/d34/c53 0 2023-12-06T15:00:28.945 INFO:tasks.workunit.client.0.smithi152.stdout:9/422: dread d0/d3f/d68/d6c/d20/f21 [4194304,4194304] 0 2023-12-06T15:00:28.945 INFO:tasks.workunit.client.0.smithi152.stdout:9/423: stat d0/d3f/f53 0 2023-12-06T15:00:28.945 INFO:tasks.workunit.client.1.smithi190.stdout:4/557: creat d3/d76/d8b/fb3 x:0 0 0 2023-12-06T15:00:28.946 INFO:tasks.workunit.client.0.smithi152.stdout:4/597: creat d2/d22/d6e/fb7 x:0 0 0 2023-12-06T15:00:28.946 INFO:tasks.workunit.client.0.smithi152.stdout:4/598: write d2/d15/d32/f66 [8847656,93120] 0 2023-12-06T15:00:28.946 INFO:tasks.workunit.client.0.smithi152.stdout:4/599: truncate d2/d15/d32/d69/f93 1365738 0 2023-12-06T15:00:28.947 INFO:tasks.workunit.client.0.smithi152.stdout:5/405: symlink d7/dd/d26/d3b/d46/l8f 0 2023-12-06T15:00:28.947 INFO:tasks.workunit.client.0.smithi152.stdout:8/294: creat d1/d6/d34/d35/d38/f54 x:0 0 0 2023-12-06T15:00:28.949 INFO:tasks.workunit.client.1.smithi190.stdout:7/697: link d0/d88/d7a/fbe d0/d5/dba/fe0 0 2023-12-06T15:00:28.949 INFO:tasks.workunit.client.0.smithi152.stdout:6/620: dread d1/dcf/ddc/d1a/f31 [4194304,4194304] 0 2023-12-06T15:00:28.950 INFO:tasks.workunit.client.0.smithi152.stdout:9/424: mknod d0/d3f/d68/d6c/d20/d38/d45/c76 0 2023-12-06T15:00:28.950 INFO:tasks.workunit.client.0.smithi152.stdout:9/425: write d0/f34 [246520,74050] 0 2023-12-06T15:00:28.951 INFO:tasks.workunit.client.0.smithi152.stdout:4/600: creat d2/d15/d23/d42/fb8 x:0 0 0 2023-12-06T15:00:28.952 INFO:tasks.workunit.client.1.smithi190.stdout:8/576: mkdir d1/d20/d3b/d4c/d8e/da5 0 2023-12-06T15:00:28.953 INFO:tasks.workunit.client.0.smithi152.stdout:9/426: creat d0/d3f/d68/d6c/d20/d38/d44/f77 x:0 0 0 2023-12-06T15:00:28.955 INFO:tasks.workunit.client.0.smithi152.stdout:4/601: getdents d2/d89 0 2023-12-06T15:00:28.956 INFO:tasks.workunit.client.0.smithi152.stdout:9/427: creat d0/d3f/f78 x:0 0 0 2023-12-06T15:00:28.956 INFO:tasks.workunit.client.0.smithi152.stdout:9/428: chown d0/d3f/d68/d6c/d20/d4a 3 1 2023-12-06T15:00:28.956 INFO:tasks.workunit.client.0.smithi152.stdout:9/429: dread - d0/d3f/d68/d6c/d20/d38/d45/d43/f52 zero size 2023-12-06T15:00:28.956 INFO:tasks.workunit.client.1.smithi190.stdout:9/700: rename d4/d27/d2f/d31/da6 to d4/d27/d2f/d31/d3f/d58/d72/db3/dea 0 2023-12-06T15:00:28.957 INFO:tasks.workunit.client.1.smithi190.stdout:9/701: write d4/d27/d2f/d31/fba [402664,33480] 0 2023-12-06T15:00:28.957 INFO:tasks.workunit.client.1.smithi190.stdout:9/702: readlink d4/l5a 0 2023-12-06T15:00:28.957 INFO:tasks.workunit.client.1.smithi190.stdout:9/703: chown d4/f24 22355775 1 2023-12-06T15:00:28.958 INFO:tasks.workunit.client.0.smithi152.stdout:9/430: stat d0/d3f/d68/d6c/d20/d38/l47 0 2023-12-06T15:00:28.959 INFO:tasks.workunit.client.1.smithi190.stdout:4/558: mknod d3/d35/d19/d41/d44/d9c/d72/cb4 0 2023-12-06T15:00:28.959 INFO:tasks.workunit.client.1.smithi190.stdout:4/559: dread - d3/d35/d19/d30/d3c/d4d/fa0 zero size 2023-12-06T15:00:28.959 INFO:tasks.workunit.client.1.smithi190.stdout:7/698: getdents d0/d88/d7a/dc9 0 2023-12-06T15:00:28.961 INFO:tasks.workunit.client.1.smithi190.stdout:1/876: dwrite d6/dc/d29/d38/d43/d7f/da7/ffd [0,4194304] 0 2023-12-06T15:00:28.961 INFO:tasks.workunit.client.1.smithi190.stdout:1/877: chown d6/dc/d29/d38/d73/d5c/c6b 387538059 1 2023-12-06T15:00:28.961 INFO:tasks.workunit.client.1.smithi190.stdout:1/878: write d6/dc/d6f/fff [48215,42835] 0 2023-12-06T15:00:28.961 INFO:tasks.workunit.client.1.smithi190.stdout:1/879: write d6/dc/d29/d38/d73/f41 [5037289,121127] 0 2023-12-06T15:00:28.961 INFO:tasks.workunit.client.1.smithi190.stdout:9/704: unlink d4/d27/d2f/d31/d3f/d58/d72/d7a/f7f 0 2023-12-06T15:00:28.962 INFO:tasks.workunit.client.1.smithi190.stdout:4/560: mkdir d3/d35/d19/d67/db5 0 2023-12-06T15:00:28.962 INFO:tasks.workunit.client.1.smithi190.stdout:4/561: write d3/d76/d7c/d96/d39/f25 [1221142,81522] 0 2023-12-06T15:00:28.963 INFO:tasks.workunit.client.1.smithi190.stdout:4/562: stat d3/d76/f88 0 2023-12-06T15:00:28.963 INFO:tasks.workunit.client.0.smithi152.stdout:9/431: rmdir d0/d3f/d68/d6c/d20/d4a/d4d 39 2023-12-06T15:00:28.965 INFO:tasks.workunit.client.1.smithi190.stdout:7/699: symlink d0/df/le1 0 2023-12-06T15:00:28.967 INFO:tasks.workunit.client.1.smithi190.stdout:9/705: write d4/fa [2358482,48195] 0 2023-12-06T15:00:28.968 INFO:tasks.workunit.client.1.smithi190.stdout:1/880: link d6/dc/l66 d6/dc/d29/d38/d43/db7/l120 0 2023-12-06T15:00:28.968 INFO:tasks.workunit.client.1.smithi190.stdout:1/881: chown d6/c77 1 1 2023-12-06T15:00:28.968 INFO:tasks.workunit.client.1.smithi190.stdout:1/882: write d6/dc/d29/d38/d73/d76/fc3 [1228715,46379] 0 2023-12-06T15:00:28.974 INFO:tasks.workunit.client.1.smithi190.stdout:4/563: rename d3/d35/d19/d30/d3c/d4d/fa0 to d3/d35/da5/fb6 0 2023-12-06T15:00:28.976 INFO:tasks.workunit.client.1.smithi190.stdout:7/700: getdents d0/df/d53/d15 0 2023-12-06T15:00:28.978 INFO:tasks.workunit.client.1.smithi190.stdout:7/701: rmdir d0/d88/d7a/d7c/dab/dc0 39 2023-12-06T15:00:28.978 INFO:tasks.workunit.client.1.smithi190.stdout:7/702: stat d0/d5/da/d56 0 2023-12-06T15:00:28.978 INFO:tasks.workunit.client.1.smithi190.stdout:9/706: dread d4/d27/d8a/dbc/fd2 [0,4194304] 0 2023-12-06T15:00:28.978 INFO:tasks.workunit.client.0.smithi152.stdout:4/602: dread d2/d10/f37 [0,4194304] 0 2023-12-06T15:00:28.979 INFO:tasks.workunit.client.1.smithi190.stdout:1/883: symlink d6/d49/d74/l121 0 2023-12-06T15:00:28.980 INFO:tasks.workunit.client.1.smithi190.stdout:4/564: dread d3/fd [4194304,4194304] 0 2023-12-06T15:00:28.980 INFO:tasks.workunit.client.1.smithi190.stdout:1/884: mkdir d6/dc/d29/d38/d43/db7/de2/d122 0 2023-12-06T15:00:28.980 INFO:tasks.workunit.client.1.smithi190.stdout:1/885: truncate d6/dc/d29/d38/d43/db7/fe5 614696 0 2023-12-06T15:00:28.981 INFO:tasks.workunit.client.0.smithi152.stdout:4/603: rename d2/d22/d6e/ca7 to d2/d15/d23/d75/cb9 0 2023-12-06T15:00:28.981 INFO:tasks.workunit.client.0.smithi152.stdout:4/604: truncate d2/d15/d32/d69/f93 1598491 0 2023-12-06T15:00:28.982 INFO:tasks.workunit.client.0.smithi152.stdout:4/605: mkdir d2/d15/d23/d42/dba 0 2023-12-06T15:00:28.982 INFO:tasks.workunit.client.1.smithi190.stdout:4/565: truncate d3/f14 1233821 0 2023-12-06T15:00:28.983 INFO:tasks.workunit.client.1.smithi190.stdout:7/703: write d0/d88/f57 [660421,68642] 0 2023-12-06T15:00:28.983 INFO:tasks.workunit.client.1.smithi190.stdout:4/566: chown d3/d35/d19 0 1 2023-12-06T15:00:28.983 INFO:tasks.workunit.client.1.smithi190.stdout:4/567: stat d3/f6d 0 2023-12-06T15:00:28.983 INFO:tasks.workunit.client.1.smithi190.stdout:7/704: readlink d0/d88/d7a/dc9/ld3 0 2023-12-06T15:00:28.984 INFO:tasks.workunit.client.1.smithi190.stdout:9/707: write d4/d27/d8a/f95 [2149596,41073] 0 2023-12-06T15:00:28.985 INFO:tasks.workunit.client.0.smithi152.stdout:9/432: write d0/f36 [1882008,62720] 0 2023-12-06T15:00:28.985 INFO:tasks.workunit.client.1.smithi190.stdout:4/568: mknod d3/d4e/cb7 0 2023-12-06T15:00:28.986 INFO:tasks.workunit.client.1.smithi190.stdout:7/705: symlink d0/df/d53/d2f/le2 0 2023-12-06T15:00:28.988 INFO:tasks.workunit.client.1.smithi190.stdout:4/569: creat d3/fb8 x:0 0 0 2023-12-06T15:00:28.990 INFO:tasks.workunit.client.0.smithi152.stdout:6/621: dwrite d1/dcf/ddc/f71 [0,4194304] 0 2023-12-06T15:00:28.990 INFO:tasks.workunit.client.0.smithi152.stdout:3/382: dwrite d9/d18/d51/f6c [0,4194304] 0 2023-12-06T15:00:28.991 INFO:tasks.workunit.client.0.smithi152.stdout:3/383: write d9/d10/d12/d43/f6d [896846,129824] 0 2023-12-06T15:00:28.991 INFO:tasks.workunit.client.0.smithi152.stdout:6/622: read d1/fbe [130154,27550] 0 2023-12-06T15:00:28.991 INFO:tasks.workunit.client.0.smithi152.stdout:6/623: chown d1/dcf/ddc/d1a/d30/f59 1 1 2023-12-06T15:00:28.993 INFO:tasks.workunit.client.1.smithi190.stdout:5/488: sync 2023-12-06T15:00:28.993 INFO:tasks.workunit.client.1.smithi190.stdout:6/698: sync 2023-12-06T15:00:28.993 INFO:tasks.workunit.client.1.smithi190.stdout:5/489: truncate d0/d6c/fa1 579341 0 2023-12-06T15:00:28.993 INFO:tasks.workunit.client.1.smithi190.stdout:5/490: chown d0/d1c/d2b/d2c/c5b 0 1 2023-12-06T15:00:28.993 INFO:tasks.workunit.client.1.smithi190.stdout:4/570: dread d3/d35/d19/f59 [0,4194304] 0 2023-12-06T15:00:28.994 INFO:tasks.workunit.client.1.smithi190.stdout:4/571: stat d3/d76/d7c/d96/d15/f23 0 2023-12-06T15:00:28.995 INFO:tasks.workunit.client.1.smithi190.stdout:6/699: rmdir d4/d12/d1a/d8a/da3 39 2023-12-06T15:00:28.995 INFO:tasks.workunit.client.1.smithi190.stdout:6/700: write d4/d12/d40/d43/d45/d4a/d77/dca/f98 [495102,25174] 0 2023-12-06T15:00:28.998 INFO:tasks.workunit.client.0.smithi152.stdout:3/384: creat d9/d10/d12/f72 x:0 0 0 2023-12-06T15:00:29.002 INFO:tasks.workunit.client.0.smithi152.stdout:5/406: dwrite d7/d47/f78 [0,4194304] 0 2023-12-06T15:00:29.002 INFO:tasks.workunit.client.0.smithi152.stdout:3/385: mknod d9/d18/d1a/c73 0 2023-12-06T15:00:29.002 INFO:tasks.workunit.client.0.smithi152.stdout:3/386: stat d9/d10/f28 0 2023-12-06T15:00:29.002 INFO:tasks.workunit.client.1.smithi190.stdout:5/491: mkdir d0/d1c/d85/da6 0 2023-12-06T15:00:29.005 INFO:tasks.workunit.client.0.smithi152.stdout:9/433: dread d0/d3f/d68/d6c/d20/d38/f46 [0,4194304] 0 2023-12-06T15:00:29.005 INFO:tasks.workunit.client.1.smithi190.stdout:5/492: mkdir d0/d6c/da7 0 2023-12-06T15:00:29.007 INFO:tasks.workunit.client.0.smithi152.stdout:5/407: rename d7/dd/d26/f44 to d7/d43/d6c/f90 0 2023-12-06T15:00:29.009 INFO:tasks.workunit.client.0.smithi152.stdout:9/434: creat d0/d50/f79 x:0 0 0 2023-12-06T15:00:29.009 INFO:tasks.workunit.client.0.smithi152.stdout:9/435: fsync d0/d3f/d68/d6c/d20/d38/d45/f64 0 2023-12-06T15:00:29.014 INFO:tasks.workunit.client.0.smithi152.stdout:3/387: dread d9/d10/d19/f33 [0,4194304] 0 2023-12-06T15:00:29.019 INFO:tasks.workunit.client.1.smithi190.stdout:7/706: dread d0/d88/d32/f59 [0,4194304] 0 2023-12-06T15:00:29.020 INFO:tasks.workunit.client.1.smithi190.stdout:8/577: dwrite d1/d20/d3b/d4c/d8e/d94/d1c/f4e [0,4194304] 0 2023-12-06T15:00:29.021 INFO:tasks.workunit.client.1.smithi190.stdout:5/493: dread d0/d1c/d2b/d2c/f49 [0,4194304] 0 2023-12-06T15:00:29.021 INFO:tasks.workunit.client.1.smithi190.stdout:7/707: creat d0/d88/d7a/d7c/dab/dc0/dd1/fe3 x:0 0 0 2023-12-06T15:00:29.024 INFO:tasks.workunit.client.1.smithi190.stdout:5/494: rename d0/d1c/d2b/d2c/d5d/l5e to d0/d1c/d94/la8 0 2023-12-06T15:00:29.026 INFO:tasks.workunit.client.1.smithi190.stdout:8/578: mknod d1/d20/d3b/d4c/d8e/d94/ca6 0 2023-12-06T15:00:29.027 INFO:tasks.workunit.client.0.smithi152.stdout:8/295: dwrite d1/d6/d34/d36/f11 [4194304,4194304] 0 2023-12-06T15:00:29.027 INFO:tasks.workunit.client.0.smithi152.stdout:8/296: truncate d1/d6/f31 492288 0 2023-12-06T15:00:29.028 INFO:tasks.workunit.client.1.smithi190.stdout:5/495: dread d0/df/d50/fa4 [0,4194304] 0 2023-12-06T15:00:29.028 INFO:tasks.workunit.client.1.smithi190.stdout:5/496: readlink d0/d1c/d85/d90/la5 0 2023-12-06T15:00:29.028 INFO:tasks.workunit.client.1.smithi190.stdout:8/579: creat d1/d20/d3b/d4c/d8e/da5/fa7 x:0 0 0 2023-12-06T15:00:29.030 INFO:tasks.workunit.client.0.smithi152.stdout:8/297: rmdir d1/d6 39 2023-12-06T15:00:29.031 INFO:tasks.workunit.client.1.smithi190.stdout:5/497: truncate d0/d1c/d3e/f51 833510 0 2023-12-06T15:00:29.031 INFO:tasks.workunit.client.1.smithi190.stdout:5/498: readlink d0/d1c/d3e/d7e/l8d 0 2023-12-06T15:00:29.032 INFO:tasks.workunit.client.1.smithi190.stdout:5/499: chown d0/df/d50/f86 192417407 1 2023-12-06T15:00:29.033 INFO:tasks.workunit.client.1.smithi190.stdout:8/580: getdents d1/d20/d3b/d4c/d8e/d94/d25 0 2023-12-06T15:00:29.033 INFO:tasks.workunit.client.1.smithi190.stdout:8/581: fsync d1/d37/fa2 0 2023-12-06T15:00:29.033 INFO:tasks.workunit.client.1.smithi190.stdout:8/582: write d1/d20/d3b/f30 [1042939,129793] 0 2023-12-06T15:00:29.035 INFO:tasks.workunit.client.1.smithi190.stdout:5/500: symlink d0/df/d50/la9 0 2023-12-06T15:00:29.035 INFO:tasks.workunit.client.1.smithi190.stdout:5/501: fsync d0/df/f17 0 2023-12-06T15:00:29.035 INFO:tasks.workunit.client.0.smithi152.stdout:4/606: read d2/d22/f59 [1307488,113708] 0 2023-12-06T15:00:29.036 INFO:tasks.workunit.client.1.smithi190.stdout:8/583: creat d1/d20/d3b/d7e/fa8 x:0 0 0 2023-12-06T15:00:29.036 INFO:tasks.workunit.client.0.smithi152.stdout:8/298: creat d1/d6/d34/d36/f55 x:0 0 0 2023-12-06T15:00:29.037 INFO:tasks.workunit.client.0.smithi152.stdout:4/607: mkdir d2/d10/dbb 0 2023-12-06T15:00:29.038 INFO:tasks.workunit.client.0.smithi152.stdout:4/608: readlink d2/d15/l34 0 2023-12-06T15:00:29.038 INFO:tasks.workunit.client.1.smithi190.stdout:5/502: mknod d0/d1c/d85/caa 0 2023-12-06T15:00:29.038 INFO:tasks.workunit.client.1.smithi190.stdout:5/503: dread - d0/f2a zero size 2023-12-06T15:00:29.038 INFO:tasks.workunit.client.1.smithi190.stdout:5/504: chown d0/d1c/d3e/f51 2 1 2023-12-06T15:00:29.039 INFO:tasks.workunit.client.1.smithi190.stdout:8/584: mknod d1/d20/d3b/d4c/d8e/da5/ca9 0 2023-12-06T15:00:29.040 INFO:tasks.workunit.client.0.smithi152.stdout:8/299: rename d1/l1d to d1/d6/d34/d36/l56 0 2023-12-06T15:00:29.040 INFO:tasks.workunit.client.0.smithi152.stdout:8/300: chown d1/d6/d34/d35/d38/c39 88 1 2023-12-06T15:00:29.044 INFO:tasks.workunit.client.0.smithi152.stdout:8/301: creat d1/d6/d34/f57 x:0 0 0 2023-12-06T15:00:29.045 INFO:tasks.workunit.client.1.smithi190.stdout:5/505: link d0/df/d50/f87 d0/d1c/d2b/d2c/d5d/d73/fab 0 2023-12-06T15:00:29.045 INFO:tasks.workunit.client.1.smithi190.stdout:5/506: chown d0/df/d50 46 1 2023-12-06T15:00:29.046 INFO:tasks.workunit.client.0.smithi152.stdout:8/302: mkdir d1/d6/d34/d36/d58 0 2023-12-06T15:00:29.047 INFO:tasks.workunit.client.1.smithi190.stdout:5/507: creat d0/d1c/d2b/d69/fac x:0 0 0 2023-12-06T15:00:29.047 INFO:tasks.workunit.client.1.smithi190.stdout:5/508: fsync d0/d1c/d85/d90/f97 0 2023-12-06T15:00:29.049 INFO:tasks.workunit.client.0.smithi152.stdout:8/303: link d1/d6/d29/c44 d1/d6/d34/d36/d58/c59 0 2023-12-06T15:00:29.049 INFO:tasks.workunit.client.1.smithi190.stdout:5/509: creat d0/df/d50/fad x:0 0 0 2023-12-06T15:00:29.050 INFO:tasks.workunit.client.1.smithi190.stdout:5/510: rename d0/d1c/d2b/l61 to d0/d1c/d3e/d7e/lae 0 2023-12-06T15:00:29.051 INFO:tasks.workunit.client.1.smithi190.stdout:1/886: dwrite d6/f12 [0,4194304] 0 2023-12-06T15:00:29.051 INFO:tasks.workunit.client.1.smithi190.stdout:4/572: dwrite d3/f78 [0,4194304] 0 2023-12-06T15:00:29.051 INFO:tasks.workunit.client.1.smithi190.stdout:4/573: stat d3/d4e/f93 0 2023-12-06T15:00:29.051 INFO:tasks.workunit.client.1.smithi190.stdout:6/701: dwrite d4/d12/d40/d43/d45/d4a/d77/dca/f89 [0,4194304] 0 2023-12-06T15:00:29.052 INFO:tasks.workunit.client.1.smithi190.stdout:6/702: chown d4/d12/d1a/d70 31623 1 2023-12-06T15:00:29.052 INFO:tasks.workunit.client.1.smithi190.stdout:6/703: chown d4/d12/d1a/d70/la1 1 1 2023-12-06T15:00:29.052 INFO:tasks.workunit.client.1.smithi190.stdout:6/704: read - d4/d12/d40/d43/d45/f88 zero size 2023-12-06T15:00:29.054 INFO:tasks.workunit.client.0.smithi152.stdout:8/304: symlink d1/d6/d34/l5a 0 2023-12-06T15:00:29.054 INFO:tasks.workunit.client.0.smithi152.stdout:8/305: mkdir d1/d6/d29/d5b 0 2023-12-06T15:00:29.054 INFO:tasks.workunit.client.0.smithi152.stdout:8/306: write d1/d6/d34/d35/d38/f54 [785851,40701] 0 2023-12-06T15:00:29.054 INFO:tasks.workunit.client.0.smithi152.stdout:5/408: dwrite d7/dd/f2a [0,4194304] 0 2023-12-06T15:00:29.054 INFO:tasks.workunit.client.0.smithi152.stdout:5/409: fdatasync d7/dd/d26/d48/f86 0 2023-12-06T15:00:29.054 INFO:tasks.workunit.client.0.smithi152.stdout:3/388: dwrite d9/f1d [0,4194304] 0 2023-12-06T15:00:29.054 INFO:tasks.workunit.client.0.smithi152.stdout:3/389: fdatasync f2 0 2023-12-06T15:00:29.054 INFO:tasks.workunit.client.0.smithi152.stdout:3/390: fsync d9/ff 0 2023-12-06T15:00:29.055 INFO:tasks.workunit.client.0.smithi152.stdout:6/624: dwrite d1/dcf/ddc/d1a/d30/d36/d35/d63/f65 [0,4194304] 0 2023-12-06T15:00:29.055 INFO:tasks.workunit.client.0.smithi152.stdout:8/307: link d1/d6/f1b d1/d6/d29/d3b/f5c 0 2023-12-06T15:00:29.055 INFO:tasks.workunit.client.1.smithi190.stdout:9/708: dwrite d4/f2e [0,4194304] 0 2023-12-06T15:00:29.056 INFO:tasks.workunit.client.1.smithi190.stdout:1/887: mkdir d6/dc/d29/d38/d43/db7/de2/d123 0 2023-12-06T15:00:29.057 INFO:tasks.workunit.client.0.smithi152.stdout:3/391: mknod d9/d10/d12/d43/d52/c74 0 2023-12-06T15:00:29.058 INFO:tasks.workunit.client.1.smithi190.stdout:4/574: mkdir d3/d76/d7c/db9 0 2023-12-06T15:00:29.058 INFO:tasks.workunit.client.1.smithi190.stdout:4/575: readlink d3/d35/d19/d41/l52 0 2023-12-06T15:00:29.059 INFO:tasks.workunit.client.0.smithi152.stdout:4/609: dwrite d2/d10/f37 [0,4194304] 0 2023-12-06T15:00:29.061 INFO:tasks.workunit.client.1.smithi190.stdout:7/708: dwrite d0/d88/d32/f59 [0,4194304] 0 2023-12-06T15:00:29.061 INFO:tasks.workunit.client.1.smithi190.stdout:9/709: write d4/d27/d2f/d31/d3f/d58/d72/db3/dea/dcd/fe3 [838844,117170] 0 2023-12-06T15:00:29.061 INFO:tasks.workunit.client.1.smithi190.stdout:9/710: stat d4/d27/c81 0 2023-12-06T15:00:29.061 INFO:tasks.workunit.client.1.smithi190.stdout:9/711: chown d4/d27/d2f/d66/lcf 1842 1 2023-12-06T15:00:29.064 INFO:tasks.workunit.client.1.smithi190.stdout:4/576: dread d3/d35/d19/f68 [0,4194304] 0 2023-12-06T15:00:29.064 INFO:tasks.workunit.client.1.smithi190.stdout:4/577: chown d3/d35/d19/f79 218784264 1 2023-12-06T15:00:29.066 INFO:tasks.workunit.client.0.smithi152.stdout:6/625: truncate d1/dcf/ddc/d1a/d30/d36/d35/d61/fc9 2386693 0 2023-12-06T15:00:29.066 INFO:tasks.workunit.client.0.smithi152.stdout:6/626: stat d1/d69/da1/d87/l1e 0 2023-12-06T15:00:29.066 INFO:tasks.workunit.client.0.smithi152.stdout:8/308: creat d1/d6/d34/d36/f5d x:0 0 0 2023-12-06T15:00:29.069 INFO:tasks.workunit.client.0.smithi152.stdout:3/392: mknod d9/d10/d19/c75 0 2023-12-06T15:00:29.071 INFO:tasks.workunit.client.1.smithi190.stdout:7/709: dread d0/df/d53/f3c [0,4194304] 0 2023-12-06T15:00:29.072 INFO:tasks.workunit.client.0.smithi152.stdout:4/610: rename d2/d15/d23 to d2/d89/d9e/dbc 0 2023-12-06T15:00:29.073 INFO:tasks.workunit.client.0.smithi152.stdout:6/627: mkdir d1/dcf/ddc/d1a/d30/da4/de6 0 2023-12-06T15:00:29.076 INFO:tasks.workunit.client.0.smithi152.stdout:3/393: mkdir d9/d18/d1a/d65/d76 0 2023-12-06T15:00:29.076 INFO:tasks.workunit.client.0.smithi152.stdout:3/394: readlink d9/d18/d39/l59 0 2023-12-06T15:00:29.077 INFO:tasks.workunit.client.0.smithi152.stdout:3/395: chown d9/d10/d19/f2c 5994 1 2023-12-06T15:00:29.077 INFO:tasks.workunit.client.1.smithi190.stdout:1/888: truncate d6/f90 4000790 0 2023-12-06T15:00:29.077 INFO:tasks.workunit.client.1.smithi190.stdout:1/889: chown d6/dc/d29 0 1 2023-12-06T15:00:29.078 INFO:tasks.workunit.client.0.smithi152.stdout:6/628: creat d1/dcf/ddc/d1a/d30/da4/fe7 x:0 0 0 2023-12-06T15:00:29.079 INFO:tasks.workunit.client.0.smithi152.stdout:5/410: truncate d7/f24 1255696 0 2023-12-06T15:00:29.079 INFO:tasks.workunit.client.1.smithi190.stdout:9/712: symlink d4/d27/d2f/d31/d3f/d58/d72/d7a/leb 0 2023-12-06T15:00:29.080 INFO:tasks.workunit.client.1.smithi190.stdout:4/578: mknod d3/da4/cba 0 2023-12-06T15:00:29.081 INFO:tasks.workunit.client.0.smithi152.stdout:4/611: read d2/f72 [1398453,130334] 0 2023-12-06T15:00:29.082 INFO:tasks.workunit.client.1.smithi190.stdout:7/710: dread d0/d5/da/d56/fa0 [0,4194304] 0 2023-12-06T15:00:29.082 INFO:tasks.workunit.client.0.smithi152.stdout:3/396: mkdir d9/d18/d1a/d77 0 2023-12-06T15:00:29.082 INFO:tasks.workunit.client.0.smithi152.stdout:5/411: symlink d7/dd/d26/d48/l91 0 2023-12-06T15:00:29.083 INFO:tasks.workunit.client.0.smithi152.stdout:4/612: write d2/d15/f58 [163973,36804] 0 2023-12-06T15:00:29.085 INFO:tasks.workunit.client.1.smithi190.stdout:7/711: dread d0/df/d1f/f46 [0,4194304] 0 2023-12-06T15:00:29.085 INFO:tasks.workunit.client.1.smithi190.stdout:7/712: chown d0/df/d53/d99/da9/dc8 403236 1 2023-12-06T15:00:29.085 INFO:tasks.workunit.client.1.smithi190.stdout:9/713: link d4/d27/d2f/d5c/c96 d4/d27/d2f/d66/cec 0 2023-12-06T15:00:29.085 INFO:tasks.workunit.client.1.smithi190.stdout:9/714: dread - d4/d27/d2f/d31/d3f/d58/d72/d7a/fd4 zero size 2023-12-06T15:00:29.085 INFO:tasks.workunit.client.1.smithi190.stdout:6/705: dwrite d4/d12/d40/d43/d45/d4a/d77/dca/f98 [0,4194304] 0 2023-12-06T15:00:29.085 INFO:tasks.workunit.client.1.smithi190.stdout:5/511: dwrite d0/f62 [0,4194304] 0 2023-12-06T15:00:29.086 INFO:tasks.workunit.client.1.smithi190.stdout:1/890: unlink d6/dc/d29/d38/d73/d5c/db5/f113 0 2023-12-06T15:00:29.088 INFO:tasks.workunit.client.0.smithi152.stdout:5/412: write d7/dd/d26/f33 [3962435,48898] 0 2023-12-06T15:00:29.088 INFO:tasks.workunit.client.0.smithi152.stdout:5/413: readlink d7/d47/l64 0 2023-12-06T15:00:29.088 INFO:tasks.workunit.client.0.smithi152.stdout:4/613: dread d2/d15/d32/d91/fb2 [0,4194304] 0 2023-12-06T15:00:29.088 INFO:tasks.workunit.client.1.smithi190.stdout:4/579: rename d3/d35/d19/d30/l63 to d3/d35/d19/d30/d3c/lbb 0 2023-12-06T15:00:29.095 INFO:tasks.workunit.client.1.smithi190.stdout:1/891: creat d6/dc/d3b/d78/d94/d109/f124 x:0 0 0 2023-12-06T15:00:29.097 INFO:tasks.workunit.client.0.smithi152.stdout:4/614: rename d2/l67 to d2/d89/d9e/lbd 0 2023-12-06T15:00:29.099 INFO:tasks.workunit.client.0.smithi152.stdout:3/397: dread d9/d18/f3c [0,4194304] 0 2023-12-06T15:00:29.099 INFO:tasks.workunit.client.1.smithi190.stdout:3/736: sync 2023-12-06T15:00:29.099 INFO:tasks.workunit.client.1.smithi190.stdout:0/597: sync 2023-12-06T15:00:29.100 INFO:tasks.workunit.client.1.smithi190.stdout:2/573: sync 2023-12-06T15:00:29.102 INFO:tasks.workunit.client.0.smithi152.stdout:4/615: getdents d2/d45 0 2023-12-06T15:00:29.104 INFO:tasks.workunit.client.0.smithi152.stdout:4/616: creat d2/d10/dab/fbe x:0 0 0 2023-12-06T15:00:29.105 INFO:tasks.workunit.client.1.smithi190.stdout:0/598: symlink d0/lbf 0 2023-12-06T15:00:29.106 INFO:tasks.workunit.client.0.smithi152.stdout:4/617: creat d2/d45/d84/fbf x:0 0 0 2023-12-06T15:00:29.106 INFO:tasks.workunit.client.0.smithi152.stdout:5/414: dread d7/dd/f16 [0,4194304] 0 2023-12-06T15:00:29.109 INFO:tasks.workunit.client.0.smithi152.stdout:4/618: creat d2/d89/d9e/dbc/d42/fc0 x:0 0 0 2023-12-06T15:00:29.109 INFO:tasks.workunit.client.0.smithi152.stdout:5/415: mknod d7/dd/d26/d87/c92 0 2023-12-06T15:00:29.109 INFO:tasks.workunit.client.0.smithi152.stdout:5/416: fdatasync d7/f24 0 2023-12-06T15:00:29.109 INFO:tasks.workunit.client.0.smithi152.stdout:5/417: write d7/dd/f5f [747193,67344] 0 2023-12-06T15:00:29.109 INFO:tasks.workunit.client.0.smithi152.stdout:5/418: write d7/dd/d26/d48/f85 [2123844,112729] 0 2023-12-06T15:00:29.110 INFO:tasks.workunit.client.0.smithi152.stdout:4/619: read d2/d45/f4e [49671,19878] 0 2023-12-06T15:00:29.110 INFO:tasks.workunit.client.0.smithi152.stdout:5/419: rmdir d7/dd/d26/d48 39 2023-12-06T15:00:29.111 INFO:tasks.workunit.client.1.smithi190.stdout:0/599: rmdir d0/da/d3e/d3a/d40 39 2023-12-06T15:00:29.111 INFO:tasks.workunit.client.1.smithi190.stdout:0/600: write d0/da/d3e/d3a/d40/d6f/fbe [562548,114049] 0 2023-12-06T15:00:29.111 INFO:tasks.workunit.client.1.smithi190.stdout:0/601: truncate d0/da/d5a/d80/f8c 1271647 0 2023-12-06T15:00:29.113 INFO:tasks.workunit.client.1.smithi190.stdout:0/602: mkdir d0/da/d3e/d3a/d40/d6f/dc0 0 2023-12-06T15:00:29.113 INFO:tasks.workunit.client.0.smithi152.stdout:4/620: symlink d2/d89/d9e/dbc/d75/lc1 0 2023-12-06T15:00:29.113 INFO:tasks.workunit.client.0.smithi152.stdout:5/420: creat d7/d43/d6c/f93 x:0 0 0 2023-12-06T15:00:29.113 INFO:tasks.workunit.client.0.smithi152.stdout:5/421: fsync d7/fc 0 2023-12-06T15:00:29.114 INFO:tasks.workunit.client.1.smithi190.stdout:7/713: dread d0/d5/da/f49 [0,4194304] 0 2023-12-06T15:00:29.114 INFO:tasks.workunit.client.0.smithi152.stdout:4/621: truncate d2/d15/f7f 647501 0 2023-12-06T15:00:29.116 INFO:tasks.workunit.client.0.smithi152.stdout:5/422: creat d7/d43/d6c/f94 x:0 0 0 2023-12-06T15:00:29.118 INFO:tasks.workunit.client.1.smithi190.stdout:9/715: dread d4/d27/d2f/d31/d3f/d58/d7d/fc3 [0,4194304] 0 2023-12-06T15:00:29.118 INFO:tasks.workunit.client.1.smithi190.stdout:7/714: symlink d0/df/d53/d99/da9/dc8/le4 0 2023-12-06T15:00:29.118 INFO:tasks.workunit.client.1.smithi190.stdout:3/737: dread d4/d1b/d54/fa1 [0,4194304] 0 2023-12-06T15:00:29.119 INFO:tasks.workunit.client.0.smithi152.stdout:4/622: symlink d2/d15/d32/lc2 0 2023-12-06T15:00:29.119 INFO:tasks.workunit.client.0.smithi152.stdout:4/623: chown d2/f26 527688615 1 2023-12-06T15:00:29.119 INFO:tasks.workunit.client.0.smithi152.stdout:4/624: getdents d2/d45 0 2023-12-06T15:00:29.120 INFO:tasks.workunit.client.0.smithi152.stdout:5/423: symlink d7/dd/d26/d3b/d46/d7e/l95 0 2023-12-06T15:00:29.120 INFO:tasks.workunit.client.0.smithi152.stdout:5/424: write d7/d43/d6c/f90 [481526,60115] 0 2023-12-06T15:00:29.122 INFO:tasks.workunit.client.1.smithi190.stdout:3/738: symlink d4/d70/d33/d45/l102 0 2023-12-06T15:00:29.122 INFO:tasks.workunit.client.1.smithi190.stdout:3/739: read d4/d1b/d54/d9c/d68/dfc/d56/d83/f87 [874425,56173] 0 2023-12-06T15:00:29.122 INFO:tasks.workunit.client.1.smithi190.stdout:3/740: rename d4/d70 to d4/d70/d19/d51/d103 22 2023-12-06T15:00:29.122 INFO:tasks.workunit.client.0.smithi152.stdout:4/625: unlink d2/d45/d84/da4/ca6 0 2023-12-06T15:00:29.123 INFO:tasks.workunit.client.1.smithi190.stdout:9/716: mknod d4/d27/d2f/d31/ced 0 2023-12-06T15:00:29.123 INFO:tasks.workunit.client.1.smithi190.stdout:3/741: mknod d4/d1b/d54/d9c/d68/dfc/d56/d94/c104 0 2023-12-06T15:00:29.123 INFO:tasks.workunit.client.1.smithi190.stdout:3/742: chown d4/d70/d33/fbe 22 1 2023-12-06T15:00:29.124 INFO:tasks.workunit.client.0.smithi152.stdout:5/425: rename d7/c23 to d7/dd/d4e/c96 0 2023-12-06T15:00:29.124 INFO:tasks.workunit.client.0.smithi152.stdout:5/426: chown d7/f28 827502918 1 2023-12-06T15:00:29.126 INFO:tasks.workunit.client.1.smithi190.stdout:9/717: rmdir d4/d27/d8a/dbc 39 2023-12-06T15:00:29.128 INFO:tasks.workunit.client.1.smithi190.stdout:3/743: creat d4/d1b/d54/d9c/d68/dfc/d56/d94/d3d/f105 x:0 0 0 2023-12-06T15:00:29.128 INFO:tasks.workunit.client.1.smithi190.stdout:3/744: chown d4/d70/dcb/lf3 32241978 1 2023-12-06T15:00:29.128 INFO:tasks.workunit.client.1.smithi190.stdout:3/745: dread - d4/d70/d19/d51/dab/ff7 zero size 2023-12-06T15:00:29.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:28 smithi152 ceph-mon[111954]: pgmap v26: 65 pgs: 65 active+clean; 1.3 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 69 MiB/s rd, 143 MiB/s wr, 237 op/s 2023-12-06T15:00:29.129 INFO:tasks.workunit.client.0.smithi152.stdout:4/626: mknod d2/d10/dbb/cc3 0 2023-12-06T15:00:29.129 INFO:tasks.workunit.client.0.smithi152.stdout:5/427: mkdir d7/dd/d26/d48/d97 0 2023-12-06T15:00:29.129 INFO:tasks.workunit.client.1.smithi190.stdout:9/718: truncate d4/f6 557835 0 2023-12-06T15:00:29.130 INFO:tasks.workunit.client.0.smithi152.stdout:4/627: creat d2/d45/fc4 x:0 0 0 2023-12-06T15:00:29.131 INFO:tasks.workunit.client.0.smithi152.stdout:5/428: mkdir d7/d43/d6c/d98 0 2023-12-06T15:00:29.131 INFO:tasks.workunit.client.0.smithi152.stdout:5/429: write d7/d47/f78 [2058431,19507] 0 2023-12-06T15:00:29.133 INFO:tasks.workunit.client.0.smithi152.stdout:4/628: mknod d2/d15/d32/d91/cc5 0 2023-12-06T15:00:29.134 INFO:tasks.workunit.client.1.smithi190.stdout:4/580: dwrite d3/fd [4194304,4194304] 0 2023-12-06T15:00:29.134 INFO:tasks.workunit.client.1.smithi190.stdout:9/719: dread d4/d27/d8a/dbc/fe7 [0,4194304] 0 2023-12-06T15:00:29.135 INFO:tasks.workunit.client.1.smithi190.stdout:0/603: dread d0/da/d3e/d3a/d40/f5e [0,4194304] 0 2023-12-06T15:00:29.135 INFO:tasks.workunit.client.0.smithi152.stdout:8/309: dwrite d1/d6/ff [0,4194304] 0 2023-12-06T15:00:29.135 INFO:tasks.workunit.client.0.smithi152.stdout:5/430: dread d7/d43/f4b [0,4194304] 0 2023-12-06T15:00:29.135 INFO:tasks.workunit.client.0.smithi152.stdout:4/629: getdents d2/d15/d32/d79 0 2023-12-06T15:00:29.135 INFO:tasks.workunit.client.0.smithi152.stdout:4/630: readlink d2/d15/d32/d79/l8b 0 2023-12-06T15:00:29.136 INFO:tasks.workunit.client.0.smithi152.stdout:4/631: write d2/d10/dab/fbe [68009,70379] 0 2023-12-06T15:00:29.136 INFO:tasks.workunit.client.0.smithi152.stdout:4/632: write d2/d15/d32/f5a [4961545,54886] 0 2023-12-06T15:00:29.136 INFO:tasks.workunit.client.0.smithi152.stdout:4/633: fsync d2/f8 0 2023-12-06T15:00:29.136 INFO:tasks.workunit.client.1.smithi190.stdout:4/581: mknod d3/d76/d7c/d96/d7a/cbc 0 2023-12-06T15:00:29.136 INFO:tasks.workunit.client.1.smithi190.stdout:6/706: dwrite d4/d12/d1a/d8a/da3/fb7 [0,4194304] 0 2023-12-06T15:00:29.136 INFO:tasks.workunit.client.1.smithi190.stdout:0/604: write d0/da/d3e/d3a/d40/f5e [2834810,42548] 0 2023-12-06T15:00:29.137 INFO:tasks.workunit.client.0.smithi152.stdout:5/431: getdents d7/d47 0 2023-12-06T15:00:29.138 INFO:tasks.workunit.client.1.smithi190.stdout:4/582: link d3/d76/d7c/d96/d15/f23 d3/d76/d7c/d96/d39/fbd 0 2023-12-06T15:00:29.139 INFO:tasks.workunit.client.0.smithi152.stdout:8/310: rename d1/c15 to d1/c5e 0 2023-12-06T15:00:29.140 INFO:tasks.workunit.client.0.smithi152.stdout:5/432: creat d7/dd/d26/d3b/d46/d7e/f99 x:0 0 0 2023-12-06T15:00:29.142 INFO:tasks.workunit.client.1.smithi190.stdout:0/605: link d0/da/d3e/d2b/d3c/d46/d8e/c99 d0/da/d3e/d3a/d40/d6f/d9e/cc1 0 2023-12-06T15:00:29.143 INFO:tasks.workunit.client.0.smithi152.stdout:5/433: mknod d7/dd/d26/d48/c9a 0 2023-12-06T15:00:29.144 INFO:tasks.workunit.client.1.smithi190.stdout:4/583: mkdir d3/d35/d19/d67/db5/dbe 0 2023-12-06T15:00:29.145 INFO:tasks.workunit.client.1.smithi190.stdout:0/606: write d0/da/d3e/d2b/d3c/d46/d8e/fb5 [3072949,31694] 0 2023-12-06T15:00:29.146 INFO:tasks.workunit.client.1.smithi190.stdout:4/584: rmdir d3/d35/d19/d41/d44/d9c/d72 39 2023-12-06T15:00:29.146 INFO:tasks.workunit.client.1.smithi190.stdout:4/585: fdatasync d3/d35/d19/f79 0 2023-12-06T15:00:29.146 INFO:tasks.workunit.client.1.smithi190.stdout:4/586: chown d3/d76/d7c/d96/d39/d54/f84 128472 1 2023-12-06T15:00:29.146 INFO:tasks.workunit.client.0.smithi152.stdout:5/434: rename d7/c6d to d7/dd/d26/d87/c9b 0 2023-12-06T15:00:29.146 INFO:tasks.workunit.client.0.smithi152.stdout:5/435: readlink d7/dd/d26/d3a/l69 0 2023-12-06T15:00:29.147 INFO:tasks.workunit.client.1.smithi190.stdout:0/607: getdents d0/da/d3e/d2b/d3c/d4c 0 2023-12-06T15:00:29.147 INFO:tasks.workunit.client.1.smithi190.stdout:0/608: chown d0/da/d3e/d2b/d3c/d46/l94 10 1 2023-12-06T15:00:29.147 INFO:tasks.workunit.client.1.smithi190.stdout:5/512: dwrite d0/d1c/d2b/f9e [0,4194304] 0 2023-12-06T15:00:29.148 INFO:tasks.workunit.client.1.smithi190.stdout:9/720: dread d4/d27/d2f/d66/f6e [0,4194304] 0 2023-12-06T15:00:29.148 INFO:tasks.workunit.client.1.smithi190.stdout:2/574: dwrite d10/f1f [0,4194304] 0 2023-12-06T15:00:29.148 INFO:tasks.workunit.client.1.smithi190.stdout:9/721: fsync d4/d27/d2f/d5c/f6c 0 2023-12-06T15:00:29.148 INFO:tasks.workunit.client.1.smithi190.stdout:9/722: dread - d4/d27/d2f/d31/fc9 zero size 2023-12-06T15:00:29.148 INFO:tasks.workunit.client.1.smithi190.stdout:9/723: chown d4/d27/f4d 30386968 1 2023-12-06T15:00:29.149 INFO:tasks.workunit.client.0.smithi152.stdout:5/436: mkdir d7/d43/d9c 0 2023-12-06T15:00:29.149 INFO:tasks.workunit.client.0.smithi152.stdout:5/437: truncate d7/dd/d26/d3b/d46/d7e/f88 3120329 0 2023-12-06T15:00:29.151 INFO:tasks.workunit.client.1.smithi190.stdout:0/609: creat d0/da/da4/fc2 x:0 0 0 2023-12-06T15:00:29.151 INFO:tasks.workunit.client.0.smithi152.stdout:5/438: unlink d7/l27 0 2023-12-06T15:00:29.152 INFO:tasks.workunit.client.1.smithi190.stdout:7/715: dwrite d0/f7b [0,4194304] 0 2023-12-06T15:00:29.153 INFO:tasks.workunit.client.0.smithi152.stdout:5/439: mknod d7/d43/d9c/c9d 0 2023-12-06T15:00:29.153 INFO:tasks.workunit.client.1.smithi190.stdout:2/575: unlink d10/d26/d5c/d49/d54/f8b 0 2023-12-06T15:00:29.155 INFO:tasks.workunit.client.1.smithi190.stdout:9/724: creat d4/d27/d2f/d31/fee x:0 0 0 2023-12-06T15:00:29.156 INFO:tasks.workunit.client.0.smithi152.stdout:5/440: rename d7/d43/d6c/f8d to d7/d43/d6c/f9e 0 2023-12-06T15:00:29.156 INFO:tasks.workunit.client.0.smithi152.stdout:5/441: chown d7/dd/d26/l6a 121 1 2023-12-06T15:00:29.157 INFO:tasks.workunit.client.0.smithi152.stdout:5/442: chown d7/dd/f67 177 1 2023-12-06T15:00:29.158 INFO:tasks.workunit.client.0.smithi152.stdout:5/443: creat d7/d43/d6c/d98/f9f x:0 0 0 2023-12-06T15:00:29.158 INFO:tasks.workunit.client.1.smithi190.stdout:7/716: mkdir d0/d5/dba/de5 0 2023-12-06T15:00:29.161 INFO:tasks.workunit.client.0.smithi152.stdout:4/634: dread d2/d22/fb6 [0,4194304] 0 2023-12-06T15:00:29.161 INFO:tasks.workunit.client.0.smithi152.stdout:4/635: dread - d2/d15/d32/f60 zero size 2023-12-06T15:00:29.162 INFO:tasks.workunit.client.0.smithi152.stdout:3/398: dwrite d9/d10/f28 [0,4194304] 0 2023-12-06T15:00:29.162 INFO:tasks.workunit.client.0.smithi152.stdout:3/399: chown d9/d18/d39/c4d 8293 1 2023-12-06T15:00:29.164 INFO:tasks.workunit.client.1.smithi190.stdout:2/576: rename d10/d26/d5b to d10/d59/d5e/d71/dad/dc4 0 2023-12-06T15:00:29.164 INFO:tasks.workunit.client.1.smithi190.stdout:2/577: write d10/d26/d5c/d49/f6f [221915,70574] 0 2023-12-06T15:00:29.167 INFO:tasks.workunit.client.1.smithi190.stdout:7/717: creat d0/df/d1f/dbd/fe6 x:0 0 0 2023-12-06T15:00:29.167 INFO:tasks.workunit.client.0.smithi152.stdout:5/444: dread d7/dd/d26/d48/f86 [0,4194304] 0 2023-12-06T15:00:29.168 INFO:tasks.workunit.client.1.smithi190.stdout:6/707: dwrite d4/d12/d40/f9e [4194304,4194304] 0 2023-12-06T15:00:29.168 INFO:tasks.workunit.client.0.smithi152.stdout:3/400: creat d9/d10/d12/d43/f78 x:0 0 0 2023-12-06T15:00:29.169 INFO:tasks.workunit.client.1.smithi190.stdout:2/578: symlink d10/d26/d5c/d35/d77/d98/lc5 0 2023-12-06T15:00:29.172 INFO:tasks.workunit.client.1.smithi190.stdout:6/708: read d4/d12/d1a/f97 [1488118,22596] 0 2023-12-06T15:00:29.172 INFO:tasks.workunit.client.1.smithi190.stdout:6/709: chown d4/d12/d1a/d44/f47 0 1 2023-12-06T15:00:29.172 INFO:tasks.workunit.client.1.smithi190.stdout:7/718: symlink d0/df/d53/d99/ddb/le7 0 2023-12-06T15:00:29.174 INFO:tasks.workunit.client.1.smithi190.stdout:9/725: rename d4/d27/d2f/d31/l2b to d4/d27/d2f/d5c/d9d/lef 0 2023-12-06T15:00:29.175 INFO:tasks.workunit.client.1.smithi190.stdout:9/726: write d4/f24 [1579867,32329] 0 2023-12-06T15:00:29.179 INFO:tasks.workunit.client.1.smithi190.stdout:5/513: dread d0/fd [0,4194304] 0 2023-12-06T15:00:29.179 INFO:tasks.workunit.client.1.smithi190.stdout:1/892: dwrite d6/dc/d29/d38/d73/f4e [0,4194304] 0 2023-12-06T15:00:29.179 INFO:tasks.workunit.client.1.smithi190.stdout:6/710: mkdir d4/d12/d1a/d8c/ded 0 2023-12-06T15:00:29.179 INFO:tasks.workunit.client.1.smithi190.stdout:6/711: dread - d4/d12/d40/d43/d45/f88 zero size 2023-12-06T15:00:29.179 INFO:tasks.workunit.client.1.smithi190.stdout:6/712: truncate d4/d12/d40/d43/d45/d4a/d77/fb5 393879 0 2023-12-06T15:00:29.180 INFO:tasks.workunit.client.1.smithi190.stdout:5/514: read d0/d1c/d2b/f9e [2732437,76132] 0 2023-12-06T15:00:29.183 INFO:tasks.workunit.client.1.smithi190.stdout:4/587: dwrite d3/d35/d19/d41/d44/f9f [0,4194304] 0 2023-12-06T15:00:29.183 INFO:tasks.workunit.client.1.smithi190.stdout:4/588: write d3/d35/d19/f47 [8898084,60670] 0 2023-12-06T15:00:29.186 INFO:tasks.workunit.client.1.smithi190.stdout:2/579: rename d10/c30 to d10/d59/d5e/d71/dad/dc4/d76/db1/cc6 0 2023-12-06T15:00:29.187 INFO:tasks.workunit.client.1.smithi190.stdout:6/713: truncate d4/d12/d1a/d32/f4c 1093142 0 2023-12-06T15:00:29.195 INFO:tasks.workunit.client.1.smithi190.stdout:4/589: creat d3/d35/d19/d30/fbf x:0 0 0 2023-12-06T15:00:29.195 INFO:tasks.workunit.client.1.smithi190.stdout:4/590: fsync d3/d35/d19/d41/d44/d5b/f61 0 2023-12-06T15:00:29.195 INFO:tasks.workunit.client.1.smithi190.stdout:5/515: symlink d0/d1c/d3e/laf 0 2023-12-06T15:00:29.195 INFO:tasks.workunit.client.1.smithi190.stdout:2/580: unlink d10/f2d 0 2023-12-06T15:00:29.195 INFO:tasks.workunit.client.1.smithi190.stdout:2/581: write d10/d26/d5c/d37/f3d [9036585,98482] 0 2023-12-06T15:00:29.198 INFO:tasks.workunit.client.1.smithi190.stdout:5/516: unlink d0/d1c/d3e/d7e/l8d 0 2023-12-06T15:00:29.200 INFO:tasks.workunit.client.1.smithi190.stdout:5/517: readlink d0/d1c/d3e/d7e/lae 0 2023-12-06T15:00:29.201 INFO:tasks.workunit.client.1.smithi190.stdout:5/518: truncate d0/d1c/d3e/f76 975520 0 2023-12-06T15:00:29.206 INFO:tasks.workunit.client.1.smithi190.stdout:2/582: read d10/d59/d5e/f47 [2596595,82429] 0 2023-12-06T15:00:29.207 INFO:tasks.workunit.client.1.smithi190.stdout:2/583: chown d10/d59/d5e/d71/dad/dc4/cac 11977 1 2023-12-06T15:00:29.208 INFO:tasks.workunit.client.1.smithi190.stdout:2/584: truncate d10/d26/f2f 5076479 0 2023-12-06T15:00:29.214 INFO:tasks.workunit.client.0.smithi152.stdout:4/636: dwrite d2/d15/f96 [0,4194304] 0 2023-12-06T15:00:29.218 INFO:tasks.workunit.client.1.smithi190.stdout:1/893: dwrite d6/f2f [0,4194304] 0 2023-12-06T15:00:29.221 INFO:tasks.workunit.client.1.smithi190.stdout:7/719: dwrite d0/d88/fb4 [0,4194304] 0 2023-12-06T15:00:29.222 INFO:tasks.workunit.client.0.smithi152.stdout:4/637: write d2/d15/d32/d79/f82 [628454,89176] 0 2023-12-06T15:00:29.222 INFO:tasks.workunit.client.0.smithi152.stdout:3/401: dwrite d9/d10/f5d [0,4194304] 0 2023-12-06T15:00:29.222 INFO:tasks.workunit.client.0.smithi152.stdout:3/402: fdatasync d9/d18/d39/f4a 0 2023-12-06T15:00:29.222 INFO:tasks.workunit.client.0.smithi152.stdout:3/403: write d9/d10/d12/d43/d52/d58/f4f [851706,7692] 0 2023-12-06T15:00:29.223 INFO:tasks.workunit.client.1.smithi190.stdout:1/894: unlink d6/dc/ff9 0 2023-12-06T15:00:29.223 INFO:tasks.workunit.client.1.smithi190.stdout:1/895: chown d6/dc/d3b/d78/fb0 239288091 1 2023-12-06T15:00:29.223 INFO:tasks.workunit.client.1.smithi190.stdout:1/896: write d6/dc/d29/d38/d73/d5c/dd2/f102 [1097563,70348] 0 2023-12-06T15:00:29.223 INFO:tasks.workunit.client.1.smithi190.stdout:1/897: write d6/dc/d29/fea [354243,73965] 0 2023-12-06T15:00:29.225 INFO:tasks.workunit.client.0.smithi152.stdout:4/638: symlink d2/d10/dab/lc6 0 2023-12-06T15:00:29.225 INFO:tasks.workunit.client.0.smithi152.stdout:4/639: chown d2/d15/l47 56048 1 2023-12-06T15:00:29.226 INFO:tasks.workunit.client.1.smithi190.stdout:7/720: rename d0/d88/d1c/d17/d94/d95/cbf to d0/df/d53/d99/ce8 0 2023-12-06T15:00:29.226 INFO:tasks.workunit.client.0.smithi152.stdout:3/404: getdents d9/d10/d12 0 2023-12-06T15:00:29.226 INFO:tasks.workunit.client.0.smithi152.stdout:3/405: chown d9/d18/d1a/c73 58102635 1 2023-12-06T15:00:29.226 INFO:tasks.workunit.client.0.smithi152.stdout:5/445: dwrite d7/d43/d6c/d98/f9f [0,4194304] 0 2023-12-06T15:00:29.228 INFO:tasks.workunit.client.0.smithi152.stdout:3/406: read d9/d10/d12/d43/f6d [103594,26208] 0 2023-12-06T15:00:29.228 INFO:tasks.workunit.client.0.smithi152.stdout:4/640: link d2/d15/d32/f5a d2/d22/d6e/da8/fc7 0 2023-12-06T15:00:29.231 INFO:tasks.workunit.client.1.smithi190.stdout:7/721: rename d0/d5/da to d0/df/d53/d2f/de9 0 2023-12-06T15:00:29.231 INFO:tasks.workunit.client.1.smithi190.stdout:7/722: write d0/d5/dba/fe0 [353509,41237] 0 2023-12-06T15:00:29.231 INFO:tasks.workunit.client.0.smithi152.stdout:5/446: link d7/dd/d26/f2e d7/d47/fa0 0 2023-12-06T15:00:29.232 INFO:tasks.workunit.client.0.smithi152.stdout:3/407: write d9/d18/d51/f6c [4038455,88904] 0 2023-12-06T15:00:29.233 INFO:tasks.workunit.client.0.smithi152.stdout:4/641: unlink d2/d15/d32/d69/f77 0 2023-12-06T15:00:29.234 INFO:tasks.workunit.client.1.smithi190.stdout:7/723: rename d0/df/d53/d2f/de9/d56/fa0 to d0/df/d53/d99/ddb/fea 0 2023-12-06T15:00:29.236 INFO:tasks.workunit.client.0.smithi152.stdout:3/408: rmdir d9 39 2023-12-06T15:00:29.236 INFO:tasks.workunit.client.1.smithi190.stdout:7/724: symlink d0/d88/d1c/d17/d94/d95/db1/leb 0 2023-12-06T15:00:29.237 INFO:tasks.workunit.client.0.smithi152.stdout:4/642: mkdir d2/d10/dc8 0 2023-12-06T15:00:29.246 INFO:tasks.workunit.client.0.smithi152.stdout:4/643: write d2/d10/f24 [1775870,34797] 0 2023-12-06T15:00:29.246 INFO:tasks.workunit.client.0.smithi152.stdout:4/644: chown d2/l1c 95380 1 2023-12-06T15:00:29.247 INFO:tasks.workunit.client.1.smithi190.stdout:9/727: dwrite d4/f17 [0,4194304] 0 2023-12-06T15:00:29.247 INFO:tasks.workunit.client.1.smithi190.stdout:9/728: write d4/d27/d2f/d66/fb4 [961316,16977] 0 2023-12-06T15:00:29.247 INFO:tasks.workunit.client.0.smithi152.stdout:4/645: rmdir d2/d45 39 2023-12-06T15:00:29.248 INFO:tasks.workunit.client.1.smithi190.stdout:5/519: dwrite d0/d1c/d2b/d2c/d5d/d73/f58 [0,4194304] 0 2023-12-06T15:00:29.248 INFO:tasks.workunit.client.0.smithi152.stdout:4/646: creat d2/d10/d27/fc9 x:0 0 0 2023-12-06T15:00:29.249 INFO:tasks.workunit.client.1.smithi190.stdout:4/591: dwrite d3/d76/d7c/d96/d15/f23 [0,4194304] 0 2023-12-06T15:00:29.249 INFO:tasks.workunit.client.1.smithi190.stdout:2/585: dwrite d10/d59/d5e/d71/dad/dc4/d7f/d8e/fa2 [0,4194304] 0 2023-12-06T15:00:29.250 INFO:tasks.workunit.client.1.smithi190.stdout:6/714: dwrite d4/d12/d40/d43/d45/d4a/dc5/fe3 [0,4194304] 0 2023-12-06T15:00:29.250 INFO:tasks.workunit.client.1.smithi190.stdout:6/715: chown d4/d12/c90 4 1 2023-12-06T15:00:29.250 INFO:tasks.workunit.client.1.smithi190.stdout:6/716: chown d4/d12/d40/d43/d45/d4a/d77/dd5 58094932 1 2023-12-06T15:00:29.250 INFO:tasks.workunit.client.1.smithi190.stdout:6/717: fsync d4/d12/d1a/d70/da9/faa 0 2023-12-06T15:00:29.250 INFO:tasks.workunit.client.1.smithi190.stdout:6/718: write d4/d12/d40/d43/f4d [889476,56425] 0 2023-12-06T15:00:29.250 INFO:tasks.workunit.client.1.smithi190.stdout:2/586: write d10/d26/d5c/d35/f87 [2448071,58327] 0 2023-12-06T15:00:29.251 INFO:tasks.workunit.client.0.smithi152.stdout:3/409: truncate d9/d10/f5d 2426169 0 2023-12-06T15:00:29.251 INFO:tasks.workunit.client.0.smithi152.stdout:3/410: write d9/f37 [4965050,35922] 0 2023-12-06T15:00:29.255 INFO:tasks.workunit.client.0.smithi152.stdout:5/447: dwrite d7/dd/f16 [0,4194304] 0 2023-12-06T15:00:29.257 INFO:tasks.workunit.client.0.smithi152.stdout:4/647: rmdir d2/d10/dab 39 2023-12-06T15:00:29.258 INFO:tasks.workunit.client.1.smithi190.stdout:6/719: dread d4/d12/d40/d43/d45/d4a/f7e [0,4194304] 0 2023-12-06T15:00:29.259 INFO:tasks.workunit.client.1.smithi190.stdout:5/520: mknod d0/d1c/d2b/cb0 0 2023-12-06T15:00:29.260 INFO:tasks.workunit.client.1.smithi190.stdout:1/898: truncate d6/dc/d29/d38/d39/dda/fdb 2483980 0 2023-12-06T15:00:29.260 INFO:tasks.workunit.client.1.smithi190.stdout:1/899: chown d6/dc/d29/d38/d39/d63/le1 2985 1 2023-12-06T15:00:29.262 INFO:tasks.workunit.client.1.smithi190.stdout:1/900: dread d6/dc/d29/d38/d39/d63/fd3 [0,4194304] 0 2023-12-06T15:00:29.263 INFO:tasks.workunit.client.0.smithi152.stdout:3/411: unlink f2 0 2023-12-06T15:00:29.264 INFO:tasks.workunit.client.1.smithi190.stdout:4/592: rename d3/d35/d19/c75 to d3/d35/d19/d30/daa/cc0 0 2023-12-06T15:00:29.266 INFO:tasks.workunit.client.0.smithi152.stdout:3/412: creat d9/d18/d1a/d65/f79 x:0 0 0 2023-12-06T15:00:29.268 INFO:tasks.workunit.client.0.smithi152.stdout:3/413: rmdir d9/d18/d1a/d65/d76 0 2023-12-06T15:00:29.269 INFO:tasks.workunit.client.0.smithi152.stdout:3/414: creat d9/d10/d12/d43/d52/f7a x:0 0 0 2023-12-06T15:00:29.270 INFO:tasks.workunit.client.1.smithi190.stdout:6/720: dread d4/d12/d1a/d8a/fb2 [0,4194304] 0 2023-12-06T15:00:29.271 INFO:tasks.workunit.client.1.smithi190.stdout:2/587: mknod d10/d59/cc7 0 2023-12-06T15:00:29.271 INFO:tasks.workunit.client.0.smithi152.stdout:5/448: dwrite d7/dd/d4e/f70 [0,4194304] 0 2023-12-06T15:00:29.272 INFO:tasks.workunit.client.0.smithi152.stdout:5/449: dread - d7/dd/d26/d3a/f6b zero size 2023-12-06T15:00:29.272 INFO:tasks.workunit.client.0.smithi152.stdout:5/450: write d7/dd/d4e/f5c [834686,130205] 0 2023-12-06T15:00:29.272 INFO:tasks.workunit.client.0.smithi152.stdout:3/415: rename d9/d18/d39/f62 to d9/d10/d19/f7b 0 2023-12-06T15:00:29.272 INFO:tasks.workunit.client.0.smithi152.stdout:3/416: fsync d9/d10/d19/f57 0 2023-12-06T15:00:29.272 INFO:tasks.workunit.client.0.smithi152.stdout:3/417: stat d9/d10/d12/f30 0 2023-12-06T15:00:29.275 INFO:tasks.workunit.client.1.smithi190.stdout:5/521: creat d0/d1c/d2b/d2c/d5d/d73/fb1 x:0 0 0 2023-12-06T15:00:29.275 INFO:tasks.workunit.client.0.smithi152.stdout:5/451: creat d7/dd/d26/d3b/fa1 x:0 0 0 2023-12-06T15:00:29.276 INFO:tasks.workunit.client.1.smithi190.stdout:1/901: mkdir d6/dc/d29/d38/d43/db7/d125 0 2023-12-06T15:00:29.277 INFO:tasks.workunit.client.1.smithi190.stdout:1/902: fdatasync d6/dc/d29/fea 0 2023-12-06T15:00:29.279 INFO:tasks.workunit.client.1.smithi190.stdout:4/593: link d3/d76/d7c/d96/f5f d3/d4e/fc1 0 2023-12-06T15:00:29.280 INFO:tasks.workunit.client.1.smithi190.stdout:6/721: mknod d4/d12/d40/d43/d45/d4a/d77/cee 0 2023-12-06T15:00:29.281 INFO:tasks.workunit.client.0.smithi152.stdout:1/568: sync 2023-12-06T15:00:29.281 INFO:tasks.workunit.client.0.smithi152.stdout:5/452: write d7/f1e [3515928,80020] 0 2023-12-06T15:00:29.282 INFO:tasks.workunit.client.1.smithi190.stdout:2/588: rename d10/d26/d5c/d8d/l95 to d10/d26/d5c/da5/lc8 0 2023-12-06T15:00:29.284 INFO:tasks.workunit.client.1.smithi190.stdout:5/522: creat d0/d1c/fb2 x:0 0 0 2023-12-06T15:00:29.285 INFO:tasks.workunit.client.1.smithi190.stdout:5/523: chown d0/d1c/d3e/d5a 21 1 2023-12-06T15:00:29.286 INFO:tasks.workunit.client.1.smithi190.stdout:4/594: mknod d3/d35/d19/d41/d44/d5b/cc2 0 2023-12-06T15:00:29.287 INFO:tasks.workunit.client.0.smithi152.stdout:1/569: unlink d3/da/f26 0 2023-12-06T15:00:29.287 INFO:tasks.workunit.client.0.smithi152.stdout:5/453: rename d7/dd/d4e/l79 to d7/d43/d6c/la2 0 2023-12-06T15:00:29.287 INFO:tasks.workunit.client.1.smithi190.stdout:4/595: dread d3/d76/d7c/d96/f5f [0,4194304] 0 2023-12-06T15:00:29.288 INFO:tasks.workunit.client.1.smithi190.stdout:6/722: creat d4/d12/d1a/d59/fef x:0 0 0 2023-12-06T15:00:29.288 INFO:tasks.workunit.client.0.smithi152.stdout:3/418: dwrite d9/f1d [0,4194304] 0 2023-12-06T15:00:29.288 INFO:tasks.workunit.client.0.smithi152.stdout:3/419: fsync d9/f38 0 2023-12-06T15:00:29.290 INFO:tasks.workunit.client.1.smithi190.stdout:5/524: creat d0/d1c/d3e/d5a/d5f/fb3 x:0 0 0 2023-12-06T15:00:29.290 INFO:tasks.workunit.client.0.smithi152.stdout:1/570: rmdir d3/da/d4c 39 2023-12-06T15:00:29.290 INFO:tasks.workunit.client.0.smithi152.stdout:1/571: stat d3/d73/fcb 0 2023-12-06T15:00:29.290 INFO:tasks.workunit.client.1.smithi190.stdout:4/596: mknod d3/d76/d7c/d96/d39/cc3 0 2023-12-06T15:00:29.291 INFO:tasks.workunit.client.1.smithi190.stdout:4/597: truncate d3/d35/f95 868802 0 2023-12-06T15:00:29.291 INFO:tasks.workunit.client.0.smithi152.stdout:5/454: truncate d7/fc 1851829 0 2023-12-06T15:00:29.291 INFO:tasks.workunit.client.1.smithi190.stdout:5/525: mknod d0/d1c/d85/d90/d99/cb4 0 2023-12-06T15:00:29.292 INFO:tasks.workunit.client.0.smithi152.stdout:3/420: symlink d9/l7c 0 2023-12-06T15:00:29.292 INFO:tasks.workunit.client.0.smithi152.stdout:1/572: rmdir d3/da/d4c/d82/d52/d55 39 2023-12-06T15:00:29.293 INFO:tasks.workunit.client.1.smithi190.stdout:5/526: creat d0/d1c/d2b/d2c/d5d/fb5 x:0 0 0 2023-12-06T15:00:29.293 INFO:tasks.workunit.client.0.smithi152.stdout:3/421: link d9/d18/d1a/c27 d9/d10/d12/d43/c7d 0 2023-12-06T15:00:29.294 INFO:tasks.workunit.client.0.smithi152.stdout:1/573: mknod d3/da/db/da0/cda 0 2023-12-06T15:00:29.294 INFO:tasks.workunit.client.0.smithi152.stdout:1/574: fdatasync d3/da/db/d54/fb5 0 2023-12-06T15:00:29.294 INFO:tasks.workunit.client.0.smithi152.stdout:1/575: truncate d3/da/d4c/d63/fa8 4372773 0 2023-12-06T15:00:29.294 INFO:tasks.workunit.client.0.smithi152.stdout:1/576: dread - d3/d73/fd4 zero size 2023-12-06T15:00:29.295 INFO:tasks.workunit.client.0.smithi152.stdout:1/577: write d3/da/d4c/d82/f31 [947886,11262] 0 2023-12-06T15:00:29.295 INFO:tasks.workunit.client.0.smithi152.stdout:3/422: mknod d9/d18/c7e 0 2023-12-06T15:00:29.295 INFO:tasks.workunit.client.1.smithi190.stdout:5/527: creat d0/d1c/d94/fb6 x:0 0 0 2023-12-06T15:00:29.295 INFO:tasks.workunit.client.1.smithi190.stdout:5/528: readlink d0/d1c/d2b/d2c/d5d/d73/l3a 0 2023-12-06T15:00:29.296 INFO:tasks.workunit.client.0.smithi152.stdout:1/578: creat d3/d44/d84/fdb x:0 0 0 2023-12-06T15:00:29.296 INFO:tasks.workunit.client.0.smithi152.stdout:3/423: rmdir d9/d18/d51 39 2023-12-06T15:00:29.296 INFO:tasks.workunit.client.0.smithi152.stdout:3/424: chown d9/d18/d1a/c23 1225843014 1 2023-12-06T15:00:29.297 INFO:tasks.workunit.client.1.smithi190.stdout:5/529: unlink d0/d1c/l4a 0 2023-12-06T15:00:29.297 INFO:tasks.workunit.client.0.smithi152.stdout:3/425: creat d9/d10/f7f x:0 0 0 2023-12-06T15:00:29.297 INFO:tasks.workunit.client.0.smithi152.stdout:3/426: read - d9/d10/d12/d43/f78 zero size 2023-12-06T15:00:29.298 INFO:tasks.workunit.client.0.smithi152.stdout:3/427: chown d9/d10/f68 14491822 1 2023-12-06T15:00:29.299 INFO:tasks.workunit.client.1.smithi190.stdout:5/530: symlink d0/d1c/d3e/d5a/d5f/lb7 0 2023-12-06T15:00:29.299 INFO:tasks.workunit.client.1.smithi190.stdout:5/531: getdents d0/d1c/d2b/d8b 0 2023-12-06T15:00:29.299 INFO:tasks.workunit.client.0.smithi152.stdout:3/428: link d9/d18/l20 d9/l80 0 2023-12-06T15:00:29.299 INFO:tasks.workunit.client.0.smithi152.stdout:3/429: readlink d9/d10/l63 0 2023-12-06T15:00:29.301 INFO:tasks.workunit.client.0.smithi152.stdout:3/430: rmdir d9/d18/d51 39 2023-12-06T15:00:29.302 INFO:tasks.workunit.client.1.smithi190.stdout:1/903: dwrite d6/dc/f15 [0,4194304] 0 2023-12-06T15:00:29.302 INFO:tasks.workunit.client.1.smithi190.stdout:1/904: write d6/dc/d29/d38/d73/d76/f8e [509156,25554] 0 2023-12-06T15:00:29.303 INFO:tasks.workunit.client.1.smithi190.stdout:4/598: dread d3/d76/d7c/d96/d15/f2f [0,4194304] 0 2023-12-06T15:00:29.306 INFO:tasks.workunit.client.1.smithi190.stdout:1/905: rename d6/dc/d29/d38/f7a to d6/dc/d29/d38/d39/d63/d67/f126 0 2023-12-06T15:00:29.307 INFO:tasks.workunit.client.1.smithi190.stdout:1/906: dread - d6/dc/d29/d38/d39/d63/d67/f126 zero size 2023-12-06T15:00:29.307 INFO:tasks.workunit.client.1.smithi190.stdout:1/907: readlink d6/dc/d6f/lc2 0 2023-12-06T15:00:29.308 INFO:tasks.workunit.client.0.smithi152.stdout:3/431: link d9/d10/d12/d43/d52/c74 d9/d10/c81 0 2023-12-06T15:00:29.308 INFO:tasks.workunit.client.0.smithi152.stdout:3/432: chown d9/l80 26848 1 2023-12-06T15:00:29.309 INFO:tasks.workunit.client.0.smithi152.stdout:3/433: symlink d9/d18/d1a/d65/l82 0 2023-12-06T15:00:29.310 INFO:tasks.workunit.client.0.smithi152.stdout:5/455: dread d7/dd/f1c [0,4194304] 0 2023-12-06T15:00:29.310 INFO:tasks.workunit.client.0.smithi152.stdout:5/456: dread - d7/dd/d26/d3a/f7b zero size 2023-12-06T15:00:29.311 INFO:tasks.workunit.client.0.smithi152.stdout:5/457: creat d7/dd/d26/d3b/d46/d7e/fa3 x:0 0 0 2023-12-06T15:00:29.311 INFO:tasks.workunit.client.0.smithi152.stdout:5/458: fsync d7/d43/f4b 0 2023-12-06T15:00:29.311 INFO:tasks.workunit.client.0.smithi152.stdout:5/459: chown d7/dd/f5f 3610188 1 2023-12-06T15:00:29.311 INFO:tasks.workunit.client.0.smithi152.stdout:5/460: readlink d7/l57 0 2023-12-06T15:00:29.312 INFO:tasks.workunit.client.0.smithi152.stdout:5/461: dread - d7/dd/d26/d3b/f8b zero size 2023-12-06T15:00:29.312 INFO:tasks.workunit.client.0.smithi152.stdout:5/462: readlink d7/dd/d26/d3b/d46/d7e/l95 0 2023-12-06T15:00:29.313 INFO:tasks.workunit.client.0.smithi152.stdout:5/463: mkdir d7/d43/d6c/da4 0 2023-12-06T15:00:29.314 INFO:tasks.workunit.client.0.smithi152.stdout:5/464: write d7/f18 [1928991,68738] 0 2023-12-06T15:00:29.314 INFO:tasks.workunit.client.1.smithi190.stdout:4/599: rmdir d3/d76/d8b 39 2023-12-06T15:00:29.316 INFO:tasks.workunit.client.0.smithi152.stdout:5/465: link d7/dd/d26/d3b/c3f d7/dd/d26/d3b/d46/d7e/ca5 0 2023-12-06T15:00:29.316 INFO:tasks.workunit.client.0.smithi152.stdout:5/466: fsync d7/dd/d26/d3b/f5a 0 2023-12-06T15:00:29.316 INFO:tasks.workunit.client.0.smithi152.stdout:5/467: fdatasync d7/dd/d4e/f55 0 2023-12-06T15:00:29.316 INFO:tasks.workunit.client.0.smithi152.stdout:5/468: chown d7/d43/d6c/la2 3777579 1 2023-12-06T15:00:29.318 INFO:tasks.workunit.client.0.smithi152.stdout:1/579: dread d3/da/d15/d17/d58/f64 [0,4194304] 0 2023-12-06T15:00:29.318 INFO:tasks.workunit.client.0.smithi152.stdout:5/469: rename d7/d43/d6c/c72 to d7/dd/d26/d87/ca6 0 2023-12-06T15:00:29.318 INFO:tasks.workunit.client.0.smithi152.stdout:5/470: fdatasync d7/d47/f74 0 2023-12-06T15:00:29.318 INFO:tasks.workunit.client.1.smithi190.stdout:4/600: mkdir d3/d76/dc4 0 2023-12-06T15:00:29.319 INFO:tasks.workunit.client.0.smithi152.stdout:5/471: rename d7/d43/d6c/f90 to d7/dd/d26/d3a/fa7 0 2023-12-06T15:00:29.320 INFO:tasks.workunit.client.0.smithi152.stdout:3/434: dread d9/d45/f53 [0,4194304] 0 2023-12-06T15:00:29.320 INFO:tasks.workunit.client.0.smithi152.stdout:5/472: rename d7/dd/d26/d3b/d46/d7e/fa3 to d7/d43/d6c/d98/fa8 0 2023-12-06T15:00:29.320 INFO:tasks.workunit.client.0.smithi152.stdout:5/473: chown d7/dd/d26 30 1 2023-12-06T15:00:29.321 INFO:tasks.workunit.client.1.smithi190.stdout:4/601: rename d3/d35/d19/d30 to d3/d76/dc4/dc5 0 2023-12-06T15:00:29.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:28 smithi190 ceph-mon[121340]: pgmap v26: 65 pgs: 65 active+clean; 1.3 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 69 MiB/s rd, 143 MiB/s wr, 237 op/s 2023-12-06T15:00:29.323 INFO:tasks.workunit.client.0.smithi152.stdout:3/435: truncate d9/d10/d19/f33 102564 0 2023-12-06T15:00:29.323 INFO:tasks.workunit.client.0.smithi152.stdout:3/436: chown d9/d18/d1a/c23 1376 1 2023-12-06T15:00:29.324 INFO:tasks.workunit.client.0.smithi152.stdout:3/437: mknod d9/d10/c83 0 2023-12-06T15:00:29.326 INFO:tasks.workunit.client.1.smithi190.stdout:5/532: dwrite d0/d1c/d2b/d2c/f43 [0,4194304] 0 2023-12-06T15:00:29.326 INFO:tasks.workunit.client.1.smithi190.stdout:5/533: fdatasync d0/d1c/d2b/f48 0 2023-12-06T15:00:29.326 INFO:tasks.workunit.client.0.smithi152.stdout:1/580: dread d3/da/d4c/d82/d52/d55/f9a [0,4194304] 0 2023-12-06T15:00:29.327 INFO:tasks.workunit.client.0.smithi152.stdout:1/581: rmdir d3/da/d15/d17/d58/da3 39 2023-12-06T15:00:29.328 INFO:tasks.workunit.client.1.smithi190.stdout:1/908: dwrite d6/dc/d29/d38/d73/fde [0,4194304] 0 2023-12-06T15:00:29.329 INFO:tasks.workunit.client.0.smithi152.stdout:1/582: symlink d3/da/d4c/d63/ldc 0 2023-12-06T15:00:29.330 INFO:tasks.workunit.client.1.smithi190.stdout:5/534: creat d0/d1c/d2b/fb8 x:0 0 0 2023-12-06T15:00:29.330 INFO:tasks.workunit.client.1.smithi190.stdout:5/535: write d0/df/d50/f75 [1580905,31437] 0 2023-12-06T15:00:29.331 INFO:tasks.workunit.client.0.smithi152.stdout:3/438: write d9/d10/d12/f3a [4036083,89491] 0 2023-12-06T15:00:29.331 INFO:tasks.workunit.client.1.smithi190.stdout:8/585: sync 2023-12-06T15:00:29.331 INFO:tasks.workunit.client.0.smithi152.stdout:1/583: creat d3/da/d15/d17/d58/da3/fdd x:0 0 0 2023-12-06T15:00:29.332 INFO:tasks.workunit.client.0.smithi152.stdout:3/439: read d9/d10/d12/f3a [1984497,69619] 0 2023-12-06T15:00:29.332 INFO:tasks.workunit.client.0.smithi152.stdout:3/440: truncate d9/f38 5070670 0 2023-12-06T15:00:29.333 INFO:tasks.workunit.client.1.smithi190.stdout:1/909: write d6/d49/f68 [448159,128075] 0 2023-12-06T15:00:29.336 INFO:tasks.workunit.client.0.smithi152.stdout:3/441: link d9/d10/d12/d43/c7d d9/d10/d12/d43/d52/c84 0 2023-12-06T15:00:29.336 INFO:tasks.workunit.client.1.smithi190.stdout:8/586: unlink d1/d20/d3b/d31/f9f 0 2023-12-06T15:00:29.337 INFO:tasks.workunit.client.1.smithi190.stdout:5/536: readlink d0/d1c/d2b/d2c/d5d/d73/l25 0 2023-12-06T15:00:29.338 INFO:tasks.workunit.client.0.smithi152.stdout:3/442: rename d9/d18/f24 to d9/d10/d12/f85 0 2023-12-06T15:00:29.339 INFO:tasks.workunit.client.1.smithi190.stdout:8/587: read d1/d20/d3b/f2d [3130211,67970] 0 2023-12-06T15:00:29.340 INFO:tasks.workunit.client.1.smithi190.stdout:8/588: chown d1/d20/d3b/d4c/d8e/d94/f78 2570962 1 2023-12-06T15:00:29.340 INFO:tasks.workunit.client.1.smithi190.stdout:8/589: fsync d1/d20/d3b/d4c/d8e/d94/d1c/f77 0 2023-12-06T15:00:29.340 INFO:tasks.workunit.client.1.smithi190.stdout:8/590: fdatasync d1/d20/d3b/d4c/d8e/d94/d1c/f77 0 2023-12-06T15:00:29.340 INFO:tasks.workunit.client.1.smithi190.stdout:1/910: symlink d6/dc/d29/d38/d43/l127 0 2023-12-06T15:00:29.340 INFO:tasks.workunit.client.1.smithi190.stdout:1/911: dread - d6/dc/ff2 zero size 2023-12-06T15:00:29.341 INFO:tasks.workunit.client.1.smithi190.stdout:5/537: symlink d0/df/d50/d9c/lb9 0 2023-12-06T15:00:29.341 INFO:tasks.workunit.client.0.smithi152.stdout:3/443: symlink d9/d18/d1a/d65/l86 0 2023-12-06T15:00:29.347 INFO:tasks.workunit.client.1.smithi190.stdout:5/538: mkdir d0/d1c/d85/d90/dba 0 2023-12-06T15:00:29.347 INFO:tasks.workunit.client.1.smithi190.stdout:1/912: mkdir d6/dc/d29/d38/d73/d5c/dd2/d128 0 2023-12-06T15:00:29.347 INFO:tasks.workunit.client.1.smithi190.stdout:5/539: dread - d0/d1c/d2b/fb8 zero size 2023-12-06T15:00:29.347 INFO:tasks.workunit.client.1.smithi190.stdout:5/540: truncate d0/df/f9b 93960 0 2023-12-06T15:00:29.348 INFO:tasks.workunit.client.1.smithi190.stdout:5/541: rmdir d0/d1c/d3e/d7e 39 2023-12-06T15:00:29.348 INFO:tasks.workunit.client.1.smithi190.stdout:5/542: chown d0/f18 5787099 1 2023-12-06T15:00:29.349 INFO:tasks.workunit.client.1.smithi190.stdout:5/543: link d0/d1c/d2b/d69/fac d0/d6c/da7/fbb 0 2023-12-06T15:00:29.350 INFO:tasks.workunit.client.1.smithi190.stdout:5/544: mknod d0/d1c/d2b/d2c/d5d/d73/cbc 0 2023-12-06T15:00:29.350 INFO:tasks.workunit.client.1.smithi190.stdout:5/545: write d0/d1c/d2b/d2c/d5d/fb5 [311295,95408] 0 2023-12-06T15:00:29.351 INFO:tasks.workunit.client.0.smithi152.stdout:7/299: sync 2023-12-06T15:00:29.351 INFO:tasks.workunit.client.1.smithi190.stdout:1/913: write d6/f2f [550142,29372] 0 2023-12-06T15:00:29.351 INFO:tasks.workunit.client.1.smithi190.stdout:1/914: fsync d6/dc/d29/d38/d43/db7/fe4 0 2023-12-06T15:00:29.351 INFO:tasks.workunit.client.1.smithi190.stdout:5/546: symlink d0/d1c/d85/d90/d99/lbd 0 2023-12-06T15:00:29.352 INFO:tasks.workunit.client.1.smithi190.stdout:4/602: dwrite d3/f3f [0,4194304] 0 2023-12-06T15:00:29.352 INFO:tasks.workunit.client.1.smithi190.stdout:4/603: stat d3/d76/d7c/d96/d39/d54/f84 0 2023-12-06T15:00:29.352 INFO:tasks.workunit.client.0.smithi152.stdout:1/584: dwrite d3/da/db/f48 [0,4194304] 0 2023-12-06T15:00:29.354 INFO:tasks.workunit.client.0.smithi152.stdout:1/585: mknod d3/da/d4c/d63/d96/cde 0 2023-12-06T15:00:29.358 INFO:tasks.workunit.client.0.smithi152.stdout:7/300: write dd/f11 [1301143,52806] 0 2023-12-06T15:00:29.421 INFO:tasks.workunit.client.0.smithi152.stdout:7/301: read f7 [10404,85962] 0 2023-12-06T15:00:29.421 INFO:tasks.workunit.client.1.smithi190.stdout:5/547: rename d0/d1c/d2b/d2c/c46 to d0/d1c/d3e/d7e/cbe 0 2023-12-06T15:00:29.422 INFO:tasks.workunit.client.0.smithi152.stdout:7/302: creat dd/df/d1b/d20/f58 x:0 0 0 2023-12-06T15:00:29.423 INFO:tasks.workunit.client.0.smithi152.stdout:7/303: link dd/df/d1b/d20/f58 dd/df/d34/f59 0 2023-12-06T15:00:29.424 INFO:tasks.workunit.client.0.smithi152.stdout:2/318: sync 2023-12-06T15:00:29.424 INFO:tasks.workunit.client.0.smithi152.stdout:0/438: sync 2023-12-06T15:00:29.424 INFO:tasks.workunit.client.1.smithi190.stdout:4/604: rename d3/d4e/fc1 to d3/d76/dc4/dc5/d3c/fc6 0 2023-12-06T15:00:29.424 INFO:tasks.workunit.client.1.smithi190.stdout:4/605: fdatasync d3/d76/d7c/d96/d15/f2f 0 2023-12-06T15:00:29.425 INFO:tasks.workunit.client.1.smithi190.stdout:8/591: dwrite d1/d20/d3b/d31/f57 [0,4194304] 0 2023-12-06T15:00:29.425 INFO:tasks.workunit.client.0.smithi152.stdout:7/304: rename dd/df/d1b/d20/d28/d38/d42/f48 to dd/df/d34/d44/f5a 0 2023-12-06T15:00:29.425 INFO:tasks.workunit.client.0.smithi152.stdout:1/586: dwrite d3/da/db/f97 [0,4194304] 0 2023-12-06T15:00:29.425 INFO:tasks.workunit.client.0.smithi152.stdout:1/587: truncate d3/fb0 159255 0 2023-12-06T15:00:29.427 INFO:tasks.workunit.client.1.smithi190.stdout:5/548: rename d0/l4f to d0/d1c/d2b/d2c/d5d/lbf 0 2023-12-06T15:00:29.427 INFO:tasks.workunit.client.1.smithi190.stdout:5/549: truncate d0/df/f41 519924 0 2023-12-06T15:00:29.427 INFO:tasks.workunit.client.0.smithi152.stdout:1/588: mknod d3/da/d4c/d63/d96/dd8/cdf 0 2023-12-06T15:00:29.428 INFO:tasks.workunit.client.1.smithi190.stdout:4/606: mknod d3/d76/d7c/d96/cc7 0 2023-12-06T15:00:29.430 INFO:tasks.workunit.client.1.smithi190.stdout:8/592: unlink d1/d20/d3b/d4c/d8e/d94/d1c/l21 0 2023-12-06T15:00:29.431 INFO:tasks.workunit.client.1.smithi190.stdout:1/915: dwrite d6/dc/d29/d38/d39/d63/d67/fcc [0,4194304] 0 2023-12-06T15:00:29.432 INFO:tasks.workunit.client.0.smithi152.stdout:7/305: fdatasync f8 0 2023-12-06T15:00:29.432 INFO:tasks.workunit.client.0.smithi152.stdout:0/439: write d8/d3e/f69 [495336,41084] 0 2023-12-06T15:00:29.438 INFO:tasks.workunit.client.0.smithi152.stdout:2/319: dread d6/d18/d43/f50 [0,4194304] 0 2023-12-06T15:00:29.438 INFO:tasks.workunit.client.0.smithi152.stdout:2/320: chown d6/d18/d43 235743 1 2023-12-06T15:00:29.438 INFO:tasks.workunit.client.0.smithi152.stdout:2/321: truncate d6/d1e/d41/f5d 450285 0 2023-12-06T15:00:29.438 INFO:tasks.workunit.client.0.smithi152.stdout:0/440: getdents d8/d3e 0 2023-12-06T15:00:29.441 INFO:tasks.workunit.client.0.smithi152.stdout:2/322: getdents d6/db/d17 0 2023-12-06T15:00:29.445 INFO:tasks.workunit.client.1.smithi190.stdout:1/916: mkdir d6/dc/d29/d129 0 2023-12-06T15:00:29.447 INFO:tasks.workunit.client.1.smithi190.stdout:1/917: symlink d6/dc/d29/l12a 0 2023-12-06T15:00:29.447 INFO:tasks.workunit.client.1.smithi190.stdout:1/918: truncate d6/dc/d3b/d78/d94/d109/f124 812925 0 2023-12-06T15:00:29.449 INFO:tasks.workunit.client.0.smithi152.stdout:0/441: rmdir d8/d3e/d87 39 2023-12-06T15:00:29.449 INFO:tasks.workunit.client.0.smithi152.stdout:0/442: truncate d8/d3e/d87/d76/f74 450194 0 2023-12-06T15:00:29.449 INFO:tasks.workunit.client.0.smithi152.stdout:0/443: stat d8/l56 0 2023-12-06T15:00:29.449 INFO:tasks.workunit.client.0.smithi152.stdout:0/444: truncate d8/d44/f46 906132 0 2023-12-06T15:00:29.449 INFO:tasks.workunit.client.0.smithi152.stdout:0/445: stat d8/d44/f78 0 2023-12-06T15:00:29.450 INFO:tasks.workunit.client.1.smithi190.stdout:1/919: dread d6/dc/fbb [0,4194304] 0 2023-12-06T15:00:29.450 INFO:tasks.workunit.client.1.smithi190.stdout:1/920: chown d6/dc/d29/d38/d73/d76/ffe 26 1 2023-12-06T15:00:29.450 INFO:tasks.workunit.client.1.smithi190.stdout:1/921: chown d6/dc/d29/c35 357678 1 2023-12-06T15:00:29.450 INFO:tasks.workunit.client.1.smithi190.stdout:1/922: fdatasync d6/dc/d29/d38/d73/d5c/dd2/f102 0 2023-12-06T15:00:29.451 INFO:tasks.workunit.client.0.smithi152.stdout:0/446: creat d8/d3e/d87/f8b x:0 0 0 2023-12-06T15:00:29.460 INFO:tasks.workunit.client.0.smithi152.stdout:1/589: dwrite d3/da/db/f81 [0,4194304] 0 2023-12-06T15:00:29.460 INFO:tasks.workunit.client.0.smithi152.stdout:1/590: fdatasync d3/d44/d84/fdb 0 2023-12-06T15:00:29.460 INFO:tasks.workunit.client.0.smithi152.stdout:1/591: chown d3/da/d15/d17/f41 76 1 2023-12-06T15:00:29.461 INFO:tasks.workunit.client.0.smithi152.stdout:2/323: dread d6/f4d [0,4194304] 0 2023-12-06T15:00:29.462 INFO:tasks.workunit.client.0.smithi152.stdout:1/592: write d3/d44/d84/fa9 [2513636,439] 0 2023-12-06T15:00:29.462 INFO:tasks.workunit.client.0.smithi152.stdout:1/593: stat d3/da/f35 0 2023-12-06T15:00:29.462 INFO:tasks.workunit.client.0.smithi152.stdout:7/306: dwrite dd/f2f [0,4194304] 0 2023-12-06T15:00:29.462 INFO:tasks.workunit.client.0.smithi152.stdout:7/307: fsync dd/df/d34/f59 0 2023-12-06T15:00:29.463 INFO:tasks.workunit.client.1.smithi190.stdout:8/593: dwrite d1/d37/f45 [4194304,4194304] 0 2023-12-06T15:00:29.463 INFO:tasks.workunit.client.0.smithi152.stdout:2/324: creat d6/d1e/d41/f60 x:0 0 0 2023-12-06T15:00:29.463 INFO:tasks.workunit.client.0.smithi152.stdout:2/325: chown d6/d1e/f53 2473750 1 2023-12-06T15:00:29.463 INFO:tasks.workunit.client.0.smithi152.stdout:0/447: dread d8/d15/d45/d73/d7a/f34 [0,4194304] 0 2023-12-06T15:00:29.464 INFO:tasks.workunit.client.1.smithi190.stdout:8/594: mkdir d1/d20/d3b/d4c/d59/daa 0 2023-12-06T15:00:29.464 INFO:tasks.workunit.client.0.smithi152.stdout:7/308: symlink dd/df/d1b/l5b 0 2023-12-06T15:00:29.464 INFO:tasks.workunit.client.0.smithi152.stdout:1/594: dread d3/da/d15/d17/d1a/f5f [0,4194304] 0 2023-12-06T15:00:29.465 INFO:tasks.workunit.client.0.smithi152.stdout:2/326: creat d6/db/f61 x:0 0 0 2023-12-06T15:00:29.465 INFO:tasks.workunit.client.1.smithi190.stdout:8/595: write d1/d20/d3b/d34/d39/fa3 [1188064,60567] 0 2023-12-06T15:00:29.465 INFO:tasks.workunit.client.1.smithi190.stdout:8/596: stat d1/d20/f42 0 2023-12-06T15:00:29.466 INFO:tasks.workunit.client.0.smithi152.stdout:0/448: mkdir d8/d15/d45/d73/d8c 0 2023-12-06T15:00:29.466 INFO:tasks.workunit.client.0.smithi152.stdout:0/449: write d8/d3e/f57 [1118127,114111] 0 2023-12-06T15:00:29.467 INFO:tasks.workunit.client.1.smithi190.stdout:8/597: unlink d1/d20/d3b/d4c/d59/f93 0 2023-12-06T15:00:29.467 INFO:tasks.workunit.client.1.smithi190.stdout:8/598: write d1/d20/d3b/d4d/f91 [854882,106003] 0 2023-12-06T15:00:29.467 INFO:tasks.workunit.client.0.smithi152.stdout:1/595: mknod d3/da/d15/d17/d58/d9f/ce0 0 2023-12-06T15:00:29.467 INFO:tasks.workunit.client.0.smithi152.stdout:2/327: creat d6/d1e/f62 x:0 0 0 2023-12-06T15:00:29.468 INFO:tasks.workunit.client.0.smithi152.stdout:0/450: creat d8/d3e/d87/f8d x:0 0 0 2023-12-06T15:00:29.469 INFO:tasks.workunit.client.1.smithi190.stdout:1/923: dwrite d6/dc/d29/d38/d43/d7f/f11e [0,4194304] 0 2023-12-06T15:00:29.469 INFO:tasks.workunit.client.1.smithi190.stdout:1/924: chown d6/dc/d29/d38/d39/d63/d67/f7d 1962634 1 2023-12-06T15:00:29.469 INFO:tasks.workunit.client.1.smithi190.stdout:1/925: fdatasync d6/dc/d3b/d78/d94/d109/f124 0 2023-12-06T15:00:29.469 INFO:tasks.workunit.client.1.smithi190.stdout:1/926: chown d6/d49/d74 15 1 2023-12-06T15:00:29.469 INFO:tasks.workunit.client.1.smithi190.stdout:8/599: rmdir d1/d20/d3b/d31 39 2023-12-06T15:00:29.470 INFO:tasks.workunit.client.0.smithi152.stdout:1/596: rmdir d3/da/d15/d17/d4d 39 2023-12-06T15:00:29.471 INFO:tasks.workunit.client.0.smithi152.stdout:1/597: read d3/da/db/d54/f6a [2449874,86819] 0 2023-12-06T15:00:29.471 INFO:tasks.workunit.client.0.smithi152.stdout:2/328: symlink d6/l63 0 2023-12-06T15:00:29.472 INFO:tasks.workunit.client.0.smithi152.stdout:0/451: creat d8/d15/f8e x:0 0 0 2023-12-06T15:00:29.472 INFO:tasks.workunit.client.1.smithi190.stdout:1/927: creat d6/dc/d29/ded/d116/f12b x:0 0 0 2023-12-06T15:00:29.474 INFO:tasks.workunit.client.0.smithi152.stdout:2/329: creat d6/d1e/f64 x:0 0 0 2023-12-06T15:00:29.474 INFO:tasks.workunit.client.0.smithi152.stdout:2/330: readlink d6/l29 0 2023-12-06T15:00:29.474 INFO:tasks.workunit.client.1.smithi190.stdout:8/600: mknod d1/d37/cab 0 2023-12-06T15:00:29.476 INFO:tasks.workunit.client.0.smithi152.stdout:1/598: creat d3/da/d4c/d82/d52/d62/dcc/fe1 x:0 0 0 2023-12-06T15:00:29.477 INFO:tasks.workunit.client.1.smithi190.stdout:8/601: unlink d1/d20/d3b/d4c/f7f 0 2023-12-06T15:00:29.477 INFO:tasks.workunit.client.0.smithi152.stdout:2/331: creat d6/d1e/d41/d55/f65 x:0 0 0 2023-12-06T15:00:29.477 INFO:tasks.workunit.client.0.smithi152.stdout:2/332: fdatasync f5 0 2023-12-06T15:00:29.478 INFO:tasks.workunit.client.1.smithi190.stdout:8/602: link d1/d20/d3b/d4c/d8e/d94/f80 d1/d20/d3b/d4c/d8e/fac 0 2023-12-06T15:00:29.478 INFO:tasks.workunit.client.0.smithi152.stdout:1/599: mkdir d3/d44/d84/de2 0 2023-12-06T15:00:29.478 INFO:tasks.workunit.client.0.smithi152.stdout:1/600: dread - d3/da/d15/d17/f86 zero size 2023-12-06T15:00:29.479 INFO:tasks.workunit.client.0.smithi152.stdout:1/601: creat d3/d44/d84/fe3 x:0 0 0 2023-12-06T15:00:29.479 INFO:tasks.workunit.client.0.smithi152.stdout:1/602: write d3/d44/d84/fdb [390719,7218] 0 2023-12-06T15:00:29.479 INFO:tasks.workunit.client.1.smithi190.stdout:7/725: sync 2023-12-06T15:00:29.479 INFO:tasks.workunit.client.1.smithi190.stdout:0/610: sync 2023-12-06T15:00:29.479 INFO:tasks.workunit.client.1.smithi190.stdout:3/746: sync 2023-12-06T15:00:29.479 INFO:tasks.workunit.client.1.smithi190.stdout:2/589: sync 2023-12-06T15:00:29.479 INFO:tasks.workunit.client.1.smithi190.stdout:2/590: stat ff 0 2023-12-06T15:00:29.480 INFO:tasks.workunit.client.1.smithi190.stdout:6/723: sync 2023-12-06T15:00:29.480 INFO:tasks.workunit.client.1.smithi190.stdout:9/729: sync 2023-12-06T15:00:29.481 INFO:tasks.workunit.client.0.smithi152.stdout:7/309: dwrite dd/df/d34/d44/d49/f54 [0,4194304] 0 2023-12-06T15:00:29.481 INFO:tasks.workunit.client.1.smithi190.stdout:7/726: unlink d0/d5/l6d 0 2023-12-06T15:00:29.481 INFO:tasks.workunit.client.1.smithi190.stdout:7/727: getdents d0/d88/d41 0 2023-12-06T15:00:29.481 INFO:tasks.workunit.client.1.smithi190.stdout:7/728: truncate d0/df/d53/d2f/de9/d56/fcf 859543 0 2023-12-06T15:00:29.482 INFO:tasks.workunit.client.1.smithi190.stdout:7/729: write d0/d88/d7a/fd2 [736390,128721] 0 2023-12-06T15:00:29.483 INFO:tasks.workunit.client.1.smithi190.stdout:7/730: dread d0/d5/d63/f96 [4194304,4194304] 0 2023-12-06T15:00:29.483 INFO:tasks.workunit.client.1.smithi190.stdout:7/731: truncate d0/d88/d1c/fd0 442162 0 2023-12-06T15:00:29.483 INFO:tasks.workunit.client.1.smithi190.stdout:0/611: creat d0/da/da4/db1/fc3 x:0 0 0 2023-12-06T15:00:29.485 INFO:tasks.workunit.client.1.smithi190.stdout:3/747: dread d4/d70/d19/d51/f5f [0,4194304] 0 2023-12-06T15:00:29.485 INFO:tasks.workunit.client.0.smithi152.stdout:7/310: getdents dd/df/d1b 0 2023-12-06T15:00:29.487 INFO:tasks.workunit.client.0.smithi152.stdout:0/452: rmdir d8/d15 39 2023-12-06T15:00:29.489 INFO:tasks.workunit.client.1.smithi190.stdout:8/603: dread d1/fb [0,4194304] 0 2023-12-06T15:00:29.489 INFO:tasks.workunit.client.1.smithi190.stdout:2/591: mkdir d10/d59/d5e/d71/dad/dc9 0 2023-12-06T15:00:29.489 INFO:tasks.workunit.client.1.smithi190.stdout:9/730: rmdir d4/d27/d2f/d31/d3f 39 2023-12-06T15:00:29.489 INFO:tasks.workunit.client.1.smithi190.stdout:9/731: read - d4/d27/d8a/f92 zero size 2023-12-06T15:00:29.489 INFO:tasks.workunit.client.1.smithi190.stdout:6/724: symlink d4/d12/d40/d43/d45/d4a/d77/dca/lf0 0 2023-12-06T15:00:29.490 INFO:tasks.workunit.client.0.smithi152.stdout:0/453: mknod d8/d3e/d87/d76/d6e/c8f 0 2023-12-06T15:00:29.490 INFO:tasks.workunit.client.0.smithi152.stdout:7/311: write f3 [3602584,111130] 0 2023-12-06T15:00:29.495 INFO:tasks.workunit.client.0.smithi152.stdout:0/454: creat d8/d3e/d87/f90 x:0 0 0 2023-12-06T15:00:29.496 INFO:tasks.workunit.client.1.smithi190.stdout:7/732: rename d0/d88/fb4 to d0/d88/fec 0 2023-12-06T15:00:29.496 INFO:tasks.workunit.client.1.smithi190.stdout:7/733: readlink d0/l2b 0 2023-12-06T15:00:29.496 INFO:tasks.workunit.client.1.smithi190.stdout:3/748: creat d4/d70/d19/d3a/f106 x:0 0 0 2023-12-06T15:00:29.496 INFO:tasks.workunit.client.1.smithi190.stdout:0/612: creat d0/da/d3e/d2b/d37/fc4 x:0 0 0 2023-12-06T15:00:29.496 INFO:tasks.workunit.client.1.smithi190.stdout:7/734: fdatasync d0/df/d53/d2f/de9/d56/f85 0 2023-12-06T15:00:29.496 INFO:tasks.workunit.client.1.smithi190.stdout:0/613: stat d0/da/f5b 0 2023-12-06T15:00:29.500 INFO:tasks.workunit.client.0.smithi152.stdout:7/312: rename dd/c10 to dd/df/d1b/d20/d28/d38/c5c 0 2023-12-06T15:00:29.501 INFO:tasks.workunit.client.1.smithi190.stdout:2/592: creat d10/d59/d5e/d71/dad/dc4/fca x:0 0 0 2023-12-06T15:00:29.502 INFO:tasks.workunit.client.0.smithi152.stdout:7/313: link dd/df/d34/f59 dd/df/d1b/d20/d28/d38/f5d 0 2023-12-06T15:00:29.502 INFO:tasks.workunit.client.1.smithi190.stdout:9/732: mknod d4/d27/cf0 0 2023-12-06T15:00:29.503 INFO:tasks.workunit.client.0.smithi152.stdout:7/314: getdents dd/df/d34 0 2023-12-06T15:00:29.503 INFO:tasks.workunit.client.0.smithi152.stdout:7/315: chown dd/df/d1b/d20/f35 61834047 1 2023-12-06T15:00:29.503 INFO:tasks.workunit.client.1.smithi190.stdout:3/749: getdents d4/d1b/d54/d9c/d68/dfc/dc4 0 2023-12-06T15:00:29.504 INFO:tasks.workunit.client.0.smithi152.stdout:2/333: dwrite d6/d1e/f2f [0,4194304] 0 2023-12-06T15:00:29.504 INFO:tasks.workunit.client.0.smithi152.stdout:7/316: link dd/df/d1b/d20/d28/f30 dd/df/f5e 0 2023-12-06T15:00:29.504 INFO:tasks.workunit.client.0.smithi152.stdout:7/317: write dd/df/d34/d44/f5a [662691,127822] 0 2023-12-06T15:00:29.504 INFO:tasks.workunit.client.0.smithi152.stdout:7/318: read - dd/df/d1b/d20/f4d zero size 2023-12-06T15:00:29.505 INFO:tasks.workunit.client.1.smithi190.stdout:0/614: rename d0/da/da4/fc2 to d0/da/d74/fc5 0 2023-12-06T15:00:29.505 INFO:tasks.workunit.client.1.smithi190.stdout:0/615: chown d0/da/d3e/d2b/d3c/c42 1886665846 1 2023-12-06T15:00:29.505 INFO:tasks.workunit.client.1.smithi190.stdout:2/593: rename d10/d26/d5c/d35/d77 to d10/d26/d5c/d35/d77/dcb 22 2023-12-06T15:00:29.506 INFO:tasks.workunit.client.0.smithi152.stdout:2/334: creat d6/db/f66 x:0 0 0 2023-12-06T15:00:29.506 INFO:tasks.workunit.client.1.smithi190.stdout:7/735: creat d0/d88/d1c/d17/d94/d95/fed x:0 0 0 2023-12-06T15:00:29.506 INFO:tasks.workunit.client.0.smithi152.stdout:7/319: symlink dd/df/d34/d44/l5f 0 2023-12-06T15:00:29.507 INFO:tasks.workunit.client.0.smithi152.stdout:1/603: dwrite d3/da/d4c/d82/d52/fd7 [0,4194304] 0 2023-12-06T15:00:29.507 INFO:tasks.workunit.client.0.smithi152.stdout:1/604: dread - d3/d44/d84/fe3 zero size 2023-12-06T15:00:29.507 INFO:tasks.workunit.client.0.smithi152.stdout:2/335: mknod d6/d18/d43/c67 0 2023-12-06T15:00:29.507 INFO:tasks.workunit.client.0.smithi152.stdout:2/336: write d6/d1e/d41/f5d [830753,32025] 0 2023-12-06T15:00:29.508 INFO:tasks.workunit.client.1.smithi190.stdout:9/733: unlink d4/d27/d2f/d31/d3f/fcb 0 2023-12-06T15:00:29.508 INFO:tasks.workunit.client.0.smithi152.stdout:7/320: creat dd/df/d1b/d20/d28/d38/f60 x:0 0 0 2023-12-06T15:00:29.508 INFO:tasks.workunit.client.0.smithi152.stdout:7/321: write dd/df/d1b/d20/d28/d38/f39 [119492,23123] 0 2023-12-06T15:00:29.513 INFO:tasks.workunit.client.1.smithi190.stdout:0/616: write d0/da/d3e/d2b/d3c/d46/f73 [2357422,24755] 0 2023-12-06T15:00:29.515 INFO:tasks.workunit.client.1.smithi190.stdout:0/617: creat d0/da/d3e/d3a/d40/d6f/dc0/fc6 x:0 0 0 2023-12-06T15:00:29.516 INFO:tasks.workunit.client.1.smithi190.stdout:0/618: symlink d0/da/d3e/d3a/lc7 0 2023-12-06T15:00:29.517 INFO:tasks.workunit.client.1.smithi190.stdout:6/725: dwrite d4/d12/d40/d43/d45/d4a/d77/dca/fa4 [0,4194304] 0 2023-12-06T15:00:29.517 INFO:tasks.workunit.client.1.smithi190.stdout:6/726: readlink d4/l72 0 2023-12-06T15:00:29.517 INFO:tasks.workunit.client.1.smithi190.stdout:6/727: chown d4/d12/d40/d43/le8 856 1 2023-12-06T15:00:29.517 INFO:tasks.workunit.client.1.smithi190.stdout:8/604: dwrite d1/d37/f45 [4194304,4194304] 0 2023-12-06T15:00:29.517 INFO:tasks.workunit.client.1.smithi190.stdout:8/605: readlink d1/d20/d3b/d4c/d8e/d94/d1c/l49 0 2023-12-06T15:00:29.518 INFO:tasks.workunit.client.1.smithi190.stdout:8/606: write d1/d20/d3b/d34/d39/fa3 [2041719,77064] 0 2023-12-06T15:00:29.518 INFO:tasks.workunit.client.1.smithi190.stdout:9/734: dread d4/f17 [0,4194304] 0 2023-12-06T15:00:29.519 INFO:tasks.workunit.client.1.smithi190.stdout:6/728: read d4/d12/d1a/f97 [4007325,126201] 0 2023-12-06T15:00:29.519 INFO:tasks.workunit.client.1.smithi190.stdout:6/729: write d4/d12/d40/d43/d45/d4a/d77/fb5 [551603,115736] 0 2023-12-06T15:00:29.521 INFO:tasks.workunit.client.1.smithi190.stdout:0/619: mkdir d0/da/d5a/dc8 0 2023-12-06T15:00:29.523 INFO:tasks.workunit.client.1.smithi190.stdout:6/730: dread d4/d12/d1a/d8a/fa7 [0,4194304] 0 2023-12-06T15:00:29.526 INFO:tasks.workunit.client.1.smithi190.stdout:8/607: creat d1/d20/d3b/fad x:0 0 0 2023-12-06T15:00:29.526 INFO:tasks.workunit.client.1.smithi190.stdout:8/608: readlink d1/d20/l70 0 2023-12-06T15:00:29.526 INFO:tasks.workunit.client.1.smithi190.stdout:8/609: chown d1/d20/d3b/d4c/d8e/d94/d25/c2b 53220 1 2023-12-06T15:00:29.526 INFO:tasks.workunit.client.1.smithi190.stdout:0/620: creat d0/da/d3e/fc9 x:0 0 0 2023-12-06T15:00:29.527 INFO:tasks.workunit.client.1.smithi190.stdout:2/594: dwrite d10/d59/d5e/d71/dad/dc4/d7f/d8e/fbd [0,4194304] 0 2023-12-06T15:00:29.528 INFO:tasks.workunit.client.1.smithi190.stdout:9/735: dread d4/f13 [4194304,4194304] 0 2023-12-06T15:00:29.528 INFO:tasks.workunit.client.1.smithi190.stdout:9/736: fdatasync d4/d27/d2f/d5c/fa4 0 2023-12-06T15:00:29.528 INFO:tasks.workunit.client.1.smithi190.stdout:9/737: chown d4/d27/d2f/d31/d3f/d58/f59 558424 1 2023-12-06T15:00:29.529 INFO:tasks.workunit.client.1.smithi190.stdout:7/736: dwrite d0/d35/d8e/f9a [0,4194304] 0 2023-12-06T15:00:29.530 INFO:tasks.workunit.client.1.smithi190.stdout:6/731: link d4/f30 d4/d12/d1a/d8c/ded/ff1 0 2023-12-06T15:00:29.530 INFO:tasks.workunit.client.1.smithi190.stdout:8/610: symlink d1/d20/d3b/d4c/d8e/d94/d1c/d4b/lae 0 2023-12-06T15:00:29.532 INFO:tasks.workunit.client.1.smithi190.stdout:2/595: write d10/d59/d5e/d71/dad/fbf [2885773,117707] 0 2023-12-06T15:00:29.534 INFO:tasks.workunit.client.1.smithi190.stdout:0/621: link d0/da/d3e/d3a/d40/d81/f63 d0/da/d3e/d3a/d40/d6f/d9e/fca 0 2023-12-06T15:00:29.534 INFO:tasks.workunit.client.1.smithi190.stdout:0/622: chown d0/da 106163639 1 2023-12-06T15:00:29.534 INFO:tasks.workunit.client.1.smithi190.stdout:7/737: dread d0/df/d1f/f46 [0,4194304] 0 2023-12-06T15:00:29.539 INFO:tasks.workunit.client.1.smithi190.stdout:2/596: symlink d10/d59/d5e/d71/dad/dc4/lcc 0 2023-12-06T15:00:29.545 INFO:tasks.workunit.client.1.smithi190.stdout:8/611: dread d1/f16 [0,4194304] 0 2023-12-06T15:00:29.545 INFO:tasks.workunit.client.1.smithi190.stdout:8/612: truncate d1/d20/d3b/d4d/f9c 157848 0 2023-12-06T15:00:29.545 INFO:tasks.workunit.client.1.smithi190.stdout:8/613: chown d1/d20/d3b/d7e/fa8 26277229 1 2023-12-06T15:00:29.545 INFO:tasks.workunit.client.1.smithi190.stdout:7/738: write d0/df/d53/d2f/de9/d56/fcf [425016,66860] 0 2023-12-06T15:00:29.546 INFO:tasks.workunit.client.1.smithi190.stdout:8/614: symlink d1/d20/laf 0 2023-12-06T15:00:29.546 INFO:tasks.workunit.client.1.smithi190.stdout:8/615: truncate d1/d20/d3b/d4d/f9c 824490 0 2023-12-06T15:00:29.548 INFO:tasks.workunit.client.1.smithi190.stdout:7/739: creat d0/df/d53/d2f/fee x:0 0 0 2023-12-06T15:00:29.549 INFO:tasks.workunit.client.1.smithi190.stdout:8/616: symlink d1/d20/d3b/d4c/d8e/d94/d25/lb0 0 2023-12-06T15:00:29.550 INFO:tasks.workunit.client.1.smithi190.stdout:7/740: mknod d0/df/d53/d2f/de9/cef 0 2023-12-06T15:00:29.551 INFO:tasks.workunit.client.1.smithi190.stdout:8/617: mknod d1/d20/d3b/d4c/d59/d7d/cb1 0 2023-12-06T15:00:29.552 INFO:tasks.workunit.client.1.smithi190.stdout:8/618: chown d1/d20/l61 121935440 1 2023-12-06T15:00:29.553 INFO:tasks.workunit.client.1.smithi190.stdout:8/619: symlink d1/d20/d3b/d4c/d8e/d94/lb2 0 2023-12-06T15:00:29.554 INFO:tasks.workunit.client.1.smithi190.stdout:8/620: symlink d1/d20/d3b/lb3 0 2023-12-06T15:00:29.554 INFO:tasks.workunit.client.1.smithi190.stdout:8/621: dread - d1/d20/d3b/fad zero size 2023-12-06T15:00:29.555 INFO:tasks.workunit.client.1.smithi190.stdout:8/622: write d1/d20/d3b/d4c/d8e/d94/d1c/f9b [464860,79024] 0 2023-12-06T15:00:29.558 INFO:tasks.workunit.client.1.smithi190.stdout:8/623: dread d1/f16 [0,4194304] 0 2023-12-06T15:00:29.559 INFO:tasks.workunit.client.1.smithi190.stdout:8/624: dread d1/d20/d3b/d4c/d8e/d94/d25/f2a [0,4194304] 0 2023-12-06T15:00:29.561 INFO:tasks.workunit.client.1.smithi190.stdout:8/625: mkdir d1/d20/d3b/d4c/d59/d7d/db4 0 2023-12-06T15:00:29.561 INFO:tasks.workunit.client.1.smithi190.stdout:8/626: creat d1/d20/d3b/d36/fb5 x:0 0 0 2023-12-06T15:00:29.563 INFO:tasks.workunit.client.1.smithi190.stdout:8/627: mkdir d1/d20/d3b/d4c/d8e/d94/db6 0 2023-12-06T15:00:29.563 INFO:tasks.workunit.client.1.smithi190.stdout:8/628: write d1/d20/d3b/d4c/d8e/d94/f80 [250197,109124] 0 2023-12-06T15:00:29.564 INFO:tasks.workunit.client.1.smithi190.stdout:8/629: getdents d1/d37 0 2023-12-06T15:00:29.566 INFO:tasks.workunit.client.0.smithi152.stdout:1/605: creat d3/da/d15/d17/d58/fe4 x:0 0 0 2023-12-06T15:00:29.566 INFO:tasks.workunit.client.0.smithi152.stdout:1/606: readlink d3/d44/l8b 0 2023-12-06T15:00:29.568 INFO:tasks.workunit.client.0.smithi152.stdout:2/337: mknod d6/d18/d43/c68 0 2023-12-06T15:00:29.568 INFO:tasks.workunit.client.0.smithi152.stdout:2/338: fdatasync d6/d1e/f62 0 2023-12-06T15:00:29.571 INFO:tasks.workunit.client.0.smithi152.stdout:1/607: mknod d3/d44/d84/de2/ce5 0 2023-12-06T15:00:29.572 INFO:tasks.workunit.client.0.smithi152.stdout:2/339: symlink d6/d18/l69 0 2023-12-06T15:00:29.572 INFO:tasks.workunit.client.0.smithi152.stdout:2/340: chown d6/db/c4c 4 1 2023-12-06T15:00:29.574 INFO:tasks.workunit.client.0.smithi152.stdout:2/341: creat d6/f6a x:0 0 0 2023-12-06T15:00:29.575 INFO:tasks.workunit.client.0.smithi152.stdout:2/342: rename d6/d1e/c3f to d6/d1e/d41/d55/c6b 0 2023-12-06T15:00:29.578 INFO:tasks.workunit.client.1.smithi190.stdout:9/738: dwrite d4/d27/d2f/d31/d3f/d58/fe9 [0,4194304] 0 2023-12-06T15:00:29.580 INFO:tasks.workunit.client.1.smithi190.stdout:6/732: dwrite d4/d12/d1a/d32/dc7/dd0/fd6 [0,4194304] 0 2023-12-06T15:00:29.580 INFO:tasks.workunit.client.1.smithi190.stdout:0/623: dwrite d0/f2e [0,4194304] 0 2023-12-06T15:00:29.581 INFO:tasks.workunit.client.0.smithi152.stdout:7/322: getdents dd/df/d34/d44 0 2023-12-06T15:00:29.582 INFO:tasks.workunit.client.1.smithi190.stdout:9/739: mkdir d4/d27/d2f/d31/d3f/d58/d72/db3/dea/dcd/df1 0 2023-12-06T15:00:29.583 INFO:tasks.workunit.client.1.smithi190.stdout:9/740: dread d4/f22 [0,4194304] 0 2023-12-06T15:00:29.585 INFO:tasks.workunit.client.1.smithi190.stdout:6/733: creat d4/d12/d1a/d70/ff2 x:0 0 0 2023-12-06T15:00:29.586 INFO:tasks.workunit.client.1.smithi190.stdout:7/741: dwrite d0/d88/d33/fc2 [0,4194304] 0 2023-12-06T15:00:29.586 INFO:tasks.workunit.client.1.smithi190.stdout:0/624: link d0/da/d74/fc5 d0/da/d3e/d2b/d3c/d65/fcb 0 2023-12-06T15:00:29.592 INFO:tasks.workunit.client.0.smithi152.stdout:1/608: dwrite d3/da/d4c/d82/d52/fd7 [0,4194304] 0 2023-12-06T15:00:29.592 INFO:tasks.workunit.client.1.smithi190.stdout:6/734: rmdir d4/d12/d40/d43/d45/d4a/d77 39 2023-12-06T15:00:29.593 INFO:tasks.workunit.client.0.smithi152.stdout:1/609: mkdir d3/da/d15/d17/d43/de6 0 2023-12-06T15:00:29.596 INFO:tasks.workunit.client.0.smithi152.stdout:1/610: mknod d3/da/d4c/d63/d96/ce7 0 2023-12-06T15:00:29.599 INFO:tasks.workunit.client.1.smithi190.stdout:7/742: symlink d0/d88/d32/lf0 0 2023-12-06T15:00:29.599 INFO:tasks.workunit.client.1.smithi190.stdout:7/743: truncate d0/d5/dba/fe0 916535 0 2023-12-06T15:00:29.600 INFO:tasks.workunit.client.0.smithi152.stdout:1/611: link d3/d44/f78 d3/da/d15/d17/d43/de6/fe8 0 2023-12-06T15:00:29.601 INFO:tasks.workunit.client.1.smithi190.stdout:0/625: mkdir d0/da/d3e/d2b/d3c/d4c/dcc 0 2023-12-06T15:00:29.602 INFO:tasks.workunit.client.0.smithi152.stdout:1/612: mknod d3/d44/d84/de2/ce9 0 2023-12-06T15:00:29.603 INFO:tasks.workunit.client.1.smithi190.stdout:6/735: creat d4/d12/d40/d43/ff3 x:0 0 0 2023-12-06T15:00:29.604 INFO:tasks.workunit.client.0.smithi152.stdout:1/613: mknod d3/da/dcd/dd9/cea 0 2023-12-06T15:00:29.605 INFO:tasks.workunit.client.1.smithi190.stdout:0/626: creat d0/da/d5a/fcd x:0 0 0 2023-12-06T15:00:29.606 INFO:tasks.workunit.client.0.smithi152.stdout:1/614: rename d3/da/d15/d17/d4d/l6f to d3/da/d4c/d63/d96/dd8/leb 0 2023-12-06T15:00:29.607 INFO:tasks.workunit.client.1.smithi190.stdout:0/627: link d0/da/d3e/d3a/d40/d6f/fbe d0/da/d3e/d3a/d40/d6f/d9e/dbb/fce 0 2023-12-06T15:00:29.609 INFO:tasks.workunit.client.0.smithi152.stdout:1/615: mknod d3/da/d4c/d82/d52/d62/dcc/cec 0 2023-12-06T15:00:29.609 INFO:tasks.workunit.client.0.smithi152.stdout:1/616: chown d3/d44/l8b 2111146057 1 2023-12-06T15:00:29.609 INFO:tasks.workunit.client.0.smithi152.stdout:1/617: truncate d3/da/d4c/d82/d52/d55/f74 1141847 0 2023-12-06T15:00:29.610 INFO:tasks.workunit.client.0.smithi152.stdout:1/618: dread d3/fb0 [0,4194304] 0 2023-12-06T15:00:29.610 INFO:tasks.workunit.client.0.smithi152.stdout:1/619: chown d3/da/d15/d17/d4d/cbb 17269512 1 2023-12-06T15:00:29.614 INFO:tasks.workunit.client.1.smithi190.stdout:7/744: dread d0/d88/d33/d4c/f75 [0,4194304] 0 2023-12-06T15:00:29.616 INFO:tasks.workunit.client.1.smithi190.stdout:7/745: mkdir d0/d88/d1c/d17/d94/df1 0 2023-12-06T15:00:29.617 INFO:tasks.workunit.client.1.smithi190.stdout:9/741: dwrite d4/d27/d8a/fb1 [0,4194304] 0 2023-12-06T15:00:29.619 INFO:tasks.workunit.client.0.smithi152.stdout:2/343: dwrite d6/d1e/f2e [0,4194304] 0 2023-12-06T15:00:29.620 INFO:tasks.workunit.client.1.smithi190.stdout:7/746: rename d0/df/d5f/fa3 to d0/df/d5f/ff2 0 2023-12-06T15:00:29.620 INFO:tasks.workunit.client.1.smithi190.stdout:7/747: readlink d0/df/d53/d2f/de9/l47 0 2023-12-06T15:00:29.620 INFO:tasks.workunit.client.0.smithi152.stdout:7/323: dwrite dd/f24 [0,4194304] 0 2023-12-06T15:00:29.621 INFO:tasks.workunit.client.1.smithi190.stdout:6/736: write d4/d12/f53 [753093,118014] 0 2023-12-06T15:00:29.621 INFO:tasks.workunit.client.1.smithi190.stdout:9/742: unlink d4/d27/f4d 0 2023-12-06T15:00:29.624 INFO:tasks.workunit.client.1.smithi190.stdout:7/748: rmdir d0/d35 39 2023-12-06T15:00:29.626 INFO:tasks.workunit.client.1.smithi190.stdout:9/743: truncate d4/d27/d2f/d31/d3f/f55 2453379 0 2023-12-06T15:00:29.629 INFO:tasks.workunit.client.1.smithi190.stdout:9/744: mknod d4/d27/d2f/d31/d3f/d58/cf2 0 2023-12-06T15:00:29.631 INFO:tasks.workunit.client.1.smithi190.stdout:0/628: dwrite d0/da/d3e/d3a/d40/f28 [4194304,4194304] 0 2023-12-06T15:00:29.631 INFO:tasks.workunit.client.0.smithi152.stdout:2/344: dread d6/f4d [0,4194304] 0 2023-12-06T15:00:29.631 INFO:tasks.workunit.client.0.smithi152.stdout:2/345: truncate d6/d1e/f62 501808 0 2023-12-06T15:00:29.634 INFO:tasks.workunit.client.0.smithi152.stdout:2/346: getdents d6/db 0 2023-12-06T15:00:29.634 INFO:tasks.workunit.client.0.smithi152.stdout:2/347: dread - d6/d18/d43/f5f zero size 2023-12-06T15:00:29.634 INFO:tasks.workunit.client.0.smithi152.stdout:2/348: stat d6/d1e/f64 0 2023-12-06T15:00:29.634 INFO:tasks.workunit.client.1.smithi190.stdout:9/745: unlink d4/d27/d2f/d31/d3f/d58/ccc 0 2023-12-06T15:00:29.635 INFO:tasks.workunit.client.0.smithi152.stdout:2/349: mknod d6/db/c6c 0 2023-12-06T15:00:29.637 INFO:tasks.workunit.client.1.smithi190.stdout:9/746: read d4/d27/d8a/f95 [3428914,47657] 0 2023-12-06T15:00:29.638 INFO:tasks.workunit.client.0.smithi152.stdout:2/350: creat d6/d18/d43/f6d x:0 0 0 2023-12-06T15:00:29.638 INFO:tasks.workunit.client.0.smithi152.stdout:2/351: fdatasync f5 0 2023-12-06T15:00:29.639 INFO:tasks.workunit.client.1.smithi190.stdout:0/629: write d0/da/d5a/f95 [2282658,109676] 0 2023-12-06T15:00:29.640 INFO:tasks.workunit.client.1.smithi190.stdout:9/747: rmdir d4/d27/d2f/d31/d3f/d58/d72/db3 39 2023-12-06T15:00:29.640 INFO:tasks.workunit.client.0.smithi152.stdout:2/352: getdents d6/d1e 0 2023-12-06T15:00:29.640 INFO:tasks.workunit.client.0.smithi152.stdout:7/324: dread f3 [0,4194304] 0 2023-12-06T15:00:29.641 INFO:tasks.workunit.client.0.smithi152.stdout:7/325: write dd/df/d1b/d20/f58 [658026,111979] 0 2023-12-06T15:00:29.642 INFO:tasks.workunit.client.1.smithi190.stdout:9/748: symlink d4/d27/d2f/d31/d3f/d58/d72/db3/dea/dcd/lf3 0 2023-12-06T15:00:29.642 INFO:tasks.workunit.client.0.smithi152.stdout:2/353: creat d6/d1e/f6e x:0 0 0 2023-12-06T15:00:29.644 INFO:tasks.workunit.client.1.smithi190.stdout:9/749: write d4/d27/d2f/d31/d3f/d58/d72/f75 [2523844,71459] 0 2023-12-06T15:00:29.644 INFO:tasks.workunit.client.0.smithi152.stdout:2/354: dread - d6/d1e/d41/d55/f65 zero size 2023-12-06T15:00:29.645 INFO:tasks.workunit.client.0.smithi152.stdout:2/355: stat d6/d1e/c21 0 2023-12-06T15:00:29.645 INFO:tasks.workunit.client.0.smithi152.stdout:2/356: fdatasync d6/db/f47 0 2023-12-06T15:00:29.646 INFO:tasks.workunit.client.1.smithi190.stdout:0/630: read d0/da/d3e/d3a/d40/d6f/f93 [742371,99091] 0 2023-12-06T15:00:29.646 INFO:tasks.workunit.client.0.smithi152.stdout:2/357: creat d6/d18/d43/f6f x:0 0 0 2023-12-06T15:00:29.646 INFO:tasks.workunit.client.0.smithi152.stdout:2/358: stat d6/db/c4e 0 2023-12-06T15:00:29.647 INFO:tasks.workunit.client.1.smithi190.stdout:0/631: creat d0/da/d3e/d87/fcf x:0 0 0 2023-12-06T15:00:29.647 INFO:tasks.workunit.client.1.smithi190.stdout:0/632: mknod d0/da/d3e/d3a/d40/d6f/d9e/cd0 0 2023-12-06T15:00:29.648 INFO:tasks.workunit.client.0.smithi152.stdout:2/359: mkdir d6/d18/d70 0 2023-12-06T15:00:29.648 INFO:tasks.workunit.client.0.smithi152.stdout:2/360: symlink d6/d18/d43/l71 0 2023-12-06T15:00:29.649 INFO:tasks.workunit.client.0.smithi152.stdout:2/361: write d6/db/d17/f46 [572205,106360] 0 2023-12-06T15:00:29.650 INFO:tasks.workunit.client.0.smithi152.stdout:2/362: creat d6/db/f72 x:0 0 0 2023-12-06T15:00:29.651 INFO:tasks.workunit.client.0.smithi152.stdout:1/620: dwrite d3/da/d4c/d82/d52/d55/f56 [0,4194304] 0 2023-12-06T15:00:29.652 INFO:tasks.workunit.client.0.smithi152.stdout:2/363: symlink d6/d18/d43/l73 0 2023-12-06T15:00:29.653 INFO:tasks.workunit.client.1.smithi190.stdout:9/750: dread d4/d27/d2f/d31/d3f/d58/d72/db3/fc7 [0,4194304] 0 2023-12-06T15:00:29.654 INFO:tasks.workunit.client.0.smithi152.stdout:2/364: creat d6/db/d17/f74 x:0 0 0 2023-12-06T15:00:29.656 INFO:tasks.workunit.client.1.smithi190.stdout:9/751: symlink d4/d27/d2f/d31/d3f/d58/dc5/lf4 0 2023-12-06T15:00:29.658 INFO:tasks.workunit.client.1.smithi190.stdout:9/752: rename d4/d27/fc0 to d4/d27/d2f/d31/ff5 0 2023-12-06T15:00:29.659 INFO:tasks.workunit.client.1.smithi190.stdout:9/753: creat d4/d27/d2f/d31/d3f/d58/d72/db3/dea/dcd/df1/ff6 x:0 0 0 2023-12-06T15:00:29.659 INFO:tasks.workunit.client.1.smithi190.stdout:9/754: chown d4/d27/d2f/d31/fee 28 1 2023-12-06T15:00:29.661 INFO:tasks.workunit.client.1.smithi190.stdout:7/749: dwrite d0/df/d5f/fa6 [0,4194304] 0 2023-12-06T15:00:29.661 INFO:tasks.workunit.client.1.smithi190.stdout:7/750: truncate d0/df/d1f/f6f 8571823 0 2023-12-06T15:00:29.664 INFO:tasks.workunit.client.1.smithi190.stdout:7/751: symlink d0/d88/d1c/d17/d94/d95/db1/lf3 0 2023-12-06T15:00:29.664 INFO:tasks.workunit.client.1.smithi190.stdout:7/752: truncate d0/d88/d7a/f69 1629776 0 2023-12-06T15:00:29.664 INFO:tasks.workunit.client.1.smithi190.stdout:7/753: dread - d0/d88/d41/d92/fcc zero size 2023-12-06T15:00:29.665 INFO:tasks.workunit.client.0.smithi152.stdout:1/621: dread d3/da/d15/d17/d58/f93 [0,4194304] 0 2023-12-06T15:00:29.665 INFO:tasks.workunit.client.0.smithi152.stdout:1/622: dread - d3/da/d15/fd6 zero size 2023-12-06T15:00:29.665 INFO:tasks.workunit.client.1.smithi190.stdout:7/754: mkdir d0/d88/d41/df4 0 2023-12-06T15:00:29.666 INFO:tasks.workunit.client.0.smithi152.stdout:1/623: creat d3/d44/d84/fed x:0 0 0 2023-12-06T15:00:29.666 INFO:tasks.workunit.client.1.smithi190.stdout:7/755: dread d0/df/d53/d2f/de9/d56/f85 [0,4194304] 0 2023-12-06T15:00:29.667 INFO:tasks.workunit.client.1.smithi190.stdout:7/756: write d0/df/d53/d2f/fb8 [276899,82726] 0 2023-12-06T15:00:29.670 INFO:tasks.workunit.client.0.smithi152.stdout:2/365: dread d6/d1e/d41/d55/f4b [0,4194304] 0 2023-12-06T15:00:29.671 INFO:tasks.workunit.client.0.smithi152.stdout:7/326: dwrite f3 [4194304,4194304] 0 2023-12-06T15:00:29.671 INFO:tasks.workunit.client.0.smithi152.stdout:7/327: chown dd/df/f5e 22892769 1 2023-12-06T15:00:29.671 INFO:tasks.workunit.client.0.smithi152.stdout:7/328: read - dd/df/d1b/d20/f4d zero size 2023-12-06T15:00:29.674 INFO:tasks.workunit.client.0.smithi152.stdout:2/366: creat d6/db/d17/f75 x:0 0 0 2023-12-06T15:00:29.675 INFO:tasks.workunit.client.0.smithi152.stdout:7/329: rmdir dd/df/d34/d44/d49 39 2023-12-06T15:00:29.677 INFO:tasks.workunit.client.1.smithi190.stdout:0/633: fsync d0/da/d3e/d3a/d40/d6f/fbe 0 2023-12-06T15:00:29.677 INFO:tasks.workunit.client.1.smithi190.stdout:0/634: chown d0/da/d3e/d2b/d37/cb4 100914662 1 2023-12-06T15:00:29.677 INFO:tasks.workunit.client.1.smithi190.stdout:0/635: dread - d0/da/d3e/d2b/d37/fc4 zero size 2023-12-06T15:00:29.677 INFO:tasks.workunit.client.1.smithi190.stdout:0/636: dread - d0/da/d3e/fc9 zero size 2023-12-06T15:00:29.677 INFO:tasks.workunit.client.1.smithi190.stdout:9/755: dread d4/d27/d2f/d31/f50 [0,4194304] 0 2023-12-06T15:00:29.677 INFO:tasks.workunit.client.1.smithi190.stdout:6/737: dwrite d4/f83 [0,4194304] 0 2023-12-06T15:00:29.680 INFO:tasks.workunit.client.0.smithi152.stdout:2/367: creat d6/d1e/d41/d55/f76 x:0 0 0 2023-12-06T15:00:29.680 INFO:tasks.workunit.client.0.smithi152.stdout:7/330: symlink dd/df/d1b/d4e/l61 0 2023-12-06T15:00:29.682 INFO:tasks.workunit.client.0.smithi152.stdout:7/331: symlink dd/df/l62 0 2023-12-06T15:00:29.682 INFO:tasks.workunit.client.0.smithi152.stdout:2/368: unlink d6/d1e/f6e 0 2023-12-06T15:00:29.682 INFO:tasks.workunit.client.0.smithi152.stdout:2/369: stat d6/db/c4e 0 2023-12-06T15:00:29.682 INFO:tasks.workunit.client.0.smithi152.stdout:2/370: readlink d6/l42 0 2023-12-06T15:00:29.682 INFO:tasks.workunit.client.0.smithi152.stdout:2/371: truncate d6/f40 385673 0 2023-12-06T15:00:29.682 INFO:tasks.workunit.client.0.smithi152.stdout:2/372: write d6/d1e/d41/d55/f14 [2207262,104236] 0 2023-12-06T15:00:29.683 INFO:tasks.workunit.client.1.smithi190.stdout:0/637: rmdir d0/da/d3e/d2b/d3c 39 2023-12-06T15:00:29.684 INFO:tasks.workunit.client.1.smithi190.stdout:9/756: symlink d4/d84/dda/lf7 0 2023-12-06T15:00:29.686 INFO:tasks.workunit.client.1.smithi190.stdout:0/638: creat d0/da/d3e/d3a/d40/fd1 x:0 0 0 2023-12-06T15:00:29.686 INFO:tasks.workunit.client.1.smithi190.stdout:0/639: chown d0/da/d3e/d2b/d37/lb2 462 1 2023-12-06T15:00:29.686 INFO:tasks.workunit.client.1.smithi190.stdout:0/640: fsync d0/da/d3e/d2b/d3c/d65/f70 0 2023-12-06T15:00:29.686 INFO:tasks.workunit.client.1.smithi190.stdout:0/641: readlink d0/da/l13 0 2023-12-06T15:00:29.686 INFO:tasks.workunit.client.1.smithi190.stdout:0/642: truncate d0/da/f25 1628585 0 2023-12-06T15:00:29.687 INFO:tasks.workunit.client.1.smithi190.stdout:9/757: symlink d4/d27/d2f/d5c/d9d/lf8 0 2023-12-06T15:00:29.687 INFO:tasks.workunit.client.1.smithi190.stdout:9/758: write d4/d27/d8a/fdb [482974,129627] 0 2023-12-06T15:00:29.687 INFO:tasks.workunit.client.1.smithi190.stdout:4/607: sync 2023-12-06T15:00:29.688 INFO:tasks.workunit.client.1.smithi190.stdout:5/550: sync 2023-12-06T15:00:29.688 INFO:tasks.workunit.client.1.smithi190.stdout:1/928: sync 2023-12-06T15:00:29.688 INFO:tasks.workunit.client.0.smithi152.stdout:2/373: rename d6/d1e/f5a to d6/d1e/f77 0 2023-12-06T15:00:29.689 INFO:tasks.workunit.client.1.smithi190.stdout:0/643: creat d0/da/d3e/d3a/d40/d6f/d9e/fd2 x:0 0 0 2023-12-06T15:00:29.690 INFO:tasks.workunit.client.0.smithi152.stdout:2/374: read d6/d1e/f53 [134893,34744] 0 2023-12-06T15:00:29.690 INFO:tasks.workunit.client.0.smithi152.stdout:2/375: chown d6/db/d17/f5e 3884715 1 2023-12-06T15:00:29.690 INFO:tasks.workunit.client.0.smithi152.stdout:2/376: truncate d6/db/f61 377348 0 2023-12-06T15:00:29.691 INFO:tasks.workunit.client.1.smithi190.stdout:1/929: unlink d6/dc/d29/d38/d39/d63/d67/ffc 0 2023-12-06T15:00:29.692 INFO:tasks.workunit.client.1.smithi190.stdout:5/551: creat d0/d1c/d85/d90/fc0 x:0 0 0 2023-12-06T15:00:29.697 INFO:tasks.workunit.client.1.smithi190.stdout:0/644: creat d0/da/d3e/d2b/d3c/d65/fd3 x:0 0 0 2023-12-06T15:00:29.697 INFO:tasks.workunit.client.1.smithi190.stdout:0/645: chown d0/da/d3e/d3a/d40/f28 60 1 2023-12-06T15:00:29.699 INFO:tasks.workunit.client.1.smithi190.stdout:0/646: creat d0/da/d3e/d2b/d3c/fd4 x:0 0 0 2023-12-06T15:00:29.701 INFO:tasks.workunit.client.0.smithi152.stdout:7/332: dread dd/df/f3b [0,4194304] 0 2023-12-06T15:00:29.701 INFO:tasks.workunit.client.0.smithi152.stdout:7/333: read - dd/df/d1b/d20/d28/d38/d42/f3d zero size 2023-12-06T15:00:29.701 INFO:tasks.workunit.client.1.smithi190.stdout:7/757: dwrite d0/df/d53/d2f/fb8 [0,4194304] 0 2023-12-06T15:00:29.703 INFO:tasks.workunit.client.0.smithi152.stdout:7/334: truncate f7 427369 0 2023-12-06T15:00:29.703 INFO:tasks.workunit.client.0.smithi152.stdout:7/335: chown dd/df/f2c 3030391 1 2023-12-06T15:00:29.703 INFO:tasks.workunit.client.0.smithi152.stdout:7/336: chown dd/df/d1b/d20/d28/l50 53590182 1 2023-12-06T15:00:29.703 INFO:tasks.workunit.client.0.smithi152.stdout:7/337: truncate fa 2004057 0 2023-12-06T15:00:29.704 INFO:tasks.workunit.client.1.smithi190.stdout:1/930: dread d6/dc/d29/fb2 [4194304,4194304] 0 2023-12-06T15:00:29.705 INFO:tasks.workunit.client.0.smithi152.stdout:7/338: dread dd/df/d1b/f41 [0,4194304] 0 2023-12-06T15:00:29.707 INFO:tasks.workunit.client.1.smithi190.stdout:7/758: rename d0/df/d53/d2f/de9/d56/fcf to d0/d88/d7a/dc9/ff5 0 2023-12-06T15:00:29.707 INFO:tasks.workunit.client.1.smithi190.stdout:1/931: write d6/dc/d29/d38/d73/d5c/ff1 [3251980,7447] 0 2023-12-06T15:00:29.707 INFO:tasks.workunit.client.1.smithi190.stdout:1/932: dread - d6/dc/d3b/d78/d94/f10e zero size 2023-12-06T15:00:29.711 INFO:tasks.workunit.client.0.smithi152.stdout:7/339: symlink dd/df/d1b/d20/l63 0 2023-12-06T15:00:29.711 INFO:tasks.workunit.client.0.smithi152.stdout:7/340: write dd/df/d1b/d20/f35 [1507646,53697] 0 2023-12-06T15:00:29.711 INFO:tasks.workunit.client.0.smithi152.stdout:7/341: chown dd/df/d1b/d20/d28/f30 67350 1 2023-12-06T15:00:29.711 INFO:tasks.workunit.client.1.smithi190.stdout:6/738: dread d4/d12/d1a/d8a/fb2 [0,4194304] 0 2023-12-06T15:00:29.712 INFO:tasks.workunit.client.1.smithi190.stdout:6/739: dread - d4/d12/d1a/d59/fef zero size 2023-12-06T15:00:29.712 INFO:tasks.workunit.client.1.smithi190.stdout:6/740: chown d4/d12/d1a/f97 9021548 1 2023-12-06T15:00:29.712 INFO:tasks.workunit.client.0.smithi152.stdout:7/342: read dd/df/d34/d44/f5a [534502,99406] 0 2023-12-06T15:00:29.712 INFO:tasks.workunit.client.0.smithi152.stdout:7/343: fdatasync dd/df/d34/f59 0 2023-12-06T15:00:29.712 INFO:tasks.workunit.client.0.smithi152.stdout:7/344: chown dd/df/d1b/d20/d28 0 1 2023-12-06T15:00:29.718 INFO:tasks.workunit.client.1.smithi190.stdout:6/741: symlink d4/d12/d40/d43/d45/d4a/lf4 0 2023-12-06T15:00:29.722 INFO:tasks.workunit.client.1.smithi190.stdout:6/742: mknod d4/d12/d1a/d8c/ded/cf5 0 2023-12-06T15:00:29.724 INFO:tasks.workunit.client.1.smithi190.stdout:6/743: link d4/d12/d1a/d32/caf d4/d12/d1a/d59/cf6 0 2023-12-06T15:00:29.725 INFO:tasks.workunit.client.1.smithi190.stdout:6/744: mknod d4/d12/d1a/d32/dc7/cf7 0 2023-12-06T15:00:29.725 INFO:tasks.workunit.client.1.smithi190.stdout:6/745: chown d4/c52 55815 1 2023-12-06T15:00:29.727 INFO:tasks.workunit.client.1.smithi190.stdout:6/746: mkdir d4/d12/d1a/d32/dab/de9/df8 0 2023-12-06T15:00:29.727 INFO:tasks.workunit.client.0.smithi152.stdout:9/436: sync 2023-12-06T15:00:29.728 INFO:tasks.workunit.client.1.smithi190.stdout:6/747: dread d4/d12/d1a/d8a/fa7 [0,4194304] 0 2023-12-06T15:00:29.728 INFO:tasks.workunit.client.1.smithi190.stdout:6/748: write d4/d12/d1a/d44/fbd [646473,64479] 0 2023-12-06T15:00:29.729 INFO:tasks.workunit.client.0.smithi152.stdout:9/437: creat d0/d3f/d68/d6c/d20/d4a/d4d/d69/f7a x:0 0 0 2023-12-06T15:00:29.729 INFO:tasks.workunit.client.1.smithi190.stdout:6/749: creat d4/d12/d1a/d8a/ff9 x:0 0 0 2023-12-06T15:00:29.733 INFO:tasks.workunit.client.0.smithi152.stdout:1/624: dwrite d3/da/d65/f77 [0,4194304] 0 2023-12-06T15:00:29.737 INFO:tasks.workunit.client.0.smithi152.stdout:1/625: mknod d3/cee 0 2023-12-06T15:00:29.737 INFO:tasks.workunit.client.0.smithi152.stdout:1/626: readlink d3/da/d4c/d63/l89 0 2023-12-06T15:00:29.738 INFO:tasks.workunit.client.0.smithi152.stdout:6/629: sync 2023-12-06T15:00:29.738 INFO:tasks.workunit.client.0.smithi152.stdout:1/627: mkdir d3/da/d15/d17/def 0 2023-12-06T15:00:29.738 INFO:tasks.workunit.client.0.smithi152.stdout:1/628: dread - d3/da/d15/fd6 zero size 2023-12-06T15:00:29.739 INFO:tasks.workunit.client.0.smithi152.stdout:1/629: dread - d3/da/db/d54/fb5 zero size 2023-12-06T15:00:29.740 INFO:tasks.workunit.client.0.smithi152.stdout:6/630: truncate d1/d69/da1/d87/f44 355304 0 2023-12-06T15:00:29.747 INFO:tasks.workunit.client.1.smithi190.stdout:4/608: dwrite d3/d76/d7c/d96/d15/f20 [4194304,4194304] 0 2023-12-06T15:00:29.749 INFO:tasks.workunit.client.1.smithi190.stdout:4/609: mkdir d3/d76/d7c/d96/d39/dc8 0 2023-12-06T15:00:29.750 INFO:tasks.workunit.client.0.smithi152.stdout:2/377: dwrite d6/db/d17/f75 [0,4194304] 0 2023-12-06T15:00:29.751 INFO:tasks.workunit.client.1.smithi190.stdout:4/610: unlink d3/d35/d19/l3d 0 2023-12-06T15:00:29.752 INFO:tasks.workunit.client.1.smithi190.stdout:4/611: mkdir d3/dc9 0 2023-12-06T15:00:29.753 INFO:tasks.workunit.client.1.smithi190.stdout:4/612: creat d3/d76/d7c/d96/d39/daf/fca x:0 0 0 2023-12-06T15:00:29.754 INFO:tasks.workunit.client.0.smithi152.stdout:2/378: link d6/d18/d43/c67 d6/d1e/d41/d55/c78 0 2023-12-06T15:00:29.754 INFO:tasks.workunit.client.1.smithi190.stdout:4/613: rename d3/d76/d7c/d8a/f99 to d3/d35/fcb 0 2023-12-06T15:00:29.755 INFO:tasks.workunit.client.0.smithi152.stdout:2/379: mknod d6/d18/d43/c79 0 2023-12-06T15:00:29.755 INFO:tasks.workunit.client.1.smithi190.stdout:4/614: symlink d3/d35/da5/lcc 0 2023-12-06T15:00:29.758 INFO:tasks.workunit.client.0.smithi152.stdout:2/380: mkdir d6/d1e/d7a 0 2023-12-06T15:00:29.758 INFO:tasks.workunit.client.1.smithi190.stdout:4/615: unlink d3/f26 0 2023-12-06T15:00:29.758 INFO:tasks.workunit.client.1.smithi190.stdout:4/616: fdatasync d3/d35/da5/fa7 0 2023-12-06T15:00:29.759 INFO:tasks.workunit.client.1.smithi190.stdout:4/617: write d3/d35/da5/fb6 [921319,103183] 0 2023-12-06T15:00:29.759 INFO:tasks.workunit.client.0.smithi152.stdout:2/381: creat d6/d1e/d7a/f7b x:0 0 0 2023-12-06T15:00:29.759 INFO:tasks.workunit.client.1.smithi190.stdout:4/618: mknod d3/d35/d19/d41/d44/d5b/ccd 0 2023-12-06T15:00:29.760 INFO:tasks.workunit.client.1.smithi190.stdout:4/619: creat d3/d76/dc4/dc5/d3c/d4d/fce x:0 0 0 2023-12-06T15:00:29.760 INFO:tasks.workunit.client.1.smithi190.stdout:4/620: fsync d3/d35/d19/f79 0 2023-12-06T15:00:29.762 INFO:tasks.workunit.client.1.smithi190.stdout:4/621: write d3/d76/dc4/dc5/f94 [1829454,94246] 0 2023-12-06T15:00:29.767 INFO:tasks.workunit.client.1.smithi190.stdout:9/759: dwrite d4/d27/d2f/d31/fc9 [0,4194304] 0 2023-12-06T15:00:29.769 INFO:tasks.workunit.client.1.smithi190.stdout:5/552: dwrite d0/d1c/d85/d90/d99/fa3 [0,4194304] 0 2023-12-06T15:00:29.769 INFO:tasks.workunit.client.1.smithi190.stdout:5/553: chown d0/df/d50/d9c 1 1 2023-12-06T15:00:29.769 INFO:tasks.workunit.client.1.smithi190.stdout:5/554: stat d0/d1c/d85/l9f 0 2023-12-06T15:00:29.769 INFO:tasks.workunit.client.1.smithi190.stdout:5/555: dread - d0/d1c/d94/fb6 zero size 2023-12-06T15:00:29.780 INFO:tasks.workunit.client.1.smithi190.stdout:4/622: dread d3/d35/f53 [0,4194304] 0 2023-12-06T15:00:29.781 INFO:tasks.workunit.client.1.smithi190.stdout:7/759: dwrite d0/df/d53/d2f/de9/f49 [4194304,4194304] 0 2023-12-06T15:00:29.781 INFO:tasks.workunit.client.1.smithi190.stdout:7/760: chown d0/d88/d1c/d17/f64 697382395 1 2023-12-06T15:00:29.781 INFO:tasks.workunit.client.0.smithi152.stdout:7/345: dwrite dd/df/d1b/d20/d28/d38/f56 [0,4194304] 0 2023-12-06T15:00:29.782 INFO:tasks.workunit.client.0.smithi152.stdout:9/438: dwrite d0/d3f/d68/d6c/d20/d38/f57 [0,4194304] 0 2023-12-06T15:00:29.782 INFO:tasks.workunit.client.1.smithi190.stdout:0/647: dwrite d0/da/d5a/fac [0,4194304] 0 2023-12-06T15:00:29.782 INFO:tasks.workunit.client.1.smithi190.stdout:1/933: dwrite d6/dc/f9b [0,4194304] 0 2023-12-06T15:00:29.782 INFO:tasks.workunit.client.1.smithi190.stdout:4/623: symlink d3/d35/d19/d41/d44/d9c/lcf 0 2023-12-06T15:00:29.784 INFO:tasks.workunit.client.1.smithi190.stdout:7/761: mkdir d0/df/df6 0 2023-12-06T15:00:29.785 INFO:tasks.workunit.client.0.smithi152.stdout:7/346: creat dd/df/d1b/d20/d28/d53/f64 x:0 0 0 2023-12-06T15:00:29.786 INFO:tasks.workunit.client.1.smithi190.stdout:0/648: symlink d0/da/d3e/d3a/d40/d6f/ld5 0 2023-12-06T15:00:29.787 INFO:tasks.workunit.client.0.smithi152.stdout:1/630: rmdir d3/da 39 2023-12-06T15:00:29.787 INFO:tasks.workunit.client.0.smithi152.stdout:1/631: chown d3/da/d15/d17/d43/d7d 1776 1 2023-12-06T15:00:29.787 INFO:tasks.workunit.client.0.smithi152.stdout:1/632: fdatasync d3/d73/fcb 0 2023-12-06T15:00:29.787 INFO:tasks.workunit.client.0.smithi152.stdout:1/633: chown d3/c24 95397 1 2023-12-06T15:00:29.787 INFO:tasks.workunit.client.1.smithi190.stdout:1/934: rmdir d6/dc/d29/d38/d73/d5c/dd2 39 2023-12-06T15:00:29.788 INFO:tasks.workunit.client.1.smithi190.stdout:4/624: mkdir d3/da4/dd0 0 2023-12-06T15:00:29.790 INFO:tasks.workunit.client.1.smithi190.stdout:6/750: dwrite d4/d12/d1a/d59/f65 [0,4194304] 0 2023-12-06T15:00:29.791 INFO:tasks.workunit.client.0.smithi152.stdout:2/382: dwrite d6/db/d17/f74 [0,4194304] 0 2023-12-06T15:00:29.792 INFO:tasks.workunit.client.1.smithi190.stdout:1/935: truncate d6/dc/d29/d38/d73/fde 1485735 0 2023-12-06T15:00:29.793 INFO:tasks.workunit.client.1.smithi190.stdout:9/760: dwrite d4/d27/d2f/d31/f50 [0,4194304] 0 2023-12-06T15:00:29.793 INFO:tasks.workunit.client.1.smithi190.stdout:9/761: read - d4/d27/d2f/d31/ff5 zero size 2023-12-06T15:00:29.793 INFO:tasks.workunit.client.0.smithi152.stdout:6/631: dwrite d1/fc2 [0,4194304] 0 2023-12-06T15:00:29.794 INFO:tasks.workunit.client.0.smithi152.stdout:7/347: unlink dd/df/d1b/d20/d28/d38/f60 0 2023-12-06T15:00:29.794 INFO:tasks.workunit.client.0.smithi152.stdout:9/439: truncate d0/f23 2363505 0 2023-12-06T15:00:29.794 INFO:tasks.workunit.client.0.smithi152.stdout:7/348: getdents dd/df/d34/d44 0 2023-12-06T15:00:29.794 INFO:tasks.workunit.client.0.smithi152.stdout:7/349: read - dd/df/d1b/d20/d28/f3e zero size 2023-12-06T15:00:29.795 INFO:tasks.workunit.client.1.smithi190.stdout:4/625: creat d3/d76/dc4/dc5/daa/fd1 x:0 0 0 2023-12-06T15:00:29.795 INFO:tasks.workunit.client.0.smithi152.stdout:6/632: write d1/dcf/ddc/d1a/d30/d36/d26/f53 [1918676,125862] 0 2023-12-06T15:00:29.796 INFO:tasks.workunit.client.1.smithi190.stdout:0/649: getdents d0/da/d3e/d2b/d3c/d65 0 2023-12-06T15:00:29.796 INFO:tasks.workunit.client.1.smithi190.stdout:0/650: rename d0 to d0/da/d74/da2/dd6 22 2023-12-06T15:00:29.797 INFO:tasks.workunit.client.1.smithi190.stdout:1/936: dread d6/dc/d29/d38/d73/d76/d7e/fbc [0,4194304] 0 2023-12-06T15:00:29.798 INFO:tasks.workunit.client.1.smithi190.stdout:1/937: truncate d6/dc/d29/d38/d73/d5c/dd2/f11f 5228686 0 2023-12-06T15:00:29.799 INFO:tasks.workunit.client.1.smithi190.stdout:9/762: read d4/d27/d2f/d31/fc9 [1522826,81756] 0 2023-12-06T15:00:29.800 INFO:tasks.workunit.client.1.smithi190.stdout:7/762: dwrite d0/f3 [0,4194304] 0 2023-12-06T15:00:29.802 INFO:tasks.workunit.client.0.smithi152.stdout:1/634: link d3/da/d4c/d82/d75/lc5 d3/da/d4c/d82/d52/d62/dcc/lf0 0 2023-12-06T15:00:29.802 INFO:tasks.workunit.client.0.smithi152.stdout:1/635: fdatasync d3/fd 0 2023-12-06T15:00:29.803 INFO:tasks.workunit.client.0.smithi152.stdout:7/350: stat dd/d17/c1e 0 2023-12-06T15:00:29.806 INFO:tasks.workunit.client.0.smithi152.stdout:6/633: creat d1/dcf/ddc/d1a/fe8 x:0 0 0 2023-12-06T15:00:29.808 INFO:tasks.workunit.client.0.smithi152.stdout:1/636: rename d3/da/d15/d17/d4d/f8a to d3/da/d4c/d63/d96/ff1 0 2023-12-06T15:00:29.810 INFO:tasks.workunit.client.0.smithi152.stdout:7/351: mknod dd/df/d1b/c65 0 2023-12-06T15:00:29.810 INFO:tasks.workunit.client.0.smithi152.stdout:1/637: stat d3/da/d4c/d82/d52/d62/fc6 0 2023-12-06T15:00:29.811 INFO:tasks.workunit.client.1.smithi190.stdout:7/763: dread d0/d35/d8e/f9a [0,4194304] 0 2023-12-06T15:00:29.811 INFO:tasks.workunit.client.1.smithi190.stdout:7/764: chown d0/df/d53/d2f/c9c 783 1 2023-12-06T15:00:29.811 INFO:tasks.workunit.client.1.smithi190.stdout:7/765: chown d0/df/d53/d2f/de9/f48 58608461 1 2023-12-06T15:00:29.813 INFO:tasks.workunit.client.0.smithi152.stdout:7/352: getdents dd/df/d1b/d20/d28/d38/d42 0 2023-12-06T15:00:29.813 INFO:tasks.workunit.client.1.smithi190.stdout:6/751: rmdir d4/d12/d1a/d32/dab/de9 39 2023-12-06T15:00:29.815 INFO:tasks.workunit.client.1.smithi190.stdout:7/766: dread d0/d88/d1c/fd0 [0,4194304] 0 2023-12-06T15:00:29.817 INFO:tasks.workunit.client.0.smithi152.stdout:7/353: rename dd/df/l3c to dd/df/l66 0 2023-12-06T15:00:29.817 INFO:tasks.workunit.client.1.smithi190.stdout:4/626: creat d3/d76/fd2 x:0 0 0 2023-12-06T15:00:29.817 INFO:tasks.workunit.client.1.smithi190.stdout:7/767: dread d0/d88/d1c/fd0 [0,4194304] 0 2023-12-06T15:00:29.820 INFO:tasks.workunit.client.1.smithi190.stdout:0/651: truncate d0/da/d5a/f95 2430468 0 2023-12-06T15:00:29.822 INFO:tasks.workunit.client.1.smithi190.stdout:1/938: mkdir d6/d49/d74/d12c 0 2023-12-06T15:00:29.822 INFO:tasks.workunit.client.1.smithi190.stdout:1/939: fsync d6/dc/d3b/d78/f9a 0 2023-12-06T15:00:29.823 INFO:tasks.workunit.client.1.smithi190.stdout:9/763: mknod d4/d27/d2f/d31/d3f/cf9 0 2023-12-06T15:00:29.826 INFO:tasks.workunit.client.1.smithi190.stdout:6/752: link d4/d12/d1a/d32/le6 d4/d12/d40/d43/d45/d4a/d77/lfa 0 2023-12-06T15:00:29.829 INFO:tasks.workunit.client.1.smithi190.stdout:0/652: getdents d0/da/d5a 0 2023-12-06T15:00:29.829 INFO:tasks.workunit.client.1.smithi190.stdout:0/653: fsync d0/da/fa3 0 2023-12-06T15:00:29.830 INFO:tasks.workunit.client.1.smithi190.stdout:9/764: creat d4/d27/d2f/d31/d3f/d58/d72/d7a/ffa x:0 0 0 2023-12-06T15:00:29.830 INFO:tasks.workunit.client.1.smithi190.stdout:9/765: chown d4/d27/d2f/d31/d3f/d58/d72/c74 87 1 2023-12-06T15:00:29.833 INFO:tasks.workunit.client.1.smithi190.stdout:4/627: rename d3/d76/f88 to d3/d35/d19/fd3 0 2023-12-06T15:00:29.833 INFO:tasks.workunit.client.1.smithi190.stdout:4/628: chown d3/f40 3 1 2023-12-06T15:00:29.833 INFO:tasks.workunit.client.1.smithi190.stdout:4/629: truncate d3/d76/dc4/dc5/daa/fd1 106949 0 2023-12-06T15:00:29.833 INFO:tasks.workunit.client.1.smithi190.stdout:6/753: read d4/d12/d1a/d70/f7f [7745397,13196] 0 2023-12-06T15:00:29.835 INFO:tasks.workunit.client.1.smithi190.stdout:0/654: mknod d0/da/d3e/d2b/d3c/d4c/da8/cd7 0 2023-12-06T15:00:29.835 INFO:tasks.workunit.client.1.smithi190.stdout:0/655: fsync d0/da/d3e/d2b/d3c/d46/d8e/d90/fb3 0 2023-12-06T15:00:29.835 INFO:tasks.workunit.client.1.smithi190.stdout:0/656: read - d0/da/d3e/d2b/d37/fc4 zero size 2023-12-06T15:00:29.836 INFO:tasks.workunit.client.1.smithi190.stdout:9/766: rmdir d4/d27/d8a 39 2023-12-06T15:00:29.840 INFO:tasks.workunit.client.1.smithi190.stdout:9/767: truncate d4/d27/d2f/d31/d3f/d58/d72/db3/dea/dcd/fe3 1076184 0 2023-12-06T15:00:29.843 INFO:tasks.workunit.client.1.smithi190.stdout:9/768: truncate d4/f33 1515334 0 2023-12-06T15:00:29.843 INFO:tasks.workunit.client.1.smithi190.stdout:9/769: fsync d4/d27/d2f/d31/d3f/d58/d72/db3/dea/dcd/df1/ff6 0 2023-12-06T15:00:29.845 INFO:tasks.workunit.client.1.smithi190.stdout:3/750: sync 2023-12-06T15:00:29.845 INFO:tasks.workunit.client.1.smithi190.stdout:2/597: sync 2023-12-06T15:00:29.845 INFO:tasks.workunit.client.1.smithi190.stdout:8/630: sync 2023-12-06T15:00:29.845 INFO:tasks.workunit.client.1.smithi190.stdout:2/598: chown d10/d26/d5c/d35/d77/lbe 1832853 1 2023-12-06T15:00:29.845 INFO:tasks.workunit.client.1.smithi190.stdout:8/631: write d1/d20/d3b/d36/fb5 [597143,63708] 0 2023-12-06T15:00:29.845 INFO:tasks.workunit.client.1.smithi190.stdout:9/770: link d4/d27/d2f/d31/cc1 d4/d27/d2f/d31/d3f/cfb 0 2023-12-06T15:00:29.847 INFO:tasks.workunit.client.1.smithi190.stdout:4/630: dread d3/d35/d19/f47 [4194304,4194304] 0 2023-12-06T15:00:29.847 INFO:tasks.workunit.client.1.smithi190.stdout:2/599: rename d10/d59/d5e/d71 to d10/d59/dcd 0 2023-12-06T15:00:29.847 INFO:tasks.workunit.client.1.smithi190.stdout:2/600: fsync d10/d59/d5e/f47 0 2023-12-06T15:00:29.848 INFO:tasks.workunit.client.1.smithi190.stdout:9/771: creat d4/d27/d2f/d31/d3f/d58/dc5/ffc x:0 0 0 2023-12-06T15:00:29.848 INFO:tasks.workunit.client.1.smithi190.stdout:9/772: truncate d4/d27/d2f/fd3 1350231 0 2023-12-06T15:00:29.857 INFO:tasks.workunit.client.0.smithi152.stdout:7/354: dwrite f7 [0,4194304] 0 2023-12-06T15:00:29.858 INFO:tasks.workunit.client.0.smithi152.stdout:1/638: dwrite d3/da/d4c/fc9 [0,4194304] 0 2023-12-06T15:00:29.858 INFO:tasks.workunit.client.0.smithi152.stdout:6/634: dwrite d1/d69/da1/d87/f8f [0,4194304] 0 2023-12-06T15:00:29.858 INFO:tasks.workunit.client.0.smithi152.stdout:6/635: chown l0 30 1 2023-12-06T15:00:29.858 INFO:tasks.workunit.client.0.smithi152.stdout:6/636: dread - d1/dcf/ddc/d1a/d30/d36/d35/d49/d50/fae zero size 2023-12-06T15:00:29.863 INFO:tasks.workunit.client.0.smithi152.stdout:7/355: write f9 [875173,123692] 0 2023-12-06T15:00:29.863 INFO:tasks.workunit.client.0.smithi152.stdout:6/637: mknod d1/dcf/ddc/d1a/d30/daa/ce9 0 2023-12-06T15:00:29.863 INFO:tasks.workunit.client.0.smithi152.stdout:6/638: chown d1/d1c 2545331 1 2023-12-06T15:00:29.863 INFO:tasks.workunit.client.0.smithi152.stdout:6/639: readlink d1/d69/da1/d87/l3a 0 2023-12-06T15:00:29.863 INFO:tasks.workunit.client.0.smithi152.stdout:1/639: mknod d3/da/d4c/d82/d52/d62/dcc/cf2 0 2023-12-06T15:00:29.863 INFO:tasks.workunit.client.1.smithi190.stdout:2/601: dread d10/d26/d5c/d49/f55 [0,4194304] 0 2023-12-06T15:00:29.864 INFO:tasks.workunit.client.1.smithi190.stdout:2/602: mkdir d10/d59/d5e/dce 0 2023-12-06T15:00:29.864 INFO:tasks.workunit.client.0.smithi152.stdout:7/356: link dd/df/d1b/d20/d28/f30 dd/df/d34/d44/f67 0 2023-12-06T15:00:29.865 INFO:tasks.workunit.client.0.smithi152.stdout:1/640: dread d3/da/db/f53 [0,4194304] 0 2023-12-06T15:00:29.865 INFO:tasks.workunit.client.0.smithi152.stdout:6/640: getdents d1/dcf/ddc/d1a/d30/d36/d35/dd1 0 2023-12-06T15:00:29.866 INFO:tasks.workunit.client.1.smithi190.stdout:2/603: mkdir d10/d26/d5c/d49/d7e/dcf 0 2023-12-06T15:00:29.866 INFO:tasks.workunit.client.1.smithi190.stdout:2/604: chown d10/d59/dcd/dad/dc4/d76 572478 1 2023-12-06T15:00:29.867 INFO:tasks.workunit.client.1.smithi190.stdout:9/773: dread d4/d27/d2f/d31/d3f/fb0 [0,4194304] 0 2023-12-06T15:00:29.867 INFO:tasks.workunit.client.0.smithi152.stdout:1/641: write d3/da/d4c/d82/d52/fd7 [1411108,91979] 0 2023-12-06T15:00:29.868 INFO:tasks.workunit.client.1.smithi190.stdout:2/605: creat d10/d59/dcd/dad/dc4/d76/db1/fd0 x:0 0 0 2023-12-06T15:00:29.868 INFO:tasks.workunit.client.0.smithi152.stdout:1/642: read d3/d44/d84/fdb [91457,27793] 0 2023-12-06T15:00:29.868 INFO:tasks.workunit.client.0.smithi152.stdout:6/641: truncate d1/dcf/ddc/d6d/f7f 537605 0 2023-12-06T15:00:29.868 INFO:tasks.workunit.client.0.smithi152.stdout:6/642: chown d1/dcf/ddc/d1a/d30/d36/d35/d49/da6/da9/le5 2397 1 2023-12-06T15:00:29.870 INFO:tasks.workunit.client.0.smithi152.stdout:1/643: link d3/da/d4c/fc9 d3/da/d4c/d63/ff3 0 2023-12-06T15:00:29.870 INFO:tasks.workunit.client.0.smithi152.stdout:1/644: write d3/da/d15/d17/d43/f91 [4903256,102727] 0 2023-12-06T15:00:29.870 INFO:tasks.workunit.client.0.smithi152.stdout:1/645: fdatasync d3/d73/fd4 0 2023-12-06T15:00:29.872 INFO:tasks.workunit.client.1.smithi190.stdout:7/768: dwrite d0/d88/d1c/f28 [0,4194304] 0 2023-12-06T15:00:29.872 INFO:tasks.workunit.client.1.smithi190.stdout:6/754: dwrite d4/d12/d40/d43/d45/d4a/d77/dca/f4e [0,4194304] 0 2023-12-06T15:00:29.873 INFO:tasks.workunit.client.1.smithi190.stdout:1/940: dwrite d6/dc/d29/d38/fc6 [0,4194304] 0 2023-12-06T15:00:29.873 INFO:tasks.workunit.client.1.smithi190.stdout:1/941: readlink d6/dc/d29/d38/d39/lbe 0 2023-12-06T15:00:29.873 INFO:tasks.workunit.client.1.smithi190.stdout:0/657: dwrite d0/da/fa3 [0,4194304] 0 2023-12-06T15:00:29.874 INFO:tasks.workunit.client.1.smithi190.stdout:9/774: dread d4/d27/d2f/fd3 [0,4194304] 0 2023-12-06T15:00:29.874 INFO:tasks.workunit.client.0.smithi152.stdout:6/643: write d1/dcf/ddc/d1a/d30/d36/f24 [3455328,6839] 0 2023-12-06T15:00:29.875 INFO:tasks.workunit.client.1.smithi190.stdout:0/658: write d0/da/d3e/d3a/d40/f28 [2913098,92889] 0 2023-12-06T15:00:29.875 INFO:tasks.workunit.client.1.smithi190.stdout:0/659: readlink d0/da/d5a/d80/l91 0 2023-12-06T15:00:29.875 INFO:tasks.workunit.client.1.smithi190.stdout:4/631: dwrite d3/d76/d7c/d96/d39/f25 [0,4194304] 0 2023-12-06T15:00:29.875 INFO:tasks.workunit.client.1.smithi190.stdout:4/632: chown d3/d35 15 1 2023-12-06T15:00:29.876 INFO:tasks.workunit.client.0.smithi152.stdout:6/644: getdents d1/dcf/ddc/d1a/d30/d36/d35/d49/d57 0 2023-12-06T15:00:29.879 INFO:tasks.workunit.client.0.smithi152.stdout:6/645: creat d1/fea x:0 0 0 2023-12-06T15:00:29.879 INFO:tasks.workunit.client.0.smithi152.stdout:6/646: stat d1/dcf/ddc/d1a/d30/f22 0 2023-12-06T15:00:29.881 INFO:tasks.workunit.client.0.smithi152.stdout:6/647: rename d1/dcf/ddc/d4b to d1/d69/da1/deb 0 2023-12-06T15:00:29.883 INFO:tasks.workunit.client.0.smithi152.stdout:6/648: creat d1/dcf/ddc/d1a/d30/da4/fec x:0 0 0 2023-12-06T15:00:29.883 INFO:tasks.workunit.client.0.smithi152.stdout:6/649: write d1/d69/da1/deb/f88 [306909,85675] 0 2023-12-06T15:00:29.884 INFO:tasks.workunit.client.1.smithi190.stdout:6/755: rmdir d4/d12/d1a/d44 39 2023-12-06T15:00:29.885 INFO:tasks.workunit.client.0.smithi152.stdout:6/650: creat d1/dcf/ddc/d1a/d30/d36/d4e/d55/dbf/fed x:0 0 0 2023-12-06T15:00:29.885 INFO:tasks.workunit.client.0.smithi152.stdout:1/646: dread d3/da/db/f48 [0,4194304] 0 2023-12-06T15:00:29.886 INFO:tasks.workunit.client.0.smithi152.stdout:6/651: creat d1/dcf/ddc/d8a/fee x:0 0 0 2023-12-06T15:00:29.887 INFO:tasks.workunit.client.1.smithi190.stdout:1/942: truncate d6/dc/d29/d38/d39/d63/d67/f7d 1000509 0 2023-12-06T15:00:29.887 INFO:tasks.workunit.client.0.smithi152.stdout:1/647: creat d3/da/db/da0/ff4 x:0 0 0 2023-12-06T15:00:29.888 INFO:tasks.workunit.client.0.smithi152.stdout:1/648: write d3/d44/d84/fdb [95796,58017] 0 2023-12-06T15:00:29.888 INFO:tasks.workunit.client.0.smithi152.stdout:6/652: truncate d1/dcf/ddc/d1a/d30/d36/f7e 1109005 0 2023-12-06T15:00:29.890 INFO:tasks.workunit.client.0.smithi152.stdout:1/649: rename d3/f30 to d3/d73/ff5 0 2023-12-06T15:00:29.891 INFO:tasks.workunit.client.0.smithi152.stdout:1/650: dread d3/fb0 [0,4194304] 0 2023-12-06T15:00:29.891 INFO:tasks.workunit.client.0.smithi152.stdout:1/651: read - d3/da/d4c/d82/d75/fc3 zero size 2023-12-06T15:00:29.892 INFO:tasks.workunit.client.0.smithi152.stdout:6/653: creat d1/dcf/ddc/d1a/d30/d36/d35/d49/fef x:0 0 0 2023-12-06T15:00:29.892 INFO:tasks.workunit.client.1.smithi190.stdout:9/775: mkdir d4/dfd 0 2023-12-06T15:00:29.893 INFO:tasks.workunit.client.1.smithi190.stdout:2/606: rmdir d10/d59 39 2023-12-06T15:00:29.893 INFO:tasks.workunit.client.1.smithi190.stdout:2/607: dread - d10/d26/d5c/f73 zero size 2023-12-06T15:00:29.894 INFO:tasks.workunit.client.0.smithi152.stdout:1/652: mknod d3/da/d4c/d82/d52/d55/cf6 0 2023-12-06T15:00:29.895 INFO:tasks.workunit.client.1.smithi190.stdout:0/660: mkdir d0/da/d3e/d2b/d3c/d46/d8e/d90/dd8 0 2023-12-06T15:00:29.896 INFO:tasks.workunit.client.0.smithi152.stdout:6/654: link d1/dcf/ddc/d1a/d30/d36/d35/d49/d57/f68 d1/dcf/ddc/d1a/d30/d36/d4e/d55/dbf/ff0 0 2023-12-06T15:00:29.898 INFO:tasks.workunit.client.0.smithi152.stdout:6/655: creat d1/dcf/ddc/d1a/d30/d36/ff1 x:0 0 0 2023-12-06T15:00:29.899 INFO:tasks.workunit.client.1.smithi190.stdout:7/769: dwrite d0/d88/d41/fa1 [0,4194304] 0 2023-12-06T15:00:29.899 INFO:tasks.workunit.client.1.smithi190.stdout:4/633: rename d3/d76/d7c/d96/d15/f23 to d3/d76/d8b/fd4 0 2023-12-06T15:00:29.900 INFO:tasks.workunit.client.0.smithi152.stdout:6/656: link d1/dcf/ddc/d1a/d30/d36/d35/f47 d1/d89/ff2 0 2023-12-06T15:00:29.900 INFO:tasks.workunit.client.1.smithi190.stdout:6/756: getdents d4/d12 0 2023-12-06T15:00:29.900 INFO:tasks.workunit.client.1.smithi190.stdout:6/757: write d4/d12/d40/d43/f9b [512064,95604] 0 2023-12-06T15:00:29.902 INFO:tasks.workunit.client.0.smithi152.stdout:6/657: rename d1/c6e to d1/dcf/ddc/d1a/d30/d36/d35/d63/cf3 0 2023-12-06T15:00:29.903 INFO:tasks.workunit.client.0.smithi152.stdout:6/658: chown d1/dcf/ddc/d1a/d30/d36/d4e/d55/dbf/fed 178328 1 2023-12-06T15:00:29.903 INFO:tasks.workunit.client.0.smithi152.stdout:6/659: write d1/d69/da1/d87/d15/f8e [3805306,101137] 0 2023-12-06T15:00:29.904 INFO:tasks.workunit.client.1.smithi190.stdout:1/943: link d6/dc/d3b/c100 d6/dc/d29/ded/d116/c12d 0 2023-12-06T15:00:29.904 INFO:tasks.workunit.client.1.smithi190.stdout:9/776: creat d4/d27/d2f/d5c/ffe x:0 0 0 2023-12-06T15:00:29.907 INFO:tasks.workunit.client.0.smithi152.stdout:6/660: creat d1/dcf/ddc/d1a/d30/d36/d35/d63/ff4 x:0 0 0 2023-12-06T15:00:29.907 INFO:tasks.workunit.client.1.smithi190.stdout:0/661: dread d0/f50 [0,4194304] 0 2023-12-06T15:00:29.909 INFO:tasks.workunit.client.1.smithi190.stdout:7/770: creat d0/d88/d7a/d7c/dab/dc0/ff7 x:0 0 0 2023-12-06T15:00:29.910 INFO:tasks.workunit.client.0.smithi152.stdout:6/661: unlink d1/dcf/ddc/d1a/d30/d36/d35/dd1/fde 0 2023-12-06T15:00:29.911 INFO:tasks.workunit.client.0.smithi152.stdout:6/662: write d1/dcf/ddc/d1a/d30/d36/d35/d63/f9b [642467,51879] 0 2023-12-06T15:00:29.913 INFO:tasks.workunit.client.1.smithi190.stdout:4/634: symlink d3/d35/d97/ld5 0 2023-12-06T15:00:29.913 INFO:tasks.workunit.client.1.smithi190.stdout:5/556: sync 2023-12-06T15:00:29.915 INFO:tasks.workunit.client.1.smithi190.stdout:9/777: truncate d4/d27/d8a/f95 4164338 0 2023-12-06T15:00:29.916 INFO:tasks.workunit.client.1.smithi190.stdout:2/608: truncate d10/d59/d5e/f24 1102217 0 2023-12-06T15:00:29.916 INFO:tasks.workunit.client.1.smithi190.stdout:2/609: fsync d10/d26/d5c/d37/f3d 0 2023-12-06T15:00:29.917 INFO:tasks.workunit.client.1.smithi190.stdout:0/662: mknod d0/da/d3e/d3a/d40/cd9 0 2023-12-06T15:00:29.920 INFO:tasks.workunit.client.0.smithi152.stdout:6/663: dread d1/dcf/ddc/d1a/f31 [0,4194304] 0 2023-12-06T15:00:29.922 INFO:tasks.workunit.client.1.smithi190.stdout:2/610: mknod d10/cd1 0 2023-12-06T15:00:29.922 INFO:tasks.workunit.client.1.smithi190.stdout:4/635: creat d3/d76/d7c/d8a/fd6 x:0 0 0 2023-12-06T15:00:29.922 INFO:tasks.workunit.client.1.smithi190.stdout:5/557: write d0/d1c/d2b/d2c/d5d/d73/fab [1041422,66585] 0 2023-12-06T15:00:29.922 INFO:tasks.workunit.client.1.smithi190.stdout:5/558: chown d0/c8 53797321 1 2023-12-06T15:00:29.922 INFO:tasks.workunit.client.1.smithi190.stdout:7/771: dread d0/f30 [0,4194304] 0 2023-12-06T15:00:29.923 INFO:tasks.workunit.client.1.smithi190.stdout:2/611: read d10/d26/d5c/d37/d83/fa0 [16222,75112] 0 2023-12-06T15:00:29.923 INFO:tasks.workunit.client.1.smithi190.stdout:0/663: rmdir d0/da/d3e/d3a/d40/d6f/d9e/dae 0 2023-12-06T15:00:29.924 INFO:tasks.workunit.client.1.smithi190.stdout:2/612: write d10/d26/d5c/f63 [1914338,13196] 0 2023-12-06T15:00:29.925 INFO:tasks.workunit.client.1.smithi190.stdout:4/636: truncate d3/d35/d19/d41/d44/f70 714055 0 2023-12-06T15:00:29.927 INFO:tasks.workunit.client.0.smithi152.stdout:8/311: sync 2023-12-06T15:00:29.927 INFO:tasks.workunit.client.0.smithi152.stdout:3/444: sync 2023-12-06T15:00:29.927 INFO:tasks.workunit.client.0.smithi152.stdout:4/648: sync 2023-12-06T15:00:29.927 INFO:tasks.workunit.client.0.smithi152.stdout:0/455: sync 2023-12-06T15:00:29.928 INFO:tasks.workunit.client.0.smithi152.stdout:0/456: stat d8/d15/d45/d73/d7a/c29 0 2023-12-06T15:00:29.928 INFO:tasks.workunit.client.0.smithi152.stdout:5/474: sync 2023-12-06T15:00:29.928 INFO:tasks.workunit.client.1.smithi190.stdout:5/559: creat d0/d1c/d85/d90/dba/fc1 x:0 0 0 2023-12-06T15:00:29.928 INFO:tasks.workunit.client.1.smithi190.stdout:7/772: mkdir d0/df/df8 0 2023-12-06T15:00:29.929 INFO:tasks.workunit.client.0.smithi152.stdout:1/653: dwrite d3/da/d15/d17/f42 [0,4194304] 0 2023-12-06T15:00:29.929 INFO:tasks.workunit.client.0.smithi152.stdout:4/649: truncate d2/f8 3042129 0 2023-12-06T15:00:29.930 INFO:tasks.workunit.client.0.smithi152.stdout:3/445: mknod d9/d10/d12/d44/c87 0 2023-12-06T15:00:29.931 INFO:tasks.workunit.client.0.smithi152.stdout:8/312: mknod d1/d6/d34/d36/c5f 0 2023-12-06T15:00:29.931 INFO:tasks.workunit.client.0.smithi152.stdout:0/457: creat d8/d44/f91 x:0 0 0 2023-12-06T15:00:29.932 INFO:tasks.workunit.client.1.smithi190.stdout:2/613: creat d10/d59/d5e/fd2 x:0 0 0 2023-12-06T15:00:29.933 INFO:tasks.workunit.client.1.smithi190.stdout:1/944: dwrite d6/f90 [0,4194304] 0 2023-12-06T15:00:29.934 INFO:tasks.workunit.client.1.smithi190.stdout:4/637: link d3/d4e/c64 d3/d35/d19/d41/d44/d5b/cd7 0 2023-12-06T15:00:29.934 INFO:tasks.workunit.client.1.smithi190.stdout:4/638: fdatasync d3/fd 0 2023-12-06T15:00:29.935 INFO:tasks.workunit.client.1.smithi190.stdout:4/639: getdents d3/da4/dd0 0 2023-12-06T15:00:29.935 INFO:tasks.workunit.client.1.smithi190.stdout:7/773: write d0/fd4 [1966020,124372] 0 2023-12-06T15:00:29.935 INFO:tasks.workunit.client.1.smithi190.stdout:9/778: dwrite d4/f14 [0,4194304] 0 2023-12-06T15:00:29.936 INFO:tasks.workunit.client.0.smithi152.stdout:4/650: rename d2/d89/d9e to d2/d10/dbb/dca 0 2023-12-06T15:00:29.936 INFO:tasks.workunit.client.0.smithi152.stdout:4/651: truncate d2/d89/fa3 532632 0 2023-12-06T15:00:29.938 INFO:tasks.workunit.client.0.smithi152.stdout:0/458: creat d8/d3e/d87/f92 x:0 0 0 2023-12-06T15:00:29.942 INFO:tasks.workunit.client.0.smithi152.stdout:0/459: link d8/d4b/f51 d8/d15/f93 0 2023-12-06T15:00:29.945 INFO:tasks.workunit.client.0.smithi152.stdout:0/460: truncate d8/fa 2485085 0 2023-12-06T15:00:29.945 INFO:tasks.workunit.client.0.smithi152.stdout:0/461: chown d8/d15/d45/f4f 0 1 2023-12-06T15:00:29.945 INFO:tasks.workunit.client.1.smithi190.stdout:2/614: rmdir d10/d59/d5e/dce 0 2023-12-06T15:00:29.946 INFO:tasks.workunit.client.1.smithi190.stdout:2/615: write d10/d26/d5c/f73 [717508,116701] 0 2023-12-06T15:00:29.946 INFO:tasks.workunit.client.1.smithi190.stdout:2/616: dread - d10/d26/d5c/d49/d7e/fb8 zero size 2023-12-06T15:00:29.946 INFO:tasks.workunit.client.1.smithi190.stdout:4/640: dread d3/fa [4194304,4194304] 0 2023-12-06T15:00:29.946 INFO:tasks.workunit.client.1.smithi190.stdout:4/641: fdatasync d3/d76/d7c/d96/d39/d54/f84 0 2023-12-06T15:00:29.946 INFO:tasks.workunit.client.1.smithi190.stdout:7/774: rename d0/d88/d41/d92/dc1 to d0/df/d53/d99/da9/df9 0 2023-12-06T15:00:29.949 INFO:tasks.workunit.client.0.smithi152.stdout:0/462: dread d8/d15/d45/d73/d7a/f39 [0,4194304] 0 2023-12-06T15:00:29.951 INFO:tasks.workunit.client.1.smithi190.stdout:4/642: dread d3/f14 [0,4194304] 0 2023-12-06T15:00:29.952 INFO:tasks.workunit.client.1.smithi190.stdout:9/779: rename d4/d27/d2f/d66 to d4/d27/d2f/d31/d3f/d58/d72/db3/dea/dcd/dff 0 2023-12-06T15:00:29.952 INFO:tasks.workunit.client.1.smithi190.stdout:9/780: stat d4/d27/d2f/d31/d3f/l64 0 2023-12-06T15:00:29.952 INFO:tasks.workunit.client.1.smithi190.stdout:9/781: truncate d4/d27/d2f/d31/f50 4645495 0 2023-12-06T15:00:29.952 INFO:tasks.workunit.client.0.smithi152.stdout:8/313: dread d1/d6/d34/d35/d38/f41 [0,4194304] 0 2023-12-06T15:00:29.955 INFO:tasks.workunit.client.0.smithi152.stdout:0/463: truncate d8/d15/d45/d73/d7a/f34 3101926 0 2023-12-06T15:00:29.957 INFO:tasks.workunit.client.0.smithi152.stdout:0/464: rename d8/l28 to d8/d3e/l94 0 2023-12-06T15:00:29.965 INFO:tasks.workunit.client.1.smithi190.stdout:4/643: getdents d3/d76/dc4/dc5/daa 0 2023-12-06T15:00:29.965 INFO:tasks.workunit.client.1.smithi190.stdout:9/782: creat d4/d27/d2f/d31/d3f/d58/f100 x:0 0 0 2023-12-06T15:00:29.965 INFO:tasks.workunit.client.1.smithi190.stdout:4/644: dread - d3/d76/dc4/dc5/d3c/f45 zero size 2023-12-06T15:00:29.966 INFO:tasks.workunit.client.1.smithi190.stdout:4/645: truncate d3/d76/d7c/d96/f98 33311 0 2023-12-06T15:00:29.966 INFO:tasks.workunit.client.1.smithi190.stdout:4/646: fsync d3/d76/d8b/fd4 0 2023-12-06T15:00:29.966 INFO:tasks.workunit.client.1.smithi190.stdout:4/647: dread - d3/d76/fb2 zero size 2023-12-06T15:00:29.966 INFO:tasks.workunit.client.1.smithi190.stdout:9/783: getdents d4/d27/d2f/d31/d3f 0 2023-12-06T15:00:29.967 INFO:tasks.workunit.client.1.smithi190.stdout:4/648: creat d3/d35/d19/d41/d44/fd8 x:0 0 0 2023-12-06T15:00:29.968 INFO:tasks.workunit.client.1.smithi190.stdout:9/784: getdents d4/d27/d2f/d5c/d9d 0 2023-12-06T15:00:29.974 INFO:tasks.workunit.client.1.smithi190.stdout:0/664: dwrite d0/da/d5a/f95 [0,4194304] 0 2023-12-06T15:00:29.979 INFO:tasks.workunit.client.0.smithi152.stdout:0/465: dread f5 [0,4194304] 0 2023-12-06T15:00:29.989 INFO:tasks.workunit.client.0.smithi152.stdout:0/466: write d8/f67 [1643090,81450] 0 2023-12-06T15:00:29.989 INFO:tasks.workunit.client.0.smithi152.stdout:0/467: chown d8/d3e/f43 0 1 2023-12-06T15:00:29.989 INFO:tasks.workunit.client.0.smithi152.stdout:0/468: chown d8/d3e/f58 13 1 2023-12-06T15:00:29.989 INFO:tasks.workunit.client.0.smithi152.stdout:0/469: fdatasync d8/d15/d45/f71 0 2023-12-06T15:00:29.990 INFO:tasks.workunit.client.0.smithi152.stdout:0/470: truncate d8/d44/f5a 904025 0 2023-12-06T15:00:29.992 INFO:tasks.workunit.client.0.smithi152.stdout:0/471: write d8/d15/f2e [471500,118030] 0 2023-12-06T15:00:29.994 INFO:tasks.workunit.client.0.smithi152.stdout:0/472: creat d8/d3e/d6f/f95 x:0 0 0 2023-12-06T15:00:29.995 INFO:tasks.workunit.client.1.smithi190.stdout:0/665: dread d0/da/d3e/d2b/d37/f39 [0,4194304] 0 2023-12-06T15:00:29.996 INFO:tasks.workunit.client.0.smithi152.stdout:6/664: dwrite d1/dcf/ddc/d1a/d30/d36/d35/d63/f9b [0,4194304] 0 2023-12-06T15:00:29.999 INFO:tasks.workunit.client.1.smithi190.stdout:1/945: dwrite d6/dc/d29/d38/d73/d5c/ff1 [0,4194304] 0 2023-12-06T15:00:30.008 INFO:tasks.workunit.client.1.smithi190.stdout:5/560: dwrite d0/d1c/d3e/f60 [0,4194304] 0 2023-12-06T15:00:30.008 INFO:tasks.workunit.client.1.smithi190.stdout:4/649: mknod d3/d35/d19/d41/d44/d5b/cd9 0 2023-12-06T15:00:30.009 INFO:tasks.workunit.client.0.smithi152.stdout:0/473: dread d8/d3e/f69 [0,4194304] 0 2023-12-06T15:00:30.010 INFO:tasks.workunit.client.0.smithi152.stdout:5/475: dwrite d7/d47/f74 [0,4194304] 0 2023-12-06T15:00:30.010 INFO:tasks.workunit.client.0.smithi152.stdout:5/476: readlink d7/dd/l39 0 2023-12-06T15:00:30.011 INFO:tasks.workunit.client.0.smithi152.stdout:3/446: dwrite d9/d10/d19/f7b [0,4194304] 0 2023-12-06T15:00:30.011 INFO:tasks.workunit.client.1.smithi190.stdout:2/617: dwrite d10/d26/d5c/d49/d7e/fb8 [0,4194304] 0 2023-12-06T15:00:30.012 INFO:tasks.workunit.client.1.smithi190.stdout:9/785: rename d4/f33 to d4/d27/d2f/d31/d3f/d58/d72/db3/dea/dcd/df1/f101 0 2023-12-06T15:00:30.012 INFO:tasks.workunit.client.1.smithi190.stdout:2/618: chown d10/d26/d5c/d35/f50 91842799 1 2023-12-06T15:00:30.013 INFO:tasks.workunit.client.0.smithi152.stdout:1/654: dwrite d3/da/d4c/d82/d52/d62/fb8 [0,4194304] 0 2023-12-06T15:00:30.014 INFO:tasks.workunit.client.0.smithi152.stdout:8/314: dwrite d1/d6/d34/d36/f5d [0,4194304] 0 2023-12-06T15:00:30.014 INFO:tasks.workunit.client.0.smithi152.stdout:0/474: mknod d8/d15/d45/d73/c96 0 2023-12-06T15:00:30.015 INFO:tasks.workunit.client.0.smithi152.stdout:0/475: dread d8/d44/f46 [0,4194304] 0 2023-12-06T15:00:30.016 INFO:tasks.workunit.client.0.smithi152.stdout:5/477: unlink d7/dd/d26/d3b/c3f 0 2023-12-06T15:00:30.018 INFO:tasks.workunit.client.0.smithi152.stdout:3/447: mknod d9/d18/c88 0 2023-12-06T15:00:30.019 INFO:tasks.workunit.client.1.smithi190.stdout:5/561: creat d0/d1c/d2b/fc2 x:0 0 0 2023-12-06T15:00:30.020 INFO:tasks.workunit.client.0.smithi152.stdout:1/655: creat d3/d73/ff7 x:0 0 0 2023-12-06T15:00:30.021 INFO:tasks.workunit.client.1.smithi190.stdout:4/650: mknod d3/d35/da6/cda 0 2023-12-06T15:00:30.022 INFO:tasks.workunit.client.0.smithi152.stdout:8/315: link d1/d6/d34/d35/d38/f4e d1/d6/d34/d36/f60 0 2023-12-06T15:00:30.024 INFO:tasks.workunit.client.0.smithi152.stdout:0/476: rename d8/d15/d45/f70 to d8/d15/d45/d73/d7a/f97 0 2023-12-06T15:00:30.026 INFO:tasks.workunit.client.0.smithi152.stdout:1/656: mkdir d3/da/d15/d17/d1a/df8 0 2023-12-06T15:00:30.027 INFO:tasks.workunit.client.0.smithi152.stdout:8/316: symlink d1/d6/d34/d36/l61 0 2023-12-06T15:00:30.027 INFO:tasks.workunit.client.0.smithi152.stdout:1/657: write d3/da/d15/d17/d43/f9e [2787436,18060] 0 2023-12-06T15:00:30.028 INFO:tasks.workunit.client.0.smithi152.stdout:0/477: mknod d8/d15/d45/d73/d7a/c98 0 2023-12-06T15:00:30.030 INFO:tasks.workunit.client.0.smithi152.stdout:0/478: mkdir d8/d15/d45/d99 0 2023-12-06T15:00:30.031 INFO:tasks.workunit.client.0.smithi152.stdout:0/479: read d8/d44/f46 [300207,125127] 0 2023-12-06T15:00:30.031 INFO:tasks.workunit.client.1.smithi190.stdout:1/946: dwrite d6/dc/f2e [0,4194304] 0 2023-12-06T15:00:30.032 INFO:tasks.workunit.client.1.smithi190.stdout:9/786: creat d4/d27/d2f/f102 x:0 0 0 2023-12-06T15:00:30.032 INFO:tasks.workunit.client.0.smithi152.stdout:0/480: mkdir d8/d15/d45/d73/d9a 0 2023-12-06T15:00:30.033 INFO:tasks.workunit.client.1.smithi190.stdout:4/651: rmdir d3/d76/dc4/dc5 39 2023-12-06T15:00:30.036 INFO:tasks.workunit.client.1.smithi190.stdout:1/947: link d6/dc/d29/d38/d73/c4c d6/dc/d29/d38/d39/d63/d67/c12e 0 2023-12-06T15:00:30.037 INFO:tasks.workunit.client.0.smithi152.stdout:8/317: write d1/d6/d34/f21 [497702,35144] 0 2023-12-06T15:00:30.037 INFO:tasks.workunit.client.0.smithi152.stdout:3/448: dread d9/d10/d19/f7b [0,4194304] 0 2023-12-06T15:00:30.043 INFO:tasks.workunit.client.1.smithi190.stdout:9/787: dread d4/d27/d2f/d31/d3f/d58/d72/db3/dea/dcd/fe3 [0,4194304] 0 2023-12-06T15:00:30.043 INFO:tasks.workunit.client.0.smithi152.stdout:0/481: write d8/d3e/d87/f53 [96746,60738] 0 2023-12-06T15:00:30.043 INFO:tasks.workunit.client.0.smithi152.stdout:3/449: link d9/d10/d12/d44/l70 d9/d10/d12/d43/l89 0 2023-12-06T15:00:30.043 INFO:tasks.workunit.client.0.smithi152.stdout:0/482: truncate d8/d3e/f58 289114 0 2023-12-06T15:00:30.043 INFO:tasks.workunit.client.0.smithi152.stdout:3/450: write d9/d18/d51/f6c [5116980,75089] 0 2023-12-06T15:00:30.048 INFO:tasks.workunit.client.1.smithi190.stdout:9/788: rename d4/d27/d2f/d31/d3f/d58/d72/d7a/cb9 to d4/d27/d2f/c103 0 2023-12-06T15:00:30.049 INFO:tasks.workunit.client.0.smithi152.stdout:6/665: dwrite d1/dcf/ddc/d1a/fe8 [0,4194304] 0 2023-12-06T15:00:30.051 INFO:tasks.workunit.client.1.smithi190.stdout:1/948: dread d6/d49/f68 [0,4194304] 0 2023-12-06T15:00:30.051 INFO:tasks.workunit.client.1.smithi190.stdout:1/949: chown d6/dc/d29/d38/d73/fde 19764070 1 2023-12-06T15:00:30.051 INFO:tasks.workunit.client.1.smithi190.stdout:2/619: dwrite d10/f4f [0,4194304] 0 2023-12-06T15:00:30.051 INFO:tasks.workunit.client.1.smithi190.stdout:9/789: unlink d4/d27/d2f/d31/d3f/d58/d72/db3/dea/dcd/df1/ff6 0 2023-12-06T15:00:30.052 INFO:tasks.workunit.client.1.smithi190.stdout:1/950: write d6/dc/d29/d38/d73/d76/d7e/fbc [104268,50943] 0 2023-12-06T15:00:30.052 INFO:tasks.workunit.client.1.smithi190.stdout:9/790: write d4/f24 [2182217,97910] 0 2023-12-06T15:00:30.052 INFO:tasks.workunit.client.0.smithi152.stdout:0/483: symlink d8/d44/l9b 0 2023-12-06T15:00:30.052 INFO:tasks.workunit.client.0.smithi152.stdout:0/484: write d8/d15/f33 [416376,120109] 0 2023-12-06T15:00:30.052 INFO:tasks.workunit.client.0.smithi152.stdout:0/485: write d8/d3e/d87/f8b [268621,61377] 0 2023-12-06T15:00:30.052 INFO:tasks.workunit.client.1.smithi190.stdout:0/666: dwrite d0/da/d3e/d3a/d40/d6f/d9e/fd2 [0,4194304] 0 2023-12-06T15:00:30.053 INFO:tasks.workunit.client.1.smithi190.stdout:2/620: rmdir d10/d26/d5c/d37 39 2023-12-06T15:00:30.054 INFO:tasks.workunit.client.1.smithi190.stdout:5/562: dwrite d0/d1c/d2b/f48 [4194304,4194304] 0 2023-12-06T15:00:30.058 INFO:tasks.workunit.client.0.smithi152.stdout:0/486: creat d8/d3e/f9c x:0 0 0 2023-12-06T15:00:30.059 INFO:tasks.workunit.client.0.smithi152.stdout:0/487: truncate d8/d3e/d87/f90 419555 0 2023-12-06T15:00:30.061 INFO:tasks.workunit.client.1.smithi190.stdout:0/667: rename d0/da/d3e/d3a/d40/d6f/dc0 to d0/da/d3e/d2b/d3c/d46/d8e/d90/dda 0 2023-12-06T15:00:30.064 INFO:tasks.workunit.client.0.smithi152.stdout:1/658: dwrite d3/d73/fcb [0,4194304] 0 2023-12-06T15:00:30.065 INFO:tasks.workunit.client.1.smithi190.stdout:5/563: rmdir d0/d1c/d85/d90 39 2023-12-06T15:00:30.066 INFO:tasks.workunit.client.1.smithi190.stdout:5/564: write d0/d1c/d2b/d2c/d5d/d73/f58 [4198989,35139] 0 2023-12-06T15:00:30.067 INFO:tasks.workunit.client.1.smithi190.stdout:1/951: dread d6/f12 [0,4194304] 0 2023-12-06T15:00:30.067 INFO:tasks.workunit.client.1.smithi190.stdout:1/952: write d6/dc/d29/d38/d73/d76/d7e/fbc [1006896,55134] 0 2023-12-06T15:00:30.067 INFO:tasks.workunit.client.1.smithi190.stdout:2/621: dread d10/f39 [0,4194304] 0 2023-12-06T15:00:30.067 INFO:tasks.workunit.client.1.smithi190.stdout:2/622: chown d10/d26/d5c/f33 33916868 1 2023-12-06T15:00:30.067 INFO:tasks.workunit.client.0.smithi152.stdout:1/659: getdents d3/da/db/da0 0 2023-12-06T15:00:30.068 INFO:tasks.workunit.client.0.smithi152.stdout:1/660: creat d3/da/d4c/d82/d52/d55/ff9 x:0 0 0 2023-12-06T15:00:30.070 INFO:tasks.workunit.client.1.smithi190.stdout:2/623: creat d10/fd3 x:0 0 0 2023-12-06T15:00:30.071 INFO:tasks.workunit.client.1.smithi190.stdout:5/565: link d0/d1c/d2b/d2c/d5d/d73/f13 d0/d1c/d85/d90/d99/fc3 0 2023-12-06T15:00:30.071 INFO:tasks.workunit.client.1.smithi190.stdout:5/566: write d0/d1c/d2b/d2c/d5d/f67 [80171,29642] 0 2023-12-06T15:00:30.071 INFO:tasks.workunit.client.1.smithi190.stdout:5/567: stat d0/d1c/d2b/f4e 0 2023-12-06T15:00:30.073 INFO:tasks.workunit.client.1.smithi190.stdout:2/624: symlink d10/d59/ld4 0 2023-12-06T15:00:30.073 INFO:tasks.workunit.client.1.smithi190.stdout:2/625: write d10/d26/d5c/d35/f82 [112135,118338] 0 2023-12-06T15:00:30.073 INFO:tasks.workunit.client.1.smithi190.stdout:2/626: stat d10/d26/d5c/l60 0 2023-12-06T15:00:30.073 INFO:tasks.workunit.client.1.smithi190.stdout:2/627: dread - d10/d26/d5c/fb3 zero size 2023-12-06T15:00:30.073 INFO:tasks.workunit.client.1.smithi190.stdout:0/668: dread d0/da/d3e/d3a/d40/f28 [4194304,4194304] 0 2023-12-06T15:00:30.074 INFO:tasks.workunit.client.1.smithi190.stdout:2/628: mknod d10/d26/d5c/d49/cd5 0 2023-12-06T15:00:30.074 INFO:tasks.workunit.client.1.smithi190.stdout:2/629: fsync d10/d26/d8a/d8f/fa7 0 2023-12-06T15:00:30.076 INFO:tasks.workunit.client.1.smithi190.stdout:2/630: symlink d10/d26/d5c/d49/d54/ld6 0 2023-12-06T15:00:30.076 INFO:tasks.workunit.client.1.smithi190.stdout:2/631: write d10/d26/d5c/d37/f9a [357863,123933] 0 2023-12-06T15:00:30.078 INFO:tasks.workunit.client.1.smithi190.stdout:4/652: dwrite d3/d35/d19/d41/d44/d5b/f6f [0,4194304] 0 2023-12-06T15:00:30.078 INFO:tasks.workunit.client.1.smithi190.stdout:2/632: symlink d10/d26/d5c/d49/d7e/dcf/ld7 0 2023-12-06T15:00:30.078 INFO:tasks.workunit.client.1.smithi190.stdout:1/953: dread d6/dc/d29/d38/d73/d76/f10d [0,4194304] 0 2023-12-06T15:00:30.079 INFO:tasks.workunit.client.0.smithi152.stdout:3/451: truncate d9/d10/d19/f7b 3588583 0 2023-12-06T15:00:30.080 INFO:tasks.workunit.client.1.smithi190.stdout:8/632: sync 2023-12-06T15:00:30.080 INFO:tasks.workunit.client.1.smithi190.stdout:3/751: sync 2023-12-06T15:00:30.080 INFO:tasks.workunit.client.0.smithi152.stdout:8/318: dwrite d1/d6/f30 [0,4194304] 0 2023-12-06T15:00:30.080 INFO:tasks.workunit.client.1.smithi190.stdout:9/791: dwrite d4/d27/d8a/fdb [0,4194304] 0 2023-12-06T15:00:30.084 INFO:tasks.workunit.client.1.smithi190.stdout:0/669: dread d0/da/f49 [0,4194304] 0 2023-12-06T15:00:30.086 INFO:tasks.workunit.client.0.smithi152.stdout:6/666: dwrite d1/dcf/ddc/d1a/d30/d36/d35/d49/d57/f99 [0,4194304] 0 2023-12-06T15:00:30.086 INFO:tasks.workunit.client.0.smithi152.stdout:6/667: write d1/d69/da1/d87/fe4 [503348,29999] 0 2023-12-06T15:00:30.087 INFO:tasks.workunit.client.1.smithi190.stdout:5/568: dread d0/d1c/d2b/f48 [0,4194304] 0 2023-12-06T15:00:30.088 INFO:tasks.workunit.client.0.smithi152.stdout:6/668: rename d1/dcf/ddc/d1a/d30/daa/fe0 to d1/dcf/ddc/d1a/d30/daa/ff5 0 2023-12-06T15:00:30.090 INFO:tasks.workunit.client.0.smithi152.stdout:6/669: creat d1/d69/da1/d87/d15/ff6 x:0 0 0 2023-12-06T15:00:30.094 INFO:tasks.workunit.client.0.smithi152.stdout:3/452: dread f7 [0,4194304] 0 2023-12-06T15:00:30.095 INFO:tasks.workunit.client.0.smithi152.stdout:3/453: write d9/d18/d51/f54 [13135,114471] 0 2023-12-06T15:00:30.095 INFO:tasks.workunit.client.0.smithi152.stdout:3/454: stat d9/ff 0 2023-12-06T15:00:30.095 INFO:tasks.workunit.client.1.smithi190.stdout:9/792: write d4/d27/d2f/f37 [3606914,102322] 0 2023-12-06T15:00:30.096 INFO:tasks.workunit.client.1.smithi190.stdout:9/793: fdatasync d4/d27/d2f/f102 0 2023-12-06T15:00:30.096 INFO:tasks.workunit.client.1.smithi190.stdout:9/794: write d4/d27/d2f/d31/d3f/d58/d72/db3/fd7 [1663589,123198] 0 2023-12-06T15:00:30.096 INFO:tasks.workunit.client.1.smithi190.stdout:4/653: getdents d3/da4 0 2023-12-06T15:00:30.096 INFO:tasks.workunit.client.1.smithi190.stdout:4/654: write d3/f90 [212800,14442] 0 2023-12-06T15:00:30.098 INFO:tasks.workunit.client.0.smithi152.stdout:3/455: creat d9/d18/d39/f8a x:0 0 0 2023-12-06T15:00:30.098 INFO:tasks.workunit.client.1.smithi190.stdout:2/633: unlink d10/d26/d5c/d49/c7b 0 2023-12-06T15:00:30.101 INFO:tasks.workunit.client.1.smithi190.stdout:1/954: symlink d6/dc/d29/d129/l12f 0 2023-12-06T15:00:30.101 INFO:tasks.workunit.client.1.smithi190.stdout:8/633: creat d1/d20/d3b/d4c/d8e/da5/fb7 x:0 0 0 2023-12-06T15:00:30.107 INFO:tasks.workunit.client.1.smithi190.stdout:0/670: creat d0/da/d5a/dc8/fdb x:0 0 0 2023-12-06T15:00:30.107 INFO:tasks.workunit.client.1.smithi190.stdout:5/569: link d0/d1c/d3e/f60 d0/d1c/d94/fc4 0 2023-12-06T15:00:30.107 INFO:tasks.workunit.client.1.smithi190.stdout:9/795: mknod d4/c104 0 2023-12-06T15:00:30.107 INFO:tasks.workunit.client.1.smithi190.stdout:9/796: readlink d4/d27/d2f/d31/d3f/l62 0 2023-12-06T15:00:30.108 INFO:tasks.workunit.client.0.smithi152.stdout:3/456: rename d9/d18/f64 to d9/d10/d12/d43/f8b 0 2023-12-06T15:00:30.108 INFO:tasks.workunit.client.0.smithi152.stdout:6/670: dread d1/f3d [0,4194304] 0 2023-12-06T15:00:30.108 INFO:tasks.workunit.client.0.smithi152.stdout:6/671: write d1/fea [326290,74456] 0 2023-12-06T15:00:30.109 INFO:tasks.workunit.client.1.smithi190.stdout:8/634: rmdir d1/d20/d3b/d4c/d59/d7d 39 2023-12-06T15:00:30.112 INFO:tasks.workunit.client.0.smithi152.stdout:3/457: creat d9/d18/d1a/d77/f8c x:0 0 0 2023-12-06T15:00:30.112 INFO:tasks.workunit.client.0.smithi152.stdout:3/458: write d9/d10/d12/d43/d52/f7a [302147,70250] 0 2023-12-06T15:00:30.112 INFO:tasks.workunit.client.0.smithi152.stdout:3/459: truncate d9/d10/f7f 912582 0 2023-12-06T15:00:30.113 INFO:tasks.workunit.client.0.smithi152.stdout:6/672: symlink d1/dcf/ddc/d1a/d30/d36/d4e/d55/lf7 0 2023-12-06T15:00:30.113 INFO:tasks.workunit.client.1.smithi190.stdout:5/570: mkdir d0/d96/dc5 0 2023-12-06T15:00:30.113 INFO:tasks.workunit.client.1.smithi190.stdout:9/797: mknod d4/c105 0 2023-12-06T15:00:30.113 INFO:tasks.workunit.client.1.smithi190.stdout:5/571: stat d0/d1c/d2b/d2c/d5d/f95 0 2023-12-06T15:00:30.113 INFO:tasks.workunit.client.1.smithi190.stdout:8/635: creat d1/d20/d3b/d4c/d8e/d94/fb8 x:0 0 0 2023-12-06T15:00:30.114 INFO:tasks.workunit.client.1.smithi190.stdout:8/636: chown d1/d20/d3b/d31/c60 39 1 2023-12-06T15:00:30.114 INFO:tasks.workunit.client.0.smithi152.stdout:8/319: dwrite d1/d6/d34/d36/f26 [4194304,4194304] 0 2023-12-06T15:00:30.114 INFO:tasks.workunit.client.0.smithi152.stdout:1/661: dwrite d3/da/d4c/d82/d75/fc3 [0,4194304] 0 2023-12-06T15:00:30.115 INFO:tasks.workunit.client.0.smithi152.stdout:6/673: write d1/fbe [394582,38137] 0 2023-12-06T15:00:30.115 INFO:tasks.workunit.client.0.smithi152.stdout:3/460: getdents d9/d10/d19 0 2023-12-06T15:00:30.115 INFO:tasks.workunit.client.1.smithi190.stdout:0/671: getdents d0/da/d3e/d3a/d40/d6f 0 2023-12-06T15:00:30.116 INFO:tasks.workunit.client.1.smithi190.stdout:0/672: dread - d0/da/d3e/d3a/d40/d6f/fab zero size 2023-12-06T15:00:30.116 INFO:tasks.workunit.client.1.smithi190.stdout:0/673: chown d0/da/d3e/d2b/d37/c4a 395761 1 2023-12-06T15:00:30.116 INFO:tasks.workunit.client.1.smithi190.stdout:3/752: dwrite d4/d70/d19/d3a/f106 [0,4194304] 0 2023-12-06T15:00:30.116 INFO:tasks.workunit.client.1.smithi190.stdout:3/753: write d4/d70/d19/d51/f5f [3059438,117775] 0 2023-12-06T15:00:30.116 INFO:tasks.workunit.client.1.smithi190.stdout:9/798: write d4/d27/d2f/f5e [525264,124652] 0 2023-12-06T15:00:30.116 INFO:tasks.workunit.client.0.smithi152.stdout:3/461: write f7 [3950175,3831] 0 2023-12-06T15:00:30.116 INFO:tasks.workunit.client.0.smithi152.stdout:3/462: chown d9/d10/d19/f57 467 1 2023-12-06T15:00:30.117 INFO:tasks.workunit.client.1.smithi190.stdout:8/637: creat d1/d20/d3b/fb9 x:0 0 0 2023-12-06T15:00:30.118 INFO:tasks.workunit.client.0.smithi152.stdout:8/320: rename d1/d6/d34/d36/f17 to d1/d6/d29/d5b/f62 0 2023-12-06T15:00:30.118 INFO:tasks.workunit.client.0.smithi152.stdout:8/321: write d1/d6/d34/d40/f52 [968277,42275] 0 2023-12-06T15:00:30.119 INFO:tasks.workunit.client.0.smithi152.stdout:8/322: fdatasync d1/d6/d34/d35/d38/f4e 0 2023-12-06T15:00:30.119 INFO:tasks.workunit.client.0.smithi152.stdout:8/323: write d1/d6/d34/d36/f60 [800768,117806] 0 2023-12-06T15:00:30.119 INFO:tasks.workunit.client.0.smithi152.stdout:8/324: write d1/d6/d34/f1a [4586067,106256] 0 2023-12-06T15:00:30.119 INFO:tasks.workunit.client.0.smithi152.stdout:8/325: readlink d1/l20 0 2023-12-06T15:00:30.124 INFO:tasks.workunit.client.0.smithi152.stdout:1/662: rename d3/da/d15/d17/f70 to d3/d73/ffa 0 2023-12-06T15:00:30.124 INFO:tasks.workunit.client.0.smithi152.stdout:1/663: write d3/fb0 [370394,115863] 0 2023-12-06T15:00:30.126 INFO:tasks.workunit.client.1.smithi190.stdout:0/674: creat d0/da/d3e/d2b/d37/fdc x:0 0 0 2023-12-06T15:00:30.127 INFO:tasks.workunit.client.1.smithi190.stdout:0/675: stat d0/da/d3e/d3a/d40/c3b 0 2023-12-06T15:00:30.127 INFO:tasks.workunit.client.0.smithi152.stdout:6/674: dread d1/dcf/ddc/d1a/d30/d36/f64 [0,4194304] 0 2023-12-06T15:00:30.127 INFO:tasks.workunit.client.0.smithi152.stdout:3/463: dread d9/f2d [0,4194304] 0 2023-12-06T15:00:30.127 INFO:tasks.workunit.client.1.smithi190.stdout:4/655: dwrite d3/d76/d8b/fb3 [0,4194304] 0 2023-12-06T15:00:30.128 INFO:tasks.workunit.client.0.smithi152.stdout:1/664: rename d3/da/d4c/d82/d75/fc3 to d3/da/d4c/ffb 0 2023-12-06T15:00:30.128 INFO:tasks.workunit.client.0.smithi152.stdout:1/665: write d3/d73/ffa [1096606,24843] 0 2023-12-06T15:00:30.128 INFO:tasks.workunit.client.0.smithi152.stdout:0/488: dwrite d8/d15/f33 [0,4194304] 0 2023-12-06T15:00:30.130 INFO:tasks.workunit.client.0.smithi152.stdout:6/675: link d1/dcf/ddc/d8a/fc6 d1/d89/ff8 0 2023-12-06T15:00:30.131 INFO:tasks.workunit.client.1.smithi190.stdout:3/754: rename d4/d1b/d54/d9c/d68/dfc/d56/d94/d3d/f105 to d4/d1b/d5d/f107 0 2023-12-06T15:00:30.132 INFO:tasks.workunit.client.0.smithi152.stdout:1/666: creat d3/da/d4c/d82/d52/d62/dcc/ffc x:0 0 0 2023-12-06T15:00:30.133 INFO:tasks.workunit.client.1.smithi190.stdout:9/799: chown d4/d27/d2f/d31/c46 1925408096 1 2023-12-06T15:00:30.133 INFO:tasks.workunit.client.1.smithi190.stdout:2/634: dwrite d10/d59/dcd/dad/dc4/d76/db1/fd0 [0,4194304] 0 2023-12-06T15:00:30.136 INFO:tasks.workunit.client.1.smithi190.stdout:5/572: dwrite d0/d1c/d3e/d5a/d5f/fb3 [0,4194304] 0 2023-12-06T15:00:30.136 INFO:tasks.workunit.client.1.smithi190.stdout:8/638: link d1/d20/d3b/d4c/d5a/l6e d1/lba 0 2023-12-06T15:00:30.136 INFO:tasks.workunit.client.1.smithi190.stdout:8/639: fdatasync d1/d20/d3b/d34/f38 0 2023-12-06T15:00:30.138 INFO:tasks.workunit.client.1.smithi190.stdout:0/676: creat d0/da/d3e/d2b/d3c/fdd x:0 0 0 2023-12-06T15:00:30.138 INFO:tasks.workunit.client.1.smithi190.stdout:0/677: fsync d0/da/d3e/d2b/d3c/d65/f72 0 2023-12-06T15:00:30.138 INFO:tasks.workunit.client.0.smithi152.stdout:0/489: getdents d8/d15/d45/d73 0 2023-12-06T15:00:30.141 INFO:tasks.workunit.client.1.smithi190.stdout:6/758: sync 2023-12-06T15:00:30.141 INFO:tasks.workunit.client.1.smithi190.stdout:7/775: sync 2023-12-06T15:00:30.141 INFO:tasks.workunit.client.1.smithi190.stdout:7/776: truncate d0/d88/fa4 328842 0 2023-12-06T15:00:30.143 INFO:tasks.workunit.client.1.smithi190.stdout:2/635: dread d10/f4f [0,4194304] 0 2023-12-06T15:00:30.143 INFO:tasks.workunit.client.1.smithi190.stdout:2/636: write d10/d26/d5c/f94 [718482,74205] 0 2023-12-06T15:00:30.144 INFO:tasks.workunit.client.0.smithi152.stdout:3/464: rename d9/d10/d12/d44 to d9/d18/d51/d8d 0 2023-12-06T15:00:30.146 INFO:tasks.workunit.client.1.smithi190.stdout:3/755: unlink d4/d1b/d54/d9c/d68/c8c 0 2023-12-06T15:00:30.146 INFO:tasks.workunit.client.0.smithi152.stdout:6/676: unlink d1/dcf/ddc/d1a/d30/d36/d35/d61/lcc 0 2023-12-06T15:00:30.148 INFO:tasks.workunit.client.1.smithi190.stdout:9/800: symlink d4/d27/d2f/d31/d3f/d58/d72/db3/l106 0 2023-12-06T15:00:30.149 INFO:tasks.workunit.client.0.smithi152.stdout:0/490: link d8/d3e/d87/f8d d8/d3e/d6f/f9d 0 2023-12-06T15:00:30.149 INFO:tasks.workunit.client.1.smithi190.stdout:6/759: write d4/d12/d40/d43/d45/d4a/d77/dca/f26 [2652435,119773] 0 2023-12-06T15:00:30.149 INFO:tasks.workunit.client.0.smithi152.stdout:0/491: dread d8/d15/d45/d73/d7a/f1f [0,4194304] 0 2023-12-06T15:00:30.153 INFO:tasks.workunit.client.1.smithi190.stdout:5/573: creat d0/d1c/d3e/d5a/d5f/fc6 x:0 0 0 2023-12-06T15:00:30.154 INFO:tasks.workunit.client.1.smithi190.stdout:5/574: chown d0/d1c/d2b/d2c/d5d 245 1 2023-12-06T15:00:30.155 INFO:tasks.workunit.client.1.smithi190.stdout:0/678: symlink d0/da/db7/lde 0 2023-12-06T15:00:30.157 INFO:tasks.workunit.client.1.smithi190.stdout:3/756: truncate d4/d1b/f38 1855377 0 2023-12-06T15:00:30.158 INFO:tasks.workunit.client.1.smithi190.stdout:9/801: unlink d4/d27/d2f/d31/fba 0 2023-12-06T15:00:30.159 INFO:tasks.workunit.client.1.smithi190.stdout:8/640: dwrite d1/d20/d3b/d36/f48 [0,4194304] 0 2023-12-06T15:00:30.159 INFO:tasks.workunit.client.1.smithi190.stdout:8/641: chown d1/d37/f85 24 1 2023-12-06T15:00:30.159 INFO:tasks.workunit.client.1.smithi190.stdout:8/642: chown d1/d20 20801 1 2023-12-06T15:00:30.160 INFO:tasks.workunit.client.1.smithi190.stdout:6/760: rmdir d4/d12/d1a/d70 39 2023-12-06T15:00:30.162 INFO:tasks.workunit.client.0.smithi152.stdout:8/326: truncate d1/d6/d34/d36/f4f 700896 0 2023-12-06T15:00:30.164 INFO:tasks.workunit.client.1.smithi190.stdout:0/679: symlink d0/da/ldf 0 2023-12-06T15:00:30.165 INFO:tasks.workunit.client.1.smithi190.stdout:3/757: symlink d4/d70/d19/d51/l108 0 2023-12-06T15:00:30.165 INFO:tasks.workunit.client.1.smithi190.stdout:3/758: readlink d4/d1b/d54/d9c/d68/dfc/d56/d83/l96 0 2023-12-06T15:00:30.168 INFO:tasks.workunit.client.0.smithi152.stdout:3/465: creat d9/d18/d39/f8e x:0 0 0 2023-12-06T15:00:30.168 INFO:tasks.workunit.client.1.smithi190.stdout:9/802: link d4/d27/d2f/d31/d3f/d58/d7d/la8 d4/d27/d2f/d31/d3f/d58/d72/db3/dea/l107 0 2023-12-06T15:00:30.169 INFO:tasks.workunit.client.0.smithi152.stdout:0/492: creat d8/d4b/f9e x:0 0 0 2023-12-06T15:00:30.169 INFO:tasks.workunit.client.0.smithi152.stdout:1/667: rename d3/da/d15/d17/d1a/df8 to d3/da/dcd/dd9/dfd 0 2023-12-06T15:00:30.170 INFO:tasks.workunit.client.1.smithi190.stdout:8/643: getdents d1/d20/d3b/d4c/d8e/d94/d25 0 2023-12-06T15:00:30.171 INFO:tasks.workunit.client.1.smithi190.stdout:7/777: dwrite d0/d5/dba/fe0 [0,4194304] 0 2023-12-06T15:00:30.171 INFO:tasks.workunit.client.1.smithi190.stdout:7/778: write d0/df/d53/d15/fad [251719,111746] 0 2023-12-06T15:00:30.172 INFO:tasks.workunit.client.0.smithi152.stdout:8/327: getdents d1/d6/d34/d36 0 2023-12-06T15:00:30.172 INFO:tasks.workunit.client.0.smithi152.stdout:6/677: dwrite d1/dcf/ddc/d1a/fe8 [0,4194304] 0 2023-12-06T15:00:30.172 INFO:tasks.workunit.client.1.smithi190.stdout:6/761: truncate d4/d12/f53 2935288 0 2023-12-06T15:00:30.173 INFO:tasks.workunit.client.1.smithi190.stdout:5/575: mkdir d0/d1c/d2b/d2c/d5d/d73/dc7 0 2023-12-06T15:00:30.173 INFO:tasks.workunit.client.1.smithi190.stdout:5/576: chown d0/d6c/f8c 57968 1 2023-12-06T15:00:30.173 INFO:tasks.workunit.client.1.smithi190.stdout:5/577: chown d0/d1c/d3e/d5a/d5f/c6f 61527824 1 2023-12-06T15:00:30.174 INFO:tasks.workunit.client.0.smithi152.stdout:3/466: mkdir d9/d18/d51/d8d/d8f 0 2023-12-06T15:00:30.175 INFO:tasks.workunit.client.0.smithi152.stdout:3/467: fdatasync d9/d18/d39/f8a 0 2023-12-06T15:00:30.175 INFO:tasks.workunit.client.0.smithi152.stdout:3/468: stat d9/d10/d19/c75 0 2023-12-06T15:00:30.175 INFO:tasks.workunit.client.0.smithi152.stdout:0/493: creat d8/d15/d45/d99/f9f x:0 0 0 2023-12-06T15:00:30.175 INFO:tasks.workunit.client.0.smithi152.stdout:0/494: chown d8/d3e/d87/d76 10903104 1 2023-12-06T15:00:30.175 INFO:tasks.workunit.client.0.smithi152.stdout:3/469: write d9/d10/d12/d43/d52/d58/f4f [1494409,66241] 0 2023-12-06T15:00:30.176 INFO:tasks.workunit.client.0.smithi152.stdout:6/678: write d1/dcf/ddc/f48 [741425,11088] 0 2023-12-06T15:00:30.176 INFO:tasks.workunit.client.0.smithi152.stdout:6/679: dread - d1/dcf/ddc/d1a/d30/d36/d35/d49/d50/fae zero size 2023-12-06T15:00:30.176 INFO:tasks.workunit.client.0.smithi152.stdout:6/680: dread - d1/dcf/ddc/d1a/d30/d36/d4e/d55/dbf/fed zero size 2023-12-06T15:00:30.179 INFO:tasks.workunit.client.0.smithi152.stdout:6/681: write d1/d69/da1/f5f [5849900,105481] 0 2023-12-06T15:00:30.181 INFO:tasks.workunit.client.0.smithi152.stdout:6/682: mknod d1/dcf/ddc/d8a/cf9 0 2023-12-06T15:00:30.183 INFO:tasks.workunit.client.1.smithi190.stdout:0/680: mknod d0/da/d3e/d2b/d3c/d46/d8e/d90/dda/ce0 0 2023-12-06T15:00:30.184 INFO:tasks.workunit.client.1.smithi190.stdout:3/759: rename d4/d1b/d77/da8 to d4/d70/d19/d51/d109 0 2023-12-06T15:00:30.184 INFO:tasks.workunit.client.0.smithi152.stdout:6/683: creat d1/dcf/ddc/d1a/d30/d18/ffa x:0 0 0 2023-12-06T15:00:30.189 INFO:tasks.workunit.client.1.smithi190.stdout:7/779: mkdir d0/df/d1f/dfa 0 2023-12-06T15:00:30.189 INFO:tasks.workunit.client.1.smithi190.stdout:3/760: creat d4/d1b/d54/d9c/d68/dfc/d56/d83/de2/f10a x:0 0 0 2023-12-06T15:00:30.189 INFO:tasks.workunit.client.1.smithi190.stdout:5/578: symlink d0/d1c/d94/lc8 0 2023-12-06T15:00:30.190 INFO:tasks.workunit.client.0.smithi152.stdout:6/684: creat d1/dcf/ddc/d1a/d30/da4/ffb x:0 0 0 2023-12-06T15:00:30.191 INFO:tasks.workunit.client.1.smithi190.stdout:0/681: dread d0/f2e [4194304,4194304] 0 2023-12-06T15:00:30.194 INFO:tasks.workunit.client.1.smithi190.stdout:7/780: mknod d0/df/d1f/dbd/cfb 0 2023-12-06T15:00:30.194 INFO:tasks.workunit.client.1.smithi190.stdout:7/781: truncate d0/d88/d1c/d17/f4a 1605815 0 2023-12-06T15:00:30.194 INFO:tasks.workunit.client.1.smithi190.stdout:7/782: fdatasync d0/d88/f57 0 2023-12-06T15:00:30.195 INFO:tasks.workunit.client.1.smithi190.stdout:3/761: creat d4/d70/d19/d51/d109/db7/dd2/f10b x:0 0 0 2023-12-06T15:00:30.196 INFO:tasks.workunit.client.1.smithi190.stdout:0/682: symlink d0/da/d74/le1 0 2023-12-06T15:00:30.197 INFO:tasks.workunit.client.1.smithi190.stdout:7/783: creat d0/df/d53/d15/ffc x:0 0 0 2023-12-06T15:00:30.197 INFO:tasks.workunit.client.1.smithi190.stdout:7/784: readlink d0/d88/d32/l52 0 2023-12-06T15:00:30.198 INFO:tasks.workunit.client.1.smithi190.stdout:3/762: truncate d4/d70/d19/d3a/d3b/d72/f86 874301 0 2023-12-06T15:00:30.199 INFO:tasks.workunit.client.1.smithi190.stdout:7/785: creat d0/d5/d63/ffd x:0 0 0 2023-12-06T15:00:30.200 INFO:tasks.workunit.client.0.smithi152.stdout:5/478: sync 2023-12-06T15:00:30.200 INFO:tasks.workunit.client.0.smithi152.stdout:4/652: sync 2023-12-06T15:00:30.201 INFO:tasks.workunit.client.1.smithi190.stdout:3/763: creat d4/d70/d19/d3a/d3b/f10c x:0 0 0 2023-12-06T15:00:30.203 INFO:tasks.workunit.client.0.smithi152.stdout:4/653: rmdir d2/d10/dab 39 2023-12-06T15:00:30.207 INFO:tasks.workunit.client.0.smithi152.stdout:4/654: rename d2/d10/d27 to d2/d10/dbb/dca/dcb 0 2023-12-06T15:00:30.207 INFO:tasks.workunit.client.0.smithi152.stdout:2/383: sync 2023-12-06T15:00:30.207 INFO:tasks.workunit.client.0.smithi152.stdout:9/440: sync 2023-12-06T15:00:30.207 INFO:tasks.workunit.client.0.smithi152.stdout:7/357: sync 2023-12-06T15:00:30.207 INFO:tasks.workunit.client.0.smithi152.stdout:9/441: readlink d0/d3f/d68/d6c/l2e 0 2023-12-06T15:00:30.207 INFO:tasks.workunit.client.0.smithi152.stdout:7/358: read dd/df/d34/f59 [667646,108048] 0 2023-12-06T15:00:30.209 INFO:tasks.workunit.client.0.smithi152.stdout:4/655: getdents d2/d22/d6e/da8 0 2023-12-06T15:00:30.209 INFO:tasks.workunit.client.0.smithi152.stdout:4/656: chown d2/d15/d32/c65 328 1 2023-12-06T15:00:30.210 INFO:tasks.workunit.client.1.smithi190.stdout:0/683: dread d0/da/d3e/d2b/d37/f76 [0,4194304] 0 2023-12-06T15:00:30.210 INFO:tasks.workunit.client.1.smithi190.stdout:6/762: dwrite d4/d12/d40/f9e [0,4194304] 0 2023-12-06T15:00:30.211 INFO:tasks.workunit.client.0.smithi152.stdout:7/359: creat dd/df/d1b/d20/d28/f68 x:0 0 0 2023-12-06T15:00:30.217 INFO:tasks.workunit.client.1.smithi190.stdout:5/579: dread d0/d1c/d2b/f32 [0,4194304] 0 2023-12-06T15:00:30.218 INFO:tasks.workunit.client.1.smithi190.stdout:0/684: unlink d0/da/d3e/d2b/d3c/d4c/da8/fb6 0 2023-12-06T15:00:30.218 INFO:tasks.workunit.client.1.smithi190.stdout:0/685: truncate d0/da/d3e/d2b/d37/fc4 769140 0 2023-12-06T15:00:30.218 INFO:tasks.workunit.client.1.smithi190.stdout:0/686: fdatasync d0/da/d3e/d2b/f33 0 2023-12-06T15:00:30.220 INFO:tasks.workunit.client.1.smithi190.stdout:6/763: rename d4/d12/d1a/f1c to d4/d12/d1a/d8c/da6/ffb 0 2023-12-06T15:00:30.220 INFO:tasks.workunit.client.1.smithi190.stdout:6/764: stat d4/d12/d40/ld7 0 2023-12-06T15:00:30.221 INFO:tasks.workunit.client.1.smithi190.stdout:0/687: getdents d0/da/db7 0 2023-12-06T15:00:30.221 INFO:tasks.workunit.client.0.smithi152.stdout:9/442: write d0/f15 [3410572,12621] 0 2023-12-06T15:00:30.221 INFO:tasks.workunit.client.1.smithi190.stdout:5/580: creat d0/d1c/d3e/d7e/fc9 x:0 0 0 2023-12-06T15:00:30.226 INFO:tasks.workunit.client.1.smithi190.stdout:0/688: getdents d0/da/d3e/d2b/d37 0 2023-12-06T15:00:30.227 INFO:tasks.workunit.client.1.smithi190.stdout:0/689: write d0/da/d3e/d3a/d40/d6f/fba [332868,71569] 0 2023-12-06T15:00:30.232 INFO:tasks.workunit.client.1.smithi190.stdout:5/581: truncate d0/df/f41 48882 0 2023-12-06T15:00:30.238 INFO:tasks.workunit.client.0.smithi152.stdout:1/668: dwrite d3/d73/ff7 [0,4194304] 0 2023-12-06T15:00:30.247 INFO:tasks.workunit.client.0.smithi152.stdout:3/470: dwrite d9/d10/f68 [0,4194304] 0 2023-12-06T15:00:30.262 INFO:tasks.workunit.client.1.smithi190.stdout:5/582: dread d0/d1c/d2b/d2c/d5d/d73/f1f [0,4194304] 0 2023-12-06T15:00:30.270 INFO:tasks.workunit.client.1.smithi190.stdout:3/764: dwrite d4/d1b/fd9 [0,4194304] 0 2023-12-06T15:00:30.276 INFO:tasks.workunit.client.1.smithi190.stdout:3/765: write d4/d1b/d54/d9c/d68/dfc/d56/d94/f91 [2949854,41087] 0 2023-12-06T15:00:30.276 INFO:tasks.workunit.client.1.smithi190.stdout:3/766: fsync d4/d1b/d54/d9c/fb6 0 2023-12-06T15:00:30.281 INFO:tasks.workunit.client.0.smithi152.stdout:0/495: dwrite d8/d3e/d87/f92 [0,4194304] 0 2023-12-06T15:00:30.282 INFO:tasks.workunit.client.1.smithi190.stdout:9/803: dwrite f1 [0,4194304] 0 2023-12-06T15:00:30.283 INFO:tasks.workunit.client.0.smithi152.stdout:6/685: dwrite d1/d69/da1/d87/d15/f1d [0,4194304] 0 2023-12-06T15:00:30.283 INFO:tasks.workunit.client.0.smithi152.stdout:1/669: dread d3/da/d15/fd3 [0,4194304] 0 2023-12-06T15:00:30.283 INFO:tasks.workunit.client.0.smithi152.stdout:1/670: truncate d3/da/db/fbc 216659 0 2023-12-06T15:00:30.287 INFO:tasks.workunit.client.1.smithi190.stdout:7/786: dwrite d0/d88/d7a/d7c/dab/dc0/dd1/fe3 [0,4194304] 0 2023-12-06T15:00:30.292 INFO:tasks.workunit.client.1.smithi190.stdout:5/583: dwrite d0/d1c/d3e/f76 [0,4194304] 0 2023-12-06T15:00:30.293 INFO:tasks.workunit.client.0.smithi152.stdout:3/471: dwrite d9/d10/d12/d43/d52/f71 [0,4194304] 0 2023-12-06T15:00:30.294 INFO:tasks.workunit.client.0.smithi152.stdout:3/472: fsync d9/d10/d12/d43/d52/f71 0 2023-12-06T15:00:30.294 INFO:tasks.workunit.client.0.smithi152.stdout:2/384: dwrite d6/d1e/d7a/f7b [0,4194304] 0 2023-12-06T15:00:30.294 INFO:tasks.workunit.client.0.smithi152.stdout:2/385: readlink d6/db/d17/l3b 0 2023-12-06T15:00:30.294 INFO:tasks.workunit.client.0.smithi152.stdout:2/386: chown d6/d1e/d41/d55/f14 868718 1 2023-12-06T15:00:30.294 INFO:tasks.workunit.client.0.smithi152.stdout:8/328: dwrite d1/d6/d34/d36/f60 [0,4194304] 0 2023-12-06T15:00:30.294 INFO:tasks.workunit.client.0.smithi152.stdout:6/686: rmdir d1/dcf/ddc/d1a/d30/d36/d26 39 2023-12-06T15:00:30.294 INFO:tasks.workunit.client.0.smithi152.stdout:9/443: dwrite d0/d3f/d68/d6c/d20/f21 [0,4194304] 0 2023-12-06T15:00:30.294 INFO:tasks.workunit.client.0.smithi152.stdout:9/444: fsync d0/f6 0 2023-12-06T15:00:30.294 INFO:tasks.workunit.client.0.smithi152.stdout:7/360: dwrite dd/df/d1b/d20/f4d [0,4194304] 0 2023-12-06T15:00:30.294 INFO:tasks.workunit.client.0.smithi152.stdout:5/479: dwrite d7/dd/d4e/f70 [0,4194304] 0 2023-12-06T15:00:30.294 INFO:tasks.workunit.client.0.smithi152.stdout:4/657: dwrite d2/d15/d32/d69/d6f/d6c/f73 [0,4194304] 0 2023-12-06T15:00:30.295 INFO:tasks.workunit.client.0.smithi152.stdout:0/496: rmdir d8/d15/d45/d73/d9a 0 2023-12-06T15:00:30.295 INFO:tasks.workunit.client.0.smithi152.stdout:3/473: write d9/d10/f2a [17048,38939] 0 2023-12-06T15:00:30.296 INFO:tasks.workunit.client.0.smithi152.stdout:6/687: write d1/d89/ff2 [4228937,10331] 0 2023-12-06T15:00:30.296 INFO:tasks.workunit.client.0.smithi152.stdout:6/688: chown d1/dcf/ddc/d1a/d30/d36/d35/d63/cf3 30860 1 2023-12-06T15:00:30.296 INFO:tasks.workunit.client.1.smithi190.stdout:3/767: rmdir d4/d1b/d54 39 2023-12-06T15:00:30.296 INFO:tasks.workunit.client.1.smithi190.stdout:3/768: dread - d4/d70/d19/d3a/d3b/d72/df5/ff9 zero size 2023-12-06T15:00:30.299 INFO:tasks.workunit.client.0.smithi152.stdout:5/480: write d7/d47/f78 [167273,19584] 0 2023-12-06T15:00:30.299 INFO:tasks.workunit.client.0.smithi152.stdout:8/329: mknod d1/d6/c63 0 2023-12-06T15:00:30.300 INFO:tasks.workunit.client.0.smithi152.stdout:8/330: chown d1/d6/d29/d5b 16850 1 2023-12-06T15:00:30.300 INFO:tasks.workunit.client.0.smithi152.stdout:9/445: creat d0/d3f/d68/d6c/d20/d38/d45/f7b x:0 0 0 2023-12-06T15:00:30.304 INFO:tasks.workunit.client.1.smithi190.stdout:5/584: symlink d0/d1c/d3e/d7e/lca 0 2023-12-06T15:00:30.307 INFO:tasks.workunit.client.0.smithi152.stdout:0/497: symlink d8/d3e/d87/d76/d68/la0 0 2023-12-06T15:00:30.307 INFO:tasks.workunit.client.0.smithi152.stdout:7/361: rename dd/df/d1b/d20/d28/d38/d42 to dd/d69 0 2023-12-06T15:00:30.307 INFO:tasks.workunit.client.0.smithi152.stdout:0/498: read - d8/d15/d45/f7f zero size 2023-12-06T15:00:30.308 INFO:tasks.workunit.client.0.smithi152.stdout:5/481: rmdir d7 39 2023-12-06T15:00:30.308 INFO:tasks.workunit.client.0.smithi152.stdout:1/671: dwrite d3/d73/fd4 [0,4194304] 0 2023-12-06T15:00:30.309 INFO:tasks.workunit.client.1.smithi190.stdout:6/765: rename d4/d12/d1a/d8c to d4/d12/d1a/d44/dfc 0 2023-12-06T15:00:30.309 INFO:tasks.workunit.client.1.smithi190.stdout:6/766: readlink d4/d12/d1a/l63 0 2023-12-06T15:00:30.309 INFO:tasks.workunit.client.0.smithi152.stdout:8/331: mkdir d1/d6/d34/d40/d64 0 2023-12-06T15:00:30.311 INFO:tasks.workunit.client.0.smithi152.stdout:3/474: rename d9/d18/l25 to d9/d10/d19/l90 0 2023-12-06T15:00:30.313 INFO:tasks.workunit.client.0.smithi152.stdout:6/689: dread d1/fea [0,4194304] 0 2023-12-06T15:00:30.318 INFO:tasks.workunit.client.1.smithi190.stdout:3/769: mknod d4/d70/c10d 0 2023-12-06T15:00:30.320 INFO:tasks.workunit.client.1.smithi190.stdout:9/804: dwrite d4/d27/d2f/d31/d3f/d58/d72/fdd [0,4194304] 0 2023-12-06T15:00:30.321 INFO:tasks.workunit.client.1.smithi190.stdout:6/767: creat d4/d12/d1a/d8a/ffd x:0 0 0 2023-12-06T15:00:30.322 INFO:tasks.workunit.client.1.smithi190.stdout:0/690: rename d0/l2c to d0/da/db7/le2 0 2023-12-06T15:00:30.322 INFO:tasks.workunit.client.0.smithi152.stdout:8/332: symlink d1/d6/d34/d40/d64/l65 0 2023-12-06T15:00:30.324 INFO:tasks.workunit.client.0.smithi152.stdout:3/475: dread d9/d18/f3c [0,4194304] 0 2023-12-06T15:00:30.324 INFO:tasks.workunit.client.0.smithi152.stdout:5/482: rename d7/dd/d26/d3b/d46/l6f to d7/d43/d6c/da4/la9 0 2023-12-06T15:00:30.325 INFO:tasks.workunit.client.1.smithi190.stdout:5/585: symlink d0/d1c/d3e/lcb 0 2023-12-06T15:00:30.325 INFO:tasks.workunit.client.1.smithi190.stdout:3/770: mkdir d4/d70/d33/d10e 0 2023-12-06T15:00:30.326 INFO:tasks.workunit.client.0.smithi152.stdout:4/658: dwrite d2/d22/d6e/fb7 [0,4194304] 0 2023-12-06T15:00:30.326 INFO:tasks.workunit.client.0.smithi152.stdout:8/333: mkdir d1/d6/d34/d35/d66 0 2023-12-06T15:00:30.327 INFO:tasks.workunit.client.0.smithi152.stdout:5/483: mknod d7/caa 0 2023-12-06T15:00:30.327 INFO:tasks.workunit.client.1.smithi190.stdout:9/805: truncate d4/f25 3313707 0 2023-12-06T15:00:30.329 INFO:tasks.workunit.client.1.smithi190.stdout:6/768: unlink d4/d12/d1a/d32/caf 0 2023-12-06T15:00:30.331 INFO:tasks.workunit.client.1.smithi190.stdout:7/787: rename d0/df/d53/d15/fad to d0/ffe 0 2023-12-06T15:00:30.331 INFO:tasks.workunit.client.1.smithi190.stdout:7/788: stat d0/d88/d1c/f23 0 2023-12-06T15:00:30.331 INFO:tasks.workunit.client.1.smithi190.stdout:7/789: stat d0/d88/d33/fc2 0 2023-12-06T15:00:30.331 INFO:tasks.workunit.client.1.smithi190.stdout:5/586: mknod d0/d1c/d2b/d2c/d5d/ccc 0 2023-12-06T15:00:30.331 INFO:tasks.workunit.client.1.smithi190.stdout:5/587: fsync d0/df/f20 0 2023-12-06T15:00:30.332 INFO:tasks.workunit.client.0.smithi152.stdout:2/387: dwrite d6/d1e/f53 [0,4194304] 0 2023-12-06T15:00:30.332 INFO:tasks.workunit.client.0.smithi152.stdout:4/659: mkdir d2/d15/d32/d79/dcc 0 2023-12-06T15:00:30.332 INFO:tasks.workunit.client.1.smithi190.stdout:3/771: mknod d4/d70/d19/d51/d109/c10f 0 2023-12-06T15:00:30.333 INFO:tasks.workunit.client.0.smithi152.stdout:8/334: creat d1/d6/d34/d36/f67 x:0 0 0 2023-12-06T15:00:30.333 INFO:tasks.workunit.client.0.smithi152.stdout:8/335: truncate d1/d6/f31 1527596 0 2023-12-06T15:00:30.333 INFO:tasks.workunit.client.1.smithi190.stdout:9/806: truncate d4/d27/d2f/f5e 3031846 0 2023-12-06T15:00:30.334 INFO:tasks.workunit.client.0.smithi152.stdout:5/484: mknod d7/d43/d6c/cab 0 2023-12-06T15:00:30.334 INFO:tasks.workunit.client.0.smithi152.stdout:5/485: readlink d7/d43/d6c/l77 0 2023-12-06T15:00:30.334 INFO:tasks.workunit.client.1.smithi190.stdout:6/769: mkdir d4/d12/d40/d43/dba/dfe 0 2023-12-06T15:00:30.335 INFO:tasks.workunit.client.1.smithi190.stdout:7/790: creat d0/d5/d63/fff x:0 0 0 2023-12-06T15:00:30.335 INFO:tasks.workunit.client.1.smithi190.stdout:7/791: dread - d0/d88/d1c/d17/fca zero size 2023-12-06T15:00:30.335 INFO:tasks.workunit.client.0.smithi152.stdout:1/672: rename d3/da/d4c/d82/laf to d3/da/d15/lfe 0 2023-12-06T15:00:30.336 INFO:tasks.workunit.client.0.smithi152.stdout:1/673: write d3/da/d15/d17/d1a/fa1 [233141,115693] 0 2023-12-06T15:00:30.336 INFO:tasks.workunit.client.1.smithi190.stdout:5/588: mkdir d0/d6c/dcd 0 2023-12-06T15:00:30.336 INFO:tasks.workunit.client.1.smithi190.stdout:5/589: write d0/d6c/f8c [790253,104724] 0 2023-12-06T15:00:30.336 INFO:tasks.workunit.client.1.smithi190.stdout:3/772: creat d4/d1b/d54/d9c/d68/dfc/dc4/f110 x:0 0 0 2023-12-06T15:00:30.337 INFO:tasks.workunit.client.1.smithi190.stdout:3/773: write d4/d1b/d77/fdc [24662,34712] 0 2023-12-06T15:00:30.337 INFO:tasks.workunit.client.1.smithi190.stdout:6/770: mkdir d4/d12/d40/d43/d45/dff 0 2023-12-06T15:00:30.337 INFO:tasks.workunit.client.1.smithi190.stdout:6/771: dread - d4/d12/d1a/d8a/fd4 zero size 2023-12-06T15:00:30.338 INFO:tasks.workunit.client.1.smithi190.stdout:7/792: rmdir d0/d88/d1c/d17 39 2023-12-06T15:00:30.339 INFO:tasks.workunit.client.1.smithi190.stdout:5/590: mknod d0/d96/dc5/cce 0 2023-12-06T15:00:30.339 INFO:tasks.workunit.client.0.smithi152.stdout:2/388: rmdir d6/d1e/d41 39 2023-12-06T15:00:30.340 INFO:tasks.workunit.client.0.smithi152.stdout:4/660: creat d2/d10/dbb/dca/dbc/fcd x:0 0 0 2023-12-06T15:00:30.341 INFO:tasks.workunit.client.1.smithi190.stdout:3/774: mkdir d4/d70/d19/d111 0 2023-12-06T15:00:30.341 INFO:tasks.workunit.client.1.smithi190.stdout:3/775: write d4/d70/d33/d45/fef [817036,129747] 0 2023-12-06T15:00:30.342 INFO:tasks.workunit.client.1.smithi190.stdout:7/793: truncate d0/d88/f57 216097 0 2023-12-06T15:00:30.342 INFO:tasks.workunit.client.1.smithi190.stdout:7/794: chown d0/df/d53/d2f 19233397 1 2023-12-06T15:00:30.342 INFO:tasks.workunit.client.0.smithi152.stdout:8/336: creat d1/d6/d34/d40/d64/f68 x:0 0 0 2023-12-06T15:00:30.342 INFO:tasks.workunit.client.0.smithi152.stdout:8/337: readlink d1/d6/d34/d36/l61 0 2023-12-06T15:00:30.342 INFO:tasks.workunit.client.0.smithi152.stdout:4/661: write d2/d15/f96 [148266,43298] 0 2023-12-06T15:00:30.342 INFO:tasks.workunit.client.1.smithi190.stdout:3/776: symlink d4/d70/d19/d51/d109/db7/dd2/l112 0 2023-12-06T15:00:30.343 INFO:tasks.workunit.client.1.smithi190.stdout:3/777: truncate d4/d1b/d54/d9c/fb2 122428 0 2023-12-06T15:00:30.343 INFO:tasks.workunit.client.1.smithi190.stdout:3/778: readlink d4/l2b 0 2023-12-06T15:00:30.343 INFO:tasks.workunit.client.0.smithi152.stdout:5/486: mkdir d7/dd/d4e/dac 0 2023-12-06T15:00:30.343 INFO:tasks.workunit.client.1.smithi190.stdout:7/795: getdents d0/d88/d7a/d7c/dab 0 2023-12-06T15:00:30.344 INFO:tasks.workunit.client.0.smithi152.stdout:1/674: symlink d3/da/d15/d17/d4d/da7/lff 0 2023-12-06T15:00:30.344 INFO:tasks.workunit.client.1.smithi190.stdout:3/779: symlink d4/d70/d19/d3a/d3b/l113 0 2023-12-06T15:00:30.345 INFO:tasks.workunit.client.1.smithi190.stdout:3/780: fsync d4/d1b/f38 0 2023-12-06T15:00:30.345 INFO:tasks.workunit.client.1.smithi190.stdout:6/772: write d4/d12/d40/d43/f7a [915481,87273] 0 2023-12-06T15:00:30.345 INFO:tasks.workunit.client.0.smithi152.stdout:3/476: dread d9/d10/f68 [0,4194304] 0 2023-12-06T15:00:30.347 INFO:tasks.workunit.client.0.smithi152.stdout:1/675: read d3/da/d4c/ffb [2365530,90365] 0 2023-12-06T15:00:30.347 INFO:tasks.workunit.client.0.smithi152.stdout:5/487: chown d7/dd/d26/d3b/d46/d7e/c82 2704 1 2023-12-06T15:00:30.348 INFO:tasks.workunit.client.0.smithi152.stdout:8/338: creat d1/d6/f69 x:0 0 0 2023-12-06T15:00:30.348 INFO:tasks.workunit.client.0.smithi152.stdout:8/339: readlink d1/d6/d34/d36/l56 0 2023-12-06T15:00:30.349 INFO:tasks.workunit.client.0.smithi152.stdout:3/477: mkdir d9/d18/d1a/d77/d91 0 2023-12-06T15:00:30.349 INFO:tasks.workunit.client.0.smithi152.stdout:5/488: write d7/d47/f74 [2849954,8204] 0 2023-12-06T15:00:30.349 INFO:tasks.workunit.client.0.smithi152.stdout:1/676: write d3/da/db/d54/f6a [4624378,38688] 0 2023-12-06T15:00:30.350 INFO:tasks.workunit.client.0.smithi152.stdout:8/340: symlink d1/d6/d34/d35/l6a 0 2023-12-06T15:00:30.353 INFO:tasks.workunit.client.0.smithi152.stdout:3/478: rename d9/d18/f3c to d9/d18/f92 0 2023-12-06T15:00:30.353 INFO:tasks.workunit.client.0.smithi152.stdout:3/479: readlink d9/lb 0 2023-12-06T15:00:30.353 INFO:tasks.workunit.client.0.smithi152.stdout:3/480: dread - d9/d18/d39/f8e zero size 2023-12-06T15:00:30.353 INFO:tasks.workunit.client.0.smithi152.stdout:3/481: dread - d9/d18/d1a/f4e zero size 2023-12-06T15:00:30.354 INFO:tasks.workunit.client.0.smithi152.stdout:3/482: chown d9/d10/d19/l1b 340 1 2023-12-06T15:00:30.356 INFO:tasks.workunit.client.1.smithi190.stdout:9/807: dread d4/f24 [0,4194304] 0 2023-12-06T15:00:30.359 INFO:tasks.workunit.client.0.smithi152.stdout:8/341: symlink d1/d6/d29/d3b/l6b 0 2023-12-06T15:00:30.359 INFO:tasks.workunit.client.0.smithi152.stdout:1/677: creat d3/da/dcd/f100 x:0 0 0 2023-12-06T15:00:30.359 INFO:tasks.workunit.client.0.smithi152.stdout:5/489: rename d7/dd/d26/d3b/d46/d7e/f99 to d7/d43/d6c/da4/fad 0 2023-12-06T15:00:30.361 INFO:tasks.workunit.client.0.smithi152.stdout:9/446: dwrite d0/d3f/d68/d6c/d20/d38/d45/f37 [0,4194304] 0 2023-12-06T15:00:30.361 INFO:tasks.workunit.client.0.smithi152.stdout:9/447: dread - d0/d3f/d68/d6c/d20/d38/d44/f77 zero size 2023-12-06T15:00:30.361 INFO:tasks.workunit.client.0.smithi152.stdout:3/483: creat d9/d10/d12/f93 x:0 0 0 2023-12-06T15:00:30.363 INFO:tasks.workunit.client.0.smithi152.stdout:8/342: truncate d1/d6/d34/f1a 2370784 0 2023-12-06T15:00:30.364 INFO:tasks.workunit.client.0.smithi152.stdout:5/490: link d7/dd/d26/d3b/f8b d7/dd/d26/fae 0 2023-12-06T15:00:30.366 INFO:tasks.workunit.client.0.smithi152.stdout:7/362: dwrite f8 [0,4194304] 0 2023-12-06T15:00:30.367 INFO:tasks.workunit.client.0.smithi152.stdout:1/678: rename d3/l8 to d3/da/d4c/d85/l101 0 2023-12-06T15:00:30.373 INFO:tasks.workunit.client.0.smithi152.stdout:7/363: link dd/df/d1b/d20/d28/d38/f39 dd/df/f6a 0 2023-12-06T15:00:30.374 INFO:tasks.workunit.client.0.smithi152.stdout:9/448: mknod d0/d3f/d5f/c7c 0 2023-12-06T15:00:30.374 INFO:tasks.workunit.client.0.smithi152.stdout:3/484: creat d9/d10/f94 x:0 0 0 2023-12-06T15:00:30.374 INFO:tasks.workunit.client.0.smithi152.stdout:7/364: dread - dd/d69/f3d zero size 2023-12-06T15:00:30.374 INFO:tasks.workunit.client.0.smithi152.stdout:7/365: fdatasync dd/d69/f3d 0 2023-12-06T15:00:30.374 INFO:tasks.workunit.client.0.smithi152.stdout:7/366: getdents dd/d69 0 2023-12-06T15:00:30.374 INFO:tasks.workunit.client.0.smithi152.stdout:1/679: rmdir d3/da 39 2023-12-06T15:00:30.375 INFO:tasks.workunit.client.0.smithi152.stdout:1/680: dread - d3/d44/d84/fba zero size 2023-12-06T15:00:30.375 INFO:tasks.workunit.client.0.smithi152.stdout:1/681: write d3/da/db/f11 [4369290,112303] 0 2023-12-06T15:00:30.375 INFO:tasks.workunit.client.0.smithi152.stdout:5/491: dread d7/d43/f4b [0,4194304] 0 2023-12-06T15:00:30.375 INFO:tasks.workunit.client.0.smithi152.stdout:3/485: rename d9/d10/d12/d43/d52/d58/f42 to d9/d18/f95 0 2023-12-06T15:00:30.378 INFO:tasks.workunit.client.0.smithi152.stdout:3/486: symlink d9/d18/d51/l96 0 2023-12-06T15:00:30.381 INFO:tasks.workunit.client.0.smithi152.stdout:7/367: write dd/df/d1b/d20/d28/f30 [2062118,100030] 0 2023-12-06T15:00:30.381 INFO:tasks.workunit.client.0.smithi152.stdout:5/492: dread d7/d43/f4b [0,4194304] 0 2023-12-06T15:00:30.383 INFO:tasks.workunit.client.0.smithi152.stdout:5/493: truncate d7/dd/f2c 2617566 0 2023-12-06T15:00:30.388 INFO:tasks.workunit.client.0.smithi152.stdout:9/449: dread d0/d3f/d68/d6c/d20/f51 [0,4194304] 0 2023-12-06T15:00:30.388 INFO:tasks.workunit.client.0.smithi152.stdout:9/450: chown d0/d3f/d68/d6c/d20/d38/d45 26225 1 2023-12-06T15:00:30.389 INFO:tasks.workunit.client.1.smithi190.stdout:0/691: dwrite d0/da/d3e/d2b/f45 [4194304,4194304] 0 2023-12-06T15:00:30.391 INFO:tasks.workunit.client.0.smithi152.stdout:9/451: symlink d0/d3f/d68/d6c/d20/d38/d45/l7d 0 2023-12-06T15:00:30.391 INFO:tasks.workunit.client.0.smithi152.stdout:9/452: fdatasync d0/d3f/d5f/d60/f6b 0 2023-12-06T15:00:30.391 INFO:tasks.workunit.client.0.smithi152.stdout:6/690: dwrite d1/dcf/ddc/d8a/f94 [4194304,4194304] 0 2023-12-06T15:00:30.393 INFO:tasks.workunit.client.1.smithi190.stdout:5/591: dwrite d0/d1c/d2b/f9a [0,4194304] 0 2023-12-06T15:00:30.393 INFO:tasks.workunit.client.1.smithi190.stdout:5/592: chown d0/d1c/d2b/c47 3 1 2023-12-06T15:00:30.403 INFO:tasks.workunit.client.1.smithi190.stdout:1/955: sync 2023-12-06T15:00:30.410 INFO:tasks.workunit.client.0.smithi152.stdout:4/662: dwrite d2/d10/fa5 [0,4194304] 0 2023-12-06T15:00:30.411 INFO:tasks.workunit.client.1.smithi190.stdout:5/593: dread d0/d1c/d2b/f48 [4194304,4194304] 0 2023-12-06T15:00:30.411 INFO:tasks.workunit.client.1.smithi190.stdout:5/594: chown d0/d1c/d85/d90/f97 26620 1 2023-12-06T15:00:30.411 INFO:tasks.workunit.client.1.smithi190.stdout:5/595: chown d0/d1c/d2b/d8b 20720 1 2023-12-06T15:00:30.411 INFO:tasks.workunit.client.1.smithi190.stdout:5/596: dread - d0/d1c/d2b/d69/fac zero size 2023-12-06T15:00:30.412 INFO:tasks.workunit.client.1.smithi190.stdout:5/597: getdents d0/df/d50/d9c 0 2023-12-06T15:00:30.413 INFO:tasks.workunit.client.0.smithi152.stdout:6/691: dread d1/dcf/ddc/d8a/f94 [4194304,4194304] 0 2023-12-06T15:00:30.414 INFO:tasks.workunit.client.1.smithi190.stdout:3/781: dwrite d4/d70/d19/d3a/f73 [0,4194304] 0 2023-12-06T15:00:30.416 INFO:tasks.workunit.client.1.smithi190.stdout:3/782: mknod d4/d1b/d54/d9c/d68/dfc/d56/d94/c114 0 2023-12-06T15:00:30.416 INFO:tasks.workunit.client.1.smithi190.stdout:3/783: dread - d4/d70/d19/d51/dab/ff7 zero size 2023-12-06T15:00:30.418 INFO:tasks.workunit.client.1.smithi190.stdout:1/956: write d6/dc/d29/d38/d73/d5c/db5/fe6 [3151833,56283] 0 2023-12-06T15:00:30.418 INFO:tasks.workunit.client.1.smithi190.stdout:3/784: link d4/d1b/f22 d4/d70/d19/d3a/ddf/f115 0 2023-12-06T15:00:30.418 INFO:tasks.workunit.client.1.smithi190.stdout:1/957: fsync d6/dc/d29/d38/d73/d5c/dd2/fd8 0 2023-12-06T15:00:30.418 INFO:tasks.workunit.client.1.smithi190.stdout:7/796: write d0/df/d1f/f6f [4878238,14287] 0 2023-12-06T15:00:30.419 INFO:tasks.workunit.client.1.smithi190.stdout:1/958: creat d6/dc/d29/d38/d73/d5c/f130 x:0 0 0 2023-12-06T15:00:30.420 INFO:tasks.workunit.client.1.smithi190.stdout:3/785: creat d4/d70/d19/d3a/ddf/f116 x:0 0 0 2023-12-06T15:00:30.422 INFO:tasks.workunit.client.1.smithi190.stdout:1/959: rename d6/dc/d29/d38/d43/d7f/da7/f118 to d6/dc/d3b/d78/d106/f131 0 2023-12-06T15:00:30.424 INFO:tasks.workunit.client.0.smithi152.stdout:4/663: dread d2/f8 [0,4194304] 0 2023-12-06T15:00:30.424 INFO:tasks.workunit.client.1.smithi190.stdout:5/598: dread d0/df/f2e [0,4194304] 0 2023-12-06T15:00:30.425 INFO:tasks.workunit.client.0.smithi152.stdout:4/664: mknod d2/d15/d32/d69/cce 0 2023-12-06T15:00:30.426 INFO:tasks.workunit.client.1.smithi190.stdout:5/599: mknod d0/d1c/d3e/d7e/ccf 0 2023-12-06T15:00:30.427 INFO:tasks.workunit.client.1.smithi190.stdout:5/600: dread - d0/d1c/fb2 zero size 2023-12-06T15:00:30.428 INFO:tasks.workunit.client.0.smithi152.stdout:4/665: rmdir d2/d15/d32/d91 39 2023-12-06T15:00:30.428 INFO:tasks.workunit.client.0.smithi152.stdout:4/666: truncate d2/d89/f83 5067750 0 2023-12-06T15:00:30.428 INFO:tasks.workunit.client.0.smithi152.stdout:4/667: chown d2/d15/d32/d69 9308 1 2023-12-06T15:00:30.429 INFO:tasks.workunit.client.0.smithi152.stdout:4/668: truncate d2/d15/d32/d69/f93 1339415 0 2023-12-06T15:00:30.429 INFO:tasks.workunit.client.0.smithi152.stdout:4/669: chown d2/d10/dbb/dca/dbc/d42/fc0 1019 1 2023-12-06T15:00:30.432 INFO:tasks.workunit.client.1.smithi190.stdout:6/773: dwrite d4/d12/d40/d43/d45/d4a/d77/dca/fa4 [4194304,4194304] 0 2023-12-06T15:00:30.434 INFO:tasks.workunit.client.0.smithi152.stdout:4/670: dread d2/d15/d32/d91/fb2 [0,4194304] 0 2023-12-06T15:00:30.434 INFO:tasks.workunit.client.0.smithi152.stdout:0/499: dwrite d8/d3e/d87/f53 [0,4194304] 0 2023-12-06T15:00:30.434 INFO:tasks.workunit.client.0.smithi152.stdout:4/671: chown d2/d10/dbb/dca/dbc/fcd 21483176 1 2023-12-06T15:00:30.436 INFO:tasks.workunit.client.1.smithi190.stdout:6/774: symlink d4/d12/d1a/d44/dfc/da6/l100 0 2023-12-06T15:00:30.437 INFO:tasks.workunit.client.0.smithi152.stdout:0/500: rename d8/d3e/f52 to d8/d3e/fa1 0 2023-12-06T15:00:30.438 INFO:tasks.workunit.client.1.smithi190.stdout:6/775: creat d4/d12/d40/d43/d45/d4a/dc5/f101 x:0 0 0 2023-12-06T15:00:30.440 INFO:tasks.workunit.client.1.smithi190.stdout:6/776: creat d4/d12/d1a/d32/dc7/f102 x:0 0 0 2023-12-06T15:00:30.440 INFO:tasks.workunit.client.0.smithi152.stdout:0/501: mkdir d8/d15/d45/da2 0 2023-12-06T15:00:30.441 INFO:tasks.workunit.client.1.smithi190.stdout:9/808: dwrite d4/d27/d2f/d31/fc9 [0,4194304] 0 2023-12-06T15:00:30.442 INFO:tasks.workunit.client.0.smithi152.stdout:5/494: fsync d7/dd/d26/f3d 0 2023-12-06T15:00:30.443 INFO:tasks.workunit.client.0.smithi152.stdout:2/389: dwrite d6/d1e/f2e [0,4194304] 0 2023-12-06T15:00:30.443 INFO:tasks.workunit.client.1.smithi190.stdout:9/809: dread d4/d27/d8a/fae [0,4194304] 0 2023-12-06T15:00:30.444 INFO:tasks.workunit.client.0.smithi152.stdout:0/502: creat d8/d44/fa3 x:0 0 0 2023-12-06T15:00:30.448 INFO:tasks.workunit.client.1.smithi190.stdout:6/777: creat d4/d12/d1a/d32/dab/dd3/f103 x:0 0 0 2023-12-06T15:00:30.448 INFO:tasks.workunit.client.1.smithi190.stdout:6/778: truncate d4/d12/d1a/d32/dab/dd3/f103 859133 0 2023-12-06T15:00:30.448 INFO:tasks.workunit.client.1.smithi190.stdout:6/779: chown d4/d12/d40/d43/d45/d4a/dc5/fe3 376 1 2023-12-06T15:00:30.448 INFO:tasks.workunit.client.1.smithi190.stdout:0/692: dwrite d0/da/f5c [0,4194304] 0 2023-12-06T15:00:30.449 INFO:tasks.workunit.client.1.smithi190.stdout:9/810: creat d4/d27/d2f/d5c/d9d/f108 x:0 0 0 2023-12-06T15:00:30.449 INFO:tasks.workunit.client.0.smithi152.stdout:3/487: dwrite d9/f2d [0,4194304] 0 2023-12-06T15:00:30.449 INFO:tasks.workunit.client.0.smithi152.stdout:8/343: dwrite d1/d6/d34/f57 [0,4194304] 0 2023-12-06T15:00:30.451 INFO:tasks.workunit.client.0.smithi152.stdout:9/453: dwrite d0/f30 [4194304,4194304] 0 2023-12-06T15:00:30.451 INFO:tasks.workunit.client.0.smithi152.stdout:9/454: chown d0/d3f/d68/d6c/d20/d38/d45/f64 6 1 2023-12-06T15:00:30.451 INFO:tasks.workunit.client.0.smithi152.stdout:9/455: stat d0/d3f/d68/d6c/d20/c62 0 2023-12-06T15:00:30.453 INFO:tasks.workunit.client.0.smithi152.stdout:5/495: creat d7/d43/d6c/faf x:0 0 0 2023-12-06T15:00:30.453 INFO:tasks.workunit.client.0.smithi152.stdout:7/368: dwrite dd/f2f [4194304,4194304] 0 2023-12-06T15:00:30.454 INFO:tasks.workunit.client.1.smithi190.stdout:7/797: fsync d0/df/d1f/f6f 0 2023-12-06T15:00:30.454 INFO:tasks.workunit.client.1.smithi190.stdout:0/693: creat d0/da/d3e/d2b/d3c/d46/d8e/d90/fe3 x:0 0 0 2023-12-06T15:00:30.454 INFO:tasks.workunit.client.1.smithi190.stdout:0/694: stat d0/da/d3e/d2b/d3c/d46/d8e/d90/dda/fc6 0 2023-12-06T15:00:30.456 INFO:tasks.workunit.client.0.smithi152.stdout:3/488: symlink d9/d18/d51/d8d/d8f/l97 0 2023-12-06T15:00:30.456 INFO:tasks.workunit.client.0.smithi152.stdout:3/489: fsync d9/f2d 0 2023-12-06T15:00:30.457 INFO:tasks.workunit.client.1.smithi190.stdout:9/811: creat d4/d27/d2f/d31/d3f/d58/d72/db3/dea/dcd/dff/f109 x:0 0 0 2023-12-06T15:00:30.457 INFO:tasks.workunit.client.1.smithi190.stdout:9/812: fdatasync d4/d84/dda/fde 0 2023-12-06T15:00:30.459 INFO:tasks.workunit.client.0.smithi152.stdout:3/490: write d9/d18/d51/f54 [713223,72513] 0 2023-12-06T15:00:30.460 INFO:tasks.workunit.client.0.smithi152.stdout:3/491: fdatasync d9/d10/d19/f49 0 2023-12-06T15:00:30.462 INFO:tasks.workunit.client.0.smithi152.stdout:6/692: dwrite d1/d69/da1/d87/fd6 [0,4194304] 0 2023-12-06T15:00:30.462 INFO:tasks.workunit.client.0.smithi152.stdout:6/693: stat d1/dcf/ddc/d1a/d30/d36/d4e/l58 0 2023-12-06T15:00:30.462 INFO:tasks.workunit.client.1.smithi190.stdout:7/798: truncate d0/df/d53/d99/da9/dc8/f86 2739336 0 2023-12-06T15:00:30.462 INFO:tasks.workunit.client.1.smithi190.stdout:0/695: rmdir d0/da/d5a/d80 39 2023-12-06T15:00:30.463 INFO:tasks.workunit.client.0.smithi152.stdout:5/496: symlink d7/dd/d4e/dac/lb0 0 2023-12-06T15:00:30.469 INFO:tasks.workunit.client.1.smithi190.stdout:0/696: symlink d0/da/db7/le4 0 2023-12-06T15:00:30.469 INFO:tasks.workunit.client.1.smithi190.stdout:7/799: mkdir d0/d88/d1c/d17/d100 0 2023-12-06T15:00:30.469 INFO:tasks.workunit.client.1.smithi190.stdout:7/800: fdatasync d0/d88/d33/f80 0 2023-12-06T15:00:30.471 INFO:tasks.workunit.client.1.smithi190.stdout:9/813: unlink d4/d27/d2f/d31/c48 0 2023-12-06T15:00:30.472 INFO:tasks.workunit.client.1.smithi190.stdout:4/656: sync 2023-12-06T15:00:30.472 INFO:tasks.workunit.client.1.smithi190.stdout:2/637: sync 2023-12-06T15:00:30.473 INFO:tasks.workunit.client.1.smithi190.stdout:7/801: unlink d0/df/d1f/f6f 0 2023-12-06T15:00:30.474 INFO:tasks.workunit.client.0.smithi152.stdout:9/456: dread d0/d3f/d68/d6c/d20/f21 [4194304,4194304] 0 2023-12-06T15:00:30.474 INFO:tasks.workunit.client.0.smithi152.stdout:7/369: symlink dd/df/d1b/d20/d28/d53/l6b 0 2023-12-06T15:00:30.474 INFO:tasks.workunit.client.0.smithi152.stdout:7/370: fdatasync dd/df/d1b/d20/d28/d38/f56 0 2023-12-06T15:00:30.474 INFO:tasks.workunit.client.0.smithi152.stdout:5/497: mkdir d7/dd/d26/db1 0 2023-12-06T15:00:30.474 INFO:tasks.workunit.client.0.smithi152.stdout:2/390: link d6/d1e/c10 d6/d1e/d41/c7c 0 2023-12-06T15:00:30.474 INFO:tasks.workunit.client.0.smithi152.stdout:5/498: readlink d7/d43/d6c/da4/la9 0 2023-12-06T15:00:30.474 INFO:tasks.workunit.client.0.smithi152.stdout:2/391: chown d6/db/d17/f5e 417812 1 2023-12-06T15:00:30.474 INFO:tasks.workunit.client.0.smithi152.stdout:5/499: fsync d7/dd/d26/d3a/fa7 0 2023-12-06T15:00:30.475 INFO:tasks.workunit.client.1.smithi190.stdout:0/697: write d0/da/d3e/d2b/d3c/d4c/f59 [666534,27237] 0 2023-12-06T15:00:30.475 INFO:tasks.workunit.client.1.smithi190.stdout:9/814: creat d4/d84/f10a x:0 0 0 2023-12-06T15:00:30.476 INFO:tasks.workunit.client.1.smithi190.stdout:4/657: mkdir d3/d35/d19/d41/ddb 0 2023-12-06T15:00:30.476 INFO:tasks.workunit.client.1.smithi190.stdout:2/638: mkdir d10/d26/d5c/d35/dd8 0 2023-12-06T15:00:30.477 INFO:tasks.workunit.client.1.smithi190.stdout:2/639: write d10/d26/f4c [4899539,120122] 0 2023-12-06T15:00:30.477 INFO:tasks.workunit.client.0.smithi152.stdout:7/371: unlink dd/df/d1b/d20/f4d 0 2023-12-06T15:00:30.477 INFO:tasks.workunit.client.0.smithi152.stdout:7/372: readlink dd/l27 0 2023-12-06T15:00:30.477 INFO:tasks.workunit.client.0.smithi152.stdout:5/500: symlink d7/dd/d26/d3b/lb2 0 2023-12-06T15:00:30.478 INFO:tasks.workunit.client.1.smithi190.stdout:7/802: mkdir d0/d88/d1c/d17/d94/d101 0 2023-12-06T15:00:30.478 INFO:tasks.workunit.client.1.smithi190.stdout:7/803: dread - d0/df/d53/d15/fd9 zero size 2023-12-06T15:00:30.478 INFO:tasks.workunit.client.0.smithi152.stdout:4/672: rename d2/d15/d32/d69/f93 to d2/d10/dbb/fcf 0 2023-12-06T15:00:30.478 INFO:tasks.workunit.client.0.smithi152.stdout:5/501: creat d7/dd/d26/d48/fb3 x:0 0 0 2023-12-06T15:00:30.479 INFO:tasks.workunit.client.0.smithi152.stdout:5/502: dread - d7/d43/d6c/f93 zero size 2023-12-06T15:00:30.482 INFO:tasks.workunit.client.0.smithi152.stdout:9/457: write d0/d3f/d68/d6c/d20/d38/f57 [2825642,8947] 0 2023-12-06T15:00:30.482 INFO:tasks.workunit.client.0.smithi152.stdout:9/458: write d0/d3f/d68/d6c/d20/d38/d44/f77 [690909,76565] 0 2023-12-06T15:00:30.482 INFO:tasks.workunit.client.0.smithi152.stdout:7/373: dread dd/df/d1b/d20/d28/d53/f3f [0,4194304] 0 2023-12-06T15:00:30.482 INFO:tasks.workunit.client.1.smithi190.stdout:0/698: symlink d0/da/da4/le5 0 2023-12-06T15:00:30.482 INFO:tasks.workunit.client.1.smithi190.stdout:9/815: unlink d4/d84/l87 0 2023-12-06T15:00:30.483 INFO:tasks.workunit.client.1.smithi190.stdout:9/816: fdatasync f1 0 2023-12-06T15:00:30.483 INFO:tasks.workunit.client.1.smithi190.stdout:4/658: mknod d3/d76/dc4/dc5/cdc 0 2023-12-06T15:00:30.483 INFO:tasks.workunit.client.0.smithi152.stdout:4/673: rmdir d2/d45/d84 39 2023-12-06T15:00:30.483 INFO:tasks.workunit.client.0.smithi152.stdout:5/503: truncate d7/f38 1072352 0 2023-12-06T15:00:30.484 INFO:tasks.workunit.client.0.smithi152.stdout:2/392: rename d6/d1e/d41/d55/l3e to d6/d18/l7d 0 2023-12-06T15:00:30.484 INFO:tasks.workunit.client.0.smithi152.stdout:2/393: chown d6/d1e/d41/d55/l22 107949 1 2023-12-06T15:00:30.484 INFO:tasks.workunit.client.1.smithi190.stdout:2/640: rmdir d10/d59/dcd/dad/dc4/d7f 39 2023-12-06T15:00:30.484 INFO:tasks.workunit.client.1.smithi190.stdout:5/601: dwrite d0/d1c/d2b/d2c/d5d/d73/f1f [0,4194304] 0 2023-12-06T15:00:30.485 INFO:tasks.workunit.client.1.smithi190.stdout:7/804: symlink d0/d88/d1c/d17/d94/d95/l102 0 2023-12-06T15:00:30.486 INFO:tasks.workunit.client.0.smithi152.stdout:5/504: mknod d7/dd/d26/d3b/cb4 0 2023-12-06T15:00:30.486 INFO:tasks.workunit.client.0.smithi152.stdout:5/505: dread - d7/dd/f7c zero size 2023-12-06T15:00:30.486 INFO:tasks.workunit.client.0.smithi152.stdout:5/506: fdatasync d7/dd/d26/f33 0 2023-12-06T15:00:30.487 INFO:tasks.workunit.client.1.smithi190.stdout:9/817: creat d4/d27/d2f/d31/f10b x:0 0 0 2023-12-06T15:00:30.487 INFO:tasks.workunit.client.1.smithi190.stdout:9/818: readlink d4/d27/d2f/d31/la1 0 2023-12-06T15:00:30.487 INFO:tasks.workunit.client.1.smithi190.stdout:9/819: fdatasync d4/d27/f6a 0 2023-12-06T15:00:30.487 INFO:tasks.workunit.client.1.smithi190.stdout:9/820: fdatasync d4/d27/d2f/d31/d3f/d58/d72/db3/dea/dcd/df1/f101 0 2023-12-06T15:00:30.488 INFO:tasks.workunit.client.0.smithi152.stdout:5/507: getdents d7/d47 0 2023-12-06T15:00:30.488 INFO:tasks.workunit.client.0.smithi152.stdout:9/459: rmdir d0/d3f/d5f 39 2023-12-06T15:00:30.488 INFO:tasks.workunit.client.1.smithi190.stdout:4/659: mknod d3/d76/d7c/d96/d7a/cdd 0 2023-12-06T15:00:30.488 INFO:tasks.workunit.client.1.smithi190.stdout:2/641: creat d10/d26/d5c/da5/fd9 x:0 0 0 2023-12-06T15:00:30.490 INFO:tasks.workunit.client.0.smithi152.stdout:5/508: rmdir d7/dd/d26/d3b/d46/d7e 39 2023-12-06T15:00:30.490 INFO:tasks.workunit.client.0.smithi152.stdout:5/509: stat d7/dd/f5f 0 2023-12-06T15:00:30.496 INFO:tasks.workunit.client.1.smithi190.stdout:3/786: dwrite d4/d70/d19/d3a/f73 [4194304,4194304] 0 2023-12-06T15:00:30.496 INFO:tasks.workunit.client.1.smithi190.stdout:0/699: dread d0/da/d3e/d3a/d40/d6f/d9e/fca [0,4194304] 0 2023-12-06T15:00:30.497 INFO:tasks.workunit.client.1.smithi190.stdout:0/700: chown d0/da/d3e/d87 60951 1 2023-12-06T15:00:30.498 INFO:tasks.workunit.client.1.smithi190.stdout:7/805: creat d0/df/d1f/dfa/f103 x:0 0 0 2023-12-06T15:00:30.500 INFO:tasks.workunit.client.1.smithi190.stdout:9/821: creat d4/d27/d2f/d5c/d9d/f10c x:0 0 0 2023-12-06T15:00:30.500 INFO:tasks.workunit.client.1.smithi190.stdout:4/660: creat d3/d4e/fde x:0 0 0 2023-12-06T15:00:30.500 INFO:tasks.workunit.client.1.smithi190.stdout:4/661: stat d3/d35/da5/fa7 0 2023-12-06T15:00:30.502 INFO:tasks.workunit.client.0.smithi152.stdout:7/374: dread f9 [0,4194304] 0 2023-12-06T15:00:30.502 INFO:tasks.workunit.client.1.smithi190.stdout:2/642: mkdir d10/d26/d5c/d35/dda 0 2023-12-06T15:00:30.503 INFO:tasks.workunit.client.0.smithi152.stdout:0/503: dwrite d8/d15/d45/d73/d7a/f1f [0,4194304] 0 2023-12-06T15:00:30.503 INFO:tasks.workunit.client.0.smithi152.stdout:0/504: chown d8/d15/d45/f71 5107578 1 2023-12-06T15:00:30.503 INFO:tasks.workunit.client.0.smithi152.stdout:5/510: dread d7/f18 [0,4194304] 0 2023-12-06T15:00:30.503 INFO:tasks.workunit.client.0.smithi152.stdout:0/505: dread - d8/d15/d45/f4f zero size 2023-12-06T15:00:30.503 INFO:tasks.workunit.client.0.smithi152.stdout:5/511: chown d7/dd/d26/d3b/f63 7967582 1 2023-12-06T15:00:30.505 INFO:tasks.workunit.client.0.smithi152.stdout:7/375: dread dd/df/f6a [0,4194304] 0 2023-12-06T15:00:30.505 INFO:tasks.workunit.client.0.smithi152.stdout:7/376: stat dd/df/f43 0 2023-12-06T15:00:30.505 INFO:tasks.workunit.client.0.smithi152.stdout:7/377: write dd/df/d34/f59 [1378588,83478] 0 2023-12-06T15:00:30.506 INFO:tasks.workunit.client.0.smithi152.stdout:3/492: dwrite d9/d10/f7f [0,4194304] 0 2023-12-06T15:00:30.508 INFO:tasks.workunit.client.1.smithi190.stdout:3/787: mknod d4/d1b/d5d/df1/c117 0 2023-12-06T15:00:30.508 INFO:tasks.workunit.client.1.smithi190.stdout:6/780: dwrite d4/d12/d1a/d32/dab/dd3/fe0 [0,4194304] 0 2023-12-06T15:00:30.508 INFO:tasks.workunit.client.1.smithi190.stdout:4/662: mkdir d3/d76/d7c/d8a/ddf 0 2023-12-06T15:00:30.508 INFO:tasks.workunit.client.1.smithi190.stdout:1/960: dwrite d6/dc/d29/d38/d43/f61 [0,4194304] 0 2023-12-06T15:00:30.508 INFO:tasks.workunit.client.1.smithi190.stdout:1/961: stat d6/dc/d29 0 2023-12-06T15:00:30.508 INFO:tasks.workunit.client.1.smithi190.stdout:1/962: chown d6/dc/d6f/da4/db9 489871998 1 2023-12-06T15:00:30.511 INFO:tasks.workunit.client.1.smithi190.stdout:7/806: write d0/df/d53/d2f/fd6 [3748391,111926] 0 2023-12-06T15:00:30.511 INFO:tasks.workunit.client.1.smithi190.stdout:7/807: fsync d0/d88/d1c/d17/fca 0 2023-12-06T15:00:30.511 INFO:tasks.workunit.client.1.smithi190.stdout:2/643: unlink d10/d26/d5c/d37/f3f 0 2023-12-06T15:00:30.513 INFO:tasks.workunit.client.0.smithi152.stdout:1/682: dwrite d3/d73/ffa [0,4194304] 0 2023-12-06T15:00:30.514 INFO:tasks.workunit.client.0.smithi152.stdout:8/344: dwrite d1/d6/d34/d36/f2e [0,4194304] 0 2023-12-06T15:00:30.514 INFO:tasks.workunit.client.0.smithi152.stdout:8/345: dread - d1/d6/d34/d40/d64/f68 zero size 2023-12-06T15:00:30.516 INFO:tasks.workunit.client.0.smithi152.stdout:7/378: creat dd/d17/f6c x:0 0 0 2023-12-06T15:00:30.518 INFO:tasks.workunit.client.1.smithi190.stdout:3/788: mknod d4/d70/c118 0 2023-12-06T15:00:30.519 INFO:tasks.workunit.client.0.smithi152.stdout:0/506: dread d8/d4b/f8a [0,4194304] 0 2023-12-06T15:00:30.519 INFO:tasks.workunit.client.0.smithi152.stdout:0/507: chown d8/d44 6614 1 2023-12-06T15:00:30.520 INFO:tasks.workunit.client.1.smithi190.stdout:3/789: write d4/d70/d19/d3a/f73 [5474673,12616] 0 2023-12-06T15:00:30.520 INFO:tasks.workunit.client.1.smithi190.stdout:3/790: write d4/d70/d33/fa9 [393044,90573] 0 2023-12-06T15:00:30.521 INFO:tasks.workunit.client.1.smithi190.stdout:1/963: dread d6/dc/d29/d38/d73/d76/f10d [0,4194304] 0 2023-12-06T15:00:30.525 INFO:tasks.workunit.client.0.smithi152.stdout:3/493: creat d9/d18/d51/d8d/f98 x:0 0 0 2023-12-06T15:00:30.526 INFO:tasks.workunit.client.1.smithi190.stdout:6/781: link d4/fd d4/d12/d1a/d70/f104 0 2023-12-06T15:00:30.526 INFO:tasks.workunit.client.1.smithi190.stdout:5/602: rmdir d0 39 2023-12-06T15:00:30.526 INFO:tasks.workunit.client.1.smithi190.stdout:4/663: creat d3/da4/dd0/fe0 x:0 0 0 2023-12-06T15:00:30.526 INFO:tasks.workunit.client.0.smithi152.stdout:5/512: dread d7/f28 [0,4194304] 0 2023-12-06T15:00:30.527 INFO:tasks.workunit.client.0.smithi152.stdout:5/513: chown d7/f19 28284 1 2023-12-06T15:00:30.527 INFO:tasks.workunit.client.1.smithi190.stdout:7/808: truncate d0/d88/d33/f80 234173 0 2023-12-06T15:00:30.527 INFO:tasks.workunit.client.1.smithi190.stdout:7/809: fsync d0/d88/d7a/fbe 0 2023-12-06T15:00:30.527 INFO:tasks.workunit.client.0.smithi152.stdout:6/694: dread d1/fbe [0,4194304] 0 2023-12-06T15:00:30.529 INFO:tasks.workunit.client.1.smithi190.stdout:2/644: mknod d10/d26/d5c/d35/dd8/cdb 0 2023-12-06T15:00:30.530 INFO:tasks.workunit.client.0.smithi152.stdout:8/346: getdents d1/d6/d34/d35/d38 0 2023-12-06T15:00:30.530 INFO:tasks.workunit.client.1.smithi190.stdout:8/644: sync 2023-12-06T15:00:30.531 INFO:tasks.workunit.client.0.smithi152.stdout:4/674: dwrite d2/d89/fa1 [0,4194304] 0 2023-12-06T15:00:30.532 INFO:tasks.workunit.client.0.smithi152.stdout:7/379: creat dd/df/d1b/d20/d28/d53/f6d x:0 0 0 2023-12-06T15:00:30.533 INFO:tasks.workunit.client.1.smithi190.stdout:1/964: rename d6/f2f to d6/dc/d29/d38/d73/d76/d10c/f132 0 2023-12-06T15:00:30.533 INFO:tasks.workunit.client.1.smithi190.stdout:3/791: dread d4/d1b/d54/d9c/fb2 [0,4194304] 0 2023-12-06T15:00:30.535 INFO:tasks.workunit.client.0.smithi152.stdout:3/494: creat d9/d18/d1a/d77/d91/f99 x:0 0 0 2023-12-06T15:00:30.536 INFO:tasks.workunit.client.0.smithi152.stdout:3/495: chown d9/d18/d39/c5a 6284759 1 2023-12-06T15:00:30.537 INFO:tasks.workunit.client.0.smithi152.stdout:5/514: unlink d7/dd/f5f 0 2023-12-06T15:00:30.538 INFO:tasks.workunit.client.0.smithi152.stdout:5/515: write d7/dd/d26/d3a/f6b [996048,102153] 0 2023-12-06T15:00:30.539 INFO:tasks.workunit.client.1.smithi190.stdout:4/664: symlink d3/d76/d7c/le1 0 2023-12-06T15:00:30.539 INFO:tasks.workunit.client.1.smithi190.stdout:5/603: rmdir d0/d1c/d85/da6 0 2023-12-06T15:00:30.539 INFO:tasks.workunit.client.1.smithi190.stdout:4/665: dread - d3/d4e/fde zero size 2023-12-06T15:00:30.539 INFO:tasks.workunit.client.1.smithi190.stdout:7/810: symlink d0/d88/d7a/d7c/dab/dc0/l104 0 2023-12-06T15:00:30.540 INFO:tasks.workunit.client.1.smithi190.stdout:7/811: chown d0/d88/d33 214 1 2023-12-06T15:00:30.540 INFO:tasks.workunit.client.0.smithi152.stdout:6/695: symlink d1/dcf/ddc/d1a/d30/d36/d4e/lfc 0 2023-12-06T15:00:30.541 INFO:tasks.workunit.client.0.smithi152.stdout:8/347: symlink d1/d6/d34/d40/d64/l6c 0 2023-12-06T15:00:30.541 INFO:tasks.workunit.client.0.smithi152.stdout:6/696: readlink d1/dcf/ddc/d1a/d30/d18/dc5/lce 0 2023-12-06T15:00:30.542 INFO:tasks.workunit.client.0.smithi152.stdout:4/675: mkdir d2/d15/d32/dd0 0 2023-12-06T15:00:30.543 INFO:tasks.workunit.client.1.smithi190.stdout:8/645: creat d1/d20/d3b/fbb x:0 0 0 2023-12-06T15:00:30.543 INFO:tasks.workunit.client.1.smithi190.stdout:2/645: dread d10/d26/f2f [4194304,4194304] 0 2023-12-06T15:00:30.543 INFO:tasks.workunit.client.1.smithi190.stdout:8/646: write d1/d20/d3b/d4d/f9c [1357211,94646] 0 2023-12-06T15:00:30.544 INFO:tasks.workunit.client.0.smithi152.stdout:2/394: dwrite d6/d1e/f4a [0,4194304] 0 2023-12-06T15:00:30.545 INFO:tasks.workunit.client.1.smithi190.stdout:3/792: mknod d4/d70/d19/c119 0 2023-12-06T15:00:30.545 INFO:tasks.workunit.client.0.smithi152.stdout:7/380: write dd/df/d1b/d20/d28/f30 [1898791,117029] 0 2023-12-06T15:00:30.550 INFO:tasks.workunit.client.1.smithi190.stdout:7/812: creat d0/d88/d33/d4c/f105 x:0 0 0 2023-12-06T15:00:30.550 INFO:tasks.workunit.client.1.smithi190.stdout:2/646: creat d10/d26/d5c/d8d/fdc x:0 0 0 2023-12-06T15:00:30.550 INFO:tasks.workunit.client.1.smithi190.stdout:4/666: link d3/d76/d7c/d96/f5f d3/d35/d19/d41/d44/d9c/d72/fe2 0 2023-12-06T15:00:30.550 INFO:tasks.workunit.client.1.smithi190.stdout:8/647: mkdir d1/d20/d3b/d34/dbc 0 2023-12-06T15:00:30.550 INFO:tasks.workunit.client.1.smithi190.stdout:8/648: readlink d1/d20/d3b/l7b 0 2023-12-06T15:00:30.551 INFO:tasks.workunit.client.1.smithi190.stdout:7/813: truncate d0/df/d53/d2f/f70 3515553 0 2023-12-06T15:00:30.553 INFO:tasks.workunit.client.1.smithi190.stdout:7/814: creat d0/d88/d1c/d17/d94/f106 x:0 0 0 2023-12-06T15:00:30.553 INFO:tasks.workunit.client.1.smithi190.stdout:7/815: truncate d0/d88/d7a/d7c/dab/dc0/dd1/fe3 4615103 0 2023-12-06T15:00:30.553 INFO:tasks.workunit.client.1.smithi190.stdout:4/667: symlink d3/d35/d19/le3 0 2023-12-06T15:00:30.554 INFO:tasks.workunit.client.1.smithi190.stdout:4/668: chown d3/d76/d7c/d96/d39 1336721014 1 2023-12-06T15:00:30.554 INFO:tasks.workunit.client.1.smithi190.stdout:4/669: chown d3/d76/dc4/dc5 435 1 2023-12-06T15:00:30.554 INFO:tasks.workunit.client.1.smithi190.stdout:4/670: chown d3/d76/dc4/dc5/f94 3201 1 2023-12-06T15:00:30.554 INFO:tasks.workunit.client.1.smithi190.stdout:7/816: creat d0/d88/d7a/d7c/dab/ddf/f107 x:0 0 0 2023-12-06T15:00:30.556 INFO:tasks.workunit.client.1.smithi190.stdout:4/671: rename d3/d76/dc4/dc5/d3c/d4d to d3/d76/dc4/dc5/daa/de4 0 2023-12-06T15:00:30.556 INFO:tasks.workunit.client.1.smithi190.stdout:4/672: dread - d3/fb8 zero size 2023-12-06T15:00:30.556 INFO:tasks.workunit.client.0.smithi152.stdout:3/496: rename d9/d10/d12/f93 to d9/d18/d1a/d77/f9a 0 2023-12-06T15:00:30.556 INFO:tasks.workunit.client.0.smithi152.stdout:2/395: dread d6/db/f47 [0,4194304] 0 2023-12-06T15:00:30.557 INFO:tasks.workunit.client.0.smithi152.stdout:5/516: mknod d7/dd/d26/d48/cb5 0 2023-12-06T15:00:30.557 INFO:tasks.workunit.client.1.smithi190.stdout:4/673: rename d3/d35/d19/le3 to d3/d35/d19/d41/d44/d5b/le5 0 2023-12-06T15:00:30.558 INFO:tasks.workunit.client.1.smithi190.stdout:4/674: creat d3/d35/d19/fe6 x:0 0 0 2023-12-06T15:00:30.559 INFO:tasks.workunit.client.0.smithi152.stdout:8/348: unlink d1/d6/f30 0 2023-12-06T15:00:30.559 INFO:tasks.workunit.client.0.smithi152.stdout:8/349: readlink d1/d6/d34/d35/l6a 0 2023-12-06T15:00:30.560 INFO:tasks.workunit.client.1.smithi190.stdout:4/675: link d3/d35/d19/d41/d44/d5b/cd9 d3/d76/d7c/d8a/ce7 0 2023-12-06T15:00:30.561 INFO:tasks.workunit.client.1.smithi190.stdout:4/676: rename d3/d76/dc4/dc5/d3c/f8d to d3/d35/d19/d67/fe8 0 2023-12-06T15:00:30.562 INFO:tasks.workunit.client.0.smithi152.stdout:6/697: link d1/dcf/ddc/d1a/d30/d36/d35/d49/d57/f99 d1/d69/da1/deb/ffd 0 2023-12-06T15:00:30.563 INFO:tasks.workunit.client.1.smithi190.stdout:4/677: creat d3/d76/d7c/fe9 x:0 0 0 2023-12-06T15:00:30.563 INFO:tasks.workunit.client.1.smithi190.stdout:4/678: fdatasync d3/d35/d19/d41/d44/d5b/f6f 0 2023-12-06T15:00:30.564 INFO:tasks.workunit.client.1.smithi190.stdout:4/679: mknod d3/d4e/cea 0 2023-12-06T15:00:30.565 INFO:tasks.workunit.client.0.smithi152.stdout:3/497: symlink d9/d10/d12/d43/d52/l9b 0 2023-12-06T15:00:30.566 INFO:tasks.workunit.client.0.smithi152.stdout:2/396: mkdir d6/d1e/d41/d7e 0 2023-12-06T15:00:30.567 INFO:tasks.workunit.client.0.smithi152.stdout:2/397: truncate d6/db/d17/f1d 2951241 0 2023-12-06T15:00:30.568 INFO:tasks.workunit.client.1.smithi190.stdout:4/680: rename d3/d76/dc4/dc5/l81 to d3/d35/d19/d41/d44/leb 0 2023-12-06T15:00:30.568 INFO:tasks.workunit.client.1.smithi190.stdout:4/681: stat d3/d35/d19/d67/db5 0 2023-12-06T15:00:30.568 INFO:tasks.workunit.client.1.smithi190.stdout:8/649: dread d1/d20/d3b/d31/f57 [0,4194304] 0 2023-12-06T15:00:30.568 INFO:tasks.workunit.client.1.smithi190.stdout:4/682: symlink d3/d35/lec 0 2023-12-06T15:00:30.568 INFO:tasks.workunit.client.1.smithi190.stdout:4/683: write d3/d76/d7c/d96/d39/f5c [1172526,125735] 0 2023-12-06T15:00:30.569 INFO:tasks.workunit.client.0.smithi152.stdout:1/683: dwrite d3/da/d15/d17/d1a/f38 [0,4194304] 0 2023-12-06T15:00:30.569 INFO:tasks.workunit.client.0.smithi152.stdout:0/508: dwrite d8/d15/d45/f71 [0,4194304] 0 2023-12-06T15:00:30.570 INFO:tasks.workunit.client.1.smithi190.stdout:9/822: dwrite d4/d84/f99 [0,4194304] 0 2023-12-06T15:00:30.570 INFO:tasks.workunit.client.1.smithi190.stdout:0/701: dwrite d0/da/d3e/d2b/d3c/f5f [0,4194304] 0 2023-12-06T15:00:30.570 INFO:tasks.workunit.client.1.smithi190.stdout:0/702: read - d0/da/d5a/dc8/fdb zero size 2023-12-06T15:00:30.570 INFO:tasks.workunit.client.1.smithi190.stdout:8/650: dread - d1/d20/d3b/d36/d50/f83 zero size 2023-12-06T15:00:30.571 INFO:tasks.workunit.client.1.smithi190.stdout:9/823: mknod d4/d27/d2f/d31/d3f/d58/d72/db3/dea/dcd/df1/c10d 0 2023-12-06T15:00:30.572 INFO:tasks.workunit.client.0.smithi152.stdout:5/517: link d7/dd/d26/d3a/f4f d7/dd/fb6 0 2023-12-06T15:00:30.572 INFO:tasks.workunit.client.0.smithi152.stdout:3/498: mkdir d9/d45/d9c 0 2023-12-06T15:00:30.572 INFO:tasks.workunit.client.0.smithi152.stdout:3/499: chown d9/c15 1275386 1 2023-12-06T15:00:30.572 INFO:tasks.workunit.client.0.smithi152.stdout:3/500: fdatasync d9/d10/d12/d43/d52/f7a 0 2023-12-06T15:00:30.572 INFO:tasks.workunit.client.1.smithi190.stdout:1/965: dwrite d6/dc/f9 [0,4194304] 0 2023-12-06T15:00:30.574 INFO:tasks.workunit.client.1.smithi190.stdout:6/782: dwrite d4/d12/d1a/d8a/fd4 [0,4194304] 0 2023-12-06T15:00:30.575 INFO:tasks.workunit.client.0.smithi152.stdout:0/509: mkdir d8/d15/d45/da4 0 2023-12-06T15:00:30.576 INFO:tasks.workunit.client.0.smithi152.stdout:0/510: chown d8/d4b/f9e 527501923 1 2023-12-06T15:00:30.578 INFO:tasks.workunit.client.0.smithi152.stdout:5/518: write d7/dd/d26/d3b/d46/d7e/f88 [3217459,658] 0 2023-12-06T15:00:30.578 INFO:tasks.workunit.client.0.smithi152.stdout:5/519: fdatasync d7/f18 0 2023-12-06T15:00:30.579 INFO:tasks.workunit.client.0.smithi152.stdout:2/398: symlink d6/d1e/l7f 0 2023-12-06T15:00:30.579 INFO:tasks.workunit.client.0.smithi152.stdout:2/399: fsync d6/db/d17/f23 0 2023-12-06T15:00:30.580 INFO:tasks.workunit.client.0.smithi152.stdout:3/501: mknod d9/d10/c9d 0 2023-12-06T15:00:30.582 INFO:tasks.workunit.client.0.smithi152.stdout:0/511: mknod d8/d15/d45/d83/ca5 0 2023-12-06T15:00:30.582 INFO:tasks.workunit.client.1.smithi190.stdout:5/604: dwrite d0/d6c/f79 [0,4194304] 0 2023-12-06T15:00:30.582 INFO:tasks.workunit.client.1.smithi190.stdout:0/703: rmdir d0/da/d3e/d2b 39 2023-12-06T15:00:30.583 INFO:tasks.workunit.client.1.smithi190.stdout:9/824: chown d4/d27/d2f/d31/l3c 24 1 2023-12-06T15:00:30.583 INFO:tasks.workunit.client.1.smithi190.stdout:8/651: creat d1/d20/d3b/d36/fbd x:0 0 0 2023-12-06T15:00:30.587 INFO:tasks.workunit.client.1.smithi190.stdout:7/817: write d0/fd4 [267029,44963] 0 2023-12-06T15:00:30.587 INFO:tasks.workunit.client.0.smithi152.stdout:5/520: chown d7/dd/d26/d3b/d46/d7e/l95 4 1 2023-12-06T15:00:30.587 INFO:tasks.workunit.client.0.smithi152.stdout:3/502: rename d9/l7c to d9/d18/d1a/l9e 0 2023-12-06T15:00:30.587 INFO:tasks.workunit.client.0.smithi152.stdout:2/400: symlink d6/d18/d43/l80 0 2023-12-06T15:00:30.592 INFO:tasks.workunit.client.0.smithi152.stdout:3/503: mkdir d9/d18/d1a/d77/d9f 0 2023-12-06T15:00:30.594 INFO:tasks.workunit.client.0.smithi152.stdout:2/401: creat d6/d18/f81 x:0 0 0 2023-12-06T15:00:30.594 INFO:tasks.workunit.client.1.smithi190.stdout:0/704: rmdir d0/da/d5a/d80 39 2023-12-06T15:00:30.594 INFO:tasks.workunit.client.1.smithi190.stdout:0/705: truncate d0/da/d74/fc5 763884 0 2023-12-06T15:00:30.595 INFO:tasks.workunit.client.0.smithi152.stdout:5/521: link d7/dd/d26/d3b/d46/d7e/c80 d7/dd/d26/d3a/cb7 0 2023-12-06T15:00:30.597 INFO:tasks.workunit.client.1.smithi190.stdout:8/652: mknod d1/d20/cbe 0 2023-12-06T15:00:30.597 INFO:tasks.workunit.client.0.smithi152.stdout:3/504: mkdir d9/d18/d51/d8d/d8f/da0 0 2023-12-06T15:00:30.597 INFO:tasks.workunit.client.0.smithi152.stdout:0/512: dread d8/d15/d45/d73/d7a/f36 [0,4194304] 0 2023-12-06T15:00:30.597 INFO:tasks.workunit.client.1.smithi190.stdout:7/818: mkdir d0/df/df8/d108 0 2023-12-06T15:00:30.598 INFO:tasks.workunit.client.1.smithi190.stdout:5/605: dread d0/f7 [0,4194304] 0 2023-12-06T15:00:30.598 INFO:tasks.workunit.client.1.smithi190.stdout:5/606: chown d0/d1c/d2b/cb0 104 1 2023-12-06T15:00:30.598 INFO:tasks.workunit.client.1.smithi190.stdout:5/607: truncate d0/d1c/d3e/d7e/fc9 374322 0 2023-12-06T15:00:30.598 INFO:tasks.workunit.client.0.smithi152.stdout:2/402: dread d6/d1e/f62 [0,4194304] 0 2023-12-06T15:00:30.598 INFO:tasks.workunit.client.1.smithi190.stdout:0/706: symlink d0/da/d3e/d2b/d3c/d65/le6 0 2023-12-06T15:00:30.599 INFO:tasks.workunit.client.0.smithi152.stdout:3/505: creat d9/d18/fa1 x:0 0 0 2023-12-06T15:00:30.601 INFO:tasks.workunit.client.0.smithi152.stdout:0/513: link d8/d15/f8e d8/d3e/d87/d76/d68/fa6 0 2023-12-06T15:00:30.603 INFO:tasks.workunit.client.0.smithi152.stdout:2/403: rename d6/db/f47 to d6/d18/d70/f82 0 2023-12-06T15:00:30.606 INFO:tasks.workunit.client.0.smithi152.stdout:3/506: read d9/d10/f28 [50081,77728] 0 2023-12-06T15:00:30.606 INFO:tasks.workunit.client.0.smithi152.stdout:3/507: chown d9/d10/d12/d43/d52/c74 21112626 1 2023-12-06T15:00:30.606 INFO:tasks.workunit.client.0.smithi152.stdout:3/508: write d9/d18/fa1 [979494,85445] 0 2023-12-06T15:00:30.606 INFO:tasks.workunit.client.0.smithi152.stdout:3/509: truncate d9/d18/f92 4622382 0 2023-12-06T15:00:30.607 INFO:tasks.workunit.client.0.smithi152.stdout:2/404: write d6/f15 [3330148,32431] 0 2023-12-06T15:00:30.608 INFO:tasks.workunit.client.0.smithi152.stdout:7/381: write dd/df/d34/d44/f67 [2839609,27661] 0 2023-12-06T15:00:30.610 INFO:tasks.workunit.client.0.smithi152.stdout:7/382: mknod dd/c6e 0 2023-12-06T15:00:30.611 INFO:tasks.workunit.client.0.smithi152.stdout:7/383: mknod dd/df/d1b/d4e/c6f 0 2023-12-06T15:00:30.613 INFO:tasks.workunit.client.0.smithi152.stdout:7/384: getdents dd/d17 0 2023-12-06T15:00:30.613 INFO:tasks.workunit.client.0.smithi152.stdout:7/385: truncate dd/df/d1b/d20/d28/f68 863077 0 2023-12-06T15:00:30.613 INFO:tasks.workunit.client.0.smithi152.stdout:5/522: dread d7/dd/f1c [0,4194304] 0 2023-12-06T15:00:30.615 INFO:tasks.workunit.client.0.smithi152.stdout:7/386: mknod dd/df/d1b/c70 0 2023-12-06T15:00:30.615 INFO:tasks.workunit.client.0.smithi152.stdout:8/350: dwrite d1/f2d [0,4194304] 0 2023-12-06T15:00:30.616 INFO:tasks.workunit.client.0.smithi152.stdout:1/684: dwrite d3/d73/fcb [4194304,4194304] 0 2023-12-06T15:00:30.616 INFO:tasks.workunit.client.0.smithi152.stdout:1/685: write d3/da/d15/d17/d58/d9f/faa [126093,114969] 0 2023-12-06T15:00:30.616 INFO:tasks.workunit.client.0.smithi152.stdout:7/387: creat dd/df/d34/d44/d49/f71 x:0 0 0 2023-12-06T15:00:30.616 INFO:tasks.workunit.client.1.smithi190.stdout:4/684: dwrite d3/d76/d7c/d96/f98 [0,4194304] 0 2023-12-06T15:00:30.618 INFO:tasks.workunit.client.0.smithi152.stdout:7/388: creat dd/df/d1b/d4e/f72 x:0 0 0 2023-12-06T15:00:30.619 INFO:tasks.workunit.client.0.smithi152.stdout:1/686: symlink d3/da/d4c/d82/d52/d62/l102 0 2023-12-06T15:00:30.620 INFO:tasks.workunit.client.0.smithi152.stdout:5/523: write d7/f24 [3175067,51041] 0 2023-12-06T15:00:30.620 INFO:tasks.workunit.client.0.smithi152.stdout:5/524: chown d7/dd/d26/d48/l91 64 1 2023-12-06T15:00:30.620 INFO:tasks.workunit.client.0.smithi152.stdout:5/525: chown d7/dd/d26/d3b/cb4 128157511 1 2023-12-06T15:00:30.621 INFO:tasks.workunit.client.1.smithi190.stdout:9/825: dwrite d4/d27/d2f/d31/ff5 [0,4194304] 0 2023-12-06T15:00:30.621 INFO:tasks.workunit.client.0.smithi152.stdout:7/389: mkdir dd/df/d34/d44/d49/d73 0 2023-12-06T15:00:30.621 INFO:tasks.workunit.client.0.smithi152.stdout:7/390: readlink dd/df/d1b/d20/d28/d38/l25 0 2023-12-06T15:00:30.622 INFO:tasks.workunit.client.0.smithi152.stdout:1/687: link d3/da/d15/fd3 d3/f103 0 2023-12-06T15:00:30.622 INFO:tasks.workunit.client.0.smithi152.stdout:3/510: dread d9/f38 [0,4194304] 0 2023-12-06T15:00:30.623 INFO:tasks.workunit.client.0.smithi152.stdout:5/526: mknod d7/dd/d26/cb8 0 2023-12-06T15:00:30.623 INFO:tasks.workunit.client.0.smithi152.stdout:1/688: creat d3/da/d4c/d85/f104 x:0 0 0 2023-12-06T15:00:30.625 INFO:tasks.workunit.client.1.smithi190.stdout:1/966: dwrite d6/dc/d29/d38/d73/d5c/f70 [4194304,4194304] 0 2023-12-06T15:00:30.625 INFO:tasks.workunit.client.1.smithi190.stdout:7/819: dwrite d0/d88/d33/d4c/fa2 [0,4194304] 0 2023-12-06T15:00:30.626 INFO:tasks.workunit.client.0.smithi152.stdout:5/527: creat d7/d43/d6c/d98/fb9 x:0 0 0 2023-12-06T15:00:30.629 INFO:tasks.workunit.client.0.smithi152.stdout:1/689: creat d3/da/f105 x:0 0 0 2023-12-06T15:00:30.630 INFO:tasks.workunit.client.0.smithi152.stdout:7/391: dread dd/df/f1a [0,4194304] 0 2023-12-06T15:00:30.630 INFO:tasks.workunit.client.0.smithi152.stdout:5/528: rename d7/dd/d26/d3b/d46/d7e/c82 to d7/d43/d6c/da4/cba 0 2023-12-06T15:00:30.632 INFO:tasks.workunit.client.0.smithi152.stdout:1/690: chown d3/da/d4c/d82/d52/d62/f72 5 1 2023-12-06T15:00:30.632 INFO:tasks.workunit.client.0.smithi152.stdout:1/691: write d3/da/d4c/d82/d52/d55/f9a [1447232,11644] 0 2023-12-06T15:00:30.632 INFO:tasks.workunit.client.0.smithi152.stdout:1/692: truncate d3/da/d15/d17/d58/d9f/faa 1082489 0 2023-12-06T15:00:30.632 INFO:tasks.workunit.client.0.smithi152.stdout:1/693: stat d3/da/d15/d17/def 0 2023-12-06T15:00:30.632 INFO:tasks.workunit.client.0.smithi152.stdout:1/694: write d3/da/d15/d17/d58/da3/fdd [790421,82695] 0 2023-12-06T15:00:30.632 INFO:tasks.workunit.client.0.smithi152.stdout:8/351: dread d1/d6/d34/fa [0,4194304] 0 2023-12-06T15:00:30.632 INFO:tasks.workunit.client.0.smithi152.stdout:8/352: truncate d1/d6/d34/d36/f55 980450 0 2023-12-06T15:00:30.632 INFO:tasks.workunit.client.0.smithi152.stdout:7/392: symlink dd/l74 0 2023-12-06T15:00:30.633 INFO:tasks.workunit.client.0.smithi152.stdout:5/529: mkdir d7/dd/d26/d48/dbb 0 2023-12-06T15:00:30.636 INFO:tasks.workunit.client.0.smithi152.stdout:8/353: rename d1/d6/d34/d35/c46 to d1/d6/c6d 0 2023-12-06T15:00:30.637 INFO:tasks.workunit.client.0.smithi152.stdout:7/393: creat dd/df/d34/d44/d49/d73/f75 x:0 0 0 2023-12-06T15:00:30.637 INFO:tasks.workunit.client.0.smithi152.stdout:7/394: write dd/df/d34/d44/f5a [2341767,28752] 0 2023-12-06T15:00:30.639 INFO:tasks.workunit.client.0.smithi152.stdout:5/530: rename d7/dd/d4e/f70 to d7/dd/d26/d87/fbc 0 2023-12-06T15:00:30.642 INFO:tasks.workunit.client.0.smithi152.stdout:7/395: creat dd/df/f76 x:0 0 0 2023-12-06T15:00:30.642 INFO:tasks.workunit.client.0.smithi152.stdout:7/396: chown f9 32673 1 2023-12-06T15:00:30.643 INFO:tasks.workunit.client.0.smithi152.stdout:8/354: rename d1/d6/d34/d36/f4c to d1/d6/d34/d36/d58/f6e 0 2023-12-06T15:00:30.643 INFO:tasks.workunit.client.1.smithi190.stdout:8/653: link d1/d20/d3b/d36/l65 d1/d20/d3b/d36/lbf 0 2023-12-06T15:00:30.644 INFO:tasks.workunit.client.0.smithi152.stdout:7/397: mkdir dd/df/d34/d44/d49/d73/d77 0 2023-12-06T15:00:30.645 INFO:tasks.workunit.client.1.smithi190.stdout:5/608: unlink d0/d1c/d3e/f51 0 2023-12-06T15:00:30.646 INFO:tasks.workunit.client.0.smithi152.stdout:8/355: rename d1/d6/d29/d3b to d1/d6/d34/d6f 0 2023-12-06T15:00:30.647 INFO:tasks.workunit.client.0.smithi152.stdout:8/356: truncate d1/d6/d34/d36/d58/f6e 485600 0 2023-12-06T15:00:30.647 INFO:tasks.workunit.client.1.smithi190.stdout:0/707: mkdir d0/da/d5a/de7 0 2023-12-06T15:00:30.647 INFO:tasks.workunit.client.1.smithi190.stdout:0/708: chown d0/da/d3e/d2b/c6e 20408 1 2023-12-06T15:00:30.648 INFO:tasks.workunit.client.0.smithi152.stdout:8/357: creat d1/d6/d34/d6f/f70 x:0 0 0 2023-12-06T15:00:30.650 INFO:tasks.workunit.client.1.smithi190.stdout:4/685: rename d3/d76/d7c/d96/d39/cc3 to d3/d35/d19/d67/db5/dbe/ced 0 2023-12-06T15:00:30.652 INFO:tasks.workunit.client.0.smithi152.stdout:3/511: rmdir d9/d18/d51/d8d 39 2023-12-06T15:00:30.652 INFO:tasks.workunit.client.0.smithi152.stdout:3/512: fsync d9/d10/d12/d43/f8b 0 2023-12-06T15:00:30.653 INFO:tasks.workunit.client.0.smithi152.stdout:3/513: write d9/f37 [4332483,19640] 0 2023-12-06T15:00:30.655 INFO:tasks.workunit.client.1.smithi190.stdout:9/826: rmdir d4/d27/d2f/d5c/d9d 39 2023-12-06T15:00:30.655 INFO:tasks.workunit.client.1.smithi190.stdout:9/827: truncate d4/d27/d2f/d31/d3f/d58/d72/db3/dea/dcd/df1/f101 1822133 0 2023-12-06T15:00:30.655 INFO:tasks.workunit.client.1.smithi190.stdout:9/828: readlink d4/d27/d2f/d5c/d9d/lbd 0 2023-12-06T15:00:30.655 INFO:tasks.workunit.client.1.smithi190.stdout:9/829: write d4/d27/d2f/d5c/ffe [57670,17250] 0 2023-12-06T15:00:30.657 INFO:tasks.workunit.client.1.smithi190.stdout:7/820: getdents d0 0 2023-12-06T15:00:30.657 INFO:tasks.workunit.client.1.smithi190.stdout:7/821: write d0/df/d53/d15/fd9 [571538,29091] 0 2023-12-06T15:00:30.657 INFO:tasks.workunit.client.1.smithi190.stdout:7/822: write d0/d5/fae [126390,28404] 0 2023-12-06T15:00:30.668 INFO:tasks.workunit.client.0.smithi152.stdout:1/695: dwrite d3/da/d15/d17/f3d [4194304,4194304] 0 2023-12-06T15:00:30.670 INFO:tasks.workunit.client.0.smithi152.stdout:7/398: dwrite dd/df/d1b/d20/d28/d53/f3f [0,4194304] 0 2023-12-06T15:00:30.670 INFO:tasks.workunit.client.1.smithi190.stdout:8/654: mkdir d1/d20/d3b/d34/dc0 0 2023-12-06T15:00:30.671 INFO:tasks.workunit.client.1.smithi190.stdout:1/967: dwrite d6/dc/d29/d38/d73/d76/ffe [0,4194304] 0 2023-12-06T15:00:30.671 INFO:tasks.workunit.client.1.smithi190.stdout:9/830: dread d4/d27/d2f/d31/f50 [0,4194304] 0 2023-12-06T15:00:30.672 INFO:tasks.workunit.client.1.smithi190.stdout:5/609: creat d0/d6c/da7/fd0 x:0 0 0 2023-12-06T15:00:30.673 INFO:tasks.workunit.client.1.smithi190.stdout:0/709: mkdir d0/da/d3e/d3a/d40/d6f/d9e/de8 0 2023-12-06T15:00:30.673 INFO:tasks.workunit.client.0.smithi152.stdout:1/696: write d3/d73/ff5 [145766,106230] 0 2023-12-06T15:00:30.673 INFO:tasks.workunit.client.0.smithi152.stdout:1/697: chown d3/da/d4c/d82/d52/d62/dcc/cec 32115207 1 2023-12-06T15:00:30.674 INFO:tasks.workunit.client.1.smithi190.stdout:4/686: symlink d3/d35/d19/d41/d44/d5b/lee 0 2023-12-06T15:00:30.678 INFO:tasks.workunit.client.1.smithi190.stdout:7/823: creat d0/df/d53/d99/f109 x:0 0 0 2023-12-06T15:00:30.679 INFO:tasks.workunit.client.0.smithi152.stdout:3/514: dwrite d9/d18/d51/f54 [0,4194304] 0 2023-12-06T15:00:30.679 INFO:tasks.workunit.client.1.smithi190.stdout:8/655: creat d1/d37/fc1 x:0 0 0 2023-12-06T15:00:30.679 INFO:tasks.workunit.client.1.smithi190.stdout:8/656: stat d1/d20/d3b/f30 0 2023-12-06T15:00:30.680 INFO:tasks.workunit.client.0.smithi152.stdout:3/515: write d9/d18/f92 [3275414,129514] 0 2023-12-06T15:00:30.682 INFO:tasks.workunit.client.1.smithi190.stdout:7/824: write d0/d88/d7a/fbe [984472,33126] 0 2023-12-06T15:00:30.682 INFO:tasks.workunit.client.1.smithi190.stdout:7/825: chown d0/d88/d7a/d7c/fb0 170511 1 2023-12-06T15:00:30.682 INFO:tasks.workunit.client.1.smithi190.stdout:7/826: stat d0/d88/d7a/dc9/ld3 0 2023-12-06T15:00:30.688 INFO:tasks.workunit.client.0.smithi152.stdout:8/358: fsync d1/d6/d34/d36/d58/f6e 0 2023-12-06T15:00:30.688 INFO:tasks.workunit.client.0.smithi152.stdout:8/359: chown d1/d6/d34/l5a 15 1 2023-12-06T15:00:30.689 INFO:tasks.workunit.client.1.smithi190.stdout:8/657: dread d1/d20/d3b/d36/f68 [0,4194304] 0 2023-12-06T15:00:30.689 INFO:tasks.workunit.client.1.smithi190.stdout:5/610: truncate d0/d1c/d2b/f4e 968551 0 2023-12-06T15:00:30.691 INFO:tasks.workunit.client.1.smithi190.stdout:0/710: unlink d0/da/l13 0 2023-12-06T15:00:30.692 INFO:tasks.workunit.client.1.smithi190.stdout:4/687: mkdir d3/d76/d7c/db9/def 0 2023-12-06T15:00:30.694 INFO:tasks.workunit.client.0.smithi152.stdout:8/360: write d1/d6/d34/d36/f60 [1939563,54571] 0 2023-12-06T15:00:30.695 INFO:tasks.workunit.client.0.smithi152.stdout:8/361: readlink d1/d6/d34/d35/l6a 0 2023-12-06T15:00:30.696 INFO:tasks.workunit.client.1.smithi190.stdout:8/658: dread d1/d20/d3b/d4c/d8e/d94/d1c/f22 [0,4194304] 0 2023-12-06T15:00:30.696 INFO:tasks.workunit.client.1.smithi190.stdout:8/659: dread - d1/d20/d3b/d34/f38 zero size 2023-12-06T15:00:30.697 INFO:tasks.workunit.client.1.smithi190.stdout:7/827: getdents d0/df/d53/d2f/de9 0 2023-12-06T15:00:30.697 INFO:tasks.workunit.client.1.smithi190.stdout:9/831: rmdir d4 39 2023-12-06T15:00:30.697 INFO:tasks.workunit.client.1.smithi190.stdout:9/832: chown d4/d27/d8a/dbc/fe7 26002 1 2023-12-06T15:00:30.697 INFO:tasks.workunit.client.1.smithi190.stdout:9/833: chown d4/d27 70429240 1 2023-12-06T15:00:30.698 INFO:tasks.workunit.client.1.smithi190.stdout:5/611: link d0/d1c/d2b/d2c/d5d/f95 d0/d1c/d2b/d8b/fd1 0 2023-12-06T15:00:30.700 INFO:tasks.workunit.client.1.smithi190.stdout:0/711: dread d0/da/f49 [0,4194304] 0 2023-12-06T15:00:30.700 INFO:tasks.workunit.client.1.smithi190.stdout:8/660: rename d1/d20/d3b/d4c/d59/f9d to d1/d20/d3b/d4c/d59/fc2 0 2023-12-06T15:00:30.701 INFO:tasks.workunit.client.0.smithi152.stdout:7/399: mkdir dd/df/d78 0 2023-12-06T15:00:30.701 INFO:tasks.workunit.client.0.smithi152.stdout:7/400: readlink dd/d17/l26 0 2023-12-06T15:00:30.701 INFO:tasks.workunit.client.0.smithi152.stdout:7/401: fdatasync f9 0 2023-12-06T15:00:30.701 INFO:tasks.workunit.client.0.smithi152.stdout:7/402: fdatasync dd/df/d1b/d20/d28/d53/f3f 0 2023-12-06T15:00:30.701 INFO:tasks.workunit.client.0.smithi152.stdout:1/698: getdents d3/da/d15/d17/d4d 0 2023-12-06T15:00:30.703 INFO:tasks.workunit.client.1.smithi190.stdout:9/834: symlink d4/d27/d8a/dbc/l10e 0 2023-12-06T15:00:30.703 INFO:tasks.workunit.client.1.smithi190.stdout:2/647: dwrite d10/d26/f2f [4194304,4194304] 0 2023-12-06T15:00:30.703 INFO:tasks.workunit.client.1.smithi190.stdout:2/648: truncate d10/d26/d5c/d8d/fdc 227383 0 2023-12-06T15:00:30.703 INFO:tasks.workunit.client.1.smithi190.stdout:5/612: creat d0/df/d50/d9c/fd2 x:0 0 0 2023-12-06T15:00:30.704 INFO:tasks.workunit.client.0.smithi152.stdout:3/516: creat d9/d18/fa2 x:0 0 0 2023-12-06T15:00:30.705 INFO:tasks.workunit.client.0.smithi152.stdout:8/362: creat d1/d6/d34/d35/d66/f71 x:0 0 0 2023-12-06T15:00:30.707 INFO:tasks.workunit.client.0.smithi152.stdout:7/403: rename dd/df/d1b/d20/d28/d38/l25 to dd/d69/l79 0 2023-12-06T15:00:30.707 INFO:tasks.workunit.client.1.smithi190.stdout:1/968: dwrite d6/dc/d29/d38/d73/f41 [0,4194304] 0 2023-12-06T15:00:30.707 INFO:tasks.workunit.client.1.smithi190.stdout:4/688: dwrite d3/d35/f46 [8388608,4194304] 0 2023-12-06T15:00:30.708 INFO:tasks.workunit.client.0.smithi152.stdout:1/699: creat d3/da/d15/d17/def/f106 x:0 0 0 2023-12-06T15:00:30.708 INFO:tasks.workunit.client.0.smithi152.stdout:1/700: dread - d3/d44/d84/fed zero size 2023-12-06T15:00:30.708 INFO:tasks.workunit.client.0.smithi152.stdout:1/701: readlink d3/da/d15/d17/d58/lca 0 2023-12-06T15:00:30.708 INFO:tasks.workunit.client.0.smithi152.stdout:1/702: fsync d3/da/d15/d17/f2d 0 2023-12-06T15:00:30.709 INFO:tasks.workunit.client.0.smithi152.stdout:8/363: truncate d1/d6/d34/d36/f11 4878850 0 2023-12-06T15:00:30.710 INFO:tasks.workunit.client.1.smithi190.stdout:0/712: rename d0/da/d3e/d3a/d40/cd9 to d0/da/d3e/d87/ce9 0 2023-12-06T15:00:30.710 INFO:tasks.workunit.client.1.smithi190.stdout:0/713: dread - d0/da/d3e/d3a/d40/fd1 zero size 2023-12-06T15:00:30.710 INFO:tasks.workunit.client.1.smithi190.stdout:0/714: write d0/f86 [1872649,44326] 0 2023-12-06T15:00:30.710 INFO:tasks.workunit.client.1.smithi190.stdout:9/835: getdents d4/d27/d2f/d31/d3f/d58 0 2023-12-06T15:00:30.712 INFO:tasks.workunit.client.0.smithi152.stdout:7/404: link dd/f24 dd/df/d1b/d20/d28/d53/f7a 0 2023-12-06T15:00:30.716 INFO:tasks.workunit.client.1.smithi190.stdout:5/613: rename d0/d1c/d3e/d7e/lca to d0/d1c/d3e/d7e/ld3 0 2023-12-06T15:00:30.716 INFO:tasks.workunit.client.1.smithi190.stdout:1/969: symlink d6/dc/d29/d38/d43/d7f/l133 0 2023-12-06T15:00:30.717 INFO:tasks.workunit.client.0.smithi152.stdout:1/703: mknod d3/da/d15/d17/d58/da3/c107 0 2023-12-06T15:00:30.719 INFO:tasks.workunit.client.1.smithi190.stdout:4/689: rmdir d3/d35/d19/d67/db5/dbe 39 2023-12-06T15:00:30.720 INFO:tasks.workunit.client.1.smithi190.stdout:1/970: write d6/dc/d29/d38/d43/d7f/da7/fc5 [2663399,15232] 0 2023-12-06T15:00:30.720 INFO:tasks.workunit.client.1.smithi190.stdout:9/836: mkdir d4/d27/d2f/d31/d3f/d58/d72/db3/d10f 0 2023-12-06T15:00:30.721 INFO:tasks.workunit.client.1.smithi190.stdout:9/837: fsync d4/d27/d2f/d5c/d9d/f10c 0 2023-12-06T15:00:30.724 INFO:tasks.workunit.client.1.smithi190.stdout:5/614: creat d0/d6c/fd4 x:0 0 0 2023-12-06T15:00:30.725 INFO:tasks.workunit.client.0.smithi152.stdout:1/704: symlink d3/da/d15/d17/d58/da3/l108 0 2023-12-06T15:00:30.725 INFO:tasks.workunit.client.1.smithi190.stdout:4/690: mkdir d3/d35/df0 0 2023-12-06T15:00:30.726 INFO:tasks.workunit.client.1.smithi190.stdout:4/691: dread d3/d76/dc4/dc5/daa/fd1 [0,4194304] 0 2023-12-06T15:00:30.726 INFO:tasks.workunit.client.1.smithi190.stdout:4/692: fsync d3/d35/d19/f47 0 2023-12-06T15:00:30.727 INFO:tasks.workunit.client.0.smithi152.stdout:1/705: creat d3/d44/f109 x:0 0 0 2023-12-06T15:00:30.728 INFO:tasks.workunit.client.1.smithi190.stdout:9/838: creat d4/dfd/f110 x:0 0 0 2023-12-06T15:00:30.730 INFO:tasks.workunit.client.1.smithi190.stdout:5/615: rename d0/d1c/d3e/d5a/d5f to d0/d96/dc5/dd5 0 2023-12-06T15:00:30.732 INFO:tasks.workunit.client.1.smithi190.stdout:9/839: mknod d4/c111 0 2023-12-06T15:00:30.732 INFO:tasks.workunit.client.1.smithi190.stdout:9/840: chown d4/d27/d2f/l56 2349826 1 2023-12-06T15:00:30.733 INFO:tasks.workunit.client.1.smithi190.stdout:5/616: creat d0/d1c/d85/d90/dba/fd6 x:0 0 0 2023-12-06T15:00:30.733 INFO:tasks.workunit.client.1.smithi190.stdout:5/617: chown d0 293033 1 2023-12-06T15:00:30.734 INFO:tasks.workunit.client.1.smithi190.stdout:9/841: symlink d4/d27/d2f/d5c/d9d/l112 0 2023-12-06T15:00:30.735 INFO:tasks.workunit.client.1.smithi190.stdout:5/618: mkdir d0/d1c/d2b/d8b/dd7 0 2023-12-06T15:00:30.736 INFO:tasks.workunit.client.1.smithi190.stdout:5/619: creat d0/d6c/dcd/fd8 x:0 0 0 2023-12-06T15:00:30.737 INFO:tasks.workunit.client.1.smithi190.stdout:5/620: mknod d0/d96/dc5/dd5/cd9 0 2023-12-06T15:00:30.742 INFO:tasks.workunit.client.1.smithi190.stdout:2/649: dwrite fc [0,4194304] 0 2023-12-06T15:00:30.744 INFO:tasks.workunit.client.1.smithi190.stdout:2/650: mknod d10/d59/dcd/dad/dc9/cdd 0 2023-12-06T15:00:30.745 INFO:tasks.workunit.client.1.smithi190.stdout:2/651: mkdir d10/d59/dcd/dde 0 2023-12-06T15:00:30.745 INFO:tasks.workunit.client.1.smithi190.stdout:2/652: write d10/d26/d5c/d35/f82 [441775,106816] 0 2023-12-06T15:00:30.746 INFO:tasks.workunit.client.1.smithi190.stdout:4/693: dwrite d3/d35/f53 [4194304,4194304] 0 2023-12-06T15:00:30.747 INFO:tasks.workunit.client.1.smithi190.stdout:2/653: rmdir d10/d26/d5c/d8d 39 2023-12-06T15:00:30.749 INFO:tasks.workunit.client.1.smithi190.stdout:4/694: getdents d3/d76/d7c 0 2023-12-06T15:00:30.749 INFO:tasks.workunit.client.1.smithi190.stdout:4/695: truncate d3/da4/dd0/fe0 255596 0 2023-12-06T15:00:30.749 INFO:tasks.workunit.client.1.smithi190.stdout:4/696: write d3/d35/d97/fab [643598,90282] 0 2023-12-06T15:00:30.750 INFO:tasks.workunit.client.1.smithi190.stdout:4/697: symlink d3/d76/dc4/dc5/daa/lf1 0 2023-12-06T15:00:30.776 INFO:tasks.workunit.client.1.smithi190.stdout:2/654: dwrite d10/d59/dcd/dad/dc4/f89 [0,4194304] 0 2023-12-06T15:00:30.776 INFO:tasks.workunit.client.1.smithi190.stdout:2/655: dread - d10/d59/dcd/dad/dc4/d76/fa6 zero size 2023-12-06T15:00:30.776 INFO:tasks.workunit.client.1.smithi190.stdout:4/698: dwrite d3/d35/d19/f79 [0,4194304] 0 2023-12-06T15:00:30.777 INFO:tasks.workunit.client.1.smithi190.stdout:2/656: write d10/d26/d5c/d49/f55 [3809385,36257] 0 2023-12-06T15:00:30.778 INFO:tasks.workunit.client.1.smithi190.stdout:2/657: mkdir d10/d26/d8a/d8f/ddf 0 2023-12-06T15:00:30.779 INFO:tasks.workunit.client.1.smithi190.stdout:2/658: stat d10/d26/d5c/d37/d83 0 2023-12-06T15:00:30.779 INFO:tasks.workunit.client.1.smithi190.stdout:2/659: symlink d10/d26/d8a/le0 0 2023-12-06T15:00:30.780 INFO:tasks.workunit.client.1.smithi190.stdout:2/660: creat d10/d26/d5c/d42/d9d/fe1 x:0 0 0 2023-12-06T15:00:30.781 INFO:tasks.workunit.client.1.smithi190.stdout:2/661: creat d10/d59/dcd/dad/fe2 x:0 0 0 2023-12-06T15:00:30.782 INFO:tasks.workunit.client.1.smithi190.stdout:2/662: truncate d10/f58 2481244 0 2023-12-06T15:00:30.801 INFO:tasks.workunit.client.1.smithi190.stdout:8/661: dwrite d1/d20/d3b/d36/f3c [0,4194304] 0 2023-12-06T15:00:30.803 INFO:tasks.workunit.client.1.smithi190.stdout:8/662: creat d1/d20/d3b/fc3 x:0 0 0 2023-12-06T15:00:30.807 INFO:tasks.workunit.client.1.smithi190.stdout:9/842: write d4/d27/d2f/d31/d3f/d58/d72/f75 [2835600,100738] 0 2023-12-06T15:00:30.809 INFO:tasks.workunit.client.1.smithi190.stdout:7/828: truncate d0/df/d53/d15/fd9 443700 0 2023-12-06T15:00:30.809 INFO:tasks.workunit.client.0.smithi152.stdout:8/364: dread d1/d6/d34/f21 [0,4194304] 0 2023-12-06T15:00:30.811 INFO:tasks.workunit.client.0.smithi152.stdout:8/365: dread d1/d6/d29/f33 [0,4194304] 0 2023-12-06T15:00:30.812 INFO:tasks.workunit.client.0.smithi152.stdout:3/517: dwrite d9/f38 [0,4194304] 0 2023-12-06T15:00:30.813 INFO:tasks.workunit.client.0.smithi152.stdout:1/706: rename d3/da/d15/d17/def to d3/d10a 0 2023-12-06T15:00:30.814 INFO:tasks.workunit.client.1.smithi190.stdout:7/829: creat d0/d35/d8e/f10a x:0 0 0 2023-12-06T15:00:30.816 INFO:tasks.workunit.client.1.smithi190.stdout:2/663: dread d10/d26/d5c/d35/f82 [0,4194304] 0 2023-12-06T15:00:30.816 INFO:tasks.workunit.client.1.smithi190.stdout:8/663: dread d1/d20/d3b/d31/f57 [0,4194304] 0 2023-12-06T15:00:30.816 INFO:tasks.workunit.client.1.smithi190.stdout:8/664: write d1/d20/d3b/d4c/d8e/d94/d25/f2a [1213401,69030] 0 2023-12-06T15:00:30.817 INFO:tasks.workunit.client.0.smithi152.stdout:3/518: write d9/d18/d51/f6c [2787221,96023] 0 2023-12-06T15:00:30.817 INFO:tasks.workunit.client.0.smithi152.stdout:1/707: creat d3/da/d4c/d63/d96/dd8/f10b x:0 0 0 2023-12-06T15:00:30.818 INFO:tasks.workunit.client.0.smithi152.stdout:1/708: write d3/da/d4c/d82/d52/d55/fbd [1637781,46118] 0 2023-12-06T15:00:30.818 INFO:tasks.workunit.client.0.smithi152.stdout:1/709: fsync d3/d44/f78 0 2023-12-06T15:00:30.818 INFO:tasks.workunit.client.1.smithi190.stdout:7/830: creat d0/d88/d1c/d17/d94/f10b x:0 0 0 2023-12-06T15:00:30.820 INFO:tasks.workunit.client.0.smithi152.stdout:3/519: creat d9/fa3 x:0 0 0 2023-12-06T15:00:30.820 INFO:tasks.workunit.client.0.smithi152.stdout:3/520: dread - d9/d18/d39/f4a zero size 2023-12-06T15:00:30.820 INFO:tasks.workunit.client.0.smithi152.stdout:3/521: readlink d9/d10/d19/l1b 0 2023-12-06T15:00:30.821 INFO:tasks.workunit.client.1.smithi190.stdout:8/665: link d1/d20/d3b/d36/f68 d1/d20/d3b/d31/fc4 0 2023-12-06T15:00:30.821 INFO:tasks.workunit.client.1.smithi190.stdout:8/666: readlink d1/l95 0 2023-12-06T15:00:30.825 INFO:tasks.workunit.client.1.smithi190.stdout:7/831: rename d0/d88/fec to d0/d5/f10c 0 2023-12-06T15:00:30.827 INFO:tasks.workunit.client.1.smithi190.stdout:8/667: rename d1/d20/d3b/d36/l58 to d1/d20/d3b/d4c/d59/d7d/lc5 0 2023-12-06T15:00:30.828 INFO:tasks.workunit.client.1.smithi190.stdout:8/668: read d1/d20/d3b/d36/fb5 [3032,60974] 0 2023-12-06T15:00:30.828 INFO:tasks.workunit.client.1.smithi190.stdout:8/669: readlink d1/d20/d3b/d31/l54 0 2023-12-06T15:00:30.828 INFO:tasks.workunit.client.1.smithi190.stdout:8/670: write d1/d37/f85 [1227740,42309] 0 2023-12-06T15:00:30.832 INFO:tasks.workunit.client.1.smithi190.stdout:8/671: write d1/d37/f45 [1602442,26469] 0 2023-12-06T15:00:30.834 INFO:tasks.workunit.client.1.smithi190.stdout:5/621: dwrite d0/d1c/d2b/d2c/d5d/f67 [0,4194304] 0 2023-12-06T15:00:30.836 INFO:tasks.workunit.client.1.smithi190.stdout:5/622: stat d0/d1c/d3e/d7e/lae 0 2023-12-06T15:00:30.837 INFO:tasks.workunit.client.1.smithi190.stdout:5/623: creat d0/d1c/d85/fda x:0 0 0 2023-12-06T15:00:30.838 INFO:tasks.workunit.client.1.smithi190.stdout:5/624: symlink d0/d1c/d85/d90/dba/ldb 0 2023-12-06T15:00:30.838 INFO:tasks.workunit.client.1.smithi190.stdout:5/625: fdatasync d0/d1c/d85/d90/d99/fa3 0 2023-12-06T15:00:30.845 INFO:tasks.workunit.client.1.smithi190.stdout:8/672: read d1/d37/f45 [4355333,104043] 0 2023-12-06T15:00:30.847 INFO:tasks.workunit.client.1.smithi190.stdout:8/673: creat d1/d20/d3b/d4c/d59/daa/fc6 x:0 0 0 2023-12-06T15:00:30.847 INFO:tasks.workunit.client.1.smithi190.stdout:8/674: write d1/d37/f73 [1386449,27634] 0 2023-12-06T15:00:30.848 INFO:tasks.workunit.client.1.smithi190.stdout:8/675: mkdir d1/dc7 0 2023-12-06T15:00:30.850 INFO:tasks.workunit.client.1.smithi190.stdout:8/676: symlink d1/d20/d3b/d4c/d59/daa/lc8 0 2023-12-06T15:00:30.850 INFO:tasks.workunit.client.1.smithi190.stdout:8/677: stat d1/d20/d3b/d4d/f91 0 2023-12-06T15:00:30.850 INFO:tasks.workunit.client.1.smithi190.stdout:8/678: readlink d1/d20/d3b/d31/l54 0 2023-12-06T15:00:30.850 INFO:tasks.workunit.client.1.smithi190.stdout:8/679: fsync d1/f51 0 2023-12-06T15:00:30.851 INFO:tasks.workunit.client.1.smithi190.stdout:8/680: mkdir d1/d37/dc9 0 2023-12-06T15:00:30.851 INFO:tasks.workunit.client.1.smithi190.stdout:8/681: chown d1/l71 16198 1 2023-12-06T15:00:30.851 INFO:tasks.workunit.client.1.smithi190.stdout:8/682: write d1/d20/d3b/fc3 [776144,99072] 0 2023-12-06T15:00:30.851 INFO:tasks.workunit.client.1.smithi190.stdout:8/683: write d1/d20/d3b/d4d/f91 [95524,36870] 0 2023-12-06T15:00:30.851 INFO:tasks.workunit.client.1.smithi190.stdout:8/684: write d1/d20/d3b/d4c/d8e/d94/d25/f76 [227207,57159] 0 2023-12-06T15:00:30.852 INFO:tasks.workunit.client.1.smithi190.stdout:8/685: truncate d1/d20/d3b/d36/f48 861256 0 2023-12-06T15:00:30.862 INFO:tasks.workunit.client.1.smithi190.stdout:1/971: dwrite d6/dc/d29/d38/d73/fd7 [0,4194304] 0 2023-12-06T15:00:30.865 INFO:tasks.workunit.client.1.smithi190.stdout:1/972: link d6/dc/d29/l5f d6/dc/d29/ded/l134 0 2023-12-06T15:00:30.868 INFO:tasks.workunit.client.1.smithi190.stdout:9/843: dwrite d4/f22 [0,4194304] 0 2023-12-06T15:00:30.868 INFO:tasks.workunit.client.1.smithi190.stdout:7/832: dwrite d0/d5/dba/fe0 [0,4194304] 0 2023-12-06T15:00:30.869 INFO:tasks.workunit.client.0.smithi152.stdout:1/710: dwrite d3/da/d15/d17/d58/fe4 [0,4194304] 0 2023-12-06T15:00:30.869 INFO:tasks.workunit.client.0.smithi152.stdout:1/711: write d3/d44/f78 [4629665,28055] 0 2023-12-06T15:00:30.869 INFO:tasks.workunit.client.0.smithi152.stdout:1/712: fsync d3/da/db/da0/fbe 0 2023-12-06T15:00:30.870 INFO:tasks.workunit.client.0.smithi152.stdout:1/713: chown d3/da/d4c/d82/cae 253164 1 2023-12-06T15:00:30.870 INFO:tasks.workunit.client.0.smithi152.stdout:1/714: dread - d3/d44/d84/fed zero size 2023-12-06T15:00:30.870 INFO:tasks.workunit.client.1.smithi190.stdout:2/664: dwrite d10/d59/dcd/dad/fe2 [0,4194304] 0 2023-12-06T15:00:30.870 INFO:tasks.workunit.client.0.smithi152.stdout:8/366: dwrite d1/d6/d34/d40/d64/f68 [0,4194304] 0 2023-12-06T15:00:30.872 INFO:tasks.workunit.client.1.smithi190.stdout:5/626: dwrite d0/d1c/d85/d90/d99/fa3 [0,4194304] 0 2023-12-06T15:00:30.872 INFO:tasks.workunit.client.1.smithi190.stdout:7/833: mkdir d0/df/d53/d10d 0 2023-12-06T15:00:30.874 INFO:tasks.workunit.client.0.smithi152.stdout:8/367: creat d1/d6/d34/d35/d66/f72 x:0 0 0 2023-12-06T15:00:30.874 INFO:tasks.workunit.client.0.smithi152.stdout:8/368: stat d1/d6/d34/d3a/f48 0 2023-12-06T15:00:30.874 INFO:tasks.workunit.client.0.smithi152.stdout:8/369: truncate d1/d6/d34/d35/d66/f71 824545 0 2023-12-06T15:00:30.874 INFO:tasks.workunit.client.1.smithi190.stdout:2/665: write d10/d59/dcd/dad/dc4/d7f/d8e/fbd [889442,108490] 0 2023-12-06T15:00:30.874 INFO:tasks.workunit.client.1.smithi190.stdout:2/666: fdatasync d10/f1f 0 2023-12-06T15:00:30.875 INFO:tasks.workunit.client.0.smithi152.stdout:1/715: mknod d3/da/c10c 0 2023-12-06T15:00:30.876 INFO:tasks.workunit.client.0.smithi152.stdout:1/716: truncate d3/da/d15/d17/f4f 518775 0 2023-12-06T15:00:30.878 INFO:tasks.workunit.client.0.smithi152.stdout:1/717: creat d3/da/d15/d17/d43/f10d x:0 0 0 2023-12-06T15:00:30.878 INFO:tasks.workunit.client.0.smithi152.stdout:1/718: write d3/da/d15/d17/d43/f66 [1889931,41768] 0 2023-12-06T15:00:30.878 INFO:tasks.workunit.client.0.smithi152.stdout:1/719: fdatasync d3/da/db/f53 0 2023-12-06T15:00:30.880 INFO:tasks.workunit.client.0.smithi152.stdout:1/720: getdents d3/da/d15/d17/d4d/da7 0 2023-12-06T15:00:30.880 INFO:tasks.workunit.client.1.smithi190.stdout:5/627: symlink d0/d1c/d85/d90/d99/ldc 0 2023-12-06T15:00:30.882 INFO:tasks.workunit.client.1.smithi190.stdout:7/834: creat d0/d88/d33/d4c/f10e x:0 0 0 2023-12-06T15:00:30.882 INFO:tasks.workunit.client.1.smithi190.stdout:7/835: getdents d0 0 2023-12-06T15:00:30.882 INFO:tasks.workunit.client.0.smithi152.stdout:8/370: write d1/d6/ff [1840320,71386] 0 2023-12-06T15:00:30.890 INFO:tasks.workunit.client.1.smithi190.stdout:8/686: dwrite d1/f35 [0,4194304] 0 2023-12-06T15:00:30.890 INFO:tasks.workunit.client.0.smithi152.stdout:8/371: symlink d1/d6/d34/l73 0 2023-12-06T15:00:30.890 INFO:tasks.workunit.client.0.smithi152.stdout:8/372: write d1/d6/d34/d6f/f70 [986896,58044] 0 2023-12-06T15:00:30.891 INFO:tasks.workunit.client.0.smithi152.stdout:8/373: chown d1/d6/d34/d36/f2b 230 1 2023-12-06T15:00:30.891 INFO:tasks.workunit.client.0.smithi152.stdout:8/374: fdatasync d1/d6/d34/d6f/f5c 0 2023-12-06T15:00:30.891 INFO:tasks.workunit.client.0.smithi152.stdout:8/375: mkdir d1/d6/d29/d74 0 2023-12-06T15:00:30.892 INFO:tasks.workunit.client.0.smithi152.stdout:8/376: mkdir d1/d6/d29/d75 0 2023-12-06T15:00:30.893 INFO:tasks.workunit.client.0.smithi152.stdout:8/377: creat d1/d6/d34/d3a/f76 x:0 0 0 2023-12-06T15:00:30.893 INFO:tasks.workunit.client.0.smithi152.stdout:8/378: chown d1/d6/d34/d36/f2b 259007 1 2023-12-06T15:00:30.894 INFO:tasks.workunit.client.0.smithi152.stdout:8/379: creat d1/f77 x:0 0 0 2023-12-06T15:00:30.896 INFO:tasks.workunit.client.1.smithi190.stdout:2/667: mknod d10/d59/dcd/dad/dc4/d76/db1/ce3 0 2023-12-06T15:00:30.896 INFO:tasks.workunit.client.0.smithi152.stdout:8/380: rename d1/f42 to d1/d6/d34/d40/f78 0 2023-12-06T15:00:30.896 INFO:tasks.workunit.client.1.smithi190.stdout:9/844: dwrite d4/fe4 [0,4194304] 0 2023-12-06T15:00:30.897 INFO:tasks.workunit.client.0.smithi152.stdout:8/381: creat d1/d6/d34/d36/f79 x:0 0 0 2023-12-06T15:00:30.897 INFO:tasks.workunit.client.1.smithi190.stdout:5/628: creat d0/d1c/d94/fdd x:0 0 0 2023-12-06T15:00:30.897 INFO:tasks.workunit.client.1.smithi190.stdout:5/629: truncate d0/d6c/fd4 222084 0 2023-12-06T15:00:30.898 INFO:tasks.workunit.client.1.smithi190.stdout:7/836: symlink d0/l10f 0 2023-12-06T15:00:30.900 INFO:tasks.workunit.client.1.smithi190.stdout:8/687: link d1/d20/d3b/d4c/d8e/d94/d25/c28 d1/d20/d3b/d31/d87/da1/cca 0 2023-12-06T15:00:30.900 INFO:tasks.workunit.client.1.smithi190.stdout:5/630: read d0/f7 [7110525,89374] 0 2023-12-06T15:00:30.901 INFO:tasks.workunit.client.1.smithi190.stdout:5/631: chown d0/f82 12331835 1 2023-12-06T15:00:30.901 INFO:tasks.workunit.client.1.smithi190.stdout:9/845: mknod d4/d27/d2f/c113 0 2023-12-06T15:00:30.902 INFO:tasks.workunit.client.1.smithi190.stdout:7/837: symlink d0/df/d5f/l110 0 2023-12-06T15:00:30.903 INFO:tasks.workunit.client.1.smithi190.stdout:8/688: mkdir d1/d20/d3b/d34/dcb 0 2023-12-06T15:00:30.904 INFO:tasks.workunit.client.0.smithi152.stdout:1/721: dwrite d3/da/d4c/ffb [0,4194304] 0 2023-12-06T15:00:30.905 INFO:tasks.workunit.client.1.smithi190.stdout:7/838: write d0/d88/d1c/f28 [5617483,98683] 0 2023-12-06T15:00:30.905 INFO:tasks.workunit.client.1.smithi190.stdout:7/839: truncate d0/d88/d1c/d17/d94/f106 516045 0 2023-12-06T15:00:30.906 INFO:tasks.workunit.client.0.smithi152.stdout:1/722: symlink d3/da/d65/l10e 0 2023-12-06T15:00:30.908 INFO:tasks.workunit.client.0.smithi152.stdout:1/723: symlink d3/da/d65/l10f 0 2023-12-06T15:00:30.908 INFO:tasks.workunit.client.0.smithi152.stdout:1/724: fsync d3/da/db/d54/fce 0 2023-12-06T15:00:30.908 INFO:tasks.workunit.client.1.smithi190.stdout:8/689: unlink d1/d20/d3b/d34/l69 0 2023-12-06T15:00:30.908 INFO:tasks.workunit.client.1.smithi190.stdout:7/840: unlink d0/d88/d1c/c9f 0 2023-12-06T15:00:30.909 INFO:tasks.workunit.client.1.smithi190.stdout:5/632: write d0/d1c/d94/fc4 [3209001,24823] 0 2023-12-06T15:00:30.909 INFO:tasks.workunit.client.1.smithi190.stdout:7/841: rmdir d0/df 39 2023-12-06T15:00:30.909 INFO:tasks.workunit.client.0.smithi152.stdout:8/382: dread d1/d6/d34/d36/f5d [0,4194304] 0 2023-12-06T15:00:30.910 INFO:tasks.workunit.client.0.smithi152.stdout:1/725: mkdir d3/da/d4c/d82/d52/d55/d110 0 2023-12-06T15:00:30.910 INFO:tasks.workunit.client.0.smithi152.stdout:1/726: chown d3/da/d65 597931 1 2023-12-06T15:00:30.910 INFO:tasks.workunit.client.0.smithi152.stdout:1/727: readlink d3/l3e 0 2023-12-06T15:00:30.911 INFO:tasks.workunit.client.0.smithi152.stdout:1/728: getdents d3/da/d4c/d85 0 2023-12-06T15:00:30.912 INFO:tasks.workunit.client.0.smithi152.stdout:1/729: chown d3/da/d4c/d85/c94 0 1 2023-12-06T15:00:30.912 INFO:tasks.workunit.client.1.smithi190.stdout:8/690: rename d1/d20/d3b/d4c/d5a/l6e to d1/d20/d3b/d4d/lcc 0 2023-12-06T15:00:30.912 INFO:tasks.workunit.client.1.smithi190.stdout:8/691: write d1/d20/d3b/fbb [401191,120953] 0 2023-12-06T15:00:30.912 INFO:tasks.workunit.client.1.smithi190.stdout:5/633: symlink d0/d96/dc5/lde 0 2023-12-06T15:00:30.912 INFO:tasks.workunit.client.1.smithi190.stdout:5/634: chown d0/d1c/d2b/d2c/c81 598359 1 2023-12-06T15:00:30.913 INFO:tasks.workunit.client.0.smithi152.stdout:1/730: mknod d3/da/dcd/dd9/dfd/c111 0 2023-12-06T15:00:30.913 INFO:tasks.workunit.client.1.smithi190.stdout:5/635: chown d0/d1c/d2b/d2c/d5d/d73/l3a 226739709 1 2023-12-06T15:00:30.913 INFO:tasks.workunit.client.1.smithi190.stdout:5/636: chown d0/d1c/d2b/fc2 360 1 2023-12-06T15:00:30.914 INFO:tasks.workunit.client.0.smithi152.stdout:1/731: mkdir d3/d10a/d112 0 2023-12-06T15:00:30.915 INFO:tasks.workunit.client.1.smithi190.stdout:5/637: creat d0/d1c/d2b/fdf x:0 0 0 2023-12-06T15:00:30.915 INFO:tasks.workunit.client.1.smithi190.stdout:5/638: chown d0/df/d50/fa4 1 1 2023-12-06T15:00:30.921 INFO:tasks.workunit.client.1.smithi190.stdout:9/846: dwrite d4/f6b [0,4194304] 0 2023-12-06T15:00:30.922 INFO:tasks.workunit.client.1.smithi190.stdout:7/842: dread d0/fbb [0,4194304] 0 2023-12-06T15:00:30.922 INFO:tasks.workunit.client.1.smithi190.stdout:9/847: fsync d4/d84/fd8 0 2023-12-06T15:00:30.922 INFO:tasks.workunit.client.1.smithi190.stdout:7/843: read - d0/d88/d7a/d7c/dab/ddf/f107 zero size 2023-12-06T15:00:30.922 INFO:tasks.workunit.client.1.smithi190.stdout:9/848: write d4/d27/d2f/d31/fad [559456,89945] 0 2023-12-06T15:00:30.924 INFO:tasks.workunit.client.1.smithi190.stdout:7/844: creat d0/df/d53/f111 x:0 0 0 2023-12-06T15:00:30.926 INFO:tasks.workunit.client.1.smithi190.stdout:7/845: creat d0/df/d1f/dbd/f112 x:0 0 0 2023-12-06T15:00:30.926 INFO:tasks.workunit.client.1.smithi190.stdout:7/846: fsync d0/ffe 0 2023-12-06T15:00:30.927 INFO:tasks.workunit.client.1.smithi190.stdout:7/847: creat d0/d5/d63/f113 x:0 0 0 2023-12-06T15:00:30.928 INFO:tasks.workunit.client.1.smithi190.stdout:8/692: dread d1/d20/d3b/d36/f48 [0,4194304] 0 2023-12-06T15:00:30.928 INFO:tasks.workunit.client.1.smithi190.stdout:8/693: fsync d1/d20/d3b/f18 0 2023-12-06T15:00:30.928 INFO:tasks.workunit.client.1.smithi190.stdout:8/694: chown d1/l95 988 1 2023-12-06T15:00:30.928 INFO:tasks.workunit.client.1.smithi190.stdout:9/849: write d4/f17 [500253,125391] 0 2023-12-06T15:00:30.930 INFO:tasks.workunit.client.1.smithi190.stdout:9/850: creat d4/d27/d2f/d31/d3f/d58/d72/db3/d10f/f114 x:0 0 0 2023-12-06T15:00:30.931 INFO:tasks.workunit.client.1.smithi190.stdout:9/851: rmdir d4/d84 39 2023-12-06T15:00:30.931 INFO:tasks.workunit.client.1.smithi190.stdout:9/852: stat d4/d27/d2f/d5c/d9d/f10c 0 2023-12-06T15:00:30.933 INFO:tasks.workunit.client.1.smithi190.stdout:9/853: creat d4/d27/d2f/f115 x:0 0 0 2023-12-06T15:00:30.945 INFO:tasks.workunit.client.0.smithi152.stdout:8/383: dwrite d1/f3c [0,4194304] 0 2023-12-06T15:00:30.945 INFO:tasks.workunit.client.0.smithi152.stdout:8/384: chown d1/c25 126 1 2023-12-06T15:00:30.946 INFO:tasks.workunit.client.0.smithi152.stdout:8/385: write d1/d6/d29/f33 [936790,3664] 0 2023-12-06T15:00:30.946 INFO:tasks.workunit.client.1.smithi190.stdout:9/854: dread f1 [0,4194304] 0 2023-12-06T15:00:30.946 INFO:tasks.workunit.client.0.smithi152.stdout:8/386: creat d1/d6/d34/d40/f7a x:0 0 0 2023-12-06T15:00:30.946 INFO:tasks.workunit.client.0.smithi152.stdout:8/387: readlink d1/d6/d34/l16 0 2023-12-06T15:00:30.947 INFO:tasks.workunit.client.1.smithi190.stdout:9/855: rename d4/d27/d8a/dbc/le0 to d4/d84/dda/l116 0 2023-12-06T15:00:30.947 INFO:tasks.workunit.client.0.smithi152.stdout:8/388: symlink d1/d6/d29/d74/l7b 0 2023-12-06T15:00:30.947 INFO:tasks.workunit.client.0.smithi152.stdout:8/389: fsync d1/d6/d34/d35/d38/f4e 0 2023-12-06T15:00:30.948 INFO:tasks.workunit.client.0.smithi152.stdout:8/390: truncate d1/d6/d34/d35/d66/f72 335130 0 2023-12-06T15:00:30.948 INFO:tasks.workunit.client.1.smithi190.stdout:9/856: mkdir d4/d27/d2f/d31/d3f/d58/d72/d117 0 2023-12-06T15:00:30.948 INFO:tasks.workunit.client.0.smithi152.stdout:8/391: write d1/d6/d29/f33 [220929,120443] 0 2023-12-06T15:00:30.949 INFO:tasks.workunit.client.1.smithi190.stdout:9/857: symlink d4/d27/d2f/d31/d3f/d58/d72/db3/dea/l118 0 2023-12-06T15:00:30.950 INFO:tasks.workunit.client.1.smithi190.stdout:9/858: rmdir d4/d27/d2f/d31/d3f/d58/d72/db3 39 2023-12-06T15:00:30.951 INFO:tasks.workunit.client.1.smithi190.stdout:9/859: symlink d4/d27/d2f/d31/d3f/d58/d72/l119 0 2023-12-06T15:00:30.951 INFO:tasks.workunit.client.1.smithi190.stdout:9/860: stat d4/d27/d2f/c98 0 2023-12-06T15:00:30.951 INFO:tasks.workunit.client.1.smithi190.stdout:9/861: chown d4/d27/f6a 30108356 1 2023-12-06T15:00:30.956 INFO:tasks.workunit.client.0.smithi152.stdout:1/732: dwrite d3/da/d4c/d63/d96/dd8/f10b [0,4194304] 0 2023-12-06T15:00:30.956 INFO:tasks.workunit.client.1.smithi190.stdout:5/639: dwrite d0/df/d50/f87 [0,4194304] 0 2023-12-06T15:00:30.956 INFO:tasks.workunit.client.1.smithi190.stdout:9/862: dread d4/fe [4194304,4194304] 0 2023-12-06T15:00:30.957 INFO:tasks.workunit.client.1.smithi190.stdout:8/695: dwrite d1/d20/d3b/d36/f3e [0,4194304] 0 2023-12-06T15:00:30.957 INFO:tasks.workunit.client.1.smithi190.stdout:8/696: chown d1/d20/d3b/d4c/ca4 51938 1 2023-12-06T15:00:30.957 INFO:tasks.workunit.client.1.smithi190.stdout:8/697: readlink d1/d20/d3b/d4c/d8e/d94/d1c/d4b/l96 0 2023-12-06T15:00:30.957 INFO:tasks.workunit.client.1.smithi190.stdout:8/698: rename d1/d20 to d1/d20/d3b/d31/d87/da1/dcd 22 2023-12-06T15:00:30.957 INFO:tasks.workunit.client.1.smithi190.stdout:7/848: dwrite d0/d35/f84 [0,4194304] 0 2023-12-06T15:00:30.957 INFO:tasks.workunit.client.1.smithi190.stdout:7/849: read - d0/d88/d1c/d17/d94/d95/fed zero size 2023-12-06T15:00:30.958 INFO:tasks.workunit.client.1.smithi190.stdout:5/640: truncate d0/fd 2934324 0 2023-12-06T15:00:30.959 INFO:tasks.workunit.client.1.smithi190.stdout:7/850: write d0/d88/d7a/d7c/dab/dc0/dd1/f7e [3153364,4354] 0 2023-12-06T15:00:30.960 INFO:tasks.workunit.client.1.smithi190.stdout:5/641: write d0/d1c/d85/d90/d99/fa3 [2996453,8761] 0 2023-12-06T15:00:30.960 INFO:tasks.workunit.client.1.smithi190.stdout:8/699: rename d1/d20/d3b/d34/l3a to d1/d20/d3b/d4c/d9e/lce 0 2023-12-06T15:00:30.962 INFO:tasks.workunit.client.0.smithi152.stdout:8/392: truncate d1/d6/d34/d35/d66/f72 235531 0 2023-12-06T15:00:30.963 INFO:tasks.workunit.client.0.smithi152.stdout:1/733: symlink d3/da/d4c/d82/d52/d62/l113 0 2023-12-06T15:00:30.964 INFO:tasks.workunit.client.1.smithi190.stdout:7/851: rename d0/df/d53/d99/f109 to d0/d88/d7a/f114 0 2023-12-06T15:00:30.964 INFO:tasks.workunit.client.0.smithi152.stdout:1/734: mknod d3/da/dcd/dd9/dfd/c114 0 2023-12-06T15:00:30.965 INFO:tasks.workunit.client.0.smithi152.stdout:1/735: symlink d3/da/d65/l115 0 2023-12-06T15:00:30.972 INFO:tasks.workunit.client.1.smithi190.stdout:9/863: dread d4/fe4 [0,4194304] 0 2023-12-06T15:00:30.976 INFO:tasks.workunit.client.1.smithi190.stdout:5/642: dread d0/d1c/d2b/f9e [0,4194304] 0 2023-12-06T15:00:30.977 INFO:tasks.workunit.client.1.smithi190.stdout:7/852: dread d0/d88/d7a/d7c/dab/dc0/dd1/fe3 [0,4194304] 0 2023-12-06T15:00:30.978 INFO:tasks.workunit.client.1.smithi190.stdout:5/643: rename d0/f28 to d0/d6c/fe0 0 2023-12-06T15:00:30.979 INFO:tasks.workunit.client.1.smithi190.stdout:5/644: creat d0/d1c/d3e/fe1 x:0 0 0 2023-12-06T15:00:30.980 INFO:tasks.workunit.client.1.smithi190.stdout:5/645: mknod d0/ce2 0 2023-12-06T15:00:30.981 INFO:tasks.workunit.client.1.smithi190.stdout:5/646: creat d0/d1c/d2b/fe3 x:0 0 0 2023-12-06T15:00:30.982 INFO:tasks.workunit.client.1.smithi190.stdout:5/647: rename d0/df/f17 to d0/d1c/d85/fe4 0 2023-12-06T15:00:30.984 INFO:tasks.workunit.client.1.smithi190.stdout:5/648: rename d0/d1c/d2b/c47 to d0/df/ce5 0 2023-12-06T15:00:30.985 INFO:tasks.workunit.client.1.smithi190.stdout:5/649: symlink d0/d1c/d2b/d2c/d5d/d73/dc7/le6 0 2023-12-06T15:00:30.985 INFO:tasks.workunit.client.1.smithi190.stdout:5/650: dread - d0/d1c/d85/d90/dba/fc1 zero size 2023-12-06T15:00:30.985 INFO:tasks.workunit.client.0.smithi152.stdout:1/736: dwrite d3/fb0 [0,4194304] 0 2023-12-06T15:00:30.985 INFO:tasks.workunit.client.0.smithi152.stdout:1/737: fsync d3/da/d15/fd6 0 2023-12-06T15:00:30.985 INFO:tasks.workunit.client.1.smithi190.stdout:5/651: truncate d0/d1c/d3e/f77 904984 0 2023-12-06T15:00:30.986 INFO:tasks.workunit.client.1.smithi190.stdout:5/652: mknod d0/d96/ce7 0 2023-12-06T15:00:30.986 INFO:tasks.workunit.client.1.smithi190.stdout:5/653: fdatasync d0/d1c/d2b/d69/f74 0 2023-12-06T15:00:30.987 INFO:tasks.workunit.client.1.smithi190.stdout:5/654: write d0/f44 [3832139,53473] 0 2023-12-06T15:00:30.987 INFO:tasks.workunit.client.0.smithi152.stdout:1/738: rename d3/da/d15/d17/d58/f93 to d3/da/d4c/d63/f116 0 2023-12-06T15:00:30.987 INFO:tasks.workunit.client.0.smithi152.stdout:1/739: fsync d3/da/d15/d17/d43/f10d 0 2023-12-06T15:00:30.988 INFO:tasks.workunit.client.1.smithi190.stdout:5/655: truncate d0/d1c/d2b/d2c/d5d/d73/fb1 418178 0 2023-12-06T15:00:30.989 INFO:tasks.workunit.client.0.smithi152.stdout:1/740: dread d3/d44/d84/f9b [0,4194304] 0 2023-12-06T15:00:31.024 INFO:tasks.workunit.client.1.smithi190.stdout:7/853: dread d0/d88/d1c/d17/f64 [0,4194304] 0 2023-12-06T15:00:31.028 INFO:tasks.workunit.client.1.smithi190.stdout:8/700: dwrite d1/d20/d3b/d4c/d8e/d94/d25/f2a [0,4194304] 0 2023-12-06T15:00:31.028 INFO:tasks.workunit.client.1.smithi190.stdout:8/701: readlink d1/d20/d3b/d4c/d8e/d94/d25/l32 0 2023-12-06T15:00:31.031 INFO:tasks.workunit.client.1.smithi190.stdout:7/854: dread d0/d88/d1c/f28 [4194304,4194304] 0 2023-12-06T15:00:31.031 INFO:tasks.workunit.client.1.smithi190.stdout:5/656: dwrite d0/f2a [0,4194304] 0 2023-12-06T15:00:31.037 INFO:tasks.workunit.client.1.smithi190.stdout:8/702: creat d1/d20/d3b/d4c/d59/d7d/fcf x:0 0 0 2023-12-06T15:00:31.038 INFO:tasks.workunit.client.1.smithi190.stdout:7/855: mknod d0/df/df6/c115 0 2023-12-06T15:00:31.040 INFO:tasks.workunit.client.1.smithi190.stdout:5/657: dread d0/f24 [0,4194304] 0 2023-12-06T15:00:31.042 INFO:tasks.workunit.client.1.smithi190.stdout:8/703: rmdir d1/d20/d3b/d36 39 2023-12-06T15:00:31.042 INFO:tasks.workunit.client.1.smithi190.stdout:8/704: chown d1/l15 225020946 1 2023-12-06T15:00:31.044 INFO:tasks.workunit.client.1.smithi190.stdout:7/856: truncate d0/df/d53/d2f/f70 226710 0 2023-12-06T15:00:31.044 INFO:tasks.workunit.client.1.smithi190.stdout:7/857: write d0/d5/d63/fff [882710,89282] 0 2023-12-06T15:00:31.044 INFO:tasks.workunit.client.0.smithi152.stdout:1/741: dwrite d3/da/d4c/d82/d52/d55/f74 [0,4194304] 0 2023-12-06T15:00:31.046 INFO:tasks.workunit.client.1.smithi190.stdout:5/658: creat d0/d6c/dcd/fe8 x:0 0 0 2023-12-06T15:00:31.047 INFO:tasks.workunit.client.1.smithi190.stdout:7/858: mknod d0/d88/d41/df4/c116 0 2023-12-06T15:00:31.048 INFO:tasks.workunit.client.1.smithi190.stdout:5/659: creat d0/d1c/d2b/d8b/dd7/fe9 x:0 0 0 2023-12-06T15:00:31.049 INFO:tasks.workunit.client.1.smithi190.stdout:7/859: rename d0/d88/c76 to d0/d88/d1c/d17/d94/d95/db1/c117 0 2023-12-06T15:00:31.051 INFO:tasks.workunit.client.1.smithi190.stdout:7/860: write d0/d88/d32/f7d [1917383,127219] 0 2023-12-06T15:00:31.052 INFO:tasks.workunit.client.1.smithi190.stdout:5/660: mkdir d0/d1c/d3e/dea 0 2023-12-06T15:00:31.054 INFO:tasks.workunit.client.1.smithi190.stdout:6/783: sync 2023-12-06T15:00:31.054 INFO:tasks.workunit.client.1.smithi190.stdout:6/784: stat d4/d12/d1a/d70/ff2 0 2023-12-06T15:00:31.055 INFO:tasks.workunit.client.1.smithi190.stdout:7/861: rmdir d0/d88/d1c/d17/d94/df1 0 2023-12-06T15:00:31.056 INFO:tasks.workunit.client.1.smithi190.stdout:6/785: unlink d4/d12/d1a/d8a/f9f 0 2023-12-06T15:00:31.058 INFO:tasks.workunit.client.1.smithi190.stdout:6/786: creat d4/d12/d40/d43/d45/d4a/f105 x:0 0 0 2023-12-06T15:00:31.060 INFO:tasks.workunit.client.1.smithi190.stdout:6/787: truncate d4/d12/d40/d43/d45/f5f 3970528 0 2023-12-06T15:00:31.064 INFO:tasks.workunit.client.1.smithi190.stdout:6/788: creat d4/d12/d1a/d32/dc7/dea/f106 x:0 0 0 2023-12-06T15:00:31.064 INFO:tasks.workunit.client.1.smithi190.stdout:6/789: chown d4/d12/d1a/d32/dab/de9 242383293 1 2023-12-06T15:00:31.065 INFO:tasks.workunit.client.1.smithi190.stdout:7/862: unlink d0/df/d53/d2f/f70 0 2023-12-06T15:00:31.065 INFO:tasks.workunit.client.1.smithi190.stdout:7/863: readlink d0/d88/d1c/l73 0 2023-12-06T15:00:31.066 INFO:tasks.workunit.client.1.smithi190.stdout:6/790: dread - d4/d12/d1a/d59/fef zero size 2023-12-06T15:00:31.066 INFO:tasks.workunit.client.1.smithi190.stdout:6/791: fdatasync d4/d12/d1a/d70/f104 0 2023-12-06T15:00:31.067 INFO:tasks.workunit.client.1.smithi190.stdout:7/864: creat d0/d88/d7a/dc9/f118 x:0 0 0 2023-12-06T15:00:31.068 INFO:tasks.workunit.client.1.smithi190.stdout:6/792: mkdir d4/d12/d1a/d32/dab/de1/d107 0 2023-12-06T15:00:31.068 INFO:tasks.workunit.client.1.smithi190.stdout:6/793: write d4/d12/d1a/d8a/fa0 [671474,26617] 0 2023-12-06T15:00:31.068 INFO:tasks.workunit.client.1.smithi190.stdout:6/794: write d4/d12/d1a/d44/fbd [1739804,30084] 0 2023-12-06T15:00:31.069 INFO:tasks.workunit.client.1.smithi190.stdout:3/793: sync 2023-12-06T15:00:31.069 INFO:tasks.workunit.client.1.smithi190.stdout:0/715: sync 2023-12-06T15:00:31.069 INFO:tasks.workunit.client.1.smithi190.stdout:3/794: fsync d4/d70/d33/d45/fac 0 2023-12-06T15:00:31.069 INFO:tasks.workunit.client.1.smithi190.stdout:4/699: sync 2023-12-06T15:00:31.069 INFO:tasks.workunit.client.1.smithi190.stdout:4/700: write d3/da4/dd0/fe0 [832257,78952] 0 2023-12-06T15:00:31.069 INFO:tasks.workunit.client.1.smithi190.stdout:6/795: getdents d4/d12/d1a/d44/dfc/da6 0 2023-12-06T15:00:31.069 INFO:tasks.workunit.client.1.smithi190.stdout:8/705: dwrite d1/d37/fc1 [0,4194304] 0 2023-12-06T15:00:31.070 INFO:tasks.workunit.client.1.smithi190.stdout:0/716: read d0/da/d3e/d3a/d40/d6f/d9e/fca [3048381,89311] 0 2023-12-06T15:00:31.070 INFO:tasks.workunit.client.1.smithi190.stdout:0/717: readlink d0/da/d3e/d2b/d3c/d46/l9b 0 2023-12-06T15:00:31.070 INFO:tasks.workunit.client.1.smithi190.stdout:4/701: unlink d3/d35/d19/d41/d44/d9c/d72/la8 0 2023-12-06T15:00:31.070 INFO:tasks.workunit.client.1.smithi190.stdout:4/702: read d3/d76/dc4/dc5/d3c/f4f [753940,14887] 0 2023-12-06T15:00:31.072 INFO:tasks.workunit.client.1.smithi190.stdout:6/796: creat d4/d12/d1a/d44/f108 x:0 0 0 2023-12-06T15:00:31.072 INFO:tasks.workunit.client.1.smithi190.stdout:6/797: fdatasync d4/d12/d1a/d32/dc7/dd0/fd6 0 2023-12-06T15:00:31.073 INFO:tasks.workunit.client.1.smithi190.stdout:7/865: write d0/d88/d33/fc2 [4016886,109909] 0 2023-12-06T15:00:31.073 INFO:tasks.workunit.client.1.smithi190.stdout:7/866: stat d0/d88/d32/fc7 0 2023-12-06T15:00:31.075 INFO:tasks.workunit.client.0.smithi152.stdout:1/742: dwrite d3/da/d15/d17/f42 [0,4194304] 0 2023-12-06T15:00:31.075 INFO:tasks.workunit.client.0.smithi152.stdout:1/743: write d3/da/d4c/d82/d52/f8e [530953,37236] 0 2023-12-06T15:00:31.076 INFO:tasks.workunit.client.0.smithi152.stdout:1/744: readlink d3/da/d65/l10f 0 2023-12-06T15:00:31.076 INFO:tasks.workunit.client.1.smithi190.stdout:5/661: dwrite d0/d1c/d94/fb6 [0,4194304] 0 2023-12-06T15:00:31.078 INFO:tasks.workunit.client.0.smithi152.stdout:1/745: creat d3/da/d4c/d82/d52/d62/dcc/f117 x:0 0 0 2023-12-06T15:00:31.078 INFO:tasks.workunit.client.0.smithi152.stdout:1/746: stat d3/da/d15/fd6 0 2023-12-06T15:00:31.085 INFO:tasks.workunit.client.1.smithi190.stdout:0/718: symlink d0/da/d3e/d2b/d37/lea 0 2023-12-06T15:00:31.085 INFO:tasks.workunit.client.1.smithi190.stdout:0/719: dread - d0/f75 zero size 2023-12-06T15:00:31.085 INFO:tasks.workunit.client.1.smithi190.stdout:7/867: dread d0/d35/d8e/f9a [0,4194304] 0 2023-12-06T15:00:31.086 INFO:tasks.workunit.client.1.smithi190.stdout:0/720: write d0/da/fa3 [3014956,122941] 0 2023-12-06T15:00:31.089 INFO:tasks.workunit.client.0.smithi152.stdout:1/747: read d3/da/db/da0/fc0 [572151,78810] 0 2023-12-06T15:00:31.090 INFO:tasks.workunit.client.1.smithi190.stdout:4/703: getdents d3/d35 0 2023-12-06T15:00:31.094 INFO:tasks.workunit.client.1.smithi190.stdout:4/704: write d3/d35/f53 [70416,103991] 0 2023-12-06T15:00:31.097 INFO:tasks.workunit.client.1.smithi190.stdout:7/868: getdents d0/df/d1f/dbd 0 2023-12-06T15:00:31.098 INFO:tasks.workunit.client.1.smithi190.stdout:4/705: mknod d3/d35/d19/d41/d44/cf2 0 2023-12-06T15:00:31.099 INFO:tasks.workunit.client.1.smithi190.stdout:4/706: chown d3/d76/dc4/dc5/d3c/f49 8 1 2023-12-06T15:00:31.099 INFO:tasks.workunit.client.1.smithi190.stdout:4/707: write d3/d35/d19/fd3 [4861450,32020] 0 2023-12-06T15:00:31.099 INFO:tasks.workunit.client.1.smithi190.stdout:4/708: fdatasync d3/f9 0 2023-12-06T15:00:31.101 INFO:tasks.workunit.client.1.smithi190.stdout:4/709: rmdir d3/d76/dc4 39 2023-12-06T15:00:31.103 INFO:tasks.workunit.client.1.smithi190.stdout:4/710: mknod d3/d76/d7c/d8a/ddf/cf3 0 2023-12-06T15:00:31.104 INFO:tasks.workunit.client.1.smithi190.stdout:4/711: mkdir d3/d76/dc4/dc5/daa/df4 0 2023-12-06T15:00:31.105 INFO:tasks.workunit.client.1.smithi190.stdout:4/712: getdents d3/d35/da9 0 2023-12-06T15:00:31.105 INFO:tasks.workunit.client.1.smithi190.stdout:4/713: readlink d3/d35/d19/d41/l6e 0 2023-12-06T15:00:31.120 INFO:tasks.workunit.client.1.smithi190.stdout:8/706: dwrite d1/d20/d3b/fc3 [0,4194304] 0 2023-12-06T15:00:31.120 INFO:tasks.workunit.client.1.smithi190.stdout:8/707: chown d1/d20/d3b/d4d/lcc 632 1 2023-12-06T15:00:31.121 INFO:tasks.workunit.client.1.smithi190.stdout:8/708: chown d1/d20/d3b/d4c/d59/d7d/lc5 50529673 1 2023-12-06T15:00:31.124 INFO:tasks.workunit.client.1.smithi190.stdout:8/709: rename d1/d20/d3b/d4d to d1/d20/d3b/d7e/dd0 0 2023-12-06T15:00:31.124 INFO:tasks.workunit.client.1.smithi190.stdout:6/798: dwrite d4/d12/d1a/d8a/fa7 [0,4194304] 0 2023-12-06T15:00:31.124 INFO:tasks.workunit.client.1.smithi190.stdout:6/799: fdatasync d4/d12/d1a/f97 0 2023-12-06T15:00:31.128 INFO:tasks.workunit.client.1.smithi190.stdout:8/710: dread d1/d37/f73 [0,4194304] 0 2023-12-06T15:00:31.130 INFO:tasks.workunit.client.1.smithi190.stdout:8/711: rename d1/d20/d3b/d4c/d8e/d94/d1c/d4b to d1/dd1 0 2023-12-06T15:00:31.131 INFO:tasks.workunit.client.1.smithi190.stdout:8/712: creat d1/d20/d3b/d4c/d8e/fd2 x:0 0 0 2023-12-06T15:00:31.132 INFO:tasks.workunit.client.1.smithi190.stdout:0/721: dwrite d0/da/d3e/d2b/d3c/f60 [0,4194304] 0 2023-12-06T15:00:31.133 INFO:tasks.workunit.client.0.smithi152.stdout:1/748: dwrite d3/da/d15/d17/d58/da3/fdd [0,4194304] 0 2023-12-06T15:00:31.133 INFO:tasks.workunit.client.1.smithi190.stdout:7/869: dwrite d0/d88/d7a/d7c/dab/dc0/ff7 [0,4194304] 0 2023-12-06T15:00:31.133 INFO:tasks.workunit.client.1.smithi190.stdout:7/870: write d0/d5/d63/fc4 [586092,112991] 0 2023-12-06T15:00:31.134 INFO:tasks.workunit.client.1.smithi190.stdout:3/795: dwrite d4/d70/d19/d51/d109/db7/dd2/fd5 [0,4194304] 0 2023-12-06T15:00:31.134 INFO:tasks.workunit.client.1.smithi190.stdout:3/796: chown d4/d70/d19 1 1 2023-12-06T15:00:31.135 INFO:tasks.workunit.client.1.smithi190.stdout:4/714: dwrite d3/d76/dc4/dc5/f86 [0,4194304] 0 2023-12-06T15:00:31.137 INFO:tasks.workunit.client.0.smithi152.stdout:1/749: rename d3/da/d15/d17/c47 to d3/da/db/c118 0 2023-12-06T15:00:31.137 INFO:tasks.workunit.client.0.smithi152.stdout:1/750: write d3/da/d4c/d82/d52/d55/fbd [2572228,86640] 0 2023-12-06T15:00:31.137 INFO:tasks.workunit.client.0.smithi152.stdout:1/751: truncate d3/da/d4c/d82/f31 1782063 0 2023-12-06T15:00:31.137 INFO:tasks.workunit.client.0.smithi152.stdout:1/752: write d3/d44/d84/fe3 [197704,109872] 0 2023-12-06T15:00:31.138 INFO:tasks.workunit.client.1.smithi190.stdout:7/871: mknod d0/d88/d7a/d7c/c119 0 2023-12-06T15:00:31.138 INFO:tasks.workunit.client.0.smithi152.stdout:1/753: creat d3/da/d15/d17/d58/f119 x:0 0 0 2023-12-06T15:00:31.141 INFO:tasks.workunit.client.0.smithi152.stdout:1/754: link d3/da/d15/d17/d1a/fb7 d3/da/db/d54/f11a 0 2023-12-06T15:00:31.142 INFO:tasks.workunit.client.1.smithi190.stdout:3/797: mknod d4/d1b/d54/d9c/d68/d8a/c11a 0 2023-12-06T15:00:31.145 INFO:tasks.workunit.client.1.smithi190.stdout:4/715: dread d3/d76/d7c/d96/d15/f20 [4194304,4194304] 0 2023-12-06T15:00:31.146 INFO:tasks.workunit.client.0.smithi152.stdout:1/755: mkdir d3/da/d4c/d82/d52/d62/d11b 0 2023-12-06T15:00:31.149 INFO:tasks.workunit.client.1.smithi190.stdout:7/872: link d0/d88/d33/fc2 d0/d88/d1c/f11a 0 2023-12-06T15:00:31.149 INFO:tasks.workunit.client.1.smithi190.stdout:7/873: readlink d0/d88/d7a/l3b 0 2023-12-06T15:00:31.149 INFO:tasks.workunit.client.1.smithi190.stdout:7/874: fdatasync d0/d88/d32/f59 0 2023-12-06T15:00:31.150 INFO:tasks.workunit.client.1.smithi190.stdout:3/798: mkdir d4/d1b/d5d/d11b 0 2023-12-06T15:00:31.151 INFO:tasks.workunit.client.1.smithi190.stdout:3/799: fdatasync d4/d70/d33/d45/f5b 0 2023-12-06T15:00:31.151 INFO:tasks.workunit.client.1.smithi190.stdout:3/800: fdatasync d4/d1b/d5d/df1/fe7 0 2023-12-06T15:00:31.152 INFO:tasks.workunit.client.1.smithi190.stdout:4/716: rename d3/d76/dc4/dc5/f85 to d3/d76/dc4/dc5/daa/ff5 0 2023-12-06T15:00:31.152 INFO:tasks.workunit.client.1.smithi190.stdout:4/717: stat d3/d76/d8b/fd4 0 2023-12-06T15:00:31.153 INFO:tasks.workunit.client.1.smithi190.stdout:7/875: symlink d0/d88/d41/df4/l11b 0 2023-12-06T15:00:31.153 INFO:tasks.workunit.client.1.smithi190.stdout:2/668: sync 2023-12-06T15:00:31.153 INFO:tasks.workunit.client.1.smithi190.stdout:9/864: sync 2023-12-06T15:00:31.153 INFO:tasks.workunit.client.1.smithi190.stdout:1/973: sync 2023-12-06T15:00:31.153 INFO:tasks.workunit.client.1.smithi190.stdout:9/865: chown d4/d84 322 1 2023-12-06T15:00:31.153 INFO:tasks.workunit.client.1.smithi190.stdout:9/866: dread - d4/d27/d2f/f115 zero size 2023-12-06T15:00:31.153 INFO:tasks.workunit.client.1.smithi190.stdout:3/801: mkdir d4/d70/dcb/d11c 0 2023-12-06T15:00:31.154 INFO:tasks.workunit.client.1.smithi190.stdout:9/867: write d4/d27/d2f/d31/ff5 [2923639,66651] 0 2023-12-06T15:00:31.155 INFO:tasks.workunit.client.1.smithi190.stdout:4/718: stat d3/d76/d7c/d96/c91 0 2023-12-06T15:00:31.155 INFO:tasks.workunit.client.1.smithi190.stdout:7/876: mkdir d0/d11c 0 2023-12-06T15:00:31.156 INFO:tasks.workunit.client.1.smithi190.stdout:2/669: creat d10/d26/d5c/d49/d54/fe4 x:0 0 0 2023-12-06T15:00:31.157 INFO:tasks.workunit.client.1.smithi190.stdout:1/974: mkdir d6/dc/d3b/d78/d106/d135 0 2023-12-06T15:00:31.158 INFO:tasks.workunit.client.1.smithi190.stdout:1/975: fsync d6/dc/d29/d38/d39/d63/d67/f126 0 2023-12-06T15:00:31.158 INFO:tasks.workunit.client.1.smithi190.stdout:1/976: write d6/dc/d29/d38/d73/d76/d7e/fbc [1745280,92069] 0 2023-12-06T15:00:31.158 INFO:tasks.workunit.client.1.smithi190.stdout:2/670: dread d10/d59/d5e/fb6 [0,4194304] 0 2023-12-06T15:00:31.158 INFO:tasks.workunit.client.1.smithi190.stdout:3/802: symlink d4/d1b/d54/d9c/d68/l11d 0 2023-12-06T15:00:31.160 INFO:tasks.workunit.client.1.smithi190.stdout:7/877: symlink d0/df/d53/d10d/l11d 0 2023-12-06T15:00:31.161 INFO:tasks.workunit.client.0.smithi152.stdout:1/756: dread d3/d73/ffa [0,4194304] 0 2023-12-06T15:00:31.161 INFO:tasks.workunit.client.1.smithi190.stdout:7/878: write d0/d5/f78 [2717851,4715] 0 2023-12-06T15:00:31.162 INFO:tasks.workunit.client.0.smithi152.stdout:1/757: unlink d3/da/d15/d17/d58/cb2 0 2023-12-06T15:00:31.163 INFO:tasks.workunit.client.1.smithi190.stdout:0/722: dwrite d0/da/d3e/d2b/d37/fc4 [0,4194304] 0 2023-12-06T15:00:31.167 INFO:tasks.workunit.client.1.smithi190.stdout:7/879: read d0/d88/d41/fa1 [1050907,93338] 0 2023-12-06T15:00:31.168 INFO:tasks.workunit.client.0.smithi152.stdout:1/758: read d3/da/d4c/d82/d52/d62/fb8 [2736988,89216] 0 2023-12-06T15:00:31.168 INFO:tasks.workunit.client.1.smithi190.stdout:6/800: dwrite d4/d12/d40/d43/d45/f5f [0,4194304] 0 2023-12-06T15:00:31.168 INFO:tasks.workunit.client.1.smithi190.stdout:6/801: fsync d4/d12/d1a/d59/fef 0 2023-12-06T15:00:31.168 INFO:tasks.workunit.client.1.smithi190.stdout:6/802: stat d4/d12/f53 0 2023-12-06T15:00:31.169 INFO:tasks.workunit.client.1.smithi190.stdout:1/977: mknod d6/d49/d74/d12c/c136 0 2023-12-06T15:00:31.170 INFO:tasks.workunit.client.1.smithi190.stdout:6/803: write d4/d12/d1a/d44/f79 [186582,124178] 0 2023-12-06T15:00:31.177 INFO:tasks.workunit.client.1.smithi190.stdout:3/803: creat d4/d1b/d54/d9c/d68/dfc/f11e x:0 0 0 2023-12-06T15:00:31.180 INFO:tasks.workunit.client.1.smithi190.stdout:1/978: rmdir d6/dc/d6f 39 2023-12-06T15:00:31.181 INFO:tasks.workunit.client.1.smithi190.stdout:6/804: rmdir d4/d12/d1a/d8a/da3 39 2023-12-06T15:00:31.183 INFO:tasks.workunit.client.1.smithi190.stdout:3/804: creat d4/d1b/d54/d9c/d68/f11f x:0 0 0 2023-12-06T15:00:31.184 INFO:tasks.workunit.client.1.smithi190.stdout:7/880: dread d0/df/f45 [0,4194304] 0 2023-12-06T15:00:31.184 INFO:tasks.workunit.client.1.smithi190.stdout:7/881: dread - d0/d88/d1c/d17/fca zero size 2023-12-06T15:00:31.184 INFO:tasks.workunit.client.1.smithi190.stdout:7/882: dread - d0/d88/d7a/dc9/f118 zero size 2023-12-06T15:00:31.184 INFO:tasks.workunit.client.1.smithi190.stdout:7/883: chown d0/cd 1124426773 1 2023-12-06T15:00:31.184 INFO:tasks.workunit.client.1.smithi190.stdout:1/979: creat d6/dc/d3b/d78/f137 x:0 0 0 2023-12-06T15:00:31.185 INFO:tasks.workunit.client.1.smithi190.stdout:1/980: write d6/dc/d29/f101 [899159,109492] 0 2023-12-06T15:00:31.185 INFO:tasks.workunit.client.1.smithi190.stdout:1/981: write d6/dc/d29/d38/d43/db7/fe5 [197321,23793] 0 2023-12-06T15:00:31.185 INFO:tasks.workunit.client.1.smithi190.stdout:6/805: creat d4/d12/d1a/d8a/da3/f109 x:0 0 0 2023-12-06T15:00:31.185 INFO:tasks.workunit.client.1.smithi190.stdout:6/806: fsync d4/d12/d40/d43/d45/d4a/f7e 0 2023-12-06T15:00:31.186 INFO:tasks.workunit.client.1.smithi190.stdout:3/805: getdents d4/d70/d19/d51/dab 0 2023-12-06T15:00:31.186 INFO:tasks.workunit.client.1.smithi190.stdout:3/806: fsync d4/d70/d33/d45/fef 0 2023-12-06T15:00:31.188 INFO:tasks.workunit.client.1.smithi190.stdout:7/884: creat d0/df/d53/d2f/de9/f11e x:0 0 0 2023-12-06T15:00:31.188 INFO:tasks.workunit.client.1.smithi190.stdout:7/885: write d0/df/d1f/dbd/f112 [304676,23472] 0 2023-12-06T15:00:31.188 INFO:tasks.workunit.client.1.smithi190.stdout:1/982: truncate d6/dc/d29/d38/d73/d76/d10c/f132 285229 0 2023-12-06T15:00:31.190 INFO:tasks.workunit.client.1.smithi190.stdout:6/807: creat d4/d12/f10a x:0 0 0 2023-12-06T15:00:31.190 INFO:tasks.workunit.client.1.smithi190.stdout:6/808: truncate d4/d12/d1a/d44/f108 151031 0 2023-12-06T15:00:31.191 INFO:tasks.workunit.client.1.smithi190.stdout:6/809: creat d4/d12/d40/d43/dba/dfe/f10b x:0 0 0 2023-12-06T15:00:31.192 INFO:tasks.workunit.client.1.smithi190.stdout:6/810: creat d4/d12/d40/d43/d45/dff/f10c x:0 0 0 2023-12-06T15:00:31.192 INFO:tasks.workunit.client.1.smithi190.stdout:6/811: dread - d4/d12/d1a/d32/dc7/dea/f106 zero size 2023-12-06T15:00:31.199 INFO:tasks.workunit.client.1.smithi190.stdout:1/983: dread d6/dc/f2e [0,4194304] 0 2023-12-06T15:00:31.199 INFO:tasks.workunit.client.1.smithi190.stdout:2/671: dwrite d10/d26/f27 [0,4194304] 0 2023-12-06T15:00:31.200 INFO:tasks.workunit.client.0.smithi152.stdout:1/759: dwrite d3/da/d15/d17/d1a/f5f [0,4194304] 0 2023-12-06T15:00:31.200 INFO:tasks.workunit.client.1.smithi190.stdout:1/984: mkdir d6/dc/d29/d38/d73/d76/d138 0 2023-12-06T15:00:31.205 INFO:tasks.workunit.client.1.smithi190.stdout:2/672: unlink d10/d59/dcd/dad/dc4/f89 0 2023-12-06T15:00:31.207 INFO:tasks.workunit.client.1.smithi190.stdout:1/985: creat d6/dc/d29/f139 x:0 0 0 2023-12-06T15:00:31.207 INFO:tasks.workunit.client.1.smithi190.stdout:1/986: chown d6/dc/d29/d38/d39/d63 5676 1 2023-12-06T15:00:31.207 INFO:tasks.workunit.client.1.smithi190.stdout:1/987: write d6/dc/d29/fea [1064431,97003] 0 2023-12-06T15:00:31.207 INFO:tasks.workunit.client.1.smithi190.stdout:1/988: read - d6/dc/d29/d38/d43/d7f/ff3 zero size 2023-12-06T15:00:31.207 INFO:tasks.workunit.client.1.smithi190.stdout:1/989: read d6/dc/d29/d38/d43/db7/fe5 [482277,124682] 0 2023-12-06T15:00:31.208 INFO:tasks.workunit.client.1.smithi190.stdout:2/673: getdents d10/d59/dcd 0 2023-12-06T15:00:31.208 INFO:tasks.workunit.client.1.smithi190.stdout:1/990: write d6/dc/d3b/d78/f9a [1162857,88684] 0 2023-12-06T15:00:31.208 INFO:tasks.workunit.client.1.smithi190.stdout:1/991: chown d6/dc/d29/d38/d73/c82 4 1 2023-12-06T15:00:31.208 INFO:tasks.workunit.client.1.smithi190.stdout:1/992: chown d6/dc/d29/d38/d73/d76/d10c/f132 5675 1 2023-12-06T15:00:31.209 INFO:tasks.workunit.client.1.smithi190.stdout:2/674: symlink d10/d59/dcd/dad/le5 0 2023-12-06T15:00:31.211 INFO:tasks.workunit.client.1.smithi190.stdout:1/993: rename d6/dc/d3b/d78/d94/c6d to d6/d49/d74/d12c/c13a 0 2023-12-06T15:00:31.213 INFO:tasks.workunit.client.0.smithi152.stdout:1/760: dwrite d3/da/fd1 [0,4194304] 0 2023-12-06T15:00:31.218 INFO:tasks.workunit.client.0.smithi152.stdout:0/514: sync 2023-12-06T15:00:31.218 INFO:tasks.workunit.client.0.smithi152.stdout:5/531: sync 2023-12-06T15:00:31.218 INFO:tasks.workunit.client.0.smithi152.stdout:3/522: sync 2023-12-06T15:00:31.218 INFO:tasks.workunit.client.0.smithi152.stdout:9/460: sync 2023-12-06T15:00:31.218 INFO:tasks.workunit.client.0.smithi152.stdout:4/676: sync 2023-12-06T15:00:31.218 INFO:tasks.workunit.client.0.smithi152.stdout:3/523: stat d9/d45/d9c 0 2023-12-06T15:00:31.219 INFO:tasks.workunit.client.0.smithi152.stdout:9/461: chown d0/d3f/d68/d6c/d20/d38/d45/f63 20246 1 2023-12-06T15:00:31.219 INFO:tasks.workunit.client.0.smithi152.stdout:4/677: chown d2/d15/f7f 9083825 1 2023-12-06T15:00:31.219 INFO:tasks.workunit.client.0.smithi152.stdout:4/678: readlink d2/d15/l34 0 2023-12-06T15:00:31.219 INFO:tasks.workunit.client.0.smithi152.stdout:7/405: sync 2023-12-06T15:00:31.219 INFO:tasks.workunit.client.0.smithi152.stdout:6/698: sync 2023-12-06T15:00:31.219 INFO:tasks.workunit.client.0.smithi152.stdout:2/405: sync 2023-12-06T15:00:31.219 INFO:tasks.workunit.client.0.smithi152.stdout:0/515: truncate d8/f17 2812359 0 2023-12-06T15:00:31.219 INFO:tasks.workunit.client.0.smithi152.stdout:0/516: write d8/d15/f8e [726148,71228] 0 2023-12-06T15:00:31.219 INFO:tasks.workunit.client.0.smithi152.stdout:0/517: chown d8/d15/d45/d73/d7a/f97 53 1 2023-12-06T15:00:31.222 INFO:tasks.workunit.client.0.smithi152.stdout:9/462: rmdir d0/d3f/d68/d6c/d20/d38/d44 39 2023-12-06T15:00:31.224 INFO:tasks.workunit.client.0.smithi152.stdout:5/532: dread d7/dd/d26/d3a/f6b [0,4194304] 0 2023-12-06T15:00:31.225 INFO:tasks.workunit.client.0.smithi152.stdout:3/524: creat d9/d18/d1a/fa4 x:0 0 0 2023-12-06T15:00:31.226 INFO:tasks.workunit.client.0.smithi152.stdout:3/525: chown d9/d18/d51 9 1 2023-12-06T15:00:31.226 INFO:tasks.workunit.client.0.smithi152.stdout:4/679: link d2/d15/d32/d79/l3d d2/d15/d32/d54/ld1 0 2023-12-06T15:00:31.226 INFO:tasks.workunit.client.0.smithi152.stdout:7/406: mknod dd/df/d1b/d20/d28/c7b 0 2023-12-06T15:00:31.226 INFO:tasks.workunit.client.0.smithi152.stdout:0/518: mknod d8/d15/d45/da2/ca7 0 2023-12-06T15:00:31.227 INFO:tasks.workunit.client.0.smithi152.stdout:5/533: mkdir d7/dd/d26/d87/dbd 0 2023-12-06T15:00:31.232 INFO:tasks.workunit.client.0.smithi152.stdout:4/680: symlink d2/d15/d32/ld2 0 2023-12-06T15:00:31.232 INFO:tasks.workunit.client.0.smithi152.stdout:4/681: dread - d2/d10/dbb/dca/dbc/d42/fc0 zero size 2023-12-06T15:00:31.233 INFO:tasks.workunit.client.0.smithi152.stdout:0/519: rename d8/d15/d45/d73/c96 to d8/d3e/d87/d76/d68/ca8 0 2023-12-06T15:00:31.235 INFO:tasks.workunit.client.0.smithi152.stdout:5/534: creat d7/dd/d26/d3b/fbe x:0 0 0 2023-12-06T15:00:31.235 INFO:tasks.workunit.client.0.smithi152.stdout:5/535: stat d7/d47 0 2023-12-06T15:00:31.235 INFO:tasks.workunit.client.0.smithi152.stdout:3/526: write d9/ff [2058451,110269] 0 2023-12-06T15:00:31.239 INFO:tasks.workunit.client.1.smithi190.stdout:7/886: dread d0/df/d53/d2f/de9/f49 [4194304,4194304] 0 2023-12-06T15:00:31.240 INFO:tasks.workunit.client.1.smithi190.stdout:6/812: dread d4/d12/d1a/d32/dc7/dd0/fd6 [0,4194304] 0 2023-12-06T15:00:31.242 INFO:tasks.workunit.client.1.smithi190.stdout:6/813: creat d4/d12/d1a/d70/f10d x:0 0 0 2023-12-06T15:00:31.243 INFO:tasks.workunit.client.1.smithi190.stdout:6/814: rmdir d4/d12/d1a/d70/da9 39 2023-12-06T15:00:31.245 INFO:tasks.workunit.client.0.smithi152.stdout:5/536: dread d7/dd/d26/d3b/d46/d7e/f88 [0,4194304] 0 2023-12-06T15:00:31.245 INFO:tasks.workunit.client.0.smithi152.stdout:5/537: dread - d7/d43/d6c/f94 zero size 2023-12-06T15:00:31.245 INFO:tasks.workunit.client.0.smithi152.stdout:5/538: chown d7/dd/d26/d48/fb3 6990445 1 2023-12-06T15:00:31.245 INFO:tasks.workunit.client.0.smithi152.stdout:5/539: dread - d7/dd/f7c zero size 2023-12-06T15:00:31.245 INFO:tasks.workunit.client.0.smithi152.stdout:5/540: write d7/dd/f2d [4645179,52685] 0 2023-12-06T15:00:31.245 INFO:tasks.workunit.client.0.smithi152.stdout:5/541: write d7/d43/d6c/faf [461123,44822] 0 2023-12-06T15:00:31.245 INFO:tasks.workunit.client.0.smithi152.stdout:5/542: fsync d7/dd/d26/d48/f86 0 2023-12-06T15:00:31.246 INFO:tasks.workunit.client.1.smithi190.stdout:1/994: write d6/d49/fe0 [2281296,41234] 0 2023-12-06T15:00:31.246 INFO:tasks.workunit.client.1.smithi190.stdout:1/995: chown d6/dc/d29/d38/d73/d76/fc3 28 1 2023-12-06T15:00:31.248 INFO:tasks.workunit.client.0.smithi152.stdout:6/699: write d1/dcf/ddc/d8a/f94 [574202,57663] 0 2023-12-06T15:00:31.248 INFO:tasks.workunit.client.0.smithi152.stdout:5/543: mknod d7/d43/d6c/d98/cbf 0 2023-12-06T15:00:31.248 INFO:tasks.workunit.client.0.smithi152.stdout:5/544: symlink d7/dd/d26/d3b/d46/lc0 0 2023-12-06T15:00:31.249 INFO:tasks.workunit.client.1.smithi190.stdout:1/996: creat d6/dc/d29/d38/d73/d5c/dd2/f13b x:0 0 0 2023-12-06T15:00:31.249 INFO:tasks.workunit.client.1.smithi190.stdout:1/997: chown d6/dc/d29/d38/d43/d7f/l133 1 1 2023-12-06T15:00:31.253 INFO:tasks.workunit.client.1.smithi190.stdout:1/998: getdents d6/dc/d3b/d78 0 2023-12-06T15:00:31.254 INFO:tasks.workunit.client.1.smithi190.stdout:1/999: symlink d6/dc/d29/d38/d43/l13c 0 2023-12-06T15:00:31.259 INFO:tasks.workunit.client.1.smithi190.stdout:0/723: dwrite d0/da/d3e/d2b/d37/f76 [0,4194304] 0 2023-12-06T15:00:31.260 INFO:tasks.workunit.client.0.smithi152.stdout:4/682: dread d2/d22/f76 [0,4194304] 0 2023-12-06T15:00:31.261 INFO:tasks.workunit.client.1.smithi190.stdout:6/815: dread d4/d12/d1a/d8a/fd4 [0,4194304] 0 2023-12-06T15:00:31.262 INFO:tasks.workunit.client.0.smithi152.stdout:4/683: symlink d2/d10/dbb/dca/dbc/ld3 0 2023-12-06T15:00:31.265 INFO:tasks.workunit.client.0.smithi152.stdout:4/684: creat d2/d10/dbb/dca/dbc/d42/dba/fd4 x:0 0 0 2023-12-06T15:00:31.266 INFO:tasks.workunit.client.0.smithi152.stdout:4/685: rmdir d2/d15/d32/d79 39 2023-12-06T15:00:31.266 INFO:tasks.workunit.client.0.smithi152.stdout:4/686: chown d2/d15/d32/d54/d85 164246997 1 2023-12-06T15:00:31.271 INFO:tasks.workunit.client.0.smithi152.stdout:5/545: dread d7/dd/f1c [0,4194304] 0 2023-12-06T15:00:31.271 INFO:tasks.workunit.client.0.smithi152.stdout:4/687: write d2/d22/f4a [984898,55827] 0 2023-12-06T15:00:31.271 INFO:tasks.workunit.client.0.smithi152.stdout:5/546: creat d7/dd/d26/d48/fc1 x:0 0 0 2023-12-06T15:00:31.272 INFO:tasks.workunit.client.0.smithi152.stdout:4/688: creat d2/d22/d6e/da8/fd5 x:0 0 0 2023-12-06T15:00:31.273 INFO:tasks.workunit.client.0.smithi152.stdout:4/689: chown d2/f72 60 1 2023-12-06T15:00:31.273 INFO:tasks.workunit.client.0.smithi152.stdout:4/690: chown d2/d15/d32/d79/l4f 11889591 1 2023-12-06T15:00:31.274 INFO:tasks.workunit.client.0.smithi152.stdout:4/691: creat d2/d45/d84/fd6 x:0 0 0 2023-12-06T15:00:31.275 INFO:tasks.workunit.client.1.smithi190.stdout:0/724: dread d0/da/d3e/d2b/d3c/d4c/f8b [0,4194304] 0 2023-12-06T15:00:31.275 INFO:tasks.workunit.client.1.smithi190.stdout:3/807: dwrite d4/d1b/d54/d9c/d68/dfc/d56/d94/d3d/fd0 [0,4194304] 0 2023-12-06T15:00:31.275 INFO:tasks.workunit.client.1.smithi190.stdout:0/725: chown d0/da/f44 184540 1 2023-12-06T15:00:31.275 INFO:tasks.workunit.client.1.smithi190.stdout:3/808: stat d4/d70/d19/d3a/d3b/d72/f86 0 2023-12-06T15:00:31.275 INFO:tasks.workunit.client.1.smithi190.stdout:9/868: dwrite f1 [0,4194304] 0 2023-12-06T15:00:31.276 INFO:tasks.workunit.client.0.smithi152.stdout:1/761: dwrite d3/da/d15/d17/f42 [0,4194304] 0 2023-12-06T15:00:31.276 INFO:tasks.workunit.client.0.smithi152.stdout:4/692: creat d2/d15/d32/d79/fd7 x:0 0 0 2023-12-06T15:00:31.277 INFO:tasks.workunit.client.1.smithi190.stdout:0/726: rmdir d0/da/d3e/d2b/d3c/d4c 39 2023-12-06T15:00:31.279 INFO:tasks.workunit.client.1.smithi190.stdout:3/809: creat d4/d1b/d54/d9c/d68/dfc/dc4/dce/f120 x:0 0 0 2023-12-06T15:00:31.279 INFO:tasks.workunit.client.1.smithi190.stdout:3/810: chown d4/d70/d19/c119 8066 1 2023-12-06T15:00:31.279 INFO:tasks.workunit.client.1.smithi190.stdout:3/811: truncate d4/d1b/f37 2060544 0 2023-12-06T15:00:31.280 INFO:tasks.workunit.client.1.smithi190.stdout:9/869: link d4/d84/f8f d4/d27/d2f/d31/d3f/d58/d72/db3/dea/dcd/f11a 0 2023-12-06T15:00:31.281 INFO:tasks.workunit.client.1.smithi190.stdout:3/812: creat d4/d1b/d54/f121 x:0 0 0 2023-12-06T15:00:31.286 INFO:tasks.workunit.client.0.smithi152.stdout:1/762: creat d3/da/d4c/d82/d52/d55/d110/f11c x:0 0 0 2023-12-06T15:00:31.286 INFO:tasks.workunit.client.0.smithi152.stdout:1/763: fdatasync d3/f1c 0 2023-12-06T15:00:31.286 INFO:tasks.workunit.client.0.smithi152.stdout:1/764: dread - d3/d44/f109 zero size 2023-12-06T15:00:31.287 INFO:tasks.workunit.client.1.smithi190.stdout:2/675: dwrite d10/d26/d5c/da5/fd9 [0,4194304] 0 2023-12-06T15:00:31.289 INFO:tasks.workunit.client.0.smithi152.stdout:6/700: dwrite d1/dcf/ddc/d1a/d30/d36/d35/d49/d6b/f95 [0,4194304] 0 2023-12-06T15:00:31.289 INFO:tasks.workunit.client.1.smithi190.stdout:6/816: dwrite d4/d12/d40/d43/d45/f60 [0,4194304] 0 2023-12-06T15:00:31.292 INFO:tasks.workunit.client.1.smithi190.stdout:7/887: dwrite d0/df/d53/f72 [0,4194304] 0 2023-12-06T15:00:31.293 INFO:tasks.workunit.client.0.smithi152.stdout:4/693: rename d2/d15/d32/d79/l44 to d2/d15/d32/d54/ld8 0 2023-12-06T15:00:31.293 INFO:tasks.workunit.client.0.smithi152.stdout:3/527: dwrite d9/d18/d1a/fa4 [0,4194304] 0 2023-12-06T15:00:31.293 INFO:tasks.workunit.client.0.smithi152.stdout:3/528: chown d9/d45/l60 1095464 1 2023-12-06T15:00:31.294 INFO:tasks.workunit.client.0.smithi152.stdout:3/529: stat d9/d18/d39/f4a 0 2023-12-06T15:00:31.294 INFO:tasks.workunit.client.0.smithi152.stdout:3/530: chown d9/d18/d51/d8d/f98 1781505584 1 2023-12-06T15:00:31.297 INFO:tasks.workunit.client.0.smithi152.stdout:9/463: dwrite d0/d3f/d68/d6c/d20/d38/d45/f64 [0,4194304] 0 2023-12-06T15:00:31.297 INFO:tasks.workunit.client.1.smithi190.stdout:3/813: dread d4/d1b/fd9 [0,4194304] 0 2023-12-06T15:00:31.298 INFO:tasks.workunit.client.1.smithi190.stdout:3/814: fsync d4/d1b/d54/d9c/d68/dfc/d56/d94/f91 0 2023-12-06T15:00:31.299 INFO:tasks.workunit.client.0.smithi152.stdout:6/701: getdents d1/d89 0 2023-12-06T15:00:31.299 INFO:tasks.workunit.client.0.smithi152.stdout:6/702: fsync d1/d89/ff2 0 2023-12-06T15:00:31.300 INFO:tasks.workunit.client.1.smithi190.stdout:2/676: rename d10/d59/ld4 to d10/d26/d5c/da5/le6 0 2023-12-06T15:00:31.300 INFO:tasks.workunit.client.0.smithi152.stdout:4/694: unlink d2/c5b 0 2023-12-06T15:00:31.300 INFO:tasks.workunit.client.0.smithi152.stdout:4/695: truncate d2/d10/dab/fbe 899746 0 2023-12-06T15:00:31.301 INFO:tasks.workunit.client.1.smithi190.stdout:7/888: mknod d0/df/d1f/dbd/c11f 0 2023-12-06T15:00:31.301 INFO:tasks.workunit.client.0.smithi152.stdout:5/547: getdents d7/dd/d26/d87 0 2023-12-06T15:00:31.301 INFO:tasks.workunit.client.0.smithi152.stdout:5/548: read d7/dd/d26/d3b/f6e [517136,40850] 0 2023-12-06T15:00:31.302 INFO:tasks.workunit.client.1.smithi190.stdout:3/815: unlink d4/d70/d19/d3a/laa 0 2023-12-06T15:00:31.302 INFO:tasks.workunit.client.1.smithi190.stdout:9/870: dwrite d4/d27/d2f/d31/d3f/d58/d72/db3/fd7 [0,4194304] 0 2023-12-06T15:00:31.303 INFO:tasks.workunit.client.1.smithi190.stdout:3/816: mkdir d4/d1b/d54/d9c/d68/dfc/d56/d122 0 2023-12-06T15:00:31.303 INFO:tasks.workunit.client.0.smithi152.stdout:3/531: truncate f7 1012447 0 2023-12-06T15:00:31.304 INFO:tasks.workunit.client.0.smithi152.stdout:3/532: stat d9/d18/d1a/l48 0 2023-12-06T15:00:31.305 INFO:tasks.workunit.client.1.smithi190.stdout:3/817: getdents d4/d1b/d54/d9c/d68/dfc/d56/d94 0 2023-12-06T15:00:31.308 INFO:tasks.workunit.client.0.smithi152.stdout:6/703: link d1/d69/da1/d87/f73 d1/d1c/ffe 0 2023-12-06T15:00:31.308 INFO:tasks.workunit.client.1.smithi190.stdout:3/818: symlink d4/d70/d19/l123 0 2023-12-06T15:00:31.312 INFO:tasks.workunit.client.0.smithi152.stdout:4/696: mkdir d2/d10/dab/dd9 0 2023-12-06T15:00:31.312 INFO:tasks.workunit.client.0.smithi152.stdout:5/549: mkdir d7/dd/d26/d48/d97/dc2 0 2023-12-06T15:00:31.313 INFO:tasks.workunit.client.0.smithi152.stdout:1/765: dwrite d3/d44/d84/fdb [0,4194304] 0 2023-12-06T15:00:31.313 INFO:tasks.workunit.client.0.smithi152.stdout:1/766: dread - d3/da/f105 zero size 2023-12-06T15:00:31.313 INFO:tasks.workunit.client.0.smithi152.stdout:3/533: rmdir d9/d18/d51/d8d 39 2023-12-06T15:00:31.315 INFO:tasks.workunit.client.1.smithi190.stdout:2/677: dread d10/d59/d5e/f47 [0,4194304] 0 2023-12-06T15:00:31.315 INFO:tasks.workunit.client.0.smithi152.stdout:9/464: dread d0/d50/f6d [0,4194304] 0 2023-12-06T15:00:31.315 INFO:tasks.workunit.client.1.smithi190.stdout:2/678: rmdir d10/d59/dcd/dad/dc4 39 2023-12-06T15:00:31.316 INFO:tasks.workunit.client.0.smithi152.stdout:6/704: creat d1/dcf/ddc/d1a/d30/fff x:0 0 0 2023-12-06T15:00:31.317 INFO:tasks.workunit.client.1.smithi190.stdout:2/679: rmdir d10/d26/d5c/d35 39 2023-12-06T15:00:31.317 INFO:tasks.workunit.client.1.smithi190.stdout:2/680: fsync d10/d59/d5e/f25 0 2023-12-06T15:00:31.318 INFO:tasks.workunit.client.0.smithi152.stdout:4/697: getdents d2/d22/d6e/da8 0 2023-12-06T15:00:31.318 INFO:tasks.workunit.client.0.smithi152.stdout:4/698: fdatasync d2/d10/dbb/dca/dbc/d75/f98 0 2023-12-06T15:00:31.318 INFO:tasks.workunit.client.0.smithi152.stdout:4/699: chown d2/d22/d6e/fac 20 1 2023-12-06T15:00:31.318 INFO:tasks.workunit.client.0.smithi152.stdout:4/700: chown d2/d45/f6b 1 1 2023-12-06T15:00:31.318 INFO:tasks.workunit.client.0.smithi152.stdout:4/701: write d2/d22/d6e/fac [940316,77260] 0 2023-12-06T15:00:31.319 INFO:tasks.workunit.client.1.smithi190.stdout:2/681: mknod d10/ce7 0 2023-12-06T15:00:31.319 INFO:tasks.workunit.client.1.smithi190.stdout:2/682: chown d10/d26/f27 1 1 2023-12-06T15:00:31.319 INFO:tasks.workunit.client.0.smithi152.stdout:5/550: creat d7/dd/d4e/fc3 x:0 0 0 2023-12-06T15:00:31.320 INFO:tasks.workunit.client.0.smithi152.stdout:6/705: write d1/d69/da1/d87/d15/f1d [4519591,83313] 0 2023-12-06T15:00:31.320 INFO:tasks.workunit.client.0.smithi152.stdout:6/706: fdatasync d1/d75/f81 0 2023-12-06T15:00:31.321 INFO:tasks.workunit.client.0.smithi152.stdout:1/767: creat d3/da/d4c/d63/d96/dd8/f11d x:0 0 0 2023-12-06T15:00:31.322 INFO:tasks.workunit.client.0.smithi152.stdout:3/534: creat d9/d18/d1a/d77/d91/fa5 x:0 0 0 2023-12-06T15:00:31.322 INFO:tasks.workunit.client.0.smithi152.stdout:3/535: write d9/d18/d1a/d77/f8c [330086,55401] 0 2023-12-06T15:00:31.323 INFO:tasks.workunit.client.0.smithi152.stdout:3/536: write d9/d18/d39/f4a [927936,134] 0 2023-12-06T15:00:31.323 INFO:tasks.workunit.client.1.smithi190.stdout:5/662: sync 2023-12-06T15:00:31.323 INFO:tasks.workunit.client.1.smithi190.stdout:5/663: fdatasync d0/d1c/d3e/d7e/f92 0 2023-12-06T15:00:31.323 INFO:tasks.workunit.client.1.smithi190.stdout:2/683: write d10/d26/d5c/d35/f68 [3256229,114900] 0 2023-12-06T15:00:31.324 INFO:tasks.workunit.client.1.smithi190.stdout:9/871: dwrite d4/d27/d2f/d31/d3f/d58/d7d/f9f [0,4194304] 0 2023-12-06T15:00:31.324 INFO:tasks.workunit.client.1.smithi190.stdout:9/872: write d4/d27/d2f/d5c/ffe [1001351,126220] 0 2023-12-06T15:00:31.324 INFO:tasks.workunit.client.1.smithi190.stdout:7/889: dwrite d0/d88/d1c/d17/fca [0,4194304] 0 2023-12-06T15:00:31.325 INFO:tasks.workunit.client.0.smithi152.stdout:9/465: symlink d0/d3f/d68/d6c/d20/d4a/l7e 0 2023-12-06T15:00:31.325 INFO:tasks.workunit.client.1.smithi190.stdout:8/713: sync 2023-12-06T15:00:31.326 INFO:tasks.workunit.client.1.smithi190.stdout:2/684: rename d10/d26/d5c/f43 to d10/d26/d8a/fe8 0 2023-12-06T15:00:31.326 INFO:tasks.workunit.client.1.smithi190.stdout:2/685: chown d10/d26/d5c/d35/d77/l7a 562 1 2023-12-06T15:00:31.326 INFO:tasks.workunit.client.0.smithi152.stdout:4/702: getdents d2/d22/d6e 0 2023-12-06T15:00:31.326 INFO:tasks.workunit.client.0.smithi152.stdout:4/703: chown d2/d45/fc4 0 1 2023-12-06T15:00:31.327 INFO:tasks.workunit.client.0.smithi152.stdout:5/551: truncate d7/dd/f2a 3007180 0 2023-12-06T15:00:31.329 INFO:tasks.workunit.client.0.smithi152.stdout:6/707: symlink d1/dcf/ddc/d1a/d30/d36/d35/d49/d57/l100 0 2023-12-06T15:00:31.329 INFO:tasks.workunit.client.0.smithi152.stdout:6/708: dread - d1/dcf/ddc/d1a/d30/d36/d35/d49/d57/f68 zero size 2023-12-06T15:00:31.329 INFO:tasks.workunit.client.0.smithi152.stdout:8/393: sync 2023-12-06T15:00:31.329 INFO:tasks.workunit.client.0.smithi152.stdout:8/394: fdatasync d1/d6/d34/d36/f4f 0 2023-12-06T15:00:31.330 INFO:tasks.workunit.client.0.smithi152.stdout:1/768: write d3/da/db/d54/f6a [467859,64881] 0 2023-12-06T15:00:31.330 INFO:tasks.workunit.client.0.smithi152.stdout:9/466: mknod d0/d3f/c7f 0 2023-12-06T15:00:31.330 INFO:tasks.workunit.client.0.smithi152.stdout:9/467: stat d0/d3f/d68/d6c/d20/d38/f3d 0 2023-12-06T15:00:31.331 INFO:tasks.workunit.client.1.smithi190.stdout:7/890: mkdir d0/df/df8/d108/d120 0 2023-12-06T15:00:31.331 INFO:tasks.workunit.client.0.smithi152.stdout:6/709: write d1/d69/da1/d87/fb [7543754,130513] 0 2023-12-06T15:00:31.331 INFO:tasks.workunit.client.1.smithi190.stdout:8/714: mkdir d1/dd3 0 2023-12-06T15:00:31.332 INFO:tasks.workunit.client.1.smithi190.stdout:8/715: chown d1/d20/d3b/d7e/dd0/f91 12 1 2023-12-06T15:00:31.332 INFO:tasks.workunit.client.0.smithi152.stdout:4/704: rmdir d2/d15/d32/d91 39 2023-12-06T15:00:31.333 INFO:tasks.workunit.client.1.smithi190.stdout:5/664: dread d0/d1c/f36 [0,4194304] 0 2023-12-06T15:00:31.333 INFO:tasks.workunit.client.1.smithi190.stdout:5/665: fdatasync d0/d1c/d85/f91 0 2023-12-06T15:00:31.334 INFO:tasks.workunit.client.1.smithi190.stdout:9/873: rename d4/c16 to d4/d27/d2f/c11b 0 2023-12-06T15:00:31.334 INFO:tasks.workunit.client.1.smithi190.stdout:5/666: write d0/d1c/d3e/f77 [12423,85033] 0 2023-12-06T15:00:31.335 INFO:tasks.workunit.client.1.smithi190.stdout:2/686: mknod d10/d59/ce9 0 2023-12-06T15:00:31.336 INFO:tasks.workunit.client.0.smithi152.stdout:8/395: symlink d1/d6/d34/d40/l7c 0 2023-12-06T15:00:31.336 INFO:tasks.workunit.client.0.smithi152.stdout:8/396: stat d1/d6/d34/c53 0 2023-12-06T15:00:31.337 INFO:tasks.workunit.client.0.smithi152.stdout:1/769: truncate d3/d44/d84/fe3 109013 0 2023-12-06T15:00:31.339 INFO:tasks.workunit.client.1.smithi190.stdout:7/891: creat d0/d5/f121 x:0 0 0 2023-12-06T15:00:31.339 INFO:tasks.workunit.client.1.smithi190.stdout:7/892: readlink d0/df/d53/d2f/de9/l47 0 2023-12-06T15:00:31.339 INFO:tasks.workunit.client.1.smithi190.stdout:7/893: readlink d0/d88/d7a/d7c/dab/dc0/l104 0 2023-12-06T15:00:31.339 INFO:tasks.workunit.client.0.smithi152.stdout:9/468: dread d0/f15 [0,4194304] 0 2023-12-06T15:00:31.339 INFO:tasks.workunit.client.1.smithi190.stdout:8/716: creat d1/d20/fd4 x:0 0 0 2023-12-06T15:00:31.340 INFO:tasks.workunit.client.1.smithi190.stdout:5/667: mkdir d0/deb 0 2023-12-06T15:00:31.342 INFO:tasks.workunit.client.1.smithi190.stdout:2/687: rename d10/d26/d5c/d49/d54/l99 to d10/d26/d5c/d35/dd8/lea 0 2023-12-06T15:00:31.343 INFO:tasks.workunit.client.1.smithi190.stdout:8/717: truncate d1/d20/d3b/f2d 2149086 0 2023-12-06T15:00:31.343 INFO:tasks.workunit.client.1.smithi190.stdout:8/718: stat d1/d20/d3b/d4c/d8e 0 2023-12-06T15:00:31.343 INFO:tasks.workunit.client.0.smithi152.stdout:4/705: mknod d2/d15/d32/dd0/cda 0 2023-12-06T15:00:31.344 INFO:tasks.workunit.client.0.smithi152.stdout:4/706: readlink d2/d15/l5f 0 2023-12-06T15:00:31.345 INFO:tasks.workunit.client.1.smithi190.stdout:5/668: rename d0/d6c/fa1 to d0/d96/fec 0 2023-12-06T15:00:31.345 INFO:tasks.workunit.client.1.smithi190.stdout:5/669: chown d0/d1c/d3e/l52 367299 1 2023-12-06T15:00:31.345 INFO:tasks.workunit.client.1.smithi190.stdout:8/719: getdents d1/d20/d3b/d7e 0 2023-12-06T15:00:31.345 INFO:tasks.workunit.client.1.smithi190.stdout:8/720: fdatasync d1/d37/f73 0 2023-12-06T15:00:31.345 INFO:tasks.workunit.client.1.smithi190.stdout:8/721: fsync d1/d20/d3b/d36/d50/f83 0 2023-12-06T15:00:31.346 INFO:tasks.workunit.client.0.smithi152.stdout:1/770: symlink d3/da/d15/d17/d1a/l11e 0 2023-12-06T15:00:31.347 INFO:tasks.workunit.client.1.smithi190.stdout:2/688: rename d10/d59/dcd/dad/dc4/f80 to d10/d59/dcd/dad/feb 0 2023-12-06T15:00:31.347 INFO:tasks.workunit.client.1.smithi190.stdout:5/670: mknod d0/d1c/d2b/d8b/ced 0 2023-12-06T15:00:31.348 INFO:tasks.workunit.client.1.smithi190.stdout:5/671: truncate d0/d1c/d2b/fb8 775341 0 2023-12-06T15:00:31.348 INFO:tasks.workunit.client.1.smithi190.stdout:5/672: readlink d0/d1c/d94/lc8 0 2023-12-06T15:00:31.348 INFO:tasks.workunit.client.0.smithi152.stdout:9/469: symlink d0/d3f/d68/d6c/l80 0 2023-12-06T15:00:31.348 INFO:tasks.workunit.client.1.smithi190.stdout:5/673: stat d0/d1c/d2b/d2c/d5d/d73/l71 0 2023-12-06T15:00:31.349 INFO:tasks.workunit.client.1.smithi190.stdout:5/674: mknod d0/d1c/d3e/dea/cee 0 2023-12-06T15:00:31.349 INFO:tasks.workunit.client.1.smithi190.stdout:7/894: dread d0/df/d53/f72 [0,4194304] 0 2023-12-06T15:00:31.349 INFO:tasks.workunit.client.1.smithi190.stdout:8/722: write d1/d20/d3b/d36/f3c [2419678,88892] 0 2023-12-06T15:00:31.350 INFO:tasks.workunit.client.1.smithi190.stdout:5/675: creat d0/df/d50/d9c/fef x:0 0 0 2023-12-06T15:00:31.350 INFO:tasks.workunit.client.0.smithi152.stdout:4/707: mkdir d2/d10/dc8/ddb 0 2023-12-06T15:00:31.350 INFO:tasks.workunit.client.0.smithi152.stdout:4/708: readlink d2/l1c 0 2023-12-06T15:00:31.350 INFO:tasks.workunit.client.1.smithi190.stdout:7/895: rmdir d0/d88/d41/df4 39 2023-12-06T15:00:31.351 INFO:tasks.workunit.client.0.smithi152.stdout:8/397: symlink d1/l7d 0 2023-12-06T15:00:31.352 INFO:tasks.workunit.client.1.smithi190.stdout:8/723: creat d1/fd5 x:0 0 0 2023-12-06T15:00:31.352 INFO:tasks.workunit.client.1.smithi190.stdout:7/896: mkdir d0/d88/d1c/d122 0 2023-12-06T15:00:31.353 INFO:tasks.workunit.client.1.smithi190.stdout:8/724: stat d1/d20/d3b/d36/l65 0 2023-12-06T15:00:31.354 INFO:tasks.workunit.client.0.smithi152.stdout:9/470: symlink d0/d3f/d68/d6c/d20/d38/d45/d43/l81 0 2023-12-06T15:00:31.354 INFO:tasks.workunit.client.0.smithi152.stdout:9/471: chown d0/d3f/d68/d6c/d20/d38/d44/f77 5928 1 2023-12-06T15:00:31.354 INFO:tasks.workunit.client.0.smithi152.stdout:9/472: write d0/d3f/d68/d6c/d20/d38/f3d [1048228,30049] 0 2023-12-06T15:00:31.354 INFO:tasks.workunit.client.0.smithi152.stdout:9/473: truncate d0/d3f/d68/d6c/f2f 1045429 0 2023-12-06T15:00:31.364 INFO:tasks.workunit.client.0.smithi152.stdout:8/398: truncate d1/d6/d34/d35/d38/f41 997949 0 2023-12-06T15:00:31.364 INFO:tasks.workunit.client.0.smithi152.stdout:8/399: rename d1 to d1/d6/d29/d5b/d7e 22 2023-12-06T15:00:31.364 INFO:tasks.workunit.client.0.smithi152.stdout:9/474: mknod d0/d3f/d68/d6c/c82 0 2023-12-06T15:00:31.366 INFO:tasks.workunit.client.0.smithi152.stdout:8/400: unlink d1/d6/d34/f1a 0 2023-12-06T15:00:31.366 INFO:tasks.workunit.client.0.smithi152.stdout:8/401: readlink d1/d6/d34/l18 0 2023-12-06T15:00:31.373 INFO:tasks.workunit.client.1.smithi190.stdout:7/897: dread d0/d5/f8 [0,4194304] 0 2023-12-06T15:00:31.373 INFO:tasks.workunit.client.1.smithi190.stdout:7/898: fdatasync d0/df/d53/d15/f8d 0 2023-12-06T15:00:31.375 INFO:tasks.workunit.client.1.smithi190.stdout:7/899: creat d0/df/df8/d108/f123 x:0 0 0 2023-12-06T15:00:31.376 INFO:tasks.workunit.client.1.smithi190.stdout:7/900: truncate d0/df/d1f/f58 963437 0 2023-12-06T15:00:31.377 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:31 smithi152 ceph-mon[111954]: pgmap v27: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 154 MiB/s rd, 313 MiB/s wr, 509 op/s 2023-12-06T15:00:31.378 INFO:tasks.workunit.client.1.smithi190.stdout:7/901: link d0/df/d53/d2f/fee d0/df/d53/d2f/f124 0 2023-12-06T15:00:31.394 INFO:tasks.workunit.client.1.smithi190.stdout:5/676: dwrite d0/d1c/f98 [4194304,4194304] 0 2023-12-06T15:00:31.394 INFO:tasks.workunit.client.1.smithi190.stdout:5/677: chown d0/d1c/d85/d90/dba/fc1 620931664 1 2023-12-06T15:00:31.395 INFO:tasks.workunit.client.0.smithi152.stdout:4/709: dwrite d2/d15/d32/d79/f82 [0,4194304] 0 2023-12-06T15:00:31.396 INFO:tasks.workunit.client.1.smithi190.stdout:5/678: rmdir d0/d6c/dcd 39 2023-12-06T15:00:31.410 INFO:tasks.workunit.client.0.smithi152.stdout:4/710: dread d2/d22/d6e/fac [0,4194304] 0 2023-12-06T15:00:31.411 INFO:tasks.workunit.client.0.smithi152.stdout:4/711: stat d2/d22/d6e/lad 0 2023-12-06T15:00:31.416 INFO:tasks.workunit.client.1.smithi190.stdout:5/679: dwrite d0/d6c/da7/fbb [0,4194304] 0 2023-12-06T15:00:31.417 INFO:tasks.workunit.client.1.smithi190.stdout:5/680: write d0/df/d50/f75 [1564093,52920] 0 2023-12-06T15:00:31.417 INFO:tasks.workunit.client.1.smithi190.stdout:5/681: write d0/d1c/d2b/fc2 [569090,68154] 0 2023-12-06T15:00:31.419 INFO:tasks.workunit.client.1.smithi190.stdout:5/682: symlink d0/d1c/d2b/d2c/lf0 0 2023-12-06T15:00:31.420 INFO:tasks.workunit.client.0.smithi152.stdout:1/771: dread d3/da/d15/d17/d43/d7d/f98 [0,4194304] 0 2023-12-06T15:00:31.421 INFO:tasks.workunit.client.0.smithi152.stdout:1/772: readlink d3/da/d15/l90 0 2023-12-06T15:00:31.422 INFO:tasks.workunit.client.0.smithi152.stdout:1/773: truncate d3/da/d4c/d82/f31 951039 0 2023-12-06T15:00:31.422 INFO:tasks.workunit.client.1.smithi190.stdout:5/683: write d0/d6c/f8c [102480,44169] 0 2023-12-06T15:00:31.423 INFO:tasks.workunit.client.1.smithi190.stdout:5/684: chown d0/d1c/d85/d90/d99/fa3 28971421 1 2023-12-06T15:00:31.423 INFO:tasks.workunit.client.1.smithi190.stdout:5/685: chown d0/d6c/f8c 3105 1 2023-12-06T15:00:31.424 INFO:tasks.workunit.client.0.smithi152.stdout:6/710: rmdir d1/dcf/ddc/d1a/d30/d36 39 2023-12-06T15:00:31.424 INFO:tasks.workunit.client.1.smithi190.stdout:5/686: dread d0/df/f41 [0,4194304] 0 2023-12-06T15:00:31.424 INFO:tasks.workunit.client.0.smithi152.stdout:6/711: write d1/d69/da1/f9e [77960,81217] 0 2023-12-06T15:00:31.428 INFO:tasks.workunit.client.1.smithi190.stdout:5/687: read d0/df/f56 [2233601,96621] 0 2023-12-06T15:00:31.430 INFO:tasks.workunit.client.1.smithi190.stdout:5/688: creat d0/d1c/d94/ff1 x:0 0 0 2023-12-06T15:00:31.430 INFO:tasks.workunit.client.1.smithi190.stdout:5/689: write d0/d1c/d2b/fe3 [584910,121873] 0 2023-12-06T15:00:31.430 INFO:tasks.workunit.client.0.smithi152.stdout:6/712: write d1/d69/da1/d87/f9 [1885193,105940] 0 2023-12-06T15:00:31.430 INFO:tasks.workunit.client.0.smithi152.stdout:6/713: fdatasync d1/dcf/ddc/d1a/d30/d36/d35/d49/d57/f68 0 2023-12-06T15:00:31.431 INFO:tasks.workunit.client.1.smithi190.stdout:5/690: link d0/ca d0/d1c/d85/d90/d99/cf2 0 2023-12-06T15:00:31.432 INFO:tasks.workunit.client.1.smithi190.stdout:5/691: mkdir d0/d6c/da7/df3 0 2023-12-06T15:00:31.434 INFO:tasks.workunit.client.0.smithi152.stdout:6/714: mkdir d1/dcf/ddc/d1a/d30/d36/d4e/d101 0 2023-12-06T15:00:31.434 INFO:tasks.workunit.client.1.smithi190.stdout:5/692: creat d0/d1c/ff4 x:0 0 0 2023-12-06T15:00:31.434 INFO:tasks.workunit.client.1.smithi190.stdout:5/693: write d0/df/d50/fad [850708,83873] 0 2023-12-06T15:00:31.434 INFO:tasks.workunit.client.1.smithi190.stdout:5/694: chown d0/d1c/d2b/d2c/d5d/d73/cbc 811590 1 2023-12-06T15:00:31.434 INFO:tasks.workunit.client.1.smithi190.stdout:5/695: chown d0/d1c/ff4 12042 1 2023-12-06T15:00:31.434 INFO:tasks.workunit.client.1.smithi190.stdout:5/696: fsync d0/d1c/d85/f91 0 2023-12-06T15:00:31.446 INFO:tasks.workunit.client.1.smithi190.stdout:9/874: dwrite d4/d27/d2f/d5c/fb2 [0,4194304] 0 2023-12-06T15:00:31.454 INFO:tasks.workunit.client.1.smithi190.stdout:9/875: truncate d4/d27/f6a 1999709 0 2023-12-06T15:00:31.455 INFO:tasks.workunit.client.1.smithi190.stdout:9/876: creat d4/d27/d2f/d5c/d9d/f11c x:0 0 0 2023-12-06T15:00:31.455 INFO:tasks.workunit.client.1.smithi190.stdout:9/877: mknod d4/d27/d2f/d31/d3f/d58/d72/db3/dea/c11d 0 2023-12-06T15:00:31.458 INFO:tasks.workunit.client.1.smithi190.stdout:9/878: link d4/d27/d2f/d31/d3f/d58/fa3 d4/d27/d2f/d31/d3f/d58/d72/d7a/f11e 0 2023-12-06T15:00:31.458 INFO:tasks.workunit.client.1.smithi190.stdout:9/879: stat d4/d27/d2f/d31/d3f/d58/d72/db3/dea/dcd/dff/f109 0 2023-12-06T15:00:31.459 INFO:tasks.workunit.client.1.smithi190.stdout:9/880: symlink d4/d27/d8a/dbc/l11f 0 2023-12-06T15:00:31.459 INFO:tasks.workunit.client.1.smithi190.stdout:9/881: dread - d4/d27/d2f/f102 zero size 2023-12-06T15:00:31.460 INFO:tasks.workunit.client.1.smithi190.stdout:9/882: readlink d4/d84/dda/lf7 0 2023-12-06T15:00:31.460 INFO:tasks.workunit.client.1.smithi190.stdout:9/883: rename d4/d27/d8a/fb1 to d4/d84/dda/f120 0 2023-12-06T15:00:31.460 INFO:tasks.workunit.client.1.smithi190.stdout:9/884: chown d4/d27/d2f/d5c/f6c 219885777 1 2023-12-06T15:00:31.461 INFO:tasks.workunit.client.1.smithi190.stdout:9/885: stat d4/f25 0 2023-12-06T15:00:31.462 INFO:tasks.workunit.client.1.smithi190.stdout:9/886: getdents d4/d84 0 2023-12-06T15:00:31.462 INFO:tasks.workunit.client.1.smithi190.stdout:2/689: dwrite d10/fd3 [0,4194304] 0 2023-12-06T15:00:31.462 INFO:tasks.workunit.client.1.smithi190.stdout:2/690: truncate d10/d26/d5c/d42/d9d/fe1 407973 0 2023-12-06T15:00:31.462 INFO:tasks.workunit.client.1.smithi190.stdout:2/691: write d10/d26/d5c/d49/f6f [1148442,123315] 0 2023-12-06T15:00:31.462 INFO:tasks.workunit.client.1.smithi190.stdout:8/725: dwrite d1/d20/d3b/fb9 [0,4194304] 0 2023-12-06T15:00:31.463 INFO:tasks.workunit.client.0.smithi152.stdout:5/552: dwrite d7/dd/f2a [0,4194304] 0 2023-12-06T15:00:31.463 INFO:tasks.workunit.client.0.smithi152.stdout:4/712: dwrite d2/d15/d32/f6a [0,4194304] 0 2023-12-06T15:00:31.463 INFO:tasks.workunit.client.0.smithi152.stdout:4/713: readlink d2/d22/d6e/lad 0 2023-12-06T15:00:31.465 INFO:tasks.workunit.client.0.smithi152.stdout:4/714: write d2/d10/dbb/dca/dcb/f71 [8090192,114237] 0 2023-12-06T15:00:31.465 INFO:tasks.workunit.client.0.smithi152.stdout:5/553: mkdir d7/dd/d26/d87/dc4 0 2023-12-06T15:00:31.466 INFO:tasks.workunit.client.0.smithi152.stdout:5/554: fdatasync d7/dd/d4e/f55 0 2023-12-06T15:00:31.466 INFO:tasks.workunit.client.0.smithi152.stdout:8/402: rmdir d1/d6 39 2023-12-06T15:00:31.466 INFO:tasks.workunit.client.0.smithi152.stdout:8/403: chown d1/d6/d29/d75 3 1 2023-12-06T15:00:31.467 INFO:tasks.workunit.client.1.smithi190.stdout:2/692: symlink d10/d26/d5c/d42/lec 0 2023-12-06T15:00:31.467 INFO:tasks.workunit.client.1.smithi190.stdout:7/902: dwrite d0/d88/d1c/d17/f64 [0,4194304] 0 2023-12-06T15:00:31.467 INFO:tasks.workunit.client.1.smithi190.stdout:7/903: write d0/f7b [4565805,58779] 0 2023-12-06T15:00:31.467 INFO:tasks.workunit.client.0.smithi152.stdout:5/555: write d7/f28 [110981,93786] 0 2023-12-06T15:00:31.468 INFO:tasks.workunit.client.0.smithi152.stdout:6/715: dwrite d1/dcf/ddc/d1a/d30/d36/f64 [0,4194304] 0 2023-12-06T15:00:31.468 INFO:tasks.workunit.client.0.smithi152.stdout:6/716: fsync d1/dcf/ddc/d1a/d30/d36/d35/d61/fc9 0 2023-12-06T15:00:31.468 INFO:tasks.workunit.client.0.smithi152.stdout:1/774: dwrite d3/da/d4c/d82/d52/fd7 [0,4194304] 0 2023-12-06T15:00:31.468 INFO:tasks.workunit.client.0.smithi152.stdout:4/715: rmdir d2/d15/d32/d69/d6f/d6c 39 2023-12-06T15:00:31.468 INFO:tasks.workunit.client.0.smithi152.stdout:4/716: fdatasync d2/d45/f4e 0 2023-12-06T15:00:31.468 INFO:tasks.workunit.client.1.smithi190.stdout:9/887: dread d4/d27/d2f/d31/d3f/d58/d72/db3/dea/dcd/dff/f6e [0,4194304] 0 2023-12-06T15:00:31.469 INFO:tasks.workunit.client.1.smithi190.stdout:8/726: rename d1/d20/d3b/d4c/d8e/d94/d1c/f22 to d1/d20/d3b/d4c/d59/fd6 0 2023-12-06T15:00:31.469 INFO:tasks.workunit.client.0.smithi152.stdout:8/404: rename d1/d6/c63 to d1/d6/d29/d74/c7f 0 2023-12-06T15:00:31.472 INFO:tasks.workunit.client.0.smithi152.stdout:5/556: mknod d7/d43/d6c/da4/cc5 0 2023-12-06T15:00:31.472 INFO:tasks.workunit.client.0.smithi152.stdout:5/557: dread - d7/dd/d26/d3b/fa1 zero size 2023-12-06T15:00:31.472 INFO:tasks.workunit.client.1.smithi190.stdout:2/693: mkdir d10/d26/d5c/da5/ded 0 2023-12-06T15:00:31.472 INFO:tasks.workunit.client.1.smithi190.stdout:2/694: fdatasync d10/fd3 0 2023-12-06T15:00:31.472 INFO:tasks.workunit.client.1.smithi190.stdout:2/695: dread - d10/d26/d5c/d49/f92 zero size 2023-12-06T15:00:31.472 INFO:tasks.workunit.client.1.smithi190.stdout:2/696: fdatasync d10/d26/d5c/d49/f55 0 2023-12-06T15:00:31.474 INFO:tasks.workunit.client.1.smithi190.stdout:7/904: mknod d0/df/d1f/dfa/c125 0 2023-12-06T15:00:31.474 INFO:tasks.workunit.client.1.smithi190.stdout:7/905: fdatasync d0/d88/d33/f80 0 2023-12-06T15:00:31.475 INFO:tasks.workunit.client.0.smithi152.stdout:1/775: getdents d3/da/d4c/d82/d52/d62/dcc 0 2023-12-06T15:00:31.475 INFO:tasks.workunit.client.0.smithi152.stdout:6/717: rename d1/d69/da1/deb/fb1 to d1/d89/f102 0 2023-12-06T15:00:31.476 INFO:tasks.workunit.client.0.smithi152.stdout:6/718: read d1/dcf/ddc/d1a/d30/daa/ff5 [345758,33380] 0 2023-12-06T15:00:31.476 INFO:tasks.workunit.client.0.smithi152.stdout:8/405: symlink d1/d6/l80 0 2023-12-06T15:00:31.477 INFO:tasks.workunit.client.0.smithi152.stdout:6/719: stat d1/dcf/ddc/d1a/d30/d36/d35/d63/cf3 0 2023-12-06T15:00:31.478 INFO:tasks.workunit.client.0.smithi152.stdout:8/406: mknod d1/d6/d34/d36/d58/c81 0 2023-12-06T15:00:31.479 INFO:tasks.workunit.client.0.smithi152.stdout:8/407: getdents d1/d6/d34/d6f 0 2023-12-06T15:00:31.501 INFO:tasks.workunit.client.0.smithi152.stdout:5/558: write d7/dd/f2d [763442,70457] 0 2023-12-06T15:00:31.501 INFO:tasks.workunit.client.0.smithi152.stdout:4/717: dwrite d2/d89/fa3 [0,4194304] 0 2023-12-06T15:00:31.501 INFO:tasks.workunit.client.0.smithi152.stdout:4/718: truncate d2/d10/dbb/dca/dbc/d42/fb8 747901 0 2023-12-06T15:00:31.501 INFO:tasks.workunit.client.0.smithi152.stdout:4/719: chown d2/f8 655383113 1 2023-12-06T15:00:31.501 INFO:tasks.workunit.client.0.smithi152.stdout:6/720: dwrite d1/d1c/ffe [0,4194304] 0 2023-12-06T15:00:31.502 INFO:tasks.workunit.client.1.smithi190.stdout:9/888: truncate d4/f2d 399955 0 2023-12-06T15:00:31.502 INFO:tasks.workunit.client.1.smithi190.stdout:8/727: symlink d1/d20/d3b/d4c/d8e/d94/db6/ld7 0 2023-12-06T15:00:31.504 INFO:tasks.workunit.client.1.smithi190.stdout:2/697: mkdir d10/d59/dcd/dad/dc4/d7f/d8e/dee 0 2023-12-06T15:00:31.506 INFO:tasks.workunit.client.1.smithi190.stdout:5/697: getdents d0/d1c/d2b/d2c 0 2023-12-06T15:00:31.506 INFO:tasks.workunit.client.1.smithi190.stdout:7/906: mkdir d0/d35/d8e/d126 0 2023-12-06T15:00:31.507 INFO:tasks.workunit.client.0.smithi152.stdout:5/559: mknod d7/dd/d26/d3b/d46/cc6 0 2023-12-06T15:00:31.508 INFO:tasks.workunit.client.0.smithi152.stdout:5/560: fdatasync d7/f24 0 2023-12-06T15:00:31.510 INFO:tasks.workunit.client.1.smithi190.stdout:8/728: mkdir d1/d20/d3b/d7e/dd0/dd8 0 2023-12-06T15:00:31.510 INFO:tasks.workunit.client.1.smithi190.stdout:8/729: chown d1/d20/d3b/d4c/d8e/d94/d1c/f64 1 1 2023-12-06T15:00:31.512 INFO:tasks.workunit.client.1.smithi190.stdout:2/698: unlink d10/d26/d5c/d35/f87 0 2023-12-06T15:00:31.513 INFO:tasks.workunit.client.1.smithi190.stdout:7/907: dread d0/d88/d7a/fd2 [0,4194304] 0 2023-12-06T15:00:31.514 INFO:tasks.workunit.client.1.smithi190.stdout:5/698: mkdir d0/d1c/d3e/dea/df5 0 2023-12-06T15:00:31.515 INFO:tasks.workunit.client.1.smithi190.stdout:8/730: creat d1/dd1/fd9 x:0 0 0 2023-12-06T15:00:31.516 INFO:tasks.workunit.client.1.smithi190.stdout:7/908: rename d0/df/d5f/l110 to d0/df/d53/l127 0 2023-12-06T15:00:31.517 INFO:tasks.workunit.client.1.smithi190.stdout:5/699: creat d0/deb/ff6 x:0 0 0 2023-12-06T15:00:31.517 INFO:tasks.workunit.client.0.smithi152.stdout:8/408: dwrite d1/d6/d34/d40/f52 [0,4194304] 0 2023-12-06T15:00:31.518 INFO:tasks.workunit.client.0.smithi152.stdout:8/409: fdatasync d1/d6/d34/d36/f5d 0 2023-12-06T15:00:31.518 INFO:tasks.workunit.client.0.smithi152.stdout:6/721: write d1/fc2 [3369049,50142] 0 2023-12-06T15:00:31.520 INFO:tasks.workunit.client.1.smithi190.stdout:2/699: write fa [3693499,109732] 0 2023-12-06T15:00:31.520 INFO:tasks.workunit.client.1.smithi190.stdout:8/731: link d1/d20/d3b/d36/fbd d1/d20/d3b/d36/d50/fda 0 2023-12-06T15:00:31.520 INFO:tasks.workunit.client.0.smithi152.stdout:8/410: mkdir d1/d6/d34/d35/d66/d82 0 2023-12-06T15:00:31.521 INFO:tasks.workunit.client.1.smithi190.stdout:7/909: mkdir d0/df/d53/d99/ddb/d128 0 2023-12-06T15:00:31.521 INFO:tasks.workunit.client.0.smithi152.stdout:6/722: creat d1/dcf/ddc/d1a/d30/d18/f103 x:0 0 0 2023-12-06T15:00:31.524 INFO:tasks.workunit.client.1.smithi190.stdout:2/700: mknod d10/d26/d5c/da5/cef 0 2023-12-06T15:00:31.524 INFO:tasks.workunit.client.1.smithi190.stdout:2/701: stat d10/d59/dcd/dad/fe2 0 2023-12-06T15:00:31.524 INFO:tasks.workunit.client.1.smithi190.stdout:2/702: write d10/f39 [4322321,128573] 0 2023-12-06T15:00:31.525 INFO:tasks.workunit.client.1.smithi190.stdout:8/732: creat d1/d37/fdb x:0 0 0 2023-12-06T15:00:31.525 INFO:tasks.workunit.client.1.smithi190.stdout:8/733: chown d1/d20/d3b/d36/fb5 2 1 2023-12-06T15:00:31.526 INFO:tasks.workunit.client.0.smithi152.stdout:8/411: truncate d1/d6/d34/f57 3355418 0 2023-12-06T15:00:31.526 INFO:tasks.workunit.client.0.smithi152.stdout:8/412: stat d1/d6/d34/d36/d58/f6e 0 2023-12-06T15:00:31.526 INFO:tasks.workunit.client.0.smithi152.stdout:8/413: readlink d1/d6/d34/d40/d64/l6c 0 2023-12-06T15:00:31.526 INFO:tasks.workunit.client.0.smithi152.stdout:6/723: creat d1/d69/da1/f104 x:0 0 0 2023-12-06T15:00:31.526 INFO:tasks.workunit.client.0.smithi152.stdout:8/414: write d1/d6/d34/d40/f78 [240244,87033] 0 2023-12-06T15:00:31.526 INFO:tasks.workunit.client.0.smithi152.stdout:6/724: mkdir d1/d75/d105 0 2023-12-06T15:00:31.526 INFO:tasks.workunit.client.0.smithi152.stdout:6/725: fsync d1/f3d 0 2023-12-06T15:00:31.527 INFO:tasks.workunit.client.0.smithi152.stdout:8/415: truncate d1/f3c 2080957 0 2023-12-06T15:00:31.527 INFO:tasks.workunit.client.1.smithi190.stdout:7/910: creat d0/d88/d41/df4/f129 x:0 0 0 2023-12-06T15:00:31.527 INFO:tasks.workunit.client.1.smithi190.stdout:7/911: dread - d0/d35/d8e/f10a zero size 2023-12-06T15:00:31.528 INFO:tasks.workunit.client.0.smithi152.stdout:6/726: mknod d1/dcf/ddc/d1a/d30/d36/d35/c106 0 2023-12-06T15:00:31.528 INFO:tasks.workunit.client.0.smithi152.stdout:6/727: chown d1/d69/da1/deb/l82 948640 1 2023-12-06T15:00:31.529 INFO:tasks.workunit.client.0.smithi152.stdout:1/776: dwrite d3/da/d15/d17/f3d [0,4194304] 0 2023-12-06T15:00:31.530 INFO:tasks.workunit.client.0.smithi152.stdout:6/728: mknod d1/dcf/ddc/d1a/d30/d36/d4e/d55/c107 0 2023-12-06T15:00:31.530 INFO:tasks.workunit.client.0.smithi152.stdout:4/720: dwrite d2/d22/f4d [0,4194304] 0 2023-12-06T15:00:31.531 INFO:tasks.workunit.client.1.smithi190.stdout:2/703: creat d10/d26/d5c/d42/d9d/ff0 x:0 0 0 2023-12-06T15:00:31.531 INFO:tasks.workunit.client.1.smithi190.stdout:5/700: mknod d0/d1c/d2b/d2c/d5d/d73/cf7 0 2023-12-06T15:00:31.532 INFO:tasks.workunit.client.0.smithi152.stdout:1/777: mknod d3/da/d15/d17/d4d/c11f 0 2023-12-06T15:00:31.532 INFO:tasks.workunit.client.0.smithi152.stdout:5/561: dwrite d7/f18 [0,4194304] 0 2023-12-06T15:00:31.532 INFO:tasks.workunit.client.0.smithi152.stdout:5/562: readlink d7/dd/d26/d3b/d46/d7e/l95 0 2023-12-06T15:00:31.532 INFO:tasks.workunit.client.0.smithi152.stdout:5/563: write d7/dd/f20 [1201364,31299] 0 2023-12-06T15:00:31.532 INFO:tasks.workunit.client.0.smithi152.stdout:8/416: mknod d1/c83 0 2023-12-06T15:00:31.533 INFO:tasks.workunit.client.0.smithi152.stdout:6/729: mkdir d1/dcf/ddc/d1a/d30/daa/d108 0 2023-12-06T15:00:31.535 INFO:tasks.workunit.client.1.smithi190.stdout:9/889: getdents d4/d84/dda 0 2023-12-06T15:00:31.535 INFO:tasks.workunit.client.1.smithi190.stdout:9/890: chown d4/d27/cf0 32732103 1 2023-12-06T15:00:31.535 INFO:tasks.workunit.client.1.smithi190.stdout:7/912: mkdir d0/df/df8/d108/d120/d12a 0 2023-12-06T15:00:31.535 INFO:tasks.workunit.client.1.smithi190.stdout:9/891: dread - d4/d27/d2f/f102 zero size 2023-12-06T15:00:31.535 INFO:tasks.workunit.client.1.smithi190.stdout:9/892: chown d4/f5b 99679349 1 2023-12-06T15:00:31.535 INFO:tasks.workunit.client.0.smithi152.stdout:4/721: unlink d2/d15/f58 0 2023-12-06T15:00:31.536 INFO:tasks.workunit.client.1.smithi190.stdout:2/704: truncate d10/d26/d5c/d35/d77/d98/fa8 729088 0 2023-12-06T15:00:31.537 INFO:tasks.workunit.client.0.smithi152.stdout:5/564: symlink d7/d47/lc7 0 2023-12-06T15:00:31.537 INFO:tasks.workunit.client.0.smithi152.stdout:5/565: write d7/dd/d4e/f73 [381716,55274] 0 2023-12-06T15:00:31.537 INFO:tasks.workunit.client.0.smithi152.stdout:5/566: write d7/f38 [1675153,6639] 0 2023-12-06T15:00:31.539 INFO:tasks.workunit.client.1.smithi190.stdout:5/701: symlink d0/d1c/d2b/lf8 0 2023-12-06T15:00:31.539 INFO:tasks.workunit.client.1.smithi190.stdout:5/702: stat d0/d1c/d3e/lcb 0 2023-12-06T15:00:31.541 INFO:tasks.workunit.client.1.smithi190.stdout:5/703: dread d0/d1c/d2b/fb8 [0,4194304] 0 2023-12-06T15:00:31.541 INFO:tasks.workunit.client.1.smithi190.stdout:5/704: fsync d0/d1c/d2b/d2c/d5d/d73/fab 0 2023-12-06T15:00:31.544 INFO:tasks.workunit.client.1.smithi190.stdout:7/913: creat d0/d5/dba/f12b x:0 0 0 2023-12-06T15:00:31.544 INFO:tasks.workunit.client.1.smithi190.stdout:7/914: fsync d0/d88/d7a/dc9/f118 0 2023-12-06T15:00:31.544 INFO:tasks.workunit.client.1.smithi190.stdout:7/915: write d0/d88/d1c/d17/d94/d95/fed [181182,127148] 0 2023-12-06T15:00:31.545 INFO:tasks.workunit.client.1.smithi190.stdout:9/893: creat d4/d27/d2f/d31/f121 x:0 0 0 2023-12-06T15:00:31.546 INFO:tasks.workunit.client.0.smithi152.stdout:1/778: dread d3/da/d65/f77 [0,4194304] 0 2023-12-06T15:00:31.546 INFO:tasks.workunit.client.1.smithi190.stdout:5/705: symlink d0/d1c/d85/d90/dba/lf9 0 2023-12-06T15:00:31.547 INFO:tasks.workunit.client.1.smithi190.stdout:7/916: mknod d0/df/d53/d99/da9/df9/c12c 0 2023-12-06T15:00:31.547 INFO:tasks.workunit.client.1.smithi190.stdout:7/917: write d0/df/d53/d2f/de9/d56/f85 [1695583,53827] 0 2023-12-06T15:00:31.549 INFO:tasks.workunit.client.1.smithi190.stdout:9/894: creat d4/d27/d8a/dbc/f122 x:0 0 0 2023-12-06T15:00:31.549 INFO:tasks.workunit.client.1.smithi190.stdout:9/895: truncate d4/d27/d2f/d31/d3f/d58/fa3 3497903 0 2023-12-06T15:00:31.549 INFO:tasks.workunit.client.1.smithi190.stdout:9/896: fsync d4/d27/f6a 0 2023-12-06T15:00:31.553 INFO:tasks.workunit.client.1.smithi190.stdout:9/897: link d4/f17 d4/d27/d2f/f123 0 2023-12-06T15:00:31.553 INFO:tasks.workunit.client.1.smithi190.stdout:9/898: readlink d4/l34 0 2023-12-06T15:00:31.553 INFO:tasks.workunit.client.1.smithi190.stdout:9/899: chown d4/d27/d2f/d31/d3f/d58/d72/db3/dea/dcd/dff/lcf 40954 1 2023-12-06T15:00:31.553 INFO:tasks.workunit.client.1.smithi190.stdout:4/719: sync 2023-12-06T15:00:31.553 INFO:tasks.workunit.client.1.smithi190.stdout:4/720: fsync d3/d35/d19/f59 0 2023-12-06T15:00:31.554 INFO:tasks.workunit.client.1.smithi190.stdout:8/734: dwrite d1/d20/d3b/d4c/d59/fc2 [4194304,4194304] 0 2023-12-06T15:00:31.554 INFO:tasks.workunit.client.0.smithi152.stdout:1/779: read d3/da/db/f4b [1008213,105064] 0 2023-12-06T15:00:31.554 INFO:tasks.workunit.client.1.smithi190.stdout:9/900: mkdir d4/d27/d8a/dbc/d124 0 2023-12-06T15:00:31.556 INFO:tasks.workunit.client.1.smithi190.stdout:4/721: mknod d3/d35/d19/d41/d44/cf6 0 2023-12-06T15:00:31.556 INFO:tasks.workunit.client.1.smithi190.stdout:3/819: sync 2023-12-06T15:00:31.556 INFO:tasks.workunit.client.1.smithi190.stdout:0/727: sync 2023-12-06T15:00:31.556 INFO:tasks.workunit.client.1.smithi190.stdout:6/817: sync 2023-12-06T15:00:31.556 INFO:tasks.workunit.client.1.smithi190.stdout:0/728: chown d0/da/d3e/d2b/d3c/d46/d8e 0 1 2023-12-06T15:00:31.557 INFO:tasks.workunit.client.0.smithi152.stdout:1/780: rename d3/da/db/d54/fb5 to d3/da/d15/d17/d1a/f120 0 2023-12-06T15:00:31.557 INFO:tasks.workunit.client.0.smithi152.stdout:1/781: dread - d3/da/d15/d17/d4d/f7f zero size 2023-12-06T15:00:31.558 INFO:tasks.workunit.client.1.smithi190.stdout:3/820: write d4/d1b/f22 [1738828,97540] 0 2023-12-06T15:00:31.560 INFO:tasks.workunit.client.1.smithi190.stdout:9/901: creat d4/d27/d2f/f125 x:0 0 0 2023-12-06T15:00:31.568 INFO:tasks.workunit.client.1.smithi190.stdout:8/735: dread d1/d20/d3b/d36/f3e [0,4194304] 0 2023-12-06T15:00:31.568 INFO:tasks.workunit.client.0.smithi152.stdout:2/406: sync 2023-12-06T15:00:31.570 INFO:tasks.workunit.client.1.smithi190.stdout:3/821: dread d4/d1b/d54/d9c/d68/dfc/f65 [0,4194304] 0 2023-12-06T15:00:31.570 INFO:tasks.workunit.client.1.smithi190.stdout:3/822: fdatasync d4/d1b/d54/ffe 0 2023-12-06T15:00:31.571 INFO:tasks.workunit.client.0.smithi152.stdout:4/722: dwrite d2/f7c [0,4194304] 0 2023-12-06T15:00:31.571 INFO:tasks.workunit.client.0.smithi152.stdout:2/407: rmdir d6/d18/d43 39 2023-12-06T15:00:31.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:31 smithi190 ceph-mon[121340]: pgmap v27: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 154 MiB/s rd, 313 MiB/s wr, 509 op/s 2023-12-06T15:00:31.575 INFO:tasks.workunit.client.0.smithi152.stdout:6/730: dwrite d1/dcf/ddc/d1a/d30/d36/f2e [0,4194304] 0 2023-12-06T15:00:31.575 INFO:tasks.workunit.client.0.smithi152.stdout:8/417: rmdir d1 39 2023-12-06T15:00:31.577 INFO:tasks.workunit.client.0.smithi152.stdout:6/731: symlink d1/dcf/ddc/d1a/d30/d36/d26/l109 0 2023-12-06T15:00:31.577 INFO:tasks.workunit.client.0.smithi152.stdout:6/732: stat d1/dcf/ddc/d6d 0 2023-12-06T15:00:31.577 INFO:tasks.workunit.client.0.smithi152.stdout:6/733: readlink d1/dcf/ddc/d1a/d30/d36/d35/lcd 0 2023-12-06T15:00:31.578 INFO:tasks.workunit.client.0.smithi152.stdout:8/418: symlink d1/d6/d34/d40/l84 0 2023-12-06T15:00:31.580 INFO:tasks.workunit.client.0.smithi152.stdout:8/419: dread d1/d6/f31 [0,4194304] 0 2023-12-06T15:00:31.580 INFO:tasks.workunit.client.0.smithi152.stdout:6/734: mkdir d1/d69/da1/d87/d10a 0 2023-12-06T15:00:31.584 INFO:tasks.workunit.client.0.smithi152.stdout:6/735: creat d1/d69/da1/deb/f10b x:0 0 0 2023-12-06T15:00:31.586 INFO:tasks.workunit.client.1.smithi190.stdout:4/722: mknod d3/da4/dd0/cf7 0 2023-12-06T15:00:31.587 INFO:tasks.workunit.client.0.smithi152.stdout:6/736: mkdir d1/dcf/ddc/d1a/d30/d18/d10c 0 2023-12-06T15:00:31.589 INFO:tasks.workunit.client.0.smithi152.stdout:4/723: dread d2/d89/fa1 [0,4194304] 0 2023-12-06T15:00:31.590 INFO:tasks.workunit.client.0.smithi152.stdout:6/737: dread d1/d69/da1/deb/f88 [0,4194304] 0 2023-12-06T15:00:31.590 INFO:tasks.workunit.client.1.smithi190.stdout:5/706: dwrite d0/d6c/f79 [4194304,4194304] 0 2023-12-06T15:00:31.591 INFO:tasks.workunit.client.1.smithi190.stdout:2/705: dwrite d10/d59/d5e/fd2 [0,4194304] 0 2023-12-06T15:00:31.593 INFO:tasks.workunit.client.0.smithi152.stdout:4/724: link d2/d10/f37 d2/d10/dbb/dca/dbc/fdc 0 2023-12-06T15:00:31.595 INFO:tasks.workunit.client.0.smithi152.stdout:2/408: dwrite d6/db/d17/f46 [0,4194304] 0 2023-12-06T15:00:31.596 INFO:tasks.workunit.client.1.smithi190.stdout:5/707: dread d0/df/d50/fad [0,4194304] 0 2023-12-06T15:00:31.596 INFO:tasks.workunit.client.0.smithi152.stdout:4/725: mknod d2/d10/dbb/dca/cdd 0 2023-12-06T15:00:31.601 INFO:tasks.workunit.client.1.smithi190.stdout:7/918: dwrite d0/df/d53/f111 [0,4194304] 0 2023-12-06T15:00:31.601 INFO:tasks.workunit.client.0.smithi152.stdout:1/782: dwrite d3/da/d15/d17/d43/f66 [0,4194304] 0 2023-12-06T15:00:31.601 INFO:tasks.workunit.client.0.smithi152.stdout:2/409: mkdir d6/d1e/d41/d83 0 2023-12-06T15:00:31.603 INFO:tasks.workunit.client.1.smithi190.stdout:7/919: dread d0/d88/d1c/d17/d94/f106 [0,4194304] 0 2023-12-06T15:00:31.603 INFO:tasks.workunit.client.1.smithi190.stdout:7/920: truncate d0/fd4 4950045 0 2023-12-06T15:00:31.603 INFO:tasks.workunit.client.0.smithi152.stdout:2/410: read d6/d18/f58 [235862,18001] 0 2023-12-06T15:00:31.603 INFO:tasks.workunit.client.0.smithi152.stdout:2/411: readlink d6/d18/d43/l71 0 2023-12-06T15:00:31.606 INFO:tasks.workunit.client.0.smithi152.stdout:1/783: truncate d3/da/db/d54/f11a 2815312 0 2023-12-06T15:00:31.609 INFO:tasks.workunit.client.0.smithi152.stdout:2/412: rmdir d6/d1e/d41/d7e 0 2023-12-06T15:00:31.609 INFO:tasks.workunit.client.0.smithi152.stdout:2/413: chown d6/db/d17/f46 1142779 1 2023-12-06T15:00:31.610 INFO:tasks.workunit.client.1.smithi190.stdout:6/818: getdents d4/d12/d9a 0 2023-12-06T15:00:31.612 INFO:tasks.workunit.client.0.smithi152.stdout:2/414: creat d6/d18/d70/f84 x:0 0 0 2023-12-06T15:00:31.612 INFO:tasks.workunit.client.0.smithi152.stdout:2/415: fsync d6/db/d17/f59 0 2023-12-06T15:00:31.614 INFO:tasks.workunit.client.1.smithi190.stdout:0/729: mknod d0/da/d3e/d3a/d40/d6f/d9e/ceb 0 2023-12-06T15:00:31.616 INFO:tasks.workunit.client.1.smithi190.stdout:9/902: rename d4/d84/f8b to d4/d27/f126 0 2023-12-06T15:00:31.617 INFO:tasks.workunit.client.0.smithi152.stdout:1/784: dread d3/da/d15/d17/d58/fe4 [0,4194304] 0 2023-12-06T15:00:31.618 INFO:tasks.workunit.client.0.smithi152.stdout:2/416: dread d6/d18/f32 [0,4194304] 0 2023-12-06T15:00:31.619 INFO:tasks.workunit.client.0.smithi152.stdout:1/785: mknod d3/da/d15/dac/c121 0 2023-12-06T15:00:31.620 INFO:tasks.workunit.client.0.smithi152.stdout:8/420: dwrite d1/d6/d34/d40/d64/f68 [0,4194304] 0 2023-12-06T15:00:31.620 INFO:tasks.workunit.client.1.smithi190.stdout:3/823: mknod d4/d70/d19/d51/c124 0 2023-12-06T15:00:31.621 INFO:tasks.workunit.client.0.smithi152.stdout:1/786: creat d3/d44/d84/de2/f122 x:0 0 0 2023-12-06T15:00:31.622 INFO:tasks.workunit.client.0.smithi152.stdout:1/787: truncate d3/da/db/ff 903584 0 2023-12-06T15:00:31.625 INFO:tasks.workunit.client.0.smithi152.stdout:6/738: dwrite d1/fa3 [0,4194304] 0 2023-12-06T15:00:31.626 INFO:tasks.workunit.client.1.smithi190.stdout:4/723: mknod d3/d35/d97/cf8 0 2023-12-06T15:00:31.626 INFO:tasks.workunit.client.1.smithi190.stdout:2/706: dwrite d10/d59/dcd/dad/dc4/d7f/d8e/fbd [0,4194304] 0 2023-12-06T15:00:31.629 INFO:tasks.workunit.client.1.smithi190.stdout:3/824: dread d4/f5 [0,4194304] 0 2023-12-06T15:00:31.629 INFO:tasks.workunit.client.1.smithi190.stdout:3/825: chown d4/d1b/d54/f9e 0 1 2023-12-06T15:00:31.631 INFO:tasks.workunit.client.0.smithi152.stdout:2/417: dread d6/f4d [0,4194304] 0 2023-12-06T15:00:31.631 INFO:tasks.workunit.client.0.smithi152.stdout:2/418: fsync d6/db/f39 0 2023-12-06T15:00:31.634 INFO:tasks.workunit.client.0.smithi152.stdout:4/726: dwrite d2/d10/f24 [0,4194304] 0 2023-12-06T15:00:31.635 INFO:tasks.workunit.client.0.smithi152.stdout:2/419: link d6/d18/d43/l51 d6/l85 0 2023-12-06T15:00:31.635 INFO:tasks.workunit.client.0.smithi152.stdout:2/420: truncate d6/db/f61 553742 0 2023-12-06T15:00:31.636 INFO:tasks.workunit.client.1.smithi190.stdout:2/707: fsync d10/d26/d5c/d49/f6f 0 2023-12-06T15:00:31.636 INFO:tasks.workunit.client.1.smithi190.stdout:2/708: write d10/d26/d5c/d37/f9a [1018766,10085] 0 2023-12-06T15:00:31.637 INFO:tasks.workunit.client.1.smithi190.stdout:0/730: symlink d0/d9d/lec 0 2023-12-06T15:00:31.638 INFO:tasks.workunit.client.0.smithi152.stdout:2/421: mknod d6/c86 0 2023-12-06T15:00:31.640 INFO:tasks.workunit.client.0.smithi152.stdout:2/422: mknod d6/d1e/d41/d55/c87 0 2023-12-06T15:00:31.645 INFO:tasks.workunit.client.0.smithi152.stdout:2/423: mknod d6/d1e/c88 0 2023-12-06T15:00:31.645 INFO:tasks.workunit.client.1.smithi190.stdout:4/724: mknod d3/d76/d8b/cf9 0 2023-12-06T15:00:31.645 INFO:tasks.workunit.client.1.smithi190.stdout:4/725: read - d3/d76/d7c/d96/d7a/f9a zero size 2023-12-06T15:00:31.647 INFO:tasks.workunit.client.1.smithi190.stdout:2/709: creat d10/d26/d8a/d8f/ff1 x:0 0 0 2023-12-06T15:00:31.654 INFO:tasks.workunit.client.1.smithi190.stdout:2/710: mknod d10/cf2 0 2023-12-06T15:00:31.654 INFO:tasks.workunit.client.1.smithi190.stdout:2/711: fdatasync d10/d26/d5c/d49/f9c 0 2023-12-06T15:00:31.655 INFO:tasks.workunit.client.0.smithi152.stdout:1/788: dwrite d3/da/fd1 [0,4194304] 0 2023-12-06T15:00:31.655 INFO:tasks.workunit.client.0.smithi152.stdout:1/789: chown d3/da/d4c/d82/d52/d55/d110 41 1 2023-12-06T15:00:31.656 INFO:tasks.workunit.client.1.smithi190.stdout:2/712: creat d10/d26/d5c/d35/d77/ff3 x:0 0 0 2023-12-06T15:00:31.656 INFO:tasks.workunit.client.0.smithi152.stdout:1/790: mkdir d3/da/d4c/d85/d123 0 2023-12-06T15:00:31.658 INFO:tasks.workunit.client.0.smithi152.stdout:1/791: rmdir d3/da/d15/d17/d43/d7d 39 2023-12-06T15:00:31.658 INFO:tasks.workunit.client.0.smithi152.stdout:1/792: fdatasync d3/d44/d84/f9b 0 2023-12-06T15:00:31.658 INFO:tasks.workunit.client.0.smithi152.stdout:1/793: fdatasync d3/da/d4c/d82/d52/d55/f56 0 2023-12-06T15:00:31.658 INFO:tasks.workunit.client.0.smithi152.stdout:8/421: dwrite d1/d6/f31 [0,4194304] 0 2023-12-06T15:00:31.660 INFO:tasks.workunit.client.0.smithi152.stdout:6/739: dwrite d1/fc2 [0,4194304] 0 2023-12-06T15:00:31.660 INFO:tasks.workunit.client.0.smithi152.stdout:6/740: stat d1/dcf/ddc/d1a/d30/d36/d35/d49/d6b/f91 0 2023-12-06T15:00:31.660 INFO:tasks.workunit.client.0.smithi152.stdout:6/741: truncate d1/dcf/ddc/d1a/d30/d36/d4e/fb2 305629 0 2023-12-06T15:00:31.660 INFO:tasks.workunit.client.0.smithi152.stdout:6/742: readlink d1/d69/da1/d87/l1e 0 2023-12-06T15:00:31.670 INFO:tasks.workunit.client.0.smithi152.stdout:1/794: dread d3/da/d15/d17/d58/fe4 [0,4194304] 0 2023-12-06T15:00:31.673 INFO:tasks.workunit.client.1.smithi190.stdout:5/708: rename d0/df/f41 to d0/d1c/d3e/d7e/ffa 0 2023-12-06T15:00:31.674 INFO:tasks.workunit.client.0.smithi152.stdout:1/795: unlink d3/d73/fd4 0 2023-12-06T15:00:31.677 INFO:tasks.workunit.client.1.smithi190.stdout:5/709: unlink d0/d1c/d2b/d2c/d5d/c6e 0 2023-12-06T15:00:31.678 INFO:tasks.workunit.client.1.smithi190.stdout:6/819: rename d4/d12/d1a/d59/c5b to d4/d12/d1a/db4/c10e 0 2023-12-06T15:00:31.678 INFO:tasks.workunit.client.0.smithi152.stdout:1/796: mknod d3/da/d15/d17/d43/c124 0 2023-12-06T15:00:31.681 INFO:tasks.workunit.client.1.smithi190.stdout:9/903: rename d4/d27/d2f/d31/d3f/d58/d72/db3/dea/dcd/df1 to d4/d27/d2f/d31/d3f/d58/dc5/d127 0 2023-12-06T15:00:31.682 INFO:tasks.workunit.client.1.smithi190.stdout:6/820: mknod d4/d12/d1a/d32/dab/dd3/c10f 0 2023-12-06T15:00:31.683 INFO:tasks.workunit.client.1.smithi190.stdout:9/904: rename d4/d27/d2f/d31/ced to d4/d27/d2f/d5c/c128 0 2023-12-06T15:00:31.683 INFO:tasks.workunit.client.1.smithi190.stdout:9/905: fdatasync d4/fe 0 2023-12-06T15:00:31.687 INFO:tasks.workunit.client.1.smithi190.stdout:9/906: creat d4/d27/d8a/f129 x:0 0 0 2023-12-06T15:00:31.688 INFO:tasks.workunit.client.1.smithi190.stdout:9/907: symlink d4/d27/d2f/d31/d3f/d58/dc5/l12a 0 2023-12-06T15:00:31.691 INFO:tasks.workunit.client.1.smithi190.stdout:9/908: creat d4/d27/d2f/d31/d3f/d58/d72/db3/dea/dcd/f12b x:0 0 0 2023-12-06T15:00:31.695 INFO:tasks.workunit.client.1.smithi190.stdout:0/731: dwrite d0/da/d5a/fcd [0,4194304] 0 2023-12-06T15:00:31.698 INFO:tasks.workunit.client.1.smithi190.stdout:6/821: rename d4/d12/d1a/d8a/l93 to d4/d12/d40/d43/d45/dff/l110 0 2023-12-06T15:00:31.700 INFO:tasks.workunit.client.1.smithi190.stdout:0/732: mknod d0/da/d3e/d3a/d40/d81/ced 0 2023-12-06T15:00:31.702 INFO:tasks.workunit.client.1.smithi190.stdout:2/713: dwrite d10/d59/dcd/dad/dc4/d76/fa6 [0,4194304] 0 2023-12-06T15:00:31.705 INFO:tasks.workunit.client.1.smithi190.stdout:8/736: link d1/d20/d3b/d31/d87/l98 d1/d20/d3b/d4c/d59/ldc 0 2023-12-06T15:00:31.705 INFO:tasks.workunit.client.1.smithi190.stdout:2/714: getdents d10/d26/d5c/d35/d77/d98 0 2023-12-06T15:00:31.705 INFO:tasks.workunit.client.1.smithi190.stdout:0/733: write d0/da/d3e/d3a/d40/d81/f89 [2397312,67622] 0 2023-12-06T15:00:31.706 INFO:tasks.workunit.client.1.smithi190.stdout:6/822: write d4/d12/d40/d43/d45/d4a/d77/dca/f98 [2750309,18124] 0 2023-12-06T15:00:31.707 INFO:tasks.workunit.client.1.smithi190.stdout:2/715: link d10/d59/d5e/l20 d10/d26/d5c/da5/ded/lf4 0 2023-12-06T15:00:31.709 INFO:tasks.workunit.client.1.smithi190.stdout:8/737: dread d1/d20/d3b/d4c/d8e/d94/f78 [0,4194304] 0 2023-12-06T15:00:31.709 INFO:tasks.workunit.client.1.smithi190.stdout:6/823: symlink d4/d12/d9a/l111 0 2023-12-06T15:00:31.710 INFO:tasks.workunit.client.1.smithi190.stdout:2/716: truncate d10/d26/d5c/d49/d54/f6d 3055014 0 2023-12-06T15:00:31.712 INFO:tasks.workunit.client.0.smithi152.stdout:8/422: dwrite d1/d6/d29/f33 [0,4194304] 0 2023-12-06T15:00:31.712 INFO:tasks.workunit.client.0.smithi152.stdout:4/727: dwrite d2/d22/fb6 [0,4194304] 0 2023-12-06T15:00:31.712 INFO:tasks.workunit.client.1.smithi190.stdout:9/909: dwrite d4/d84/fe8 [0,4194304] 0 2023-12-06T15:00:31.714 INFO:tasks.workunit.client.1.smithi190.stdout:8/738: getdents d1/d20/d3b/d36 0 2023-12-06T15:00:31.714 INFO:tasks.workunit.client.1.smithi190.stdout:5/710: dwrite d0/d1c/f98 [4194304,4194304] 0 2023-12-06T15:00:31.715 INFO:tasks.workunit.client.1.smithi190.stdout:5/711: stat d0/d6c/dcd 0 2023-12-06T15:00:31.716 INFO:tasks.workunit.client.1.smithi190.stdout:9/910: write d4/d27/d2f/d31/d3f/d58/dc5/d127/f101 [1028970,61224] 0 2023-12-06T15:00:31.716 INFO:tasks.workunit.client.1.smithi190.stdout:6/824: mknod d4/d12/d9a/c112 0 2023-12-06T15:00:31.718 INFO:tasks.workunit.client.1.smithi190.stdout:9/911: write d4/fa [2515527,123732] 0 2023-12-06T15:00:31.718 INFO:tasks.workunit.client.0.smithi152.stdout:6/743: dwrite d1/dcf/ddc/d1a/d30/d36/d35/d63/ff4 [0,4194304] 0 2023-12-06T15:00:31.718 INFO:tasks.workunit.client.0.smithi152.stdout:2/424: dwrite d6/d1e/d41/d55/f65 [0,4194304] 0 2023-12-06T15:00:31.721 INFO:tasks.workunit.client.1.smithi190.stdout:8/739: rmdir d1/d20/d3b/d31/d87 39 2023-12-06T15:00:31.721 INFO:tasks.workunit.client.1.smithi190.stdout:8/740: stat d1/d20/d3b/d34/dbc 0 2023-12-06T15:00:31.722 INFO:tasks.workunit.client.1.smithi190.stdout:9/912: mkdir d4/d27/d2f/d31/d12c 0 2023-12-06T15:00:31.724 INFO:tasks.workunit.client.0.smithi152.stdout:6/744: write d1/dcf/ddc/d1a/d30/d36/d35/d63/ff4 [574444,68236] 0 2023-12-06T15:00:31.724 INFO:tasks.workunit.client.0.smithi152.stdout:1/797: dwrite d3/da/d15/d17/d1a/f38 [0,4194304] 0 2023-12-06T15:00:31.727 INFO:tasks.workunit.client.1.smithi190.stdout:9/913: mknod d4/d27/d2f/c12d 0 2023-12-06T15:00:31.727 INFO:tasks.workunit.client.0.smithi152.stdout:2/425: creat d6/d1e/d41/d55/f89 x:0 0 0 2023-12-06T15:00:31.727 INFO:tasks.workunit.client.0.smithi152.stdout:2/426: write d6/db/f66 [354403,33083] 0 2023-12-06T15:00:31.728 INFO:tasks.workunit.client.0.smithi152.stdout:6/745: write d1/dcf/ddc/d1a/d30/d36/f24 [2616194,11277] 0 2023-12-06T15:00:31.730 INFO:tasks.workunit.client.1.smithi190.stdout:0/734: dwrite d0/da/d3e/d3a/d40/d6f/fba [0,4194304] 0 2023-12-06T15:00:31.730 INFO:tasks.workunit.client.1.smithi190.stdout:6/825: dread d4/d12/d1a/d70/f7f [8388608,4194304] 0 2023-12-06T15:00:31.731 INFO:tasks.workunit.client.0.smithi152.stdout:1/798: rename d3/da/d15/d17/fd5 to d3/da/d4c/d82/d52/d62/d11b/f125 0 2023-12-06T15:00:31.732 INFO:tasks.workunit.client.0.smithi152.stdout:1/799: write d3/da/d4c/d82/d52/d55/fbd [2276624,51929] 0 2023-12-06T15:00:31.733 INFO:tasks.workunit.client.0.smithi152.stdout:2/427: creat d6/db/f8a x:0 0 0 2023-12-06T15:00:31.734 INFO:tasks.workunit.client.1.smithi190.stdout:6/826: creat d4/d12/d1a/d32/dab/de1/d107/f113 x:0 0 0 2023-12-06T15:00:31.734 INFO:tasks.workunit.client.1.smithi190.stdout:2/717: dread fc [0,4194304] 0 2023-12-06T15:00:31.736 INFO:tasks.workunit.client.0.smithi152.stdout:1/800: rename d3/d73/ff7 to d3/da/d4c/d82/d52/d55/f126 0 2023-12-06T15:00:31.737 INFO:tasks.workunit.client.1.smithi190.stdout:6/827: creat d4/d12/f114 x:0 0 0 2023-12-06T15:00:31.738 INFO:tasks.workunit.client.1.smithi190.stdout:2/718: creat d10/d59/dcd/dad/dc4/d7f/d8e/dee/ff5 x:0 0 0 2023-12-06T15:00:31.741 INFO:tasks.workunit.client.0.smithi152.stdout:2/428: getdents d6/d18/d43 0 2023-12-06T15:00:31.742 INFO:tasks.workunit.client.0.smithi152.stdout:4/728: truncate d2/d22/fb6 1958719 0 2023-12-06T15:00:31.745 INFO:tasks.workunit.client.0.smithi152.stdout:2/429: link d6/d1e/f77 d6/d1e/d7a/f8b 0 2023-12-06T15:00:31.746 INFO:tasks.workunit.client.0.smithi152.stdout:2/430: chown d6/db/f66 5549 1 2023-12-06T15:00:31.746 INFO:tasks.workunit.client.0.smithi152.stdout:2/431: chown d6/d1e/d41/d55/l22 20 1 2023-12-06T15:00:31.746 INFO:tasks.workunit.client.0.smithi152.stdout:2/432: dread d6/db/f61 [0,4194304] 0 2023-12-06T15:00:31.746 INFO:tasks.workunit.client.1.smithi190.stdout:2/719: write d10/d26/d5c/da5/fd9 [2498486,91581] 0 2023-12-06T15:00:31.747 INFO:tasks.workunit.client.0.smithi152.stdout:4/729: chown d2/d10/d52/c46 194098 1 2023-12-06T15:00:31.747 INFO:tasks.workunit.client.1.smithi190.stdout:0/735: dread d0/da/f5c [0,4194304] 0 2023-12-06T15:00:31.750 INFO:tasks.workunit.client.1.smithi190.stdout:2/720: rmdir d10/d26/d8a/d8f/ddf 0 2023-12-06T15:00:31.750 INFO:tasks.workunit.client.0.smithi152.stdout:8/423: dwrite d1/d6/d29/f4d [0,4194304] 0 2023-12-06T15:00:31.751 INFO:tasks.workunit.client.0.smithi152.stdout:4/730: creat d2/d10/dbb/dca/dcb/fde x:0 0 0 2023-12-06T15:00:31.753 INFO:tasks.workunit.client.1.smithi190.stdout:2/721: mkdir d10/d59/dcd/dad/df6 0 2023-12-06T15:00:31.753 INFO:tasks.workunit.client.0.smithi152.stdout:8/424: truncate d1/d6/d34/d35/d38/f4e 532296 0 2023-12-06T15:00:31.755 INFO:tasks.workunit.client.1.smithi190.stdout:2/722: unlink d10/d26/d5c/d35/dd8/lea 0 2023-12-06T15:00:31.756 INFO:tasks.workunit.client.0.smithi152.stdout:4/731: symlink d2/d15/d32/dd0/ldf 0 2023-12-06T15:00:31.759 INFO:tasks.workunit.client.1.smithi190.stdout:2/723: creat d10/d26/d5c/d35/d77/ff7 x:0 0 0 2023-12-06T15:00:31.759 INFO:tasks.workunit.client.1.smithi190.stdout:2/724: write d10/d26/d5c/d49/d7e/faf [885012,29910] 0 2023-12-06T15:00:31.759 INFO:tasks.workunit.client.0.smithi152.stdout:8/425: dread d1/d6/d34/d6f/f70 [0,4194304] 0 2023-12-06T15:00:31.761 INFO:tasks.workunit.client.1.smithi190.stdout:2/725: getdents d10/d26/d5c/d8d 0 2023-12-06T15:00:31.761 INFO:tasks.workunit.client.1.smithi190.stdout:2/726: chown d10/d26/d5c/d49/d7e/lbb 3072009 1 2023-12-06T15:00:31.761 INFO:tasks.workunit.client.1.smithi190.stdout:2/727: chown d10/d26/d5c/d37/c79 182700054 1 2023-12-06T15:00:31.761 INFO:tasks.workunit.client.1.smithi190.stdout:6/828: read d4/d12/d1a/d8a/fa7 [143545,104510] 0 2023-12-06T15:00:31.763 INFO:tasks.workunit.client.1.smithi190.stdout:6/829: creat d4/d12/d40/d43/dba/dfe/f115 x:0 0 0 2023-12-06T15:00:31.771 INFO:tasks.workunit.client.1.smithi190.stdout:5/712: dwrite d0/d1c/d2b/fe3 [0,4194304] 0 2023-12-06T15:00:31.776 INFO:tasks.workunit.client.0.smithi152.stdout:8/426: dread d1/d6/d34/d3a/f48 [0,4194304] 0 2023-12-06T15:00:31.778 INFO:tasks.workunit.client.0.smithi152.stdout:6/746: dwrite d1/dcf/ddc/d1a/f4a [0,4194304] 0 2023-12-06T15:00:31.778 INFO:tasks.workunit.client.0.smithi152.stdout:6/747: stat d1/dcf/ddc/d1a/d30/d36/d35/d49/caf 0 2023-12-06T15:00:31.779 INFO:tasks.workunit.client.1.smithi190.stdout:8/741: dwrite d1/d20/d3b/d4c/d8e/d94/d1c/f64 [4194304,4194304] 0 2023-12-06T15:00:31.780 INFO:tasks.workunit.client.1.smithi190.stdout:7/921: truncate d0/df/d53/d2f/fd6 2956309 0 2023-12-06T15:00:31.780 INFO:tasks.workunit.client.1.smithi190.stdout:7/922: chown d0/df/ldd 69154 1 2023-12-06T15:00:31.780 INFO:tasks.workunit.client.1.smithi190.stdout:7/923: chown d0/d35 0 1 2023-12-06T15:00:31.780 INFO:tasks.workunit.client.1.smithi190.stdout:7/924: chown d0/d35 167524 1 2023-12-06T15:00:31.780 INFO:tasks.workunit.client.1.smithi190.stdout:7/925: chown d0/f30 0 1 2023-12-06T15:00:31.780 INFO:tasks.workunit.client.1.smithi190.stdout:7/926: chown d0/d88/d1c/d17/d94/d95/l102 14216 1 2023-12-06T15:00:31.780 INFO:tasks.workunit.client.1.smithi190.stdout:7/927: fsync d0/d88/d41/d92/fcc 0 2023-12-06T15:00:31.781 INFO:tasks.workunit.client.1.smithi190.stdout:7/928: write d0/d88/d7a/f5e [1172933,94958] 0 2023-12-06T15:00:31.784 INFO:tasks.workunit.client.1.smithi190.stdout:8/742: creat d1/d20/d3b/d31/fdd x:0 0 0 2023-12-06T15:00:31.784 INFO:tasks.workunit.client.1.smithi190.stdout:8/743: fsync d1/d20/d3b/d36/f48 0 2023-12-06T15:00:31.785 INFO:tasks.workunit.client.1.smithi190.stdout:8/744: chown d1/d20/d3b/d4c/d59/f81 364382 1 2023-12-06T15:00:31.785 INFO:tasks.workunit.client.1.smithi190.stdout:8/745: readlink d1/d20/d3b/d4c/d8e/d94/d25/l32 0 2023-12-06T15:00:31.785 INFO:tasks.workunit.client.1.smithi190.stdout:5/713: dread d0/df/d50/f75 [0,4194304] 0 2023-12-06T15:00:31.790 INFO:tasks.workunit.client.1.smithi190.stdout:5/714: symlink d0/d1c/d85/d90/lfb 0 2023-12-06T15:00:31.791 INFO:tasks.workunit.client.1.smithi190.stdout:5/715: dread d0/d1c/d3e/d7e/fc9 [0,4194304] 0 2023-12-06T15:00:31.793 INFO:tasks.workunit.client.0.smithi152.stdout:1/801: dwrite d3/da/d4c/d63/ff3 [0,4194304] 0 2023-12-06T15:00:31.793 INFO:tasks.workunit.client.0.smithi152.stdout:6/748: dread d1/dcf/ddc/f48 [0,4194304] 0 2023-12-06T15:00:31.797 INFO:tasks.workunit.client.0.smithi152.stdout:8/427: dread d1/d6/d34/d36/f11 [0,4194304] 0 2023-12-06T15:00:31.797 INFO:tasks.workunit.client.0.smithi152.stdout:8/428: dread - d1/d6/d34/d36/f67 zero size 2023-12-06T15:00:31.798 INFO:tasks.workunit.client.0.smithi152.stdout:1/802: read d3/f103 [3701374,21383] 0 2023-12-06T15:00:31.799 INFO:tasks.workunit.client.0.smithi152.stdout:1/803: chown d3/da/d4c/d82/d52/d55/d110 521490353 1 2023-12-06T15:00:31.799 INFO:tasks.workunit.client.1.smithi190.stdout:9/914: dwrite d4/d27/d2f/d31/d3f/d58/f59 [0,4194304] 0 2023-12-06T15:00:31.800 INFO:tasks.workunit.client.1.smithi190.stdout:8/746: write d1/f1b [466467,82765] 0 2023-12-06T15:00:31.801 INFO:tasks.workunit.client.0.smithi152.stdout:8/429: rmdir d1/d6/d34/d35/d38 39 2023-12-06T15:00:31.801 INFO:tasks.workunit.client.0.smithi152.stdout:8/430: write d1/d6/d34/d36/f67 [647682,62327] 0 2023-12-06T15:00:31.803 INFO:tasks.workunit.client.0.smithi152.stdout:8/431: link d1/d6/d34/d40/f52 d1/d6/d34/d40/f85 0 2023-12-06T15:00:31.803 INFO:tasks.workunit.client.0.smithi152.stdout:8/432: chown d1/d6/d34/d3a/l47 243648352 1 2023-12-06T15:00:31.805 INFO:tasks.workunit.client.0.smithi152.stdout:8/433: mkdir d1/d6/d86 0 2023-12-06T15:00:31.808 INFO:tasks.workunit.client.0.smithi152.stdout:4/732: dwrite d2/d89/fa3 [0,4194304] 0 2023-12-06T15:00:31.808 INFO:tasks.workunit.client.0.smithi152.stdout:4/733: dread - d2/d10/dbb/dca/dbc/d42/fc0 zero size 2023-12-06T15:00:31.808 INFO:tasks.workunit.client.0.smithi152.stdout:4/734: readlink d2/d10/dbb/dca/dbc/d42/la0 0 2023-12-06T15:00:31.809 INFO:tasks.workunit.client.0.smithi152.stdout:8/434: unlink d1/d6/d34/l5a 0 2023-12-06T15:00:31.810 INFO:tasks.workunit.client.0.smithi152.stdout:4/735: creat d2/d15/d32/d79/fe0 x:0 0 0 2023-12-06T15:00:31.810 INFO:tasks.workunit.client.0.smithi152.stdout:4/736: stat d2/d15/d32/dd0/cda 0 2023-12-06T15:00:31.810 INFO:tasks.workunit.client.0.smithi152.stdout:8/435: mkdir d1/d6/d29/d87 0 2023-12-06T15:00:31.811 INFO:tasks.workunit.client.1.smithi190.stdout:2/728: dwrite d10/d59/dcd/dad/dc4/d7f/d8e/dee/ff5 [0,4194304] 0 2023-12-06T15:00:31.811 INFO:tasks.workunit.client.1.smithi190.stdout:2/729: write d10/d26/d5c/f5a [4845506,108647] 0 2023-12-06T15:00:31.811 INFO:tasks.workunit.client.1.smithi190.stdout:3/826: dwrite d4/d1b/f37 [0,4194304] 0 2023-12-06T15:00:31.813 INFO:tasks.workunit.client.0.smithi152.stdout:8/436: symlink d1/d6/d34/d36/l88 0 2023-12-06T15:00:31.816 INFO:tasks.workunit.client.1.smithi190.stdout:2/730: unlink d10/f62 0 2023-12-06T15:00:31.816 INFO:tasks.workunit.client.1.smithi190.stdout:6/830: dwrite d4/d12/d1a/db4/fc0 [0,4194304] 0 2023-12-06T15:00:31.816 INFO:tasks.workunit.client.1.smithi190.stdout:6/831: fdatasync d4/d12/d1a/d32/fd1 0 2023-12-06T15:00:31.816 INFO:tasks.workunit.client.1.smithi190.stdout:6/832: stat d4/d12/d40/d43/d45/d4a/d77/cee 0 2023-12-06T15:00:31.818 INFO:tasks.workunit.client.0.smithi152.stdout:4/737: creat d2/d15/d32/d54/fe1 x:0 0 0 2023-12-06T15:00:31.818 INFO:tasks.workunit.client.1.smithi190.stdout:2/731: read d10/d59/d5e/f16 [2890719,11085] 0 2023-12-06T15:00:31.818 INFO:tasks.workunit.client.1.smithi190.stdout:2/732: chown d10/d59/dcd/dad/dc4/d7f/d8e/fbd 53587040 1 2023-12-06T15:00:31.819 INFO:tasks.workunit.client.1.smithi190.stdout:3/827: symlink d4/d70/d19/d3a/d3b/d72/df5/l125 0 2023-12-06T15:00:31.820 INFO:tasks.workunit.client.0.smithi152.stdout:0/520: sync 2023-12-06T15:00:31.821 INFO:tasks.workunit.client.0.smithi152.stdout:4/738: chown d2/d10/dab/dd9 92404 1 2023-12-06T15:00:31.823 INFO:tasks.workunit.client.0.smithi152.stdout:2/433: dwrite d6/d1e/f2f [0,4194304] 0 2023-12-06T15:00:31.823 INFO:tasks.workunit.client.0.smithi152.stdout:0/521: mknod d8/d15/d45/da4/ca9 0 2023-12-06T15:00:31.823 INFO:tasks.workunit.client.1.smithi190.stdout:3/828: rmdir d4/d70/d19/d51/d109/db7/dd2 39 2023-12-06T15:00:31.824 INFO:tasks.workunit.client.1.smithi190.stdout:2/733: symlink d10/d26/d5c/d37/d83/lf8 0 2023-12-06T15:00:31.824 INFO:tasks.workunit.client.1.smithi190.stdout:2/734: readlink d10/d26/d5c/d35/d77/lbe 0 2023-12-06T15:00:31.824 INFO:tasks.workunit.client.0.smithi152.stdout:4/739: rename d2/d10/d52/c46 to d2/d45/d84/ce2 0 2023-12-06T15:00:31.825 INFO:tasks.workunit.client.0.smithi152.stdout:2/434: symlink d6/d18/d70/l8c 0 2023-12-06T15:00:31.827 INFO:tasks.workunit.client.0.smithi152.stdout:4/740: link d2/d15/d32/d79/l49 d2/d15/d32/d69/le3 0 2023-12-06T15:00:31.827 INFO:tasks.workunit.client.0.smithi152.stdout:4/741: fdatasync d2/d15/d32/d54/fa2 0 2023-12-06T15:00:31.829 INFO:tasks.workunit.client.0.smithi152.stdout:2/435: symlink d6/d1e/d41/d55/l8d 0 2023-12-06T15:00:31.829 INFO:tasks.workunit.client.0.smithi152.stdout:2/436: readlink d6/l42 0 2023-12-06T15:00:31.829 INFO:tasks.workunit.client.0.smithi152.stdout:0/522: dread d8/d3e/d87/f59 [0,4194304] 0 2023-12-06T15:00:31.829 INFO:tasks.workunit.client.0.smithi152.stdout:0/523: read - d8/d4b/f51 zero size 2023-12-06T15:00:31.829 INFO:tasks.workunit.client.0.smithi152.stdout:7/407: sync 2023-12-06T15:00:31.830 INFO:tasks.workunit.client.0.smithi152.stdout:7/408: stat dd/l4b 0 2023-12-06T15:00:31.830 INFO:tasks.workunit.client.0.smithi152.stdout:7/409: fsync dd/df/d34/d44/d49/d73/f75 0 2023-12-06T15:00:31.832 INFO:tasks.workunit.client.0.smithi152.stdout:0/524: unlink d8/d15/d45/da4/ca9 0 2023-12-06T15:00:31.832 INFO:tasks.workunit.client.0.smithi152.stdout:0/525: chown d8/d44/fa3 226 1 2023-12-06T15:00:31.833 INFO:tasks.workunit.client.1.smithi190.stdout:6/833: dread d4/d12/d1a/d32/dab/dd3/fe0 [0,4194304] 0 2023-12-06T15:00:31.833 INFO:tasks.workunit.client.1.smithi190.stdout:2/735: dread d10/d26/d8a/fe8 [0,4194304] 0 2023-12-06T15:00:31.834 INFO:tasks.workunit.client.0.smithi152.stdout:2/437: read d6/d1e/f2e [69956,30793] 0 2023-12-06T15:00:31.836 INFO:tasks.workunit.client.1.smithi190.stdout:3/829: dread d4/d1b/d54/d9c/d68/dfc/d56/d94/d3d/fbf [0,4194304] 0 2023-12-06T15:00:31.844 INFO:tasks.workunit.client.0.smithi152.stdout:2/438: creat d6/f8e x:0 0 0 2023-12-06T15:00:31.844 INFO:tasks.workunit.client.1.smithi190.stdout:7/929: dwrite d0/df/d1f/dbd/fe6 [0,4194304] 0 2023-12-06T15:00:31.846 INFO:tasks.workunit.client.1.smithi190.stdout:0/736: dwrite d0/da/d3e/d3a/f7f [0,4194304] 0 2023-12-06T15:00:31.849 INFO:tasks.workunit.client.0.smithi152.stdout:2/439: symlink d6/d1e/l8f 0 2023-12-06T15:00:31.850 INFO:tasks.workunit.client.1.smithi190.stdout:8/747: dwrite d1/d37/fa2 [0,4194304] 0 2023-12-06T15:00:31.851 INFO:tasks.workunit.client.0.smithi152.stdout:7/410: dread f9 [0,4194304] 0 2023-12-06T15:00:31.851 INFO:tasks.workunit.client.0.smithi152.stdout:7/411: fdatasync dd/df/f43 0 2023-12-06T15:00:31.852 INFO:tasks.workunit.client.1.smithi190.stdout:9/915: rename d4/d27/d2f/d31/d3f/d58/d72/db3/dea/dcd/dff/fb4 to d4/d27/d2f/d31/d3f/f12e 0 2023-12-06T15:00:31.852 INFO:tasks.workunit.client.1.smithi190.stdout:0/737: symlink d0/da/da4/lee 0 2023-12-06T15:00:31.852 INFO:tasks.workunit.client.1.smithi190.stdout:0/738: fsync d0/da/d3e/d2b/d3c/d46/d8e/d90/fb3 0 2023-12-06T15:00:31.858 INFO:tasks.workunit.client.1.smithi190.stdout:0/739: creat d0/da/d3e/d3a/d40/d6f/d9e/de8/fef x:0 0 0 2023-12-06T15:00:31.859 INFO:tasks.workunit.client.0.smithi152.stdout:8/437: dwrite d1/d6/d34/d36/f55 [0,4194304] 0 2023-12-06T15:00:31.859 INFO:tasks.workunit.client.0.smithi152.stdout:8/438: write d1/f77 [615077,20994] 0 2023-12-06T15:00:31.860 INFO:tasks.workunit.client.1.smithi190.stdout:2/736: rename d10/d26/d5c/d49/d54/l74 to d10/d26/d5c/d49/lf9 0 2023-12-06T15:00:31.860 INFO:tasks.workunit.client.1.smithi190.stdout:2/737: getdents d10/d59/dcd/dde 0 2023-12-06T15:00:31.860 INFO:tasks.workunit.client.1.smithi190.stdout:2/738: chown d10/d26/d5c/d8d/fdc 126 1 2023-12-06T15:00:31.861 INFO:tasks.workunit.client.1.smithi190.stdout:7/930: unlink d0/d88/d1c/d17/f64 0 2023-12-06T15:00:31.863 INFO:tasks.workunit.client.1.smithi190.stdout:2/739: mkdir d10/d26/d8a/dfa 0 2023-12-06T15:00:31.863 INFO:tasks.workunit.client.0.smithi152.stdout:8/439: symlink d1/d6/d34/l89 0 2023-12-06T15:00:31.864 INFO:tasks.workunit.client.0.smithi152.stdout:8/440: chown d1/f3c 472492760 1 2023-12-06T15:00:31.864 INFO:tasks.workunit.client.0.smithi152.stdout:1/804: dwrite d3/da/d4c/ffb [0,4194304] 0 2023-12-06T15:00:31.866 INFO:tasks.workunit.client.0.smithi152.stdout:2/440: dread d6/db/d17/f23 [0,4194304] 0 2023-12-06T15:00:31.866 INFO:tasks.workunit.client.0.smithi152.stdout:2/441: chown d6/d1e/d41/d55/c6b 1710713 1 2023-12-06T15:00:31.866 INFO:tasks.workunit.client.0.smithi152.stdout:2/442: truncate d6/f40 1271592 0 2023-12-06T15:00:31.870 INFO:tasks.workunit.client.1.smithi190.stdout:2/740: mknod d10/d59/dcd/dad/dc4/cfb 0 2023-12-06T15:00:31.870 INFO:tasks.workunit.client.0.smithi152.stdout:8/441: creat d1/d6/d34/d35/d66/d82/f8a x:0 0 0 2023-12-06T15:00:31.874 INFO:tasks.workunit.client.0.smithi152.stdout:1/805: link d3/da/d4c/d82/d52/d62/dcc/cf2 d3/d44/c127 0 2023-12-06T15:00:31.874 INFO:tasks.workunit.client.1.smithi190.stdout:8/748: link d1/d20/d3b/d4c/d8e/da5/fb7 d1/d20/d3b/d4c/fde 0 2023-12-06T15:00:31.876 INFO:tasks.workunit.client.1.smithi190.stdout:2/741: truncate d10/d26/d5c/d49/d7e/fb8 64572 0 2023-12-06T15:00:31.878 INFO:tasks.workunit.client.1.smithi190.stdout:2/742: read d10/d59/d5e/f1b [3819189,77957] 0 2023-12-06T15:00:31.880 INFO:tasks.workunit.client.0.smithi152.stdout:7/412: dread dd/df/d1b/d20/d28/d53/f3f [0,4194304] 0 2023-12-06T15:00:31.883 INFO:tasks.workunit.client.1.smithi190.stdout:8/749: dread d1/d37/f85 [0,4194304] 0 2023-12-06T15:00:31.886 INFO:tasks.workunit.client.1.smithi190.stdout:5/716: creat d0/d1c/d3e/ffc x:0 0 0 2023-12-06T15:00:31.890 INFO:tasks.workunit.client.0.smithi152.stdout:7/413: mkdir dd/df/d1b/d20/d7c 0 2023-12-06T15:00:31.891 INFO:tasks.workunit.client.1.smithi190.stdout:5/717: getdents d0/d1c/d2b/d69 0 2023-12-06T15:00:31.895 INFO:tasks.workunit.client.1.smithi190.stdout:2/743: dread d10/d26/d5c/d37/d83/fa0 [0,4194304] 0 2023-12-06T15:00:31.901 INFO:tasks.workunit.client.1.smithi190.stdout:4/726: mknod d3/d35/d19/d41/cfa 0 2023-12-06T15:00:31.903 INFO:tasks.workunit.client.0.smithi152.stdout:1/806: dread d3/da/d4c/d82/d52/d55/f56 [0,4194304] 0 2023-12-06T15:00:31.903 INFO:tasks.workunit.client.0.smithi152.stdout:4/742: dwrite d2/d10/dbb/dca/dcb/fc9 [0,4194304] 0 2023-12-06T15:00:31.905 INFO:tasks.workunit.client.0.smithi152.stdout:4/743: mknod d2/d15/d32/d54/d85/ce4 0 2023-12-06T15:00:31.905 INFO:tasks.workunit.client.0.smithi152.stdout:4/744: stat d2/d15/d32 0 2023-12-06T15:00:31.906 INFO:tasks.workunit.client.0.smithi152.stdout:1/807: creat d3/da/d4c/d63/d96/f128 x:0 0 0 2023-12-06T15:00:31.909 INFO:tasks.workunit.client.0.smithi152.stdout:4/745: rename d2/d10/dbb/dca/cb0 to d2/d10/dbb/dca/dbc/ce5 0 2023-12-06T15:00:31.909 INFO:tasks.workunit.client.1.smithi190.stdout:2/744: write d10/d59/dcd/dad/dc4/d7f/d8e/dee/ff5 [521963,57830] 0 2023-12-06T15:00:31.911 INFO:tasks.workunit.client.0.smithi152.stdout:0/526: dwrite d8/d15/f18 [0,4194304] 0 2023-12-06T15:00:31.911 INFO:tasks.workunit.client.0.smithi152.stdout:0/527: readlink d8/d3e/d87/d76/d68/la0 0 2023-12-06T15:00:31.912 INFO:tasks.workunit.client.0.smithi152.stdout:0/528: creat d8/d15/d45/d73/faa x:0 0 0 2023-12-06T15:00:31.914 INFO:tasks.workunit.client.1.smithi190.stdout:3/830: dwrite d4/d1b/d54/f121 [0,4194304] 0 2023-12-06T15:00:31.915 INFO:tasks.workunit.client.1.smithi190.stdout:9/916: dwrite d4/d84/f10a [0,4194304] 0 2023-12-06T15:00:31.915 INFO:tasks.workunit.client.1.smithi190.stdout:9/917: chown d4/d27/d2f/d5c/d9d 8 1 2023-12-06T15:00:31.915 INFO:tasks.workunit.client.1.smithi190.stdout:9/918: readlink d4/d27/d2f/laa 0 2023-12-06T15:00:31.915 INFO:tasks.workunit.client.1.smithi190.stdout:0/740: dwrite d0/da/d3e/d3a/d40/d81/f63 [0,4194304] 0 2023-12-06T15:00:31.916 INFO:tasks.workunit.client.1.smithi190.stdout:2/745: link d10/d26/d5c/d35/d77/lb0 d10/d26/d5c/da5/ded/lfc 0 2023-12-06T15:00:31.916 INFO:tasks.workunit.client.1.smithi190.stdout:2/746: truncate d10/d26/d5c/d37/d83/fa0 652008 0 2023-12-06T15:00:31.920 INFO:tasks.workunit.client.1.smithi190.stdout:3/831: creat d4/d70/d19/d51/d109/db7/f126 x:0 0 0 2023-12-06T15:00:31.921 INFO:tasks.workunit.client.0.smithi152.stdout:4/746: write d2/d15/d32/d69/d6f/d6c/f73 [3634676,111240] 0 2023-12-06T15:00:31.921 INFO:tasks.workunit.client.0.smithi152.stdout:4/747: chown d2/d45/d84/fbf 127 1 2023-12-06T15:00:31.922 INFO:tasks.workunit.client.1.smithi190.stdout:9/919: creat d4/d27/d2f/d31/d3f/d58/dc5/d127/f12f x:0 0 0 2023-12-06T15:00:31.925 INFO:tasks.workunit.client.1.smithi190.stdout:9/920: read f1 [3928635,85829] 0 2023-12-06T15:00:31.925 INFO:tasks.workunit.client.1.smithi190.stdout:0/741: link d0/da/d3e/d3a/d40/l4f d0/da/d74/da2/lf0 0 2023-12-06T15:00:31.925 INFO:tasks.workunit.client.1.smithi190.stdout:2/747: mkdir d10/d26/d5c/d42/dfd 0 2023-12-06T15:00:31.925 INFO:tasks.workunit.client.1.smithi190.stdout:2/748: fsync d10/d59/dcd/dad/fc0 0 2023-12-06T15:00:31.925 INFO:tasks.workunit.client.1.smithi190.stdout:2/749: readlink d10/d26/d5c/da5/ded/lf4 0 2023-12-06T15:00:31.925 INFO:tasks.workunit.client.1.smithi190.stdout:3/832: mknod d4/d70/d19/d51/d109/db7/dd2/c127 0 2023-12-06T15:00:31.926 INFO:tasks.workunit.client.1.smithi190.stdout:9/921: getdents d4/d27/d2f/d31/d3f/d58/d7d 0 2023-12-06T15:00:31.927 INFO:tasks.workunit.client.1.smithi190.stdout:0/742: mknod d0/da/d3e/d2b/d3c/d4c/cf1 0 2023-12-06T15:00:31.927 INFO:tasks.workunit.client.1.smithi190.stdout:0/743: write d0/da/d3e/d2b/d3c/d65/f7c [691123,42591] 0 2023-12-06T15:00:31.927 INFO:tasks.workunit.client.0.smithi152.stdout:4/748: dread d2/d22/f18 [0,4194304] 0 2023-12-06T15:00:31.927 INFO:tasks.workunit.client.0.smithi152.stdout:4/749: fdatasync d2/d15/f62 0 2023-12-06T15:00:31.928 INFO:tasks.workunit.client.1.smithi190.stdout:9/922: getdents d4 0 2023-12-06T15:00:31.928 INFO:tasks.workunit.client.0.smithi152.stdout:4/750: link d2/d15/d32/lc2 d2/d10/dbb/dca/dbc/le6 0 2023-12-06T15:00:31.929 INFO:tasks.workunit.client.1.smithi190.stdout:2/750: read d10/d26/f27 [2815892,45566] 0 2023-12-06T15:00:31.930 INFO:tasks.workunit.client.1.smithi190.stdout:0/744: link d0/da/d3e/d2b/d3c/d65/f72 d0/da/ff2 0 2023-12-06T15:00:31.931 INFO:tasks.workunit.client.1.smithi190.stdout:9/923: rename d4/l5a to d4/d27/d2f/d31/d3f/d58/d7d/l130 0 2023-12-06T15:00:31.934 INFO:tasks.workunit.client.1.smithi190.stdout:9/924: creat d4/d27/d2f/d31/d3f/d58/dc5/d127/f131 x:0 0 0 2023-12-06T15:00:31.934 INFO:tasks.workunit.client.1.smithi190.stdout:9/925: readlink d4/d27/d2f/d5c/d9d/lbd 0 2023-12-06T15:00:31.934 INFO:tasks.workunit.client.1.smithi190.stdout:9/926: stat f2 0 2023-12-06T15:00:31.934 INFO:tasks.workunit.client.1.smithi190.stdout:9/927: creat d4/d27/f132 x:0 0 0 2023-12-06T15:00:31.935 INFO:tasks.workunit.client.1.smithi190.stdout:7/931: dwrite d0/df/d53/d2f/de9/f49 [4194304,4194304] 0 2023-12-06T15:00:31.936 INFO:tasks.workunit.client.1.smithi190.stdout:7/932: creat d0/d88/f12d x:0 0 0 2023-12-06T15:00:31.940 INFO:tasks.workunit.client.1.smithi190.stdout:3/833: write d4/d1b/d5d/faf [74055,102563] 0 2023-12-06T15:00:31.940 INFO:tasks.workunit.client.1.smithi190.stdout:3/834: chown d4/d1b/d54/d9c/d68/dfc/d56/d94/d3d/fd0 806 1 2023-12-06T15:00:31.940 INFO:tasks.workunit.client.0.smithi152.stdout:3/537: sync 2023-12-06T15:00:31.942 INFO:tasks.workunit.client.1.smithi190.stdout:3/835: mknod d4/d1b/c128 0 2023-12-06T15:00:31.943 INFO:tasks.workunit.client.1.smithi190.stdout:3/836: getdents d4/d70/d19/d3a/d3b 0 2023-12-06T15:00:31.951 INFO:tasks.workunit.client.0.smithi152.stdout:8/442: dwrite d1/d6/d34/d36/f26 [0,4194304] 0 2023-12-06T15:00:31.952 INFO:tasks.workunit.client.1.smithi190.stdout:3/837: write d4/d1b/d54/d9c/d68/dfc/d56/fa7 [1789408,82083] 0 2023-12-06T15:00:31.953 INFO:tasks.workunit.client.0.smithi152.stdout:8/443: truncate d1/f2d 271862 0 2023-12-06T15:00:31.953 INFO:tasks.workunit.client.0.smithi152.stdout:3/538: dread d9/d18/d1a/fa4 [0,4194304] 0 2023-12-06T15:00:31.954 INFO:tasks.workunit.client.0.smithi152.stdout:2/443: dwrite d6/d18/d70/f84 [0,4194304] 0 2023-12-06T15:00:31.954 INFO:tasks.workunit.client.1.smithi190.stdout:8/750: dwrite d1/d20/d3b/d4c/d8e/fd2 [0,4194304] 0 2023-12-06T15:00:31.955 INFO:tasks.workunit.client.1.smithi190.stdout:3/838: mknod d4/d70/dcb/c129 0 2023-12-06T15:00:31.955 INFO:tasks.workunit.client.1.smithi190.stdout:3/839: chown d4/d70/dcb/d11c 231 1 2023-12-06T15:00:31.956 INFO:tasks.workunit.client.0.smithi152.stdout:0/529: dwrite d8/d44/f72 [0,4194304] 0 2023-12-06T15:00:31.956 INFO:tasks.workunit.client.0.smithi152.stdout:1/808: dwrite d3/da/d15/f5e [0,4194304] 0 2023-12-06T15:00:31.956 INFO:tasks.workunit.client.0.smithi152.stdout:1/809: fdatasync d3/da/d15/d17/d1a/fb7 0 2023-12-06T15:00:31.956 INFO:tasks.workunit.client.1.smithi190.stdout:5/718: dwrite d0/d1c/d2b/d2c/f49 [0,4194304] 0 2023-12-06T15:00:31.957 INFO:tasks.workunit.client.1.smithi190.stdout:5/719: truncate d0/df/d50/f86 332019 0 2023-12-06T15:00:31.958 INFO:tasks.workunit.client.0.smithi152.stdout:2/444: getdents d6 0 2023-12-06T15:00:31.958 INFO:tasks.workunit.client.0.smithi152.stdout:8/444: rename d1/d6/d29/c4a to d1/d6/d34/d35/d66/d82/c8b 0 2023-12-06T15:00:31.958 INFO:tasks.workunit.client.1.smithi190.stdout:4/727: dwrite d3/d35/d19/f68 [0,4194304] 0 2023-12-06T15:00:31.960 INFO:tasks.workunit.client.1.smithi190.stdout:5/720: unlink d0/df/ce5 0 2023-12-06T15:00:31.962 INFO:tasks.workunit.client.0.smithi152.stdout:2/445: write d6/f40 [1705514,63189] 0 2023-12-06T15:00:31.965 INFO:tasks.workunit.client.0.smithi152.stdout:8/445: rename d1/d6/c6d to d1/d6/d86/c8c 0 2023-12-06T15:00:31.965 INFO:tasks.workunit.client.0.smithi152.stdout:2/446: mknod d6/d18/c90 0 2023-12-06T15:00:31.967 INFO:tasks.workunit.client.0.smithi152.stdout:0/530: rename d8/d3e/l94 to d8/d3e/d87/d76/d6e/lab 0 2023-12-06T15:00:31.967 INFO:tasks.workunit.client.0.smithi152.stdout:8/446: mkdir d1/d6/d34/d35/d8d 0 2023-12-06T15:00:31.968 INFO:tasks.workunit.client.1.smithi190.stdout:5/721: mkdir d0/d1c/d3e/dfd 0 2023-12-06T15:00:31.969 INFO:tasks.workunit.client.0.smithi152.stdout:7/414: dwrite fa [0,4194304] 0 2023-12-06T15:00:31.969 INFO:tasks.workunit.client.0.smithi152.stdout:2/447: mkdir d6/db/d91 0 2023-12-06T15:00:31.969 INFO:tasks.workunit.client.0.smithi152.stdout:0/531: getdents d8/d15 0 2023-12-06T15:00:31.970 INFO:tasks.workunit.client.0.smithi152.stdout:8/447: unlink d1/d6/d34/f21 0 2023-12-06T15:00:31.972 INFO:tasks.workunit.client.1.smithi190.stdout:3/840: dread d4/d1b/d54/d9c/d68/dfc/d56/d94/f91 [0,4194304] 0 2023-12-06T15:00:31.972 INFO:tasks.workunit.client.1.smithi190.stdout:3/841: readlink d4/d70/d33/l6b 0 2023-12-06T15:00:31.972 INFO:tasks.workunit.client.0.smithi152.stdout:2/448: write d6/db/d17/f74 [1338314,83615] 0 2023-12-06T15:00:31.975 INFO:tasks.workunit.client.0.smithi152.stdout:0/532: mkdir d8/d15/d45/d73/dac 0 2023-12-06T15:00:31.975 INFO:tasks.workunit.client.0.smithi152.stdout:0/533: truncate d8/d15/d45/d73/d7a/f1f 4210731 0 2023-12-06T15:00:31.975 INFO:tasks.workunit.client.0.smithi152.stdout:8/448: write d1/d6/d34/d36/f5d [1846160,76620] 0 2023-12-06T15:00:31.975 INFO:tasks.workunit.client.1.smithi190.stdout:2/751: rename d10/d26/d5c/da5 to d10/d26/d5c/d35/d77/d98/dfe 0 2023-12-06T15:00:31.975 INFO:tasks.workunit.client.1.smithi190.stdout:2/752: truncate d10/d26/d8a/d8f/fa7 122023 0 2023-12-06T15:00:31.975 INFO:tasks.workunit.client.1.smithi190.stdout:2/753: chown d10/d59/dcd/dad/fb5 2 1 2023-12-06T15:00:31.976 INFO:tasks.workunit.client.0.smithi152.stdout:2/449: getdents d6/d1e/d41 0 2023-12-06T15:00:31.976 INFO:tasks.workunit.client.0.smithi152.stdout:0/534: link d8/d3e/d87/c88 d8/d15/d45/da4/cad 0 2023-12-06T15:00:31.977 INFO:tasks.workunit.client.1.smithi190.stdout:2/754: dread d10/d26/d5c/d42/d9d/fe1 [0,4194304] 0 2023-12-06T15:00:31.977 INFO:tasks.workunit.client.1.smithi190.stdout:4/728: rename d3/f40 to d3/d76/d7c/d96/d15/ffb 0 2023-12-06T15:00:31.978 INFO:tasks.workunit.client.1.smithi190.stdout:4/729: chown d3/d76/d7c/d96/d7a/ca2 1429664 1 2023-12-06T15:00:31.978 INFO:tasks.workunit.client.0.smithi152.stdout:2/450: mkdir d6/d1e/d41/d92 0 2023-12-06T15:00:31.978 INFO:tasks.workunit.client.1.smithi190.stdout:3/842: getdents d4/d70/d19/d51/d109/db7 0 2023-12-06T15:00:31.979 INFO:tasks.workunit.client.1.smithi190.stdout:3/843: dread - d4/d1b/d54/d9c/d68/ff0 zero size 2023-12-06T15:00:31.979 INFO:tasks.workunit.client.1.smithi190.stdout:3/844: read - d4/d70/d33/d45/fdd zero size 2023-12-06T15:00:31.979 INFO:tasks.workunit.client.0.smithi152.stdout:2/451: creat d6/d1e/d41/d83/f93 x:0 0 0 2023-12-06T15:00:31.979 INFO:tasks.workunit.client.0.smithi152.stdout:2/452: fsync d6/d18/d43/f6d 0 2023-12-06T15:00:31.980 INFO:tasks.workunit.client.0.smithi152.stdout:8/449: dread d1/d6/d34/d40/f78 [0,4194304] 0 2023-12-06T15:00:31.983 INFO:tasks.workunit.client.0.smithi152.stdout:1/810: dwrite d3/da/db/fbf [0,4194304] 0 2023-12-06T15:00:31.983 INFO:tasks.workunit.client.0.smithi152.stdout:1/811: write d3/d44/d84/f9b [604858,100984] 0 2023-12-06T15:00:31.983 INFO:tasks.workunit.client.0.smithi152.stdout:1/812: chown d3/da/d15/d17/d4d/cbb 63 1 2023-12-06T15:00:31.983 INFO:tasks.workunit.client.1.smithi190.stdout:7/933: dwrite d0/d5/d63/fc3 [0,4194304] 0 2023-12-06T15:00:31.984 INFO:tasks.workunit.client.1.smithi190.stdout:9/928: dwrite d4/d27/d8a/dbc/fe2 [0,4194304] 0 2023-12-06T15:00:31.984 INFO:tasks.workunit.client.1.smithi190.stdout:9/929: write d4/d27/d2f/d31/d3f/d58/dc5/ffc [732126,36992] 0 2023-12-06T15:00:31.984 INFO:tasks.workunit.client.1.smithi190.stdout:4/730: creat d3/d76/d7c/d96/d39/ffc x:0 0 0 2023-12-06T15:00:31.984 INFO:tasks.workunit.client.1.smithi190.stdout:5/722: rename d0/d1c/d2b/d2c/d5d/d73/l3a to d0/df/lfe 0 2023-12-06T15:00:31.985 INFO:tasks.workunit.client.1.smithi190.stdout:3/845: write d4/d1b/d54/d9c/d68/dfc/d56/d94/f91 [1564835,53992] 0 2023-12-06T15:00:31.988 INFO:tasks.workunit.client.0.smithi152.stdout:8/450: symlink d1/d6/d34/l8e 0 2023-12-06T15:00:31.990 INFO:tasks.workunit.client.1.smithi190.stdout:4/731: symlink d3/d76/d7c/d8a/lfd 0 2023-12-06T15:00:31.990 INFO:tasks.workunit.client.1.smithi190.stdout:4/732: write d3/d35/d19/fe6 [474541,2358] 0 2023-12-06T15:00:31.991 INFO:tasks.workunit.client.0.smithi152.stdout:0/535: dread d8/d15/d45/d73/d7a/f36 [0,4194304] 0 2023-12-06T15:00:31.991 INFO:tasks.workunit.client.0.smithi152.stdout:0/536: write d8/d15/f93 [52551,33707] 0 2023-12-06T15:00:31.991 INFO:tasks.workunit.client.0.smithi152.stdout:0/537: readlink d8/d15/d45/d73/d7a/l1d 0 2023-12-06T15:00:31.991 INFO:tasks.workunit.client.0.smithi152.stdout:0/538: stat d8/d44/c5d 0 2023-12-06T15:00:31.992 INFO:tasks.workunit.client.0.smithi152.stdout:0/539: fsync d8/d44/f91 0 2023-12-06T15:00:31.992 INFO:tasks.workunit.client.0.smithi152.stdout:1/813: unlink d3/da/f35 0 2023-12-06T15:00:31.992 INFO:tasks.workunit.client.1.smithi190.stdout:5/723: truncate d0/d1c/d2b/d2c/d5d/d73/f58 2926330 0 2023-12-06T15:00:31.992 INFO:tasks.workunit.client.1.smithi190.stdout:9/930: write d4/d27/d2f/d5c/f6c [938094,127036] 0 2023-12-06T15:00:31.996 INFO:tasks.workunit.client.0.smithi152.stdout:8/451: unlink d1/d6/ff 0 2023-12-06T15:00:31.997 INFO:tasks.workunit.client.1.smithi190.stdout:3/846: link d4/d70/lc5 d4/d70/d19/d3a/d3b/l12a 0 2023-12-06T15:00:31.999 INFO:tasks.workunit.client.0.smithi152.stdout:0/540: mknod d8/d15/d45/d73/d8c/cae 0 2023-12-06T15:00:32.001 INFO:tasks.workunit.client.1.smithi190.stdout:2/755: dwrite d10/d26/d8a/fe8 [0,4194304] 0 2023-12-06T15:00:32.003 INFO:tasks.workunit.client.0.smithi152.stdout:8/452: mknod d1/d6/d34/d35/d8d/c8f 0 2023-12-06T15:00:32.003 INFO:tasks.workunit.client.0.smithi152.stdout:0/541: creat d8/d3e/d87/faf x:0 0 0 2023-12-06T15:00:32.003 INFO:tasks.workunit.client.0.smithi152.stdout:8/453: fdatasync d1/d6/f1b 0 2023-12-06T15:00:32.004 INFO:tasks.workunit.client.1.smithi190.stdout:7/934: dwrite d0/d5/d63/ffd [0,4194304] 0 2023-12-06T15:00:32.005 INFO:tasks.workunit.client.1.smithi190.stdout:4/733: dread d3/d76/dc4/dc5/f86 [0,4194304] 0 2023-12-06T15:00:32.005 INFO:tasks.workunit.client.0.smithi152.stdout:5/567: sync 2023-12-06T15:00:32.005 INFO:tasks.workunit.client.0.smithi152.stdout:9/475: sync 2023-12-06T15:00:32.005 INFO:tasks.workunit.client.0.smithi152.stdout:5/568: write d7/dd/d26/d3a/f6b [1313671,48917] 0 2023-12-06T15:00:32.007 INFO:tasks.workunit.client.0.smithi152.stdout:8/454: mkdir d1/d6/d34/d90 0 2023-12-06T15:00:32.007 INFO:tasks.workunit.client.1.smithi190.stdout:8/751: truncate d1/d20/d3b/d4c/d8e/d94/d1c/f64 6087564 0 2023-12-06T15:00:32.008 INFO:tasks.workunit.client.0.smithi152.stdout:9/476: dread d0/d3f/d68/d6c/d20/d38/d44/f77 [0,4194304] 0 2023-12-06T15:00:32.010 INFO:tasks.workunit.client.0.smithi152.stdout:9/477: mknod d0/d3f/d5f/c83 0 2023-12-06T15:00:32.010 INFO:tasks.workunit.client.0.smithi152.stdout:0/542: dread d8/d3e/d87/f5f [0,4194304] 0 2023-12-06T15:00:32.010 INFO:tasks.workunit.client.0.smithi152.stdout:0/543: dread - d8/d3e/f9c zero size 2023-12-06T15:00:32.011 INFO:tasks.workunit.client.0.smithi152.stdout:6/749: sync 2023-12-06T15:00:32.011 INFO:tasks.workunit.client.0.smithi152.stdout:9/478: symlink d0/d3f/d68/d6c/d20/l84 0 2023-12-06T15:00:32.013 INFO:tasks.workunit.client.0.smithi152.stdout:0/544: rename d8/d44/f72 to d8/d3e/fb0 0 2023-12-06T15:00:32.015 INFO:tasks.workunit.client.1.smithi190.stdout:9/931: symlink d4/d27/d2f/d31/d3f/d58/d7d/l133 0 2023-12-06T15:00:32.015 INFO:tasks.workunit.client.1.smithi190.stdout:5/724: creat d0/d1c/d85/d90/dba/fff x:0 0 0 2023-12-06T15:00:32.015 INFO:tasks.workunit.client.1.smithi190.stdout:9/932: write d4/d27/d2f/d5c/d9d/f11c [138551,95234] 0 2023-12-06T15:00:32.015 INFO:tasks.workunit.client.0.smithi152.stdout:1/814: dwrite d3/da/d15/d17/d43/d7d/f98 [0,4194304] 0 2023-12-06T15:00:32.016 INFO:tasks.workunit.client.0.smithi152.stdout:6/750: write d1/dcf/ddc/d1a/d30/d36/d35/d49/d57/f99 [1869906,56651] 0 2023-12-06T15:00:32.017 INFO:tasks.workunit.client.0.smithi152.stdout:8/455: dread d1/d6/d34/d6f/f70 [0,4194304] 0 2023-12-06T15:00:32.017 INFO:tasks.workunit.client.0.smithi152.stdout:9/479: rename d0/f34 to d0/d3f/d68/d6c/d20/d38/d45/f85 0 2023-12-06T15:00:32.017 INFO:tasks.workunit.client.0.smithi152.stdout:9/480: chown d0/d50/c55 3209736 1 2023-12-06T15:00:32.021 INFO:tasks.workunit.client.0.smithi152.stdout:1/815: creat d3/da/d15/d17/d58/d9f/f129 x:0 0 0 2023-12-06T15:00:32.021 INFO:tasks.workunit.client.0.smithi152.stdout:1/816: fdatasync d3/d44/d84/de2/f122 0 2023-12-06T15:00:32.022 INFO:tasks.workunit.client.0.smithi152.stdout:8/456: rmdir d1/d6/d29/d74 39 2023-12-06T15:00:32.022 INFO:tasks.workunit.client.1.smithi190.stdout:2/756: creat d10/d59/dcd/dad/df6/fff x:0 0 0 2023-12-06T15:00:32.024 INFO:tasks.workunit.client.0.smithi152.stdout:6/751: rename d1/dcf/ddc/f71 to d1/dcf/ddc/d1a/d30/d36/d35/dd1/f10d 0 2023-12-06T15:00:32.024 INFO:tasks.workunit.client.0.smithi152.stdout:6/752: write d1/dcf/ddc/d1a/d30/d36/d35/d49/fef [842148,100624] 0 2023-12-06T15:00:32.024 INFO:tasks.workunit.client.1.smithi190.stdout:7/935: link d0/d88/d41/df4/c116 d0/d88/d41/c12e 0 2023-12-06T15:00:32.024 INFO:tasks.workunit.client.1.smithi190.stdout:7/936: fsync d0/d88/d7a/d7c/dab/dc0/ff7 0 2023-12-06T15:00:32.024 INFO:tasks.workunit.client.1.smithi190.stdout:7/937: dread - d0/df/d53/d15/ffc zero size 2023-12-06T15:00:32.026 INFO:tasks.workunit.client.0.smithi152.stdout:1/817: write d3/d44/f78 [3642198,115256] 0 2023-12-06T15:00:32.026 INFO:tasks.workunit.client.0.smithi152.stdout:9/481: mkdir d0/d3f/d5f/d86 0 2023-12-06T15:00:32.026 INFO:tasks.workunit.client.1.smithi190.stdout:4/734: rename d3/d35/d19/d41/d44/f70 to d3/d76/d7c/d8a/ffe 0 2023-12-06T15:00:32.027 INFO:tasks.workunit.client.0.smithi152.stdout:8/457: unlink d1/d6/d34/d40/f85 0 2023-12-06T15:00:32.031 INFO:tasks.workunit.client.1.smithi190.stdout:7/938: dread d0/d5/d63/f96 [4194304,4194304] 0 2023-12-06T15:00:32.031 INFO:tasks.workunit.client.1.smithi190.stdout:8/752: mkdir d1/d20/d3b/d4c/d59/daa/ddf 0 2023-12-06T15:00:32.031 INFO:tasks.workunit.client.1.smithi190.stdout:8/753: readlink d1/d20/d3b/d4c/d59/daa/lc8 0 2023-12-06T15:00:32.031 INFO:tasks.workunit.client.1.smithi190.stdout:5/725: mknod d0/d6c/da7/c100 0 2023-12-06T15:00:32.032 INFO:tasks.workunit.client.0.smithi152.stdout:9/482: link d0/d3f/d68/d6c/d20/d38/d44/f58 d0/d3f/d68/d6c/d20/d4a/d4d/f87 0 2023-12-06T15:00:32.034 INFO:tasks.workunit.client.1.smithi190.stdout:9/933: link d4/d27/d2f/d31/d3f/d58/d72/db3/fc7 d4/d27/d2f/d31/d3f/d58/d72/f134 0 2023-12-06T15:00:32.034 INFO:tasks.workunit.client.1.smithi190.stdout:9/934: chown d4/d27/d2f/f102 2405 1 2023-12-06T15:00:32.034 INFO:tasks.workunit.client.0.smithi152.stdout:8/458: creat d1/d6/d29/f91 x:0 0 0 2023-12-06T15:00:32.035 INFO:tasks.workunit.client.0.smithi152.stdout:9/483: symlink d0/d3f/d5f/l88 0 2023-12-06T15:00:32.035 INFO:tasks.workunit.client.1.smithi190.stdout:4/735: symlink d3/d35/da5/lff 0 2023-12-06T15:00:32.035 INFO:tasks.workunit.client.1.smithi190.stdout:2/757: dread d10/d59/dcd/dad/fbf [0,4194304] 0 2023-12-06T15:00:32.036 INFO:tasks.workunit.client.0.smithi152.stdout:8/459: mknod d1/d6/d34/d6f/c92 0 2023-12-06T15:00:32.037 INFO:tasks.workunit.client.1.smithi190.stdout:8/754: mkdir d1/d20/d3b/d4c/d8e/d94/d1c/de0 0 2023-12-06T15:00:32.037 INFO:tasks.workunit.client.0.smithi152.stdout:5/569: dwrite d7/dd/f3c [0,4194304] 0 2023-12-06T15:00:32.037 INFO:tasks.workunit.client.0.smithi152.stdout:5/570: stat d7/dd/c41 0 2023-12-06T15:00:32.037 INFO:tasks.workunit.client.0.smithi152.stdout:6/753: dread d1/dcf/ddc/d1a/d30/d36/d35/d63/f9b [0,4194304] 0 2023-12-06T15:00:32.038 INFO:tasks.workunit.client.1.smithi190.stdout:5/726: unlink d0/df/d50/la9 0 2023-12-06T15:00:32.038 INFO:tasks.workunit.client.1.smithi190.stdout:5/727: fdatasync d0/d1c/d2b/d69/f8e 0 2023-12-06T15:00:32.039 INFO:tasks.workunit.client.1.smithi190.stdout:4/736: truncate d3/d76/d7c/d96/f2a 4202677 0 2023-12-06T15:00:32.039 INFO:tasks.workunit.client.0.smithi152.stdout:6/754: symlink d1/dcf/ddc/d1a/d30/d36/d26/l10e 0 2023-12-06T15:00:32.039 INFO:tasks.workunit.client.0.smithi152.stdout:6/755: fdatasync d1/dcf/ddc/d1a/d30/da4/fec 0 2023-12-06T15:00:32.040 INFO:tasks.workunit.client.1.smithi190.stdout:2/758: creat d10/d59/dcd/dad/f100 x:0 0 0 2023-12-06T15:00:32.041 INFO:tasks.workunit.client.0.smithi152.stdout:5/571: write d7/d47/f74 [3705167,67535] 0 2023-12-06T15:00:32.041 INFO:tasks.workunit.client.0.smithi152.stdout:5/572: dread - d7/dd/d26/d3b/fa1 zero size 2023-12-06T15:00:32.041 INFO:tasks.workunit.client.0.smithi152.stdout:5/573: stat d7/dd/d26/d3b/d46/c4c 0 2023-12-06T15:00:32.041 INFO:tasks.workunit.client.1.smithi190.stdout:2/759: read d10/fd3 [2285965,24283] 0 2023-12-06T15:00:32.042 INFO:tasks.workunit.client.1.smithi190.stdout:5/728: creat d0/d1c/d85/d90/f101 x:0 0 0 2023-12-06T15:00:32.044 INFO:tasks.workunit.client.0.smithi152.stdout:5/574: mkdir d7/d43/d6c/d98/dc8 0 2023-12-06T15:00:32.044 INFO:tasks.workunit.client.0.smithi152.stdout:5/575: readlink d7/d43/l50 0 2023-12-06T15:00:32.044 INFO:tasks.workunit.client.1.smithi190.stdout:4/737: mkdir d3/da4/dd0/d100 0 2023-12-06T15:00:32.044 INFO:tasks.workunit.client.1.smithi190.stdout:7/939: dread d0/df/d53/d2f/fb8 [0,4194304] 0 2023-12-06T15:00:32.045 INFO:tasks.workunit.client.0.smithi152.stdout:5/576: mkdir d7/dd/d26/d3b/d46/dc9 0 2023-12-06T15:00:32.045 INFO:tasks.workunit.client.1.smithi190.stdout:2/760: read d10/d26/d5c/d42/d9d/fae [2209550,89540] 0 2023-12-06T15:00:32.046 INFO:tasks.workunit.client.1.smithi190.stdout:4/738: mknod d3/d35/d97/c101 0 2023-12-06T15:00:32.048 INFO:tasks.workunit.client.0.smithi152.stdout:8/460: read d1/f2d [50737,92375] 0 2023-12-06T15:00:32.049 INFO:tasks.workunit.client.1.smithi190.stdout:2/761: creat d10/d26/d5c/d35/d77/d98/dfe/ded/f101 x:0 0 0 2023-12-06T15:00:32.049 INFO:tasks.workunit.client.1.smithi190.stdout:2/762: write d10/d26/d8a/d8f/ff1 [305448,82154] 0 2023-12-06T15:00:32.049 INFO:tasks.workunit.client.1.smithi190.stdout:3/847: dwrite d4/d1b/d54/d9c/d68/d8a/ffb [0,4194304] 0 2023-12-06T15:00:32.049 INFO:tasks.workunit.client.1.smithi190.stdout:3/848: chown d4/d1b/d5d/df1/db5/lf4 0 1 2023-12-06T15:00:32.049 INFO:tasks.workunit.client.1.smithi190.stdout:3/849: write d4/d70/d19/d51/d109/db7/dd2/f10b [649759,84132] 0 2023-12-06T15:00:32.049 INFO:tasks.workunit.client.0.smithi152.stdout:5/577: mknod d7/d43/d6c/d98/cca 0 2023-12-06T15:00:32.052 INFO:tasks.workunit.client.0.smithi152.stdout:0/545: dwrite d8/d3e/d87/faf [0,4194304] 0 2023-12-06T15:00:32.053 INFO:tasks.workunit.client.0.smithi152.stdout:5/578: link d7/dd/d4e/f55 d7/dd/d4e/dac/fcb 0 2023-12-06T15:00:32.057 INFO:tasks.workunit.client.0.smithi152.stdout:9/484: dread d0/f24 [4194304,4194304] 0 2023-12-06T15:00:32.058 INFO:tasks.workunit.client.0.smithi152.stdout:0/546: rename d8/d3e/d87/d76/d6e/c82 to d8/d15/d45/d73/cb1 0 2023-12-06T15:00:32.058 INFO:tasks.workunit.client.0.smithi152.stdout:5/579: symlink d7/dd/d26/d3b/d46/d7e/lcc 0 2023-12-06T15:00:32.058 INFO:tasks.workunit.client.1.smithi190.stdout:9/935: dread d4/d27/d2f/d31/ff5 [0,4194304] 0 2023-12-06T15:00:32.058 INFO:tasks.workunit.client.1.smithi190.stdout:9/936: dread d4/d27/d2f/d31/d3f/d58/d72/db3/dea/dcd/fe3 [0,4194304] 0 2023-12-06T15:00:32.058 INFO:tasks.workunit.client.1.smithi190.stdout:3/850: mkdir d4/d1b/d12b 0 2023-12-06T15:00:32.063 INFO:tasks.workunit.client.1.smithi190.stdout:3/851: symlink d4/l12c 0 2023-12-06T15:00:32.063 INFO:tasks.workunit.client.1.smithi190.stdout:3/852: chown d4/d1b/d54/d9c/d68/dfc/d56/d94/f4e 0 1 2023-12-06T15:00:32.067 INFO:tasks.workunit.client.0.smithi152.stdout:9/485: mknod d0/d3f/d68/d6c/d20/c89 0 2023-12-06T15:00:32.067 INFO:tasks.workunit.client.0.smithi152.stdout:0/547: link d8/c47 d8/d15/d45/da4/cb2 0 2023-12-06T15:00:32.067 INFO:tasks.workunit.client.0.smithi152.stdout:5/580: creat d7/dd/d26/d3b/d46/d7e/fcd x:0 0 0 2023-12-06T15:00:32.067 INFO:tasks.workunit.client.0.smithi152.stdout:5/581: chown d7/dd/d26/d87/c9b 1458 1 2023-12-06T15:00:32.068 INFO:tasks.workunit.client.1.smithi190.stdout:7/940: dread d0/d5/f78 [0,4194304] 0 2023-12-06T15:00:32.068 INFO:tasks.workunit.client.1.smithi190.stdout:8/755: dread d1/d20/d3b/d4c/d8e/d94/d1c/f64 [4194304,4194304] 0 2023-12-06T15:00:32.068 INFO:tasks.workunit.client.1.smithi190.stdout:8/756: fdatasync d1/d20/fd4 0 2023-12-06T15:00:32.071 INFO:tasks.workunit.client.0.smithi152.stdout:9/486: rmdir d0/d3f/d68/d6c 39 2023-12-06T15:00:32.071 INFO:tasks.workunit.client.1.smithi190.stdout:7/941: unlink d0/d5/f7f 0 2023-12-06T15:00:32.072 INFO:tasks.workunit.client.0.smithi152.stdout:5/582: creat d7/dd/d26/d3b/d46/d7e/fce x:0 0 0 2023-12-06T15:00:32.072 INFO:tasks.workunit.client.0.smithi152.stdout:5/583: readlink d7/dd/d26/d3b/d46/d7e/l95 0 2023-12-06T15:00:32.072 INFO:tasks.workunit.client.0.smithi152.stdout:5/584: fdatasync d7/dd/d26/d3a/f7b 0 2023-12-06T15:00:32.072 INFO:tasks.workunit.client.0.smithi152.stdout:5/585: chown d7/dd/d4e/f5c 60191 1 2023-12-06T15:00:32.073 INFO:tasks.workunit.client.1.smithi190.stdout:8/757: creat d1/d20/d3b/d4c/fe1 x:0 0 0 2023-12-06T15:00:32.073 INFO:tasks.workunit.client.1.smithi190.stdout:7/942: getdents d0/df/d53 0 2023-12-06T15:00:32.074 INFO:tasks.workunit.client.1.smithi190.stdout:7/943: mkdir d0/d88/d32/d12f 0 2023-12-06T15:00:32.077 INFO:tasks.workunit.client.1.smithi190.stdout:3/853: dread d4/d1b/d54/d9c/d68/dfc/d56/d94/f81 [0,4194304] 0 2023-12-06T15:00:32.078 INFO:tasks.workunit.client.0.smithi152.stdout:5/586: write d7/dd/d26/d48/f85 [150523,102651] 0 2023-12-06T15:00:32.078 INFO:tasks.workunit.client.0.smithi152.stdout:5/587: truncate d7/dd/f3c 4339929 0 2023-12-06T15:00:32.079 INFO:tasks.workunit.client.0.smithi152.stdout:5/588: readlink d7/dd/d26/d3a/l45 0 2023-12-06T15:00:32.082 INFO:tasks.workunit.client.0.smithi152.stdout:9/487: dread d0/f1c [0,4194304] 0 2023-12-06T15:00:32.083 INFO:tasks.workunit.client.1.smithi190.stdout:7/944: read d0/d88/d7a/fbe [2942725,95653] 0 2023-12-06T15:00:32.083 INFO:tasks.workunit.client.1.smithi190.stdout:7/945: fdatasync d0/d5/d63/f96 0 2023-12-06T15:00:32.085 INFO:tasks.workunit.client.0.smithi152.stdout:5/589: creat d7/dd/d26/d48/fcf x:0 0 0 2023-12-06T15:00:32.087 INFO:tasks.workunit.client.0.smithi152.stdout:9/488: creat d0/d3f/d68/d6c/d20/d38/d44/f8a x:0 0 0 2023-12-06T15:00:32.088 INFO:tasks.workunit.client.0.smithi152.stdout:5/590: mknod d7/dd/d26/d48/dbb/cd0 0 2023-12-06T15:00:32.088 INFO:tasks.workunit.client.0.smithi152.stdout:5/591: write d7/dd/d26/d3b/f6e [1467006,8108] 0 2023-12-06T15:00:32.090 INFO:tasks.workunit.client.0.smithi152.stdout:9/489: link d0/c13 d0/d3f/d5f/d60/c8b 0 2023-12-06T15:00:32.091 INFO:tasks.workunit.client.0.smithi152.stdout:9/490: dread - d0/d3f/d68/d6c/d20/d38/f6e zero size 2023-12-06T15:00:32.094 INFO:tasks.workunit.client.0.smithi152.stdout:9/491: unlink d0/d3f/d68/d6c/d20/d38/l54 0 2023-12-06T15:00:32.095 INFO:tasks.workunit.client.0.smithi152.stdout:9/492: write d0/d3f/d68/d6c/f2f [104202,83493] 0 2023-12-06T15:00:32.097 INFO:tasks.workunit.client.0.smithi152.stdout:9/493: mknod d0/d3f/d68/d6c/d20/d38/d45/c8c 0 2023-12-06T15:00:32.099 INFO:tasks.workunit.client.0.smithi152.stdout:9/494: unlink d0/d3f/c7f 0 2023-12-06T15:00:32.101 INFO:tasks.workunit.client.0.smithi152.stdout:9/495: symlink d0/d3f/d68/d6c/l8d 0 2023-12-06T15:00:32.103 INFO:tasks.workunit.client.0.smithi152.stdout:8/461: dwrite d1/d6/d34/d35/d38/f54 [0,4194304] 0 2023-12-06T15:00:32.103 INFO:tasks.workunit.client.0.smithi152.stdout:8/462: write d1/d6/d34/d35/d38/f41 [1555822,58870] 0 2023-12-06T15:00:32.104 INFO:tasks.workunit.client.1.smithi190.stdout:2/763: dwrite d10/d59/dcd/dad/fc0 [0,4194304] 0 2023-12-06T15:00:32.106 INFO:tasks.workunit.client.1.smithi190.stdout:2/764: mknod d10/d59/dcd/dad/c102 0 2023-12-06T15:00:32.106 INFO:tasks.workunit.client.1.smithi190.stdout:2/765: read - d10/d26/d5c/f96 zero size 2023-12-06T15:00:32.107 INFO:tasks.workunit.client.1.smithi190.stdout:2/766: rmdir d10/d26/d5c/d35 39 2023-12-06T15:00:32.107 INFO:tasks.workunit.client.1.smithi190.stdout:2/767: readlink d10/d59/d5e/l9e 0 2023-12-06T15:00:32.108 INFO:tasks.workunit.client.1.smithi190.stdout:2/768: truncate d10/d26/d5c/d35/d77/d98/fa8 757899 0 2023-12-06T15:00:32.109 INFO:tasks.workunit.client.0.smithi152.stdout:8/463: mknod d1/d6/d34/c93 0 2023-12-06T15:00:32.109 INFO:tasks.workunit.client.0.smithi152.stdout:8/464: readlink d1/d6/d34/d36/l88 0 2023-12-06T15:00:32.109 INFO:tasks.workunit.client.0.smithi152.stdout:8/465: truncate d1/d6/d34/d40/f78 953848 0 2023-12-06T15:00:32.109 INFO:tasks.workunit.client.0.smithi152.stdout:8/466: truncate d1/d6/d29/f91 676856 0 2023-12-06T15:00:32.109 INFO:tasks.workunit.client.1.smithi190.stdout:2/769: creat d10/d59/dcd/dad/dc4/f103 x:0 0 0 2023-12-06T15:00:32.109 INFO:tasks.workunit.client.1.smithi190.stdout:4/739: dwrite d3/d35/d19/f79 [0,4194304] 0 2023-12-06T15:00:32.110 INFO:tasks.workunit.client.0.smithi152.stdout:5/592: dwrite d7/dd/d4e/f5c [0,4194304] 0 2023-12-06T15:00:32.110 INFO:tasks.workunit.client.0.smithi152.stdout:8/467: rmdir d1/d6/d34/d40/d64 39 2023-12-06T15:00:32.111 INFO:tasks.workunit.client.1.smithi190.stdout:8/758: dwrite d1/d20/d3b/d4c/d59/f81 [0,4194304] 0 2023-12-06T15:00:32.111 INFO:tasks.workunit.client.1.smithi190.stdout:9/937: dwrite d4/fe4 [4194304,4194304] 0 2023-12-06T15:00:32.111 INFO:tasks.workunit.client.1.smithi190.stdout:9/938: write d4/d27/d2f/f5e [3143483,21936] 0 2023-12-06T15:00:32.111 INFO:tasks.workunit.client.1.smithi190.stdout:3/854: dwrite d4/d70/d19/d3a/d3b/d72/f86 [0,4194304] 0 2023-12-06T15:00:32.111 INFO:tasks.workunit.client.1.smithi190.stdout:2/770: creat d10/d59/dcd/dad/df6/f104 x:0 0 0 2023-12-06T15:00:32.111 INFO:tasks.workunit.client.0.smithi152.stdout:9/496: dread d0/d3f/d68/d6c/d20/f3c [0,4194304] 0 2023-12-06T15:00:32.114 INFO:tasks.workunit.client.1.smithi190.stdout:4/740: rmdir d3/d35/da6 39 2023-12-06T15:00:32.118 INFO:tasks.workunit.client.1.smithi190.stdout:9/939: creat d4/d27/d2f/d31/d3f/d58/d72/db3/dea/dcd/dff/f135 x:0 0 0 2023-12-06T15:00:32.120 INFO:tasks.workunit.client.1.smithi190.stdout:3/855: creat d4/d70/d19/d3a/d3b/d72/f12d x:0 0 0 2023-12-06T15:00:32.120 INFO:tasks.workunit.client.1.smithi190.stdout:4/741: getdents d3/d76/dc4/dc5/daa 0 2023-12-06T15:00:32.120 INFO:tasks.workunit.client.0.smithi152.stdout:5/593: rename d7/dd/f2a to d7/d43/d6c/fd1 0 2023-12-06T15:00:32.120 INFO:tasks.workunit.client.0.smithi152.stdout:5/594: chown d7/dd/d4e/f73 0 1 2023-12-06T15:00:32.121 INFO:tasks.workunit.client.1.smithi190.stdout:3/856: truncate d4/d1b/d54/f9e 1300248 0 2023-12-06T15:00:32.121 INFO:tasks.workunit.client.1.smithi190.stdout:3/857: chown d4/d1b/d54/f97 30289488 1 2023-12-06T15:00:32.121 INFO:tasks.workunit.client.1.smithi190.stdout:9/940: rename d4/c105 to d4/d27/d2f/d31/d3f/d58/d72/db3/c136 0 2023-12-06T15:00:32.123 INFO:tasks.workunit.client.1.smithi190.stdout:4/742: creat d3/d35/d19/d67/f102 x:0 0 0 2023-12-06T15:00:32.123 INFO:tasks.workunit.client.0.smithi152.stdout:8/468: rmdir d1/d6/d34/d35/d66 39 2023-12-06T15:00:32.125 INFO:tasks.workunit.client.0.smithi152.stdout:5/595: symlink d7/dd/d26/db1/ld2 0 2023-12-06T15:00:32.126 INFO:tasks.workunit.client.1.smithi190.stdout:9/941: link d4/d27/f126 d4/d27/d2f/d31/d3f/d58/d72/db3/f137 0 2023-12-06T15:00:32.126 INFO:tasks.workunit.client.1.smithi190.stdout:2/771: dread d10/d59/dcd/dad/fc0 [0,4194304] 0 2023-12-06T15:00:32.126 INFO:tasks.workunit.client.1.smithi190.stdout:9/942: write d4/d27/d2f/d31/d3f/d58/d72/db3/dea/dcd/fd9 [399795,90615] 0 2023-12-06T15:00:32.126 INFO:tasks.workunit.client.1.smithi190.stdout:4/743: truncate d3/d76/dc4/dc5/f94 679519 0 2023-12-06T15:00:32.126 INFO:tasks.workunit.client.1.smithi190.stdout:4/744: chown d3/d35/d19/d41/d44/leb 1069292 1 2023-12-06T15:00:32.127 INFO:tasks.workunit.client.1.smithi190.stdout:3/858: dread d4/d1b/d54/d9c/d68/dfc/d56/d83/f87 [0,4194304] 0 2023-12-06T15:00:32.128 INFO:tasks.workunit.client.0.smithi152.stdout:5/596: rename d7/dd/d26/f3d to d7/dd/d26/d48/d97/dc2/fd3 0 2023-12-06T15:00:32.129 INFO:tasks.workunit.client.1.smithi190.stdout:2/772: rename d10/d59/l91 to d10/d26/d5c/d49/d7e/dcf/l105 0 2023-12-06T15:00:32.129 INFO:tasks.workunit.client.1.smithi190.stdout:2/773: write d10/d59/dcd/dad/f100 [532798,107317] 0 2023-12-06T15:00:32.129 INFO:tasks.workunit.client.1.smithi190.stdout:2/774: write d10/d59/dcd/dad/dc4/fca [698372,47399] 0 2023-12-06T15:00:32.129 INFO:tasks.workunit.client.1.smithi190.stdout:4/745: mkdir d3/d76/d7c/d96/d15/d103 0 2023-12-06T15:00:32.130 INFO:tasks.workunit.client.1.smithi190.stdout:3/859: symlink d4/d70/d19/d111/l12e 0 2023-12-06T15:00:32.131 INFO:tasks.workunit.client.0.smithi152.stdout:5/597: truncate d7/dd/d26/d3a/f4f 2045175 0 2023-12-06T15:00:32.132 INFO:tasks.workunit.client.1.smithi190.stdout:2/775: rename d10/d26/d5c/d35/dd8 to d10/d26/d5c/d35/d77/d98/dfe/d106 0 2023-12-06T15:00:32.133 INFO:tasks.workunit.client.1.smithi190.stdout:9/943: dread d4/f2d [0,4194304] 0 2023-12-06T15:00:32.134 INFO:tasks.workunit.client.1.smithi190.stdout:8/759: dwrite d1/d20/d3b/d36/fbd [0,4194304] 0 2023-12-06T15:00:32.135 INFO:tasks.workunit.client.0.smithi152.stdout:5/598: write d7/dd/d4e/f5c [2400557,80124] 0 2023-12-06T15:00:32.136 INFO:tasks.workunit.client.0.smithi152.stdout:5/599: read d7/d47/fa0 [739574,19928] 0 2023-12-06T15:00:32.136 INFO:tasks.workunit.client.0.smithi152.stdout:5/600: dread - d7/dd/d26/d3b/f8b zero size 2023-12-06T15:00:32.136 INFO:tasks.workunit.client.0.smithi152.stdout:5/601: write d7/d43/d6c/d98/fa8 [399780,120620] 0 2023-12-06T15:00:32.138 INFO:tasks.workunit.client.1.smithi190.stdout:4/746: dread d3/d35/d19/d41/d44/f9b [0,4194304] 0 2023-12-06T15:00:32.140 INFO:tasks.workunit.client.1.smithi190.stdout:9/944: getdents d4/d27/d2f/d31 0 2023-12-06T15:00:32.140 INFO:tasks.workunit.client.1.smithi190.stdout:8/760: mknod d1/ce2 0 2023-12-06T15:00:32.141 INFO:tasks.workunit.client.0.smithi152.stdout:8/469: dwrite d1/d6/d29/f51 [0,4194304] 0 2023-12-06T15:00:32.142 INFO:tasks.workunit.client.1.smithi190.stdout:4/747: creat d3/d76/d7c/db9/def/f104 x:0 0 0 2023-12-06T15:00:32.143 INFO:tasks.workunit.client.0.smithi152.stdout:5/602: dread d7/d47/f78 [0,4194304] 0 2023-12-06T15:00:32.145 INFO:tasks.workunit.client.1.smithi190.stdout:9/945: rmdir d4/d27/d2f/d31/d3f/d58/d72/db3/dea/dcd 39 2023-12-06T15:00:32.145 INFO:tasks.workunit.client.1.smithi190.stdout:9/946: chown d4/d27/d2f/d31/d3f/d58/c8d 379641602 1 2023-12-06T15:00:32.148 INFO:tasks.workunit.client.1.smithi190.stdout:8/761: mknod d1/d20/d3b/d34/dc0/ce3 0 2023-12-06T15:00:32.148 INFO:tasks.workunit.client.0.smithi152.stdout:8/470: link d1/d6/d34/d36/f26 d1/d6/d34/d40/d64/f94 0 2023-12-06T15:00:32.148 INFO:tasks.workunit.client.0.smithi152.stdout:8/471: stat d1/d6/d34/d40 0 2023-12-06T15:00:32.151 INFO:tasks.workunit.client.0.smithi152.stdout:8/472: rename d1/d6/d34/d40/l84 to d1/d6/d29/d75/l95 0 2023-12-06T15:00:32.152 INFO:tasks.workunit.client.1.smithi190.stdout:4/748: creat d3/d76/dc4/dc5/f105 x:0 0 0 2023-12-06T15:00:32.152 INFO:tasks.workunit.client.1.smithi190.stdout:8/762: write d1/d20/d3b/d4c/d8e/d94/d1c/f9b [694478,121814] 0 2023-12-06T15:00:32.154 INFO:tasks.workunit.client.0.smithi152.stdout:8/473: creat d1/f96 x:0 0 0 2023-12-06T15:00:32.154 INFO:tasks.workunit.client.1.smithi190.stdout:9/947: mknod d4/d27/d2f/c138 0 2023-12-06T15:00:32.154 INFO:tasks.workunit.client.1.smithi190.stdout:4/749: creat d3/f106 x:0 0 0 2023-12-06T15:00:32.154 INFO:tasks.workunit.client.1.smithi190.stdout:4/750: dread - d3/d76/dc4/dc5/f37 zero size 2023-12-06T15:00:32.154 INFO:tasks.workunit.client.1.smithi190.stdout:4/751: stat d3/d76/dc4/dc5/daa/cc0 0 2023-12-06T15:00:32.155 INFO:tasks.workunit.client.1.smithi190.stdout:4/752: readlink d3/d76/dc4/dc5/d3c/l3e 0 2023-12-06T15:00:32.155 INFO:tasks.workunit.client.0.smithi152.stdout:8/474: creat d1/d6/d34/d90/f97 x:0 0 0 2023-12-06T15:00:32.156 INFO:tasks.workunit.client.1.smithi190.stdout:8/763: rename d1/d20/d3b/f53 to d1/d20/d3b/d4c/d8e/d94/d1c/fe4 0 2023-12-06T15:00:32.156 INFO:tasks.workunit.client.1.smithi190.stdout:8/764: readlink d1/d20/d3b/d7e/l8c 0 2023-12-06T15:00:32.157 INFO:tasks.workunit.client.1.smithi190.stdout:4/753: unlink d3/d35/d19/d41/d44/cf6 0 2023-12-06T15:00:32.159 INFO:tasks.workunit.client.1.smithi190.stdout:4/754: symlink d3/d4e/l107 0 2023-12-06T15:00:32.160 INFO:tasks.workunit.client.1.smithi190.stdout:4/755: symlink d3/d35/d19/d41/ddb/l108 0 2023-12-06T15:00:32.160 INFO:tasks.workunit.client.1.smithi190.stdout:4/756: truncate d3/d35/d19/f59 3026206 0 2023-12-06T15:00:32.161 INFO:tasks.workunit.client.1.smithi190.stdout:4/757: creat d3/d76/d7c/d96/d7a/f109 x:0 0 0 2023-12-06T15:00:32.161 INFO:tasks.workunit.client.1.smithi190.stdout:4/758: stat d3/d76/fd2 0 2023-12-06T15:00:32.162 INFO:tasks.workunit.client.1.smithi190.stdout:9/948: write d4/f25 [1684232,24482] 0 2023-12-06T15:00:32.166 INFO:tasks.workunit.client.0.smithi152.stdout:5/603: dwrite d7/dd/d26/d3b/d46/d7e/fce [0,4194304] 0 2023-12-06T15:00:32.166 INFO:tasks.workunit.client.1.smithi190.stdout:2/776: dwrite d10/d26/d5c/f96 [0,4194304] 0 2023-12-06T15:00:32.166 INFO:tasks.workunit.client.1.smithi190.stdout:2/777: stat d10/d26/d5c/d42/d9d 0 2023-12-06T15:00:32.166 INFO:tasks.workunit.client.1.smithi190.stdout:2/778: truncate d10/d26/d8a/d8f/fa7 258058 0 2023-12-06T15:00:32.166 INFO:tasks.workunit.client.1.smithi190.stdout:2/779: write d10/d26/d5c/fb3 [47707,26601] 0 2023-12-06T15:00:32.167 INFO:tasks.workunit.client.1.smithi190.stdout:9/949: rename d4/l4a to d4/d27/d2f/d31/d3f/d58/d72/db3/dea/dcd/l139 0 2023-12-06T15:00:32.167 INFO:tasks.workunit.client.0.smithi152.stdout:5/604: creat d7/d43/d6c/fd4 x:0 0 0 2023-12-06T15:00:32.169 INFO:tasks.workunit.client.1.smithi190.stdout:8/765: dread d1/d20/d3b/d4c/d8e/fd2 [0,4194304] 0 2023-12-06T15:00:32.169 INFO:tasks.workunit.client.1.smithi190.stdout:3/860: dwrite d4/d1b/d54/d9c/fb6 [0,4194304] 0 2023-12-06T15:00:32.169 INFO:tasks.workunit.client.1.smithi190.stdout:9/950: creat d4/d27/d8a/dbc/f13a x:0 0 0 2023-12-06T15:00:32.170 INFO:tasks.workunit.client.1.smithi190.stdout:8/766: mknod d1/dd3/ce5 0 2023-12-06T15:00:32.171 INFO:tasks.workunit.client.0.smithi152.stdout:5/605: mknod d7/dd/d26/d3b/d46/d7e/cd5 0 2023-12-06T15:00:32.171 INFO:tasks.workunit.client.0.smithi152.stdout:5/606: truncate d7/dd/d26/d3b/f8b 585537 0 2023-12-06T15:00:32.171 INFO:tasks.workunit.client.1.smithi190.stdout:9/951: read d4/d27/d2f/d31/d3f/d58/d72/f75 [3533273,121526] 0 2023-12-06T15:00:32.176 INFO:tasks.workunit.client.1.smithi190.stdout:3/861: symlink d4/d1b/d54/d9c/d68/dfc/dc4/dce/l12f 0 2023-12-06T15:00:32.176 INFO:tasks.workunit.client.1.smithi190.stdout:8/767: rename d1/l8f to d1/d20/d3b/d4c/d9e/le6 0 2023-12-06T15:00:32.176 INFO:tasks.workunit.client.1.smithi190.stdout:8/768: chown d1/d20/d3b/d4c/d8e/d94/d25/f76 35805979 1 2023-12-06T15:00:32.178 INFO:tasks.workunit.client.1.smithi190.stdout:9/952: creat d4/d27/d2f/d31/d3f/d58/f13b x:0 0 0 2023-12-06T15:00:32.184 INFO:tasks.workunit.client.1.smithi190.stdout:4/759: dwrite d3/fb8 [0,4194304] 0 2023-12-06T15:00:32.184 INFO:tasks.workunit.client.1.smithi190.stdout:4/760: truncate d3/d76/d7c/db9/def/f104 1035559 0 2023-12-06T15:00:32.186 INFO:tasks.workunit.client.1.smithi190.stdout:2/780: write d10/d59/d5e/f24 [1035522,34821] 0 2023-12-06T15:00:32.188 INFO:tasks.workunit.client.1.smithi190.stdout:4/761: mknod d3/d76/d7c/db9/def/c10a 0 2023-12-06T15:00:32.188 INFO:tasks.workunit.client.1.smithi190.stdout:8/769: dread d1/d20/d3b/d36/d50/fda [0,4194304] 0 2023-12-06T15:00:32.190 INFO:tasks.workunit.client.1.smithi190.stdout:4/762: mknod d3/d35/d19/d67/db5/c10b 0 2023-12-06T15:00:32.190 INFO:tasks.workunit.client.1.smithi190.stdout:4/763: chown d3/d76/d7c/d96/d39/d54/f60 16140 1 2023-12-06T15:00:32.194 INFO:tasks.workunit.client.1.smithi190.stdout:8/770: symlink d1/d20/d3b/d4c/d8e/d94/d1c/le7 0 2023-12-06T15:00:32.194 INFO:tasks.workunit.client.1.smithi190.stdout:4/764: symlink d3/d76/d7c/db9/l10c 0 2023-12-06T15:00:32.194 INFO:tasks.workunit.client.0.smithi152.stdout:5/607: dwrite d7/dd/f16 [0,4194304] 0 2023-12-06T15:00:32.195 INFO:tasks.workunit.client.1.smithi190.stdout:4/765: mkdir d3/da4/d10d 0 2023-12-06T15:00:32.196 INFO:tasks.workunit.client.1.smithi190.stdout:4/766: creat d3/d76/d7c/d96/d15/d103/f10e x:0 0 0 2023-12-06T15:00:32.196 INFO:tasks.workunit.client.1.smithi190.stdout:4/767: write d3/d76/d7c/d96/d15/f2f [1426711,29203] 0 2023-12-06T15:00:32.196 INFO:tasks.workunit.client.1.smithi190.stdout:4/768: chown d3/d76/d7c/db9/def/f104 194464917 1 2023-12-06T15:00:32.196 INFO:tasks.workunit.client.1.smithi190.stdout:4/769: write d3/d35/d19/d41/d44/f83 [422488,75073] 0 2023-12-06T15:00:32.199 INFO:tasks.workunit.client.1.smithi190.stdout:4/770: unlink d3/d76/d7c/d96/d15/c65 0 2023-12-06T15:00:32.200 INFO:tasks.workunit.client.0.smithi152.stdout:5/608: creat d7/dd/d4e/dac/fd6 x:0 0 0 2023-12-06T15:00:32.215 INFO:tasks.workunit.client.0.smithi152.stdout:5/609: dread d7/dd/d26/d48/f85 [0,4194304] 0 2023-12-06T15:00:32.215 INFO:tasks.workunit.client.0.smithi152.stdout:5/610: truncate d7/dd/d26/d3a/f7b 1043960 0 2023-12-06T15:00:32.219 INFO:tasks.workunit.client.1.smithi190.stdout:2/781: dwrite d10/d59/dcd/dad/fc0 [0,4194304] 0 2023-12-06T15:00:32.219 INFO:tasks.workunit.client.1.smithi190.stdout:9/953: dwrite d4/d84/f8f [4194304,4194304] 0 2023-12-06T15:00:32.220 INFO:tasks.workunit.client.1.smithi190.stdout:2/782: creat d10/d26/d8a/d8f/f107 x:0 0 0 2023-12-06T15:00:32.220 INFO:tasks.workunit.client.1.smithi190.stdout:2/783: write d10/d59/f93 [1624948,86628] 0 2023-12-06T15:00:32.220 INFO:tasks.workunit.client.1.smithi190.stdout:2/784: chown d10/d59/dcd/dad/dc4/d7f/d8e 55 1 2023-12-06T15:00:32.221 INFO:tasks.workunit.client.1.smithi190.stdout:2/785: dread d10/d59/d5e/fb6 [0,4194304] 0 2023-12-06T15:00:32.222 INFO:tasks.workunit.client.1.smithi190.stdout:9/954: getdents d4/dfd 0 2023-12-06T15:00:32.223 INFO:tasks.workunit.client.1.smithi190.stdout:9/955: rmdir d4/d27/d2f/d31/d3f/d58/d72/db3/dea/dcd/dff 39 2023-12-06T15:00:32.223 INFO:tasks.workunit.client.1.smithi190.stdout:2/786: dread d10/d26/d5c/d49/d54/f5d [4194304,4194304] 0 2023-12-06T15:00:32.223 INFO:tasks.workunit.client.1.smithi190.stdout:2/787: truncate d10/d26/d8a/d8f/f107 828414 0 2023-12-06T15:00:32.223 INFO:tasks.workunit.client.1.smithi190.stdout:2/788: truncate d10/d26/d5c/f5a 4978623 0 2023-12-06T15:00:32.224 INFO:tasks.workunit.client.1.smithi190.stdout:4/771: dwrite d3/d76/d7c/d96/d7a/f109 [0,4194304] 0 2023-12-06T15:00:32.224 INFO:tasks.workunit.client.1.smithi190.stdout:2/789: chown d10/d26/d8a/d8f/ff1 60202 1 2023-12-06T15:00:32.224 INFO:tasks.workunit.client.1.smithi190.stdout:8/771: dwrite d1/d20/d3b/d31/f57 [0,4194304] 0 2023-12-06T15:00:32.224 INFO:tasks.workunit.client.1.smithi190.stdout:8/772: stat d1/d20/l27 0 2023-12-06T15:00:32.224 INFO:tasks.workunit.client.1.smithi190.stdout:9/956: mkdir d4/d27/d2f/d31/d3f/d58/d72/db3/d10f/d13c 0 2023-12-06T15:00:32.226 INFO:tasks.workunit.client.1.smithi190.stdout:4/772: read d3/d35/f46 [4085801,42019] 0 2023-12-06T15:00:32.226 INFO:tasks.workunit.client.1.smithi190.stdout:4/773: write d3/d35/d19/fe6 [482246,106736] 0 2023-12-06T15:00:32.226 INFO:tasks.workunit.client.1.smithi190.stdout:2/790: symlink d10/d26/d5c/d42/dfd/l108 0 2023-12-06T15:00:32.227 INFO:tasks.workunit.client.1.smithi190.stdout:9/957: chown d4/f6b 247 1 2023-12-06T15:00:32.227 INFO:tasks.workunit.client.1.smithi190.stdout:9/958: write d4/d27/d2f/f115 [754538,71702] 0 2023-12-06T15:00:32.230 INFO:tasks.workunit.client.1.smithi190.stdout:2/791: rename d10/d26/d5c/d49/f55 to d10/d26/f109 0 2023-12-06T15:00:32.230 INFO:tasks.workunit.client.1.smithi190.stdout:9/959: mknod d4/d27/d2f/d31/d3f/d58/dc5/c13d 0 2023-12-06T15:00:32.233 INFO:tasks.workunit.client.1.smithi190.stdout:9/960: mkdir d4/d27/d2f/d31/d3f/d58/d13e 0 2023-12-06T15:00:32.235 INFO:tasks.workunit.client.1.smithi190.stdout:4/774: dread d3/d76/dc4/dc5/d3c/f5a [0,4194304] 0 2023-12-06T15:00:32.237 INFO:tasks.workunit.client.1.smithi190.stdout:4/775: creat d3/d76/dc4/f10f x:0 0 0 2023-12-06T15:00:32.238 INFO:tasks.workunit.client.1.smithi190.stdout:4/776: unlink d3/d35/d19/d41/d44/f4c 0 2023-12-06T15:00:32.239 INFO:tasks.workunit.client.1.smithi190.stdout:4/777: link d3/d76/d7c/db9/def/c10a d3/d76/d7c/d8a/ddf/c110 0 2023-12-06T15:00:32.239 INFO:tasks.workunit.client.1.smithi190.stdout:4/778: chown d3/d35/d19/d41/d44/cf2 4 1 2023-12-06T15:00:32.242 INFO:tasks.workunit.client.1.smithi190.stdout:8/773: dwrite d1/d20/d3b/d34/d39/fa3 [0,4194304] 0 2023-12-06T15:00:32.244 INFO:tasks.workunit.client.1.smithi190.stdout:8/774: rename d1/d20/d3b/d4c/d59/d7d/db4 to d1/d20/d3b/d7e/de8 0 2023-12-06T15:00:32.245 INFO:tasks.workunit.client.1.smithi190.stdout:8/775: truncate d1/fd5 992576 0 2023-12-06T15:00:32.245 INFO:tasks.workunit.client.1.smithi190.stdout:8/776: stat d1/d20/d3b/d4c/d8e/d94/db6/ld7 0 2023-12-06T15:00:32.245 INFO:tasks.workunit.client.1.smithi190.stdout:8/777: chown d1/d20/d3b/d34/d39/fa3 210 1 2023-12-06T15:00:32.245 INFO:tasks.workunit.client.1.smithi190.stdout:8/778: write d1/d20/d3b/d4c/d8e/d94/f78 [1572860,90565] 0 2023-12-06T15:00:32.245 INFO:tasks.workunit.client.1.smithi190.stdout:8/779: write d1/d20/d3b/d4c/d8e/fac [1379144,92334] 0 2023-12-06T15:00:32.245 INFO:tasks.workunit.client.1.smithi190.stdout:8/780: write d1/d20/d3b/f2d [289215,68404] 0 2023-12-06T15:00:32.247 INFO:tasks.workunit.client.1.smithi190.stdout:8/781: creat d1/d20/d3b/d4c/d59/d7d/fe9 x:0 0 0 2023-12-06T15:00:32.248 INFO:tasks.workunit.client.1.smithi190.stdout:8/782: symlink d1/d20/d3b/d4c/d5a/lea 0 2023-12-06T15:00:32.250 INFO:tasks.workunit.client.1.smithi190.stdout:8/783: creat d1/d20/d3b/d4c/d59/feb x:0 0 0 2023-12-06T15:00:32.250 INFO:tasks.workunit.client.1.smithi190.stdout:8/784: dread - d1/d20/d3b/d4c/d8e/da5/fa7 zero size 2023-12-06T15:00:32.250 INFO:tasks.workunit.client.1.smithi190.stdout:8/785: truncate d1/d20/d3b/d4c/d8e/d94/f80 2040140 0 2023-12-06T15:00:32.250 INFO:tasks.workunit.client.1.smithi190.stdout:8/786: link d1/d20/d3b/d36/f3c d1/d20/d3b/d34/dbc/fec 0 2023-12-06T15:00:32.252 INFO:tasks.workunit.client.1.smithi190.stdout:8/787: creat d1/d20/d3b/d4c/d8e/d94/db6/fed x:0 0 0 2023-12-06T15:00:32.253 INFO:tasks.workunit.client.1.smithi190.stdout:2/792: truncate d10/d26/d8a/d8f/fa7 68637 0 2023-12-06T15:00:32.253 INFO:tasks.workunit.client.1.smithi190.stdout:8/788: creat d1/fee x:0 0 0 2023-12-06T15:00:32.254 INFO:tasks.workunit.client.1.smithi190.stdout:2/793: mkdir d10/d59/dcd/dad/d10a 0 2023-12-06T15:00:32.262 INFO:tasks.workunit.client.1.smithi190.stdout:8/789: dread d1/d20/d3b/fc3 [0,4194304] 0 2023-12-06T15:00:32.263 INFO:tasks.workunit.client.1.smithi190.stdout:8/790: rmdir d1/d20/d3b/d4c/d8e 39 2023-12-06T15:00:32.264 INFO:tasks.workunit.client.1.smithi190.stdout:8/791: write d1/d20/d3b/d4c/d8e/d94/db6/fed [24187,37493] 0 2023-12-06T15:00:32.264 INFO:tasks.workunit.client.1.smithi190.stdout:2/794: dread d10/d59/d5e/f16 [0,4194304] 0 2023-12-06T15:00:32.264 INFO:tasks.workunit.client.1.smithi190.stdout:2/795: truncate d10/d59/dcd/dad/feb 1037317 0 2023-12-06T15:00:32.264 INFO:tasks.workunit.client.1.smithi190.stdout:8/792: mkdir d1/d20/d3b/d4c/d9e/def 0 2023-12-06T15:00:32.264 INFO:tasks.workunit.client.1.smithi190.stdout:8/793: chown d1/d20/d3b/d31 30598 1 2023-12-06T15:00:32.267 INFO:tasks.workunit.client.1.smithi190.stdout:2/796: mknod d10/d26/d5c/d35/d77/d98/dfe/ded/c10b 0 2023-12-06T15:00:32.270 INFO:tasks.workunit.client.1.smithi190.stdout:2/797: mknod d10/d59/d5e/c10c 0 2023-12-06T15:00:32.270 INFO:tasks.workunit.client.1.smithi190.stdout:2/798: readlink d10/d59/lba 0 2023-12-06T15:00:32.282 INFO:tasks.workunit.client.1.smithi190.stdout:2/799: dwrite d10/d26/d5c/d49/f9c [0,4194304] 0 2023-12-06T15:00:32.291 INFO:tasks.workunit.client.1.smithi190.stdout:2/800: link l7 d10/d26/d8a/dfa/l10d 0 2023-12-06T15:00:32.291 INFO:tasks.workunit.client.1.smithi190.stdout:2/801: creat d10/d26/d5c/d42/d9d/f10e x:0 0 0 2023-12-06T15:00:32.292 INFO:tasks.workunit.client.1.smithi190.stdout:2/802: truncate d10/d26/d8a/fe8 4343816 0 2023-12-06T15:00:32.293 INFO:tasks.workunit.client.1.smithi190.stdout:0/745: sync 2023-12-06T15:00:32.293 INFO:tasks.workunit.client.1.smithi190.stdout:6/834: sync 2023-12-06T15:00:32.293 INFO:tasks.workunit.client.1.smithi190.stdout:0/746: readlink d0/da/d3e/d2b/laf 0 2023-12-06T15:00:32.297 INFO:tasks.workunit.client.1.smithi190.stdout:0/747: rename d0/da/d3e/d3a/d40/d6f/d9e/de8/fef to d0/da/d3e/d3a/d40/d81/ff3 0 2023-12-06T15:00:32.300 INFO:tasks.workunit.client.1.smithi190.stdout:0/748: link d0/da/d3e/d2b/f33 d0/da/d3e/d2b/d3c/d4c/dcc/ff4 0 2023-12-06T15:00:32.324 INFO:tasks.workunit.client.1.smithi190.stdout:2/803: dwrite d10/f58 [0,4194304] 0 2023-12-06T15:00:32.324 INFO:tasks.workunit.client.0.smithi152.stdout:2/453: sync 2023-12-06T15:00:32.324 INFO:tasks.workunit.client.0.smithi152.stdout:7/415: sync 2023-12-06T15:00:32.325 INFO:tasks.workunit.client.0.smithi152.stdout:4/751: sync 2023-12-06T15:00:32.325 INFO:tasks.workunit.client.0.smithi152.stdout:3/539: sync 2023-12-06T15:00:32.325 INFO:tasks.workunit.client.0.smithi152.stdout:2/454: rmdir d6/d18/d43 39 2023-12-06T15:00:32.325 INFO:tasks.workunit.client.1.smithi190.stdout:2/804: truncate d10/d26/f27 1825438 0 2023-12-06T15:00:32.325 INFO:tasks.workunit.client.1.smithi190.stdout:6/835: dwrite d4/d12/d40/f4f [4194304,4194304] 0 2023-12-06T15:00:32.326 INFO:tasks.workunit.client.1.smithi190.stdout:0/749: dwrite d0/da/d3e/d3a/d40/f48 [0,4194304] 0 2023-12-06T15:00:32.326 INFO:tasks.workunit.client.0.smithi152.stdout:4/752: mknod d2/d45/d84/da4/ce7 0 2023-12-06T15:00:32.327 INFO:tasks.workunit.client.0.smithi152.stdout:7/416: creat dd/df/d1b/f7d x:0 0 0 2023-12-06T15:00:32.327 INFO:tasks.workunit.client.1.smithi190.stdout:2/805: unlink d10/c21 0 2023-12-06T15:00:32.328 INFO:tasks.workunit.client.1.smithi190.stdout:2/806: dread - d10/d59/dcd/dad/dc4/f103 zero size 2023-12-06T15:00:32.328 INFO:tasks.workunit.client.0.smithi152.stdout:4/753: write d2/d22/d6e/da8/fc7 [405307,55496] 0 2023-12-06T15:00:32.329 INFO:tasks.workunit.client.0.smithi152.stdout:3/540: rename d9/d18/d1a/d65/l86 to d9/d10/d12/d43/d52/la6 0 2023-12-06T15:00:32.330 INFO:tasks.workunit.client.0.smithi152.stdout:2/455: mknod d6/d18/d70/c94 0 2023-12-06T15:00:32.330 INFO:tasks.workunit.client.0.smithi152.stdout:7/417: creat dd/df/d34/f7e x:0 0 0 2023-12-06T15:00:32.336 INFO:tasks.workunit.client.0.smithi152.stdout:4/754: creat d2/d22/d6e/da8/fe8 x:0 0 0 2023-12-06T15:00:32.337 INFO:tasks.workunit.client.0.smithi152.stdout:3/541: mknod d9/d18/d1a/d65/ca7 0 2023-12-06T15:00:32.337 INFO:tasks.workunit.client.0.smithi152.stdout:3/542: chown d9/d18/d51/d8d/d8f 245 1 2023-12-06T15:00:32.337 INFO:tasks.workunit.client.0.smithi152.stdout:2/456: mkdir d6/d18/d43/d95 0 2023-12-06T15:00:32.337 INFO:tasks.workunit.client.0.smithi152.stdout:2/457: chown d6/d1e/c21 2610199 1 2023-12-06T15:00:32.338 INFO:tasks.workunit.client.0.smithi152.stdout:2/458: write d6/d1e/d7a/f7b [2838275,90500] 0 2023-12-06T15:00:32.338 INFO:tasks.workunit.client.0.smithi152.stdout:3/543: symlink d9/d10/d32/la8 0 2023-12-06T15:00:32.338 INFO:tasks.workunit.client.0.smithi152.stdout:3/544: fdatasync d9/d18/d51/f54 0 2023-12-06T15:00:32.340 INFO:tasks.workunit.client.0.smithi152.stdout:2/459: chown d6/d1e/c54 0 1 2023-12-06T15:00:32.340 INFO:tasks.workunit.client.0.smithi152.stdout:2/460: truncate d6/d18/f81 633527 0 2023-12-06T15:00:32.340 INFO:tasks.workunit.client.0.smithi152.stdout:2/461: getdents d6/db/d91 0 2023-12-06T15:00:32.341 INFO:tasks.workunit.client.0.smithi152.stdout:2/462: dread - d6/d1e/f5b zero size 2023-12-06T15:00:32.344 INFO:tasks.workunit.client.0.smithi152.stdout:2/463: creat d6/db/f96 x:0 0 0 2023-12-06T15:00:32.345 INFO:tasks.workunit.client.1.smithi190.stdout:6/836: dread d4/d12/f53 [0,4194304] 0 2023-12-06T15:00:32.345 INFO:tasks.workunit.client.1.smithi190.stdout:6/837: chown d4/d12/f114 111362 1 2023-12-06T15:00:32.346 INFO:tasks.workunit.client.1.smithi190.stdout:6/838: write d4/d12/d1a/d44/fbd [1108279,77025] 0 2023-12-06T15:00:32.346 INFO:tasks.workunit.client.0.smithi152.stdout:2/464: mknod d6/d1e/d41/d92/c97 0 2023-12-06T15:00:32.347 INFO:tasks.workunit.client.1.smithi190.stdout:6/839: creat d4/d12/d40/f116 x:0 0 0 2023-12-06T15:00:32.349 INFO:tasks.workunit.client.1.smithi190.stdout:6/840: mkdir d4/d12/d1a/d70/da9/d117 0 2023-12-06T15:00:32.349 INFO:tasks.workunit.client.1.smithi190.stdout:6/841: readlink d4/d12/d40/ld7 0 2023-12-06T15:00:32.349 INFO:tasks.workunit.client.1.smithi190.stdout:2/807: write d10/d26/d5c/d42/d9d/fae [1951491,16469] 0 2023-12-06T15:00:32.350 INFO:tasks.workunit.client.1.smithi190.stdout:2/808: stat d10/d59/dcd/dad/dc4/lcc 0 2023-12-06T15:00:32.350 INFO:tasks.workunit.client.1.smithi190.stdout:6/842: creat d4/d12/d40/d43/d45/d4a/f118 x:0 0 0 2023-12-06T15:00:32.350 INFO:tasks.workunit.client.1.smithi190.stdout:6/843: truncate d4/d12/d1a/d8a/fa0 1613348 0 2023-12-06T15:00:32.350 INFO:tasks.workunit.client.1.smithi190.stdout:6/844: readlink d4/d12/d40/d43/dba/lc2 0 2023-12-06T15:00:32.358 INFO:tasks.workunit.client.0.smithi152.stdout:7/418: dwrite f1 [0,4194304] 0 2023-12-06T15:00:32.359 INFO:tasks.workunit.client.1.smithi190.stdout:0/750: dwrite d0/da/d5a/fcd [0,4194304] 0 2023-12-06T15:00:32.360 INFO:tasks.workunit.client.1.smithi190.stdout:0/751: write d0/da/d3e/d3a/d40/d6f/fab [434944,87451] 0 2023-12-06T15:00:32.361 INFO:tasks.workunit.client.0.smithi152.stdout:7/419: dread dd/df/d1b/d20/d28/f68 [0,4194304] 0 2023-12-06T15:00:32.361 INFO:tasks.workunit.client.0.smithi152.stdout:7/420: dread - dd/df/d34/f7e zero size 2023-12-06T15:00:32.361 INFO:tasks.workunit.client.0.smithi152.stdout:4/755: dwrite d2/d15/d32/d69/d6f/d6c/f73 [0,4194304] 0 2023-12-06T15:00:32.362 INFO:tasks.workunit.client.1.smithi190.stdout:0/752: creat d0/da/d3e/d3a/d40/ff5 x:0 0 0 2023-12-06T15:00:32.362 INFO:tasks.workunit.client.1.smithi190.stdout:0/753: truncate d0/da/d3e/d2b/d3c/d46/d8e/fa0 265061 0 2023-12-06T15:00:32.365 INFO:tasks.workunit.client.0.smithi152.stdout:3/545: rename d9/d10/d32 to d9/d10/d12/d43/d52/d58/da9 0 2023-12-06T15:00:32.365 INFO:tasks.workunit.client.0.smithi152.stdout:3/546: readlink d9/d10/d12/d43/d52/l9b 0 2023-12-06T15:00:32.365 INFO:tasks.workunit.client.0.smithi152.stdout:3/547: fdatasync d9/d10/d19/f57 0 2023-12-06T15:00:32.365 INFO:tasks.workunit.client.0.smithi152.stdout:3/548: fdatasync d9/d10/f94 0 2023-12-06T15:00:32.365 INFO:tasks.workunit.client.0.smithi152.stdout:3/549: fsync d9/d18/d1a/d77/d91/fa5 0 2023-12-06T15:00:32.366 INFO:tasks.workunit.client.0.smithi152.stdout:7/421: symlink dd/df/d1b/d20/d28/d38/l7f 0 2023-12-06T15:00:32.367 INFO:tasks.workunit.client.1.smithi190.stdout:2/809: dread d10/d59/d5e/fd2 [0,4194304] 0 2023-12-06T15:00:32.368 INFO:tasks.workunit.client.0.smithi152.stdout:4/756: unlink d2/d15/c8f 0 2023-12-06T15:00:32.373 INFO:tasks.workunit.client.0.smithi152.stdout:7/422: rename dd/df/d34/d44/f67 to dd/df/d1b/d20/d28/f80 0 2023-12-06T15:00:32.375 INFO:tasks.workunit.client.1.smithi190.stdout:6/845: dwrite d4/fd [4194304,4194304] 0 2023-12-06T15:00:32.376 INFO:tasks.workunit.client.0.smithi152.stdout:4/757: rename d2/d89/l61 to d2/d15/d32/d69/d6f/le9 0 2023-12-06T15:00:32.376 INFO:tasks.workunit.client.0.smithi152.stdout:4/758: write d2/d45/f6b [9090532,73869] 0 2023-12-06T15:00:32.377 INFO:tasks.workunit.client.1.smithi190.stdout:6/846: mknod d4/d12/d1a/d32/dc7/dd0/c119 0 2023-12-06T15:00:32.377 INFO:tasks.workunit.client.1.smithi190.stdout:6/847: readlink d4/lad 0 2023-12-06T15:00:32.377 INFO:tasks.workunit.client.1.smithi190.stdout:6/848: chown d4/d12/d1a/d44/l80 1779 1 2023-12-06T15:00:32.378 INFO:tasks.workunit.client.1.smithi190.stdout:6/849: mknod d4/d12/d1a/d8a/c11a 0 2023-12-06T15:00:32.379 INFO:tasks.workunit.client.0.smithi152.stdout:7/423: creat dd/df/d78/f81 x:0 0 0 2023-12-06T15:00:32.379 INFO:tasks.workunit.client.0.smithi152.stdout:7/424: truncate dd/df/d34/d44/d49/f71 963950 0 2023-12-06T15:00:32.381 INFO:tasks.workunit.client.1.smithi190.stdout:6/850: symlink d4/d12/d1a/d70/l11b 0 2023-12-06T15:00:32.381 INFO:tasks.workunit.client.1.smithi190.stdout:6/851: dread - d4/d12/d1a/d32/dc7/f102 zero size 2023-12-06T15:00:32.384 INFO:tasks.workunit.client.0.smithi152.stdout:3/550: dread d9/d10/d12/d43/d52/d58/da9/f3d [0,4194304] 0 2023-12-06T15:00:32.387 INFO:tasks.workunit.client.1.smithi190.stdout:6/852: mkdir d4/d12/d40/d11c 0 2023-12-06T15:00:32.388 INFO:tasks.workunit.client.0.smithi152.stdout:2/465: dwrite d6/f4d [0,4194304] 0 2023-12-06T15:00:32.390 INFO:tasks.workunit.client.1.smithi190.stdout:6/853: mkdir d4/d12/d40/d43/d11d 0 2023-12-06T15:00:32.390 INFO:tasks.workunit.client.1.smithi190.stdout:6/854: dread - d4/d12/d40/d43/d45/d4a/f118 zero size 2023-12-06T15:00:32.391 INFO:tasks.workunit.client.0.smithi152.stdout:2/466: link d6/d1e/d41/c5c d6/d1e/d41/d83/c98 0 2023-12-06T15:00:32.393 INFO:tasks.workunit.client.1.smithi190.stdout:0/754: dwrite d0/da/d3e/d2b/d3c/d4c/f59 [0,4194304] 0 2023-12-06T15:00:32.394 INFO:tasks.workunit.client.0.smithi152.stdout:2/467: rmdir d6/d1e/d7a 39 2023-12-06T15:00:32.397 INFO:tasks.workunit.client.1.smithi190.stdout:2/810: dwrite d10/d26/d5c/d49/d54/fc2 [0,4194304] 0 2023-12-06T15:00:32.398 INFO:tasks.workunit.client.1.smithi190.stdout:0/755: rename d0/da/d3e/d2b/d3c/d46/d8e/d90/dd8 to d0/da/d3e/df6 0 2023-12-06T15:00:32.398 INFO:tasks.workunit.client.1.smithi190.stdout:6/855: unlink d4/d12/d40/d43/d45/d4a/d77/dca/c2e 0 2023-12-06T15:00:32.401 INFO:tasks.workunit.client.1.smithi190.stdout:2/811: creat d10/d59/dcd/dad/dc9/f10f x:0 0 0 2023-12-06T15:00:32.403 INFO:tasks.workunit.client.1.smithi190.stdout:6/856: write d4/d12/d1a/d44/fce [4028564,98086] 0 2023-12-06T15:00:32.405 INFO:tasks.workunit.client.0.smithi152.stdout:4/759: dwrite d2/d15/d32/d54/fe1 [0,4194304] 0 2023-12-06T15:00:32.408 INFO:tasks.workunit.client.0.smithi152.stdout:4/760: truncate d2/d15/d32/d54/d85/f86 109600 0 2023-12-06T15:00:32.410 INFO:tasks.workunit.client.0.smithi152.stdout:4/761: creat d2/d15/d32/d69/fea x:0 0 0 2023-12-06T15:00:32.415 INFO:tasks.workunit.client.0.smithi152.stdout:7/425: dwrite dd/df/d1b/d20/d28/d38/f56 [0,4194304] 0 2023-12-06T15:00:32.415 INFO:tasks.workunit.client.1.smithi190.stdout:2/812: dread d10/d59/dcd/dad/dc4/d76/fa6 [0,4194304] 0 2023-12-06T15:00:32.416 INFO:tasks.workunit.client.1.smithi190.stdout:2/813: symlink d10/d59/dcd/dad/dc4/d76/db1/l110 0 2023-12-06T15:00:32.424 INFO:tasks.workunit.client.0.smithi152.stdout:3/551: dwrite d9/d18/d39/f8a [0,4194304] 0 2023-12-06T15:00:32.427 INFO:tasks.workunit.client.0.smithi152.stdout:7/426: dread dd/f11 [0,4194304] 0 2023-12-06T15:00:32.428 INFO:tasks.workunit.client.0.smithi152.stdout:3/552: getdents d9/d10/d12/d43/d52/d58/da9 0 2023-12-06T15:00:32.428 INFO:tasks.workunit.client.0.smithi152.stdout:3/553: fdatasync d9/d18/d1a/d77/f8c 0 2023-12-06T15:00:32.430 INFO:tasks.workunit.client.0.smithi152.stdout:7/427: creat dd/df/d1b/d20/d28/d38/f82 x:0 0 0 2023-12-06T15:00:32.431 INFO:tasks.workunit.client.0.smithi152.stdout:2/468: dwrite d6/d1e/f64 [0,4194304] 0 2023-12-06T15:00:32.431 INFO:tasks.workunit.client.0.smithi152.stdout:2/469: write d6/db/f61 [1319783,106290] 0 2023-12-06T15:00:32.431 INFO:tasks.workunit.client.0.smithi152.stdout:2/470: truncate d6/db/d17/f23 5173422 0 2023-12-06T15:00:32.432 INFO:tasks.workunit.client.1.smithi190.stdout:6/857: dwrite d4/d12/d9a/fd2 [0,4194304] 0 2023-12-06T15:00:32.433 INFO:tasks.workunit.client.1.smithi190.stdout:2/814: dwrite d10/d59/d5e/fb6 [0,4194304] 0 2023-12-06T15:00:32.436 INFO:tasks.workunit.client.0.smithi152.stdout:2/471: creat d6/d1e/d41/d83/f99 x:0 0 0 2023-12-06T15:00:32.440 INFO:tasks.workunit.client.1.smithi190.stdout:6/858: creat d4/d12/d1a/d44/dfc/ded/f11e x:0 0 0 2023-12-06T15:00:32.443 INFO:tasks.workunit.client.0.smithi152.stdout:2/472: symlink d6/d1e/l9a 0 2023-12-06T15:00:32.443 INFO:tasks.workunit.client.0.smithi152.stdout:2/473: chown d6/d1e/d41/c5c 108710527 1 2023-12-06T15:00:32.444 INFO:tasks.workunit.client.0.smithi152.stdout:2/474: getdents d6/d18/d43/d95 0 2023-12-06T15:00:32.453 INFO:tasks.workunit.client.1.smithi190.stdout:6/859: dread d4/d12/d1a/d32/dc7/dd0/fd6 [0,4194304] 0 2023-12-06T15:00:32.454 INFO:tasks.workunit.client.1.smithi190.stdout:2/815: dread d10/d26/d5c/d37/fa9 [0,4194304] 0 2023-12-06T15:00:32.454 INFO:tasks.workunit.client.1.smithi190.stdout:2/816: fdatasync d10/d26/d5c/d49/d7e/fb8 0 2023-12-06T15:00:32.455 INFO:tasks.workunit.client.1.smithi190.stdout:6/860: mknod d4/d12/d1a/db4/c11f 0 2023-12-06T15:00:32.455 INFO:tasks.workunit.client.1.smithi190.stdout:5/729: sync 2023-12-06T15:00:32.455 INFO:tasks.workunit.client.1.smithi190.stdout:5/730: chown d0/d1c/d2b/f32 496 1 2023-12-06T15:00:32.458 INFO:tasks.workunit.client.1.smithi190.stdout:2/817: creat d10/d59/dcd/f111 x:0 0 0 2023-12-06T15:00:32.458 INFO:tasks.workunit.client.1.smithi190.stdout:5/731: link d0/d1c/d2b/d2c/d5d/l8a d0/d1c/d85/d90/d99/l102 0 2023-12-06T15:00:32.460 INFO:tasks.workunit.client.1.smithi190.stdout:6/861: dread d4/d12/d1a/d44/f57 [0,4194304] 0 2023-12-06T15:00:32.477 INFO:tasks.workunit.client.0.smithi152.stdout:3/554: dwrite d9/d10/d12/d43/d52/d58/da9/f3d [0,4194304] 0 2023-12-06T15:00:32.478 INFO:tasks.workunit.client.1.smithi190.stdout:5/732: dread d0/df/d50/fa4 [0,4194304] 0 2023-12-06T15:00:32.478 INFO:tasks.workunit.client.1.smithi190.stdout:5/733: chown d0/la2 455893768 1 2023-12-06T15:00:32.478 INFO:tasks.workunit.client.1.smithi190.stdout:5/734: read - d0/d1c/d2b/d8b/fd1 zero size 2023-12-06T15:00:32.479 INFO:tasks.workunit.client.0.smithi152.stdout:3/555: truncate d9/d10/d19/f7b 2840562 0 2023-12-06T15:00:32.480 INFO:tasks.workunit.client.0.smithi152.stdout:3/556: rename d9/d18/d51/d8d/f98 to d9/d18/d1a/d65/faa 0 2023-12-06T15:00:32.480 INFO:tasks.workunit.client.0.smithi152.stdout:3/557: chown d9/d10/d12/d43/d52/c84 2205757 1 2023-12-06T15:00:32.482 INFO:tasks.workunit.client.0.smithi152.stdout:3/558: mkdir d9/d18/d51/d8d/d8f/da0/dab 0 2023-12-06T15:00:32.484 INFO:tasks.workunit.client.1.smithi190.stdout:5/735: write d0/d6c/fe0 [2311982,44625] 0 2023-12-06T15:00:32.484 INFO:tasks.workunit.client.1.smithi190.stdout:5/736: chown d0/d1c/d2b/d2c/d5d/d73/f1f 30 1 2023-12-06T15:00:32.486 INFO:tasks.workunit.client.1.smithi190.stdout:5/737: rename d0/d6c/dcd/fe8 to d0/d1c/d85/d90/dba/f103 0 2023-12-06T15:00:32.486 INFO:tasks.workunit.client.1.smithi190.stdout:5/738: write d0/fd [3299800,115092] 0 2023-12-06T15:00:32.486 INFO:tasks.workunit.client.1.smithi190.stdout:5/739: chown d0/d6c/fe0 7 1 2023-12-06T15:00:32.489 INFO:tasks.workunit.client.1.smithi190.stdout:5/740: link d0/d1c/d2b/d2c/d5d/f95 d0/d1c/d2b/d69/f104 0 2023-12-06T15:00:32.489 INFO:tasks.workunit.client.1.smithi190.stdout:5/741: fdatasync d0/d1c/d85/d90/d99/fa3 0 2023-12-06T15:00:32.491 INFO:tasks.workunit.client.0.smithi152.stdout:7/428: dwrite dd/df/f5e [0,4194304] 0 2023-12-06T15:00:32.492 INFO:tasks.workunit.client.1.smithi190.stdout:2/818: dwrite d10/d59/dcd/dad/dc4/d7f/d8e/fbd [0,4194304] 0 2023-12-06T15:00:32.492 INFO:tasks.workunit.client.1.smithi190.stdout:2/819: write d10/d26/d5c/f94 [1460606,72909] 0 2023-12-06T15:00:32.492 INFO:tasks.workunit.client.1.smithi190.stdout:6/862: dwrite d4/d12/d40/d43/d45/d4a/f105 [0,4194304] 0 2023-12-06T15:00:32.493 INFO:tasks.workunit.client.0.smithi152.stdout:2/475: dwrite d6/f40 [0,4194304] 0 2023-12-06T15:00:32.493 INFO:tasks.workunit.client.0.smithi152.stdout:2/476: stat d6/d1e/l8f 0 2023-12-06T15:00:32.493 INFO:tasks.workunit.client.0.smithi152.stdout:4/762: dwrite d2/d15/d32/d54/d85/f86 [0,4194304] 0 2023-12-06T15:00:32.495 INFO:tasks.workunit.client.1.smithi190.stdout:6/863: readlink d4/d12/d40/d43/d45/d4a/d77/dca/l37 0 2023-12-06T15:00:32.496 INFO:tasks.workunit.client.0.smithi152.stdout:7/429: symlink dd/df/d1b/d20/d28/d53/l83 0 2023-12-06T15:00:32.498 INFO:tasks.workunit.client.1.smithi190.stdout:6/864: mknod d4/d12/d1a/d32/dab/de9/c120 0 2023-12-06T15:00:32.498 INFO:tasks.workunit.client.1.smithi190.stdout:6/865: chown d4/d12/d1a/d70/f10d 55688219 1 2023-12-06T15:00:32.499 INFO:tasks.workunit.client.0.smithi152.stdout:2/477: symlink d6/d18/d70/l9b 0 2023-12-06T15:00:32.503 INFO:tasks.workunit.client.0.smithi152.stdout:4/763: mkdir d2/d10/dbb/dca/dbc/d75/deb 0 2023-12-06T15:00:32.503 INFO:tasks.workunit.client.0.smithi152.stdout:4/764: readlink d2/d10/dbb/dca/dbc/le6 0 2023-12-06T15:00:32.506 INFO:tasks.workunit.client.0.smithi152.stdout:2/478: link d6/d18/d43/l51 d6/d1e/d7a/l9c 0 2023-12-06T15:00:32.507 INFO:tasks.workunit.client.0.smithi152.stdout:4/765: symlink d2/d45/lec 0 2023-12-06T15:00:32.509 INFO:tasks.workunit.client.0.smithi152.stdout:2/479: creat d6/d1e/d41/d92/f9d x:0 0 0 2023-12-06T15:00:32.509 INFO:tasks.workunit.client.0.smithi152.stdout:2/480: write d6/db/d17/f59 [413892,122710] 0 2023-12-06T15:00:32.509 INFO:tasks.workunit.client.0.smithi152.stdout:2/481: truncate d6/d1e/d41/f60 81583 0 2023-12-06T15:00:32.509 INFO:tasks.workunit.client.0.smithi152.stdout:7/430: write f8 [1384054,62212] 0 2023-12-06T15:00:32.509 INFO:tasks.workunit.client.0.smithi152.stdout:7/431: fdatasync dd/df/d1b/d20/d28/d38/f82 0 2023-12-06T15:00:32.509 INFO:tasks.workunit.client.0.smithi152.stdout:7/432: write dd/df/d34/f59 [1598067,100528] 0 2023-12-06T15:00:32.510 INFO:tasks.workunit.client.0.smithi152.stdout:4/766: creat d2/d15/d32/fed x:0 0 0 2023-12-06T15:00:32.510 INFO:tasks.workunit.client.1.smithi190.stdout:6/866: dread d4/fc [8388608,4194304] 0 2023-12-06T15:00:32.511 INFO:tasks.workunit.client.0.smithi152.stdout:2/482: truncate d6/db/f39 2817283 0 2023-12-06T15:00:32.512 INFO:tasks.workunit.client.0.smithi152.stdout:7/433: creat dd/df/d1b/d20/d7c/f84 x:0 0 0 2023-12-06T15:00:32.513 INFO:tasks.workunit.client.0.smithi152.stdout:7/434: symlink dd/df/d1b/d20/d28/l85 0 2023-12-06T15:00:32.515 INFO:tasks.workunit.client.0.smithi152.stdout:7/435: mkdir dd/df/d1b/d20/d7c/d86 0 2023-12-06T15:00:32.515 INFO:tasks.workunit.client.0.smithi152.stdout:7/436: chown dd/d69/l37 26138 1 2023-12-06T15:00:32.517 INFO:tasks.workunit.client.0.smithi152.stdout:7/437: unlink dd/df/d1b/d20/d28/c52 0 2023-12-06T15:00:32.517 INFO:tasks.workunit.client.0.smithi152.stdout:7/438: dread - dd/df/d1b/f7d zero size 2023-12-06T15:00:32.521 INFO:tasks.workunit.client.0.smithi152.stdout:7/439: rename dd/df/f6a to dd/df/d1b/d20/d7c/d86/f87 0 2023-12-06T15:00:32.522 INFO:tasks.workunit.client.0.smithi152.stdout:7/440: truncate dd/df/d1b/d20/d28/d38/f39 254641 0 2023-12-06T15:00:32.522 INFO:tasks.workunit.client.0.smithi152.stdout:3/559: dwrite d9/d10/f7f [0,4194304] 0 2023-12-06T15:00:32.522 INFO:tasks.workunit.client.1.smithi190.stdout:6/867: dread d4/fd [4194304,4194304] 0 2023-12-06T15:00:32.523 INFO:tasks.workunit.client.1.smithi190.stdout:5/742: dwrite d0/d1c/d2b/d8b/fd1 [0,4194304] 0 2023-12-06T15:00:32.525 INFO:tasks.workunit.client.1.smithi190.stdout:2/820: dwrite d10/d26/d5c/d49/f6f [0,4194304] 0 2023-12-06T15:00:32.525 INFO:tasks.workunit.client.1.smithi190.stdout:6/868: truncate d4/d12/f53 2554113 0 2023-12-06T15:00:32.526 INFO:tasks.workunit.client.1.smithi190.stdout:5/743: getdents d0/d1c/d2b/d8b 0 2023-12-06T15:00:32.527 INFO:tasks.workunit.client.0.smithi152.stdout:7/441: creat dd/df/d1b/d20/d7c/f88 x:0 0 0 2023-12-06T15:00:32.527 INFO:tasks.workunit.client.1.smithi190.stdout:2/821: creat d10/d26/d5c/d42/f112 x:0 0 0 2023-12-06T15:00:32.528 INFO:tasks.workunit.client.1.smithi190.stdout:6/869: symlink d4/d12/d40/l121 0 2023-12-06T15:00:32.529 INFO:tasks.workunit.client.0.smithi152.stdout:7/442: mkdir dd/d69/d89 0 2023-12-06T15:00:32.530 INFO:tasks.workunit.client.1.smithi190.stdout:5/744: link d0/df/lfe d0/d6c/da7/df3/l105 0 2023-12-06T15:00:32.531 INFO:tasks.workunit.client.0.smithi152.stdout:7/443: creat dd/df/d34/f8a x:0 0 0 2023-12-06T15:00:32.531 INFO:tasks.workunit.client.0.smithi152.stdout:7/444: stat dd/df/d1b/d20/d28/d38/f56 0 2023-12-06T15:00:32.532 INFO:tasks.workunit.client.1.smithi190.stdout:5/745: link d0/d1c/d85/d90/fc0 d0/d1c/d3e/dea/f106 0 2023-12-06T15:00:32.532 INFO:tasks.workunit.client.1.smithi190.stdout:6/870: getdents d4/d12/d40/d43/d45/d4a/dc5 0 2023-12-06T15:00:32.534 INFO:tasks.workunit.client.0.smithi152.stdout:7/445: creat dd/df/d34/d44/d49/d73/d77/f8b x:0 0 0 2023-12-06T15:00:32.534 INFO:tasks.workunit.client.0.smithi152.stdout:7/446: stat dd/df/d1b/d4e/l61 0 2023-12-06T15:00:32.534 INFO:tasks.workunit.client.0.smithi152.stdout:7/447: truncate dd/df/d1b/f41 967755 0 2023-12-06T15:00:32.535 INFO:tasks.workunit.client.1.smithi190.stdout:5/746: creat d0/d1c/d2b/d8b/f107 x:0 0 0 2023-12-06T15:00:32.535 INFO:tasks.workunit.client.1.smithi190.stdout:5/747: readlink d0/d1c/d2b/d2c/d5d/d73/l71 0 2023-12-06T15:00:32.535 INFO:tasks.workunit.client.1.smithi190.stdout:5/748: chown d0/d6c/da7/fbb 452 1 2023-12-06T15:00:32.535 INFO:tasks.workunit.client.1.smithi190.stdout:5/749: fdatasync d0/d1c/d2b/d69/fac 0 2023-12-06T15:00:32.535 INFO:tasks.workunit.client.1.smithi190.stdout:5/750: write d0/d96/dc5/dd5/fc6 [730172,84579] 0 2023-12-06T15:00:32.535 INFO:tasks.workunit.client.1.smithi190.stdout:5/751: chown d0/d1c/d2b/d2c/f43 322040666 1 2023-12-06T15:00:32.535 INFO:tasks.workunit.client.0.smithi152.stdout:4/767: dwrite d2/d15/d32/d79/f82 [0,4194304] 0 2023-12-06T15:00:32.537 INFO:tasks.workunit.client.1.smithi190.stdout:5/752: link d0/d1c/d85/l9f d0/d1c/d94/l108 0 2023-12-06T15:00:32.539 INFO:tasks.workunit.client.1.smithi190.stdout:5/753: truncate d0/d1c/d2b/d69/fac 1307729 0 2023-12-06T15:00:32.541 INFO:tasks.workunit.client.0.smithi152.stdout:9/497: sync 2023-12-06T15:00:32.541 INFO:tasks.workunit.client.0.smithi152.stdout:9/498: chown d0/d3f/d68/d6c/d20/d38/d45/d43 36 1 2023-12-06T15:00:32.541 INFO:tasks.workunit.client.0.smithi152.stdout:6/756: sync 2023-12-06T15:00:32.541 INFO:tasks.workunit.client.0.smithi152.stdout:1/818: sync 2023-12-06T15:00:32.542 INFO:tasks.workunit.client.0.smithi152.stdout:8/475: sync 2023-12-06T15:00:32.542 INFO:tasks.workunit.client.0.smithi152.stdout:0/548: sync 2023-12-06T15:00:32.542 INFO:tasks.workunit.client.0.smithi152.stdout:5/611: sync 2023-12-06T15:00:32.543 INFO:tasks.workunit.client.0.smithi152.stdout:2/483: dread d6/d1e/d7a/f7b [0,4194304] 0 2023-12-06T15:00:32.543 INFO:tasks.workunit.client.0.smithi152.stdout:9/499: symlink d0/l8e 0 2023-12-06T15:00:32.543 INFO:tasks.workunit.client.0.smithi152.stdout:9/500: truncate d0/d50/f79 919662 0 2023-12-06T15:00:32.543 INFO:tasks.workunit.client.0.smithi152.stdout:6/757: rmdir d1/dcf/ddc/d1a/d30/d36/d35/d49/da6 39 2023-12-06T15:00:32.544 INFO:tasks.workunit.client.0.smithi152.stdout:2/484: read d6/d1e/d41/d55/f14 [2728586,67195] 0 2023-12-06T15:00:32.544 INFO:tasks.workunit.client.0.smithi152.stdout:2/485: write d6/d1e/d41/f60 [350460,64668] 0 2023-12-06T15:00:32.544 INFO:tasks.workunit.client.0.smithi152.stdout:8/476: unlink d1/d6/d34/d35/d66/f72 0 2023-12-06T15:00:32.546 INFO:tasks.workunit.client.1.smithi190.stdout:7/946: sync 2023-12-06T15:00:32.546 INFO:tasks.workunit.client.1.smithi190.stdout:7/947: write d0/d5/d63/ffd [4544931,66721] 0 2023-12-06T15:00:32.546 INFO:tasks.workunit.client.1.smithi190.stdout:7/948: truncate d0/df/d53/d2f/de9/f11e 10106 0 2023-12-06T15:00:32.547 INFO:tasks.workunit.client.0.smithi152.stdout:5/612: read d7/dd/d26/d3b/f5a [2771766,46844] 0 2023-12-06T15:00:32.547 INFO:tasks.workunit.client.0.smithi152.stdout:0/549: symlink d8/d3e/lb3 0 2023-12-06T15:00:32.547 INFO:tasks.workunit.client.0.smithi152.stdout:9/501: mkdir d0/d3f/d68/d6c/d20/d38/d45/d43/d8f 0 2023-12-06T15:00:32.548 INFO:tasks.workunit.client.1.smithi190.stdout:6/871: dread d4/d12/d1a/d44/f8f [0,4194304] 0 2023-12-06T15:00:32.549 INFO:tasks.workunit.client.0.smithi152.stdout:7/448: dread dd/df/f1a [4194304,4194304] 0 2023-12-06T15:00:32.550 INFO:tasks.workunit.client.0.smithi152.stdout:6/758: creat d1/dcf/ddc/d1a/d30/d36/d35/d49/da6/f10f x:0 0 0 2023-12-06T15:00:32.551 INFO:tasks.workunit.client.0.smithi152.stdout:2/486: unlink d6/c2d 0 2023-12-06T15:00:32.551 INFO:tasks.workunit.client.1.smithi190.stdout:7/949: rmdir d0/d88/d7a/d7c 39 2023-12-06T15:00:32.552 INFO:tasks.workunit.client.0.smithi152.stdout:0/550: creat d8/d15/d45/da4/fb4 x:0 0 0 2023-12-06T15:00:32.553 INFO:tasks.workunit.client.1.smithi190.stdout:9/961: sync 2023-12-06T15:00:32.553 INFO:tasks.workunit.client.1.smithi190.stdout:9/962: chown d4/d27/d2f/d31/la1 4886 1 2023-12-06T15:00:32.553 INFO:tasks.workunit.client.1.smithi190.stdout:9/963: write d4/d27/d2f/d31/d3f/d58/d72/fe6 [833238,4371] 0 2023-12-06T15:00:32.553 INFO:tasks.workunit.client.0.smithi152.stdout:9/502: mkdir d0/d3f/d68/d6c/d20/d38/d48/d90 0 2023-12-06T15:00:32.554 INFO:tasks.workunit.client.0.smithi152.stdout:5/613: write d7/dd/fb6 [1610443,127642] 0 2023-12-06T15:00:32.555 INFO:tasks.workunit.client.1.smithi190.stdout:8/794: sync 2023-12-06T15:00:32.556 INFO:tasks.workunit.client.1.smithi190.stdout:0/756: sync 2023-12-06T15:00:32.556 INFO:tasks.workunit.client.1.smithi190.stdout:3/862: sync 2023-12-06T15:00:32.556 INFO:tasks.workunit.client.1.smithi190.stdout:4/779: sync 2023-12-06T15:00:32.556 INFO:tasks.workunit.client.0.smithi152.stdout:7/449: creat dd/df/d34/d44/f8c x:0 0 0 2023-12-06T15:00:32.556 INFO:tasks.workunit.client.0.smithi152.stdout:1/819: dread d3/da/fa6 [0,4194304] 0 2023-12-06T15:00:32.556 INFO:tasks.workunit.client.0.smithi152.stdout:4/768: dwrite d2/d10/dbb/dca/dbc/fdc [0,4194304] 0 2023-12-06T15:00:32.556 INFO:tasks.workunit.client.0.smithi152.stdout:2/487: chown d6/d1e/l3a 104 1 2023-12-06T15:00:32.556 INFO:tasks.workunit.client.0.smithi152.stdout:2/488: stat d6/d1e 0 2023-12-06T15:00:32.557 INFO:tasks.workunit.client.0.smithi152.stdout:9/503: rmdir d0/d3f/d68/d6c/d20/d38/d45/d43/d8f 0 2023-12-06T15:00:32.557 INFO:tasks.workunit.client.0.smithi152.stdout:9/504: truncate d0/d3f/d68/d6c/d20/d38/d45/d43/f52 790839 0 2023-12-06T15:00:32.559 INFO:tasks.workunit.client.1.smithi190.stdout:7/950: mknod d0/df/d1f/dfa/c130 0 2023-12-06T15:00:32.560 INFO:tasks.workunit.client.1.smithi190.stdout:6/872: mknod d4/d12/d1a/d32/c122 0 2023-12-06T15:00:32.560 INFO:tasks.workunit.client.1.smithi190.stdout:9/964: dread d4/d27/d2f/d5c/d9d/f11c [0,4194304] 0 2023-12-06T15:00:32.560 INFO:tasks.workunit.client.1.smithi190.stdout:6/873: fdatasync d4/d12/d1a/d70/fcd 0 2023-12-06T15:00:32.560 INFO:tasks.workunit.client.1.smithi190.stdout:9/965: chown d4/d27/d2f/d31/d3f/d58/d72/cc4 50 1 2023-12-06T15:00:32.560 INFO:tasks.workunit.client.0.smithi152.stdout:1/820: chown d3/da/f5c 24 1 2023-12-06T15:00:32.561 INFO:tasks.workunit.client.0.smithi152.stdout:4/769: symlink d2/d45/d84/da4/lee 0 2023-12-06T15:00:32.562 INFO:tasks.workunit.client.0.smithi152.stdout:1/821: symlink d3/da/d15/d17/d4d/da7/l12a 0 2023-12-06T15:00:32.562 INFO:tasks.workunit.client.0.smithi152.stdout:1/822: chown d3/da/d4c/d82/d52/d55/cf6 9158 1 2023-12-06T15:00:32.563 INFO:tasks.workunit.client.1.smithi190.stdout:8/795: unlink d1/d20/d3b/l7b 0 2023-12-06T15:00:32.563 INFO:tasks.workunit.client.1.smithi190.stdout:8/796: chown d1/d37/fc1 1456598 1 2023-12-06T15:00:32.563 INFO:tasks.workunit.client.1.smithi190.stdout:5/754: dread d0/d1c/d94/fc4 [0,4194304] 0 2023-12-06T15:00:32.565 INFO:tasks.workunit.client.0.smithi152.stdout:6/759: read d1/dcf/ddc/d1a/d30/d36/f2e [3767873,55100] 0 2023-12-06T15:00:32.565 INFO:tasks.workunit.client.0.smithi152.stdout:6/760: write d1/d69/da1/deb/f10b [887997,31645] 0 2023-12-06T15:00:32.565 INFO:tasks.workunit.client.1.smithi190.stdout:0/757: rmdir d0/da/d3e/d2b/d3c/d46/d8e/d90 39 2023-12-06T15:00:32.565 INFO:tasks.workunit.client.1.smithi190.stdout:0/758: fsync d0/da/d3e/d2b/d3c/d4c/da8/fb9 0 2023-12-06T15:00:32.566 INFO:tasks.workunit.client.1.smithi190.stdout:4/780: getdents d3/d76/d8b 0 2023-12-06T15:00:32.566 INFO:tasks.workunit.client.1.smithi190.stdout:7/951: symlink d0/d35/d8e/l131 0 2023-12-06T15:00:32.568 INFO:tasks.workunit.client.0.smithi152.stdout:4/770: creat d2/d15/d32/fef x:0 0 0 2023-12-06T15:00:32.568 INFO:tasks.workunit.client.0.smithi152.stdout:4/771: readlink d2/d15/d32/d79/l8b 0 2023-12-06T15:00:32.568 INFO:tasks.workunit.client.0.smithi152.stdout:4/772: fsync d2/d15/d32/d69/d6f/d6c/f73 0 2023-12-06T15:00:32.569 INFO:tasks.workunit.client.1.smithi190.stdout:6/874: rename d4/d12/d1a/d8a/l91 to d4/d12/d1a/d8a/l123 0 2023-12-06T15:00:32.569 INFO:tasks.workunit.client.1.smithi190.stdout:6/875: truncate d4/d12/d1a/d32/dc7/f102 397062 0 2023-12-06T15:00:32.569 INFO:tasks.workunit.client.1.smithi190.stdout:8/797: link d1/d20/d3b/d4c/d8e/d94/d25/lb0 d1/d20/d3b/d4c/d8e/d94/db6/lf0 0 2023-12-06T15:00:32.570 INFO:tasks.workunit.client.0.smithi152.stdout:5/614: write d7/dd/d26/d3a/f7b [722919,86852] 0 2023-12-06T15:00:32.570 INFO:tasks.workunit.client.0.smithi152.stdout:5/615: readlink d7/dd/d26/l4a 0 2023-12-06T15:00:32.570 INFO:tasks.workunit.client.0.smithi152.stdout:5/616: chown d7/dd/d26/d3b/d46/d7e/fce 1942930899 1 2023-12-06T15:00:32.570 INFO:tasks.workunit.client.0.smithi152.stdout:5/617: getdents d7/dd/d26/d3b/d46/dc9 0 2023-12-06T15:00:32.570 INFO:tasks.workunit.client.0.smithi152.stdout:5/618: write d7/dd/d4e/dac/fcb [5126100,16450] 0 2023-12-06T15:00:32.570 INFO:tasks.workunit.client.1.smithi190.stdout:5/755: rename d0/d1c/d2b/d69/f104 to d0/df/f109 0 2023-12-06T15:00:32.570 INFO:tasks.workunit.client.1.smithi190.stdout:3/863: dread d4/d1b/d5d/faf [0,4194304] 0 2023-12-06T15:00:32.572 INFO:tasks.workunit.client.1.smithi190.stdout:9/966: write d4/f2e [1463357,37828] 0 2023-12-06T15:00:32.573 INFO:tasks.workunit.client.0.smithi152.stdout:1/823: creat d3/da/dcd/dd9/f12b x:0 0 0 2023-12-06T15:00:32.573 INFO:tasks.workunit.client.0.smithi152.stdout:1/824: write d3/da/d15/f5e [4512443,13407] 0 2023-12-06T15:00:32.575 INFO:tasks.workunit.client.0.smithi152.stdout:4/773: mknod d2/d10/dbb/cf0 0 2023-12-06T15:00:32.575 INFO:tasks.workunit.client.0.smithi152.stdout:5/619: symlink d7/dd/d4e/ld7 0 2023-12-06T15:00:32.577 INFO:tasks.workunit.client.0.smithi152.stdout:1/825: dread d3/da/d4c/d82/d52/d62/fb8 [4194304,4194304] 0 2023-12-06T15:00:32.577 INFO:tasks.workunit.client.1.smithi190.stdout:3/864: dread d4/d70/d19/d3a/f7b [0,4194304] 0 2023-12-06T15:00:32.580 INFO:tasks.workunit.client.0.smithi152.stdout:1/826: creat d3/da/d15/f12c x:0 0 0 2023-12-06T15:00:32.580 INFO:tasks.workunit.client.0.smithi152.stdout:1/827: write d3/da/d4c/d82/d52/d62/f72 [3223309,94544] 0 2023-12-06T15:00:32.581 INFO:tasks.workunit.client.0.smithi152.stdout:1/828: creat d3/da/d15/d17/d58/f12d x:0 0 0 2023-12-06T15:00:32.581 INFO:tasks.workunit.client.0.smithi152.stdout:1/829: chown d3/da/d65/f77 361296410 1 2023-12-06T15:00:32.582 INFO:tasks.workunit.client.0.smithi152.stdout:4/774: write d2/f3a [766708,98735] 0 2023-12-06T15:00:32.583 INFO:tasks.workunit.client.0.smithi152.stdout:1/830: rmdir d3/da/d4c/d63/d96 39 2023-12-06T15:00:32.584 INFO:tasks.workunit.client.0.smithi152.stdout:4/775: rmdir d2/d10 39 2023-12-06T15:00:32.584 INFO:tasks.workunit.client.0.smithi152.stdout:4/776: fsync d2/d10/dbb/dca/dcb/f43 0 2023-12-06T15:00:32.585 INFO:tasks.workunit.client.0.smithi152.stdout:4/777: creat d2/d15/d32/d79/ff1 x:0 0 0 2023-12-06T15:00:32.586 INFO:tasks.workunit.client.0.smithi152.stdout:4/778: read d2/d22/f18 [1025912,57013] 0 2023-12-06T15:00:32.586 INFO:tasks.workunit.client.0.smithi152.stdout:2/489: dwrite d6/db/d17/f46 [0,4194304] 0 2023-12-06T15:00:32.586 INFO:tasks.workunit.client.0.smithi152.stdout:2/490: stat d6/db/d17/f28 0 2023-12-06T15:00:32.587 INFO:tasks.workunit.client.1.smithi190.stdout:6/876: dread d4/d12/d1a/db4/fc0 [0,4194304] 0 2023-12-06T15:00:32.587 INFO:tasks.workunit.client.1.smithi190.stdout:6/877: stat d4/d12/d40/d43/d45/d4a/d77/dca/l37 0 2023-12-06T15:00:32.588 INFO:tasks.workunit.client.0.smithi152.stdout:4/779: getdents d2/d22/d6e/da8 0 2023-12-06T15:00:32.588 INFO:tasks.workunit.client.0.smithi152.stdout:4/780: readlink d2/d15/d32/d79/l4f 0 2023-12-06T15:00:32.590 INFO:tasks.workunit.client.0.smithi152.stdout:4/781: mknod d2/d10/dbb/dca/dbc/d75/cf2 0 2023-12-06T15:00:32.592 INFO:tasks.workunit.client.0.smithi152.stdout:2/491: symlink d6/d1e/l9e 0 2023-12-06T15:00:32.592 INFO:tasks.workunit.client.0.smithi152.stdout:2/492: read - d6/db/f72 zero size 2023-12-06T15:00:32.592 INFO:tasks.workunit.client.0.smithi152.stdout:2/493: stat d6/db/c52 0 2023-12-06T15:00:32.592 INFO:tasks.workunit.client.0.smithi152.stdout:4/782: creat d2/d10/ff3 x:0 0 0 2023-12-06T15:00:32.592 INFO:tasks.workunit.client.0.smithi152.stdout:4/783: truncate d2/d10/ff3 156549 0 2023-12-06T15:00:32.593 INFO:tasks.workunit.client.0.smithi152.stdout:2/494: creat d6/d1e/d7a/f9f x:0 0 0 2023-12-06T15:00:32.594 INFO:tasks.workunit.client.0.smithi152.stdout:4/784: unlink d2/d15/d32/f5a 0 2023-12-06T15:00:32.596 INFO:tasks.workunit.client.0.smithi152.stdout:2/495: dread d6/d18/f81 [0,4194304] 0 2023-12-06T15:00:32.597 INFO:tasks.workunit.client.0.smithi152.stdout:2/496: truncate d6/d18/f58 1195749 0 2023-12-06T15:00:32.597 INFO:tasks.workunit.client.0.smithi152.stdout:2/497: symlink d6/d18/la0 0 2023-12-06T15:00:32.599 INFO:tasks.workunit.client.0.smithi152.stdout:9/505: dwrite d0/f14 [0,4194304] 0 2023-12-06T15:00:32.599 INFO:tasks.workunit.client.0.smithi152.stdout:9/506: fsync d0/d3f/d68/d6c/f17 0 2023-12-06T15:00:32.599 INFO:tasks.workunit.client.0.smithi152.stdout:9/507: write d0/d50/f79 [434466,44165] 0 2023-12-06T15:00:32.603 INFO:tasks.workunit.client.0.smithi152.stdout:8/477: dwrite d1/d6/f69 [0,4194304] 0 2023-12-06T15:00:32.603 INFO:tasks.workunit.client.1.smithi190.stdout:7/952: dwrite d0/d88/d7a/d7c/dab/dc0/ff7 [4194304,4194304] 0 2023-12-06T15:00:32.603 INFO:tasks.workunit.client.1.smithi190.stdout:7/953: readlink d0/d88/d7a/dc9/ld3 0 2023-12-06T15:00:32.604 INFO:tasks.workunit.client.0.smithi152.stdout:5/620: dwrite d7/fc [0,4194304] 0 2023-12-06T15:00:32.604 INFO:tasks.workunit.client.0.smithi152.stdout:4/785: dread d2/d15/d32/d69/d6f/d6c/f73 [0,4194304] 0 2023-12-06T15:00:32.605 INFO:tasks.workunit.client.0.smithi152.stdout:1/831: dwrite d3/d44/d84/f9b [0,4194304] 0 2023-12-06T15:00:32.607 INFO:tasks.workunit.client.0.smithi152.stdout:9/508: rename d0/d3f/d68/d6c/d20/d38/c65 to d0/d3f/d68/d6c/d20/d4a/d71/c91 0 2023-12-06T15:00:32.609 INFO:tasks.workunit.client.0.smithi152.stdout:2/498: dread d6/d1e/d41/d55/f4b [0,4194304] 0 2023-12-06T15:00:32.610 INFO:tasks.workunit.client.0.smithi152.stdout:8/478: truncate d1/d6/d34/d35/d38/f4e 158434 0 2023-12-06T15:00:32.611 INFO:tasks.workunit.client.0.smithi152.stdout:8/479: read d1/d6/d34/d36/d58/f6e [141965,21249] 0 2023-12-06T15:00:32.611 INFO:tasks.workunit.client.0.smithi152.stdout:8/480: readlink d1/d6/d34/d40/d64/l65 0 2023-12-06T15:00:32.615 INFO:tasks.workunit.client.0.smithi152.stdout:5/621: stat d7/d43/d6c/da4/la9 0 2023-12-06T15:00:32.616 INFO:tasks.workunit.client.0.smithi152.stdout:4/786: mknod d2/d22/d6e/da8/cf4 0 2023-12-06T15:00:32.616 INFO:tasks.workunit.client.0.smithi152.stdout:4/787: dread - d2/d15/d32/d79/ff1 zero size 2023-12-06T15:00:32.616 INFO:tasks.workunit.client.0.smithi152.stdout:4/788: stat d2/d15/d32/f66 0 2023-12-06T15:00:32.618 INFO:tasks.workunit.client.0.smithi152.stdout:5/622: write d7/fb [249298,42623] 0 2023-12-06T15:00:32.619 INFO:tasks.workunit.client.0.smithi152.stdout:1/832: creat d3/da/d4c/d82/d52/d62/dcc/f12e x:0 0 0 2023-12-06T15:00:32.619 INFO:tasks.workunit.client.0.smithi152.stdout:2/499: mknod d6/d18/d70/ca1 0 2023-12-06T15:00:32.623 INFO:tasks.workunit.client.0.smithi152.stdout:2/500: mkdir d6/d1e/d41/da2 0 2023-12-06T15:00:32.623 INFO:tasks.workunit.client.0.smithi152.stdout:2/501: fdatasync d6/d1e/d41/d55/f89 0 2023-12-06T15:00:32.623 INFO:tasks.workunit.client.0.smithi152.stdout:5/623: write d7/d43/d6c/fd1 [983517,59855] 0 2023-12-06T15:00:32.624 INFO:tasks.workunit.client.0.smithi152.stdout:4/789: link d2/d15/l5f d2/lf5 0 2023-12-06T15:00:32.625 INFO:tasks.workunit.client.0.smithi152.stdout:2/502: write d6/db/f2b [4149296,87496] 0 2023-12-06T15:00:32.627 INFO:tasks.workunit.client.0.smithi152.stdout:5/624: creat d7/dd/d26/fd8 x:0 0 0 2023-12-06T15:00:32.629 INFO:tasks.workunit.client.0.smithi152.stdout:5/625: creat d7/d43/fd9 x:0 0 0 2023-12-06T15:00:32.629 INFO:tasks.workunit.client.0.smithi152.stdout:5/626: fdatasync d7/d47/fa0 0 2023-12-06T15:00:32.629 INFO:tasks.workunit.client.0.smithi152.stdout:5/627: stat d7/dd/d26/d3b/d46/d7e/fce 0 2023-12-06T15:00:32.629 INFO:tasks.workunit.client.0.smithi152.stdout:5/628: chown d7/c9 29690601 1 2023-12-06T15:00:32.629 INFO:tasks.workunit.client.0.smithi152.stdout:5/629: truncate d7/d43/f7f 724254 0 2023-12-06T15:00:32.641 INFO:tasks.workunit.client.0.smithi152.stdout:9/509: dwrite d0/d3f/d68/d6c/d20/d38/f3d [0,4194304] 0 2023-12-06T15:00:32.642 INFO:tasks.workunit.client.0.smithi152.stdout:9/510: chown d0/d3f/d68/d6c/d20/d38/d44/f4e 0 1 2023-12-06T15:00:32.642 INFO:tasks.workunit.client.0.smithi152.stdout:9/511: fdatasync d0/d3f/d68/f6a 0 2023-12-06T15:00:32.644 INFO:tasks.workunit.client.0.smithi152.stdout:9/512: mkdir d0/d3f/d68/d6c/d92 0 2023-12-06T15:00:32.645 INFO:tasks.workunit.client.0.smithi152.stdout:9/513: creat d0/d50/f93 x:0 0 0 2023-12-06T15:00:32.661 INFO:tasks.workunit.client.0.smithi152.stdout:8/481: dwrite d1/d6/d34/d35/d66/f71 [0,4194304] 0 2023-12-06T15:00:32.661 INFO:tasks.workunit.client.0.smithi152.stdout:4/790: dwrite d2/d10/dbb/dca/dcb/f48 [4194304,4194304] 0 2023-12-06T15:00:32.662 INFO:tasks.workunit.client.0.smithi152.stdout:4/791: chown d2/d10/dab 327 1 2023-12-06T15:00:32.662 INFO:tasks.workunit.client.1.smithi190.stdout:7/954: dwrite d0/d5/d63/fc4 [0,4194304] 0 2023-12-06T15:00:32.662 INFO:tasks.workunit.client.1.smithi190.stdout:7/955: truncate d0/d88/d33/d4c/f105 622464 0 2023-12-06T15:00:32.662 INFO:tasks.workunit.client.0.smithi152.stdout:5/630: dwrite d7/dd/d26/d3b/f8b [0,4194304] 0 2023-12-06T15:00:32.664 INFO:tasks.workunit.client.0.smithi152.stdout:8/482: creat d1/d6/d34/f98 x:0 0 0 2023-12-06T15:00:32.668 INFO:tasks.workunit.client.0.smithi152.stdout:9/514: dwrite d0/d3f/d68/d6c/f2f [0,4194304] 0 2023-12-06T15:00:32.668 INFO:tasks.workunit.client.0.smithi152.stdout:9/515: write d0/d3f/d68/d6c/d20/d4a/d4d/d69/f7a [240947,85989] 0 2023-12-06T15:00:32.670 INFO:tasks.workunit.client.0.smithi152.stdout:5/631: link d7/dd/d26/d48/f85 d7/dd/d26/d48/dbb/fda 0 2023-12-06T15:00:32.672 INFO:tasks.workunit.client.0.smithi152.stdout:4/792: dread d2/d22/d6e/fb7 [0,4194304] 0 2023-12-06T15:00:32.672 INFO:tasks.workunit.client.0.smithi152.stdout:4/793: write d2/d15/f7f [1295727,99527] 0 2023-12-06T15:00:32.672 INFO:tasks.workunit.client.0.smithi152.stdout:4/794: chown d2/d15/d32/d79 11 1 2023-12-06T15:00:32.673 INFO:tasks.workunit.client.0.smithi152.stdout:8/483: mknod d1/d6/d29/d87/c99 0 2023-12-06T15:00:32.676 INFO:tasks.workunit.client.1.smithi190.stdout:0/759: getdents d0/da/d3e/d2b/d3c/d46 0 2023-12-06T15:00:32.679 INFO:tasks.workunit.client.0.smithi152.stdout:8/484: creat d1/d6/d34/d90/f9a x:0 0 0 2023-12-06T15:00:32.680 INFO:tasks.workunit.client.1.smithi190.stdout:4/781: symlink d3/d76/d7c/d8a/l111 0 2023-12-06T15:00:32.681 INFO:tasks.workunit.client.0.smithi152.stdout:8/485: truncate d1/d6/f31 3350748 0 2023-12-06T15:00:32.681 INFO:tasks.workunit.client.0.smithi152.stdout:8/486: chown d1/d6/d34/d35 0 1 2023-12-06T15:00:32.681 INFO:tasks.workunit.client.0.smithi152.stdout:8/487: fdatasync d1/d6/d34/d36/f2b 0 2023-12-06T15:00:32.682 INFO:tasks.workunit.client.0.smithi152.stdout:8/488: write d1/d6/d34/d6f/f5c [3643151,80661] 0 2023-12-06T15:00:32.682 INFO:tasks.workunit.client.1.smithi190.stdout:8/798: mknod d1/d20/d3b/d34/cf1 0 2023-12-06T15:00:32.683 INFO:tasks.workunit.client.0.smithi152.stdout:8/489: read d1/d6/d34/d36/f60 [88803,122925] 0 2023-12-06T15:00:32.685 INFO:tasks.workunit.client.1.smithi190.stdout:5/756: symlink d0/d1c/d2b/d2c/l10a 0 2023-12-06T15:00:32.686 INFO:tasks.workunit.client.0.smithi152.stdout:8/490: creat d1/d6/d34/d35/f9b x:0 0 0 2023-12-06T15:00:32.686 INFO:tasks.workunit.client.0.smithi152.stdout:8/491: fsync d1/d6/d34/d36/f79 0 2023-12-06T15:00:32.686 INFO:tasks.workunit.client.0.smithi152.stdout:8/492: fsync d1/d6/d34/d36/f5d 0 2023-12-06T15:00:32.693 INFO:tasks.workunit.client.1.smithi190.stdout:3/865: link d4/d70/d19/l123 d4/d1b/d5d/df1/l130 0 2023-12-06T15:00:32.693 INFO:tasks.workunit.client.1.smithi190.stdout:3/866: fsync d4/d1b/d54/d9c/fb2 0 2023-12-06T15:00:32.694 INFO:tasks.workunit.client.1.smithi190.stdout:6/878: rename d4/fd to d4/d12/d40/d43/dba/f124 0 2023-12-06T15:00:32.694 INFO:tasks.workunit.client.1.smithi190.stdout:6/879: fsync d4/d12/d40/d43/f9b 0 2023-12-06T15:00:32.697 INFO:tasks.workunit.client.1.smithi190.stdout:7/956: symlink d0/df/d53/d2f/l132 0 2023-12-06T15:00:32.699 INFO:tasks.workunit.client.1.smithi190.stdout:0/760: creat d0/da/d3e/d2b/d3c/d4c/dcc/ff7 x:0 0 0 2023-12-06T15:00:32.699 INFO:tasks.workunit.client.1.smithi190.stdout:4/782: creat d3/d35/d19/d67/db5/dbe/f112 x:0 0 0 2023-12-06T15:00:32.699 INFO:tasks.workunit.client.1.smithi190.stdout:0/761: write d0/da/d3e/d3a/d40/ff5 [785775,115684] 0 2023-12-06T15:00:32.700 INFO:tasks.workunit.client.1.smithi190.stdout:5/757: rmdir d0/d1c/d94 39 2023-12-06T15:00:32.702 INFO:tasks.workunit.client.1.smithi190.stdout:6/880: mknod d4/d12/d1a/d32/dc7/c125 0 2023-12-06T15:00:32.702 INFO:tasks.workunit.client.1.smithi190.stdout:6/881: chown d4/d12/d40/d43/d45/d4a/l84 61 1 2023-12-06T15:00:32.702 INFO:tasks.workunit.client.1.smithi190.stdout:6/882: fdatasync d4/d12/d1a/d44/dfc/ded/ff1 0 2023-12-06T15:00:32.703 INFO:tasks.workunit.client.1.smithi190.stdout:3/867: read d4/d70/d19/d3a/d3b/d72/f86 [428241,7939] 0 2023-12-06T15:00:32.703 INFO:tasks.workunit.client.1.smithi190.stdout:9/967: dread d4/f67 [0,4194304] 0 2023-12-06T15:00:32.703 INFO:tasks.workunit.client.1.smithi190.stdout:0/762: mknod d0/da/d3e/d2b/cf8 0 2023-12-06T15:00:32.704 INFO:tasks.workunit.client.1.smithi190.stdout:4/783: creat d3/d76/dc4/dc5/daa/f113 x:0 0 0 2023-12-06T15:00:32.704 INFO:tasks.workunit.client.1.smithi190.stdout:3/868: write d4/d1b/d54/d9c/d68/dfc/f65 [1579219,65397] 0 2023-12-06T15:00:32.704 INFO:tasks.workunit.client.1.smithi190.stdout:5/758: link d0/d1c/d85/d90/lfb d0/d1c/d94/l10b 0 2023-12-06T15:00:32.707 INFO:tasks.workunit.client.1.smithi190.stdout:9/968: rename d4/d27/d8a/dbc/l10e to d4/d27/d2f/d31/d3f/d58/l13f 0 2023-12-06T15:00:32.707 INFO:tasks.workunit.client.1.smithi190.stdout:4/784: mknod d3/da4/d10d/c114 0 2023-12-06T15:00:32.707 INFO:tasks.workunit.client.1.smithi190.stdout:4/785: fsync d3/d35/d19/d41/d44/f9f 0 2023-12-06T15:00:32.708 INFO:tasks.workunit.client.1.smithi190.stdout:6/883: mknod d4/d12/d1a/c126 0 2023-12-06T15:00:32.711 INFO:tasks.workunit.client.1.smithi190.stdout:5/759: rename d0/d1c/d3e/d7e/f92 to d0/d1c/d2b/d8b/f10c 0 2023-12-06T15:00:32.712 INFO:tasks.workunit.client.1.smithi190.stdout:9/969: getdents d4/d27/d2f/d31/d3f/d58/d72/db3/dea 0 2023-12-06T15:00:32.712 INFO:tasks.workunit.client.1.smithi190.stdout:6/884: getdents d4/d12/d1a/d32/dab/de9 0 2023-12-06T15:00:32.715 INFO:tasks.workunit.client.1.smithi190.stdout:5/760: rmdir d0/d6c 39 2023-12-06T15:00:32.717 INFO:tasks.workunit.client.1.smithi190.stdout:9/970: creat d4/d27/d2f/d31/d3f/d58/d72/db3/d10f/d13c/f140 x:0 0 0 2023-12-06T15:00:32.719 INFO:tasks.workunit.client.1.smithi190.stdout:6/885: unlink d4/d12/d1a/d44/f47 0 2023-12-06T15:00:32.719 INFO:tasks.workunit.client.1.smithi190.stdout:6/886: chown d4/d12/d1a/d70/f104 2 1 2023-12-06T15:00:32.721 INFO:tasks.workunit.client.1.smithi190.stdout:5/761: rename d0/d1c/d2b/d2c/f49 to d0/f10d 0 2023-12-06T15:00:32.721 INFO:tasks.workunit.client.1.smithi190.stdout:5/762: truncate d0/d1c/d85/f91 669698 0 2023-12-06T15:00:32.723 INFO:tasks.workunit.client.1.smithi190.stdout:6/887: rename d4/d12/d9a/ca2 to d4/d12/d1a/d32/dab/de1/c127 0 2023-12-06T15:00:32.724 INFO:tasks.workunit.client.1.smithi190.stdout:6/888: dread - d4/d12/d40/d43/d45/d4a/f118 zero size 2023-12-06T15:00:32.724 INFO:tasks.workunit.client.1.smithi190.stdout:6/889: truncate d4/d12/f10a 219882 0 2023-12-06T15:00:32.724 INFO:tasks.workunit.client.1.smithi190.stdout:5/763: mknod d0/d1c/d85/d90/c10e 0 2023-12-06T15:00:32.724 INFO:tasks.workunit.client.1.smithi190.stdout:5/764: stat d0/d1c/d94/fc4 0 2023-12-06T15:00:32.726 INFO:tasks.workunit.client.1.smithi190.stdout:6/890: rename d4/d12/d1a/d59/l6e to d4/d12/d40/d43/d45/d4a/d77/l128 0 2023-12-06T15:00:32.726 INFO:tasks.workunit.client.1.smithi190.stdout:6/891: getdents d4/d12/d40/d43/d11d 0 2023-12-06T15:00:32.729 INFO:tasks.workunit.client.1.smithi190.stdout:9/971: dread d4/d27/d2f/d5c/fb2 [0,4194304] 0 2023-12-06T15:00:32.730 INFO:tasks.workunit.client.1.smithi190.stdout:9/972: mknod d4/d27/d8a/dbc/d124/c141 0 2023-12-06T15:00:32.731 INFO:tasks.workunit.client.0.smithi152.stdout:9/516: dwrite d0/d3f/d68/d6c/d20/f51 [0,4194304] 0 2023-12-06T15:00:32.731 INFO:tasks.workunit.client.0.smithi152.stdout:9/517: dread - d0/d3f/d68/f6a zero size 2023-12-06T15:00:32.731 INFO:tasks.workunit.client.0.smithi152.stdout:9/518: write d0/d3f/d68/d6c/d20/d38/d48/f70 [1637,8549] 0 2023-12-06T15:00:32.731 INFO:tasks.workunit.client.1.smithi190.stdout:6/892: write d4/d12/d1a/d44/f8f [31093,35754] 0 2023-12-06T15:00:32.732 INFO:tasks.workunit.client.0.smithi152.stdout:5/632: dwrite d7/f15 [0,4194304] 0 2023-12-06T15:00:32.732 INFO:tasks.workunit.client.0.smithi152.stdout:4/795: dwrite d2/d15/d32/f92 [0,4194304] 0 2023-12-06T15:00:32.735 INFO:tasks.workunit.client.0.smithi152.stdout:5/633: creat d7/dd/d26/d3b/d46/dc9/fdb x:0 0 0 2023-12-06T15:00:32.735 INFO:tasks.workunit.client.0.smithi152.stdout:5/634: chown d7/dd/f20 1177 1 2023-12-06T15:00:32.735 INFO:tasks.workunit.client.0.smithi152.stdout:8/493: dwrite d1/d6/d34/d35/d38/f45 [0,4194304] 0 2023-12-06T15:00:32.735 INFO:tasks.workunit.client.0.smithi152.stdout:5/635: dread - d7/dd/f8a zero size 2023-12-06T15:00:32.735 INFO:tasks.workunit.client.0.smithi152.stdout:8/494: fdatasync d1/d6/d34/f98 0 2023-12-06T15:00:32.736 INFO:tasks.workunit.client.1.smithi190.stdout:0/763: dwrite d0/da/d3e/d2b/d37/f39 [0,4194304] 0 2023-12-06T15:00:32.736 INFO:tasks.workunit.client.1.smithi190.stdout:0/764: chown d0/da/d3e/d2b/d3c/d65/l7e 351 1 2023-12-06T15:00:32.736 INFO:tasks.workunit.client.1.smithi190.stdout:0/765: fdatasync d0/f2e 0 2023-12-06T15:00:32.737 INFO:tasks.workunit.client.0.smithi152.stdout:4/796: symlink d2/d10/dbb/dca/dbc/d42/dba/lf6 0 2023-12-06T15:00:32.737 INFO:tasks.workunit.client.0.smithi152.stdout:4/797: chown d2/d89 351867438 1 2023-12-06T15:00:32.739 INFO:tasks.workunit.client.1.smithi190.stdout:4/786: dwrite d3/d4e/f73 [0,4194304] 0 2023-12-06T15:00:32.739 INFO:tasks.workunit.client.1.smithi190.stdout:8/799: dwrite d1/f51 [0,4194304] 0 2023-12-06T15:00:32.739 INFO:tasks.workunit.client.1.smithi190.stdout:2/822: sync 2023-12-06T15:00:32.739 INFO:tasks.workunit.client.1.smithi190.stdout:2/823: fsync d10/d26/d5c/f94 0 2023-12-06T15:00:32.741 INFO:tasks.workunit.client.1.smithi190.stdout:9/973: rename d4/d27/d2f/laa to d4/l142 0 2023-12-06T15:00:32.746 INFO:tasks.workunit.client.1.smithi190.stdout:2/824: rename d10/d59/dcd/dad/dc4/f103 to d10/d26/d5c/d8d/f113 0 2023-12-06T15:00:32.747 INFO:tasks.workunit.client.0.smithi152.stdout:4/798: creat d2/d22/d6e/ff7 x:0 0 0 2023-12-06T15:00:32.750 INFO:tasks.workunit.client.0.smithi152.stdout:8/495: link d1/d6/d34/c24 d1/c9c 0 2023-12-06T15:00:32.752 INFO:tasks.workunit.client.1.smithi190.stdout:2/825: write d10/d26/d5c/f63 [3380450,84127] 0 2023-12-06T15:00:32.752 INFO:tasks.workunit.client.0.smithi152.stdout:8/496: mknod d1/d6/d29/d75/c9d 0 2023-12-06T15:00:32.753 INFO:tasks.workunit.client.0.smithi152.stdout:8/497: getdents d1/d6/d34/d40/d64 0 2023-12-06T15:00:32.753 INFO:tasks.workunit.client.0.smithi152.stdout:8/498: chown d1/d6/d34/c24 3 1 2023-12-06T15:00:32.754 INFO:tasks.workunit.client.1.smithi190.stdout:6/893: unlink d4/d12/d40/d43/d45/d4a/d77/dca/lf0 0 2023-12-06T15:00:32.755 INFO:tasks.workunit.client.0.smithi152.stdout:8/499: rename d1/d6/d34/d36/f60 to d1/d6/d34/d90/f9e 0 2023-12-06T15:00:32.757 INFO:tasks.workunit.client.0.smithi152.stdout:8/500: rename d1/d6/d34/d35/d38/f41 to d1/d6/d34/d40/f9f 0 2023-12-06T15:00:32.758 INFO:tasks.workunit.client.1.smithi190.stdout:2/826: mknod d10/d26/d5c/d37/c114 0 2023-12-06T15:00:32.760 INFO:tasks.workunit.client.0.smithi152.stdout:3/560: sync 2023-12-06T15:00:32.761 INFO:tasks.workunit.client.1.smithi190.stdout:6/894: rmdir d4/d12/d1a/d32/dab/dd3 39 2023-12-06T15:00:32.763 INFO:tasks.workunit.client.1.smithi190.stdout:6/895: rmdir d4/d12/d1a/d44/dfc/ded 39 2023-12-06T15:00:32.765 INFO:tasks.workunit.client.1.smithi190.stdout:6/896: write d4/d12/d40/d43/d45/d4a/d77/dca/f4e [3959080,121968] 0 2023-12-06T15:00:32.767 INFO:tasks.workunit.client.1.smithi190.stdout:6/897: mknod d4/d12/d40/d43/d45/d4a/d77/dca/c129 0 2023-12-06T15:00:32.767 INFO:tasks.workunit.client.1.smithi190.stdout:6/898: fsync d4/d12/d40/d43/d45/f88 0 2023-12-06T15:00:32.767 INFO:tasks.workunit.client.1.smithi190.stdout:6/899: write d4/d12/d40/d43/dba/dfe/f10b [618402,68] 0 2023-12-06T15:00:32.767 INFO:tasks.workunit.client.1.smithi190.stdout:6/900: mkdir d4/d12/d9a/d12a 0 2023-12-06T15:00:32.835 INFO:tasks.workunit.client.0.smithi152.stdout:9/519: dwrite d0/d50/f79 [0,4194304] 0 2023-12-06T15:00:32.836 INFO:tasks.workunit.client.0.smithi152.stdout:8/501: link d1/d6/d34/c93 d1/d6/d29/d5b/ca0 0 2023-12-06T15:00:32.836 INFO:tasks.workunit.client.0.smithi152.stdout:8/502: write d1/d6/d34/d90/f9e [715689,77344] 0 2023-12-06T15:00:32.837 INFO:tasks.workunit.client.0.smithi152.stdout:5/636: dwrite d7/dd/d26/d3b/d46/d7e/fcd [0,4194304] 0 2023-12-06T15:00:32.837 INFO:tasks.workunit.client.0.smithi152.stdout:3/561: symlink d9/d10/d12/d43/lac 0 2023-12-06T15:00:32.842 INFO:tasks.workunit.client.0.smithi152.stdout:8/503: rename d1/d6/d34/d36/f11 to d1/d6/d34/d35/d8d/fa1 0 2023-12-06T15:00:32.842 INFO:tasks.workunit.client.0.smithi152.stdout:8/504: write d1/d6/d34/d90/f97 [533285,95828] 0 2023-12-06T15:00:32.843 INFO:tasks.workunit.client.0.smithi152.stdout:5/637: getdents d7/dd/d26/d87 0 2023-12-06T15:00:32.846 INFO:tasks.workunit.client.0.smithi152.stdout:5/638: rename d7/dd/d4e/dac to d7/dd/d26/d87/dc4/ddc 0 2023-12-06T15:00:32.846 INFO:tasks.workunit.client.0.smithi152.stdout:5/639: chown d7/dd/d4e/c96 23 1 2023-12-06T15:00:32.846 INFO:tasks.workunit.client.1.smithi190.stdout:9/974: rmdir d4/d27 39 2023-12-06T15:00:32.848 INFO:tasks.workunit.client.0.smithi152.stdout:5/640: mkdir d7/dd/ddd 0 2023-12-06T15:00:32.848 INFO:tasks.workunit.client.1.smithi190.stdout:9/975: creat d4/dfd/f143 x:0 0 0 2023-12-06T15:00:32.849 INFO:tasks.workunit.client.0.smithi152.stdout:5/641: getdents d7/dd/d26/d3b 0 2023-12-06T15:00:32.850 INFO:tasks.workunit.client.1.smithi190.stdout:9/976: rmdir d4/d27/d2f/d31/d3f/d58/d13e 0 2023-12-06T15:00:32.850 INFO:tasks.workunit.client.1.smithi190.stdout:0/766: dwrite d0/da/d3e/d3a/d40/d81/ff3 [0,4194304] 0 2023-12-06T15:00:32.851 INFO:tasks.workunit.client.0.smithi152.stdout:9/520: dread d0/d3f/d68/d6c/d20/d4a/d4d/f5e [0,4194304] 0 2023-12-06T15:00:32.851 INFO:tasks.workunit.client.0.smithi152.stdout:5/642: mkdir d7/d43/d6c/dde 0 2023-12-06T15:00:32.851 INFO:tasks.workunit.client.1.smithi190.stdout:9/977: rmdir d4/d27/d2f/d31/d3f/d58/d72/db3/dea 39 2023-12-06T15:00:32.856 INFO:tasks.workunit.client.0.smithi152.stdout:8/505: dread d1/d6/d34/d40/d64/f68 [0,4194304] 0 2023-12-06T15:00:32.857 INFO:tasks.workunit.client.0.smithi152.stdout:4/799: dwrite d2/d15/f96 [0,4194304] 0 2023-12-06T15:00:32.858 INFO:tasks.workunit.client.1.smithi190.stdout:0/767: creat d0/da/d3e/d3a/d40/ff9 x:0 0 0 2023-12-06T15:00:32.858 INFO:tasks.workunit.client.1.smithi190.stdout:9/978: symlink d4/d84/dda/l144 0 2023-12-06T15:00:32.862 INFO:tasks.workunit.client.0.smithi152.stdout:4/800: chown d2/d22/d6e/da8/fe8 24467 1 2023-12-06T15:00:32.863 INFO:tasks.workunit.client.0.smithi152.stdout:4/801: mkdir d2/d15/d32/d69/d6f/d6c/df8 0 2023-12-06T15:00:32.863 INFO:tasks.workunit.client.1.smithi190.stdout:6/901: dwrite d4/d12/d1a/d32/dc7/dea/f106 [0,4194304] 0 2023-12-06T15:00:32.864 INFO:tasks.workunit.client.1.smithi190.stdout:9/979: truncate d4/d27/d8a/dbc/fd2 199184 0 2023-12-06T15:00:32.867 INFO:tasks.workunit.client.1.smithi190.stdout:6/902: mknod d4/d12/d1a/d32/dc7/c12b 0 2023-12-06T15:00:32.867 INFO:tasks.workunit.client.1.smithi190.stdout:6/903: chown d4/d12/c90 156786912 1 2023-12-06T15:00:32.867 INFO:tasks.workunit.client.1.smithi190.stdout:6/904: getdents d4/d12/d1a/d32/dab/de9 0 2023-12-06T15:00:32.867 INFO:tasks.workunit.client.1.smithi190.stdout:9/980: write d4/d84/f99 [1953553,92868] 0 2023-12-06T15:00:32.871 INFO:tasks.workunit.client.1.smithi190.stdout:6/905: write d4/d12/d40/d43/d45/d4a/d77/dca/f96 [1670255,36348] 0 2023-12-06T15:00:32.871 INFO:tasks.workunit.client.1.smithi190.stdout:6/906: mkdir d4/d12/d40/d43/d45/dff/d12c 0 2023-12-06T15:00:32.879 INFO:tasks.workunit.client.0.smithi152.stdout:4/802: dread d2/d10/fa5 [0,4194304] 0 2023-12-06T15:00:32.879 INFO:tasks.workunit.client.0.smithi152.stdout:3/562: dwrite d9/d18/d1a/d65/faa [0,4194304] 0 2023-12-06T15:00:32.879 INFO:tasks.workunit.client.0.smithi152.stdout:4/803: stat d2/d45/fc4 0 2023-12-06T15:00:32.879 INFO:tasks.workunit.client.0.smithi152.stdout:4/804: fsync d2/d22/d6e/fac 0 2023-12-06T15:00:32.881 INFO:tasks.workunit.client.0.smithi152.stdout:4/805: mkdir d2/d89/df9 0 2023-12-06T15:00:32.882 INFO:tasks.workunit.client.0.smithi152.stdout:4/806: mknod d2/d10/dab/dd9/cfa 0 2023-12-06T15:00:32.882 INFO:tasks.workunit.client.0.smithi152.stdout:4/807: dread - d2/d15/d32/f60 zero size 2023-12-06T15:00:32.883 INFO:tasks.workunit.client.0.smithi152.stdout:4/808: creat d2/d22/ffb x:0 0 0 2023-12-06T15:00:32.884 INFO:tasks.workunit.client.0.smithi152.stdout:4/809: truncate d2/d10/dbb/fcf 299559 0 2023-12-06T15:00:32.885 INFO:tasks.workunit.client.0.smithi152.stdout:4/810: symlink d2/d89/df9/lfc 0 2023-12-06T15:00:32.885 INFO:tasks.workunit.client.0.smithi152.stdout:4/811: readlink d2/d10/dbb/dca/lbd 0 2023-12-06T15:00:32.887 INFO:tasks.workunit.client.0.smithi152.stdout:4/812: rename d2/d45/d84/da4/ce7 to d2/d10/dc8/ddb/cfd 0 2023-12-06T15:00:32.887 INFO:tasks.workunit.client.0.smithi152.stdout:5/643: dwrite d7/dd/d26/d87/fbc [0,4194304] 0 2023-12-06T15:00:32.887 INFO:tasks.workunit.client.0.smithi152.stdout:5/644: readlink d7/dd/d4e/ld7 0 2023-12-06T15:00:32.888 INFO:tasks.workunit.client.1.smithi190.stdout:9/981: dwrite d4/f2e [4194304,4194304] 0 2023-12-06T15:00:32.889 INFO:tasks.workunit.client.0.smithi152.stdout:9/521: dwrite d0/d3f/d5f/d60/f6b [0,4194304] 0 2023-12-06T15:00:32.891 INFO:tasks.workunit.client.0.smithi152.stdout:0/551: sync 2023-12-06T15:00:32.891 INFO:tasks.workunit.client.0.smithi152.stdout:7/450: sync 2023-12-06T15:00:32.891 INFO:tasks.workunit.client.0.smithi152.stdout:6/761: sync 2023-12-06T15:00:32.892 INFO:tasks.workunit.client.0.smithi152.stdout:9/522: mkdir d0/d50/d94 0 2023-12-06T15:00:32.893 INFO:tasks.workunit.client.0.smithi152.stdout:9/523: chown d0/d3f/f78 1 1 2023-12-06T15:00:32.893 INFO:tasks.workunit.client.0.smithi152.stdout:7/451: mknod dd/df/d78/c8d 0 2023-12-06T15:00:32.893 INFO:tasks.workunit.client.0.smithi152.stdout:7/452: fdatasync f7 0 2023-12-06T15:00:32.894 INFO:tasks.workunit.client.0.smithi152.stdout:3/563: dread d9/ff [0,4194304] 0 2023-12-06T15:00:32.894 INFO:tasks.workunit.client.0.smithi152.stdout:6/762: mknod d1/dcf/ddc/d8a/c110 0 2023-12-06T15:00:32.895 INFO:tasks.workunit.client.1.smithi190.stdout:9/982: rename d4/d27/d2f/d31/d3f/d58/fe9 to d4/d27/d2f/d31/d3f/d58/d72/db3/dea/dcd/dff/f145 0 2023-12-06T15:00:32.900 INFO:tasks.workunit.client.0.smithi152.stdout:9/524: creat d0/d3f/d68/d6c/d20/d38/d48/d90/f95 x:0 0 0 2023-12-06T15:00:32.900 INFO:tasks.workunit.client.0.smithi152.stdout:3/564: mkdir d9/d18/d1a/d77/d9f/dad 0 2023-12-06T15:00:32.900 INFO:tasks.workunit.client.0.smithi152.stdout:3/565: fdatasync d9/d18/d1a/d65/f79 0 2023-12-06T15:00:32.900 INFO:tasks.workunit.client.0.smithi152.stdout:4/813: dread d2/d15/f62 [0,4194304] 0 2023-12-06T15:00:32.900 INFO:tasks.workunit.client.0.smithi152.stdout:4/814: chown d2/d10/d52/l36 672 1 2023-12-06T15:00:32.904 INFO:tasks.workunit.client.0.smithi152.stdout:9/525: mknod d0/d3f/c96 0 2023-12-06T15:00:32.904 INFO:tasks.workunit.client.0.smithi152.stdout:0/552: dread d8/d3e/d87/f92 [0,4194304] 0 2023-12-06T15:00:32.905 INFO:tasks.workunit.client.0.smithi152.stdout:0/553: chown d8/c14 1052 1 2023-12-06T15:00:32.906 INFO:tasks.workunit.client.0.smithi152.stdout:3/566: creat d9/d18/fae x:0 0 0 2023-12-06T15:00:32.908 INFO:tasks.workunit.client.0.smithi152.stdout:4/815: mkdir d2/d89/df9/dfe 0 2023-12-06T15:00:32.908 INFO:tasks.workunit.client.0.smithi152.stdout:4/816: chown d2/d10/dbb/dca/dbc/ld3 159041 1 2023-12-06T15:00:32.910 INFO:tasks.workunit.client.0.smithi152.stdout:9/526: creat d0/d3f/d68/d6c/d20/d38/d48/d90/f97 x:0 0 0 2023-12-06T15:00:32.910 INFO:tasks.workunit.client.0.smithi152.stdout:2/503: sync 2023-12-06T15:00:32.910 INFO:tasks.workunit.client.0.smithi152.stdout:1/833: sync 2023-12-06T15:00:32.910 INFO:tasks.workunit.client.0.smithi152.stdout:9/527: truncate d0/d3f/d68/d6c/d20/d38/d45/f7b 511193 0 2023-12-06T15:00:32.910 INFO:tasks.workunit.client.0.smithi152.stdout:9/528: chown d0/d3f/d5f 14 1 2023-12-06T15:00:32.910 INFO:tasks.workunit.client.0.smithi152.stdout:9/529: fdatasync d0/f1c 0 2023-12-06T15:00:32.910 INFO:tasks.workunit.client.0.smithi152.stdout:0/554: mknod d8/d15/d45/d73/cb5 0 2023-12-06T15:00:32.911 INFO:tasks.workunit.client.0.smithi152.stdout:3/567: symlink d9/d18/laf 0 2023-12-06T15:00:32.911 INFO:tasks.workunit.client.0.smithi152.stdout:3/568: dread - d9/d10/d12/f72 zero size 2023-12-06T15:00:32.913 INFO:tasks.workunit.client.0.smithi152.stdout:4/817: creat d2/d15/d32/d69/d6f/fff x:0 0 0 2023-12-06T15:00:32.913 INFO:tasks.workunit.client.0.smithi152.stdout:4/818: dread - d2/d10/dbb/dca/dbc/fcd zero size 2023-12-06T15:00:32.914 INFO:tasks.workunit.client.0.smithi152.stdout:9/530: symlink d0/d3f/d68/d6c/d20/d38/d45/d43/l98 0 2023-12-06T15:00:32.915 INFO:tasks.workunit.client.0.smithi152.stdout:0/555: symlink d8/d15/d45/d83/lb6 0 2023-12-06T15:00:32.918 INFO:tasks.workunit.client.0.smithi152.stdout:5/645: dwrite d7/dd/d26/d3b/d46/d7e/fcd [0,4194304] 0 2023-12-06T15:00:32.918 INFO:tasks.workunit.client.1.smithi190.stdout:9/983: dwrite d4/d27/d2f/d5c/f82 [0,4194304] 0 2023-12-06T15:00:32.920 INFO:tasks.workunit.client.0.smithi152.stdout:9/531: unlink d0/d3f/d68/d6c/d20/f21 0 2023-12-06T15:00:32.920 INFO:tasks.workunit.client.0.smithi152.stdout:0/556: mknod d8/d3e/d87/cb7 0 2023-12-06T15:00:32.920 INFO:tasks.workunit.client.0.smithi152.stdout:0/557: stat d8/d15/d45/d73/d7a/c3d 0 2023-12-06T15:00:32.920 INFO:tasks.workunit.client.0.smithi152.stdout:0/558: stat d8/d3e/f58 0 2023-12-06T15:00:32.922 INFO:tasks.workunit.client.0.smithi152.stdout:7/453: dwrite f3 [8388608,4194304] 0 2023-12-06T15:00:32.922 INFO:tasks.workunit.client.0.smithi152.stdout:7/454: getdents dd/d17 0 2023-12-06T15:00:32.923 INFO:tasks.workunit.client.0.smithi152.stdout:5/646: rmdir d7/dd/ddd 0 2023-12-06T15:00:32.924 INFO:tasks.workunit.client.1.smithi190.stdout:9/984: symlink d4/d27/d2f/l146 0 2023-12-06T15:00:32.924 INFO:tasks.workunit.client.1.smithi190.stdout:9/985: rmdir d4/d27/d2f/d31/d3f/d58/dc5/d127 39 2023-12-06T15:00:32.925 INFO:tasks.workunit.client.0.smithi152.stdout:9/532: dread d0/d3f/d68/d6c/d20/f5a [0,4194304] 0 2023-12-06T15:00:32.925 INFO:tasks.workunit.client.0.smithi152.stdout:7/455: rename dd/l55 to dd/df/d34/d44/d49/d73/d77/l8e 0 2023-12-06T15:00:32.926 INFO:tasks.workunit.client.1.smithi190.stdout:9/986: unlink d4/d27/d2f/c36 0 2023-12-06T15:00:32.926 INFO:tasks.workunit.client.1.smithi190.stdout:9/987: write d4/d27/d2f/d5c/d9d/f108 [484685,23491] 0 2023-12-06T15:00:32.926 INFO:tasks.workunit.client.1.smithi190.stdout:9/988: write d4/d27/d2f/f125 [197821,111629] 0 2023-12-06T15:00:32.927 INFO:tasks.workunit.client.0.smithi152.stdout:5/647: creat d7/d47/fdf x:0 0 0 2023-12-06T15:00:32.927 INFO:tasks.workunit.client.0.smithi152.stdout:5/648: dread - d7/dd/d26/d3b/d46/f76 zero size 2023-12-06T15:00:32.929 INFO:tasks.workunit.client.0.smithi152.stdout:5/649: mkdir d7/d43/d6c/d98/de0 0 2023-12-06T15:00:32.930 INFO:tasks.workunit.client.0.smithi152.stdout:7/456: mknod dd/c8f 0 2023-12-06T15:00:32.930 INFO:tasks.workunit.client.0.smithi152.stdout:9/533: unlink d0/d3f/d68/d6c/f42 0 2023-12-06T15:00:32.931 INFO:tasks.workunit.client.0.smithi152.stdout:4/819: dread d2/d15/f62 [0,4194304] 0 2023-12-06T15:00:32.931 INFO:tasks.workunit.client.0.smithi152.stdout:4/820: stat d2/d10/dbb/dca/dbc/c3b 0 2023-12-06T15:00:32.934 INFO:tasks.workunit.client.0.smithi152.stdout:4/821: dread - d2/d22/d6e/ff7 zero size 2023-12-06T15:00:32.935 INFO:tasks.workunit.client.0.smithi152.stdout:5/650: mknod d7/dd/d4e/ce1 0 2023-12-06T15:00:32.935 INFO:tasks.workunit.client.0.smithi152.stdout:9/534: creat d0/d50/f99 x:0 0 0 2023-12-06T15:00:32.935 INFO:tasks.workunit.client.0.smithi152.stdout:5/651: getdents d7/dd/d26/d87/dc4/ddc 0 2023-12-06T15:00:32.936 INFO:tasks.workunit.client.1.smithi190.stdout:9/989: write d4/d27/d2f/d31/d3f/d58/d72/db3/dea/dcd/dff/f6e [620590,68895] 0 2023-12-06T15:00:32.939 INFO:tasks.workunit.client.1.smithi190.stdout:9/990: getdents d4/d27/d2f/d31/d3f/d58/d72/db3 0 2023-12-06T15:00:32.939 INFO:tasks.workunit.client.1.smithi190.stdout:9/991: fsync d4/d84/f8f 0 2023-12-06T15:00:32.939 INFO:tasks.workunit.client.0.smithi152.stdout:5/652: symlink d7/d43/d6c/da4/le2 0 2023-12-06T15:00:32.939 INFO:tasks.workunit.client.0.smithi152.stdout:4/822: write d2/d22/f76 [769515,110633] 0 2023-12-06T15:00:32.940 INFO:tasks.workunit.client.0.smithi152.stdout:5/653: dread d7/f19 [0,4194304] 0 2023-12-06T15:00:32.944 INFO:tasks.workunit.client.0.smithi152.stdout:4/823: mkdir d2/d10/dc8/d100 0 2023-12-06T15:00:32.945 INFO:tasks.workunit.client.0.smithi152.stdout:4/824: fsync d2/d10/fa5 0 2023-12-06T15:00:32.950 INFO:tasks.workunit.client.0.smithi152.stdout:5/654: mkdir d7/d43/d6c/dde/de3 0 2023-12-06T15:00:32.951 INFO:tasks.workunit.client.0.smithi152.stdout:4/825: creat d2/d10/dbb/dca/dbc/d75/deb/f101 x:0 0 0 2023-12-06T15:00:32.953 INFO:tasks.workunit.client.0.smithi152.stdout:5/655: unlink d7/dd/d26/d3b/d46/c54 0 2023-12-06T15:00:32.953 INFO:tasks.workunit.client.0.smithi152.stdout:5/656: chown d7/dd/d26/d48/d97/dc2 57133712 1 2023-12-06T15:00:32.954 INFO:tasks.workunit.client.0.smithi152.stdout:4/826: symlink d2/d10/d52/l102 0 2023-12-06T15:00:32.956 INFO:tasks.workunit.client.0.smithi152.stdout:4/827: mkdir d2/d10/dbb/dca/dbc/d103 0 2023-12-06T15:00:32.956 INFO:tasks.workunit.client.0.smithi152.stdout:5/657: read d7/dd/d26/f2e [1228822,34948] 0 2023-12-06T15:00:32.957 INFO:tasks.workunit.client.0.smithi152.stdout:4/828: creat d2/d45/d84/da4/f104 x:0 0 0 2023-12-06T15:00:32.959 INFO:tasks.workunit.client.0.smithi152.stdout:5/658: link d7/dd/d26/d3b/d46/c4c d7/dd/d26/ce4 0 2023-12-06T15:00:32.959 INFO:tasks.workunit.client.0.smithi152.stdout:1/834: dwrite d3/da/d15/d17/f3d [0,4194304] 0 2023-12-06T15:00:32.960 INFO:tasks.workunit.client.0.smithi152.stdout:2/504: dwrite d6/db/f72 [0,4194304] 0 2023-12-06T15:00:32.960 INFO:tasks.workunit.client.0.smithi152.stdout:2/505: truncate d6/d1e/d7a/f9f 538336 0 2023-12-06T15:00:32.960 INFO:tasks.workunit.client.0.smithi152.stdout:2/506: fsync d6/d1e/f64 0 2023-12-06T15:00:32.960 INFO:tasks.workunit.client.0.smithi152.stdout:4/829: getdents d2/d45/d84 0 2023-12-06T15:00:32.961 INFO:tasks.workunit.client.0.smithi152.stdout:5/659: mknod d7/dd/d26/d48/ce5 0 2023-12-06T15:00:32.964 INFO:tasks.workunit.client.0.smithi152.stdout:2/507: getdents d6/d1e/d41/d83 0 2023-12-06T15:00:32.964 INFO:tasks.workunit.client.0.smithi152.stdout:1/835: write d3/da/d15/d17/d1a/f45 [3567586,10797] 0 2023-12-06T15:00:32.964 INFO:tasks.workunit.client.0.smithi152.stdout:1/836: fdatasync d3/da/d15/d17/d58/d9f/f129 0 2023-12-06T15:00:32.965 INFO:tasks.workunit.client.0.smithi152.stdout:4/830: mknod d2/d10/d52/c105 0 2023-12-06T15:00:32.965 INFO:tasks.workunit.client.0.smithi152.stdout:4/831: stat d2/d15/d32 0 2023-12-06T15:00:32.967 INFO:tasks.workunit.client.0.smithi152.stdout:5/660: rename d7/dd/d26/d3a/c89 to d7/dd/d26/d3b/d46/ce6 0 2023-12-06T15:00:32.968 INFO:tasks.workunit.client.0.smithi152.stdout:2/508: unlink d6/d18/d70/l9b 0 2023-12-06T15:00:32.970 INFO:tasks.workunit.client.0.smithi152.stdout:1/837: mkdir d3/da/d15/d17/d4d/d12f 0 2023-12-06T15:00:32.970 INFO:tasks.workunit.client.0.smithi152.stdout:1/838: read - d3/da/d4c/d85/f104 zero size 2023-12-06T15:00:32.970 INFO:tasks.workunit.client.0.smithi152.stdout:1/839: dread - d3/da/d4c/d82/d52/d62/dcc/ffc zero size 2023-12-06T15:00:32.970 INFO:tasks.workunit.client.0.smithi152.stdout:4/832: symlink d2/d10/dc8/ddb/l106 0 2023-12-06T15:00:32.970 INFO:tasks.workunit.client.0.smithi152.stdout:4/833: dread - d2/d10/dbb/dca/dbc/fcd zero size 2023-12-06T15:00:32.971 INFO:tasks.workunit.client.0.smithi152.stdout:4/834: write d2/d10/dab/fbe [1897408,56541] 0 2023-12-06T15:00:32.971 INFO:tasks.workunit.client.0.smithi152.stdout:1/840: rename d3/da/d4c/d82/d52/d62/dcc/cf2 to d3/da/d4c/d82/d52/d62/dcc/c130 0 2023-12-06T15:00:32.972 INFO:tasks.workunit.client.0.smithi152.stdout:4/835: read d2/f26 [2229643,87550] 0 2023-12-06T15:00:32.977 INFO:tasks.workunit.client.0.smithi152.stdout:2/509: write f5 [7789011,95196] 0 2023-12-06T15:00:32.979 INFO:tasks.workunit.client.0.smithi152.stdout:0/559: dwrite d8/d3e/d87/faf [0,4194304] 0 2023-12-06T15:00:32.979 INFO:tasks.workunit.client.0.smithi152.stdout:3/569: dwrite d9/d10/d12/d43/f78 [0,4194304] 0 2023-12-06T15:00:32.979 INFO:tasks.workunit.client.0.smithi152.stdout:4/836: fdatasync d2/d10/dab/fbe 0 2023-12-06T15:00:32.979 INFO:tasks.workunit.client.0.smithi152.stdout:7/457: dwrite dd/df/f2c [0,4194304] 0 2023-12-06T15:00:32.980 INFO:tasks.workunit.client.0.smithi152.stdout:2/510: link d6/d1e/d41/c7c d6/d18/ca3 0 2023-12-06T15:00:32.982 INFO:tasks.workunit.client.1.smithi190.stdout:9/992: dwrite d4/f14 [0,4194304] 0 2023-12-06T15:00:32.984 INFO:tasks.workunit.client.0.smithi152.stdout:0/560: link d8/d15/f93 d8/d15/d45/fb8 0 2023-12-06T15:00:32.984 INFO:tasks.workunit.client.1.smithi190.stdout:9/993: rename d4/d27/d2f/d31/c46 to d4/d27/d2f/d5c/c147 0 2023-12-06T15:00:32.985 INFO:tasks.workunit.client.1.smithi190.stdout:9/994: creat d4/d27/d2f/d31/d3f/d58/d72/d7a/f148 x:0 0 0 2023-12-06T15:00:32.985 INFO:tasks.workunit.client.0.smithi152.stdout:3/570: rename d9/d18/d1a/d65/l82 to d9/d10/d19/lb0 0 2023-12-06T15:00:32.986 INFO:tasks.workunit.client.1.smithi190.stdout:9/995: mkdir d4/d27/d2f/d31/d3f/d58/d72/db3/dea/dcd/d149 0 2023-12-06T15:00:32.987 INFO:tasks.workunit.client.1.smithi190.stdout:9/996: creat d4/d27/d2f/d31/d3f/d58/d72/db3/d10f/f14a x:0 0 0 2023-12-06T15:00:32.987 INFO:tasks.workunit.client.1.smithi190.stdout:9/997: write d4/d27/d2f/d31/d3f/d58/dc5/ffc [496318,79874] 0 2023-12-06T15:00:32.988 INFO:tasks.workunit.client.1.smithi190.stdout:9/998: rmdir d4/d84 39 2023-12-06T15:00:32.988 INFO:tasks.workunit.client.1.smithi190.stdout:9/999: chown d4/d27/d2f/d5c/d9d 0 1 2023-12-06T15:00:32.988 INFO:tasks.workunit.client.0.smithi152.stdout:4/837: link d2/d15/d32/f6a d2/d45/d84/f107 0 2023-12-06T15:00:32.989 INFO:tasks.workunit.client.0.smithi152.stdout:4/838: dread - d2/d10/dbb/dca/dbc/fcd zero size 2023-12-06T15:00:32.989 INFO:tasks.workunit.client.0.smithi152.stdout:7/458: symlink dd/df/d34/d44/d49/l90 0 2023-12-06T15:00:32.991 INFO:tasks.workunit.client.0.smithi152.stdout:2/511: link d6/d1e/f4a d6/db/fa4 0 2023-12-06T15:00:32.996 INFO:tasks.workunit.client.0.smithi152.stdout:1/841: dwrite d3/da/d4c/d82/d52/d62/dcc/f117 [0,4194304] 0 2023-12-06T15:00:32.997 INFO:tasks.workunit.client.0.smithi152.stdout:3/571: mknod d9/d18/d1a/d77/cb1 0 2023-12-06T15:00:32.998 INFO:tasks.workunit.client.0.smithi152.stdout:4/839: mkdir d2/d10/dbb/dca/dbc/d42/d108 0 2023-12-06T15:00:33.000 INFO:tasks.workunit.client.0.smithi152.stdout:2/512: creat d6/db/fa5 x:0 0 0 2023-12-06T15:00:33.000 INFO:tasks.workunit.client.0.smithi152.stdout:2/513: chown d6/d1e/c54 41 1 2023-12-06T15:00:33.000 INFO:tasks.workunit.client.0.smithi152.stdout:2/514: readlink d6/d1e/l9e 0 2023-12-06T15:00:33.000 INFO:tasks.workunit.client.0.smithi152.stdout:9/535: rmdir d0/d3f/d68/d6c/d20 39 2023-12-06T15:00:33.003 INFO:tasks.workunit.client.0.smithi152.stdout:1/842: symlink d3/da/d15/d17/d43/de6/l131 0 2023-12-06T15:00:33.004 INFO:tasks.workunit.client.0.smithi152.stdout:3/572: mknod d9/d10/d12/cb2 0 2023-12-06T15:00:33.005 INFO:tasks.workunit.client.0.smithi152.stdout:1/843: read d3/d44/f78 [792823,19684] 0 2023-12-06T15:00:33.005 INFO:tasks.workunit.client.0.smithi152.stdout:4/840: rmdir d2/d10/dbb/dca/dbc/d75 39 2023-12-06T15:00:33.005 INFO:tasks.workunit.client.0.smithi152.stdout:7/459: dwrite dd/df/d34/d44/f5a [0,4194304] 0 2023-12-06T15:00:33.007 INFO:tasks.workunit.client.0.smithi152.stdout:2/515: unlink d6/d18/f36 0 2023-12-06T15:00:33.007 INFO:tasks.workunit.client.0.smithi152.stdout:2/516: stat d6/d1e/l8f 0 2023-12-06T15:00:33.007 INFO:tasks.workunit.client.0.smithi152.stdout:9/536: rmdir d0/d3f/d68/d6c/d20/d4a/d71 39 2023-12-06T15:00:33.008 INFO:tasks.workunit.client.0.smithi152.stdout:9/537: chown d0/d3f/d68/d6c/l2e 14427 1 2023-12-06T15:00:33.009 INFO:tasks.workunit.client.0.smithi152.stdout:3/573: symlink d9/d18/d1a/d65/lb3 0 2023-12-06T15:00:33.010 INFO:tasks.workunit.client.0.smithi152.stdout:1/844: mknod d3/da/d15/d17/d4d/d12f/c132 0 2023-12-06T15:00:33.010 INFO:tasks.workunit.client.1.smithi190.stdout:7/957: sync 2023-12-06T15:00:33.011 INFO:tasks.workunit.client.0.smithi152.stdout:4/841: symlink d2/d15/d32/dd0/l109 0 2023-12-06T15:00:33.011 INFO:tasks.workunit.client.1.smithi190.stdout:7/958: write d0/fbb [1995767,44731] 0 2023-12-06T15:00:33.012 INFO:tasks.workunit.client.0.smithi152.stdout:2/517: truncate d6/d1e/f64 2242769 0 2023-12-06T15:00:33.013 INFO:tasks.workunit.client.0.smithi152.stdout:9/538: mknod d0/d3f/d68/d6c/d20/d4a/d71/c9a 0 2023-12-06T15:00:33.013 INFO:tasks.workunit.client.0.smithi152.stdout:9/539: write d0/d3f/d68/d6c/d20/d38/f6e [29189,21294] 0 2023-12-06T15:00:33.017 INFO:tasks.workunit.client.0.smithi152.stdout:4/842: dread d2/f8 [0,4194304] 0 2023-12-06T15:00:33.018 INFO:tasks.workunit.client.0.smithi152.stdout:4/843: write d2/d22/d6e/fb7 [444644,115724] 0 2023-12-06T15:00:33.021 INFO:tasks.workunit.client.0.smithi152.stdout:1/845: creat d3/d10a/f133 x:0 0 0 2023-12-06T15:00:33.021 INFO:tasks.workunit.client.0.smithi152.stdout:2/518: creat d6/db/d17/fa6 x:0 0 0 2023-12-06T15:00:33.021 INFO:tasks.workunit.client.0.smithi152.stdout:2/519: chown d6/db/d17/f1d 100723 1 2023-12-06T15:00:33.022 INFO:tasks.workunit.client.1.smithi190.stdout:7/959: dwrite d0/d88/d7a/d7c/dab/ddf/f107 [0,4194304] 0 2023-12-06T15:00:33.023 INFO:tasks.workunit.client.0.smithi152.stdout:4/844: creat d2/d15/d32/d69/d6f/daf/f10a x:0 0 0 2023-12-06T15:00:33.025 INFO:tasks.workunit.client.0.smithi152.stdout:2/520: unlink d6/f40 0 2023-12-06T15:00:33.025 INFO:tasks.workunit.client.0.smithi152.stdout:2/521: fdatasync d6/d1e/d7a/f7b 0 2023-12-06T15:00:33.025 INFO:tasks.workunit.client.0.smithi152.stdout:4/845: dread d2/d22/f18 [0,4194304] 0 2023-12-06T15:00:33.035 INFO:tasks.workunit.client.1.smithi190.stdout:7/960: mknod d0/d88/d1c/d17/d100/c133 0 2023-12-06T15:00:33.042 INFO:tasks.workunit.client.0.smithi152.stdout:8/506: sync 2023-12-06T15:00:33.042 INFO:tasks.workunit.client.0.smithi152.stdout:3/574: rename d9/d18/d1a to d9/d10/d12/d43/d52/db4 0 2023-12-06T15:00:33.042 INFO:tasks.workunit.client.0.smithi152.stdout:3/575: fsync d9/f37 0 2023-12-06T15:00:33.043 INFO:tasks.workunit.client.0.smithi152.stdout:8/507: rmdir d1/d6/d34 39 2023-12-06T15:00:33.044 INFO:tasks.workunit.client.0.smithi152.stdout:3/576: mkdir d9/d10/d12/d43/d52/db4/d77/db5 0 2023-12-06T15:00:33.046 INFO:tasks.workunit.client.0.smithi152.stdout:3/577: dread d9/d10/f2e [0,4194304] 0 2023-12-06T15:00:33.048 INFO:tasks.workunit.client.0.smithi152.stdout:8/508: link d1/d6/d34/d35/d38/f45 d1/d6/d34/fa2 0 2023-12-06T15:00:33.050 INFO:tasks.workunit.client.0.smithi152.stdout:2/522: dwrite d6/d1e/d41/d55/f4b [0,4194304] 0 2023-12-06T15:00:33.050 INFO:tasks.workunit.client.0.smithi152.stdout:2/523: chown d6/d1e/l9a 1665431 1 2023-12-06T15:00:33.050 INFO:tasks.workunit.client.0.smithi152.stdout:4/846: dwrite d2/d22/f76 [0,4194304] 0 2023-12-06T15:00:33.050 INFO:tasks.workunit.client.0.smithi152.stdout:8/509: truncate d1/d6/d34/d36/d58/f6e 275940 0 2023-12-06T15:00:33.051 INFO:tasks.workunit.client.1.smithi190.stdout:7/961: dread d0/df/d1f/dbd/fe6 [0,4194304] 0 2023-12-06T15:00:33.051 INFO:tasks.workunit.client.1.smithi190.stdout:7/962: chown d0/df/d53/d99/da9/dc8/le4 7 1 2023-12-06T15:00:33.053 INFO:tasks.workunit.client.1.smithi190.stdout:7/963: symlink d0/df/d1f/dfa/l134 0 2023-12-06T15:00:33.054 INFO:tasks.workunit.client.0.smithi152.stdout:4/847: rename d2/d22 to d2/d15/d32/d69/d6f/d10b 0 2023-12-06T15:00:33.055 INFO:tasks.workunit.client.0.smithi152.stdout:8/510: creat d1/d6/fa3 x:0 0 0 2023-12-06T15:00:33.055 INFO:tasks.workunit.client.0.smithi152.stdout:8/511: write d1/f96 [140977,86958] 0 2023-12-06T15:00:33.055 INFO:tasks.workunit.client.0.smithi152.stdout:8/512: readlink d1/d6/d34/d36/l88 0 2023-12-06T15:00:33.056 INFO:tasks.workunit.client.0.smithi152.stdout:4/848: rename d2/d15/f99 to d2/d15/d32/d69/f10c 0 2023-12-06T15:00:33.057 INFO:tasks.workunit.client.0.smithi152.stdout:4/849: creat d2/d15/d32/d69/d6f/daf/f10d x:0 0 0 2023-12-06T15:00:33.058 INFO:tasks.workunit.client.1.smithi190.stdout:8/800: sync 2023-12-06T15:00:33.058 INFO:tasks.workunit.client.1.smithi190.stdout:4/787: sync 2023-12-06T15:00:33.058 INFO:tasks.workunit.client.1.smithi190.stdout:3/869: sync 2023-12-06T15:00:33.058 INFO:tasks.workunit.client.1.smithi190.stdout:5/765: sync 2023-12-06T15:00:33.058 INFO:tasks.workunit.client.1.smithi190.stdout:3/870: read - d4/d70/d19/d3a/d3b/d72/f12d zero size 2023-12-06T15:00:33.059 INFO:tasks.workunit.client.1.smithi190.stdout:8/801: mkdir d1/d20/df2 0 2023-12-06T15:00:33.059 INFO:tasks.workunit.client.1.smithi190.stdout:8/802: stat d1/d20/d3b/d4c/d8e/d94/ca6 0 2023-12-06T15:00:33.059 INFO:tasks.workunit.client.0.smithi152.stdout:4/850: creat d2/d15/f10e x:0 0 0 2023-12-06T15:00:33.060 INFO:tasks.workunit.client.1.smithi190.stdout:4/788: read d3/d76/d7c/d96/f98 [2459077,82379] 0 2023-12-06T15:00:33.060 INFO:tasks.workunit.client.1.smithi190.stdout:4/789: write d3/d35/da5/fa7 [372434,115672] 0 2023-12-06T15:00:33.061 INFO:tasks.workunit.client.1.smithi190.stdout:3/871: creat d4/d1b/d5d/f131 x:0 0 0 2023-12-06T15:00:33.061 INFO:tasks.workunit.client.1.smithi190.stdout:3/872: chown d4/d1b/d69/f90 0 1 2023-12-06T15:00:33.061 INFO:tasks.workunit.client.1.smithi190.stdout:8/803: creat d1/d20/d3b/d4c/d8e/d94/d1c/de0/ff3 x:0 0 0 2023-12-06T15:00:33.062 INFO:tasks.workunit.client.1.smithi190.stdout:4/790: creat d3/d35/d19/d67/db5/dbe/f115 x:0 0 0 2023-12-06T15:00:33.064 INFO:tasks.workunit.client.0.smithi152.stdout:4/851: rename d2/d89/fa1 to d2/d45/f10f 0 2023-12-06T15:00:33.064 INFO:tasks.workunit.client.0.smithi152.stdout:4/852: chown d2/d15/d32/dd0/ldf 31913157 1 2023-12-06T15:00:33.065 INFO:tasks.workunit.client.0.smithi152.stdout:4/853: creat d2/d15/d32/d69/d6f/daf/f110 x:0 0 0 2023-12-06T15:00:33.068 INFO:tasks.workunit.client.0.smithi152.stdout:3/578: dwrite d9/d18/fa2 [0,4194304] 0 2023-12-06T15:00:33.068 INFO:tasks.workunit.client.0.smithi152.stdout:8/513: write d1/d6/d29/d5b/f62 [4158460,92470] 0 2023-12-06T15:00:33.069 INFO:tasks.workunit.client.0.smithi152.stdout:2/524: dread d6/db/fa4 [0,4194304] 0 2023-12-06T15:00:33.069 INFO:tasks.workunit.client.1.smithi190.stdout:3/873: symlink d4/l132 0 2023-12-06T15:00:33.069 INFO:tasks.workunit.client.1.smithi190.stdout:8/804: creat d1/d20/d3b/d4c/d8e/d94/d1c/de0/ff4 x:0 0 0 2023-12-06T15:00:33.070 INFO:tasks.workunit.client.1.smithi190.stdout:4/791: rename d3/d76/d7c/d96 to d3/d76/dc4/dc5/d3c/d116 0 2023-12-06T15:00:33.070 INFO:tasks.workunit.client.1.smithi190.stdout:4/792: write d3/d76/fb2 [182507,96541] 0 2023-12-06T15:00:33.070 INFO:tasks.workunit.client.1.smithi190.stdout:3/874: symlink d4/d1b/d5d/d11b/l133 0 2023-12-06T15:00:33.071 INFO:tasks.workunit.client.1.smithi190.stdout:8/805: symlink d1/dd3/lf5 0 2023-12-06T15:00:33.071 INFO:tasks.workunit.client.1.smithi190.stdout:5/766: dread d0/d1c/f98 [4194304,4194304] 0 2023-12-06T15:00:33.071 INFO:tasks.workunit.client.0.smithi152.stdout:4/854: creat d2/d10/dbb/dca/dbc/d75/f111 x:0 0 0 2023-12-06T15:00:33.072 INFO:tasks.workunit.client.1.smithi190.stdout:4/793: mkdir d3/da4/d117 0 2023-12-06T15:00:33.074 INFO:tasks.workunit.client.1.smithi190.stdout:3/875: write d4/d1b/d54/f121 [2301768,97122] 0 2023-12-06T15:00:33.075 INFO:tasks.workunit.client.0.smithi152.stdout:3/579: mkdir d9/d10/d12/d43/d52/db4/d77/db6 0 2023-12-06T15:00:33.075 INFO:tasks.workunit.client.1.smithi190.stdout:8/806: mknod d1/d20/d3b/d4c/d8e/d94/cf6 0 2023-12-06T15:00:33.075 INFO:tasks.workunit.client.1.smithi190.stdout:8/807: stat d1/d20/d3b/d4c/d8e/d94/d25/f2a 0 2023-12-06T15:00:33.076 INFO:tasks.workunit.client.1.smithi190.stdout:7/964: dwrite d0/d88/d33/d4c/f75 [0,4194304] 0 2023-12-06T15:00:33.076 INFO:tasks.workunit.client.1.smithi190.stdout:7/965: truncate d0/d5/d63/f113 449631 0 2023-12-06T15:00:33.076 INFO:tasks.workunit.client.1.smithi190.stdout:7/966: write d0/d88/d7a/f114 [116503,2064] 0 2023-12-06T15:00:33.076 INFO:tasks.workunit.client.1.smithi190.stdout:7/967: chown d0/l4 73 1 2023-12-06T15:00:33.077 INFO:tasks.workunit.client.1.smithi190.stdout:4/794: read d3/fb8 [3640620,130553] 0 2023-12-06T15:00:33.077 INFO:tasks.workunit.client.0.smithi152.stdout:8/514: mknod d1/d6/d34/d35/d66/ca4 0 2023-12-06T15:00:33.078 INFO:tasks.workunit.client.1.smithi190.stdout:3/876: symlink d4/d70/d19/d51/l134 0 2023-12-06T15:00:33.078 INFO:tasks.workunit.client.0.smithi152.stdout:2/525: rename d6/d1e/d41/d55/l3c to d6/d18/d43/la7 0 2023-12-06T15:00:33.079 INFO:tasks.workunit.client.0.smithi152.stdout:3/580: creat d9/d10/d12/d43/d52/db4/d77/db6/fb7 x:0 0 0 2023-12-06T15:00:33.079 INFO:tasks.workunit.client.0.smithi152.stdout:3/581: chown d9/d10/d12/d43/d52/db4/d77/d9f/dad 8 1 2023-12-06T15:00:33.079 INFO:tasks.workunit.client.0.smithi152.stdout:3/582: chown d9/d10/d12/d43/d52/f61 4472758 1 2023-12-06T15:00:33.080 INFO:tasks.workunit.client.1.smithi190.stdout:8/808: creat d1/d20/d3b/d4c/d8e/ff7 x:0 0 0 2023-12-06T15:00:33.080 INFO:tasks.workunit.client.1.smithi190.stdout:8/809: chown d1/d20/l70 1601198 1 2023-12-06T15:00:33.080 INFO:tasks.workunit.client.1.smithi190.stdout:8/810: stat d1/d20/d3b/d4c/d59/d7d 0 2023-12-06T15:00:33.081 INFO:tasks.workunit.client.0.smithi152.stdout:8/515: creat d1/d6/d34/d36/d58/fa5 x:0 0 0 2023-12-06T15:00:33.081 INFO:tasks.workunit.client.0.smithi152.stdout:3/583: rmdir d9/d18/d51/d8d 39 2023-12-06T15:00:33.081 INFO:tasks.workunit.client.0.smithi152.stdout:3/584: dread - d9/d10/d19/f57 zero size 2023-12-06T15:00:33.082 INFO:tasks.workunit.client.0.smithi152.stdout:3/585: creat d9/fb8 x:0 0 0 2023-12-06T15:00:33.084 INFO:tasks.workunit.client.0.smithi152.stdout:8/516: rename d1/c83 to d1/ca6 0 2023-12-06T15:00:33.085 INFO:tasks.workunit.client.1.smithi190.stdout:7/968: rename d0/d88/d7a/fbe to d0/d88/d1c/d17/d94/f135 0 2023-12-06T15:00:33.086 INFO:tasks.workunit.client.1.smithi190.stdout:3/877: creat d4/d1b/d5d/df1/db5/f135 x:0 0 0 2023-12-06T15:00:33.086 INFO:tasks.workunit.client.1.smithi190.stdout:3/878: dread - d4/d1b/d5d/f107 zero size 2023-12-06T15:00:33.086 INFO:tasks.workunit.client.1.smithi190.stdout:3/879: dread - d4/d70/d19/d51/fcc zero size 2023-12-06T15:00:33.087 INFO:tasks.workunit.client.0.smithi152.stdout:8/517: getdents d1/d6/d29/d75 0 2023-12-06T15:00:33.087 INFO:tasks.workunit.client.1.smithi190.stdout:8/811: creat d1/d20/d3b/d4c/d8e/d94/ff8 x:0 0 0 2023-12-06T15:00:33.087 INFO:tasks.workunit.client.1.smithi190.stdout:8/812: fdatasync d1/fd5 0 2023-12-06T15:00:33.088 INFO:tasks.workunit.client.1.smithi190.stdout:7/969: rmdir d0/df/df8/d108 39 2023-12-06T15:00:33.089 INFO:tasks.workunit.client.0.smithi152.stdout:8/518: rename d1/d6/d34/d90/f97 to d1/d6/d34/d36/fa7 0 2023-12-06T15:00:33.089 INFO:tasks.workunit.client.0.smithi152.stdout:2/526: dread d6/f15 [0,4194304] 0 2023-12-06T15:00:33.090 INFO:tasks.workunit.client.1.smithi190.stdout:4/795: mknod d3/d35/d19/c118 0 2023-12-06T15:00:33.090 INFO:tasks.workunit.client.1.smithi190.stdout:3/880: creat d4/d1b/d5d/df1/f136 x:0 0 0 2023-12-06T15:00:33.093 INFO:tasks.workunit.client.1.smithi190.stdout:8/813: creat d1/d20/d3b/d34/ff9 x:0 0 0 2023-12-06T15:00:33.093 INFO:tasks.workunit.client.1.smithi190.stdout:8/814: chown d1/d20/d3b/d4c/d8e/d94/f80 165323 1 2023-12-06T15:00:33.093 INFO:tasks.workunit.client.1.smithi190.stdout:7/970: rmdir d0/d11c 0 2023-12-06T15:00:33.094 INFO:tasks.workunit.client.1.smithi190.stdout:7/971: stat d0/d88/d1c/c4e 0 2023-12-06T15:00:33.095 INFO:tasks.workunit.client.0.smithi152.stdout:6/763: sync 2023-12-06T15:00:33.095 INFO:tasks.workunit.client.0.smithi152.stdout:6/764: write d1/dcf/ddc/d1a/d30/fff [245825,92829] 0 2023-12-06T15:00:33.095 INFO:tasks.workunit.client.0.smithi152.stdout:6/765: chown d1/dcf/ddc/d1a/d30/d36/l98 0 1 2023-12-06T15:00:33.097 INFO:tasks.workunit.client.0.smithi152.stdout:6/766: symlink d1/d89/l111 0 2023-12-06T15:00:33.097 INFO:tasks.workunit.client.0.smithi152.stdout:6/767: truncate d1/dcf/ddc/d1a/d30/fff 714270 0 2023-12-06T15:00:33.098 INFO:tasks.workunit.client.0.smithi152.stdout:3/586: dread d9/d18/fa2 [0,4194304] 0 2023-12-06T15:00:33.098 INFO:tasks.workunit.client.1.smithi190.stdout:3/881: creat d4/d1b/d54/d9c/d68/dfc/f137 x:0 0 0 2023-12-06T15:00:33.101 INFO:tasks.workunit.client.1.smithi190.stdout:3/882: truncate d4/d1b/d5d/fe3 3054775 0 2023-12-06T15:00:33.101 INFO:tasks.workunit.client.1.smithi190.stdout:3/883: chown d4/d70/d19/d51/d109/db7/f126 26 1 2023-12-06T15:00:33.102 INFO:tasks.workunit.client.0.smithi152.stdout:8/519: dread d1/f3c [0,4194304] 0 2023-12-06T15:00:33.107 INFO:tasks.workunit.client.0.smithi152.stdout:6/768: mkdir d1/d69/da1/deb/d112 0 2023-12-06T15:00:33.107 INFO:tasks.workunit.client.0.smithi152.stdout:4/855: dwrite d2/d10/ff3 [0,4194304] 0 2023-12-06T15:00:33.107 INFO:tasks.workunit.client.0.smithi152.stdout:4/856: write d2/d10/dbb/dca/dbc/d42/fc0 [633664,88611] 0 2023-12-06T15:00:33.107 INFO:tasks.workunit.client.1.smithi190.stdout:3/884: write d4/d1b/d54/d9c/d68/dfc/d56/d94/d3d/fd0 [2357067,35923] 0 2023-12-06T15:00:33.108 INFO:tasks.workunit.client.0.smithi152.stdout:3/587: rename d9/d18/fa2 to d9/d18/d39/fb9 0 2023-12-06T15:00:33.109 INFO:tasks.workunit.client.1.smithi190.stdout:3/885: write d4/d70/d19/d3a/ddf/f115 [3144287,90486] 0 2023-12-06T15:00:33.110 INFO:tasks.workunit.client.0.smithi152.stdout:8/520: unlink d1/d6/d34/l89 0 2023-12-06T15:00:33.110 INFO:tasks.workunit.client.1.smithi190.stdout:6/907: sync 2023-12-06T15:00:33.111 INFO:tasks.workunit.client.0.smithi152.stdout:6/769: getdents d1/dcf/ddc/d1a/d30/d18/d3b 0 2023-12-06T15:00:33.113 INFO:tasks.workunit.client.0.smithi152.stdout:4/857: creat d2/d10/dab/f112 x:0 0 0 2023-12-06T15:00:33.114 INFO:tasks.workunit.client.0.smithi152.stdout:3/588: rmdir d9/d10/d12/d43/d52 39 2023-12-06T15:00:33.116 INFO:tasks.workunit.client.0.smithi152.stdout:8/521: creat d1/d6/d34/d36/d58/fa8 x:0 0 0 2023-12-06T15:00:33.118 INFO:tasks.workunit.client.0.smithi152.stdout:6/770: unlink d1/dcf/ddc/d1a/d30/d36/d35/cc3 0 2023-12-06T15:00:33.118 INFO:tasks.workunit.client.0.smithi152.stdout:4/858: link d2/d10/dbb/dca/dbc/d75/f111 d2/d45/d84/f113 0 2023-12-06T15:00:33.119 INFO:tasks.workunit.client.0.smithi152.stdout:8/522: mknod d1/d6/ca9 0 2023-12-06T15:00:33.119 INFO:tasks.workunit.client.0.smithi152.stdout:8/523: chown d1/d6/d34/d35/l6a 266 1 2023-12-06T15:00:33.120 INFO:tasks.workunit.client.0.smithi152.stdout:4/859: mknod d2/d45/d84/c114 0 2023-12-06T15:00:33.120 INFO:tasks.workunit.client.0.smithi152.stdout:8/524: mkdir d1/d6/d29/d87/daa 0 2023-12-06T15:00:33.120 INFO:tasks.workunit.client.0.smithi152.stdout:8/525: chown d1/d6/d34/l18 1208 1 2023-12-06T15:00:33.120 INFO:tasks.workunit.client.0.smithi152.stdout:8/526: chown d1/d6/d34/d35 13643472 1 2023-12-06T15:00:33.121 INFO:tasks.workunit.client.0.smithi152.stdout:4/860: mkdir d2/d89/df9/dfe/d115 0 2023-12-06T15:00:33.121 INFO:tasks.workunit.client.0.smithi152.stdout:4/861: chown d2/d10/dbb/dca/dcb 1388942 1 2023-12-06T15:00:33.122 INFO:tasks.workunit.client.0.smithi152.stdout:6/771: dread d1/d69/da1/deb/f10b [0,4194304] 0 2023-12-06T15:00:33.122 INFO:tasks.workunit.client.0.smithi152.stdout:6/772: dread - d1/dcf/ddc/d1a/d30/d36/d4e/d55/fc0 zero size 2023-12-06T15:00:33.125 INFO:tasks.workunit.client.0.smithi152.stdout:4/862: write d2/d15/d32/d69/d6f/d10b/f4a [1661595,29316] 0 2023-12-06T15:00:33.129 INFO:tasks.workunit.client.0.smithi152.stdout:4/863: write d2/d15/d32/d69/d6f/d10b/f4d [1887941,5602] 0 2023-12-06T15:00:33.130 INFO:tasks.workunit.client.1.smithi190.stdout:0/768: sync 2023-12-06T15:00:33.130 INFO:tasks.workunit.client.1.smithi190.stdout:0/769: stat d0/da/da4/db1/fc3 0 2023-12-06T15:00:33.130 INFO:tasks.workunit.client.1.smithi190.stdout:2/827: sync 2023-12-06T15:00:33.130 INFO:tasks.workunit.client.1.smithi190.stdout:5/767: dwrite d0/d1c/d2b/d2c/d5d/d73/f1f [0,4194304] 0 2023-12-06T15:00:33.131 INFO:tasks.workunit.client.0.smithi152.stdout:4/864: creat d2/d10/dc8/ddb/f116 x:0 0 0 2023-12-06T15:00:33.132 INFO:tasks.workunit.client.1.smithi190.stdout:2/828: link d10/d26/d5c/d35/d77/d98/lc5 d10/d59/d5e/l115 0 2023-12-06T15:00:33.132 INFO:tasks.workunit.client.1.smithi190.stdout:2/829: fsync d10/d26/d5c/d49/f6f 0 2023-12-06T15:00:33.132 INFO:tasks.workunit.client.1.smithi190.stdout:2/830: chown d10/d59/dcd/dad/df6/fff 229862073 1 2023-12-06T15:00:33.132 INFO:tasks.workunit.client.0.smithi152.stdout:4/865: read d2/d15/d32/d69/f10c [759529,75609] 0 2023-12-06T15:00:33.133 INFO:tasks.workunit.client.0.smithi152.stdout:3/589: dread d9/d10/d12/d43/d52/f71 [0,4194304] 0 2023-12-06T15:00:33.133 INFO:tasks.workunit.client.1.smithi190.stdout:0/770: write d0/da/d3e/d2b/d3c/d46/f73 [778579,8979] 0 2023-12-06T15:00:33.133 INFO:tasks.workunit.client.1.smithi190.stdout:5/768: unlink d0/d6c/da7/c100 0 2023-12-06T15:00:33.134 INFO:tasks.workunit.client.1.smithi190.stdout:5/769: stat d0/d1c/d2b/d8b/f10c 0 2023-12-06T15:00:33.137 INFO:tasks.workunit.client.1.smithi190.stdout:0/771: mknod d0/da/d5a/dc8/cfa 0 2023-12-06T15:00:33.138 INFO:tasks.workunit.client.1.smithi190.stdout:5/770: creat d0/d1c/d85/d90/f10f x:0 0 0 2023-12-06T15:00:33.138 INFO:tasks.workunit.client.1.smithi190.stdout:0/772: chown d0/da/d3e/d2b/d3c/d46/d8e/c99 1216214 1 2023-12-06T15:00:33.138 INFO:tasks.workunit.client.0.smithi152.stdout:4/866: unlink d2/d10/dbb/dca/dcb/f48 0 2023-12-06T15:00:33.139 INFO:tasks.workunit.client.0.smithi152.stdout:8/527: dread d1/d6/d29/d5b/f62 [4194304,4194304] 0 2023-12-06T15:00:33.139 INFO:tasks.workunit.client.0.smithi152.stdout:4/867: rename d2/d15/d32 to d2/d15/d32/d54/d85/d117 22 2023-12-06T15:00:33.139 INFO:tasks.workunit.client.0.smithi152.stdout:3/590: creat d9/d10/d12/d43/d52/db4/d77/d9f/dad/fba x:0 0 0 2023-12-06T15:00:33.139 INFO:tasks.workunit.client.0.smithi152.stdout:4/868: dread - d2/d15/d32/d69/d6f/d10b/ffb zero size 2023-12-06T15:00:33.139 INFO:tasks.workunit.client.0.smithi152.stdout:4/869: chown d2/d10/fa5 331845724 1 2023-12-06T15:00:33.139 INFO:tasks.workunit.client.0.smithi152.stdout:2/527: dwrite d6/f6a [0,4194304] 0 2023-12-06T15:00:33.139 INFO:tasks.workunit.client.0.smithi152.stdout:3/591: unlink d9/d10/d12/f1e 0 2023-12-06T15:00:33.139 INFO:tasks.workunit.client.0.smithi152.stdout:3/592: truncate d9/d10/f2a 1386738 0 2023-12-06T15:00:33.139 INFO:tasks.workunit.client.0.smithi152.stdout:4/870: write d2/d10/dbb/dca/dbc/fdc [2320186,12162] 0 2023-12-06T15:00:33.140 INFO:tasks.workunit.client.1.smithi190.stdout:0/773: creat d0/da/da4/db1/ffb x:0 0 0 2023-12-06T15:00:33.140 INFO:tasks.workunit.client.1.smithi190.stdout:0/774: getdents d0/da/d3e/d2b/d3c/d46/d8e/d90 0 2023-12-06T15:00:33.141 INFO:tasks.workunit.client.0.smithi152.stdout:2/528: mknod d6/d1e/d41/d55/ca8 0 2023-12-06T15:00:33.141 INFO:tasks.workunit.client.1.smithi190.stdout:0/775: unlink d0/da/d3e/d3a/d40/d81/f89 0 2023-12-06T15:00:33.141 INFO:tasks.workunit.client.1.smithi190.stdout:5/771: dread d0/df/d50/f75 [0,4194304] 0 2023-12-06T15:00:33.142 INFO:tasks.workunit.client.0.smithi152.stdout:3/593: creat d9/d10/d12/d43/d52/db4/d65/fbb x:0 0 0 2023-12-06T15:00:33.143 INFO:tasks.workunit.client.1.smithi190.stdout:6/908: dwrite d4/d12/d40/d43/d45/d4a/d77/fb5 [0,4194304] 0 2023-12-06T15:00:33.143 INFO:tasks.workunit.client.1.smithi190.stdout:4/796: dwrite d3/d76/dc4/dc5/d3c/d116/f7b [0,4194304] 0 2023-12-06T15:00:33.143 INFO:tasks.workunit.client.1.smithi190.stdout:0/776: mkdir d0/da/d74/dfc 0 2023-12-06T15:00:33.143 INFO:tasks.workunit.client.1.smithi190.stdout:0/777: truncate d0/da/d3e/d3a/d40/fd1 109163 0 2023-12-06T15:00:33.144 INFO:tasks.workunit.client.0.smithi152.stdout:4/871: mkdir d2/d15/d32/d54/d85/d118 0 2023-12-06T15:00:33.144 INFO:tasks.workunit.client.0.smithi152.stdout:4/872: truncate d2/d45/f4e 1201238 0 2023-12-06T15:00:33.144 INFO:tasks.workunit.client.1.smithi190.stdout:8/815: dwrite d1/d20/f42 [0,4194304] 0 2023-12-06T15:00:33.144 INFO:tasks.workunit.client.1.smithi190.stdout:7/972: dwrite d0/d88/d1c/f28 [4194304,4194304] 0 2023-12-06T15:00:33.145 INFO:tasks.workunit.client.0.smithi152.stdout:2/529: symlink d6/db/d91/la9 0 2023-12-06T15:00:33.146 INFO:tasks.workunit.client.1.smithi190.stdout:8/816: write d1/d20/d3b/d4c/d8e/fd2 [2491020,52047] 0 2023-12-06T15:00:33.147 INFO:tasks.workunit.client.0.smithi152.stdout:4/873: symlink d2/d15/d32/d69/d6f/l119 0 2023-12-06T15:00:33.148 INFO:tasks.workunit.client.1.smithi190.stdout:4/797: rmdir d3/d76/dc4/dc5 39 2023-12-06T15:00:33.148 INFO:tasks.workunit.client.1.smithi190.stdout:4/798: chown d3/d35/d19/d41/d44/leb 926036794 1 2023-12-06T15:00:33.149 INFO:tasks.workunit.client.0.smithi152.stdout:6/773: dwrite d1/d69/da1/d87/f44 [0,4194304] 0 2023-12-06T15:00:33.150 INFO:tasks.workunit.client.0.smithi152.stdout:2/530: rename d6/d18/d43/f6f to d6/db/faa 0 2023-12-06T15:00:33.151 INFO:tasks.workunit.client.0.smithi152.stdout:4/874: mknod d2/d15/d32/d69/d6f/c11a 0 2023-12-06T15:00:33.152 INFO:tasks.workunit.client.1.smithi190.stdout:0/778: rmdir d0/da/d3e/d2b/d3c/d46/d8e 39 2023-12-06T15:00:33.152 INFO:tasks.workunit.client.1.smithi190.stdout:6/909: dread d4/d12/d40/d43/d45/d4a/f7e [0,4194304] 0 2023-12-06T15:00:33.153 INFO:tasks.workunit.client.0.smithi152.stdout:3/594: write d9/d10/d12/d43/f8b [481350,81619] 0 2023-12-06T15:00:33.154 INFO:tasks.workunit.client.0.smithi152.stdout:6/774: write d1/d69/da1/deb/ffd [1044202,40261] 0 2023-12-06T15:00:33.155 INFO:tasks.workunit.client.1.smithi190.stdout:8/817: mkdir d1/d20/d3b/d34/dc0/dfa 0 2023-12-06T15:00:33.155 INFO:tasks.workunit.client.1.smithi190.stdout:8/818: chown d1/d20/d3b/d4c/d8e/da5/ca9 198286246 1 2023-12-06T15:00:33.156 INFO:tasks.workunit.client.1.smithi190.stdout:8/819: write d1/d20/d3b/d4c/d8e/d94/d1c/f9b [1542394,123591] 0 2023-12-06T15:00:33.156 INFO:tasks.workunit.client.0.smithi152.stdout:3/595: dread d9/d10/f2a [0,4194304] 0 2023-12-06T15:00:33.157 INFO:tasks.workunit.client.0.smithi152.stdout:2/531: creat d6/fab x:0 0 0 2023-12-06T15:00:33.158 INFO:tasks.workunit.client.1.smithi190.stdout:4/799: rename d3/d35/d97 to d3/d4e/d119 0 2023-12-06T15:00:33.158 INFO:tasks.workunit.client.1.smithi190.stdout:4/800: chown d3/c27 215819330 1 2023-12-06T15:00:33.158 INFO:tasks.workunit.client.1.smithi190.stdout:4/801: fdatasync d3/d76/dc4/dc5/d3c/fc6 0 2023-12-06T15:00:33.159 INFO:tasks.workunit.client.1.smithi190.stdout:0/779: symlink d0/da/d3e/d3a/d40/d81/lfd 0 2023-12-06T15:00:33.160 INFO:tasks.workunit.client.1.smithi190.stdout:6/910: truncate d4/d12/d40/d43/d45/d4a/d77/dca/f96 3874278 0 2023-12-06T15:00:33.160 INFO:tasks.workunit.client.0.smithi152.stdout:4/875: mknod d2/d10/dbb/dca/dbc/d75/deb/c11b 0 2023-12-06T15:00:33.162 INFO:tasks.workunit.client.1.smithi190.stdout:7/973: dread d0/d88/d32/f59 [0,4194304] 0 2023-12-06T15:00:33.163 INFO:tasks.workunit.client.1.smithi190.stdout:8/820: getdents d1/d20/d3b/d34 0 2023-12-06T15:00:33.163 INFO:tasks.workunit.client.1.smithi190.stdout:7/974: readlink d0/d88/lb2 0 2023-12-06T15:00:33.163 INFO:tasks.workunit.client.1.smithi190.stdout:7/975: chown d0/d88/d32/c9d 945733 1 2023-12-06T15:00:33.163 INFO:tasks.workunit.client.1.smithi190.stdout:4/802: creat d3/d35/d19/f11a x:0 0 0 2023-12-06T15:00:33.163 INFO:tasks.workunit.client.0.smithi152.stdout:4/876: rename d2/d15/d32/d54/d85/d118 to d2/d15/d32/d69/d6f/daf/d11c 0 2023-12-06T15:00:33.166 INFO:tasks.workunit.client.1.smithi190.stdout:0/780: mknod d0/da/d3e/d3a/d40/d6f/d9e/dbb/cfe 0 2023-12-06T15:00:33.166 INFO:tasks.workunit.client.1.smithi190.stdout:6/911: truncate d4/d12/d40/d43/d45/f5f 2273571 0 2023-12-06T15:00:33.166 INFO:tasks.workunit.client.0.smithi152.stdout:4/877: read d2/d15/d32/d69/d6f/d10b/d6e/fac [893197,6510] 0 2023-12-06T15:00:33.167 INFO:tasks.workunit.client.0.smithi152.stdout:2/532: link d6/c48 d6/d1e/cac 0 2023-12-06T15:00:33.168 INFO:tasks.workunit.client.0.smithi152.stdout:4/878: creat d2/d10/dbb/dca/dbc/d42/f11d x:0 0 0 2023-12-06T15:00:33.169 INFO:tasks.workunit.client.1.smithi190.stdout:4/803: link d3/d76/dc4/dc5/d3c/d116/f7b d3/dc9/f11b 0 2023-12-06T15:00:33.172 INFO:tasks.workunit.client.1.smithi190.stdout:0/781: creat d0/da/db7/fff x:0 0 0 2023-12-06T15:00:33.173 INFO:tasks.workunit.client.1.smithi190.stdout:6/912: mkdir d4/d12/d40/d43/d12d 0 2023-12-06T15:00:33.173 INFO:tasks.workunit.client.1.smithi190.stdout:6/913: stat d4/d12/d40/d43/d45/d4a/d77/fb5 0 2023-12-06T15:00:33.175 INFO:tasks.workunit.client.1.smithi190.stdout:8/821: mkdir d1/d20/d3b/d4c/d5a/dfb 0 2023-12-06T15:00:33.175 INFO:tasks.workunit.client.1.smithi190.stdout:8/822: chown d1/d20/d3b/d4c/d8e/da5/fa7 44 1 2023-12-06T15:00:33.175 INFO:tasks.workunit.client.1.smithi190.stdout:8/823: readlink d1/d20/d3b/d7e/dd0/lcc 0 2023-12-06T15:00:33.175 INFO:tasks.workunit.client.1.smithi190.stdout:8/824: stat d1/d20/d3b/d36/fb5 0 2023-12-06T15:00:33.176 INFO:tasks.workunit.client.1.smithi190.stdout:3/886: dread d4/d1b/d5d/fe3 [0,4194304] 0 2023-12-06T15:00:33.176 INFO:tasks.workunit.client.1.smithi190.stdout:3/887: write d4/fa5 [1492939,39379] 0 2023-12-06T15:00:33.176 INFO:tasks.workunit.client.1.smithi190.stdout:2/831: dwrite fa [0,4194304] 0 2023-12-06T15:00:33.176 INFO:tasks.workunit.client.1.smithi190.stdout:2/832: fsync d10/d26/d5c/f94 0 2023-12-06T15:00:33.177 INFO:tasks.workunit.client.1.smithi190.stdout:0/782: mknod d0/d9d/c100 0 2023-12-06T15:00:33.177 INFO:tasks.workunit.client.1.smithi190.stdout:0/783: fsync d0/da/d3e/d87/fcf 0 2023-12-06T15:00:33.180 INFO:tasks.workunit.client.0.smithi152.stdout:5/661: sync 2023-12-06T15:00:33.180 INFO:tasks.workunit.client.0.smithi152.stdout:2/533: fsync d6/db/faa 0 2023-12-06T15:00:33.180 INFO:tasks.workunit.client.0.smithi152.stdout:2/534: stat d6/d1e/d41/d83/f93 0 2023-12-06T15:00:33.181 INFO:tasks.workunit.client.1.smithi190.stdout:8/825: creat d1/d37/dc9/ffc x:0 0 0 2023-12-06T15:00:33.182 INFO:tasks.workunit.client.0.smithi152.stdout:5/662: creat d7/dd/d26/d3b/d46/fe7 x:0 0 0 2023-12-06T15:00:33.185 INFO:tasks.workunit.client.1.smithi190.stdout:3/888: rename d4/d70/d19/d111/l12e to d4/d70/d19/d3a/d3b/d72/df5/l138 0 2023-12-06T15:00:33.186 INFO:tasks.workunit.client.1.smithi190.stdout:5/772: dwrite d0/d1c/d3e/f60 [0,4194304] 0 2023-12-06T15:00:33.188 INFO:tasks.workunit.client.1.smithi190.stdout:2/833: mkdir d10/d59/dcd/dad/d116 0 2023-12-06T15:00:33.188 INFO:tasks.workunit.client.1.smithi190.stdout:0/784: mkdir d0/da/da4/db1/d101 0 2023-12-06T15:00:33.190 INFO:tasks.workunit.client.0.smithi152.stdout:6/775: dwrite d1/d69/da1/d87/f73 [0,4194304] 0 2023-12-06T15:00:33.190 INFO:tasks.workunit.client.0.smithi152.stdout:6/776: dread - d1/dcf/ddc/d1a/d30/d36/d35/d61/fdd zero size 2023-12-06T15:00:33.190 INFO:tasks.workunit.client.0.smithi152.stdout:6/777: stat d1/d1c/c4d 0 2023-12-06T15:00:33.190 INFO:tasks.workunit.client.0.smithi152.stdout:6/778: chown d1/dcf/ddc/d1a/d30/d36/d56/cc4 1284379 1 2023-12-06T15:00:33.191 INFO:tasks.workunit.client.1.smithi190.stdout:3/889: mkdir d4/d70/d19/d51/d109/db7/dd2/d139 0 2023-12-06T15:00:33.191 INFO:tasks.workunit.client.1.smithi190.stdout:8/826: symlink d1/d20/lfd 0 2023-12-06T15:00:33.191 INFO:tasks.workunit.client.1.smithi190.stdout:8/827: write d1/d20/d3b/d36/d50/f83 [118783,84303] 0 2023-12-06T15:00:33.191 INFO:tasks.workunit.client.1.smithi190.stdout:8/828: write d1/d20/d3b/d4c/d59/d7d/fe9 [459296,119984] 0 2023-12-06T15:00:33.192 INFO:tasks.workunit.client.1.smithi190.stdout:8/829: stat d1/d20/d3b/d4c/d8e/d94/d1c/f9b 0 2023-12-06T15:00:33.192 INFO:tasks.workunit.client.1.smithi190.stdout:8/830: chown d1/d20/d3b/d36/d50 8243326 1 2023-12-06T15:00:33.192 INFO:tasks.workunit.client.0.smithi152.stdout:5/663: creat d7/dd/d26/d48/d97/dc2/fe8 x:0 0 0 2023-12-06T15:00:33.194 INFO:tasks.workunit.client.1.smithi190.stdout:2/834: creat d10/d59/dcd/dad/dc9/f117 x:0 0 0 2023-12-06T15:00:33.194 INFO:tasks.workunit.client.1.smithi190.stdout:5/773: write d0/d1c/d2b/d2c/d5d/f95 [2371836,67135] 0 2023-12-06T15:00:33.194 INFO:tasks.workunit.client.1.smithi190.stdout:5/774: chown d0/d1c/d94/ff1 9480 1 2023-12-06T15:00:33.195 INFO:tasks.workunit.client.0.smithi152.stdout:6/779: mknod d1/d69/da1/d87/d10a/c113 0 2023-12-06T15:00:33.195 INFO:tasks.workunit.client.0.smithi152.stdout:6/780: truncate d1/dcf/ddc/f48 4505533 0 2023-12-06T15:00:33.198 INFO:tasks.workunit.client.0.smithi152.stdout:6/781: creat d1/d69/da1/deb/d112/f114 x:0 0 0 2023-12-06T15:00:33.198 INFO:tasks.workunit.client.0.smithi152.stdout:6/782: fdatasync d1/dcf/ddc/d1a/d30/d36/d4e/f5e 0 2023-12-06T15:00:33.198 INFO:tasks.workunit.client.0.smithi152.stdout:6/783: fsync d1/dcf/ddc/d1a/d30/d36/d35/d49/d6b/f95 0 2023-12-06T15:00:33.198 INFO:tasks.workunit.client.0.smithi152.stdout:6/784: stat d1/d69/da1/d87/d10a/c113 0 2023-12-06T15:00:33.198 INFO:tasks.workunit.client.0.smithi152.stdout:6/785: write d1/dcf/ddc/d6d/fe1 [744964,121473] 0 2023-12-06T15:00:33.200 INFO:tasks.workunit.client.0.smithi152.stdout:6/786: rename d1/dcf/ddc/d1a/d30/d36/d56/c38 to d1/d69/da1/d87/d15/c115 0 2023-12-06T15:00:33.200 INFO:tasks.workunit.client.0.smithi152.stdout:6/787: write d1/f7 [3385204,46956] 0 2023-12-06T15:00:33.200 INFO:tasks.workunit.client.0.smithi152.stdout:6/788: write d1/d69/da1/d87/d15/fc1 [361352,116134] 0 2023-12-06T15:00:33.201 INFO:tasks.workunit.client.1.smithi190.stdout:5/775: rename d0/d1c/d2b/d8b/fd1 to d0/d1c/d85/d90/f110 0 2023-12-06T15:00:33.201 INFO:tasks.workunit.client.1.smithi190.stdout:5/776: chown d0/d1c/d94/fc4 33 1 2023-12-06T15:00:33.201 INFO:tasks.workunit.client.1.smithi190.stdout:5/777: chown d0/d1c/d2b/d2c/d5d/l8a 92 1 2023-12-06T15:00:33.201 INFO:tasks.workunit.client.1.smithi190.stdout:5/778: write d0/d1c/d85/d90/f10f [221010,75444] 0 2023-12-06T15:00:33.202 INFO:tasks.workunit.client.0.smithi152.stdout:9/540: sync 2023-12-06T15:00:33.203 INFO:tasks.workunit.client.1.smithi190.stdout:5/779: symlink d0/d1c/d3e/d5a/l111 0 2023-12-06T15:00:33.204 INFO:tasks.workunit.client.0.smithi152.stdout:9/541: dread d0/d3f/d68/d6c/f3b [0,4194304] 0 2023-12-06T15:00:33.204 INFO:tasks.workunit.client.0.smithi152.stdout:3/596: dwrite d9/f38 [4194304,4194304] 0 2023-12-06T15:00:33.205 INFO:tasks.workunit.client.0.smithi152.stdout:3/597: fdatasync d9/d18/d39/fb9 0 2023-12-06T15:00:33.205 INFO:tasks.workunit.client.0.smithi152.stdout:3/598: chown d9/d10/d19/l1b 23788 1 2023-12-06T15:00:33.205 INFO:tasks.workunit.client.1.smithi190.stdout:5/780: rmdir d0 39 2023-12-06T15:00:33.205 INFO:tasks.workunit.client.0.smithi152.stdout:9/542: mknod d0/d3f/d68/c9b 0 2023-12-06T15:00:33.206 INFO:tasks.workunit.client.0.smithi152.stdout:3/599: creat d9/d10/d12/d43/d52/d58/da9/fbc x:0 0 0 2023-12-06T15:00:33.206 INFO:tasks.workunit.client.0.smithi152.stdout:9/543: mknod d0/d3f/d5f/c9c 0 2023-12-06T15:00:33.207 INFO:tasks.workunit.client.0.smithi152.stdout:9/544: read - d0/d3f/d68/d6c/d20/d38/d48/d90/f95 zero size 2023-12-06T15:00:33.207 INFO:tasks.workunit.client.0.smithi152.stdout:9/545: truncate d0/d3f/d68/d6c/d20/d38/d44/f58 634284 0 2023-12-06T15:00:33.207 INFO:tasks.workunit.client.0.smithi152.stdout:3/600: link d9/d10/d12/d43/d52/d58/da9/c3b d9/d45/d9c/cbd 0 2023-12-06T15:00:33.209 INFO:tasks.workunit.client.1.smithi190.stdout:5/781: unlink d0/d1c/d2b/d2c/c81 0 2023-12-06T15:00:33.209 INFO:tasks.workunit.client.1.smithi190.stdout:4/804: dwrite d3/d76/dc4/dc5/d3c/fc6 [0,4194304] 0 2023-12-06T15:00:33.209 INFO:tasks.workunit.client.0.smithi152.stdout:9/546: creat d0/d3f/d5f/f9d x:0 0 0 2023-12-06T15:00:33.209 INFO:tasks.workunit.client.0.smithi152.stdout:9/547: dread - d0/d50/f61 zero size 2023-12-06T15:00:33.212 INFO:tasks.workunit.client.0.smithi152.stdout:6/789: write d1/d75/f7d [1179367,79017] 0 2023-12-06T15:00:33.212 INFO:tasks.workunit.client.0.smithi152.stdout:6/790: dread - d1/dcf/ddc/d1a/d30/d36/ff1 zero size 2023-12-06T15:00:33.212 INFO:tasks.workunit.client.0.smithi152.stdout:6/791: readlink d1/dcf/ddc/d1a/d30/d36/d35/d49/l83 0 2023-12-06T15:00:33.212 INFO:tasks.workunit.client.0.smithi152.stdout:3/601: rename d9/d10/d19/c67 to d9/cbe 0 2023-12-06T15:00:33.212 INFO:tasks.workunit.client.0.smithi152.stdout:9/548: rmdir d0/d3f/d68/d6c/d20/d4a 39 2023-12-06T15:00:33.212 INFO:tasks.workunit.client.0.smithi152.stdout:9/549: fsync d0/d3f/d68/d6c/d20/d4a/d4d/d69/f7a 0 2023-12-06T15:00:33.214 INFO:tasks.workunit.client.0.smithi152.stdout:7/460: sync 2023-12-06T15:00:33.214 INFO:tasks.workunit.client.0.smithi152.stdout:0/561: sync 2023-12-06T15:00:33.214 INFO:tasks.workunit.client.0.smithi152.stdout:1/846: sync 2023-12-06T15:00:33.214 INFO:tasks.workunit.client.0.smithi152.stdout:9/550: mkdir d0/d3f/d68/d6c/d92/d9e 0 2023-12-06T15:00:33.216 INFO:tasks.workunit.client.0.smithi152.stdout:7/461: rename dd/df/d1b/d4e/c6f to dd/df/d34/d44/d49/d73/c91 0 2023-12-06T15:00:33.216 INFO:tasks.workunit.client.0.smithi152.stdout:6/792: write d1/dcf/ddc/d1a/d30/d36/d35/d49/d6b/f91 [1268052,35194] 0 2023-12-06T15:00:33.216 INFO:tasks.workunit.client.0.smithi152.stdout:6/793: read - d1/dcf/ddc/d1a/d30/d18/ffa zero size 2023-12-06T15:00:33.217 INFO:tasks.workunit.client.0.smithi152.stdout:0/562: mkdir d8/d15/d45/d73/db9 0 2023-12-06T15:00:33.218 INFO:tasks.workunit.client.0.smithi152.stdout:9/551: mkdir d0/d3f/d68/d9f 0 2023-12-06T15:00:33.220 INFO:tasks.workunit.client.1.smithi190.stdout:3/890: dread d4/d70/f9b [0,4194304] 0 2023-12-06T15:00:33.220 INFO:tasks.workunit.client.1.smithi190.stdout:3/891: readlink d4/d1b/d54/d9c/l8b 0 2023-12-06T15:00:33.220 INFO:tasks.workunit.client.1.smithi190.stdout:2/835: dread d10/d26/d5c/d42/d9d/fae [0,4194304] 0 2023-12-06T15:00:33.221 INFO:tasks.workunit.client.1.smithi190.stdout:3/892: symlink d4/d1b/d5d/df1/l13a 0 2023-12-06T15:00:33.221 INFO:tasks.workunit.client.1.smithi190.stdout:3/893: fdatasync d4/d70/d19/d3a/d3b/d72/f86 0 2023-12-06T15:00:33.224 INFO:tasks.workunit.client.1.smithi190.stdout:3/894: creat d4/d1b/d54/d9c/f13b x:0 0 0 2023-12-06T15:00:33.226 INFO:tasks.workunit.client.1.smithi190.stdout:7/976: dwrite d0/d35/f84 [4194304,4194304] 0 2023-12-06T15:00:33.226 INFO:tasks.workunit.client.1.smithi190.stdout:5/782: dread d0/d1c/d94/fc4 [0,4194304] 0 2023-12-06T15:00:33.229 INFO:tasks.workunit.client.1.smithi190.stdout:7/977: rename d0/d5/d63/fc4 to d0/df/d53/d99/ddb/f136 0 2023-12-06T15:00:33.234 INFO:tasks.workunit.client.0.smithi152.stdout:6/794: dread d1/fa3 [0,4194304] 0 2023-12-06T15:00:33.236 INFO:tasks.workunit.client.1.smithi190.stdout:6/914: dwrite d4/d12/d40/d43/d45/d4a/d77/dca/f89 [0,4194304] 0 2023-12-06T15:00:33.236 INFO:tasks.workunit.client.1.smithi190.stdout:0/785: dwrite d0/da/d3e/d3a/d40/d81/f63 [4194304,4194304] 0 2023-12-06T15:00:33.237 INFO:tasks.workunit.client.1.smithi190.stdout:5/783: mkdir d0/d96/d112 0 2023-12-06T15:00:33.238 INFO:tasks.workunit.client.0.smithi152.stdout:5/664: dwrite d7/f21 [0,4194304] 0 2023-12-06T15:00:33.238 INFO:tasks.workunit.client.0.smithi152.stdout:5/665: chown d7/dd/d4e 13 1 2023-12-06T15:00:33.238 INFO:tasks.workunit.client.1.smithi190.stdout:7/978: mknod d0/d88/d32/d12f/c137 0 2023-12-06T15:00:33.240 INFO:tasks.workunit.client.1.smithi190.stdout:8/831: dwrite d1/d20/f99 [0,4194304] 0 2023-12-06T15:00:33.240 INFO:tasks.workunit.client.1.smithi190.stdout:8/832: chown d1/d20/d3b/fc3 7 1 2023-12-06T15:00:33.240 INFO:tasks.workunit.client.1.smithi190.stdout:8/833: stat d1/d37/l97 0 2023-12-06T15:00:33.240 INFO:tasks.workunit.client.1.smithi190.stdout:8/834: dread - d1/d20/d3b/d4c/d8e/ff7 zero size 2023-12-06T15:00:33.240 INFO:tasks.workunit.client.0.smithi152.stdout:2/535: dwrite d6/d18/d70/f84 [0,4194304] 0 2023-12-06T15:00:33.241 INFO:tasks.workunit.client.1.smithi190.stdout:6/915: truncate d4/d12/d1a/fc9 1915 0 2023-12-06T15:00:33.243 INFO:tasks.workunit.client.0.smithi152.stdout:1/847: dread d3/da/d65/f77 [0,4194304] 0 2023-12-06T15:00:33.249 INFO:tasks.workunit.client.1.smithi190.stdout:0/786: rename d0/da/d3e/d3a/la6 to d0/da/d3e/d2b/d3c/d46/d8e/l102 0 2023-12-06T15:00:33.250 INFO:tasks.workunit.client.1.smithi190.stdout:5/784: mkdir d0/d96/dc5/d113 0 2023-12-06T15:00:33.250 INFO:tasks.workunit.client.1.smithi190.stdout:5/785: chown d0/d1c/d2b/d2c/d5d/d73 143 1 2023-12-06T15:00:33.251 INFO:tasks.workunit.client.1.smithi190.stdout:7/979: creat d0/df/df8/d108/d120/f138 x:0 0 0 2023-12-06T15:00:33.258 INFO:tasks.workunit.client.0.smithi152.stdout:0/563: symlink d8/d15/d45/d99/lba 0 2023-12-06T15:00:33.261 INFO:tasks.workunit.client.0.smithi152.stdout:9/552: link d0/d3f/d68/d6c/d20/d38/d45/f3a d0/d3f/d68/d6c/d92/d9e/fa0 0 2023-12-06T15:00:33.261 INFO:tasks.workunit.client.0.smithi152.stdout:9/553: write d0/d3f/d68/d6c/d20/d38/d44/f58 [849131,66037] 0 2023-12-06T15:00:33.261 INFO:tasks.workunit.client.0.smithi152.stdout:9/554: write d0/d3f/d68/d6c/d20/d38/d48/d90/f97 [1012923,16170] 0 2023-12-06T15:00:33.261 INFO:tasks.workunit.client.0.smithi152.stdout:9/555: fsync d0/d3f/d68/d6c/d20/d4a/d4d/f5e 0 2023-12-06T15:00:33.263 INFO:tasks.workunit.client.1.smithi190.stdout:8/835: mknod d1/d20/d3b/d34/dbc/cfe 0 2023-12-06T15:00:33.270 INFO:tasks.workunit.client.1.smithi190.stdout:0/787: dread d0/da/d5a/fcd [0,4194304] 0 2023-12-06T15:00:33.270 INFO:tasks.workunit.client.1.smithi190.stdout:5/786: rmdir d0/df 39 2023-12-06T15:00:33.271 INFO:tasks.workunit.client.1.smithi190.stdout:5/787: write d0/d1c/f36 [1013549,92704] 0 2023-12-06T15:00:33.272 INFO:tasks.workunit.client.0.smithi152.stdout:2/536: creat d6/db/d17/fad x:0 0 0 2023-12-06T15:00:33.274 INFO:tasks.workunit.client.1.smithi190.stdout:8/836: creat d1/d20/d3b/d34/fff x:0 0 0 2023-12-06T15:00:33.275 INFO:tasks.workunit.client.1.smithi190.stdout:6/916: truncate d4/d12/d40/d43/d45/d4a/d77/dca/f26 1883519 0 2023-12-06T15:00:33.277 INFO:tasks.workunit.client.0.smithi152.stdout:2/537: write d6/d18/d43/f50 [6496986,110907] 0 2023-12-06T15:00:33.277 INFO:tasks.workunit.client.1.smithi190.stdout:0/788: mknod d0/da/d3e/d2b/d3c/d46/d8e/c103 0 2023-12-06T15:00:33.277 INFO:tasks.workunit.client.1.smithi190.stdout:0/789: write d0/da/d3e/d3a/d40/d81/ff3 [4991897,103261] 0 2023-12-06T15:00:33.277 INFO:tasks.workunit.client.1.smithi190.stdout:0/790: write d0/da/d3e/d2b/d3c/d46/d8e/fa0 [298874,47345] 0 2023-12-06T15:00:33.277 INFO:tasks.workunit.client.1.smithi190.stdout:0/791: write d0/da/fa9 [583470,19154] 0 2023-12-06T15:00:33.277 INFO:tasks.workunit.client.1.smithi190.stdout:0/792: dread - d0/da/db7/fff zero size 2023-12-06T15:00:33.279 INFO:tasks.workunit.client.1.smithi190.stdout:8/837: mknod d1/d20/d3b/d7e/c100 0 2023-12-06T15:00:33.279 INFO:tasks.workunit.client.1.smithi190.stdout:8/838: write d1/d20/d3b/d4c/d8e/d94/d1c/de0/ff3 [865401,101519] 0 2023-12-06T15:00:33.279 INFO:tasks.workunit.client.1.smithi190.stdout:6/917: rmdir d4/d12/d1a/d70 39 2023-12-06T15:00:33.280 INFO:tasks.workunit.client.1.smithi190.stdout:6/918: readlink d4/d12/d1a/d70/l11b 0 2023-12-06T15:00:33.282 INFO:tasks.workunit.client.1.smithi190.stdout:0/793: unlink d0/da/d3e/d2b/d3c/d46/d8e/d90/fb3 0 2023-12-06T15:00:33.282 INFO:tasks.workunit.client.1.smithi190.stdout:5/788: mkdir d0/d1c/d2b/d2c/d5d/d73/d114 0 2023-12-06T15:00:33.283 INFO:tasks.workunit.client.0.smithi152.stdout:2/538: link d6/d1e/f2e d6/db/d17/fae 0 2023-12-06T15:00:33.284 INFO:tasks.workunit.client.1.smithi190.stdout:8/839: mknod d1/d20/d3b/d4c/d59/daa/ddf/c101 0 2023-12-06T15:00:33.284 INFO:tasks.workunit.client.1.smithi190.stdout:8/840: readlink d1/d20/d3b/d4c/d8e/d94/db6/ld7 0 2023-12-06T15:00:33.284 INFO:tasks.workunit.client.1.smithi190.stdout:8/841: write d1/d37/f73 [2236508,4988] 0 2023-12-06T15:00:33.285 INFO:tasks.workunit.client.1.smithi190.stdout:0/794: rmdir d0/da/d3e/df6 0 2023-12-06T15:00:33.286 INFO:tasks.workunit.client.1.smithi190.stdout:5/789: rename d0/deb/ff6 to d0/d1c/d85/d90/d99/f115 0 2023-12-06T15:00:33.287 INFO:tasks.workunit.client.1.smithi190.stdout:8/842: rename d1/d20/d3b/d4c/d8e/d94/db6/ld7 to d1/d20/d3b/d4c/d8e/d94/d25/l102 0 2023-12-06T15:00:33.287 INFO:tasks.workunit.client.1.smithi190.stdout:8/843: stat d1/dd1/l96 0 2023-12-06T15:00:33.288 INFO:tasks.workunit.client.1.smithi190.stdout:5/790: unlink d0/d6c/f79 0 2023-12-06T15:00:33.288 INFO:tasks.workunit.client.1.smithi190.stdout:5/791: chown d0/d1c/d85 275 1 2023-12-06T15:00:33.289 INFO:tasks.workunit.client.1.smithi190.stdout:5/792: truncate d0/f2a 49648 0 2023-12-06T15:00:33.289 INFO:tasks.workunit.client.1.smithi190.stdout:5/793: fsync d0/d1c/d85/fe4 0 2023-12-06T15:00:33.289 INFO:tasks.workunit.client.1.smithi190.stdout:3/895: dwrite d4/d70/d19/d3a/f46 [0,4194304] 0 2023-12-06T15:00:33.290 INFO:tasks.workunit.client.0.smithi152.stdout:7/462: dwrite dd/df/d34/f7e [0,4194304] 0 2023-12-06T15:00:33.291 INFO:tasks.workunit.client.1.smithi190.stdout:2/836: dwrite d10/d26/d5c/d37/f38 [0,4194304] 0 2023-12-06T15:00:33.291 INFO:tasks.workunit.client.1.smithi190.stdout:2/837: chown d10/d26/d5c/d8d/fdc 1390 1 2023-12-06T15:00:33.291 INFO:tasks.workunit.client.1.smithi190.stdout:5/794: truncate d0/df/d50/f75 519188 0 2023-12-06T15:00:33.292 INFO:tasks.workunit.client.1.smithi190.stdout:8/844: dread d1/d20/f8b [0,4194304] 0 2023-12-06T15:00:33.293 INFO:tasks.workunit.client.0.smithi152.stdout:1/848: dwrite d3/da/d15/d17/d43/f91 [4194304,4194304] 0 2023-12-06T15:00:33.293 INFO:tasks.workunit.client.0.smithi152.stdout:1/849: chown d3/da/d15/f3f 2446 1 2023-12-06T15:00:33.293 INFO:tasks.workunit.client.0.smithi152.stdout:1/850: truncate d3/da/d4c/d82/db4/fc8 1023972 0 2023-12-06T15:00:33.293 INFO:tasks.workunit.client.1.smithi190.stdout:3/896: rmdir d4/d1b/d54/d9c/dea 0 2023-12-06T15:00:33.294 INFO:tasks.workunit.client.0.smithi152.stdout:6/795: dwrite d1/dcf/ddc/d1a/d30/d18/f103 [0,4194304] 0 2023-12-06T15:00:33.294 INFO:tasks.workunit.client.0.smithi152.stdout:0/564: dwrite d8/f67 [12582912,4194304] 0 2023-12-06T15:00:33.294 INFO:tasks.workunit.client.0.smithi152.stdout:6/796: write d1/d89/f102 [676308,128324] 0 2023-12-06T15:00:33.294 INFO:tasks.workunit.client.1.smithi190.stdout:3/897: read d4/fa5 [1353870,89231] 0 2023-12-06T15:00:33.295 INFO:tasks.workunit.client.1.smithi190.stdout:7/980: fsync d0/df/d53/d99/ddb/f136 0 2023-12-06T15:00:33.295 INFO:tasks.workunit.client.0.smithi152.stdout:0/565: write d8/d3e/f43 [2026034,28139] 0 2023-12-06T15:00:33.296 INFO:tasks.workunit.client.1.smithi190.stdout:7/981: dread d0/d88/d41/d92/faf [0,4194304] 0 2023-12-06T15:00:33.296 INFO:tasks.workunit.client.0.smithi152.stdout:1/851: unlink d3/fd 0 2023-12-06T15:00:33.296 INFO:tasks.workunit.client.0.smithi152.stdout:6/797: write d1/dcf/ddc/d1a/f4a [2959375,125368] 0 2023-12-06T15:00:33.299 INFO:tasks.workunit.client.1.smithi190.stdout:2/838: rename d10/d59/dcd/dad/dc4/d7f/d8e/dee to d10/d59/d118 0 2023-12-06T15:00:33.299 INFO:tasks.workunit.client.1.smithi190.stdout:2/839: write d10/d26/d5c/d35/f82 [1113073,87513] 0 2023-12-06T15:00:33.301 INFO:tasks.workunit.client.0.smithi152.stdout:0/566: dread d8/ff [0,4194304] 0 2023-12-06T15:00:33.301 INFO:tasks.workunit.client.0.smithi152.stdout:1/852: write d3/da/db/f11 [2540795,24411] 0 2023-12-06T15:00:33.301 INFO:tasks.workunit.client.1.smithi190.stdout:8/845: creat d1/d20/d3b/d7e/f103 x:0 0 0 2023-12-06T15:00:33.307 INFO:tasks.workunit.client.1.smithi190.stdout:3/898: mknod d4/d70/d19/d3a/d3b/d72/c13c 0 2023-12-06T15:00:33.312 INFO:tasks.workunit.client.1.smithi190.stdout:3/899: write d4/d70/d33/d45/f98 [3538207,91356] 0 2023-12-06T15:00:33.312 INFO:tasks.workunit.client.1.smithi190.stdout:3/900: chown d4/d1b/d54/d9c/d68/dfc/d56/d122 35 1 2023-12-06T15:00:33.313 INFO:tasks.workunit.client.1.smithi190.stdout:2/840: mknod d10/d59/dcd/dad/d10a/c119 0 2023-12-06T15:00:33.314 INFO:tasks.workunit.client.0.smithi152.stdout:6/798: mknod d1/dcf/ddc/d1a/d30/daa/c116 0 2023-12-06T15:00:33.316 INFO:tasks.workunit.client.1.smithi190.stdout:5/795: rename d0/d96 to d0/d1c/d2b/d2c/d5d/d73/d116 0 2023-12-06T15:00:33.317 INFO:tasks.workunit.client.0.smithi152.stdout:1/853: dread d3/da/d15/f3f [0,4194304] 0 2023-12-06T15:00:33.319 INFO:tasks.workunit.client.1.smithi190.stdout:3/901: creat d4/d70/d33/f13d x:0 0 0 2023-12-06T15:00:33.320 INFO:tasks.workunit.client.1.smithi190.stdout:3/902: chown d4/d70/d33/d10e 110883446 1 2023-12-06T15:00:33.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:32 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:33.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:32 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:33.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:32 smithi190 ceph-mon[121340]: Reconfiguring node-exporter.smithi190 (dependencies changed)... 2023-12-06T15:00:33.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:32 smithi190 ceph-mon[121340]: Reconfiguring daemon node-exporter.smithi190 on smithi190 2023-12-06T15:00:33.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:32 smithi190 ceph-mon[121340]: pgmap v28: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 149 MiB/s rd, 302 MiB/s wr, 483 op/s 2023-12-06T15:00:33.325 INFO:tasks.workunit.client.1.smithi190.stdout:2/841: rename d10/d26/d5c/d49/d54/c97 to d10/d59/dcd/dad/dc4/c11a 0 2023-12-06T15:00:33.326 INFO:tasks.workunit.client.0.smithi152.stdout:5/666: creat d7/d43/fe9 x:0 0 0 2023-12-06T15:00:33.326 INFO:tasks.workunit.client.0.smithi152.stdout:7/463: dwrite dd/df/d1b/d20/d28/d53/f64 [0,4194304] 0 2023-12-06T15:00:33.330 INFO:tasks.workunit.client.1.smithi190.stdout:5/796: creat d0/d6c/dcd/f117 x:0 0 0 2023-12-06T15:00:33.330 INFO:tasks.workunit.client.1.smithi190.stdout:7/982: dwrite d0/d88/d33/fc2 [4194304,4194304] 0 2023-12-06T15:00:33.331 INFO:tasks.workunit.client.1.smithi190.stdout:7/983: read d0/ffe [189516,90780] 0 2023-12-06T15:00:33.332 INFO:tasks.workunit.client.1.smithi190.stdout:2/842: write d10/d59/d5e/f13 [3167932,25676] 0 2023-12-06T15:00:33.333 INFO:tasks.workunit.client.1.smithi190.stdout:2/843: dread - d10/d59/dcd/dad/fb9 zero size 2023-12-06T15:00:33.333 INFO:tasks.workunit.client.0.smithi152.stdout:5/667: write d7/d43/f4b [1047665,65983] 0 2023-12-06T15:00:33.333 INFO:tasks.workunit.client.0.smithi152.stdout:5/668: chown d7/dd/l5d 30342865 1 2023-12-06T15:00:33.333 INFO:tasks.workunit.client.0.smithi152.stdout:5/669: chown d7/d43/d6c/dde 5956525 1 2023-12-06T15:00:33.333 INFO:tasks.workunit.client.0.smithi152.stdout:7/464: symlink dd/df/d1b/d4e/l92 0 2023-12-06T15:00:33.334 INFO:tasks.workunit.client.1.smithi190.stdout:5/797: mkdir d0/d1c/d2b/d2c/d5d/d73/d118 0 2023-12-06T15:00:33.336 INFO:tasks.workunit.client.1.smithi190.stdout:2/844: dread d10/d26/d5c/d8d/faa [0,4194304] 0 2023-12-06T15:00:33.336 INFO:tasks.workunit.client.1.smithi190.stdout:2/845: truncate d10/d59/dcd/dad/dc9/f10f 217108 0 2023-12-06T15:00:33.342 INFO:tasks.workunit.client.0.smithi152.stdout:5/670: creat d7/d43/d9c/fea x:0 0 0 2023-12-06T15:00:33.342 INFO:tasks.workunit.client.0.smithi152.stdout:5/671: dread - d7/dd/d26/d3b/d46/dc9/fdb zero size 2023-12-06T15:00:33.342 INFO:tasks.workunit.client.1.smithi190.stdout:8/846: dwrite d1/d37/fdb [0,4194304] 0 2023-12-06T15:00:33.342 INFO:tasks.workunit.client.1.smithi190.stdout:2/846: symlink d10/d59/dcd/dad/dc4/d76/l11b 0 2023-12-06T15:00:33.343 INFO:tasks.workunit.client.1.smithi190.stdout:2/847: chown d10/d59/dcd/dad/fbf 2561 1 2023-12-06T15:00:33.343 INFO:tasks.workunit.client.1.smithi190.stdout:2/848: fdatasync d10/d59/dcd/dad/dc4/d7f/d8e/fa2 0 2023-12-06T15:00:33.344 INFO:tasks.workunit.client.0.smithi152.stdout:5/672: rmdir d7/d43/d6c/d98/de0 0 2023-12-06T15:00:33.345 INFO:tasks.workunit.client.1.smithi190.stdout:8/847: creat d1/d20/d3b/d4c/d8e/d94/d25/f104 x:0 0 0 2023-12-06T15:00:33.345 INFO:tasks.workunit.client.1.smithi190.stdout:8/848: fsync d1/d20/d3b/d4c/d8e/d94/d1c/f4e 0 2023-12-06T15:00:33.345 INFO:tasks.workunit.client.1.smithi190.stdout:8/849: stat d1/d20/d3b/d31/d87/da1 0 2023-12-06T15:00:33.347 INFO:tasks.workunit.client.0.smithi152.stdout:0/567: creat d8/d15/d45/d73/fbb x:0 0 0 2023-12-06T15:00:33.347 INFO:tasks.workunit.client.1.smithi190.stdout:2/849: mknod d10/d59/dcd/dad/d116/c11c 0 2023-12-06T15:00:33.349 INFO:tasks.workunit.client.0.smithi152.stdout:0/568: creat d8/d15/d45/da4/fbc x:0 0 0 2023-12-06T15:00:33.349 INFO:tasks.workunit.client.0.smithi152.stdout:0/569: dread d8/d44/f5a [0,4194304] 0 2023-12-06T15:00:33.349 INFO:tasks.workunit.client.1.smithi190.stdout:8/850: rename d1/d20/d3b/d34/dcb to d1/d20/d3b/d36/d105 0 2023-12-06T15:00:33.352 INFO:tasks.workunit.client.1.smithi190.stdout:8/851: read d1/d20/d3b/d7e/dd0/f9c [55711,51383] 0 2023-12-06T15:00:33.352 INFO:tasks.workunit.client.1.smithi190.stdout:8/852: write d1/d20/d3b/d34/f38 [499828,111535] 0 2023-12-06T15:00:33.353 INFO:tasks.workunit.client.0.smithi152.stdout:9/556: rename d0/d3f/d68/d6c/d20/d38/d45/d43 to d0/d3f/d5f/d60/da1 0 2023-12-06T15:00:33.354 INFO:tasks.workunit.client.0.smithi152.stdout:2/539: rename d6/db/fa5 to d6/d1e/d41/faf 0 2023-12-06T15:00:33.357 INFO:tasks.workunit.client.0.smithi152.stdout:5/673: rename d7/dd/d26/d3b/d46/d7e/c80 to d7/dd/ceb 0 2023-12-06T15:00:33.358 INFO:tasks.workunit.client.0.smithi152.stdout:6/799: dwrite d1/dcf/ddc/d1a/d30/d36/d35/d49/d57/f99 [0,4194304] 0 2023-12-06T15:00:33.362 INFO:tasks.workunit.client.1.smithi190.stdout:2/850: dread d10/d59/d5e/f16 [0,4194304] 0 2023-12-06T15:00:33.364 INFO:tasks.workunit.client.1.smithi190.stdout:7/984: dwrite d0/d88/d33/d4c/f105 [0,4194304] 0 2023-12-06T15:00:33.364 INFO:tasks.workunit.client.0.smithi152.stdout:5/674: mknod d7/d43/d6c/cec 0 2023-12-06T15:00:33.365 INFO:tasks.workunit.client.1.smithi190.stdout:2/851: unlink d10/d59/dcd/dad/df6/f104 0 2023-12-06T15:00:33.365 INFO:tasks.workunit.client.0.smithi152.stdout:1/854: dwrite d3/da/d4c/d82/d52/d55/ff9 [0,4194304] 0 2023-12-06T15:00:33.365 INFO:tasks.workunit.client.0.smithi152.stdout:1/855: read - d3/da/d4c/d82/d52/d62/fc6 zero size 2023-12-06T15:00:33.366 INFO:tasks.workunit.client.0.smithi152.stdout:9/557: write d0/f30 [3295576,55968] 0 2023-12-06T15:00:33.366 INFO:tasks.workunit.client.0.smithi152.stdout:9/558: readlink d0/l8e 0 2023-12-06T15:00:33.366 INFO:tasks.workunit.client.0.smithi152.stdout:9/559: readlink d0/d3f/d68/d6c/d20/d38/l47 0 2023-12-06T15:00:33.366 INFO:tasks.workunit.client.0.smithi152.stdout:9/560: fdatasync d0/d3f/d68/d6c/d20/f51 0 2023-12-06T15:00:33.367 INFO:tasks.workunit.client.1.smithi190.stdout:5/798: dwrite d0/df/d50/fa4 [0,4194304] 0 2023-12-06T15:00:33.367 INFO:tasks.workunit.client.1.smithi190.stdout:3/903: dwrite d4/d1b/d54/d9c/d68/d8a/fe4 [0,4194304] 0 2023-12-06T15:00:33.371 INFO:tasks.workunit.client.0.smithi152.stdout:6/800: write d1/d89/ff8 [1944072,127845] 0 2023-12-06T15:00:33.371 INFO:tasks.workunit.client.0.smithi152.stdout:6/801: dread - d1/dcf/ddc/d1a/d30/da4/fe7 zero size 2023-12-06T15:00:33.371 INFO:tasks.workunit.client.0.smithi152.stdout:1/856: mkdir d3/da/d4c/d85/d134 0 2023-12-06T15:00:33.371 INFO:tasks.workunit.client.1.smithi190.stdout:7/985: dread d0/d88/d1c/f23 [0,4194304] 0 2023-12-06T15:00:33.373 INFO:tasks.workunit.client.0.smithi152.stdout:9/561: creat d0/d3f/d68/d6c/d20/d38/d48/d90/fa2 x:0 0 0 2023-12-06T15:00:33.374 INFO:tasks.workunit.client.1.smithi190.stdout:5/799: getdents d0/d1c/d85/d90/dba 0 2023-12-06T15:00:33.375 INFO:tasks.workunit.client.0.smithi152.stdout:1/857: read d3/da/d15/d17/d43/f9e [639263,99602] 0 2023-12-06T15:00:33.377 INFO:tasks.workunit.client.1.smithi190.stdout:5/800: dread d0/d1c/d2b/d2c/d5d/d73/fb1 [0,4194304] 0 2023-12-06T15:00:33.377 INFO:tasks.workunit.client.1.smithi190.stdout:5/801: truncate d0/df/d50/d9c/fef 279068 0 2023-12-06T15:00:33.377 INFO:tasks.workunit.client.1.smithi190.stdout:7/986: unlink d0/ffe 0 2023-12-06T15:00:33.377 INFO:tasks.workunit.client.1.smithi190.stdout:2/852: symlink d10/d26/d5c/d42/dfd/l11d 0 2023-12-06T15:00:33.377 INFO:tasks.workunit.client.1.smithi190.stdout:2/853: dread - d10/d26/d5c/d35/d77/fa3 zero size 2023-12-06T15:00:33.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:32 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:33.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:32 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:33.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:32 smithi152 ceph-mon[111954]: Reconfiguring node-exporter.smithi190 (dependencies changed)... 2023-12-06T15:00:33.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:32 smithi152 ceph-mon[111954]: Reconfiguring daemon node-exporter.smithi190 on smithi190 2023-12-06T15:00:33.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:32 smithi152 ceph-mon[111954]: pgmap v28: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 149 MiB/s rd, 302 MiB/s wr, 483 op/s 2023-12-06T15:00:33.379 INFO:tasks.workunit.client.1.smithi190.stdout:5/802: creat d0/d1c/d3e/dfd/f119 x:0 0 0 2023-12-06T15:00:33.379 INFO:tasks.workunit.client.1.smithi190.stdout:5/803: dread - d0/d1c/d3e/ffc zero size 2023-12-06T15:00:33.380 INFO:tasks.workunit.client.0.smithi152.stdout:6/802: link d1/d1c/cb3 d1/dcf/ddc/d1a/d30/d36/d4e/d55/c117 0 2023-12-06T15:00:33.381 INFO:tasks.workunit.client.0.smithi152.stdout:9/562: creat d0/d3f/d5f/fa3 x:0 0 0 2023-12-06T15:00:33.381 INFO:tasks.workunit.client.1.smithi190.stdout:2/854: stat d10/c56 0 2023-12-06T15:00:33.383 INFO:tasks.workunit.client.1.smithi190.stdout:5/804: dread d0/d1c/d2b/fc2 [0,4194304] 0 2023-12-06T15:00:33.383 INFO:tasks.workunit.client.1.smithi190.stdout:5/805: getdents d0/d1c/d85/d90/dba 0 2023-12-06T15:00:33.383 INFO:tasks.workunit.client.1.smithi190.stdout:5/806: fsync d0/d6c/dcd/f117 0 2023-12-06T15:00:33.383 INFO:tasks.workunit.client.0.smithi152.stdout:2/540: unlink d6/d18/c90 0 2023-12-06T15:00:33.383 INFO:tasks.workunit.client.0.smithi152.stdout:2/541: write d6/db/f8a [104380,94745] 0 2023-12-06T15:00:33.384 INFO:tasks.workunit.client.0.smithi152.stdout:1/858: creat d3/da/d15/d17/d58/da3/f135 x:0 0 0 2023-12-06T15:00:33.385 INFO:tasks.workunit.client.0.smithi152.stdout:9/563: symlink d0/d3f/d5f/d60/da1/la4 0 2023-12-06T15:00:33.387 INFO:tasks.workunit.client.0.smithi152.stdout:2/542: rename d6/d18/l69 to d6/d1e/d7a/lb0 0 2023-12-06T15:00:33.387 INFO:tasks.workunit.client.0.smithi152.stdout:2/543: chown d6/d18/d43/l73 47748427 1 2023-12-06T15:00:33.389 INFO:tasks.workunit.client.1.smithi190.stdout:5/807: write d0/d1c/d3e/f60 [3394677,105097] 0 2023-12-06T15:00:33.390 INFO:tasks.workunit.client.0.smithi152.stdout:1/859: unlink d3/da/d15/d17/d43/de6/l131 0 2023-12-06T15:00:33.390 INFO:tasks.workunit.client.0.smithi152.stdout:2/544: truncate d6/d18/f32 1092933 0 2023-12-06T15:00:33.390 INFO:tasks.workunit.client.0.smithi152.stdout:2/545: chown d6/d1e/d41/c7c 1633283 1 2023-12-06T15:00:33.390 INFO:tasks.workunit.client.0.smithi152.stdout:5/675: dwrite d7/f1f [4194304,4194304] 0 2023-12-06T15:00:33.391 INFO:tasks.workunit.client.1.smithi190.stdout:8/853: dwrite d1/d20/d3b/d4c/d8e/d94/f5e [0,4194304] 0 2023-12-06T15:00:33.391 INFO:tasks.workunit.client.1.smithi190.stdout:5/808: unlink d0/df/d50/l5c 0 2023-12-06T15:00:33.391 INFO:tasks.workunit.client.1.smithi190.stdout:5/809: chown d0/d1c/d2b/fb8 58 1 2023-12-06T15:00:33.393 INFO:tasks.workunit.client.1.smithi190.stdout:5/810: dread d0/df/f38 [0,4194304] 0 2023-12-06T15:00:33.394 INFO:tasks.workunit.client.1.smithi190.stdout:8/854: write d1/d20/d3b/d4c/d8e/d94/f78 [1243169,30032] 0 2023-12-06T15:00:33.394 INFO:tasks.workunit.client.1.smithi190.stdout:8/855: chown d1/d20/d3b/d36/f68 6 1 2023-12-06T15:00:33.394 INFO:tasks.workunit.client.1.smithi190.stdout:8/856: readlink d1/d20/d3b/d4c/d8e/d94/db6/lf0 0 2023-12-06T15:00:33.394 INFO:tasks.workunit.client.1.smithi190.stdout:8/857: read - d1/d20/d3b/d4c/d8e/d94/ff8 zero size 2023-12-06T15:00:33.397 INFO:tasks.workunit.client.0.smithi152.stdout:7/465: creat dd/df/d1b/f93 x:0 0 0 2023-12-06T15:00:33.401 INFO:tasks.workunit.client.1.smithi190.stdout:8/858: dread d1/d20/d3b/d4c/d8e/d94/d1c/de0/ff3 [0,4194304] 0 2023-12-06T15:00:33.402 INFO:tasks.workunit.client.0.smithi152.stdout:7/466: write dd/df/d1b/d20/d28/d53/f64 [2271639,95758] 0 2023-12-06T15:00:33.402 INFO:tasks.workunit.client.0.smithi152.stdout:7/467: truncate dd/df/d1b/f93 302030 0 2023-12-06T15:00:33.403 INFO:tasks.workunit.client.1.smithi190.stdout:8/859: creat d1/d20/d3b/d34/dbc/f106 x:0 0 0 2023-12-06T15:00:33.403 INFO:tasks.workunit.client.1.smithi190.stdout:8/860: chown d1/d20/d3b/d4c/d8e/d94/ff8 500 1 2023-12-06T15:00:33.404 INFO:tasks.workunit.client.1.smithi190.stdout:5/811: fdatasync d0/d1c/d94/fc4 0 2023-12-06T15:00:33.411 INFO:tasks.workunit.client.0.smithi152.stdout:6/803: dread d1/dcf/ddc/d8a/fc6 [0,4194304] 0 2023-12-06T15:00:33.420 INFO:tasks.workunit.client.0.smithi152.stdout:5/676: dwrite d7/d43/d9c/fea [0,4194304] 0 2023-12-06T15:00:33.420 INFO:tasks.workunit.client.0.smithi152.stdout:9/564: dwrite d0/d3f/d68/f6a [0,4194304] 0 2023-12-06T15:00:33.420 INFO:tasks.workunit.client.0.smithi152.stdout:1/860: dwrite d3/da/d4c/d82/d52/d62/dcc/fe1 [0,4194304] 0 2023-12-06T15:00:33.423 INFO:tasks.workunit.client.0.smithi152.stdout:9/565: getdents d0/d3f/d5f/d60 0 2023-12-06T15:00:33.431 INFO:tasks.workunit.client.0.smithi152.stdout:6/804: dwrite d1/dcf/ddc/d1a/f31 [4194304,4194304] 0 2023-12-06T15:00:33.525 INFO:tasks.workunit.client.0.smithi152.stdout:5/677: symlink d7/d43/d6c/d98/dc8/led 0 2023-12-06T15:00:33.529 INFO:tasks.workunit.client.0.smithi152.stdout:8/528: sync 2023-12-06T15:00:33.529 INFO:tasks.workunit.client.0.smithi152.stdout:3/602: sync 2023-12-06T15:00:33.529 INFO:tasks.workunit.client.0.smithi152.stdout:3/603: stat d9/d10/l63 0 2023-12-06T15:00:33.529 INFO:tasks.workunit.client.0.smithi152.stdout:4/879: sync 2023-12-06T15:00:33.529 INFO:tasks.workunit.client.0.smithi152.stdout:1/861: creat d3/da/db/d54/f136 x:0 0 0 2023-12-06T15:00:33.530 INFO:tasks.workunit.client.0.smithi152.stdout:7/468: truncate dd/df/d1b/f93 73349 0 2023-12-06T15:00:33.530 INFO:tasks.workunit.client.0.smithi152.stdout:7/469: stat dd/df/f2c 0 2023-12-06T15:00:33.532 INFO:tasks.workunit.client.0.smithi152.stdout:2/546: write d6/d18/f32 [890219,91704] 0 2023-12-06T15:00:33.532 INFO:tasks.workunit.client.0.smithi152.stdout:2/547: chown d6/d1e/d41/c7c 14174 1 2023-12-06T15:00:33.532 INFO:tasks.workunit.client.0.smithi152.stdout:9/566: symlink d0/d3f/d68/d6c/d92/d9e/la5 0 2023-12-06T15:00:33.534 INFO:tasks.workunit.client.0.smithi152.stdout:5/678: dread d7/dd/d26/fae [0,4194304] 0 2023-12-06T15:00:33.534 INFO:tasks.workunit.client.0.smithi152.stdout:5/679: readlink d7/dd/d26/d48/l60 0 2023-12-06T15:00:33.534 INFO:tasks.workunit.client.0.smithi152.stdout:5/680: truncate d7/dd/d26/f2e 4979406 0 2023-12-06T15:00:33.538 INFO:tasks.workunit.client.0.smithi152.stdout:6/805: rename d1/d69/da1/d87/d15/f5c to d1/d75/d105/f118 0 2023-12-06T15:00:33.538 INFO:tasks.workunit.client.0.smithi152.stdout:4/880: mkdir d2/d15/d32/d91/d11e 0 2023-12-06T15:00:33.538 INFO:tasks.workunit.client.0.smithi152.stdout:1/862: symlink d3/d44/d84/de2/l137 0 2023-12-06T15:00:33.538 INFO:tasks.workunit.client.0.smithi152.stdout:7/470: unlink dd/d17/c1e 0 2023-12-06T15:00:33.538 INFO:tasks.workunit.client.0.smithi152.stdout:9/567: creat d0/d3f/d68/d6c/d20/d4a/d4d/fa6 x:0 0 0 2023-12-06T15:00:33.538 INFO:tasks.workunit.client.0.smithi152.stdout:1/863: chown d3/da/d4c/d63/d96/dd8/f10b 11745 1 2023-12-06T15:00:33.539 INFO:tasks.workunit.client.0.smithi152.stdout:5/681: truncate d7/dd/d26/d3a/f6b 207219 0 2023-12-06T15:00:33.541 INFO:tasks.workunit.client.0.smithi152.stdout:7/471: unlink fa 0 2023-12-06T15:00:33.541 INFO:tasks.workunit.client.0.smithi152.stdout:7/472: truncate dd/df/d34/d44/d49/f71 2003691 0 2023-12-06T15:00:33.542 INFO:tasks.workunit.client.0.smithi152.stdout:7/473: write dd/df/d1b/d20/d28/d38/f39 [184355,2493] 0 2023-12-06T15:00:33.542 INFO:tasks.workunit.client.0.smithi152.stdout:4/881: mknod d2/d89/df9/c11f 0 2023-12-06T15:00:33.542 INFO:tasks.workunit.client.0.smithi152.stdout:4/882: chown d2/c97 198624920 1 2023-12-06T15:00:33.546 INFO:tasks.workunit.client.0.smithi152.stdout:4/883: getdents d2/d10/dbb/dca/dbc/d42/d108 0 2023-12-06T15:00:33.547 INFO:tasks.workunit.client.0.smithi152.stdout:5/682: mknod d7/d43/d6c/d98/dc8/cee 0 2023-12-06T15:00:33.547 INFO:tasks.workunit.client.0.smithi152.stdout:7/474: mknod dd/df/d1b/d20/d28/c94 0 2023-12-06T15:00:33.547 INFO:tasks.workunit.client.0.smithi152.stdout:1/864: mknod d3/da/d15/c138 0 2023-12-06T15:00:33.547 INFO:tasks.workunit.client.0.smithi152.stdout:1/865: write d3/da/d15/d17/d1a/fa1 [1383109,19135] 0 2023-12-06T15:00:33.547 INFO:tasks.workunit.client.0.smithi152.stdout:7/475: mkdir dd/df/d34/d95 0 2023-12-06T15:00:33.547 INFO:tasks.workunit.client.0.smithi152.stdout:7/476: chown dd/df/d1b/d20/d28/d53/l6b 76297 1 2023-12-06T15:00:33.547 INFO:tasks.workunit.client.0.smithi152.stdout:7/477: dread - dd/df/d1b/d20/d28/f3e zero size 2023-12-06T15:00:33.548 INFO:tasks.workunit.client.0.smithi152.stdout:1/866: rename d3/d44/d84/fdb to d3/da/d15/d17/d58/da3/f139 0 2023-12-06T15:00:33.552 INFO:tasks.workunit.client.0.smithi152.stdout:5/683: write d7/d43/f8e [3816183,44027] 0 2023-12-06T15:00:33.555 INFO:tasks.workunit.client.0.smithi152.stdout:5/684: creat d7/fef x:0 0 0 2023-12-06T15:00:33.555 INFO:tasks.workunit.client.0.smithi152.stdout:8/529: dwrite d1/d6/d29/d5b/f62 [4194304,4194304] 0 2023-12-06T15:00:33.555 INFO:tasks.workunit.client.0.smithi152.stdout:9/568: dread d0/f5 [0,4194304] 0 2023-12-06T15:00:33.557 INFO:tasks.workunit.client.0.smithi152.stdout:8/530: creat d1/d6/d34/d6f/fab x:0 0 0 2023-12-06T15:00:33.557 INFO:tasks.workunit.client.0.smithi152.stdout:8/531: write d1/d6/d34/d3a/f48 [2465584,63494] 0 2023-12-06T15:00:33.561 INFO:tasks.workunit.client.0.smithi152.stdout:5/685: dread d7/d43/d6c/d98/fa8 [0,4194304] 0 2023-12-06T15:00:33.563 INFO:tasks.workunit.client.0.smithi152.stdout:1/867: dread d3/da/d4c/d63/f116 [0,4194304] 0 2023-12-06T15:00:33.563 INFO:tasks.workunit.client.0.smithi152.stdout:5/686: symlink d7/d43/d9c/lf0 0 2023-12-06T15:00:33.563 INFO:tasks.workunit.client.0.smithi152.stdout:1/868: chown d3/da/db/f2c 2015008 1 2023-12-06T15:00:33.563 INFO:tasks.workunit.client.0.smithi152.stdout:1/869: write d3/da/d4c/d63/d96/ff1 [833767,47771] 0 2023-12-06T15:00:33.563 INFO:tasks.workunit.client.0.smithi152.stdout:2/548: dwrite d6/d1e/d41/d55/f89 [0,4194304] 0 2023-12-06T15:00:33.566 INFO:tasks.workunit.client.0.smithi152.stdout:5/687: rename d7/d43/d6c/d98/f9f to d7/dd/d26/d3a/ff1 0 2023-12-06T15:00:33.567 INFO:tasks.workunit.client.0.smithi152.stdout:1/870: creat d3/d10a/d112/f13a x:0 0 0 2023-12-06T15:00:33.567 INFO:tasks.workunit.client.0.smithi152.stdout:1/871: fsync d3/da/d15/d17/f60 0 2023-12-06T15:00:33.567 INFO:tasks.workunit.client.0.smithi152.stdout:1/872: chown d3/da/d4c/d63/d96/dd8 148675134 1 2023-12-06T15:00:33.567 INFO:tasks.workunit.client.0.smithi152.stdout:1/873: fdatasync d3/d44/f109 0 2023-12-06T15:00:33.572 INFO:tasks.workunit.client.0.smithi152.stdout:1/874: symlink d3/da/d15/dac/l13b 0 2023-12-06T15:00:33.572 INFO:tasks.workunit.client.0.smithi152.stdout:1/875: fdatasync d3/da/d15/d17/d58/f64 0 2023-12-06T15:00:33.572 INFO:tasks.workunit.client.0.smithi152.stdout:1/876: truncate d3/d44/d84/fe3 367738 0 2023-12-06T15:00:33.572 INFO:tasks.workunit.client.0.smithi152.stdout:1/877: fdatasync d3/da/d4c/d85/f104 0 2023-12-06T15:00:33.574 INFO:tasks.workunit.client.0.smithi152.stdout:1/878: rename d3/da/d15/d17/d4d/cbb to d3/da/d15/d17/c13c 0 2023-12-06T15:00:33.574 INFO:tasks.workunit.client.0.smithi152.stdout:1/879: truncate d3/da/d4c/ffb 4307680 0 2023-12-06T15:00:33.575 INFO:tasks.workunit.client.0.smithi152.stdout:1/880: stat d3/da/c8c 0 2023-12-06T15:00:33.575 INFO:tasks.workunit.client.0.smithi152.stdout:4/884: dwrite d2/d15/d32/d69/d6f/d10b/f59 [0,4194304] 0 2023-12-06T15:00:33.575 INFO:tasks.workunit.client.0.smithi152.stdout:9/569: dread d0/f8 [0,4194304] 0 2023-12-06T15:00:33.575 INFO:tasks.workunit.client.0.smithi152.stdout:4/885: write d2/d15/d32/d69/d6f/d10b/d6e/da8/fe8 [277900,120651] 0 2023-12-06T15:00:33.575 INFO:tasks.workunit.client.0.smithi152.stdout:9/570: read d0/d3f/d68/d6c/d20/d4a/d4d/d69/f7a [124506,83186] 0 2023-12-06T15:00:33.575 INFO:tasks.workunit.client.0.smithi152.stdout:9/571: dread - d0/d3f/f78 zero size 2023-12-06T15:00:33.576 INFO:tasks.workunit.client.0.smithi152.stdout:1/881: truncate d3/da/d15/f5e 3848001 0 2023-12-06T15:00:33.576 INFO:tasks.workunit.client.0.smithi152.stdout:2/549: dread d6/db/d17/f75 [0,4194304] 0 2023-12-06T15:00:33.577 INFO:tasks.workunit.client.0.smithi152.stdout:4/886: symlink d2/d10/dab/dd9/l120 0 2023-12-06T15:00:33.578 INFO:tasks.workunit.client.0.smithi152.stdout:9/572: mknod d0/d3f/d68/d6c/d20/d38/d48/d90/ca7 0 2023-12-06T15:00:33.580 INFO:tasks.workunit.client.0.smithi152.stdout:1/882: rmdir d3/da/db/da0 39 2023-12-06T15:00:33.580 INFO:tasks.workunit.client.0.smithi152.stdout:1/883: truncate d3/da/d4c/d82/d52/d62/d11b/f125 363439 0 2023-12-06T15:00:33.581 INFO:tasks.workunit.client.0.smithi152.stdout:4/887: mknod d2/d15/d32/d79/dcc/c121 0 2023-12-06T15:00:33.582 INFO:tasks.workunit.client.0.smithi152.stdout:9/573: mkdir d0/d3f/d68/d6c/d20/d38/da8 0 2023-12-06T15:00:33.582 INFO:tasks.workunit.client.0.smithi152.stdout:9/574: stat d0/d3f/d68/d6c/d20/d38/d48/f70 0 2023-12-06T15:00:33.583 INFO:tasks.workunit.client.0.smithi152.stdout:1/884: write d3/da/db/d54/f92 [891946,126017] 0 2023-12-06T15:00:33.585 INFO:tasks.workunit.client.0.smithi152.stdout:4/888: creat d2/d15/d32/d69/d6f/f122 x:0 0 0 2023-12-06T15:00:33.586 INFO:tasks.workunit.client.0.smithi152.stdout:9/575: mkdir d0/d3f/d5f/d60/da9 0 2023-12-06T15:00:33.586 INFO:tasks.workunit.client.0.smithi152.stdout:8/532: dwrite d1/f77 [0,4194304] 0 2023-12-06T15:00:33.589 INFO:tasks.workunit.client.0.smithi152.stdout:9/576: write d0/f6 [1607336,67982] 0 2023-12-06T15:00:33.591 INFO:tasks.workunit.client.0.smithi152.stdout:8/533: getdents d1/d6/d34/d35 0 2023-12-06T15:00:33.591 INFO:tasks.workunit.client.0.smithi152.stdout:8/534: fdatasync d1/f77 0 2023-12-06T15:00:33.592 INFO:tasks.workunit.client.0.smithi152.stdout:9/577: mknod d0/d3f/d5f/d86/caa 0 2023-12-06T15:00:33.593 INFO:tasks.workunit.client.0.smithi152.stdout:9/578: dread - d0/d3f/d68/d6c/d20/d38/d44/f8a zero size 2023-12-06T15:00:33.593 INFO:tasks.workunit.client.0.smithi152.stdout:9/579: chown d0/d3f/d68/d6c/d20/d38/d44/f58 101810 1 2023-12-06T15:00:33.594 INFO:tasks.workunit.client.0.smithi152.stdout:5/688: dwrite d7/dd/d26/d3b/d46/d7e/fce [0,4194304] 0 2023-12-06T15:00:33.599 INFO:tasks.workunit.client.0.smithi152.stdout:5/689: mknod d7/dd/d26/d3b/cf2 0 2023-12-06T15:00:33.599 INFO:tasks.workunit.client.0.smithi152.stdout:5/690: chown d7/dd/d26/d3b/d46/f76 96262988 1 2023-12-06T15:00:33.599 INFO:tasks.workunit.client.0.smithi152.stdout:5/691: read d7/dd/d4e/f73 [274352,80577] 0 2023-12-06T15:00:33.599 INFO:tasks.workunit.client.0.smithi152.stdout:5/692: fsync d7/dd/d26/d48/f85 0 2023-12-06T15:00:33.602 INFO:tasks.workunit.client.0.smithi152.stdout:5/693: symlink d7/d43/d6c/d98/dc8/lf3 0 2023-12-06T15:00:33.605 INFO:tasks.workunit.client.0.smithi152.stdout:5/694: mknod d7/d43/d6c/d98/cf4 0 2023-12-06T15:00:33.606 INFO:tasks.workunit.client.0.smithi152.stdout:8/535: dread d1/d6/d34/d36/f26 [0,4194304] 0 2023-12-06T15:00:33.606 INFO:tasks.workunit.client.0.smithi152.stdout:8/536: readlink d1/l20 0 2023-12-06T15:00:33.606 INFO:tasks.workunit.client.0.smithi152.stdout:5/695: unlink d7/dd/d26/f2e 0 2023-12-06T15:00:33.609 INFO:tasks.workunit.client.0.smithi152.stdout:5/696: truncate d7/d47/fa0 1878784 0 2023-12-06T15:00:33.609 INFO:tasks.workunit.client.0.smithi152.stdout:5/697: chown d7/f24 1 1 2023-12-06T15:00:33.610 INFO:tasks.workunit.client.0.smithi152.stdout:5/698: creat d7/dd/d26/d48/d97/ff5 x:0 0 0 2023-12-06T15:00:33.611 INFO:tasks.workunit.client.0.smithi152.stdout:5/699: write d7/dd/d26/d3b/f6e [334982,9780] 0 2023-12-06T15:00:33.615 INFO:tasks.workunit.client.0.smithi152.stdout:0/570: sync 2023-12-06T15:00:33.615 INFO:tasks.workunit.client.0.smithi152.stdout:0/571: stat d8/d3e/lb3 0 2023-12-06T15:00:33.615 INFO:tasks.workunit.client.0.smithi152.stdout:0/572: chown d8/d3e/f7e 2782314 1 2023-12-06T15:00:33.615 INFO:tasks.workunit.client.0.smithi152.stdout:0/573: fdatasync d8/f3f 0 2023-12-06T15:00:33.615 INFO:tasks.workunit.client.0.smithi152.stdout:0/574: chown d8/d3e/d87/f53 29 1 2023-12-06T15:00:33.615 INFO:tasks.workunit.client.0.smithi152.stdout:2/550: dwrite d6/db/faa [0,4194304] 0 2023-12-06T15:00:33.615 INFO:tasks.workunit.client.0.smithi152.stdout:2/551: write d6/d1e/d41/faf [957388,81841] 0 2023-12-06T15:00:33.615 INFO:tasks.workunit.client.0.smithi152.stdout:6/806: dwrite d1/dcf/ddc/d1a/d30/d36/f2e [0,4194304] 0 2023-12-06T15:00:33.615 INFO:tasks.workunit.client.0.smithi152.stdout:6/807: readlink d1/d69/da1/d87/d15/l4c 0 2023-12-06T15:00:33.615 INFO:tasks.workunit.client.0.smithi152.stdout:0/575: creat d8/d4b/fbd x:0 0 0 2023-12-06T15:00:33.616 INFO:tasks.workunit.client.0.smithi152.stdout:6/808: write d1/dcf/ddc/d1a/d30/daa/ff5 [2268991,8862] 0 2023-12-06T15:00:33.617 INFO:tasks.workunit.client.0.smithi152.stdout:8/537: dread d1/f77 [0,4194304] 0 2023-12-06T15:00:33.618 INFO:tasks.workunit.client.0.smithi152.stdout:6/809: link d1/d69/da1/f9e d1/dcf/ddc/d1a/d30/daa/d108/f119 0 2023-12-06T15:00:33.619 INFO:tasks.workunit.client.0.smithi152.stdout:1/885: dwrite d3/d44/f109 [0,4194304] 0 2023-12-06T15:00:33.619 INFO:tasks.workunit.client.0.smithi152.stdout:0/576: write d8/d15/f18 [3245708,97468] 0 2023-12-06T15:00:33.619 INFO:tasks.workunit.client.0.smithi152.stdout:0/577: chown d8/d15/f2e 1581941343 1 2023-12-06T15:00:33.619 INFO:tasks.workunit.client.0.smithi152.stdout:0/578: fsync d8/d15/d45/d73/fbb 0 2023-12-06T15:00:33.619 INFO:tasks.workunit.client.0.smithi152.stdout:0/579: truncate d8/d15/d45/da4/fbc 1048514 0 2023-12-06T15:00:33.619 INFO:tasks.workunit.client.0.smithi152.stdout:9/580: dwrite d0/d3f/d68/d6c/d20/d38/d45/f66 [0,4194304] 0 2023-12-06T15:00:33.622 INFO:tasks.workunit.client.0.smithi152.stdout:0/580: dread d8/d3e/d87/f59 [0,4194304] 0 2023-12-06T15:00:33.622 INFO:tasks.workunit.client.0.smithi152.stdout:6/810: write d1/d69/da1/d87/d15/f1d [304985,11829] 0 2023-12-06T15:00:33.624 INFO:tasks.workunit.client.0.smithi152.stdout:8/538: dread d1/d6/d34/d36/f26 [0,4194304] 0 2023-12-06T15:00:33.626 INFO:tasks.workunit.client.0.smithi152.stdout:0/581: creat d8/d15/d45/da2/fbe x:0 0 0 2023-12-06T15:00:33.628 INFO:tasks.workunit.client.0.smithi152.stdout:6/811: creat d1/dcf/ddc/d1a/d30/d36/d35/dd1/f11a x:0 0 0 2023-12-06T15:00:33.628 INFO:tasks.workunit.client.0.smithi152.stdout:6/812: fdatasync d1/dcf/ddc/d1a/d30/f22 0 2023-12-06T15:00:33.636 INFO:tasks.workunit.client.0.smithi152.stdout:9/581: dwrite d0/d3f/d68/d6c/d20/d4a/d4d/fa6 [0,4194304] 0 2023-12-06T15:00:33.636 INFO:tasks.workunit.client.0.smithi152.stdout:9/582: chown d0/d3f/d68/d6c/d20/d38/d48/d90/fa2 1682 1 2023-12-06T15:00:33.636 INFO:tasks.workunit.client.0.smithi152.stdout:9/583: truncate d0/d50/f93 299924 0 2023-12-06T15:00:33.637 INFO:tasks.workunit.client.0.smithi152.stdout:0/582: truncate d8/d3e/d87/f5f 926128 0 2023-12-06T15:00:33.637 INFO:tasks.workunit.client.0.smithi152.stdout:0/583: chown d8/d3e/l89 7349 1 2023-12-06T15:00:33.638 INFO:tasks.workunit.client.0.smithi152.stdout:6/813: mkdir d1/dcf/ddc/d1a/d30/d36/d4e/d11b 0 2023-12-06T15:00:33.642 INFO:tasks.workunit.client.0.smithi152.stdout:9/584: creat d0/d3f/d68/d6c/d20/d4a/d4d/d69/fab x:0 0 0 2023-12-06T15:00:33.642 INFO:tasks.workunit.client.0.smithi152.stdout:9/585: write d0/d3f/d68/d6c/d20/d4a/d4d/d69/f7a [1106325,128401] 0 2023-12-06T15:00:33.644 INFO:tasks.workunit.client.0.smithi152.stdout:5/700: fsync d7/d47/f78 0 2023-12-06T15:00:33.654 INFO:tasks.workunit.client.0.smithi152.stdout:0/584: dwrite d8/f17 [0,4194304] 0 2023-12-06T15:00:33.655 INFO:tasks.workunit.client.0.smithi152.stdout:0/585: read d8/d4b/f65 [4035536,123959] 0 2023-12-06T15:00:33.670 INFO:tasks.workunit.client.0.smithi152.stdout:5/701: dwrite d7/dd/d26/d48/d97/dc2/fe8 [0,4194304] 0 2023-12-06T15:00:33.671 INFO:tasks.workunit.client.0.smithi152.stdout:5/702: chown d7/d43/f8e 3 1 2023-12-06T15:00:33.671 INFO:tasks.workunit.client.0.smithi152.stdout:9/586: dwrite d0/d3f/d68/d6c/d20/d4a/d4d/f5e [4194304,4194304] 0 2023-12-06T15:00:33.682 INFO:tasks.workunit.client.0.smithi152.stdout:5/703: dwrite d7/dd/d26/d3b/fa1 [0,4194304] 0 2023-12-06T15:00:33.748 INFO:tasks.workunit.client.1.smithi190.stdout:4/805: sync 2023-12-06T15:00:33.749 INFO:tasks.workunit.client.1.smithi190.stdout:4/806: unlink d3/d35/da5/fb6 0 2023-12-06T15:00:33.749 INFO:tasks.workunit.client.1.smithi190.stdout:4/807: stat d3/d76/dc4/dc5/l56 0 2023-12-06T15:00:33.749 INFO:tasks.workunit.client.1.smithi190.stdout:4/808: readlink d3/d35/d19/d41/d44/l89 0 2023-12-06T15:00:33.750 INFO:tasks.workunit.client.1.smithi190.stdout:4/809: write d3/d76/dc4/dc5/d3c/d116/d15/f2f [1352767,111309] 0 2023-12-06T15:00:33.756 INFO:tasks.workunit.client.1.smithi190.stdout:4/810: dread d3/d35/d19/f59 [0,4194304] 0 2023-12-06T15:00:33.757 INFO:tasks.workunit.client.1.smithi190.stdout:4/811: mkdir d3/d76/d7c/d8a/ddf/d11c 0 2023-12-06T15:00:33.759 INFO:tasks.workunit.client.1.smithi190.stdout:4/812: rename d3/d76/dc4/dc5/daa to d3/d35/d19/d41/d44/d11d 0 2023-12-06T15:00:33.760 INFO:tasks.workunit.client.1.smithi190.stdout:4/813: truncate d3/d76/dc4/dc5/d3c/f5a 1789049 0 2023-12-06T15:00:33.760 INFO:tasks.workunit.client.1.smithi190.stdout:4/814: write d3/d76/dc4/dc5/d3c/d116/d39/f5c [1865140,107682] 0 2023-12-06T15:00:33.760 INFO:tasks.workunit.client.1.smithi190.stdout:4/815: fdatasync d3/d35/d19/d67/db5/dbe/f115 0 2023-12-06T15:00:33.761 INFO:tasks.workunit.client.1.smithi190.stdout:4/816: getdents d3/d4e 0 2023-12-06T15:00:33.762 INFO:tasks.workunit.client.1.smithi190.stdout:4/817: mknod d3/da4/dd0/d100/c11e 0 2023-12-06T15:00:33.764 INFO:tasks.workunit.client.1.smithi190.stdout:4/818: symlink d3/d35/d19/d41/d44/d11d/de4/l11f 0 2023-12-06T15:00:33.764 INFO:tasks.workunit.client.1.smithi190.stdout:4/819: write d3/d35/d19/f5e [4156466,43533] 0 2023-12-06T15:00:33.766 INFO:tasks.workunit.client.1.smithi190.stdout:4/820: unlink d3/d35/d19/d41/d44/fd8 0 2023-12-06T15:00:33.773 INFO:tasks.workunit.client.1.smithi190.stdout:4/821: link d3/d76/dc4/dc5/d3c/d116/d15/l2c d3/d35/d19/d41/d44/d5b/l120 0 2023-12-06T15:00:33.774 INFO:tasks.workunit.client.1.smithi190.stdout:4/822: creat d3/d35/d19/d41/d44/d9c/f121 x:0 0 0 2023-12-06T15:00:33.774 INFO:tasks.workunit.client.1.smithi190.stdout:4/823: mknod d3/d76/dc4/dc5/d3c/d116/d39/daf/c122 0 2023-12-06T15:00:33.776 INFO:tasks.workunit.client.1.smithi190.stdout:4/824: creat d3/da4/f123 x:0 0 0 2023-12-06T15:00:33.776 INFO:tasks.workunit.client.1.smithi190.stdout:4/825: truncate d3/da4/f123 795197 0 2023-12-06T15:00:33.776 INFO:tasks.workunit.client.1.smithi190.stdout:4/826: truncate d3/d76/d7c/d8a/ffe 236532 0 2023-12-06T15:00:33.777 INFO:tasks.workunit.client.1.smithi190.stdout:4/827: getdents d3/d35/da6 0 2023-12-06T15:00:33.777 INFO:tasks.workunit.client.1.smithi190.stdout:4/828: chown d3/l11 111026384 1 2023-12-06T15:00:33.778 INFO:tasks.workunit.client.1.smithi190.stdout:4/829: creat d3/d76/dc4/dc5/d3c/d116/d15/f124 x:0 0 0 2023-12-06T15:00:33.778 INFO:tasks.workunit.client.1.smithi190.stdout:4/830: write d3/d76/dc4/dc5/d3c/d116/d39/f5c [2322093,41619] 0 2023-12-06T15:00:33.784 INFO:tasks.workunit.client.1.smithi190.stdout:4/831: dread d3/f78 [0,4194304] 0 2023-12-06T15:00:33.784 INFO:tasks.workunit.client.1.smithi190.stdout:4/832: dread d3/d76/dc4/dc5/d3c/f4f [0,4194304] 0 2023-12-06T15:00:33.853 INFO:tasks.workunit.client.0.smithi152.stdout:6/814: mknod d1/dcf/ddc/d6d/c11c 0 2023-12-06T15:00:33.853 INFO:tasks.workunit.client.0.smithi152.stdout:6/815: stat d1/d69/da1/d87/f8f 0 2023-12-06T15:00:33.854 INFO:tasks.workunit.client.0.smithi152.stdout:0/586: symlink d8/d3e/d87/d76/d68/lbf 0 2023-12-06T15:00:33.858 INFO:tasks.workunit.client.0.smithi152.stdout:9/587: symlink d0/d3f/d68/d6c/d20/d38/d48/d90/lac 0 2023-12-06T15:00:33.859 INFO:tasks.workunit.client.0.smithi152.stdout:9/588: write d0/d3f/d68/d6c/d20/f3c [3791716,126774] 0 2023-12-06T15:00:33.860 INFO:tasks.workunit.client.0.smithi152.stdout:9/589: read d0/d3f/d68/d6c/d20/d38/f3d [2884895,23480] 0 2023-12-06T15:00:33.863 INFO:tasks.workunit.client.1.smithi190.stdout:4/833: dwrite d3/d76/dc4/dc5/d3c/d116/d39/fbd [0,4194304] 0 2023-12-06T15:00:33.864 INFO:tasks.workunit.client.0.smithi152.stdout:5/704: mkdir d7/dd/d26/df6 0 2023-12-06T15:00:33.870 INFO:tasks.workunit.client.0.smithi152.stdout:6/816: rename d1/dcf/ddc/d1a/d30/d36/d35/dd1/f10d to d1/dcf/ddc/d1a/d30/d36/d35/d63/d86/f11d 0 2023-12-06T15:00:33.870 INFO:tasks.workunit.client.0.smithi152.stdout:6/817: chown d1/dcf/ddc/d1a/d30/d18/c7a 1 1 2023-12-06T15:00:33.871 INFO:tasks.workunit.client.0.smithi152.stdout:5/705: getdents d7/dd/d26/d48 0 2023-12-06T15:00:33.876 INFO:tasks.workunit.client.0.smithi152.stdout:0/587: dread d8/d15/f33 [0,4194304] 0 2023-12-06T15:00:33.876 INFO:tasks.workunit.client.0.smithi152.stdout:3/604: sync 2023-12-06T15:00:33.878 INFO:tasks.workunit.client.0.smithi152.stdout:3/605: creat d9/d10/d12/d43/d52/db4/fbf x:0 0 0 2023-12-06T15:00:33.879 INFO:tasks.workunit.client.0.smithi152.stdout:3/606: read - d9/d10/d12/f72 zero size 2023-12-06T15:00:33.880 INFO:tasks.workunit.client.0.smithi152.stdout:9/590: dwrite d0/d3f/f78 [0,4194304] 0 2023-12-06T15:00:33.880 INFO:tasks.workunit.client.0.smithi152.stdout:9/591: write d0/d3f/d68/d6c/d20/d4a/d4d/d69/f7a [1309537,88626] 0 2023-12-06T15:00:33.883 INFO:tasks.workunit.client.0.smithi152.stdout:4/889: sync 2023-12-06T15:00:33.883 INFO:tasks.workunit.client.0.smithi152.stdout:7/478: sync 2023-12-06T15:00:33.883 INFO:tasks.workunit.client.0.smithi152.stdout:9/592: symlink d0/d3f/d68/d6c/d20/d38/d48/lad 0 2023-12-06T15:00:33.883 INFO:tasks.workunit.client.0.smithi152.stdout:9/593: truncate d0/d3f/d68/d6c/d20/d38/d48/d90/fa2 501012 0 2023-12-06T15:00:33.883 INFO:tasks.workunit.client.0.smithi152.stdout:9/594: truncate d0/d3f/d68/d6c/d20/f5a 1155382 0 2023-12-06T15:00:33.885 INFO:tasks.workunit.client.0.smithi152.stdout:4/890: truncate d2/d15/f62 486260 0 2023-12-06T15:00:33.885 INFO:tasks.workunit.client.0.smithi152.stdout:4/891: write d2/d15/f10e [487511,28847] 0 2023-12-06T15:00:33.885 INFO:tasks.workunit.client.0.smithi152.stdout:4/892: chown d2/d45/c95 1460869024 1 2023-12-06T15:00:33.885 INFO:tasks.workunit.client.0.smithi152.stdout:4/893: write d2/d15/d32/d54/d85/f87 [1438528,2878] 0 2023-12-06T15:00:33.890 INFO:tasks.workunit.client.0.smithi152.stdout:4/894: creat d2/d10/dbb/dca/dbc/d42/dba/f123 x:0 0 0 2023-12-06T15:00:33.893 INFO:tasks.workunit.client.0.smithi152.stdout:4/895: link d2/d15/d32/d54/ld1 d2/d10/dbb/dca/dbc/d75/deb/l124 0 2023-12-06T15:00:33.893 INFO:tasks.workunit.client.0.smithi152.stdout:3/607: dread d9/d10/d12/f3a [0,4194304] 0 2023-12-06T15:00:33.904 INFO:tasks.workunit.client.0.smithi152.stdout:9/595: dread d0/d3f/d68/d6c/d20/d38/f46 [0,4194304] 0 2023-12-06T15:00:33.909 INFO:tasks.workunit.client.0.smithi152.stdout:3/608: dread d9/d10/d12/d43/f78 [0,4194304] 0 2023-12-06T15:00:33.912 INFO:tasks.workunit.client.0.smithi152.stdout:8/539: sync 2023-12-06T15:00:33.912 INFO:tasks.workunit.client.0.smithi152.stdout:2/552: sync 2023-12-06T15:00:33.912 INFO:tasks.workunit.client.0.smithi152.stdout:1/886: sync 2023-12-06T15:00:33.912 INFO:tasks.workunit.client.0.smithi152.stdout:1/887: chown d3/d44/f78 163 1 2023-12-06T15:00:33.913 INFO:tasks.workunit.client.0.smithi152.stdout:2/553: link d6/d1e/d7a/f9f d6/db/fb1 0 2023-12-06T15:00:33.913 INFO:tasks.workunit.client.0.smithi152.stdout:2/554: truncate d6/d1e/f4a 4464322 0 2023-12-06T15:00:33.914 INFO:tasks.workunit.client.0.smithi152.stdout:1/888: creat d3/da/d4c/d82/f13d x:0 0 0 2023-12-06T15:00:33.914 INFO:tasks.workunit.client.0.smithi152.stdout:1/889: chown d3/da/d15/d17/d1a/f28 2 1 2023-12-06T15:00:33.917 INFO:tasks.workunit.client.0.smithi152.stdout:0/588: dwrite d8/d3e/d87/f8b [0,4194304] 0 2023-12-06T15:00:33.917 INFO:tasks.workunit.client.0.smithi152.stdout:9/596: dread d0/d3f/d68/d6c/d20/d38/f57 [0,4194304] 0 2023-12-06T15:00:33.921 INFO:tasks.workunit.client.0.smithi152.stdout:0/589: write d8/fd [2682434,125645] 0 2023-12-06T15:00:33.921 INFO:tasks.workunit.client.0.smithi152.stdout:0/590: creat d8/d3e/d6f/fc0 x:0 0 0 2023-12-06T15:00:33.923 INFO:tasks.workunit.client.0.smithi152.stdout:9/597: write d0/f24 [4147334,44493] 0 2023-12-06T15:00:33.923 INFO:tasks.workunit.client.0.smithi152.stdout:9/598: chown d0/d3f/d68/d6c/d20/f5a 10139 1 2023-12-06T15:00:33.923 INFO:tasks.workunit.client.0.smithi152.stdout:0/591: link d8/d44/f78 d8/d3e/d87/fc1 0 2023-12-06T15:00:33.924 INFO:tasks.workunit.client.0.smithi152.stdout:9/599: mknod d0/d3f/d68/d6c/d20/d38/d44/cae 0 2023-12-06T15:00:33.924 INFO:tasks.workunit.client.0.smithi152.stdout:9/600: fsync d0/d3f/d68/d6c/d20/d38/d45/f85 0 2023-12-06T15:00:33.925 INFO:tasks.workunit.client.0.smithi152.stdout:9/601: fsync d0/f8 0 2023-12-06T15:00:33.925 INFO:tasks.workunit.client.0.smithi152.stdout:0/592: symlink d8/d15/d45/d73/d8c/lc2 0 2023-12-06T15:00:33.926 INFO:tasks.workunit.client.0.smithi152.stdout:8/540: dread d1/d6/d34/d6f/f5c [0,4194304] 0 2023-12-06T15:00:33.926 INFO:tasks.workunit.client.0.smithi152.stdout:8/541: write d1/d6/d34/d3a/f76 [219266,22610] 0 2023-12-06T15:00:33.927 INFO:tasks.workunit.client.0.smithi152.stdout:5/706: dwrite d7/fc [0,4194304] 0 2023-12-06T15:00:33.927 INFO:tasks.workunit.client.1.smithi190.stdout:4/834: dwrite d3/d76/dc4/dc5/d3c/d116/d39/f48 [8388608,4194304] 0 2023-12-06T15:00:33.927 INFO:tasks.workunit.client.1.smithi190.stdout:4/835: truncate d3/d76/dc4/dc5/d3c/d116/d7a/f9a 714398 0 2023-12-06T15:00:33.929 INFO:tasks.workunit.client.0.smithi152.stdout:0/593: creat d8/d44/fc3 x:0 0 0 2023-12-06T15:00:33.929 INFO:tasks.workunit.client.1.smithi190.stdout:4/836: symlink d3/d76/dc4/dc5/d3c/d116/d7a/l125 0 2023-12-06T15:00:33.929 INFO:tasks.workunit.client.1.smithi190.stdout:4/837: write d3/d35/f46 [5174808,71841] 0 2023-12-06T15:00:33.932 INFO:tasks.workunit.client.0.smithi152.stdout:7/479: dwrite dd/df/d1b/d20/d7c/f84 [0,4194304] 0 2023-12-06T15:00:33.932 INFO:tasks.workunit.client.0.smithi152.stdout:4/896: dwrite d2/d15/d32/d69/d6f/d6c/f73 [0,4194304] 0 2023-12-06T15:00:33.932 INFO:tasks.workunit.client.1.smithi190.stdout:4/838: mkdir d3/d76/d126 0 2023-12-06T15:00:33.934 INFO:tasks.workunit.client.0.smithi152.stdout:5/707: symlink d7/dd/d26/db1/lf7 0 2023-12-06T15:00:33.934 INFO:tasks.workunit.client.0.smithi152.stdout:5/708: chown d7/d43/d6c/d98 19873 1 2023-12-06T15:00:33.934 INFO:tasks.workunit.client.0.smithi152.stdout:0/594: truncate d8/d15/d45/d73/d7a/f27 1122819 0 2023-12-06T15:00:33.940 INFO:tasks.workunit.client.0.smithi152.stdout:8/542: dread d1/d6/d34/d40/d64/f94 [0,4194304] 0 2023-12-06T15:00:33.940 INFO:tasks.workunit.client.0.smithi152.stdout:6/818: dwrite d1/fc2 [0,4194304] 0 2023-12-06T15:00:33.941 INFO:tasks.workunit.client.0.smithi152.stdout:5/709: link d7/dd/d26/ce4 d7/dd/d26/d3b/d46/cf8 0 2023-12-06T15:00:33.941 INFO:tasks.workunit.client.0.smithi152.stdout:5/710: fdatasync d7/dd/d26/f32 0 2023-12-06T15:00:33.943 INFO:tasks.workunit.client.0.smithi152.stdout:0/595: rmdir d8/d4b 39 2023-12-06T15:00:33.948 INFO:tasks.workunit.client.0.smithi152.stdout:5/711: write d7/dd/f2d [2104632,77998] 0 2023-12-06T15:00:33.948 INFO:tasks.workunit.client.0.smithi152.stdout:5/712: write d7/dd/d26/d3b/d46/f76 [322625,89523] 0 2023-12-06T15:00:33.950 INFO:tasks.workunit.client.0.smithi152.stdout:0/596: mkdir d8/d15/d45/d73/db9/dc4 0 2023-12-06T15:00:33.951 INFO:tasks.workunit.client.0.smithi152.stdout:5/713: truncate d7/dd/d26/d87/dc4/ddc/fcb 625469 0 2023-12-06T15:00:33.957 INFO:tasks.workunit.client.0.smithi152.stdout:1/890: dwrite d3/da/db/d54/f92 [0,4194304] 0 2023-12-06T15:00:33.959 INFO:tasks.workunit.client.1.smithi190.stdout:4/839: dread d3/d76/dc4/dc5/d3c/d116/d15/f34 [0,4194304] 0 2023-12-06T15:00:33.962 INFO:tasks.workunit.client.0.smithi152.stdout:2/555: dwrite d6/db/f2b [0,4194304] 0 2023-12-06T15:00:33.962 INFO:tasks.workunit.client.0.smithi152.stdout:2/556: fdatasync d6/f8e 0 2023-12-06T15:00:33.963 INFO:tasks.workunit.client.0.smithi152.stdout:9/602: dwrite d0/d3f/d68/d6c/d20/d38/d45/f64 [4194304,4194304] 0 2023-12-06T15:00:33.964 INFO:tasks.workunit.client.1.smithi190.stdout:4/840: getdents d3/da4/dd0 0 2023-12-06T15:00:33.966 INFO:tasks.workunit.client.1.smithi190.stdout:4/841: creat d3/da4/d10d/f127 x:0 0 0 2023-12-06T15:00:33.966 INFO:tasks.workunit.client.1.smithi190.stdout:4/842: chown d3/d35/d19/d41/cfa 1 1 2023-12-06T15:00:33.968 INFO:tasks.workunit.client.1.smithi190.stdout:4/843: symlink d3/da4/d117/l128 0 2023-12-06T15:00:33.969 INFO:tasks.workunit.client.1.smithi190.stdout:4/844: mkdir d3/d35/d19/d41/d44/d11d/d129 0 2023-12-06T15:00:33.970 INFO:tasks.workunit.client.1.smithi190.stdout:4/845: mkdir d3/d35/d19/d67/db5/d12a 0 2023-12-06T15:00:33.985 INFO:tasks.workunit.client.0.smithi152.stdout:4/897: dwrite d2/f8c [0,4194304] 0 2023-12-06T15:00:33.985 INFO:tasks.workunit.client.0.smithi152.stdout:1/891: dwrite d3/da/d4c/d82/d52/d62/fb8 [0,4194304] 0 2023-12-06T15:00:33.987 INFO:tasks.workunit.client.0.smithi152.stdout:9/603: dread d0/f23 [0,4194304] 0 2023-12-06T15:00:33.988 INFO:tasks.workunit.client.0.smithi152.stdout:4/898: rename d2/d15/d32/d69/d6f/daf/d11c to d2/d10/dab/d125 0 2023-12-06T15:00:33.990 INFO:tasks.workunit.client.0.smithi152.stdout:1/892: mknod d3/da/db/d54/c13e 0 2023-12-06T15:00:33.991 INFO:tasks.workunit.client.0.smithi152.stdout:1/893: read d3/da/d4c/d82/d52/d55/f126 [3779531,10683] 0 2023-12-06T15:00:33.991 INFO:tasks.workunit.client.0.smithi152.stdout:9/604: creat d0/d3f/d5f/d60/da9/faf x:0 0 0 2023-12-06T15:00:33.993 INFO:tasks.workunit.client.0.smithi152.stdout:1/894: mknod d3/da/d15/d17/d43/de6/c13f 0 2023-12-06T15:00:33.994 INFO:tasks.workunit.client.0.smithi152.stdout:1/895: link d3/d44/d84/fe3 d3/d10a/f140 0 2023-12-06T15:00:33.995 INFO:tasks.workunit.client.0.smithi152.stdout:1/896: creat d3/da/f141 x:0 0 0 2023-12-06T15:00:33.997 INFO:tasks.workunit.client.0.smithi152.stdout:4/899: write d2/d15/d32/d69/d6f/d10b/f4d [1159363,106545] 0 2023-12-06T15:00:34.000 INFO:tasks.workunit.client.0.smithi152.stdout:4/900: creat d2/d15/d32/d79/f126 x:0 0 0 2023-12-06T15:00:34.002 INFO:tasks.workunit.client.0.smithi152.stdout:7/480: dwrite dd/df/d34/d44/f8c [0,4194304] 0 2023-12-06T15:00:34.002 INFO:tasks.workunit.client.0.smithi152.stdout:7/481: write dd/df/d1b/d20/d28/d53/f6d [252159,56758] 0 2023-12-06T15:00:34.002 INFO:tasks.workunit.client.0.smithi152.stdout:6/819: dwrite d1/dcf/ddc/d1a/d30/d36/d35/d61/fc9 [0,4194304] 0 2023-12-06T15:00:34.002 INFO:tasks.workunit.client.0.smithi152.stdout:8/543: dwrite d1/d6/d29/f51 [0,4194304] 0 2023-12-06T15:00:34.002 INFO:tasks.workunit.client.0.smithi152.stdout:8/544: chown d1/d6/d34/d36/f67 92064776 1 2023-12-06T15:00:34.003 INFO:tasks.workunit.client.0.smithi152.stdout:8/545: read d1/d6/d29/f91 [389401,116230] 0 2023-12-06T15:00:34.003 INFO:tasks.workunit.client.0.smithi152.stdout:7/482: dread dd/df/d1b/f93 [0,4194304] 0 2023-12-06T15:00:34.003 INFO:tasks.workunit.client.0.smithi152.stdout:7/483: stat dd/df/d1b/d20/d28 0 2023-12-06T15:00:34.008 INFO:tasks.workunit.client.0.smithi152.stdout:6/820: mknod d1/dcf/ddc/d1a/d30/d36/d4e/d11b/c11e 0 2023-12-06T15:00:34.008 INFO:tasks.workunit.client.0.smithi152.stdout:6/821: stat d1/d1c/cb5 0 2023-12-06T15:00:34.009 INFO:tasks.workunit.client.1.smithi190.stdout:6/919: sync 2023-12-06T15:00:34.010 INFO:tasks.workunit.client.0.smithi152.stdout:8/546: rename d1/d6/d34/d6f/f5c to d1/d6/d29/d87/daa/fac 0 2023-12-06T15:00:34.011 INFO:tasks.workunit.client.0.smithi152.stdout:6/822: rmdir d1/dcf/ddc/d1a/d30/d18 39 2023-12-06T15:00:34.011 INFO:tasks.workunit.client.0.smithi152.stdout:6/823: fdatasync d1/d69/da1/deb/d112/f114 0 2023-12-06T15:00:34.012 INFO:tasks.workunit.client.0.smithi152.stdout:6/824: write d1/d75/d105/f118 [1244501,10308] 0 2023-12-06T15:00:34.012 INFO:tasks.workunit.client.0.smithi152.stdout:8/547: creat d1/d6/d34/d35/d38/fad x:0 0 0 2023-12-06T15:00:34.012 INFO:tasks.workunit.client.0.smithi152.stdout:8/548: truncate d1/d6/d29/f51 4801771 0 2023-12-06T15:00:34.013 INFO:tasks.workunit.client.0.smithi152.stdout:6/825: creat d1/dcf/ddc/d1a/d30/da4/f11f x:0 0 0 2023-12-06T15:00:34.013 INFO:tasks.workunit.client.0.smithi152.stdout:6/826: write d1/dcf/ddc/d1a/d30/d36/d4e/d55/dbf/fdb [827191,16244] 0 2023-12-06T15:00:34.013 INFO:tasks.workunit.client.0.smithi152.stdout:8/549: creat d1/d6/d29/fae x:0 0 0 2023-12-06T15:00:34.015 INFO:tasks.workunit.client.0.smithi152.stdout:6/827: rename d1/dcf/ddc/d1a/d30/d36/d4e/d55/dbf to d1/dcf/ddc/d1a/d30/d36/d35/d49/da6/da9/d120 0 2023-12-06T15:00:34.016 INFO:tasks.workunit.client.0.smithi152.stdout:8/550: creat d1/d6/d34/d35/d66/faf x:0 0 0 2023-12-06T15:00:34.018 INFO:tasks.workunit.client.1.smithi190.stdout:6/920: mkdir d4/d12/d40/d12e 0 2023-12-06T15:00:34.020 INFO:tasks.workunit.client.1.smithi190.stdout:6/921: mkdir d4/d12/d1a/d59/d12f 0 2023-12-06T15:00:34.024 INFO:tasks.workunit.client.1.smithi190.stdout:6/922: rename d4/d12/d1a/fc9 to d4/d12/d1a/d32/dc7/f130 0 2023-12-06T15:00:34.024 INFO:tasks.workunit.client.1.smithi190.stdout:6/923: dread - d4/d12/d1a/d70/fcd zero size 2023-12-06T15:00:34.026 INFO:tasks.workunit.client.1.smithi190.stdout:6/924: rename d4/d12/d1a/d8a/fa7 to d4/d12/d1a/d59/f131 0 2023-12-06T15:00:34.026 INFO:tasks.workunit.client.0.smithi152.stdout:0/597: dwrite d8/d15/d45/d73/d7a/f27 [0,4194304] 0 2023-12-06T15:00:34.027 INFO:tasks.workunit.client.1.smithi190.stdout:4/846: dwrite d3/d76/dc4/dc5/d3c/d116/d39/ffc [0,4194304] 0 2023-12-06T15:00:34.029 INFO:tasks.workunit.client.0.smithi152.stdout:2/557: dwrite d6/d18/d43/f50 [4194304,4194304] 0 2023-12-06T15:00:34.029 INFO:tasks.workunit.client.0.smithi152.stdout:0/598: rename d8/c85 to d8/d15/d45/d99/cc5 0 2023-12-06T15:00:34.029 INFO:tasks.workunit.client.0.smithi152.stdout:0/599: read - d8/d3e/d6f/f95 zero size 2023-12-06T15:00:34.032 INFO:tasks.workunit.client.1.smithi190.stdout:6/925: write d4/d12/d40/d43/d45/f60 [1860231,100058] 0 2023-12-06T15:00:34.033 INFO:tasks.workunit.client.0.smithi152.stdout:2/558: write d6/db/f39 [1009342,112173] 0 2023-12-06T15:00:34.033 INFO:tasks.workunit.client.1.smithi190.stdout:6/926: symlink d4/d12/d1a/d59/d12f/l132 0 2023-12-06T15:00:34.036 INFO:tasks.workunit.client.0.smithi152.stdout:2/559: creat d6/d18/d43/d95/fb2 x:0 0 0 2023-12-06T15:00:34.038 INFO:tasks.workunit.client.0.smithi152.stdout:2/560: mkdir d6/d18/d43/db3 0 2023-12-06T15:00:34.039 INFO:tasks.workunit.client.0.smithi152.stdout:9/605: dwrite d0/f15 [0,4194304] 0 2023-12-06T15:00:34.043 INFO:tasks.workunit.client.0.smithi152.stdout:9/606: write d0/d3f/d5f/d60/da1/f73 [5500083,44829] 0 2023-12-06T15:00:34.043 INFO:tasks.workunit.client.0.smithi152.stdout:9/607: dread - d0/d3f/d68/d6c/d20/d4a/d4d/d69/fab zero size 2023-12-06T15:00:34.044 INFO:tasks.workunit.client.0.smithi152.stdout:9/608: write d0/d3f/d68/d6c/f2f [1396079,71880] 0 2023-12-06T15:00:34.046 INFO:tasks.workunit.client.0.smithi152.stdout:2/561: write d6/db/d17/f46 [246012,32968] 0 2023-12-06T15:00:34.047 INFO:tasks.workunit.client.0.smithi152.stdout:9/609: rename d0/d50 to d0/d3f/d68/d6c/d20/db0 0 2023-12-06T15:00:34.049 INFO:tasks.workunit.client.0.smithi152.stdout:2/562: creat d6/d1e/d41/d83/fb4 x:0 0 0 2023-12-06T15:00:34.050 INFO:tasks.workunit.client.0.smithi152.stdout:9/610: mkdir d0/d3f/d68/d6c/d20/d4a/d71/db1 0 2023-12-06T15:00:34.052 INFO:tasks.workunit.client.0.smithi152.stdout:8/551: dwrite d1/d6/d29/d87/daa/fac [0,4194304] 0 2023-12-06T15:00:34.052 INFO:tasks.workunit.client.0.smithi152.stdout:1/897: dwrite d3/da/d15/d17/f4f [0,4194304] 0 2023-12-06T15:00:34.052 INFO:tasks.workunit.client.0.smithi152.stdout:1/898: chown d3/d44 9490229 1 2023-12-06T15:00:34.052 INFO:tasks.workunit.client.0.smithi152.stdout:7/484: dwrite dd/df/d1b/d20/f58 [0,4194304] 0 2023-12-06T15:00:34.055 INFO:tasks.workunit.client.0.smithi152.stdout:9/611: write d0/f24 [255397,95261] 0 2023-12-06T15:00:34.056 INFO:tasks.workunit.client.1.smithi190.stdout:6/927: dwrite d4/d12/d9a/fbb [0,4194304] 0 2023-12-06T15:00:34.056 INFO:tasks.workunit.client.1.smithi190.stdout:6/928: write d4/d12/d1a/d8a/ff9 [817643,6562] 0 2023-12-06T15:00:34.059 INFO:tasks.workunit.client.1.smithi190.stdout:0/795: sync 2023-12-06T15:00:34.059 INFO:tasks.workunit.client.1.smithi190.stdout:3/904: sync 2023-12-06T15:00:34.059 INFO:tasks.workunit.client.1.smithi190.stdout:2/855: sync 2023-12-06T15:00:34.059 INFO:tasks.workunit.client.1.smithi190.stdout:2/856: write d10/d26/d5c/d49/f6f [4877147,17794] 0 2023-12-06T15:00:34.059 INFO:tasks.workunit.client.1.smithi190.stdout:8/861: sync 2023-12-06T15:00:34.059 INFO:tasks.workunit.client.1.smithi190.stdout:7/987: sync 2023-12-06T15:00:34.060 INFO:tasks.workunit.client.1.smithi190.stdout:7/988: write d0/d88/d41/d92/fcc [256132,19924] 0 2023-12-06T15:00:34.060 INFO:tasks.workunit.client.0.smithi152.stdout:6/828: dwrite d1/dcf/ddc/d1a/d30/d36/d26/f53 [0,4194304] 0 2023-12-06T15:00:34.061 INFO:tasks.workunit.client.1.smithi190.stdout:3/905: link d4/d70/d19/d3a/d3b/d72/df5/l125 d4/d1b/d5d/l13e 0 2023-12-06T15:00:34.061 INFO:tasks.workunit.client.1.smithi190.stdout:5/812: sync 2023-12-06T15:00:34.061 INFO:tasks.workunit.client.0.smithi152.stdout:8/552: rmdir d1/d6/d34/d35/d66/d82 39 2023-12-06T15:00:34.062 INFO:tasks.workunit.client.1.smithi190.stdout:0/796: mknod d0/da/da4/c104 0 2023-12-06T15:00:34.062 INFO:tasks.workunit.client.1.smithi190.stdout:5/813: read d0/d1c/f35 [1239222,2795] 0 2023-12-06T15:00:34.062 INFO:tasks.workunit.client.1.smithi190.stdout:0/797: fdatasync d0/da/d3e/d3a/d40/f5e 0 2023-12-06T15:00:34.062 INFO:tasks.workunit.client.1.smithi190.stdout:5/814: fdatasync d0/d1c/d85/d90/f10f 0 2023-12-06T15:00:34.063 INFO:tasks.workunit.client.1.smithi190.stdout:2/857: read d10/d26/d5c/d37/f69 [1358969,113132] 0 2023-12-06T15:00:34.064 INFO:tasks.workunit.client.1.smithi190.stdout:6/929: dread d4/d12/d40/d43/d45/d4a/f7e [0,4194304] 0 2023-12-06T15:00:34.064 INFO:tasks.workunit.client.1.smithi190.stdout:8/862: creat d1/d20/d3b/d36/d105/f107 x:0 0 0 2023-12-06T15:00:34.064 INFO:tasks.workunit.client.1.smithi190.stdout:6/930: fdatasync d4/d12/d1a/f28 0 2023-12-06T15:00:34.064 INFO:tasks.workunit.client.1.smithi190.stdout:6/931: chown d4/d12/d1a/c126 142981 1 2023-12-06T15:00:34.064 INFO:tasks.workunit.client.1.smithi190.stdout:8/863: write d1/d20/d3b/d4c/d8e/d94/d1c/f9b [1721658,35344] 0 2023-12-06T15:00:34.064 INFO:tasks.workunit.client.1.smithi190.stdout:6/932: write d4/d12/d40/d43/f4d [1021027,112935] 0 2023-12-06T15:00:34.065 INFO:tasks.workunit.client.0.smithi152.stdout:1/899: creat d3/da/f142 x:0 0 0 2023-12-06T15:00:34.065 INFO:tasks.workunit.client.0.smithi152.stdout:1/900: stat d3/da/d4c/d85/c99 0 2023-12-06T15:00:34.065 INFO:tasks.workunit.client.0.smithi152.stdout:1/901: chown d3/da/d15/d17/d4d/d12f/c132 1786801 1 2023-12-06T15:00:34.066 INFO:tasks.workunit.client.0.smithi152.stdout:1/902: dread - d3/da/d4c/d63/d96/dd8/f11d zero size 2023-12-06T15:00:34.066 INFO:tasks.workunit.client.0.smithi152.stdout:8/553: dread d1/d6/d34/d3a/f48 [0,4194304] 0 2023-12-06T15:00:34.068 INFO:tasks.workunit.client.1.smithi190.stdout:3/906: creat d4/d1b/d54/d9c/d68/dfc/d56/f13f x:0 0 0 2023-12-06T15:00:34.068 INFO:tasks.workunit.client.1.smithi190.stdout:7/989: truncate d0/d88/d1c/f23 208118 0 2023-12-06T15:00:34.069 INFO:tasks.workunit.client.1.smithi190.stdout:0/798: mknod d0/da/d74/dfc/c105 0 2023-12-06T15:00:34.069 INFO:tasks.workunit.client.1.smithi190.stdout:5/815: rename d0/df/f20 to d0/d1c/d85/d90/d99/f11a 0 2023-12-06T15:00:34.070 INFO:tasks.workunit.client.1.smithi190.stdout:2/858: write d10/d59/dcd/dad/dc4/d76/db1/fd0 [3435978,27271] 0 2023-12-06T15:00:34.072 INFO:tasks.workunit.client.0.smithi152.stdout:7/485: unlink dd/df/d1b/d20/l63 0 2023-12-06T15:00:34.072 INFO:tasks.workunit.client.0.smithi152.stdout:7/486: truncate dd/df/d1b/f7d 241179 0 2023-12-06T15:00:34.072 INFO:tasks.workunit.client.0.smithi152.stdout:2/563: dwrite d6/db/f2b [0,4194304] 0 2023-12-06T15:00:34.073 INFO:tasks.workunit.client.0.smithi152.stdout:2/564: write d6/db/f61 [994081,3491] 0 2023-12-06T15:00:34.073 INFO:tasks.workunit.client.1.smithi190.stdout:8/864: mkdir d1/d20/d3b/d4c/d8e/d94/db6/d108 0 2023-12-06T15:00:34.073 INFO:tasks.workunit.client.1.smithi190.stdout:7/990: truncate d0/d88/d33/fc2 6776377 0 2023-12-06T15:00:34.073 INFO:tasks.workunit.client.1.smithi190.stdout:5/816: rmdir d0/d1c/d3e/dfd 39 2023-12-06T15:00:34.073 INFO:tasks.workunit.client.1.smithi190.stdout:8/865: write d1/d20/d3b/d4c/d8e/d94/d1c/f4f [884196,92729] 0 2023-12-06T15:00:34.076 INFO:tasks.workunit.client.1.smithi190.stdout:0/799: creat d0/da/d3e/d2b/d3c/d4c/da8/f106 x:0 0 0 2023-12-06T15:00:34.078 INFO:tasks.workunit.client.1.smithi190.stdout:2/859: mknod d10/d26/d5c/d35/d77/c11e 0 2023-12-06T15:00:34.078 INFO:tasks.workunit.client.1.smithi190.stdout:2/860: stat d10/d59/dcd/dad/f100 0 2023-12-06T15:00:34.079 INFO:tasks.workunit.client.1.smithi190.stdout:5/817: link d0/f82 d0/deb/f11b 0 2023-12-06T15:00:34.079 INFO:tasks.workunit.client.0.smithi152.stdout:9/612: rename d0/d3f/d68/d6c/d20/d38/d48/lad to d0/d3f/lb2 0 2023-12-06T15:00:34.080 INFO:tasks.workunit.client.0.smithi152.stdout:6/829: creat d1/dcf/ddc/d1a/d30/d36/d26/f121 x:0 0 0 2023-12-06T15:00:34.080 INFO:tasks.workunit.client.0.smithi152.stdout:1/903: mkdir d3/da/d4c/d82/d143 0 2023-12-06T15:00:34.080 INFO:tasks.workunit.client.0.smithi152.stdout:1/904: readlink d3/da/d15/dac/l13b 0 2023-12-06T15:00:34.081 INFO:tasks.workunit.client.1.smithi190.stdout:8/866: truncate d1/d37/f73 16671 0 2023-12-06T15:00:34.081 INFO:tasks.workunit.client.1.smithi190.stdout:8/867: fdatasync d1/d20/d3b/d7e/fa8 0 2023-12-06T15:00:34.081 INFO:tasks.workunit.client.1.smithi190.stdout:8/868: chown d1/d20/d3b/d7e/l8c 392528 1 2023-12-06T15:00:34.082 INFO:tasks.workunit.client.0.smithi152.stdout:8/554: creat d1/d6/d29/d87/fb0 x:0 0 0 2023-12-06T15:00:34.084 INFO:tasks.workunit.client.0.smithi152.stdout:7/487: mknod dd/df/d34/d95/c96 0 2023-12-06T15:00:34.087 INFO:tasks.workunit.client.1.smithi190.stdout:2/861: creat d10/d59/dcd/dad/f11f x:0 0 0 2023-12-06T15:00:34.087 INFO:tasks.workunit.client.1.smithi190.stdout:0/800: creat d0/da/d3e/d2b/d3c/d46/f107 x:0 0 0 2023-12-06T15:00:34.090 INFO:tasks.workunit.client.1.smithi190.stdout:0/801: mknod d0/da/d3e/d2b/d3c/d46/c108 0 2023-12-06T15:00:34.090 INFO:tasks.workunit.client.1.smithi190.stdout:8/869: symlink d1/d20/d3b/d34/dc0/l109 0 2023-12-06T15:00:34.090 INFO:tasks.workunit.client.1.smithi190.stdout:0/802: fdatasync d0/da/f49 0 2023-12-06T15:00:34.090 INFO:tasks.workunit.client.1.smithi190.stdout:8/870: chown d1/d20/f8b 7947 1 2023-12-06T15:00:34.093 INFO:tasks.workunit.client.1.smithi190.stdout:0/803: link d0/da/d3e/d2b/d3c/d46/l6c d0/da/d3e/db8/l109 0 2023-12-06T15:00:34.095 INFO:tasks.workunit.client.0.smithi152.stdout:9/613: mkdir d0/d3f/d68/d6c/d20/db0/db3 0 2023-12-06T15:00:34.096 INFO:tasks.workunit.client.1.smithi190.stdout:0/804: rmdir d0/da/d74/da2 39 2023-12-06T15:00:34.099 INFO:tasks.workunit.client.1.smithi190.stdout:0/805: symlink d0/da/d3e/d2b/d3c/d65/l10a 0 2023-12-06T15:00:34.099 INFO:tasks.workunit.client.1.smithi190.stdout:0/806: stat d0/da/d3e/d3a/d40/f5e 0 2023-12-06T15:00:34.100 INFO:tasks.workunit.client.0.smithi152.stdout:1/905: mknod d3/d44/d84/c144 0 2023-12-06T15:00:34.102 INFO:tasks.workunit.client.0.smithi152.stdout:8/555: creat d1/d6/d29/d5b/fb1 x:0 0 0 2023-12-06T15:00:34.103 INFO:tasks.workunit.client.1.smithi190.stdout:0/807: write d0/da/d3e/d2b/d3c/d65/f72 [518868,130722] 0 2023-12-06T15:00:34.103 INFO:tasks.workunit.client.1.smithi190.stdout:0/808: write d0/da/d3e/d2b/d37/f76 [4768135,58395] 0 2023-12-06T15:00:34.104 INFO:tasks.workunit.client.0.smithi152.stdout:7/488: symlink dd/df/d34/d44/d49/l97 0 2023-12-06T15:00:34.106 INFO:tasks.workunit.client.1.smithi190.stdout:3/907: dwrite d4/d1b/d54/d9c/f13b [0,4194304] 0 2023-12-06T15:00:34.108 INFO:tasks.workunit.client.0.smithi152.stdout:9/614: mknod d0/d3f/d68/d6c/d20/db0/db3/cb4 0 2023-12-06T15:00:34.108 INFO:tasks.workunit.client.1.smithi190.stdout:3/908: write d4/d1b/d54/d9c/d68/dfc/d56/d94/d3d/fc3 [327147,97153] 0 2023-12-06T15:00:34.109 INFO:tasks.workunit.client.0.smithi152.stdout:1/906: rmdir d3/da/d4c/d85 39 2023-12-06T15:00:34.109 INFO:tasks.workunit.client.0.smithi152.stdout:1/907: write d3/da/d4c/d82/f31 [1661867,55985] 0 2023-12-06T15:00:34.109 INFO:tasks.workunit.client.0.smithi152.stdout:7/489: read - dd/df/d1b/d20/d28/d38/f82 zero size 2023-12-06T15:00:34.109 INFO:tasks.workunit.client.0.smithi152.stdout:7/490: chown dd/df/d34/d44/c4f 11 1 2023-12-06T15:00:34.110 INFO:tasks.workunit.client.0.smithi152.stdout:7/491: write f1 [4342618,105284] 0 2023-12-06T15:00:34.112 INFO:tasks.workunit.client.0.smithi152.stdout:9/615: mkdir d0/d3f/d68/d6c/d20/d4a/d4d/d69/db5 0 2023-12-06T15:00:34.112 INFO:tasks.workunit.client.1.smithi190.stdout:7/991: write d0/d88/d33/fc2 [5831225,116565] 0 2023-12-06T15:00:34.112 INFO:tasks.workunit.client.0.smithi152.stdout:9/616: read d0/f5 [3065854,72093] 0 2023-12-06T15:00:34.113 INFO:tasks.workunit.client.0.smithi152.stdout:1/908: truncate d3/d44/fad 1980790 0 2023-12-06T15:00:34.113 INFO:tasks.workunit.client.1.smithi190.stdout:7/992: creat d0/df/d53/d10d/f139 x:0 0 0 2023-12-06T15:00:34.115 INFO:tasks.workunit.client.1.smithi190.stdout:3/909: write d4/d1b/d5d/fc0 [3265864,112253] 0 2023-12-06T15:00:34.115 INFO:tasks.workunit.client.1.smithi190.stdout:3/910: truncate d4/d1b/d54/d9c/d68/dfc/d56/d83/de2/fee 651511 0 2023-12-06T15:00:34.118 INFO:tasks.workunit.client.0.smithi152.stdout:1/909: write d3/da/db/f48 [2511623,78795] 0 2023-12-06T15:00:34.118 INFO:tasks.workunit.client.0.smithi152.stdout:7/492: creat dd/df/d34/d44/d49/f98 x:0 0 0 2023-12-06T15:00:34.118 INFO:tasks.workunit.client.0.smithi152.stdout:1/910: chown d3/da/db/f81 12141 1 2023-12-06T15:00:34.118 INFO:tasks.workunit.client.0.smithi152.stdout:1/911: fsync d3/da/d15/d17/d1a/fa1 0 2023-12-06T15:00:34.118 INFO:tasks.workunit.client.0.smithi152.stdout:1/912: chown d3/d10a/f140 484 1 2023-12-06T15:00:34.121 INFO:tasks.workunit.client.0.smithi152.stdout:1/913: dread d3/da/d15/d17/d43/f83 [0,4194304] 0 2023-12-06T15:00:34.121 INFO:tasks.workunit.client.0.smithi152.stdout:1/914: chown d3/da/d65/l10f 18963 1 2023-12-06T15:00:34.124 INFO:tasks.workunit.client.0.smithi152.stdout:1/915: symlink d3/da/d4c/d85/d123/l145 0 2023-12-06T15:00:34.127 INFO:tasks.workunit.client.0.smithi152.stdout:3/609: sync 2023-12-06T15:00:34.127 INFO:tasks.workunit.client.0.smithi152.stdout:3/610: write d9/d18/d39/f8a [4879105,70578] 0 2023-12-06T15:00:34.131 INFO:tasks.workunit.client.0.smithi152.stdout:2/565: dwrite d6/db/d17/fad [0,4194304] 0 2023-12-06T15:00:34.135 INFO:tasks.workunit.client.1.smithi190.stdout:2/862: dwrite d10/d59/dcd/dad/dc4/d76/fa6 [0,4194304] 0 2023-12-06T15:00:34.135 INFO:tasks.workunit.client.0.smithi152.stdout:9/617: dread d0/d3f/f78 [0,4194304] 0 2023-12-06T15:00:34.138 INFO:tasks.workunit.client.1.smithi190.stdout:0/809: dread d0/da/ff2 [0,4194304] 0 2023-12-06T15:00:34.139 INFO:tasks.workunit.client.1.smithi190.stdout:0/810: dread d0/da/ff2 [0,4194304] 0 2023-12-06T15:00:34.140 INFO:tasks.workunit.client.1.smithi190.stdout:0/811: readlink d0/da/d3e/d2b/d3c/d46/d8e/l102 0 2023-12-06T15:00:34.140 INFO:tasks.workunit.client.0.smithi152.stdout:9/618: dread d0/d3f/d68/d6c/d20/f29 [0,4194304] 0 2023-12-06T15:00:34.140 INFO:tasks.workunit.client.1.smithi190.stdout:2/863: write fa [1992678,76830] 0 2023-12-06T15:00:34.142 INFO:tasks.workunit.client.0.smithi152.stdout:5/714: sync 2023-12-06T15:00:34.143 INFO:tasks.workunit.client.0.smithi152.stdout:2/566: dread d6/db/d17/f75 [0,4194304] 0 2023-12-06T15:00:34.144 INFO:tasks.workunit.client.0.smithi152.stdout:5/715: mkdir d7/d43/d6c/d98/dc8/df9 0 2023-12-06T15:00:34.145 INFO:tasks.workunit.client.0.smithi152.stdout:5/716: symlink d7/dd/d26/d3b/lfa 0 2023-12-06T15:00:34.145 INFO:tasks.workunit.client.0.smithi152.stdout:2/567: symlink d6/d1e/lb5 0 2023-12-06T15:00:34.147 INFO:tasks.workunit.client.0.smithi152.stdout:2/568: mknod d6/d18/d43/d95/cb6 0 2023-12-06T15:00:34.147 INFO:tasks.workunit.client.0.smithi152.stdout:2/569: readlink d6/l1c 0 2023-12-06T15:00:34.147 INFO:tasks.workunit.client.0.smithi152.stdout:2/570: dread - d6/d1e/f5b zero size 2023-12-06T15:00:34.147 INFO:tasks.workunit.client.0.smithi152.stdout:5/717: write d7/dd/ff [2824559,86714] 0 2023-12-06T15:00:34.147 INFO:tasks.workunit.client.0.smithi152.stdout:2/571: stat d6/c48 0 2023-12-06T15:00:34.150 INFO:tasks.workunit.client.0.smithi152.stdout:5/718: rmdir d7/d43/d6c/d98/dc8/df9 0 2023-12-06T15:00:34.150 INFO:tasks.workunit.client.0.smithi152.stdout:2/572: mkdir d6/d18/d43/db3/db7 0 2023-12-06T15:00:34.151 INFO:tasks.workunit.client.1.smithi190.stdout:0/812: creat d0/da/d74/da2/f10b x:0 0 0 2023-12-06T15:00:34.151 INFO:tasks.workunit.client.1.smithi190.stdout:5/818: dwrite d0/d1c/d2b/d2c/d5d/fb5 [0,4194304] 0 2023-12-06T15:00:34.152 INFO:tasks.workunit.client.1.smithi190.stdout:2/864: dread d10/d26/d5c/d35/f50 [0,4194304] 0 2023-12-06T15:00:34.152 INFO:tasks.workunit.client.0.smithi152.stdout:5/719: rename d7/dd/d4e to d7/d43/d9c/dfb 0 2023-12-06T15:00:34.154 INFO:tasks.workunit.client.1.smithi190.stdout:0/813: mknod d0/c10c 0 2023-12-06T15:00:34.154 INFO:tasks.workunit.client.1.smithi190.stdout:5/819: mknod d0/d1c/d85/d90/c11c 0 2023-12-06T15:00:34.155 INFO:tasks.workunit.client.1.smithi190.stdout:2/865: creat d10/d26/d8a/d8f/f120 x:0 0 0 2023-12-06T15:00:34.156 INFO:tasks.workunit.client.1.smithi190.stdout:0/814: truncate d0/da/f25 1067360 0 2023-12-06T15:00:34.157 INFO:tasks.workunit.client.1.smithi190.stdout:5/820: mknod d0/df/d50/c11d 0 2023-12-06T15:00:34.158 INFO:tasks.workunit.client.0.smithi152.stdout:6/830: dwrite d1/dcf/ddc/d1a/d30/fe [12582912,4194304] 0 2023-12-06T15:00:34.158 INFO:tasks.workunit.client.0.smithi152.stdout:8/556: dwrite d1/d6/d29/d87/fb0 [0,4194304] 0 2023-12-06T15:00:34.161 INFO:tasks.workunit.client.1.smithi190.stdout:0/815: creat d0/da/d3e/db8/f10d x:0 0 0 2023-12-06T15:00:34.162 INFO:tasks.workunit.client.1.smithi190.stdout:0/816: read - d0/da/d3e/d3a/d40/ff9 zero size 2023-12-06T15:00:34.163 INFO:tasks.workunit.client.1.smithi190.stdout:2/866: rename d10/d26/d5c/d49/d7e/lbb to d10/d59/d5e/l121 0 2023-12-06T15:00:34.165 INFO:tasks.workunit.client.0.smithi152.stdout:6/831: rmdir d1/dcf/ddc/d1a 39 2023-12-06T15:00:34.165 INFO:tasks.workunit.client.0.smithi152.stdout:2/573: dread d6/d1e/f53 [0,4194304] 0 2023-12-06T15:00:34.165 INFO:tasks.workunit.client.0.smithi152.stdout:2/574: write d6/db/d17/fa6 [380062,93968] 0 2023-12-06T15:00:34.165 INFO:tasks.workunit.client.1.smithi190.stdout:2/867: mknod d10/d59/dcd/dad/dc9/c122 0 2023-12-06T15:00:34.167 INFO:tasks.workunit.client.0.smithi152.stdout:2/575: mkdir d6/d18/d43/db8 0 2023-12-06T15:00:34.169 INFO:tasks.workunit.client.0.smithi152.stdout:2/576: symlink d6/d18/lb9 0 2023-12-06T15:00:34.174 INFO:tasks.workunit.client.0.smithi152.stdout:1/916: dwrite d3/da/d15/d17/d1a/fb7 [0,4194304] 0 2023-12-06T15:00:34.174 INFO:tasks.workunit.client.0.smithi152.stdout:8/557: dread d1/d6/d29/d87/daa/fac [0,4194304] 0 2023-12-06T15:00:34.174 INFO:tasks.workunit.client.0.smithi152.stdout:8/558: fdatasync d1/d6/d34/d36/f79 0 2023-12-06T15:00:34.176 INFO:tasks.workunit.client.0.smithi152.stdout:2/577: creat d6/d18/d70/fba x:0 0 0 2023-12-06T15:00:34.178 INFO:tasks.workunit.client.0.smithi152.stdout:8/559: creat d1/d6/d34/d35/fb2 x:0 0 0 2023-12-06T15:00:34.178 INFO:tasks.workunit.client.0.smithi152.stdout:8/560: dread - d1/d6/d29/fae zero size 2023-12-06T15:00:34.178 INFO:tasks.workunit.client.0.smithi152.stdout:1/917: mknod d3/da/dcd/dd9/dfd/c146 0 2023-12-06T15:00:34.178 INFO:tasks.workunit.client.1.smithi190.stdout:8/871: dwrite d1/d20/d3b/d4c/fde [0,4194304] 0 2023-12-06T15:00:34.179 INFO:tasks.workunit.client.0.smithi152.stdout:2/578: creat d6/d18/d43/db8/fbb x:0 0 0 2023-12-06T15:00:34.179 INFO:tasks.workunit.client.0.smithi152.stdout:8/561: mknod d1/d6/d29/cb3 0 2023-12-06T15:00:34.180 INFO:tasks.workunit.client.0.smithi152.stdout:2/579: link d6/d1e/d41/d55/c78 d6/d18/d43/db3/cbc 0 2023-12-06T15:00:34.181 INFO:tasks.workunit.client.0.smithi152.stdout:1/918: write d3/da/d15/d17/d1a/fb7 [1518974,66438] 0 2023-12-06T15:00:34.182 INFO:tasks.workunit.client.1.smithi190.stdout:3/911: dwrite d4/d70/d33/d45/fef [0,4194304] 0 2023-12-06T15:00:34.182 INFO:tasks.workunit.client.1.smithi190.stdout:3/912: chown d4/d70/d19/d3a/d3b/d72/df5/l138 9 1 2023-12-06T15:00:34.182 INFO:tasks.workunit.client.0.smithi152.stdout:8/562: rename d1/d6/d34/d40/d64 to d1/d6/d34/d36/db4 0 2023-12-06T15:00:34.183 INFO:tasks.workunit.client.0.smithi152.stdout:3/611: dwrite d9/d10/d12/d43/d52/f61 [0,4194304] 0 2023-12-06T15:00:34.183 INFO:tasks.workunit.client.0.smithi152.stdout:3/612: dread - d9/d10/d19/f57 zero size 2023-12-06T15:00:34.183 INFO:tasks.workunit.client.0.smithi152.stdout:3/613: readlink d9/d10/d12/d43/d52/db4/l9e 0 2023-12-06T15:00:34.184 INFO:tasks.workunit.client.0.smithi152.stdout:8/563: creat d1/d6/d34/d35/d8d/fb5 x:0 0 0 2023-12-06T15:00:34.186 INFO:tasks.workunit.client.1.smithi190.stdout:8/872: unlink d1/d20/d3b/d4c/d59/fd6 0 2023-12-06T15:00:34.188 INFO:tasks.workunit.client.0.smithi152.stdout:1/919: rename d3/da/d4c/d82/d52 to d3/da/d15/d17/d147 0 2023-12-06T15:00:34.189 INFO:tasks.workunit.client.0.smithi152.stdout:9/619: dwrite d0/d3f/d68/d6c/d20/d38/d45/f85 [0,4194304] 0 2023-12-06T15:00:34.190 INFO:tasks.workunit.client.1.smithi190.stdout:3/913: symlink d4/d70/d19/d3a/ddf/l140 0 2023-12-06T15:00:34.190 INFO:tasks.workunit.client.1.smithi190.stdout:8/873: getdents d1/d20/d3b/d4c/d9e 0 2023-12-06T15:00:34.193 INFO:tasks.workunit.client.0.smithi152.stdout:1/920: rename d3/da/d65/l10f to d3/d10a/l148 0 2023-12-06T15:00:34.193 INFO:tasks.workunit.client.0.smithi152.stdout:1/921: read - d3/da/d15/fd6 zero size 2023-12-06T15:00:34.193 INFO:tasks.workunit.client.1.smithi190.stdout:8/874: unlink d1/d20/d3b/d4c/d8e/d94/d25/l32 0 2023-12-06T15:00:34.197 INFO:tasks.workunit.client.0.smithi152.stdout:8/564: dread d1/d6/d34/f57 [0,4194304] 0 2023-12-06T15:00:34.197 INFO:tasks.workunit.client.0.smithi152.stdout:5/720: dwrite d7/dd/f67 [0,4194304] 0 2023-12-06T15:00:34.199 INFO:tasks.workunit.client.1.smithi190.stdout:5/821: dwrite d0/df/d50/fad [0,4194304] 0 2023-12-06T15:00:34.200 INFO:tasks.workunit.client.0.smithi152.stdout:1/922: write d3/da/d15/d17/d1a/f5f [2433579,7395] 0 2023-12-06T15:00:34.204 INFO:tasks.workunit.client.0.smithi152.stdout:1/923: truncate d3/da/d4c/d63/fa8 5091563 0 2023-12-06T15:00:34.204 INFO:tasks.workunit.client.1.smithi190.stdout:5/822: rmdir d0/d1c/d2b/d2c/d5d/d73/d118 0 2023-12-06T15:00:34.204 INFO:tasks.workunit.client.1.smithi190.stdout:5/823: write d0/df/d50/f87 [4331627,61100] 0 2023-12-06T15:00:34.204 INFO:tasks.workunit.client.0.smithi152.stdout:9/620: dread d0/f1 [0,4194304] 0 2023-12-06T15:00:34.208 INFO:tasks.workunit.client.1.smithi190.stdout:2/868: dwrite d10/d59/dcd/dad/fe2 [0,4194304] 0 2023-12-06T15:00:34.208 INFO:tasks.workunit.client.1.smithi190.stdout:5/824: mkdir d0/d1c/d2b/d11e 0 2023-12-06T15:00:34.209 INFO:tasks.workunit.client.0.smithi152.stdout:1/924: creat d3/da/d15/d17/d58/d9f/f149 x:0 0 0 2023-12-06T15:00:34.210 INFO:tasks.workunit.client.1.smithi190.stdout:0/817: dwrite d0/da/d3e/d2b/d3c/d4c/dcc/ff7 [0,4194304] 0 2023-12-06T15:00:34.210 INFO:tasks.workunit.client.0.smithi152.stdout:9/621: rename d0/d3f/d68/d6c/d20/d38/d45/l7d to d0/d3f/d68/d6c/d20/d4a/d4d/lb6 0 2023-12-06T15:00:34.211 INFO:tasks.workunit.client.1.smithi190.stdout:2/869: unlink d10/d59/f93 0 2023-12-06T15:00:34.211 INFO:tasks.workunit.client.1.smithi190.stdout:2/870: stat d10/d59/dcd/dad/dc9 0 2023-12-06T15:00:34.213 INFO:tasks.workunit.client.1.smithi190.stdout:5/825: creat d0/d1c/d3e/dea/df5/f11f x:0 0 0 2023-12-06T15:00:34.213 INFO:tasks.workunit.client.0.smithi152.stdout:1/925: rename d3/da/d15/d17/d147/d62/dcc/f117 to d3/d44/d84/de2/f14a 0 2023-12-06T15:00:34.213 INFO:tasks.workunit.client.0.smithi152.stdout:1/926: chown d3/da/d15/d17/c13c 128904 1 2023-12-06T15:00:34.215 INFO:tasks.workunit.client.0.smithi152.stdout:8/565: dread d1/d6/d34/d35/d8d/fa1 [0,4194304] 0 2023-12-06T15:00:34.215 INFO:tasks.workunit.client.0.smithi152.stdout:1/927: creat d3/da/d15/d17/d4d/f14b x:0 0 0 2023-12-06T15:00:34.215 INFO:tasks.workunit.client.0.smithi152.stdout:8/566: truncate d1/d6/d34/d35/d38/f4e 922696 0 2023-12-06T15:00:34.215 INFO:tasks.workunit.client.0.smithi152.stdout:8/567: chown d1/d6/d29/d5b/fb1 9471 1 2023-12-06T15:00:34.216 INFO:tasks.workunit.client.0.smithi152.stdout:4/901: sync 2023-12-06T15:00:34.217 INFO:tasks.workunit.client.1.smithi190.stdout:5/826: write d0/f7 [6254829,50079] 0 2023-12-06T15:00:34.217 INFO:tasks.workunit.client.0.smithi152.stdout:8/568: rmdir d1/d6/d29/d5b 39 2023-12-06T15:00:34.217 INFO:tasks.workunit.client.0.smithi152.stdout:8/569: truncate d1/d6/d34/d6f/fab 858642 0 2023-12-06T15:00:34.222 INFO:tasks.workunit.client.0.smithi152.stdout:4/902: creat d2/d10/dab/d125/f127 x:0 0 0 2023-12-06T15:00:34.222 INFO:tasks.workunit.client.0.smithi152.stdout:4/903: getdents d2/d10/dc8/d100 0 2023-12-06T15:00:34.222 INFO:tasks.workunit.client.0.smithi152.stdout:2/580: dwrite d6/db/f96 [0,4194304] 0 2023-12-06T15:00:34.223 INFO:tasks.workunit.client.1.smithi190.stdout:2/871: creat d10/d26/d5c/d35/f123 x:0 0 0 2023-12-06T15:00:34.223 INFO:tasks.workunit.client.1.smithi190.stdout:0/818: getdents d0/da/d5a/dc8 0 2023-12-06T15:00:34.226 INFO:tasks.workunit.client.0.smithi152.stdout:2/581: creat d6/d1e/d41/d55/fbd x:0 0 0 2023-12-06T15:00:34.227 INFO:tasks.workunit.client.0.smithi152.stdout:8/570: dread d1/d6/d34/d40/f9f [0,4194304] 0 2023-12-06T15:00:34.229 INFO:tasks.workunit.client.0.smithi152.stdout:8/571: getdents d1/d6/d34/d35/d8d 0 2023-12-06T15:00:34.230 INFO:tasks.workunit.client.1.smithi190.stdout:5/827: symlink d0/d1c/d85/d90/dba/l120 0 2023-12-06T15:00:34.230 INFO:tasks.workunit.client.1.smithi190.stdout:0/819: symlink d0/da/d3e/db8/l10e 0 2023-12-06T15:00:34.230 INFO:tasks.workunit.client.1.smithi190.stdout:0/820: truncate d0/da/d3e/d3a/d40/ff5 1346788 0 2023-12-06T15:00:34.230 INFO:tasks.workunit.client.1.smithi190.stdout:2/872: creat d10/d26/d5c/d35/f124 x:0 0 0 2023-12-06T15:00:34.231 INFO:tasks.workunit.client.0.smithi152.stdout:8/572: mkdir d1/d6/d34/d35/d66/d82/db6 0 2023-12-06T15:00:34.232 INFO:tasks.workunit.client.0.smithi152.stdout:8/573: rmdir d1/d6/d29/d87/daa 39 2023-12-06T15:00:34.233 INFO:tasks.workunit.client.1.smithi190.stdout:0/821: rename d0/da/d3e/d87 to d0/da/d3e/d2b/d3c/d10f 0 2023-12-06T15:00:34.233 INFO:tasks.workunit.client.1.smithi190.stdout:0/822: chown d0/da/d3e/d2b/d3c/d46/d8e/d90/dda 582648 1 2023-12-06T15:00:34.234 INFO:tasks.workunit.client.0.smithi152.stdout:0/600: sync 2023-12-06T15:00:34.236 INFO:tasks.workunit.client.1.smithi190.stdout:8/875: dwrite d1/d20/d3b/d4c/d8e/fac [0,4194304] 0 2023-12-06T15:00:34.236 INFO:tasks.workunit.client.1.smithi190.stdout:8/876: dread - d1/fee zero size 2023-12-06T15:00:34.236 INFO:tasks.workunit.client.1.smithi190.stdout:8/877: truncate d1/d20/d3b/d4c/d8e/d94/fb8 2514 0 2023-12-06T15:00:34.239 INFO:tasks.workunit.client.0.smithi152.stdout:4/904: dread d2/d15/d32/f66 [0,4194304] 0 2023-12-06T15:00:34.239 INFO:tasks.workunit.client.0.smithi152.stdout:4/905: chown d2/d45/d84/c9b 13495947 1 2023-12-06T15:00:34.240 INFO:tasks.workunit.client.1.smithi190.stdout:0/823: mkdir d0/da/d3e/db8/d110 0 2023-12-06T15:00:34.240 INFO:tasks.workunit.client.1.smithi190.stdout:0/824: dread - d0/da/d3e/d2b/d3c/d46/f107 zero size 2023-12-06T15:00:34.242 INFO:tasks.workunit.client.0.smithi152.stdout:4/906: unlink d2/d10/dbb/dca/dcb/fc9 0 2023-12-06T15:00:34.242 INFO:tasks.workunit.client.0.smithi152.stdout:4/907: dread - d2/d15/d32/d69/d6f/fff zero size 2023-12-06T15:00:34.245 INFO:tasks.workunit.client.0.smithi152.stdout:2/582: dread d6/db/d17/f28 [4194304,4194304] 0 2023-12-06T15:00:34.246 INFO:tasks.workunit.client.0.smithi152.stdout:2/583: stat d6/d1e/d41/da2 0 2023-12-06T15:00:34.248 INFO:tasks.workunit.client.1.smithi190.stdout:0/825: mkdir d0/da/da4/db1/d111 0 2023-12-06T15:00:34.248 INFO:tasks.workunit.client.1.smithi190.stdout:0/826: fdatasync d0/da/da4/db1/ffb 0 2023-12-06T15:00:34.248 INFO:tasks.workunit.client.1.smithi190.stdout:8/878: creat d1/d20/d3b/d31/d87/f10a x:0 0 0 2023-12-06T15:00:34.248 INFO:tasks.workunit.client.1.smithi190.stdout:8/879: write d1/d20/d3b/d4c/d8e/fd2 [4276790,11003] 0 2023-12-06T15:00:34.249 INFO:tasks.workunit.client.0.smithi152.stdout:5/721: dwrite d7/dd/d26/d3b/d46/dc9/fdb [0,4194304] 0 2023-12-06T15:00:34.249 INFO:tasks.workunit.client.0.smithi152.stdout:4/908: mknod d2/d10/dbb/dca/dbc/d75/c128 0 2023-12-06T15:00:34.257 INFO:tasks.workunit.client.0.smithi152.stdout:2/584: truncate d6/db/d17/f75 328070 0 2023-12-06T15:00:34.257 INFO:tasks.workunit.client.0.smithi152.stdout:2/585: stat d6/db/d17/f74 0 2023-12-06T15:00:34.259 INFO:tasks.workunit.client.0.smithi152.stdout:9/622: dwrite d0/d3f/d68/d6c/d20/d38/d48/d90/f95 [0,4194304] 0 2023-12-06T15:00:34.260 INFO:tasks.workunit.client.0.smithi152.stdout:1/928: dwrite d3/da/d4c/ffb [0,4194304] 0 2023-12-06T15:00:34.261 INFO:tasks.workunit.client.0.smithi152.stdout:2/586: unlink d6/d1e/c44 0 2023-12-06T15:00:34.262 INFO:tasks.workunit.client.0.smithi152.stdout:2/587: write d6/d1e/f77 [793783,88733] 0 2023-12-06T15:00:34.263 INFO:tasks.workunit.client.1.smithi190.stdout:8/880: write d1/f16 [559564,36112] 0 2023-12-06T15:00:34.266 INFO:tasks.workunit.client.0.smithi152.stdout:9/623: getdents d0/d3f/d68/d6c/d92 0 2023-12-06T15:00:34.266 INFO:tasks.workunit.client.1.smithi190.stdout:2/873: dwrite d10/d59/dcd/dad/dc4/d76/db1/fd0 [0,4194304] 0 2023-12-06T15:00:34.268 INFO:tasks.workunit.client.0.smithi152.stdout:1/929: rename d3/da/db/da0 to d3/da/db/d14c 0 2023-12-06T15:00:34.268 INFO:tasks.workunit.client.0.smithi152.stdout:1/930: write d3/da/d15/d17/d1a/f38 [4951883,72055] 0 2023-12-06T15:00:34.269 INFO:tasks.workunit.client.1.smithi190.stdout:2/874: symlink d10/d26/d5c/d8d/l125 0 2023-12-06T15:00:34.270 INFO:tasks.workunit.client.0.smithi152.stdout:9/624: creat d0/d3f/d68/d6c/d20/d4a/d71/db1/fb7 x:0 0 0 2023-12-06T15:00:34.270 INFO:tasks.workunit.client.0.smithi152.stdout:9/625: chown d0/d3f/d68/d6c/d20/d38/d48/f70 3028899 1 2023-12-06T15:00:34.271 INFO:tasks.workunit.client.0.smithi152.stdout:1/931: rename d3/d44/f109 to d3/da/d15/d17/d43/f14d 0 2023-12-06T15:00:34.274 INFO:tasks.workunit.client.0.smithi152.stdout:9/626: mkdir d0/db8 0 2023-12-06T15:00:34.274 INFO:tasks.workunit.client.0.smithi152.stdout:1/932: mkdir d3/da/d15/d17/d4d/d14e 0 2023-12-06T15:00:34.274 INFO:tasks.workunit.client.0.smithi152.stdout:9/627: fsync d0/d3f/d68/d6c/fe 0 2023-12-06T15:00:34.275 INFO:tasks.workunit.client.0.smithi152.stdout:9/628: write d0/d3f/d68/d6c/d20/f51 [2938228,30206] 0 2023-12-06T15:00:34.275 INFO:tasks.workunit.client.0.smithi152.stdout:1/933: rmdir d3/da/d15/d17 39 2023-12-06T15:00:34.277 INFO:tasks.workunit.client.0.smithi152.stdout:1/934: read d3/da/d15/d17/d147/d55/f74 [1486921,45014] 0 2023-12-06T15:00:34.284 INFO:tasks.workunit.client.1.smithi190.stdout:5/828: dwrite d0/d1c/d85/d90/d99/fa3 [0,4194304] 0 2023-12-06T15:00:34.285 INFO:tasks.workunit.client.0.smithi152.stdout:9/629: dread d0/d3f/d68/d6c/f17 [4194304,4194304] 0 2023-12-06T15:00:34.289 INFO:tasks.workunit.client.0.smithi152.stdout:9/630: write d0/d3f/d68/d6c/d20/d4a/d4d/fa6 [3087477,36696] 0 2023-12-06T15:00:34.289 INFO:tasks.workunit.client.1.smithi190.stdout:5/829: mknod d0/df/c121 0 2023-12-06T15:00:34.291 INFO:tasks.workunit.client.1.smithi190.stdout:5/830: write d0/d1c/d2b/d2c/d5d/d73/d116/dc5/dd5/fc6 [199071,106624] 0 2023-12-06T15:00:34.291 INFO:tasks.workunit.client.1.smithi190.stdout:5/831: chown d0/d1c/d3e/dea/df5 466 1 2023-12-06T15:00:34.291 INFO:tasks.workunit.client.0.smithi152.stdout:9/631: mknod d0/d3f/d68/d6c/d20/d4a/cb9 0 2023-12-06T15:00:34.292 INFO:tasks.workunit.client.0.smithi152.stdout:9/632: chown d0/d3f/d68/d6c/d92 45 1 2023-12-06T15:00:34.292 INFO:tasks.workunit.client.0.smithi152.stdout:1/935: dread d3/da/d15/d17/d43/de6/fe8 [0,4194304] 0 2023-12-06T15:00:34.292 INFO:tasks.workunit.client.0.smithi152.stdout:0/601: dwrite d8/d15/d45/d73/d7a/f5b [4194304,4194304] 0 2023-12-06T15:00:34.292 INFO:tasks.workunit.client.0.smithi152.stdout:8/574: dwrite d1/d6/f1b [4194304,4194304] 0 2023-12-06T15:00:34.293 INFO:tasks.workunit.client.0.smithi152.stdout:1/936: write d3/da/d15/d17/d147/d62/dcc/f12e [606754,49072] 0 2023-12-06T15:00:34.293 INFO:tasks.workunit.client.0.smithi152.stdout:1/937: write d3/f7 [1973355,84030] 0 2023-12-06T15:00:34.293 INFO:tasks.workunit.client.0.smithi152.stdout:1/938: chown d3/da/d15/f3f 55176 1 2023-12-06T15:00:34.301 INFO:tasks.workunit.client.0.smithi152.stdout:9/633: dread d0/d3f/d5f/d60/da1/f73 [0,4194304] 0 2023-12-06T15:00:34.302 INFO:tasks.workunit.client.0.smithi152.stdout:5/722: dwrite d7/f28 [0,4194304] 0 2023-12-06T15:00:34.303 INFO:tasks.workunit.client.1.smithi190.stdout:2/875: dwrite d10/d59/dcd/dad/f100 [0,4194304] 0 2023-12-06T15:00:34.305 INFO:tasks.workunit.client.0.smithi152.stdout:0/602: link d8/d15/d45/da4/fb4 d8/fc6 0 2023-12-06T15:00:34.305 INFO:tasks.workunit.client.0.smithi152.stdout:0/603: write d8/d4b/f9e [75047,12923] 0 2023-12-06T15:00:34.305 INFO:tasks.workunit.client.1.smithi190.stdout:8/881: rename d1/d20/d3b/d31 to d1/dd1/d10b 0 2023-12-06T15:00:34.306 INFO:tasks.workunit.client.0.smithi152.stdout:9/634: creat d0/d3f/d68/d9f/fba x:0 0 0 2023-12-06T15:00:34.306 INFO:tasks.workunit.client.0.smithi152.stdout:9/635: chown d0/d3f/d68/d6c/d20/db0/d94 11154166 1 2023-12-06T15:00:34.306 INFO:tasks.workunit.client.0.smithi152.stdout:9/636: chown d0/d3f/d68/d6c/d20/d38/d48/d90/f97 109 1 2023-12-06T15:00:34.306 INFO:tasks.workunit.client.0.smithi152.stdout:9/637: chown d0/d3f/d5f/c83 15 1 2023-12-06T15:00:34.306 INFO:tasks.workunit.client.0.smithi152.stdout:9/638: chown d0/d3f/d68/d6c/d20/d38/d48/d90 11 1 2023-12-06T15:00:34.306 INFO:tasks.workunit.client.0.smithi152.stdout:9/639: stat d0/d3f/d68/d6c/d20/d38/d45/c5d 0 2023-12-06T15:00:34.310 INFO:tasks.workunit.client.0.smithi152.stdout:5/723: mkdir d7/dd/dfc 0 2023-12-06T15:00:34.310 INFO:tasks.workunit.client.0.smithi152.stdout:2/588: dread d6/db/d17/f75 [0,4194304] 0 2023-12-06T15:00:34.314 INFO:tasks.workunit.client.1.smithi190.stdout:8/882: rename d1/d20/d3b/d36/d50/fda to d1/d20/d3b/d4c/d5a/dfb/f10c 0 2023-12-06T15:00:34.314 INFO:tasks.workunit.client.1.smithi190.stdout:8/883: dread - d1/d20/d3b/d36/d105/f107 zero size 2023-12-06T15:00:34.315 INFO:tasks.workunit.client.0.smithi152.stdout:8/575: link d1/d6/d34/c13 d1/d6/d34/d3a/cb7 0 2023-12-06T15:00:34.316 INFO:tasks.workunit.client.0.smithi152.stdout:9/640: mkdir d0/d3f/d5f/dbb 0 2023-12-06T15:00:34.316 INFO:tasks.workunit.client.1.smithi190.stdout:2/876: mknod d10/d59/dcd/dad/dc4/d7f/d8e/c126 0 2023-12-06T15:00:34.316 INFO:tasks.workunit.client.1.smithi190.stdout:2/877: chown d10/d26/d5c/d49/d54/f61 0 1 2023-12-06T15:00:34.318 INFO:tasks.workunit.client.0.smithi152.stdout:5/724: mknod d7/dd/d26/cfd 0 2023-12-06T15:00:34.318 INFO:tasks.workunit.client.1.smithi190.stdout:2/878: mknod d10/d59/c127 0 2023-12-06T15:00:34.318 INFO:tasks.workunit.client.1.smithi190.stdout:2/879: chown d10/d26/l3b 0 1 2023-12-06T15:00:34.321 INFO:tasks.workunit.client.0.smithi152.stdout:5/725: creat d7/d43/d9c/dfb/ffe x:0 0 0 2023-12-06T15:00:34.322 INFO:tasks.workunit.client.0.smithi152.stdout:9/641: dread d0/d3f/d68/d6c/d20/d38/d48/d90/f97 [0,4194304] 0 2023-12-06T15:00:34.326 INFO:tasks.workunit.client.0.smithi152.stdout:1/939: dwrite d3/d44/d84/de2/f122 [0,4194304] 0 2023-12-06T15:00:34.327 INFO:tasks.workunit.client.0.smithi152.stdout:0/604: dwrite d8/d15/d45/d73/d7a/f39 [0,4194304] 0 2023-12-06T15:00:34.329 INFO:tasks.workunit.client.0.smithi152.stdout:5/726: rename d7/caa to d7/d43/cff 0 2023-12-06T15:00:34.329 INFO:tasks.workunit.client.0.smithi152.stdout:7/493: sync 2023-12-06T15:00:34.331 INFO:tasks.workunit.client.1.smithi190.stdout:5/832: dwrite d0/d1c/d2b/fc2 [0,4194304] 0 2023-12-06T15:00:34.338 INFO:tasks.workunit.client.1.smithi190.stdout:4/847: sync 2023-12-06T15:00:34.341 INFO:tasks.workunit.client.0.smithi152.stdout:9/642: rename d0/d3f/d5f/c83 to d0/d3f/d68/d6c/d20/d38/cbc 0 2023-12-06T15:00:34.341 INFO:tasks.workunit.client.0.smithi152.stdout:7/494: creat dd/df/d1b/d20/d28/d53/f99 x:0 0 0 2023-12-06T15:00:34.341 INFO:tasks.workunit.client.0.smithi152.stdout:6/832: sync 2023-12-06T15:00:34.341 INFO:tasks.workunit.client.0.smithi152.stdout:7/495: truncate dd/d69/f3d 628139 0 2023-12-06T15:00:34.341 INFO:tasks.workunit.client.0.smithi152.stdout:9/643: write d0/d3f/d68/d6c/d20/d38/d45/f63 [435243,63437] 0 2023-12-06T15:00:34.341 INFO:tasks.workunit.client.0.smithi152.stdout:7/496: write dd/df/d1b/d20/d7c/f88 [928255,4894] 0 2023-12-06T15:00:34.342 INFO:tasks.workunit.client.0.smithi152.stdout:3/614: sync 2023-12-06T15:00:34.345 INFO:tasks.workunit.client.0.smithi152.stdout:6/833: creat d1/dcf/ddc/d1a/d30/d36/d4e/d101/f122 x:0 0 0 2023-12-06T15:00:34.345 INFO:tasks.workunit.client.0.smithi152.stdout:9/644: symlink d0/d3f/d5f/d60/da1/lbd 0 2023-12-06T15:00:34.345 INFO:tasks.workunit.client.0.smithi152.stdout:7/497: rmdir dd/df/d1b/d20/d28 39 2023-12-06T15:00:34.346 INFO:tasks.workunit.client.1.smithi190.stdout:4/848: write d3/d35/d19/d41/d44/d5b/f6f [3745593,83938] 0 2023-12-06T15:00:34.347 INFO:tasks.workunit.client.0.smithi152.stdout:3/615: symlink d9/lc0 0 2023-12-06T15:00:34.348 INFO:tasks.workunit.client.0.smithi152.stdout:6/834: truncate d1/fa3 2195824 0 2023-12-06T15:00:34.349 INFO:tasks.workunit.client.1.smithi190.stdout:4/849: mkdir d3/d76/dc4/dc5/d3c/d116/d15/d12b 0 2023-12-06T15:00:34.350 INFO:tasks.workunit.client.0.smithi152.stdout:7/498: mknod dd/df/d34/d44/c9a 0 2023-12-06T15:00:34.350 INFO:tasks.workunit.client.1.smithi190.stdout:4/850: symlink d3/d76/d7c/l12c 0 2023-12-06T15:00:34.351 INFO:tasks.workunit.client.1.smithi190.stdout:4/851: mkdir d3/d4e/d119/d12d 0 2023-12-06T15:00:34.353 INFO:tasks.workunit.client.1.smithi190.stdout:4/852: mknod d3/d76/d7c/db9/def/c12e 0 2023-12-06T15:00:34.353 INFO:tasks.workunit.client.1.smithi190.stdout:4/853: fsync d3/f9 0 2023-12-06T15:00:34.353 INFO:tasks.workunit.client.1.smithi190.stdout:4/854: read - d3/d76/d7c/fe9 zero size 2023-12-06T15:00:34.353 INFO:tasks.workunit.client.1.smithi190.stdout:4/855: truncate d3/d76/d8b/fb3 4917602 0 2023-12-06T15:00:34.353 INFO:tasks.workunit.client.1.smithi190.stdout:4/856: fdatasync d3/d76/dc4/dc5/d3c/d116/d15/f2f 0 2023-12-06T15:00:34.354 INFO:tasks.workunit.client.0.smithi152.stdout:2/589: dwrite d6/db/d17/f74 [4194304,4194304] 0 2023-12-06T15:00:34.354 INFO:tasks.workunit.client.0.smithi152.stdout:2/590: chown d6/d18/d43/d95/cb6 341304 1 2023-12-06T15:00:34.354 INFO:tasks.workunit.client.0.smithi152.stdout:2/591: chown d6/d1e/l8f 1993268409 1 2023-12-06T15:00:34.354 INFO:tasks.workunit.client.0.smithi152.stdout:6/835: truncate d1/dcf/ddc/d6d/f7f 502066 0 2023-12-06T15:00:34.355 INFO:tasks.workunit.client.0.smithi152.stdout:7/499: mknod dd/df/d1b/d20/d28/d53/c9b 0 2023-12-06T15:00:34.355 INFO:tasks.workunit.client.1.smithi190.stdout:4/857: symlink d3/d76/dc4/dc5/d3c/d116/d15/d103/l12f 0 2023-12-06T15:00:34.355 INFO:tasks.workunit.client.1.smithi190.stdout:4/858: write d3/d76/dc4/dc5/d3c/d116/d15/f2f [423120,105409] 0 2023-12-06T15:00:34.355 INFO:tasks.workunit.client.1.smithi190.stdout:4/859: write d3/d35/d19/d41/d44/d11d/f113 [190012,127574] 0 2023-12-06T15:00:34.355 INFO:tasks.workunit.client.1.smithi190.stdout:4/860: chown d3/d35/d19/l24 6661978 1 2023-12-06T15:00:34.356 INFO:tasks.workunit.client.1.smithi190.stdout:4/861: mkdir d3/d76/d7c/d130 0 2023-12-06T15:00:34.357 INFO:tasks.workunit.client.1.smithi190.stdout:4/862: mknod d3/d35/d19/d67/c131 0 2023-12-06T15:00:34.358 INFO:tasks.workunit.client.0.smithi152.stdout:2/592: creat d6/d1e/d41/d83/fbe x:0 0 0 2023-12-06T15:00:34.359 INFO:tasks.workunit.client.0.smithi152.stdout:6/836: mknod d1/dcf/c123 0 2023-12-06T15:00:34.360 INFO:tasks.workunit.client.0.smithi152.stdout:7/500: link dd/df/d1b/d20/d28/d53/c4c dd/d17/c9c 0 2023-12-06T15:00:34.361 INFO:tasks.workunit.client.0.smithi152.stdout:6/837: truncate d1/d69/da1/deb/f10b 286629 0 2023-12-06T15:00:34.366 INFO:tasks.workunit.client.0.smithi152.stdout:6/838: write d1/d69/da1/deb/ffd [1768663,118030] 0 2023-12-06T15:00:34.369 INFO:tasks.workunit.client.0.smithi152.stdout:6/839: unlink d1/dcf/ddc/d1a/d30/d36/d26/l76 0 2023-12-06T15:00:34.370 INFO:tasks.workunit.client.0.smithi152.stdout:6/840: truncate d1/dcf/ddc/d1a/f54 2669510 0 2023-12-06T15:00:34.370 INFO:tasks.workunit.client.0.smithi152.stdout:0/605: dread d8/d4b/f9e [0,4194304] 0 2023-12-06T15:00:34.371 INFO:tasks.workunit.client.0.smithi152.stdout:0/606: symlink d8/d3e/lc7 0 2023-12-06T15:00:34.373 INFO:tasks.workunit.client.0.smithi152.stdout:6/841: read d1/dcf/ddc/d1a/d30/fe [7824217,79606] 0 2023-12-06T15:00:34.373 INFO:tasks.workunit.client.0.smithi152.stdout:0/607: rmdir d8/d3e 39 2023-12-06T15:00:34.373 INFO:tasks.workunit.client.0.smithi152.stdout:6/842: chown d1/dcf/ddc/d1a/d30/d36/d35/d49/d57/l5b 3879 1 2023-12-06T15:00:34.373 INFO:tasks.workunit.client.0.smithi152.stdout:2/593: dread d6/db/d17/fad [0,4194304] 0 2023-12-06T15:00:34.373 INFO:tasks.workunit.client.0.smithi152.stdout:2/594: fsync d6/d18/d70/f84 0 2023-12-06T15:00:34.373 INFO:tasks.workunit.client.0.smithi152.stdout:2/595: fsync d6/d18/f58 0 2023-12-06T15:00:34.374 INFO:tasks.workunit.client.0.smithi152.stdout:0/608: creat d8/d15/d45/da2/fc8 x:0 0 0 2023-12-06T15:00:34.375 INFO:tasks.workunit.client.1.smithi190.stdout:2/880: dwrite d10/d26/d5c/d42/d9d/ff0 [0,4194304] 0 2023-12-06T15:00:34.377 INFO:tasks.workunit.client.0.smithi152.stdout:8/576: dwrite d1/d6/d34/d6f/f70 [0,4194304] 0 2023-12-06T15:00:34.378 INFO:tasks.workunit.client.1.smithi190.stdout:2/881: creat d10/d26/d8a/d8f/f128 x:0 0 0 2023-12-06T15:00:34.380 INFO:tasks.workunit.client.1.smithi190.stdout:2/882: truncate d10/d59/dcd/dad/dc4/fca 572501 0 2023-12-06T15:00:34.381 INFO:tasks.workunit.client.0.smithi152.stdout:8/577: truncate d1/d6/d34/d40/f52 2726679 0 2023-12-06T15:00:34.381 INFO:tasks.workunit.client.1.smithi190.stdout:2/883: mknod d10/d26/d5c/d49/d7e/c129 0 2023-12-06T15:00:34.382 INFO:tasks.workunit.client.0.smithi152.stdout:8/578: symlink d1/d6/d29/d87/daa/lb8 0 2023-12-06T15:00:34.382 INFO:tasks.workunit.client.0.smithi152.stdout:6/843: write d1/dcf/ddc/d1a/d30/d36/d35/d63/f9b [2238563,95779] 0 2023-12-06T15:00:34.383 INFO:tasks.workunit.client.0.smithi152.stdout:8/579: chown d1/d6/fa3 108 1 2023-12-06T15:00:34.387 INFO:tasks.workunit.client.0.smithi152.stdout:6/844: rename d1/dcf/ddc/f48 to d1/dcf/ddc/d1a/d30/d18/f124 0 2023-12-06T15:00:34.387 INFO:tasks.workunit.client.0.smithi152.stdout:8/580: unlink d1/d6/d34/d35/f9b 0 2023-12-06T15:00:34.387 INFO:tasks.workunit.client.0.smithi152.stdout:6/845: chown d1/dcf/ddc/d1a/d30/d36/d35/lcd 3 1 2023-12-06T15:00:34.388 INFO:tasks.workunit.client.1.smithi190.stdout:5/833: dwrite d0/f2a [0,4194304] 0 2023-12-06T15:00:34.388 INFO:tasks.workunit.client.0.smithi152.stdout:5/727: dwrite d7/dd/d26/f32 [0,4194304] 0 2023-12-06T15:00:34.388 INFO:tasks.workunit.client.0.smithi152.stdout:9/645: dwrite d0/d3f/d68/d6c/d20/f5a [0,4194304] 0 2023-12-06T15:00:34.388 INFO:tasks.workunit.client.0.smithi152.stdout:9/646: dread - d0/d3f/d68/d6c/d20/d38/d44/f8a zero size 2023-12-06T15:00:34.389 INFO:tasks.workunit.client.1.smithi190.stdout:2/884: creat d10/d59/d118/f12a x:0 0 0 2023-12-06T15:00:34.389 INFO:tasks.workunit.client.0.smithi152.stdout:6/846: dread d1/d89/ff2 [4194304,4194304] 0 2023-12-06T15:00:34.391 INFO:tasks.workunit.client.1.smithi190.stdout:5/834: unlink d0/d1c/d2b/d2c/d5d/fb5 0 2023-12-06T15:00:34.392 INFO:tasks.workunit.client.1.smithi190.stdout:2/885: mkdir d10/d26/d8a/d8f/d12b 0 2023-12-06T15:00:34.394 INFO:tasks.workunit.client.1.smithi190.stdout:2/886: creat d10/d26/d8a/d8f/f12c x:0 0 0 2023-12-06T15:00:34.397 INFO:tasks.workunit.client.0.smithi152.stdout:7/501: dwrite dd/df/d34/f8a [0,4194304] 0 2023-12-06T15:00:34.397 INFO:tasks.workunit.client.1.smithi190.stdout:4/863: truncate d3/d35/d19/d41/d44/d5b/f6f 3230461 0 2023-12-06T15:00:34.403 INFO:tasks.workunit.client.0.smithi152.stdout:5/728: mkdir d7/dd/d26/d87/d100 0 2023-12-06T15:00:34.403 INFO:tasks.workunit.client.0.smithi152.stdout:9/647: link d0/d3f/d68/d6c/d20/db0/f79 d0/d3f/d68/d6c/d20/d38/fbe 0 2023-12-06T15:00:34.403 INFO:tasks.workunit.client.0.smithi152.stdout:9/648: fsync d0/d3f/d68/d6c/d20/d38/d45/f64 0 2023-12-06T15:00:34.405 INFO:tasks.workunit.client.0.smithi152.stdout:2/596: dwrite d6/db/f2b [0,4194304] 0 2023-12-06T15:00:34.405 INFO:tasks.workunit.client.0.smithi152.stdout:9/649: symlink d0/d3f/d68/d6c/d20/d38/d48/d90/lbf 0 2023-12-06T15:00:34.407 INFO:tasks.workunit.client.0.smithi152.stdout:9/650: write d0/d3f/d68/d6c/d20/d38/d45/f66 [1882110,62498] 0 2023-12-06T15:00:34.408 INFO:tasks.workunit.client.0.smithi152.stdout:3/616: rmdir d9 39 2023-12-06T15:00:34.408 INFO:tasks.workunit.client.0.smithi152.stdout:3/617: chown d9/d10/d12/d43/d52/db4/d77/db6 20157 1 2023-12-06T15:00:34.408 INFO:tasks.workunit.client.0.smithi152.stdout:3/618: chown d9/d18/d39/f4a 396652558 1 2023-12-06T15:00:34.408 INFO:tasks.workunit.client.0.smithi152.stdout:3/619: truncate d9/d10/d12/d43/d52/f7a 517380 0 2023-12-06T15:00:34.410 INFO:tasks.workunit.client.0.smithi152.stdout:2/597: unlink d6/d1e/l3a 0 2023-12-06T15:00:34.411 INFO:tasks.workunit.client.1.smithi190.stdout:4/864: dread d3/d76/dc4/dc5/d3c/d116/d39/d54/f60 [0,4194304] 0 2023-12-06T15:00:34.411 INFO:tasks.workunit.client.1.smithi190.stdout:4/865: dread - d3/d76/dc4/dc5/f105 zero size 2023-12-06T15:00:34.411 INFO:tasks.workunit.client.1.smithi190.stdout:4/866: write d3/d35/d19/d41/d44/d9c/f121 [134403,63813] 0 2023-12-06T15:00:34.413 INFO:tasks.workunit.client.0.smithi152.stdout:9/651: creat d0/d3f/d68/d6c/d20/db0/db3/fc0 x:0 0 0 2023-12-06T15:00:34.415 INFO:tasks.workunit.client.0.smithi152.stdout:6/847: rmdir d1/dcf/ddc/d1a/d30/d36/d26 39 2023-12-06T15:00:34.415 INFO:tasks.workunit.client.0.smithi152.stdout:6/848: stat d1/d69/fa0 0 2023-12-06T15:00:34.415 INFO:tasks.workunit.client.0.smithi152.stdout:0/609: dwrite d8/f6d [0,4194304] 0 2023-12-06T15:00:34.416 INFO:tasks.workunit.client.0.smithi152.stdout:7/502: write dd/df/d1b/d20/d28/d53/f7a [146567,77571] 0 2023-12-06T15:00:34.416 INFO:tasks.workunit.client.0.smithi152.stdout:7/503: stat dd/df/f76 0 2023-12-06T15:00:34.418 INFO:tasks.workunit.client.0.smithi152.stdout:6/849: symlink d1/dcf/ddc/d1a/d30/d36/d35/d63/d86/l125 0 2023-12-06T15:00:34.419 INFO:tasks.workunit.client.0.smithi152.stdout:0/610: rename d8/c63 to d8/d15/d45/cc9 0 2023-12-06T15:00:34.419 INFO:tasks.workunit.client.0.smithi152.stdout:5/729: write d7/dd/d26/d3b/d46/dc9/fdb [3458571,80643] 0 2023-12-06T15:00:34.426 INFO:tasks.workunit.client.0.smithi152.stdout:2/598: dread d6/d18/d70/f84 [0,4194304] 0 2023-12-06T15:00:34.428 INFO:tasks.workunit.client.0.smithi152.stdout:0/611: creat d8/d3e/fca x:0 0 0 2023-12-06T15:00:34.428 INFO:tasks.workunit.client.0.smithi152.stdout:5/730: creat d7/d43/d9c/f101 x:0 0 0 2023-12-06T15:00:34.430 INFO:tasks.workunit.client.0.smithi152.stdout:2/599: mkdir d6/d1e/d41/d92/dbf 0 2023-12-06T15:00:34.430 INFO:tasks.workunit.client.0.smithi152.stdout:6/850: mknod d1/dcf/ddc/d6d/c126 0 2023-12-06T15:00:34.432 INFO:tasks.workunit.client.0.smithi152.stdout:0/612: rename d8/d44/l4d to d8/d3e/lcb 0 2023-12-06T15:00:34.432 INFO:tasks.workunit.client.0.smithi152.stdout:0/613: fdatasync d8/d3e/d87/f90 0 2023-12-06T15:00:34.433 INFO:tasks.workunit.client.0.smithi152.stdout:7/504: dread f8 [0,4194304] 0 2023-12-06T15:00:34.434 INFO:tasks.workunit.client.0.smithi152.stdout:6/851: rename d1/d69/da1/deb/d112/f114 to d1/dcf/ddc/d1a/d30/d18/dc5/f127 0 2023-12-06T15:00:34.434 INFO:tasks.workunit.client.0.smithi152.stdout:0/614: mkdir d8/dcc 0 2023-12-06T15:00:34.434 INFO:tasks.workunit.client.0.smithi152.stdout:9/652: dread d0/f30 [0,4194304] 0 2023-12-06T15:00:34.435 INFO:tasks.workunit.client.0.smithi152.stdout:5/731: dread d7/f21 [0,4194304] 0 2023-12-06T15:00:34.435 INFO:tasks.workunit.client.0.smithi152.stdout:7/505: symlink dd/df/d1b/d4e/l9d 0 2023-12-06T15:00:34.436 INFO:tasks.workunit.client.0.smithi152.stdout:6/852: mknod d1/d69/da1/deb/c128 0 2023-12-06T15:00:34.436 INFO:tasks.workunit.client.0.smithi152.stdout:7/506: truncate dd/d17/f6c 998761 0 2023-12-06T15:00:34.436 INFO:tasks.workunit.client.0.smithi152.stdout:0/615: creat d8/d15/d45/d73/db9/dc4/fcd x:0 0 0 2023-12-06T15:00:34.441 INFO:tasks.workunit.client.0.smithi152.stdout:5/732: rename d7/dd/f20 to d7/dd/d26/d87/f102 0 2023-12-06T15:00:34.441 INFO:tasks.workunit.client.0.smithi152.stdout:6/853: mkdir d1/d1c/d129 0 2023-12-06T15:00:34.441 INFO:tasks.workunit.client.0.smithi152.stdout:0/616: symlink d8/d15/d45/d73/d8c/lce 0 2023-12-06T15:00:34.441 INFO:tasks.workunit.client.0.smithi152.stdout:0/617: write d8/d15/d45/fb8 [742390,93605] 0 2023-12-06T15:00:34.441 INFO:tasks.workunit.client.0.smithi152.stdout:5/733: truncate d7/f18 3747280 0 2023-12-06T15:00:34.442 INFO:tasks.workunit.client.0.smithi152.stdout:7/507: write f1 [2752807,51723] 0 2023-12-06T15:00:34.443 INFO:tasks.workunit.client.0.smithi152.stdout:0/618: rename d8/d3e/f9c to d8/d4b/fcf 0 2023-12-06T15:00:34.446 INFO:tasks.workunit.client.1.smithi190.stdout:5/835: dwrite d0/d1c/d85/fda [0,4194304] 0 2023-12-06T15:00:34.446 INFO:tasks.workunit.client.1.smithi190.stdout:5/836: truncate d0/d1c/d85/d90/dba/fd6 471376 0 2023-12-06T15:00:34.446 INFO:tasks.workunit.client.1.smithi190.stdout:5/837: readlink d0/d1c/d85/l9f 0 2023-12-06T15:00:34.446 INFO:tasks.workunit.client.1.smithi190.stdout:5/838: chown d0/d1c/d3e/dea/df5/f11f 746581 1 2023-12-06T15:00:34.446 INFO:tasks.workunit.client.1.smithi190.stdout:5/839: chown d0/d1c/d2b/d8b/ced 1 1 2023-12-06T15:00:34.446 INFO:tasks.workunit.client.0.smithi152.stdout:8/581: dwrite d1/d6/d34/fa2 [4194304,4194304] 0 2023-12-06T15:00:34.447 INFO:tasks.workunit.client.0.smithi152.stdout:7/508: mknod dd/df/d1b/d4e/c9e 0 2023-12-06T15:00:34.448 INFO:tasks.workunit.client.0.smithi152.stdout:2/600: dread d6/d1e/d7a/f7b [0,4194304] 0 2023-12-06T15:00:34.449 INFO:tasks.workunit.client.0.smithi152.stdout:0/619: truncate d8/d15/d45/d73/d7a/f34 1583595 0 2023-12-06T15:00:34.450 INFO:tasks.workunit.client.0.smithi152.stdout:1/940: dwrite d3/da/d4c/d82/db4/fc8 [0,4194304] 0 2023-12-06T15:00:34.450 INFO:tasks.workunit.client.0.smithi152.stdout:3/620: dwrite d9/d10/d19/f49 [0,4194304] 0 2023-12-06T15:00:34.450 INFO:tasks.workunit.client.0.smithi152.stdout:3/621: read - d9/d10/d12/d43/d52/db4/d65/fbb zero size 2023-12-06T15:00:34.450 INFO:tasks.workunit.client.0.smithi152.stdout:3/622: fsync d9/d10/f7f 0 2023-12-06T15:00:34.451 INFO:tasks.workunit.client.1.smithi190.stdout:2/887: dwrite d10/d26/d5c/fb3 [0,4194304] 0 2023-12-06T15:00:34.452 INFO:tasks.workunit.client.1.smithi190.stdout:5/840: rename d0/d1c/d3e/d7e/cbe to d0/d1c/d2b/d8b/c122 0 2023-12-06T15:00:34.452 INFO:tasks.workunit.client.0.smithi152.stdout:8/582: creat d1/d6/d34/fb9 x:0 0 0 2023-12-06T15:00:34.454 INFO:tasks.workunit.client.0.smithi152.stdout:7/509: symlink dd/df/d1b/d4e/l9f 0 2023-12-06T15:00:34.458 INFO:tasks.workunit.client.1.smithi190.stdout:5/841: write d0/f10d [1316807,74601] 0 2023-12-06T15:00:34.459 INFO:tasks.workunit.client.0.smithi152.stdout:0/620: rmdir d8/d15/d45 39 2023-12-06T15:00:34.459 INFO:tasks.workunit.client.0.smithi152.stdout:4/909: sync 2023-12-06T15:00:34.461 INFO:tasks.workunit.client.1.smithi190.stdout:2/888: rmdir d10/d26/d8a 39 2023-12-06T15:00:34.462 INFO:tasks.workunit.client.0.smithi152.stdout:1/941: symlink d3/da/d15/d17/d4d/d12f/l14f 0 2023-12-06T15:00:34.462 INFO:tasks.workunit.client.1.smithi190.stdout:5/842: mknod d0/deb/c123 0 2023-12-06T15:00:34.462 INFO:tasks.workunit.client.1.smithi190.stdout:2/889: dread d10/d59/dcd/dad/dc9/f10f [0,4194304] 0 2023-12-06T15:00:34.463 INFO:tasks.workunit.client.0.smithi152.stdout:3/623: mkdir d9/d10/d12/d43/d52/db4/dc1 0 2023-12-06T15:00:34.464 INFO:tasks.workunit.client.0.smithi152.stdout:9/653: dwrite d0/d3f/d5f/d60/da1/f52 [0,4194304] 0 2023-12-06T15:00:34.465 INFO:tasks.workunit.client.0.smithi152.stdout:0/621: creat d8/d15/d45/d73/db9/fd0 x:0 0 0 2023-12-06T15:00:34.468 INFO:tasks.workunit.client.0.smithi152.stdout:4/910: link d2/d15/d32/d79/c3c d2/d10/dbb/dca/dcb/c129 0 2023-12-06T15:00:34.471 INFO:tasks.workunit.client.1.smithi190.stdout:5/843: write d0/d1c/d3e/f60 [468983,91079] 0 2023-12-06T15:00:34.472 INFO:tasks.workunit.client.0.smithi152.stdout:3/624: mkdir d9/d10/d12/d43/d52/d58/dc2 0 2023-12-06T15:00:34.472 INFO:tasks.workunit.client.1.smithi190.stdout:5/844: chown d0/d1c/d2b/d2c/d5d/d73/l25 20 1 2023-12-06T15:00:34.473 INFO:tasks.workunit.client.1.smithi190.stdout:5/845: fsync d0/d1c/d3e/dea/f106 0 2023-12-06T15:00:34.476 INFO:tasks.workunit.client.0.smithi152.stdout:4/911: truncate d2/d45/f4e 1136650 0 2023-12-06T15:00:34.476 INFO:tasks.workunit.client.0.smithi152.stdout:4/912: stat d2/f3a 0 2023-12-06T15:00:34.477 INFO:tasks.workunit.client.0.smithi152.stdout:4/913: creat d2/d10/dbb/dca/f12a x:0 0 0 2023-12-06T15:00:34.477 INFO:tasks.workunit.client.0.smithi152.stdout:4/914: truncate d2/d10/dc8/ddb/f116 1039965 0 2023-12-06T15:00:34.478 INFO:tasks.workunit.client.0.smithi152.stdout:4/915: creat d2/d10/dbb/dca/dbc/f12b x:0 0 0 2023-12-06T15:00:34.479 INFO:tasks.workunit.client.0.smithi152.stdout:6/854: dwrite d1/dcf/ddc/d1a/d30/d36/d35/d49/da6/da9/fac [0,4194304] 0 2023-12-06T15:00:34.482 INFO:tasks.workunit.client.0.smithi152.stdout:6/855: mknod d1/dcf/ddc/d1a/d30/d36/d56/c12a 0 2023-12-06T15:00:34.482 INFO:tasks.workunit.client.0.smithi152.stdout:3/625: dread d9/d45/f53 [0,4194304] 0 2023-12-06T15:00:34.483 INFO:tasks.workunit.client.0.smithi152.stdout:6/856: mknod d1/dcf/ddc/d1a/d30/d36/d4e/d11b/c12b 0 2023-12-06T15:00:34.484 INFO:tasks.workunit.client.1.smithi190.stdout:4/867: write d3/d35/d19/d41/d44/d5b/f6f [2755179,27582] 0 2023-12-06T15:00:34.485 INFO:tasks.workunit.client.1.smithi190.stdout:4/868: truncate d3/d4e/f73 2350309 0 2023-12-06T15:00:34.485 INFO:tasks.workunit.client.1.smithi190.stdout:4/869: write d3/d35/d19/d41/d44/f9f [4383917,64579] 0 2023-12-06T15:00:34.485 INFO:tasks.workunit.client.0.smithi152.stdout:3/626: rename d9/d10/d12/d43/d52/db4/d77 to d9/d18/d51/d8d/d8f/da0/dab/dc3 0 2023-12-06T15:00:34.486 INFO:tasks.workunit.client.1.smithi190.stdout:4/870: creat d3/d76/d7c/d8a/f132 x:0 0 0 2023-12-06T15:00:34.487 INFO:tasks.workunit.client.0.smithi152.stdout:6/857: symlink d1/dcf/ddc/d1a/d30/d36/d35/d49/l12c 0 2023-12-06T15:00:34.490 INFO:tasks.workunit.client.0.smithi152.stdout:2/601: getdents d6/d1e/d41/d92 0 2023-12-06T15:00:34.490 INFO:tasks.workunit.client.0.smithi152.stdout:2/602: write d6/fab [87496,61763] 0 2023-12-06T15:00:34.492 INFO:tasks.workunit.client.0.smithi152.stdout:5/734: dwrite d7/dd/d26/d48/fcf [0,4194304] 0 2023-12-06T15:00:34.493 INFO:tasks.workunit.client.1.smithi190.stdout:5/846: dread d0/d6c/fd4 [0,4194304] 0 2023-12-06T15:00:34.493 INFO:tasks.workunit.client.1.smithi190.stdout:5/847: fdatasync d0/f82 0 2023-12-06T15:00:34.494 INFO:tasks.workunit.client.0.smithi152.stdout:2/603: read d6/d1e/f2e [3124408,62625] 0 2023-12-06T15:00:34.498 INFO:tasks.workunit.client.0.smithi152.stdout:9/654: dread d0/d3f/d5f/d60/f6b [0,4194304] 0 2023-12-06T15:00:34.498 INFO:tasks.workunit.client.0.smithi152.stdout:9/655: readlink d0/l28 0 2023-12-06T15:00:34.499 INFO:tasks.workunit.client.0.smithi152.stdout:8/583: dwrite d1/f77 [0,4194304] 0 2023-12-06T15:00:34.501 INFO:tasks.workunit.client.0.smithi152.stdout:5/735: mkdir d7/dd/d103 0 2023-12-06T15:00:34.505 INFO:tasks.workunit.client.0.smithi152.stdout:5/736: mkdir d7/d43/d9c/d104 0 2023-12-06T15:00:34.506 INFO:tasks.workunit.client.0.smithi152.stdout:5/737: dread - d7/d47/fdf zero size 2023-12-06T15:00:34.506 INFO:tasks.workunit.client.0.smithi152.stdout:9/656: mknod d0/d3f/d68/d6c/d20/d4a/d4d/d69/cc1 0 2023-12-06T15:00:34.506 INFO:tasks.workunit.client.0.smithi152.stdout:2/604: symlink d6/d18/lc0 0 2023-12-06T15:00:34.506 INFO:tasks.workunit.client.0.smithi152.stdout:2/605: stat d6/d1e/l9e 0 2023-12-06T15:00:34.506 INFO:tasks.workunit.client.0.smithi152.stdout:8/584: creat d1/d6/d34/d35/d38/fba x:0 0 0 2023-12-06T15:00:34.506 INFO:tasks.workunit.client.0.smithi152.stdout:2/606: fdatasync d6/d1e/d41/f60 0 2023-12-06T15:00:34.508 INFO:tasks.workunit.client.0.smithi152.stdout:5/738: unlink d7/dd/d26/cfd 0 2023-12-06T15:00:34.509 INFO:tasks.workunit.client.0.smithi152.stdout:2/607: creat d6/d1e/d41/d83/fc1 x:0 0 0 2023-12-06T15:00:34.511 INFO:tasks.workunit.client.0.smithi152.stdout:8/585: rename d1/d6/c3e to d1/d6/d34/d35/d66/d82/db6/cbb 0 2023-12-06T15:00:34.511 INFO:tasks.workunit.client.0.smithi152.stdout:5/739: creat d7/f105 x:0 0 0 2023-12-06T15:00:34.511 INFO:tasks.workunit.client.0.smithi152.stdout:4/916: write d2/f7c [3379062,16761] 0 2023-12-06T15:00:34.511 INFO:tasks.workunit.client.0.smithi152.stdout:4/917: stat d2/d15/d32/d69/d6f/d10b/d6e/c8d 0 2023-12-06T15:00:34.512 INFO:tasks.workunit.client.0.smithi152.stdout:8/586: rmdir d1/d6/d34/d40 39 2023-12-06T15:00:34.512 INFO:tasks.workunit.client.0.smithi152.stdout:8/587: chown d1/d6/d34/d35/d38/f45 30 1 2023-12-06T15:00:34.512 INFO:tasks.workunit.client.0.smithi152.stdout:8/588: fsync d1/d6/d34/d36/f79 0 2023-12-06T15:00:34.512 INFO:tasks.workunit.client.0.smithi152.stdout:7/510: dwrite dd/df/f3b [0,4194304] 0 2023-12-06T15:00:34.512 INFO:tasks.workunit.client.1.smithi190.stdout:4/871: fsync d3/d35/d19/d41/d44/d11d/f113 0 2023-12-06T15:00:34.512 INFO:tasks.workunit.client.1.smithi190.stdout:4/872: write d3/d76/d7c/d8a/f132 [603757,109584] 0 2023-12-06T15:00:34.513 INFO:tasks.workunit.client.0.smithi152.stdout:5/740: getdents d7/dd/d26/d48/dbb 0 2023-12-06T15:00:34.513 INFO:tasks.workunit.client.0.smithi152.stdout:9/657: dread d0/d3f/d68/d6c/d20/f29 [0,4194304] 0 2023-12-06T15:00:34.513 INFO:tasks.workunit.client.0.smithi152.stdout:4/918: creat d2/d15/f12c x:0 0 0 2023-12-06T15:00:34.514 INFO:tasks.workunit.client.1.smithi190.stdout:4/873: rmdir d3/d35/d19/d41/d44/d9c/d72 39 2023-12-06T15:00:34.514 INFO:tasks.workunit.client.0.smithi152.stdout:8/589: mknod d1/d6/d34/d35/d66/d82/cbc 0 2023-12-06T15:00:34.517 INFO:tasks.workunit.client.0.smithi152.stdout:7/511: mknod dd/df/ca0 0 2023-12-06T15:00:34.517 INFO:tasks.workunit.client.0.smithi152.stdout:7/512: fsync dd/df/d1b/d20/d28/d53/f64 0 2023-12-06T15:00:34.521 INFO:tasks.workunit.client.1.smithi190.stdout:3/914: sync 2023-12-06T15:00:34.521 INFO:tasks.workunit.client.1.smithi190.stdout:6/933: sync 2023-12-06T15:00:34.523 INFO:tasks.workunit.client.0.smithi152.stdout:5/741: mknod d7/dd/d26/d3a/c106 0 2023-12-06T15:00:34.523 INFO:tasks.workunit.client.1.smithi190.stdout:6/934: truncate d4/d12/d1a/d32/dab/de1/d107/f113 140855 0 2023-12-06T15:00:34.523 INFO:tasks.workunit.client.1.smithi190.stdout:0/827: sync 2023-12-06T15:00:34.523 INFO:tasks.workunit.client.1.smithi190.stdout:8/884: sync 2023-12-06T15:00:34.523 INFO:tasks.workunit.client.1.smithi190.stdout:7/993: sync 2023-12-06T15:00:34.526 INFO:tasks.workunit.client.0.smithi152.stdout:9/658: getdents d0/d3f/d68/d6c/d20/d4a/d71 0 2023-12-06T15:00:34.527 INFO:tasks.workunit.client.0.smithi152.stdout:8/590: symlink d1/d6/d34/d36/lbd 0 2023-12-06T15:00:34.528 INFO:tasks.workunit.client.0.smithi152.stdout:5/742: truncate d7/d43/d9c/fea 1928632 0 2023-12-06T15:00:34.529 INFO:tasks.workunit.client.0.smithi152.stdout:8/591: write d1/d6/d34/d36/f26 [3659689,36493] 0 2023-12-06T15:00:34.530 INFO:tasks.workunit.client.0.smithi152.stdout:4/919: rename d2/d10/dbb/dca/dbc/d75/deb/c11b to d2/d10/c12d 0 2023-12-06T15:00:34.531 INFO:tasks.workunit.client.0.smithi152.stdout:2/608: dread d6/d1e/d41/d55/f89 [0,4194304] 0 2023-12-06T15:00:34.531 INFO:tasks.workunit.client.0.smithi152.stdout:2/609: chown d6/d1e/d41/d55/f14 191093 1 2023-12-06T15:00:34.531 INFO:tasks.workunit.client.1.smithi190.stdout:0/828: creat d0/da/d3e/db8/f112 x:0 0 0 2023-12-06T15:00:34.531 INFO:tasks.workunit.client.1.smithi190.stdout:6/935: rename d4/d12/d1a/d59/c5e to d4/d12/d1a/d32/dc7/dd0/c133 0 2023-12-06T15:00:34.531 INFO:tasks.workunit.client.1.smithi190.stdout:6/936: truncate d4/d12/d1a/d44/dfc/ded/f11e 189547 0 2023-12-06T15:00:34.532 INFO:tasks.workunit.client.1.smithi190.stdout:0/829: creat d0/da/d3e/f113 x:0 0 0 2023-12-06T15:00:34.532 INFO:tasks.workunit.client.1.smithi190.stdout:0/830: write d0/da/d3e/d3a/d40/fd1 [999459,30283] 0 2023-12-06T15:00:34.532 INFO:tasks.workunit.client.1.smithi190.stdout:6/937: mkdir d4/d12/d1a/db4/d134 0 2023-12-06T15:00:34.533 INFO:tasks.workunit.client.0.smithi152.stdout:5/743: truncate d7/f15 4013362 0 2023-12-06T15:00:34.533 INFO:tasks.workunit.client.0.smithi152.stdout:4/920: getdents d2/d15/d32/d79/dcc 0 2023-12-06T15:00:34.533 INFO:tasks.workunit.client.0.smithi152.stdout:5/744: dread - d7/d43/fe9 zero size 2023-12-06T15:00:34.534 INFO:tasks.workunit.client.1.smithi190.stdout:7/994: rmdir d0/d5/dba 39 2023-12-06T15:00:34.534 INFO:tasks.workunit.client.1.smithi190.stdout:7/995: chown d0/df/d53/d2f/de9/lc6 104 1 2023-12-06T15:00:34.534 INFO:tasks.workunit.client.1.smithi190.stdout:7/996: stat d0/df/d53/d2f/de9/lc6 0 2023-12-06T15:00:34.534 INFO:tasks.workunit.client.1.smithi190.stdout:3/915: dread d4/d1b/f37 [0,4194304] 0 2023-12-06T15:00:34.534 INFO:tasks.workunit.client.1.smithi190.stdout:6/938: rename d4/d12/d1a/d32/f9d to d4/d12/d1a/d32/dab/de9/df8/f135 0 2023-12-06T15:00:34.535 INFO:tasks.workunit.client.0.smithi152.stdout:2/610: mknod d6/d1e/d41/d55/cc2 0 2023-12-06T15:00:34.535 INFO:tasks.workunit.client.0.smithi152.stdout:2/611: dread - d6/d18/d43/f6d zero size 2023-12-06T15:00:34.536 INFO:tasks.workunit.client.1.smithi190.stdout:3/916: creat d4/d70/d19/d3a/ddf/f141 x:0 0 0 2023-12-06T15:00:34.536 INFO:tasks.workunit.client.0.smithi152.stdout:4/921: symlink d2/d89/df9/dfe/d115/l12e 0 2023-12-06T15:00:34.537 INFO:tasks.workunit.client.1.smithi190.stdout:6/939: creat d4/d12/d40/d11c/f136 x:0 0 0 2023-12-06T15:00:34.538 INFO:tasks.workunit.client.0.smithi152.stdout:5/745: mknod d7/d43/d6c/dde/c107 0 2023-12-06T15:00:34.538 INFO:tasks.workunit.client.0.smithi152.stdout:5/746: getdents d7/dd/dfc 0 2023-12-06T15:00:34.538 INFO:tasks.workunit.client.0.smithi152.stdout:2/612: symlink d6/db/lc3 0 2023-12-06T15:00:34.538 INFO:tasks.workunit.client.0.smithi152.stdout:2/613: dread - d6/d1e/d41/d83/f93 zero size 2023-12-06T15:00:34.538 INFO:tasks.workunit.client.0.smithi152.stdout:2/614: fdatasync d6/d1e/f2f 0 2023-12-06T15:00:34.538 INFO:tasks.workunit.client.1.smithi190.stdout:6/940: creat d4/d12/d1a/d32/dc7/f137 x:0 0 0 2023-12-06T15:00:34.539 INFO:tasks.workunit.client.1.smithi190.stdout:6/941: write d4/d12/d40/d43/d45/f88 [186525,15892] 0 2023-12-06T15:00:34.539 INFO:tasks.workunit.client.1.smithi190.stdout:2/890: dwrite d10/d26/f27 [0,4194304] 0 2023-12-06T15:00:34.539 INFO:tasks.workunit.client.1.smithi190.stdout:7/997: dread d0/d88/fa4 [0,4194304] 0 2023-12-06T15:00:34.543 INFO:tasks.workunit.client.1.smithi190.stdout:2/891: mkdir d10/d59/dcd/d12d 0 2023-12-06T15:00:34.547 INFO:tasks.workunit.client.1.smithi190.stdout:6/942: dread d4/d12/d1a/d44/fbd [0,4194304] 0 2023-12-06T15:00:34.550 INFO:tasks.workunit.client.0.smithi152.stdout:5/747: write d7/d43/d6c/fd1 [2415411,19231] 0 2023-12-06T15:00:34.551 INFO:tasks.workunit.client.1.smithi190.stdout:2/892: rmdir d10/d59/dcd/dad/d10a 39 2023-12-06T15:00:34.556 INFO:tasks.workunit.client.1.smithi190.stdout:7/998: rename d0/d88/d1c to d0/df/df8/d108/d120/d13a 0 2023-12-06T15:00:34.558 INFO:tasks.workunit.client.1.smithi190.stdout:8/885: dread d1/d20/d3b/d4c/d8e/fac [0,4194304] 0 2023-12-06T15:00:34.558 INFO:tasks.workunit.client.1.smithi190.stdout:8/886: chown d1/d20/d3b/d34/dbc/fec 41790 1 2023-12-06T15:00:34.559 INFO:tasks.workunit.client.1.smithi190.stdout:2/893: write fc [3103542,24781] 0 2023-12-06T15:00:34.559 INFO:tasks.workunit.client.1.smithi190.stdout:2/894: fdatasync d10/d26/d5c/f63 0 2023-12-06T15:00:34.562 INFO:tasks.workunit.client.1.smithi190.stdout:6/943: rename d4/d12/d1a/lcc to d4/d12/d40/d43/d45/d4a/d77/l138 0 2023-12-06T15:00:34.562 INFO:tasks.workunit.client.1.smithi190.stdout:7/999: symlink d0/df/d53/d99/da9/df9/l13b 0 2023-12-06T15:00:34.565 INFO:tasks.workunit.client.1.smithi190.stdout:2/895: getdents d10/d59/d5e 0 2023-12-06T15:00:34.570 INFO:tasks.workunit.client.1.smithi190.stdout:2/896: symlink d10/d26/d5c/d35/d77/l12e 0 2023-12-06T15:00:34.570 INFO:tasks.workunit.client.1.smithi190.stdout:2/897: chown c1 302326 1 2023-12-06T15:00:34.607 INFO:tasks.workunit.client.0.smithi152.stdout:3/627: dwrite d9/d18/d39/fb9 [0,4194304] 0 2023-12-06T15:00:34.608 INFO:tasks.workunit.client.0.smithi152.stdout:3/628: chown d9/d10/d12/d43/d52/db4 904 1 2023-12-06T15:00:34.608 INFO:tasks.workunit.client.1.smithi190.stdout:5/848: dwrite d0/d1c/d2b/d2c/d5d/f95 [4194304,4194304] 0 2023-12-06T15:00:34.610 INFO:tasks.workunit.client.1.smithi190.stdout:5/849: creat d0/d6c/da7/df3/f124 x:0 0 0 2023-12-06T15:00:34.611 INFO:tasks.workunit.client.1.smithi190.stdout:5/850: creat d0/df/d50/d9c/f125 x:0 0 0 2023-12-06T15:00:34.611 INFO:tasks.workunit.client.1.smithi190.stdout:5/851: write d0/fd [3677457,68814] 0 2023-12-06T15:00:34.613 INFO:tasks.workunit.client.1.smithi190.stdout:5/852: mkdir d0/d126 0 2023-12-06T15:00:34.624 INFO:tasks.workunit.client.1.smithi190.stdout:8/887: dwrite d1/d20/d3b/f30 [0,4194304] 0 2023-12-06T15:00:34.626 INFO:tasks.workunit.client.1.smithi190.stdout:8/888: unlink d1/f7 0 2023-12-06T15:00:34.631 INFO:tasks.workunit.client.0.smithi152.stdout:1/942: dwrite d3/f7 [0,4194304] 0 2023-12-06T15:00:34.631 INFO:tasks.workunit.client.0.smithi152.stdout:6/858: dwrite d1/dcf/ddc/d1a/d30/d36/d35/d61/f85 [0,4194304] 0 2023-12-06T15:00:34.631 INFO:tasks.workunit.client.0.smithi152.stdout:6/859: fsync d1/dcf/ddc/d1a/d30/d36/d35/d49/da6/f10f 0 2023-12-06T15:00:34.632 INFO:tasks.workunit.client.1.smithi190.stdout:4/874: dwrite d3/f78 [0,4194304] 0 2023-12-06T15:00:34.632 INFO:tasks.workunit.client.1.smithi190.stdout:4/875: fdatasync d3/d76/dc4/dc5/d3c/f49 0 2023-12-06T15:00:34.633 INFO:tasks.workunit.client.1.smithi190.stdout:8/889: dread d1/d20/d3b/d4c/d59/f81 [0,4194304] 0 2023-12-06T15:00:34.635 INFO:tasks.workunit.client.1.smithi190.stdout:4/876: symlink d3/d35/d19/d67/l133 0 2023-12-06T15:00:34.636 INFO:tasks.workunit.client.1.smithi190.stdout:8/890: truncate d1/d20/d3b/d4c/d59/fc2 5569638 0 2023-12-06T15:00:34.636 INFO:tasks.workunit.client.1.smithi190.stdout:8/891: dread - d1/dd1/fd9 zero size 2023-12-06T15:00:34.637 INFO:tasks.workunit.client.1.smithi190.stdout:8/892: link d1/dd1/d10b/c3f d1/dd3/c10d 0 2023-12-06T15:00:34.644 INFO:tasks.workunit.client.0.smithi152.stdout:6/860: dread d1/d75/f81 [0,4194304] 0 2023-12-06T15:00:34.644 INFO:tasks.workunit.client.1.smithi190.stdout:8/893: write d1/f35 [341818,88497] 0 2023-12-06T15:00:34.645 INFO:tasks.workunit.client.0.smithi152.stdout:6/861: getdents d1/dcf/ddc/d1a/d30/d36/d35 0 2023-12-06T15:00:34.645 INFO:tasks.workunit.client.0.smithi152.stdout:7/513: dwrite dd/df/d1b/f7d [0,4194304] 0 2023-12-06T15:00:34.646 INFO:tasks.workunit.client.1.smithi190.stdout:3/917: dwrite d4/d70/d33/d45/fef [0,4194304] 0 2023-12-06T15:00:34.646 INFO:tasks.workunit.client.0.smithi152.stdout:6/862: truncate d1/dcf/ddc/d6d/fe1 251921 0 2023-12-06T15:00:34.647 INFO:tasks.workunit.client.1.smithi190.stdout:8/894: getdents d1/d20/d3b/d4c 0 2023-12-06T15:00:34.647 INFO:tasks.workunit.client.1.smithi190.stdout:8/895: dread - d1/d37/dc9/ffc zero size 2023-12-06T15:00:34.649 INFO:tasks.workunit.client.1.smithi190.stdout:3/918: mkdir d4/d1b/d5d/d11b/d142 0 2023-12-06T15:00:34.650 INFO:tasks.workunit.client.0.smithi152.stdout:7/514: rename dd/df/d1b/d20/d28/d53/f99 to dd/df/d1b/d20/d7c/fa1 0 2023-12-06T15:00:34.650 INFO:tasks.workunit.client.1.smithi190.stdout:3/919: mknod d4/d1b/d54/d9c/d68/dfc/dc4/dce/c143 0 2023-12-06T15:00:34.651 INFO:tasks.workunit.client.1.smithi190.stdout:3/920: mknod d4/d70/c144 0 2023-12-06T15:00:34.654 INFO:tasks.workunit.client.0.smithi152.stdout:7/515: mkdir dd/df/d34/d44/d49/d73/d77/da2 0 2023-12-06T15:00:34.655 INFO:tasks.workunit.client.1.smithi190.stdout:8/896: dread d1/f1b [0,4194304] 0 2023-12-06T15:00:34.655 INFO:tasks.workunit.client.1.smithi190.stdout:8/897: write d1/f6c [882951,27111] 0 2023-12-06T15:00:34.656 INFO:tasks.workunit.client.0.smithi152.stdout:6/863: symlink d1/dcf/ddc/d6d/l12d 0 2023-12-06T15:00:34.658 INFO:tasks.workunit.client.0.smithi152.stdout:7/516: rename dd/df/d78/c8d to dd/df/ca3 0 2023-12-06T15:00:34.658 INFO:tasks.workunit.client.0.smithi152.stdout:7/517: readlink dd/df/d34/d44/d49/l90 0 2023-12-06T15:00:34.659 INFO:tasks.workunit.client.1.smithi190.stdout:0/831: dwrite d0/da/da4/db1/fc3 [0,4194304] 0 2023-12-06T15:00:34.659 INFO:tasks.workunit.client.0.smithi152.stdout:2/615: dwrite d6/d1e/f62 [0,4194304] 0 2023-12-06T15:00:34.659 INFO:tasks.workunit.client.0.smithi152.stdout:2/616: truncate d6/d1e/d41/f60 1255557 0 2023-12-06T15:00:34.659 INFO:tasks.workunit.client.0.smithi152.stdout:4/922: dwrite d2/d15/d32/fef [0,4194304] 0 2023-12-06T15:00:34.659 INFO:tasks.workunit.client.0.smithi152.stdout:2/617: write d6/db/f8a [190624,62702] 0 2023-12-06T15:00:34.659 INFO:tasks.workunit.client.0.smithi152.stdout:4/923: truncate d2/d15/f7f 2390670 0 2023-12-06T15:00:34.660 INFO:tasks.workunit.client.0.smithi152.stdout:6/864: creat d1/dcf/ddc/d1a/d30/da4/f12e x:0 0 0 2023-12-06T15:00:34.660 INFO:tasks.workunit.client.0.smithi152.stdout:6/865: write d1/d69/da1/f104 [568848,20420] 0 2023-12-06T15:00:34.661 INFO:tasks.workunit.client.0.smithi152.stdout:7/518: write dd/f2f [7128855,45206] 0 2023-12-06T15:00:34.661 INFO:tasks.workunit.client.0.smithi152.stdout:7/519: write dd/df/d1b/d20/d28/d53/f64 [5136529,56599] 0 2023-12-06T15:00:34.662 INFO:tasks.workunit.client.0.smithi152.stdout:7/520: read - dd/df/d1b/d4e/f72 zero size 2023-12-06T15:00:34.663 INFO:tasks.workunit.client.1.smithi190.stdout:0/832: rename d0/da/d3e/d2b/d3c/c42 to d0/da/da4/c114 0 2023-12-06T15:00:34.668 INFO:tasks.workunit.client.0.smithi152.stdout:4/924: link d2/lf5 d2/d15/d32/d69/d6f/l12f 0 2023-12-06T15:00:34.669 INFO:tasks.workunit.client.0.smithi152.stdout:2/618: symlink d6/d1e/d41/d55/lc4 0 2023-12-06T15:00:34.669 INFO:tasks.workunit.client.0.smithi152.stdout:2/619: chown d6/d18/d43/db3/cbc 1275 1 2023-12-06T15:00:34.669 INFO:tasks.workunit.client.1.smithi190.stdout:0/833: rename d0/da/d3e/d2b/d3c/d4c/f59 to d0/da/d5a/de7/f115 0 2023-12-06T15:00:34.669 INFO:tasks.workunit.client.1.smithi190.stdout:0/834: chown d0/da/d3e/d2b/d3c/d46/l58 0 1 2023-12-06T15:00:34.671 INFO:tasks.workunit.client.0.smithi152.stdout:5/748: dwrite d7/f28 [4194304,4194304] 0 2023-12-06T15:00:34.671 INFO:tasks.workunit.client.1.smithi190.stdout:6/944: dwrite d4/d12/d1a/d32/dab/de1/d107/f113 [0,4194304] 0 2023-12-06T15:00:34.671 INFO:tasks.workunit.client.1.smithi190.stdout:6/945: readlink d4/d12/d40/d43/dba/lc2 0 2023-12-06T15:00:34.671 INFO:tasks.workunit.client.1.smithi190.stdout:6/946: dread - d4/d12/d1a/d59/fef zero size 2023-12-06T15:00:34.672 INFO:tasks.workunit.client.0.smithi152.stdout:3/629: dwrite d9/d10/d12/d43/d52/f7a [0,4194304] 0 2023-12-06T15:00:34.672 INFO:tasks.workunit.client.0.smithi152.stdout:3/630: read - d9/d10/d12/d43/d52/db4/f4e zero size 2023-12-06T15:00:34.674 INFO:tasks.workunit.client.1.smithi190.stdout:0/835: creat d0/da/d3e/d2b/d37/f116 x:0 0 0 2023-12-06T15:00:34.675 INFO:tasks.workunit.client.0.smithi152.stdout:4/925: mknod d2/d89/df9/dfe/c130 0 2023-12-06T15:00:34.676 INFO:tasks.workunit.client.0.smithi152.stdout:2/620: truncate d6/d18/d70/f82 4151557 0 2023-12-06T15:00:34.682 INFO:tasks.workunit.client.0.smithi152.stdout:3/631: creat d9/d10/d12/d43/d52/db4/fc4 x:0 0 0 2023-12-06T15:00:34.682 INFO:tasks.workunit.client.0.smithi152.stdout:3/632: stat d9/d10/f94 0 2023-12-06T15:00:34.683 INFO:tasks.workunit.client.1.smithi190.stdout:6/947: rename d4/d12/d40/d43/d45/leb to d4/d12/d40/d43/dba/l139 0 2023-12-06T15:00:34.683 INFO:tasks.workunit.client.1.smithi190.stdout:6/948: chown d4/d12/d1a/d44/dfc/da6/cdb 4708085 1 2023-12-06T15:00:34.683 INFO:tasks.workunit.client.1.smithi190.stdout:6/949: read - d4/d12/d1a/d70/f82 zero size 2023-12-06T15:00:34.684 INFO:tasks.workunit.client.0.smithi152.stdout:4/926: creat d2/d15/f131 x:0 0 0 2023-12-06T15:00:34.685 INFO:tasks.workunit.client.0.smithi152.stdout:3/633: mkdir d9/d10/d12/d43/d52/dc5 0 2023-12-06T15:00:34.689 INFO:tasks.workunit.client.0.smithi152.stdout:3/634: read d9/d10/d12/d43/d52/f61 [3415787,50826] 0 2023-12-06T15:00:34.689 INFO:tasks.workunit.client.0.smithi152.stdout:3/635: readlink d9/d18/d39/l40 0 2023-12-06T15:00:34.689 INFO:tasks.workunit.client.0.smithi152.stdout:3/636: fdatasync d9/d18/fae 0 2023-12-06T15:00:34.691 INFO:tasks.workunit.client.0.smithi152.stdout:3/637: rename d9/d10/d12/d43/d52/db4/c23 to d9/d10/cc6 0 2023-12-06T15:00:34.692 INFO:tasks.workunit.client.0.smithi152.stdout:3/638: stat d9/d10/d19/l90 0 2023-12-06T15:00:34.694 INFO:tasks.workunit.client.1.smithi190.stdout:6/950: mknod d4/d12/d40/d43/d45/c13a 0 2023-12-06T15:00:34.695 INFO:tasks.workunit.client.1.smithi190.stdout:0/836: link d0/da/d5a/fcd d0/da/d3e/d2b/d3c/d10f/f117 0 2023-12-06T15:00:34.695 INFO:tasks.workunit.client.1.smithi190.stdout:6/951: fdatasync d4/d12/d1a/d32/dc7/dea/f106 0 2023-12-06T15:00:34.695 INFO:tasks.workunit.client.1.smithi190.stdout:0/837: chown d0/da/d3e/d2b/d3c/d4c/f53 21695516 1 2023-12-06T15:00:34.695 INFO:tasks.workunit.client.1.smithi190.stdout:5/853: getdents d0/df/d50/d9c 0 2023-12-06T15:00:34.698 INFO:tasks.workunit.client.0.smithi152.stdout:1/943: dwrite d3/d44/fad [0,4194304] 0 2023-12-06T15:00:34.699 INFO:tasks.workunit.client.1.smithi190.stdout:6/952: write d4/d12/d1a/d32/dab/dd3/fe0 [143293,48892] 0 2023-12-06T15:00:34.699 INFO:tasks.workunit.client.1.smithi190.stdout:0/838: rename d0/da/l15 to d0/da/d3e/d3a/d40/d81/l118 0 2023-12-06T15:00:34.699 INFO:tasks.workunit.client.1.smithi190.stdout:4/877: dwrite d3/d35/d19/d41/d44/d5b/f61 [0,4194304] 0 2023-12-06T15:00:34.699 INFO:tasks.workunit.client.1.smithi190.stdout:4/878: chown d3/da4/d10d 146 1 2023-12-06T15:00:34.701 INFO:tasks.workunit.client.1.smithi190.stdout:5/854: unlink d0/d1c/d2b/l70 0 2023-12-06T15:00:34.701 INFO:tasks.workunit.client.1.smithi190.stdout:5/855: fsync d0/d1c/d3e/f76 0 2023-12-06T15:00:34.705 INFO:tasks.workunit.client.0.smithi152.stdout:7/521: rmdir dd/df/d34/d44/d49/d73 39 2023-12-06T15:00:34.705 INFO:tasks.workunit.client.1.smithi190.stdout:0/839: dread d0/da/d3e/d2b/d3c/d65/f7c [0,4194304] 0 2023-12-06T15:00:34.705 INFO:tasks.workunit.client.1.smithi190.stdout:5/856: creat d0/d1c/d85/f127 x:0 0 0 2023-12-06T15:00:34.707 INFO:tasks.workunit.client.1.smithi190.stdout:0/840: creat d0/da/d74/dfc/f119 x:0 0 0 2023-12-06T15:00:34.707 INFO:tasks.workunit.client.1.smithi190.stdout:0/841: write d0/da/d3e/d2b/d37/f116 [564768,38935] 0 2023-12-06T15:00:34.709 INFO:tasks.workunit.client.1.smithi190.stdout:5/857: link d0/d1c/d3e/d5a/l111 d0/d1c/d2b/d2c/d5d/d73/d116/dc5/dd5/l128 0 2023-12-06T15:00:34.710 INFO:tasks.workunit.client.0.smithi152.stdout:1/944: creat d3/da/d65/f150 x:0 0 0 2023-12-06T15:00:34.710 INFO:tasks.workunit.client.0.smithi152.stdout:3/639: dread d9/d18/d39/f8a [0,4194304] 0 2023-12-06T15:00:34.710 INFO:tasks.workunit.client.0.smithi152.stdout:7/522: mkdir dd/df/d1b/d20/d7c/d86/da4 0 2023-12-06T15:00:34.710 INFO:tasks.workunit.client.0.smithi152.stdout:7/523: truncate dd/df/d1b/d20/d28/f3e 862314 0 2023-12-06T15:00:34.710 INFO:tasks.workunit.client.0.smithi152.stdout:7/524: chown dd/df 82807 1 2023-12-06T15:00:34.710 INFO:tasks.workunit.client.1.smithi190.stdout:3/921: dwrite d4/d1b/d54/fb1 [4194304,4194304] 0 2023-12-06T15:00:34.712 INFO:tasks.workunit.client.0.smithi152.stdout:1/945: rename d3/da/db/d54/f11a to d3/da/d15/d17/d4d/da7/f151 0 2023-12-06T15:00:34.713 INFO:tasks.workunit.client.1.smithi190.stdout:0/842: mknod d0/da/d3e/d2b/d3c/d46/c11a 0 2023-12-06T15:00:34.713 INFO:tasks.workunit.client.1.smithi190.stdout:0/843: chown d0/da/d3e/d2b/d3c/d46/d8e/d90/fe3 3280 1 2023-12-06T15:00:34.714 INFO:tasks.workunit.client.1.smithi190.stdout:5/858: creat d0/d1c/d3e/dfd/f129 x:0 0 0 2023-12-06T15:00:34.720 INFO:tasks.workunit.client.1.smithi190.stdout:3/922: unlink d4/d1b/d54/f121 0 2023-12-06T15:00:34.721 INFO:tasks.workunit.client.1.smithi190.stdout:5/859: creat d0/d1c/d2b/f12a x:0 0 0 2023-12-06T15:00:34.725 INFO:tasks.workunit.client.1.smithi190.stdout:3/923: mkdir d4/d70/d19/d51/d109/d145 0 2023-12-06T15:00:34.725 INFO:tasks.workunit.client.1.smithi190.stdout:3/924: dread - d4/d1b/d54/d9c/fe9 zero size 2023-12-06T15:00:34.728 INFO:tasks.workunit.client.0.smithi152.stdout:2/621: dwrite d6/d18/d43/db8/fbb [0,4194304] 0 2023-12-06T15:00:34.730 INFO:tasks.workunit.client.1.smithi190.stdout:6/953: dread d4/d12/d1a/d59/f131 [0,4194304] 0 2023-12-06T15:00:34.731 INFO:tasks.workunit.client.0.smithi152.stdout:2/622: creat d6/d1e/d41/d83/fc5 x:0 0 0 2023-12-06T15:00:34.731 INFO:tasks.workunit.client.0.smithi152.stdout:2/623: stat d6/db/f2b 0 2023-12-06T15:00:34.734 INFO:tasks.workunit.client.0.smithi152.stdout:2/624: getdents d6/d18/d43/db3 0 2023-12-06T15:00:34.734 INFO:tasks.workunit.client.0.smithi152.stdout:2/625: truncate d6/d1e/d41/d83/fc1 364368 0 2023-12-06T15:00:34.735 INFO:tasks.workunit.client.1.smithi190.stdout:3/925: dread d4/d1b/d54/f60 [0,4194304] 0 2023-12-06T15:00:34.736 INFO:tasks.workunit.client.1.smithi190.stdout:3/926: mkdir d4/d70/d19/d51/dab/d146 0 2023-12-06T15:00:34.739 INFO:tasks.workunit.client.0.smithi152.stdout:6/866: dwrite d1/f3d [0,4194304] 0 2023-12-06T15:00:34.751 INFO:tasks.workunit.client.1.smithi190.stdout:6/954: dread d4/d12/d1a/d8a/da3/fb7 [0,4194304] 0 2023-12-06T15:00:34.751 INFO:tasks.workunit.client.1.smithi190.stdout:6/955: chown d4/d12/d40/d43/d11d 5494479 1 2023-12-06T15:00:34.751 INFO:tasks.workunit.client.1.smithi190.stdout:6/956: fdatasync d4/d12/d40/d43/d45/f60 0 2023-12-06T15:00:34.753 INFO:tasks.workunit.client.1.smithi190.stdout:6/957: link d4/d12/d40/d43/d45/f88 d4/d12/d40/d43/d11d/f13b 0 2023-12-06T15:00:34.753 INFO:tasks.workunit.client.1.smithi190.stdout:6/958: fdatasync d4/d12/d40/d11c/f136 0 2023-12-06T15:00:34.753 INFO:tasks.workunit.client.1.smithi190.stdout:6/959: dread - d4/d12/d1a/d70/ff2 zero size 2023-12-06T15:00:34.753 INFO:tasks.workunit.client.1.smithi190.stdout:6/960: mkdir d4/d12/d40/d43/d13c 0 2023-12-06T15:00:34.766 INFO:tasks.workunit.client.1.smithi190.stdout:6/961: dread d4/d12/d1a/d59/f131 [0,4194304] 0 2023-12-06T15:00:34.767 INFO:tasks.workunit.client.1.smithi190.stdout:6/962: symlink d4/d12/d1a/d32/dc7/l13d 0 2023-12-06T15:00:34.768 INFO:tasks.workunit.client.1.smithi190.stdout:6/963: symlink d4/d12/d1a/d70/da9/l13e 0 2023-12-06T15:00:34.768 INFO:tasks.workunit.client.1.smithi190.stdout:6/964: write d4/d12/d1a/d70/f10d [163768,72557] 0 2023-12-06T15:00:34.769 INFO:tasks.workunit.client.1.smithi190.stdout:6/965: write d4/d12/d1a/d32/dab/de9/df8/f135 [140949,21662] 0 2023-12-06T15:00:34.769 INFO:tasks.workunit.client.1.smithi190.stdout:6/966: write d4/d12/d1a/d32/dc7/f130 [868172,12893] 0 2023-12-06T15:00:34.770 INFO:tasks.workunit.client.1.smithi190.stdout:6/967: link d4/d12/d9a/c112 d4/d12/d1a/db4/d134/c13f 0 2023-12-06T15:00:34.771 INFO:tasks.workunit.client.1.smithi190.stdout:6/968: rmdir d4/d12/d1a/d32/dc7/dd0 39 2023-12-06T15:00:34.772 INFO:tasks.workunit.client.1.smithi190.stdout:6/969: symlink d4/d12/d1a/d32/dc7/l140 0 2023-12-06T15:00:34.773 INFO:tasks.workunit.client.1.smithi190.stdout:6/970: read d4/d12/d1a/d8a/fa0 [1225669,76385] 0 2023-12-06T15:00:34.773 INFO:tasks.workunit.client.1.smithi190.stdout:6/971: write d4/d12/d40/d43/d45/d4a/f118 [395102,51828] 0 2023-12-06T15:00:34.773 INFO:tasks.workunit.client.1.smithi190.stdout:6/972: fdatasync d4/d12/d1a/f7c 0 2023-12-06T15:00:34.773 INFO:tasks.workunit.client.1.smithi190.stdout:6/973: chown d4/d12/l36 94442079 1 2023-12-06T15:00:34.774 INFO:tasks.workunit.client.1.smithi190.stdout:6/974: symlink d4/d12/d1a/d59/d12f/l141 0 2023-12-06T15:00:34.775 INFO:tasks.workunit.client.1.smithi190.stdout:6/975: rename d4/d12/d1a/d44/f8f to d4/d12/d1a/d70/da9/f142 0 2023-12-06T15:00:34.775 INFO:tasks.workunit.client.1.smithi190.stdout:6/976: read - d4/d12/d40/d43/d45/d4a/dc5/f101 zero size 2023-12-06T15:00:34.776 INFO:tasks.workunit.client.1.smithi190.stdout:6/977: fsync d4/d12/d1a/d70/fcd 0 2023-12-06T15:00:34.790 INFO:tasks.workunit.client.1.smithi190.stdout:6/978: dread d4/d12/d40/d43/d45/d4a/f105 [0,4194304] 0 2023-12-06T15:00:34.793 INFO:tasks.workunit.client.0.smithi152.stdout:5/749: dwrite d7/dd/d26/d3b/d46/d7e/fcd [0,4194304] 0 2023-12-06T15:00:34.793 INFO:tasks.workunit.client.0.smithi152.stdout:5/750: write d7/f28 [9350808,28924] 0 2023-12-06T15:00:34.793 INFO:tasks.workunit.client.0.smithi152.stdout:5/751: getdents d7/dd/d26/d48 0 2023-12-06T15:00:34.793 INFO:tasks.workunit.client.0.smithi152.stdout:4/927: dwrite d2/d15/d32/f6a [0,4194304] 0 2023-12-06T15:00:34.793 INFO:tasks.workunit.client.0.smithi152.stdout:4/928: truncate d2/d15/d32/d69/d6f/daf/f110 949837 0 2023-12-06T15:00:34.794 INFO:tasks.workunit.client.1.smithi190.stdout:4/879: dwrite d3/d76/dc4/dc5/d3c/d116/d7a/f109 [0,4194304] 0 2023-12-06T15:00:34.794 INFO:tasks.workunit.client.1.smithi190.stdout:8/898: dwrite d1/d20/d3b/d4c/d8e/fac [0,4194304] 0 2023-12-06T15:00:34.794 INFO:tasks.workunit.client.1.smithi190.stdout:4/880: write d3/d76/d7c/d8a/fd6 [211628,112173] 0 2023-12-06T15:00:34.794 INFO:tasks.workunit.client.0.smithi152.stdout:3/640: dwrite d9/d10/d12/d43/d52/f7a [0,4194304] 0 2023-12-06T15:00:34.794 INFO:tasks.workunit.client.0.smithi152.stdout:1/946: dwrite d3/da/d15/d17/d147/f9c [0,4194304] 0 2023-12-06T15:00:34.794 INFO:tasks.workunit.client.0.smithi152.stdout:7/525: dwrite dd/df/d34/f8a [0,4194304] 0 2023-12-06T15:00:34.794 INFO:tasks.workunit.client.0.smithi152.stdout:6/867: dwrite d1/dcf/ddc/d1a/d30/f84 [0,4194304] 0 2023-12-06T15:00:34.795 INFO:tasks.workunit.client.1.smithi190.stdout:0/844: dwrite d0/da/d3e/d3a/d40/d6f/fbe [0,4194304] 0 2023-12-06T15:00:34.795 INFO:tasks.workunit.client.1.smithi190.stdout:0/845: readlink d0/da/d3e/d3a/d40/l55 0 2023-12-06T15:00:34.796 INFO:tasks.workunit.client.0.smithi152.stdout:5/752: write d7/d47/f78 [1115101,100525] 0 2023-12-06T15:00:34.798 INFO:tasks.workunit.client.1.smithi190.stdout:3/927: dwrite d4/d1b/d54/d9c/d68/d8a/ffb [0,4194304] 0 2023-12-06T15:00:34.804 INFO:tasks.workunit.client.0.smithi152.stdout:3/641: dread d9/d18/d39/f8a [0,4194304] 0 2023-12-06T15:00:34.805 INFO:tasks.workunit.client.0.smithi152.stdout:4/929: symlink d2/d45/d84/da4/l132 0 2023-12-06T15:00:34.805 INFO:tasks.workunit.client.0.smithi152.stdout:3/642: write d9/d18/d51/f6c [823980,37441] 0 2023-12-06T15:00:34.806 INFO:tasks.workunit.client.1.smithi190.stdout:8/899: creat d1/d20/d3b/d4c/d8e/d94/db6/d108/f10e x:0 0 0 2023-12-06T15:00:34.806 INFO:tasks.workunit.client.1.smithi190.stdout:4/881: getdents d3/d35/d19 0 2023-12-06T15:00:34.813 INFO:tasks.workunit.client.0.smithi152.stdout:3/643: write d9/d10/d12/d43/d52/db4/fa4 [646704,64287] 0 2023-12-06T15:00:34.813 INFO:tasks.workunit.client.0.smithi152.stdout:3/644: fsync d9/d10/f2e 0 2023-12-06T15:00:34.814 INFO:tasks.workunit.client.0.smithi152.stdout:1/947: mknod d3/da/d15/d17/d4d/d12f/c152 0 2023-12-06T15:00:34.816 INFO:tasks.workunit.client.1.smithi190.stdout:3/928: creat d4/d1b/d54/d9c/d68/dfc/dc4/dce/f147 x:0 0 0 2023-12-06T15:00:34.816 INFO:tasks.workunit.client.1.smithi190.stdout:3/929: stat d4/d1b/d54/d9c/d68/dfc/d56/d94/d3d/fd0 0 2023-12-06T15:00:34.816 INFO:tasks.workunit.client.1.smithi190.stdout:3/930: readlink d4/d70/d19/d3a/l4c 0 2023-12-06T15:00:34.816 INFO:tasks.workunit.client.1.smithi190.stdout:3/931: chown d4/d1b/d5d/df1/fe7 21883878 1 2023-12-06T15:00:34.817 INFO:tasks.workunit.client.0.smithi152.stdout:7/526: creat dd/df/d1b/d20/d28/d38/fa5 x:0 0 0 2023-12-06T15:00:34.818 INFO:tasks.workunit.client.1.smithi190.stdout:8/900: symlink d1/d20/d3b/d4c/d9e/def/l10f 0 2023-12-06T15:00:34.818 INFO:tasks.workunit.client.0.smithi152.stdout:1/948: read d3/da/d15/d17/f3d [4955865,3700] 0 2023-12-06T15:00:34.819 INFO:tasks.workunit.client.0.smithi152.stdout:3/645: write d9/d10/d12/d43/d52/d58/da9/f3d [131791,112874] 0 2023-12-06T15:00:34.819 INFO:tasks.workunit.client.0.smithi152.stdout:3/646: chown d9/d10/d12/d43/d52/c74 3635 1 2023-12-06T15:00:34.820 INFO:tasks.workunit.client.0.smithi152.stdout:6/868: creat d1/d89/f12f x:0 0 0 2023-12-06T15:00:34.823 INFO:tasks.workunit.client.0.smithi152.stdout:5/753: creat d7/d43/d6c/d98/dc8/f108 x:0 0 0 2023-12-06T15:00:34.823 INFO:tasks.workunit.client.0.smithi152.stdout:5/754: dread - d7/d43/d6c/fd4 zero size 2023-12-06T15:00:34.825 INFO:tasks.workunit.client.0.smithi152.stdout:0/622: sync 2023-12-06T15:00:34.825 INFO:tasks.workunit.client.0.smithi152.stdout:0/623: chown d8/fd 14709 1 2023-12-06T15:00:34.828 INFO:tasks.workunit.client.0.smithi152.stdout:4/930: mknod d2/d10/d52/c133 0 2023-12-06T15:00:34.828 INFO:tasks.workunit.client.0.smithi152.stdout:4/931: fdatasync d2/f72 0 2023-12-06T15:00:34.832 INFO:tasks.workunit.client.0.smithi152.stdout:7/527: rename dd/df/d1b/d4e/l61 to dd/df/d1b/d20/la6 0 2023-12-06T15:00:34.832 INFO:tasks.workunit.client.0.smithi152.stdout:1/949: link d3/da/d15/d17/d1a/l23 d3/d10a/d112/l153 0 2023-12-06T15:00:34.832 INFO:tasks.workunit.client.0.smithi152.stdout:7/528: fsync dd/df/d1b/d20/d28/d53/f3f 0 2023-12-06T15:00:34.832 INFO:tasks.workunit.client.0.smithi152.stdout:7/529: chown dd 4801663 1 2023-12-06T15:00:34.835 INFO:tasks.workunit.client.0.smithi152.stdout:3/647: mknod d9/d18/d51/d8d/d8f/da0/dab/dc3/cc7 0 2023-12-06T15:00:34.835 INFO:tasks.workunit.client.0.smithi152.stdout:6/869: getdents d1/dcf/ddc/d1a/d30/d18/dc5 0 2023-12-06T15:00:34.836 INFO:tasks.workunit.client.0.smithi152.stdout:0/624: mknod d8/cd1 0 2023-12-06T15:00:34.836 INFO:tasks.workunit.client.0.smithi152.stdout:0/625: chown d8/d3e/d87/l3b 236881 1 2023-12-06T15:00:34.836 INFO:tasks.workunit.client.0.smithi152.stdout:1/950: symlink d3/da/d4c/d82/l154 0 2023-12-06T15:00:34.836 INFO:tasks.workunit.client.0.smithi152.stdout:1/951: chown d3/da/d65/l10e 6 1 2023-12-06T15:00:34.837 INFO:tasks.workunit.client.0.smithi152.stdout:1/952: fsync d3/da/d15/d17/d58/f64 0 2023-12-06T15:00:34.839 INFO:tasks.workunit.client.0.smithi152.stdout:1/953: write d3/d73/ffa [2178910,20415] 0 2023-12-06T15:00:34.839 INFO:tasks.workunit.client.0.smithi152.stdout:7/530: truncate dd/df/d1b/d20/d28/f80 2038582 0 2023-12-06T15:00:34.840 INFO:tasks.workunit.client.0.smithi152.stdout:5/755: rename d7/d43/d6c/d98/cf4 to d7/dd/d26/d87/d100/c109 0 2023-12-06T15:00:34.840 INFO:tasks.workunit.client.0.smithi152.stdout:5/756: truncate d7/d43/f7f 1704968 0 2023-12-06T15:00:34.842 INFO:tasks.workunit.client.0.smithi152.stdout:0/626: mknod d8/d3e/d87/cd2 0 2023-12-06T15:00:34.842 INFO:tasks.workunit.client.0.smithi152.stdout:0/627: dread - d8/d15/d45/d73/db9/dc4/fcd zero size 2023-12-06T15:00:34.843 INFO:tasks.workunit.client.0.smithi152.stdout:7/531: truncate f7 1353365 0 2023-12-06T15:00:34.845 INFO:tasks.workunit.client.0.smithi152.stdout:6/870: rename d1/dcf/ddc/d1a/d30/d18/c7a to d1/d69/da1/deb/d112/c130 0 2023-12-06T15:00:34.846 INFO:tasks.workunit.client.0.smithi152.stdout:7/532: symlink dd/d69/la7 0 2023-12-06T15:00:34.847 INFO:tasks.workunit.client.0.smithi152.stdout:7/533: mkdir dd/d17/da8 0 2023-12-06T15:00:34.858 INFO:tasks.workunit.client.0.smithi152.stdout:5/757: dread d7/dd/d26/d48/d97/dc2/fe8 [0,4194304] 0 2023-12-06T15:00:34.858 INFO:tasks.workunit.client.0.smithi152.stdout:7/534: write dd/df/d1b/f7d [4175932,62170] 0 2023-12-06T15:00:34.861 INFO:tasks.workunit.client.0.smithi152.stdout:5/758: symlink d7/dd/d26/df6/l10a 0 2023-12-06T15:00:34.861 INFO:tasks.workunit.client.0.smithi152.stdout:5/759: getdents d7/d43/d6c/dde/de3 0 2023-12-06T15:00:34.862 INFO:tasks.workunit.client.0.smithi152.stdout:5/760: dread - d7/dd/d26/f36 zero size 2023-12-06T15:00:34.862 INFO:tasks.workunit.client.0.smithi152.stdout:5/761: write d7/dd/d26/d87/dc4/ddc/fcb [875467,74933] 0 2023-12-06T15:00:34.862 INFO:tasks.workunit.client.0.smithi152.stdout:5/762: dread - d7/d43/d9c/dfb/ffe zero size 2023-12-06T15:00:34.862 INFO:tasks.workunit.client.0.smithi152.stdout:6/871: dread d1/dcf/ddc/d1a/d30/d36/d35/d49/d6b/f95 [0,4194304] 0 2023-12-06T15:00:34.862 INFO:tasks.workunit.client.0.smithi152.stdout:6/872: chown d1/dcf/ddc/d6d/f7f 324760 1 2023-12-06T15:00:34.863 INFO:tasks.workunit.client.0.smithi152.stdout:5/763: creat d7/dd/d26/f10b x:0 0 0 2023-12-06T15:00:34.863 INFO:tasks.workunit.client.0.smithi152.stdout:6/873: mknod d1/dcf/ddc/d1a/d30/c131 0 2023-12-06T15:00:34.872 INFO:tasks.workunit.client.1.smithi190.stdout:6/979: dwrite d4/d12/d1a/d8a/fb2 [0,4194304] 0 2023-12-06T15:00:34.876 INFO:tasks.workunit.client.1.smithi190.stdout:6/980: mknod d4/d12/d1a/d8a/da3/c143 0 2023-12-06T15:00:34.892 INFO:tasks.workunit.client.0.smithi152.stdout:8/592: sync 2023-12-06T15:00:34.892 INFO:tasks.workunit.client.0.smithi152.stdout:9/659: sync 2023-12-06T15:00:34.892 INFO:tasks.workunit.client.0.smithi152.stdout:8/593: fdatasync d1/d6/d34/d36/f4f 0 2023-12-06T15:00:34.892 INFO:tasks.workunit.client.0.smithi152.stdout:9/660: truncate d0/d3f/d68/d6c/d20/d38/d45/f85 4677320 0 2023-12-06T15:00:34.918 INFO:tasks.workunit.client.1.smithi190.stdout:0/846: dwrite d0/da/d3e/d3a/d40/d81/f92 [0,4194304] 0 2023-12-06T15:00:34.920 INFO:tasks.workunit.client.1.smithi190.stdout:0/847: creat d0/da/d3e/d2b/d3c/d10f/f11b x:0 0 0 2023-12-06T15:00:34.921 INFO:tasks.workunit.client.1.smithi190.stdout:0/848: mkdir d0/da/d3e/d2b/d3c/d11c 0 2023-12-06T15:00:34.921 INFO:tasks.workunit.client.1.smithi190.stdout:0/849: truncate d0/da/d3e/d2b/d3c/d46/f73 4780406 0 2023-12-06T15:00:34.923 INFO:tasks.workunit.client.1.smithi190.stdout:0/850: link d0/da/da4/c104 d0/da/d3e/d3a/d40/d6f/d9e/de8/c11d 0 2023-12-06T15:00:34.924 INFO:tasks.workunit.client.1.smithi190.stdout:0/851: link d0/da/d3e/d2b/d3c/d46/d8e/fa0 d0/da/d5a/f11e 0 2023-12-06T15:00:34.925 INFO:tasks.workunit.client.1.smithi190.stdout:0/852: creat d0/da/d3e/db8/d110/f11f x:0 0 0 2023-12-06T15:00:34.931 INFO:tasks.workunit.client.1.smithi190.stdout:0/853: dread d0/da/fa3 [0,4194304] 0 2023-12-06T15:00:34.937 INFO:tasks.workunit.client.1.smithi190.stdout:0/854: dread d0/da/d3e/d3a/d40/d6f/fba [0,4194304] 0 2023-12-06T15:00:34.938 INFO:tasks.workunit.client.1.smithi190.stdout:0/855: rmdir d0/da/d5a 39 2023-12-06T15:00:34.939 INFO:tasks.workunit.client.1.smithi190.stdout:0/856: mknod d0/da/d3e/d2b/d3c/d4c/da8/c120 0 2023-12-06T15:00:34.940 INFO:tasks.workunit.client.1.smithi190.stdout:0/857: truncate d0/da/f25 1382059 0 2023-12-06T15:00:34.940 INFO:tasks.workunit.client.1.smithi190.stdout:0/858: symlink d0/da/d3e/d2b/d3c/d4c/dcc/l121 0 2023-12-06T15:00:34.957 INFO:tasks.workunit.client.0.smithi152.stdout:4/932: dwrite d2/d10/dbb/dca/dbc/d75/deb/f101 [0,4194304] 0 2023-12-06T15:00:34.959 INFO:tasks.workunit.client.0.smithi152.stdout:4/933: mkdir d2/d89/d134 0 2023-12-06T15:00:34.959 INFO:tasks.workunit.client.0.smithi152.stdout:4/934: chown d2/d10/dbb/dca/dcb/c129 4 1 2023-12-06T15:00:34.959 INFO:tasks.workunit.client.0.smithi152.stdout:4/935: dread - d2/d15/d32/d69/d6f/daf/f10a zero size 2023-12-06T15:00:34.960 INFO:tasks.workunit.client.0.smithi152.stdout:4/936: rename d2/d15/f62 to d2/d15/d32/d69/d6f/f135 0 2023-12-06T15:00:34.986 INFO:tasks.workunit.client.0.smithi152.stdout:9/661: dwrite d0/d3f/d68/f6a [0,4194304] 0 2023-12-06T15:00:34.986 INFO:tasks.workunit.client.0.smithi152.stdout:9/662: read d0/d3f/d68/d6c/d20/d38/d44/f77 [384733,55128] 0 2023-12-06T15:00:34.986 INFO:tasks.workunit.client.0.smithi152.stdout:9/663: write d0/d3f/d5f/f9d [675258,117530] 0 2023-12-06T15:00:34.988 INFO:tasks.workunit.client.0.smithi152.stdout:9/664: write d0/d3f/d68/d6c/f2f [2607784,113693] 0 2023-12-06T15:00:34.992 INFO:tasks.workunit.client.0.smithi152.stdout:1/954: dwrite d3/da/d15/d17/d58/da3/f139 [0,4194304] 0 2023-12-06T15:00:34.992 INFO:tasks.workunit.client.0.smithi152.stdout:1/955: stat d3/da/db/f4b 0 2023-12-06T15:00:34.992 INFO:tasks.workunit.client.1.smithi190.stdout:3/932: dwrite d4/d70/d33/fa9 [0,4194304] 0 2023-12-06T15:00:34.992 INFO:tasks.workunit.client.1.smithi190.stdout:3/933: chown d4/d1b/d54/d9c/d68/dfc/dc4/dce/f147 166262 1 2023-12-06T15:00:34.992 INFO:tasks.workunit.client.1.smithi190.stdout:8/901: dwrite d1/d20/d3b/d4c/d59/f81 [0,4194304] 0 2023-12-06T15:00:34.994 INFO:tasks.workunit.client.1.smithi190.stdout:3/934: symlink d4/d70/d19/d51/dab/l148 0 2023-12-06T15:00:34.995 INFO:tasks.workunit.client.1.smithi190.stdout:3/935: creat d4/d70/d19/d51/d109/db7/dd2/f149 x:0 0 0 2023-12-06T15:00:34.995 INFO:tasks.workunit.client.1.smithi190.stdout:3/936: fsync d4/d70/d19/d3a/f106 0 2023-12-06T15:00:34.996 INFO:tasks.workunit.client.1.smithi190.stdout:3/937: link d4/d70/d19/d3a/f7b d4/d70/d33/f14a 0 2023-12-06T15:00:34.997 INFO:tasks.workunit.client.1.smithi190.stdout:3/938: dread - d4/d1b/d54/d9c/d68/f11f zero size 2023-12-06T15:00:34.997 INFO:tasks.workunit.client.1.smithi190.stdout:3/939: symlink d4/d70/dcb/d11c/l14b 0 2023-12-06T15:00:34.998 INFO:tasks.workunit.client.1.smithi190.stdout:3/940: mknod d4/d1b/d54/d9c/d68/dfc/d56/d94/c14c 0 2023-12-06T15:00:34.999 INFO:tasks.workunit.client.0.smithi152.stdout:6/874: dwrite d1/dcf/ddc/d1a/d30/da4/fe7 [0,4194304] 0 2023-12-06T15:00:34.999 INFO:tasks.workunit.client.0.smithi152.stdout:3/648: dwrite d9/d10/d12/f3e [0,4194304] 0 2023-12-06T15:00:34.999 INFO:tasks.workunit.client.0.smithi152.stdout:0/628: dwrite d8/d3e/d87/faf [0,4194304] 0 2023-12-06T15:00:34.999 INFO:tasks.workunit.client.0.smithi152.stdout:7/535: dwrite dd/df/d34/d44/f8c [4194304,4194304] 0 2023-12-06T15:00:34.999 INFO:tasks.workunit.client.0.smithi152.stdout:7/536: fdatasync dd/df/d1b/d20/d28/f3e 0 2023-12-06T15:00:35.000 INFO:tasks.workunit.client.1.smithi190.stdout:6/981: dwrite d4/d12/d1a/d59/f65 [0,4194304] 0 2023-12-06T15:00:35.000 INFO:tasks.workunit.client.1.smithi190.stdout:3/941: write d4/d1b/d54/d9c/d68/dfc/d56/d94/f4e [445853,76229] 0 2023-12-06T15:00:35.000 INFO:tasks.workunit.client.0.smithi152.stdout:8/594: dwrite d1/d6/d34/d40/f52 [0,4194304] 0 2023-12-06T15:00:35.003 INFO:tasks.workunit.client.1.smithi190.stdout:3/942: write d4/d1b/d5d/fe3 [2595642,21497] 0 2023-12-06T15:00:35.003 INFO:tasks.workunit.client.1.smithi190.stdout:3/943: stat d4/d1b/d54/d9c/d68/dfc/d56/l7d 0 2023-12-06T15:00:35.003 INFO:tasks.workunit.client.1.smithi190.stdout:3/944: chown d4/d70/d19/d3a/f46 3831 1 2023-12-06T15:00:35.003 INFO:tasks.workunit.client.1.smithi190.stdout:3/945: write d4/d70/d19/d3a/d3b/f10c [652027,99906] 0 2023-12-06T15:00:35.004 INFO:tasks.workunit.client.1.smithi190.stdout:3/946: creat d4/d70/d19/d51/d109/db7/f14d x:0 0 0 2023-12-06T15:00:35.005 INFO:tasks.workunit.client.1.smithi190.stdout:3/947: unlink d4/ccd 0 2023-12-06T15:00:35.007 INFO:tasks.workunit.client.1.smithi190.stdout:3/948: unlink d4/d1b/d5d/df1/db5/ld7 0 2023-12-06T15:00:35.008 INFO:tasks.workunit.client.1.smithi190.stdout:3/949: link d4/d70/d19/d3a/d3b/d72/df5/ff9 d4/d70/d19/d51/d109/db7/dd2/d139/f14e 0 2023-12-06T15:00:35.008 INFO:tasks.workunit.client.1.smithi190.stdout:3/950: fsync d4/d70/d19/f57 0 2023-12-06T15:00:35.011 INFO:tasks.workunit.client.1.smithi190.stdout:3/951: dread d4/d1b/d5d/df1/f8e [0,4194304] 0 2023-12-06T15:00:35.016 INFO:tasks.workunit.client.0.smithi152.stdout:4/937: creat d2/d10/dbb/dca/dbc/f136 x:0 0 0 2023-12-06T15:00:35.019 INFO:tasks.workunit.client.1.smithi190.stdout:0/859: dwrite d0/da/d3e/d2b/d3c/f5f [0,4194304] 0 2023-12-06T15:00:35.020 INFO:tasks.workunit.client.0.smithi152.stdout:9/665: truncate d0/f1 3889885 0 2023-12-06T15:00:35.022 INFO:tasks.workunit.client.1.smithi190.stdout:0/860: mkdir d0/da/d3e/db8/d122 0 2023-12-06T15:00:35.022 INFO:tasks.workunit.client.1.smithi190.stdout:0/861: truncate d0/da/d3e/db8/f112 608612 0 2023-12-06T15:00:35.022 INFO:tasks.workunit.client.1.smithi190.stdout:0/862: write d0/da/d3e/d2b/d37/fdc [317233,80566] 0 2023-12-06T15:00:35.023 INFO:tasks.workunit.client.0.smithi152.stdout:1/956: truncate d3/da/d15/f3f 1403343 0 2023-12-06T15:00:35.024 INFO:tasks.workunit.client.1.smithi190.stdout:3/952: dread d4/d70/d19/d3a/f106 [0,4194304] 0 2023-12-06T15:00:35.024 INFO:tasks.workunit.client.1.smithi190.stdout:3/953: chown d4/d70 635009 1 2023-12-06T15:00:35.024 INFO:tasks.workunit.client.0.smithi152.stdout:9/666: dread d0/d3f/d68/d6c/d20/d38/d45/f63 [0,4194304] 0 2023-12-06T15:00:35.024 INFO:tasks.workunit.client.0.smithi152.stdout:9/667: write d0/d3f/d68/d6c/f3b [611923,5030] 0 2023-12-06T15:00:35.025 INFO:tasks.workunit.client.1.smithi190.stdout:3/954: creat d4/f14f x:0 0 0 2023-12-06T15:00:35.025 INFO:tasks.workunit.client.0.smithi152.stdout:9/668: write d0/d3f/d68/d6c/d20/d38/d44/f58 [115450,96943] 0 2023-12-06T15:00:35.026 INFO:tasks.workunit.client.1.smithi190.stdout:3/955: symlink d4/d1b/d54/d9c/d68/dfc/d56/d83/de2/l150 0 2023-12-06T15:00:35.026 INFO:tasks.workunit.client.1.smithi190.stdout:3/956: write d4/d1b/d54/d9c/d68/dfc/d56/d94/f81 [4943927,111909] 0 2023-12-06T15:00:35.029 INFO:tasks.workunit.client.1.smithi190.stdout:3/957: link d4/d1b/d5d/df1/l13a d4/d70/dcb/d11c/l151 0 2023-12-06T15:00:35.029 INFO:tasks.workunit.client.1.smithi190.stdout:3/958: fdatasync d4/d70/d19/d51/d109/db7/dd2/f10b 0 2023-12-06T15:00:35.030 INFO:tasks.workunit.client.1.smithi190.stdout:3/959: chown d4/d1b/d54/d9c/d68/dfc/d56/d83/de2/f10a 29 1 2023-12-06T15:00:35.031 INFO:tasks.workunit.client.1.smithi190.stdout:3/960: creat d4/d1b/d54/d9c/d68/f152 x:0 0 0 2023-12-06T15:00:35.032 INFO:tasks.workunit.client.0.smithi152.stdout:3/649: dwrite d9/d18/f6b [0,4194304] 0 2023-12-06T15:00:35.032 INFO:tasks.workunit.client.0.smithi152.stdout:3/650: truncate d9/d18/d39/f8a 5215366 0 2023-12-06T15:00:35.032 INFO:tasks.workunit.client.0.smithi152.stdout:3/651: fsync d9/d10/d12/d43/d52/db4/fa4 0 2023-12-06T15:00:35.036 INFO:tasks.workunit.client.1.smithi190.stdout:3/961: symlink d4/d70/d19/d3a/d3b/d72/df5/l153 0 2023-12-06T15:00:35.037 INFO:tasks.workunit.client.1.smithi190.stdout:0/863: dread d0/da/d3e/d2b/d3c/d10f/f117 [0,4194304] 0 2023-12-06T15:00:35.041 INFO:tasks.workunit.client.1.smithi190.stdout:2/898: sync 2023-12-06T15:00:35.041 INFO:tasks.workunit.client.1.smithi190.stdout:2/899: write d10/d26/d8a/d8f/f120 [953417,7417] 0 2023-12-06T15:00:35.043 INFO:tasks.workunit.client.0.smithi152.stdout:0/629: getdents d8/d3e 0 2023-12-06T15:00:35.043 INFO:tasks.workunit.client.0.smithi152.stdout:0/630: fsync d8/d3e/d6f/fc0 0 2023-12-06T15:00:35.043 INFO:tasks.workunit.client.0.smithi152.stdout:0/631: stat d8/d15/d45/d73/d8c/lc2 0 2023-12-06T15:00:35.046 INFO:tasks.workunit.client.0.smithi152.stdout:6/875: symlink d1/dcf/ddc/d1a/d30/daa/l132 0 2023-12-06T15:00:35.046 INFO:tasks.workunit.client.0.smithi152.stdout:6/876: chown d1/dcf/ddc/d1a/d30/d36/d35/d49/d57/l7b 13778980 1 2023-12-06T15:00:35.046 INFO:tasks.workunit.client.0.smithi152.stdout:6/877: write d1/fea [1086594,116515] 0 2023-12-06T15:00:35.047 INFO:tasks.workunit.client.1.smithi190.stdout:2/900: write d10/d59/dcd/dad/fe2 [905462,117683] 0 2023-12-06T15:00:35.049 INFO:tasks.workunit.client.0.smithi152.stdout:7/537: creat dd/d17/da8/fa9 x:0 0 0 2023-12-06T15:00:35.052 INFO:tasks.workunit.client.0.smithi152.stdout:6/878: dread d1/dcf/ddc/d1a/d30/d36/d35/d49/da6/da9/d120/fdb [0,4194304] 0 2023-12-06T15:00:35.052 INFO:tasks.workunit.client.0.smithi152.stdout:6/879: rename d1/dcf/ddc/d1a/d30/d18/dc5 to d1/dcf/ddc/d1a/d30/d18/dc5/d133 22 2023-12-06T15:00:35.053 INFO:tasks.workunit.client.0.smithi152.stdout:6/880: fsync d1/dcf/ddc/d1a/fe8 0 2023-12-06T15:00:35.053 INFO:tasks.workunit.client.0.smithi152.stdout:6/881: fdatasync d1/dcf/ddc/d1a/d30/d36/d35/d49/da6/da9/d120/fdb 0 2023-12-06T15:00:35.053 INFO:tasks.workunit.client.0.smithi152.stdout:8/595: creat d1/d6/d29/d87/daa/fbe x:0 0 0 2023-12-06T15:00:35.058 INFO:tasks.workunit.client.0.smithi152.stdout:4/938: creat d2/d89/d134/f137 x:0 0 0 2023-12-06T15:00:35.061 INFO:tasks.workunit.client.1.smithi190.stdout:2/901: dread d10/d26/f2f [4194304,4194304] 0 2023-12-06T15:00:35.061 INFO:tasks.workunit.client.0.smithi152.stdout:1/957: mkdir d3/da/d4c/d63/d96/d155 0 2023-12-06T15:00:35.062 INFO:tasks.workunit.client.0.smithi152.stdout:1/958: chown d3/da/d4c/d63/d96/ce7 13562567 1 2023-12-06T15:00:35.066 INFO:tasks.workunit.client.0.smithi152.stdout:9/669: creat d0/d3f/d5f/d86/fc2 x:0 0 0 2023-12-06T15:00:35.069 INFO:tasks.workunit.client.1.smithi190.stdout:3/962: dwrite d4/d1b/d77/fdc [0,4194304] 0 2023-12-06T15:00:35.072 INFO:tasks.workunit.client.0.smithi152.stdout:3/652: unlink d9/d10/d12/f30 0 2023-12-06T15:00:35.073 INFO:tasks.workunit.client.0.smithi152.stdout:0/632: mknod d8/d3e/cd3 0 2023-12-06T15:00:35.074 INFO:tasks.workunit.client.1.smithi190.stdout:0/864: dwrite d0/da/d3e/d2b/d3c/d4c/da8/fb9 [0,4194304] 0 2023-12-06T15:00:35.075 INFO:tasks.workunit.client.0.smithi152.stdout:6/882: creat d1/dcf/ddc/d1a/d30/d18/f134 x:0 0 0 2023-12-06T15:00:35.076 INFO:tasks.workunit.client.0.smithi152.stdout:6/883: read d1/d69/da1/f9e [262853,94224] 0 2023-12-06T15:00:35.078 INFO:tasks.workunit.client.0.smithi152.stdout:8/596: rename d1/d6/d29/f91 to d1/d6/d34/d35/d8d/fbf 0 2023-12-06T15:00:35.079 INFO:tasks.workunit.client.0.smithi152.stdout:7/538: dwrite dd/d17/f6c [0,4194304] 0 2023-12-06T15:00:35.079 INFO:tasks.workunit.client.0.smithi152.stdout:7/539: truncate dd/df/d1b/d20/d7c/f88 1049190 0 2023-12-06T15:00:35.080 INFO:tasks.workunit.client.0.smithi152.stdout:4/939: creat d2/d15/d32/d69/d6f/d10b/f138 x:0 0 0 2023-12-06T15:00:35.080 INFO:tasks.workunit.client.0.smithi152.stdout:0/633: dread d8/d15/f93 [0,4194304] 0 2023-12-06T15:00:35.081 INFO:tasks.workunit.client.0.smithi152.stdout:0/634: readlink d8/d15/d45/d73/d7a/l4c 0 2023-12-06T15:00:35.081 INFO:tasks.workunit.client.0.smithi152.stdout:0/635: dread - d8/d15/d45/f84 zero size 2023-12-06T15:00:35.081 INFO:tasks.workunit.client.1.smithi190.stdout:0/865: rename d0/da/d3e/d2b/d3c/fd4 to d0/da/d3e/d2b/d3c/d46/f123 0 2023-12-06T15:00:35.081 INFO:tasks.workunit.client.1.smithi190.stdout:0/866: truncate d0/da/d3e/d3a/d40/f5e 3989157 0 2023-12-06T15:00:35.082 INFO:tasks.workunit.client.0.smithi152.stdout:1/959: symlink d3/d73/l156 0 2023-12-06T15:00:35.083 INFO:tasks.workunit.client.0.smithi152.stdout:9/670: creat d0/d3f/d68/d6c/d20/d38/da8/fc3 x:0 0 0 2023-12-06T15:00:35.083 INFO:tasks.workunit.client.0.smithi152.stdout:9/671: write d0/f6 [2444290,48524] 0 2023-12-06T15:00:35.085 INFO:tasks.workunit.client.0.smithi152.stdout:8/597: creat d1/d6/d34/d3a/fc0 x:0 0 0 2023-12-06T15:00:35.085 INFO:tasks.workunit.client.0.smithi152.stdout:3/653: dread d9/d10/d12/d43/d52/f71 [0,4194304] 0 2023-12-06T15:00:35.085 INFO:tasks.workunit.client.0.smithi152.stdout:6/884: dread d1/dcf/ddc/d1a/d30/d36/d4e/fb2 [0,4194304] 0 2023-12-06T15:00:35.087 INFO:tasks.workunit.client.1.smithi190.stdout:2/902: dwrite d10/d26/d5c/d49/f9c [4194304,4194304] 0 2023-12-06T15:00:35.087 INFO:tasks.workunit.client.1.smithi190.stdout:3/963: fsync d4/d1b/d54/d9c/d68/dfc/d56/d94/f81 0 2023-12-06T15:00:35.087 INFO:tasks.workunit.client.1.smithi190.stdout:3/964: fsync d4/d1b/d5d/faf 0 2023-12-06T15:00:35.088 INFO:tasks.workunit.client.0.smithi152.stdout:2/626: sync 2023-12-06T15:00:35.088 INFO:tasks.workunit.client.0.smithi152.stdout:2/627: dread - d6/d1e/d41/d55/f76 zero size 2023-12-06T15:00:35.088 INFO:tasks.workunit.client.1.smithi190.stdout:2/903: truncate d10/d59/d5e/f1b 3132053 0 2023-12-06T15:00:35.089 INFO:tasks.workunit.client.1.smithi190.stdout:3/965: creat d4/d1b/d5d/df1/f154 x:0 0 0 2023-12-06T15:00:35.089 INFO:tasks.workunit.client.1.smithi190.stdout:3/966: chown d4/d1b/d54/d9c/d68/dfc/d56/d94/c114 3179570 1 2023-12-06T15:00:35.089 INFO:tasks.workunit.client.1.smithi190.stdout:3/967: stat d4/d1b/d69/f95 0 2023-12-06T15:00:35.091 INFO:tasks.workunit.client.0.smithi152.stdout:7/540: rename dd/df/l62 to dd/df/d1b/d20/d7c/d86/da4/laa 0 2023-12-06T15:00:35.092 INFO:tasks.workunit.client.0.smithi152.stdout:4/940: unlink d2/d15/d32/d69/d6f/l12f 0 2023-12-06T15:00:35.092 INFO:tasks.workunit.client.1.smithi190.stdout:2/904: symlink d10/d26/d5c/d49/d54/l12f 0 2023-12-06T15:00:35.093 INFO:tasks.workunit.client.1.smithi190.stdout:2/905: getdents d10/d59/dcd/d12d 0 2023-12-06T15:00:35.093 INFO:tasks.workunit.client.0.smithi152.stdout:3/654: write d9/d10/f2a [545961,105545] 0 2023-12-06T15:00:35.094 INFO:tasks.workunit.client.0.smithi152.stdout:0/636: mkdir d8/d3e/d6f/dd4 0 2023-12-06T15:00:35.096 INFO:tasks.workunit.client.1.smithi190.stdout:0/867: dread d0/da/d3e/d2b/d37/f39 [0,4194304] 0 2023-12-06T15:00:35.097 INFO:tasks.workunit.client.1.smithi190.stdout:2/906: dread d10/d26/d5c/d8d/faa [0,4194304] 0 2023-12-06T15:00:35.099 INFO:tasks.workunit.client.0.smithi152.stdout:3/655: write d9/f37 [2134665,12250] 0 2023-12-06T15:00:35.100 INFO:tasks.workunit.client.0.smithi152.stdout:3/656: truncate d9/d18/fa1 2046490 0 2023-12-06T15:00:35.100 INFO:tasks.workunit.client.0.smithi152.stdout:3/657: dread - d9/d18/d51/d8d/d8f/da0/dab/dc3/db6/fb7 zero size 2023-12-06T15:00:35.100 INFO:tasks.workunit.client.0.smithi152.stdout:1/960: mknod d3/da/d15/d17/d43/d7d/c157 0 2023-12-06T15:00:35.100 INFO:tasks.workunit.client.0.smithi152.stdout:1/961: fsync d3/da/d15/d17/f60 0 2023-12-06T15:00:35.100 INFO:tasks.workunit.client.0.smithi152.stdout:8/598: mknod d1/d6/d29/d5b/cc1 0 2023-12-06T15:00:35.102 INFO:tasks.workunit.client.0.smithi152.stdout:2/628: dread d6/db/d17/f28 [0,4194304] 0 2023-12-06T15:00:35.104 INFO:tasks.workunit.client.0.smithi152.stdout:6/885: link d1/dcf/ddc/d1a/d30/da4/cbb d1/dcf/ddc/d1a/d30/da4/de6/c135 0 2023-12-06T15:00:35.107 INFO:tasks.workunit.client.0.smithi152.stdout:7/541: creat dd/df/d34/d44/d49/d73/d77/da2/fab x:0 0 0 2023-12-06T15:00:35.107 INFO:tasks.workunit.client.0.smithi152.stdout:7/542: write dd/df/d34/d44/d49/d73/d77/da2/fab [745170,21546] 0 2023-12-06T15:00:35.108 INFO:tasks.workunit.client.0.smithi152.stdout:1/962: write d3/da/d15/d17/d58/fe4 [1856121,108836] 0 2023-12-06T15:00:35.108 INFO:tasks.workunit.client.1.smithi190.stdout:2/907: dread d10/d59/dcd/dad/fc0 [0,4194304] 0 2023-12-06T15:00:35.109 INFO:tasks.workunit.client.0.smithi152.stdout:9/672: rename d0/d3f/d68/d6c/d20/d4a/d4d to d0/d3f/d68/d6c/d20/d38/d44/dc4 0 2023-12-06T15:00:35.111 INFO:tasks.workunit.client.1.smithi190.stdout:2/908: mkdir d10/d26/d5c/d42/d130 0 2023-12-06T15:00:35.112 INFO:tasks.workunit.client.0.smithi152.stdout:4/941: symlink d2/d89/df9/l139 0 2023-12-06T15:00:35.124 INFO:tasks.workunit.client.0.smithi152.stdout:1/963: dread d3/d73/ff5 [0,4194304] 0 2023-12-06T15:00:35.128 INFO:tasks.workunit.client.0.smithi152.stdout:3/658: symlink d9/d18/lc8 0 2023-12-06T15:00:35.133 INFO:tasks.workunit.client.0.smithi152.stdout:8/599: rename d1/d6/d34/d36/f26 to d1/d6/d34/d36/fc2 0 2023-12-06T15:00:35.133 INFO:tasks.workunit.client.0.smithi152.stdout:2/629: symlink d6/db/d17/lc6 0 2023-12-06T15:00:35.133 INFO:tasks.workunit.client.0.smithi152.stdout:8/600: write d1/d6/d34/d36/fc2 [4969880,16057] 0 2023-12-06T15:00:35.133 INFO:tasks.workunit.client.0.smithi152.stdout:2/630: read - d6/f8e zero size 2023-12-06T15:00:35.133 INFO:tasks.workunit.client.0.smithi152.stdout:5/764: sync 2023-12-06T15:00:35.133 INFO:tasks.workunit.client.0.smithi152.stdout:7/543: mkdir dd/df/d34/dac 0 2023-12-06T15:00:35.133 INFO:tasks.workunit.client.0.smithi152.stdout:5/765: write d7/f19 [404943,51729] 0 2023-12-06T15:00:35.138 INFO:tasks.workunit.client.1.smithi190.stdout:0/868: dwrite d0/da/d3e/d2b/d3c/d46/d8e/fb5 [0,4194304] 0 2023-12-06T15:00:35.138 INFO:tasks.workunit.client.0.smithi152.stdout:9/673: link d0/c13 d0/d3f/d68/d6c/d20/d4a/d71/db1/cc5 0 2023-12-06T15:00:35.139 INFO:tasks.workunit.client.0.smithi152.stdout:1/964: dread d3/da/d15/d17/d147/d55/f56 [0,4194304] 0 2023-12-06T15:00:35.142 INFO:tasks.workunit.client.0.smithi152.stdout:0/637: rename d8/d15/f18 to d8/dcc/fd5 0 2023-12-06T15:00:35.142 INFO:tasks.workunit.client.0.smithi152.stdout:0/638: dread - d8/d3e/d6f/f95 zero size 2023-12-06T15:00:35.143 INFO:tasks.workunit.client.0.smithi152.stdout:3/659: symlink d9/d10/d12/d43/d52/d58/lc9 0 2023-12-06T15:00:35.144 INFO:tasks.workunit.client.0.smithi152.stdout:7/544: getdents dd/df/d34/d44/d49/d73/d77 0 2023-12-06T15:00:35.144 INFO:tasks.workunit.client.0.smithi152.stdout:5/766: creat d7/d43/f10c x:0 0 0 2023-12-06T15:00:35.150 INFO:tasks.workunit.client.0.smithi152.stdout:9/674: getdents d0/d3f/d68/d6c/d20/db0/db3 0 2023-12-06T15:00:35.150 INFO:tasks.workunit.client.0.smithi152.stdout:8/601: dread d1/d6/d34/fa2 [0,4194304] 0 2023-12-06T15:00:35.151 INFO:tasks.workunit.client.0.smithi152.stdout:1/965: mkdir d3/da/d15/d17/d4d/da7/d158 0 2023-12-06T15:00:35.151 INFO:tasks.workunit.client.0.smithi152.stdout:1/966: chown d3/da/d15/d17/d43/c124 16 1 2023-12-06T15:00:35.151 INFO:tasks.workunit.client.0.smithi152.stdout:5/767: dread d7/dd/d26/d87/f102 [0,4194304] 0 2023-12-06T15:00:35.152 INFO:tasks.workunit.client.0.smithi152.stdout:0/639: mkdir d8/d15/d45/dd6 0 2023-12-06T15:00:35.155 INFO:tasks.workunit.client.0.smithi152.stdout:7/545: link dd/df/d1b/d20/d7c/d86/da4/laa dd/d69/d89/lad 0 2023-12-06T15:00:35.155 INFO:tasks.workunit.client.0.smithi152.stdout:7/546: truncate f7 2096483 0 2023-12-06T15:00:35.156 INFO:tasks.workunit.client.0.smithi152.stdout:9/675: write d0/d3f/d68/d6c/d20/d38/d48/d90/f95 [1685578,30464] 0 2023-12-06T15:00:35.156 INFO:tasks.workunit.client.0.smithi152.stdout:9/676: write d0/d3f/d68/d6c/d20/db0/f61 [1039802,124948] 0 2023-12-06T15:00:35.156 INFO:tasks.workunit.client.0.smithi152.stdout:8/602: creat d1/d6/d86/fc3 x:0 0 0 2023-12-06T15:00:35.157 INFO:tasks.workunit.client.0.smithi152.stdout:1/967: symlink d3/da/d15/d17/d58/d9f/l159 0 2023-12-06T15:00:35.158 INFO:tasks.workunit.client.0.smithi152.stdout:6/886: dwrite d1/dcf/ddc/d1a/d30/fe [8388608,4194304] 0 2023-12-06T15:00:35.158 INFO:tasks.workunit.client.0.smithi152.stdout:3/660: dread d9/d10/d12/d43/f78 [0,4194304] 0 2023-12-06T15:00:35.158 INFO:tasks.workunit.client.1.smithi190.stdout:2/909: dwrite d10/d26/d5c/f63 [0,4194304] 0 2023-12-06T15:00:35.159 INFO:tasks.workunit.client.0.smithi152.stdout:4/942: dwrite d2/d15/d32/d69/d6f/daf/f10d [0,4194304] 0 2023-12-06T15:00:35.159 INFO:tasks.workunit.client.0.smithi152.stdout:0/640: unlink d8/d3e/fb0 0 2023-12-06T15:00:35.159 INFO:tasks.workunit.client.0.smithi152.stdout:4/943: write d2/d15/d32/d69/d6f/d10b/fb6 [2777192,102114] 0 2023-12-06T15:00:35.160 INFO:tasks.workunit.client.0.smithi152.stdout:4/944: write d2/d10/dbb/dca/f12a [617729,1105] 0 2023-12-06T15:00:35.160 INFO:tasks.workunit.client.1.smithi190.stdout:0/869: dwrite d0/da/d3e/d2b/d3c/d65/fcb [0,4194304] 0 2023-12-06T15:00:35.162 INFO:tasks.workunit.client.0.smithi152.stdout:7/547: mknod dd/df/d34/d44/d49/cae 0 2023-12-06T15:00:35.162 INFO:tasks.workunit.client.0.smithi152.stdout:7/548: fsync dd/df/d1b/d20/f58 0 2023-12-06T15:00:35.162 INFO:tasks.workunit.client.0.smithi152.stdout:7/549: chown dd/df/d78 229557 1 2023-12-06T15:00:35.163 INFO:tasks.workunit.client.1.smithi190.stdout:2/910: symlink d10/d26/d8a/d8f/d12b/l131 0 2023-12-06T15:00:35.163 INFO:tasks.workunit.client.1.smithi190.stdout:2/911: dread - d10/d26/d5c/d35/d77/fa3 zero size 2023-12-06T15:00:35.163 INFO:tasks.workunit.client.1.smithi190.stdout:2/912: fsync d10/d59/dcd/dad/dc4/d76/fa6 0 2023-12-06T15:00:35.165 INFO:tasks.workunit.client.1.smithi190.stdout:2/913: creat d10/d59/dcd/dad/dc4/f132 x:0 0 0 2023-12-06T15:00:35.166 INFO:tasks.workunit.client.0.smithi152.stdout:9/677: creat d0/d3f/d68/fc6 x:0 0 0 2023-12-06T15:00:35.167 INFO:tasks.workunit.client.1.smithi190.stdout:2/914: creat d10/d26/f133 x:0 0 0 2023-12-06T15:00:35.167 INFO:tasks.workunit.client.0.smithi152.stdout:8/603: rmdir d1/d6/d29/d5b 39 2023-12-06T15:00:35.168 INFO:tasks.workunit.client.0.smithi152.stdout:5/768: dread d7/dd/d26/d48/d97/dc2/fe8 [0,4194304] 0 2023-12-06T15:00:35.168 INFO:tasks.workunit.client.0.smithi152.stdout:8/604: dread - d1/d6/d29/d5b/fb1 zero size 2023-12-06T15:00:35.169 INFO:tasks.workunit.client.0.smithi152.stdout:3/661: getdents d9/d18 0 2023-12-06T15:00:35.173 INFO:tasks.workunit.client.0.smithi152.stdout:1/968: dread d3/da/d15/d17/d147/d55/ff9 [0,4194304] 0 2023-12-06T15:00:35.176 INFO:tasks.workunit.client.0.smithi152.stdout:0/641: mknod d8/d15/d45/d73/db9/dc4/cd7 0 2023-12-06T15:00:35.178 INFO:tasks.workunit.client.1.smithi190.stdout:0/870: dread d0/da/d3e/d3a/d40/d81/f92 [0,4194304] 0 2023-12-06T15:00:35.178 INFO:tasks.workunit.client.1.smithi190.stdout:0/871: truncate d0/da/d3e/d2b/d3c/d46/d8e/d90/fe3 347014 0 2023-12-06T15:00:35.179 INFO:tasks.workunit.client.0.smithi152.stdout:4/945: getdents d2/d45/d84/da4 0 2023-12-06T15:00:35.180 INFO:tasks.workunit.client.1.smithi190.stdout:0/872: mkdir d0/da/d3e/d3a/d40/d124 0 2023-12-06T15:00:35.181 INFO:tasks.workunit.client.0.smithi152.stdout:6/887: dwrite d1/dcf/ddc/d1a/d30/d36/f24 [0,4194304] 0 2023-12-06T15:00:35.185 INFO:tasks.workunit.client.0.smithi152.stdout:7/550: mkdir dd/df/d34/d44/d49/daf 0 2023-12-06T15:00:35.185 INFO:tasks.workunit.client.0.smithi152.stdout:7/551: write dd/df/d1b/d20/d28/f80 [2450386,27650] 0 2023-12-06T15:00:35.186 INFO:tasks.workunit.client.0.smithi152.stdout:9/678: mknod d0/cc7 0 2023-12-06T15:00:35.186 INFO:tasks.workunit.client.1.smithi190.stdout:2/915: write d10/d26/d5c/d49/d54/f5d [838319,24252] 0 2023-12-06T15:00:35.187 INFO:tasks.workunit.client.0.smithi152.stdout:5/769: creat d7/dd/d26/d3a/f10d x:0 0 0 2023-12-06T15:00:35.188 INFO:tasks.workunit.client.0.smithi152.stdout:5/770: write d7/f15 [4165648,113433] 0 2023-12-06T15:00:35.188 INFO:tasks.workunit.client.1.smithi190.stdout:2/916: link d10/d59/dcd/dad/f11f d10/d59/dcd/dad/dc4/d7f/f134 0 2023-12-06T15:00:35.189 INFO:tasks.workunit.client.0.smithi152.stdout:0/642: dread d8/d3e/d87/f8b [0,4194304] 0 2023-12-06T15:00:35.189 INFO:tasks.workunit.client.0.smithi152.stdout:8/605: getdents d1/d6/d34/d6f 0 2023-12-06T15:00:35.190 INFO:tasks.workunit.client.1.smithi190.stdout:2/917: link d10/d26/d5c/d49/c9b d10/c135 0 2023-12-06T15:00:35.190 INFO:tasks.workunit.client.0.smithi152.stdout:8/606: read d1/d6/d29/f4d [2655009,56455] 0 2023-12-06T15:00:35.191 INFO:tasks.workunit.client.1.smithi190.stdout:2/918: symlink d10/d59/dcd/dad/dc4/d7f/d8e/l136 0 2023-12-06T15:00:35.191 INFO:tasks.workunit.client.0.smithi152.stdout:1/969: symlink d3/da/d4c/d63/d96/l15a 0 2023-12-06T15:00:35.193 INFO:tasks.workunit.client.0.smithi152.stdout:4/946: creat d2/d15/d32/d79/dcc/f13a x:0 0 0 2023-12-06T15:00:35.193 INFO:tasks.workunit.client.1.smithi190.stdout:2/919: rename d10/d26/d5c/d35/d77/d98/lc5 to d10/d26/d5c/d35/d77/l137 0 2023-12-06T15:00:35.194 INFO:tasks.workunit.client.0.smithi152.stdout:6/888: mknod d1/dcf/ddc/d1a/d30/d36/d35/d49/da6/da9/d120/c136 0 2023-12-06T15:00:35.195 INFO:tasks.workunit.client.1.smithi190.stdout:0/873: dread d0/da/d3e/d3a/d40/f48 [0,4194304] 0 2023-12-06T15:00:35.195 INFO:tasks.workunit.client.1.smithi190.stdout:0/874: write d0/da/d3e/d2b/d3c/d46/f123 [1147,82419] 0 2023-12-06T15:00:35.197 INFO:tasks.workunit.client.1.smithi190.stdout:0/875: write d0/da/d3e/d3a/d40/f28 [4161368,28245] 0 2023-12-06T15:00:35.202 INFO:tasks.workunit.client.1.smithi190.stdout:0/876: symlink d0/da/d3e/d2b/d3c/d4c/dcc/l125 0 2023-12-06T15:00:35.204 INFO:tasks.workunit.client.1.smithi190.stdout:5/860: sync 2023-12-06T15:00:35.204 INFO:tasks.workunit.client.1.smithi190.stdout:5/861: fsync d0/d1c/d85/d90/dba/f103 0 2023-12-06T15:00:35.209 INFO:tasks.workunit.client.0.smithi152.stdout:7/552: mknod dd/df/d34/dac/cb0 0 2023-12-06T15:00:35.211 INFO:tasks.workunit.client.0.smithi152.stdout:9/679: unlink d0/f36 0 2023-12-06T15:00:35.211 INFO:tasks.workunit.client.0.smithi152.stdout:5/771: creat d7/d43/d6c/f10e x:0 0 0 2023-12-06T15:00:35.213 INFO:tasks.workunit.client.0.smithi152.stdout:0/643: unlink d8/d3e/d6f/c80 0 2023-12-06T15:00:35.213 INFO:tasks.workunit.client.0.smithi152.stdout:0/644: write d8/d15/d45/fb8 [1022479,89440] 0 2023-12-06T15:00:35.215 INFO:tasks.workunit.client.0.smithi152.stdout:5/772: dread d7/d43/d6c/d98/fa8 [0,4194304] 0 2023-12-06T15:00:35.215 INFO:tasks.workunit.client.0.smithi152.stdout:8/607: rmdir d1/d6/d86 39 2023-12-06T15:00:35.216 INFO:tasks.workunit.client.0.smithi152.stdout:1/970: mkdir d3/da/d4c/d85/d15b 0 2023-12-06T15:00:35.216 INFO:tasks.workunit.client.0.smithi152.stdout:1/971: readlink d3/da/d15/d17/d4d/da7/lff 0 2023-12-06T15:00:35.217 INFO:tasks.workunit.client.0.smithi152.stdout:4/947: creat d2/d15/d32/d69/d6f/daf/f13b x:0 0 0 2023-12-06T15:00:35.217 INFO:tasks.workunit.client.0.smithi152.stdout:4/948: write d2/d15/d32/d69/d6f/d10b/f59 [4767608,72638] 0 2023-12-06T15:00:35.217 INFO:tasks.workunit.client.0.smithi152.stdout:4/949: chown d2/d10/d52/c133 429 1 2023-12-06T15:00:35.217 INFO:tasks.workunit.client.0.smithi152.stdout:4/950: stat d2/d10/dab 0 2023-12-06T15:00:35.218 INFO:tasks.workunit.client.0.smithi152.stdout:7/553: mkdir dd/df/d34/d44/d49/daf/db1 0 2023-12-06T15:00:35.219 INFO:tasks.workunit.client.0.smithi152.stdout:9/680: getdents d0/d3f/d68/d6c 0 2023-12-06T15:00:35.219 INFO:tasks.workunit.client.0.smithi152.stdout:9/681: dread - d0/d3f/d68/d6c/d20/d38/d44/dc4/d69/fab zero size 2023-12-06T15:00:35.222 INFO:tasks.workunit.client.0.smithi152.stdout:5/773: rename d7/dd/d26/d87/c92 to d7/d47/c10f 0 2023-12-06T15:00:35.224 INFO:tasks.workunit.client.0.smithi152.stdout:0/645: write d8/dcc/fd5 [249330,4735] 0 2023-12-06T15:00:35.224 INFO:tasks.workunit.client.0.smithi152.stdout:0/646: write d8/d4b/f8a [4657694,121861] 0 2023-12-06T15:00:35.224 INFO:tasks.workunit.client.0.smithi152.stdout:8/608: link d1/d6/d34/d35/d66/d82/cbc d1/d6/d34/d35/d66/d82/db6/cc4 0 2023-12-06T15:00:35.224 INFO:tasks.workunit.client.0.smithi152.stdout:8/609: truncate d1/d6/d34/d35/fb2 835930 0 2023-12-06T15:00:35.224 INFO:tasks.workunit.client.0.smithi152.stdout:8/610: readlink d1/d6/d34/d36/l2c 0 2023-12-06T15:00:35.224 INFO:tasks.workunit.client.0.smithi152.stdout:8/611: readlink d1/d6/d34/l18 0 2023-12-06T15:00:35.225 INFO:tasks.workunit.client.0.smithi152.stdout:1/972: mkdir d3/da/d4c/d63/d96/d15c 0 2023-12-06T15:00:35.228 INFO:tasks.workunit.client.0.smithi152.stdout:8/612: write d1/d6/f1b [4357271,16163] 0 2023-12-06T15:00:35.228 INFO:tasks.workunit.client.0.smithi152.stdout:8/613: readlink d1/l23 0 2023-12-06T15:00:35.228 INFO:tasks.workunit.client.0.smithi152.stdout:8/614: fdatasync d1/d6/d29/d87/daa/fbe 0 2023-12-06T15:00:35.228 INFO:tasks.workunit.client.0.smithi152.stdout:8/615: getdents d1/d6/d34/d6f 0 2023-12-06T15:00:35.228 INFO:tasks.workunit.client.0.smithi152.stdout:7/554: link dd/df/f2c dd/df/d34/d44/d49/daf/fb2 0 2023-12-06T15:00:35.228 INFO:tasks.workunit.client.0.smithi152.stdout:7/555: write dd/df/d1b/d20/d28/d53/f6d [951348,62732] 0 2023-12-06T15:00:35.230 INFO:tasks.workunit.client.0.smithi152.stdout:9/682: creat d0/d3f/d68/d6c/d20/fc8 x:0 0 0 2023-12-06T15:00:35.230 INFO:tasks.workunit.client.0.smithi152.stdout:5/774: mkdir d7/dd/d26/d87/d100/d110 0 2023-12-06T15:00:35.230 INFO:tasks.workunit.client.0.smithi152.stdout:5/775: chown d7/d43/c8c 242 1 2023-12-06T15:00:35.232 INFO:tasks.workunit.client.0.smithi152.stdout:0/647: mknod d8/d15/d45/da2/cd8 0 2023-12-06T15:00:35.232 INFO:tasks.workunit.client.1.smithi190.stdout:0/877: dwrite d0/da/d3e/d2b/d37/f116 [0,4194304] 0 2023-12-06T15:00:35.234 INFO:tasks.workunit.client.0.smithi152.stdout:5/776: write d7/f1f [366200,126910] 0 2023-12-06T15:00:35.234 INFO:tasks.workunit.client.0.smithi152.stdout:7/556: rename dd/df/d1b/d20/d28/d53/f6d to dd/df/d34/d44/d49/d73/fb3 0 2023-12-06T15:00:35.235 INFO:tasks.workunit.client.0.smithi152.stdout:9/683: mkdir d0/d3f/d5f/d60/dc9 0 2023-12-06T15:00:35.236 INFO:tasks.workunit.client.0.smithi152.stdout:7/557: read dd/df/d1b/d20/d28/d53/f3f [1697668,120521] 0 2023-12-06T15:00:35.236 INFO:tasks.workunit.client.0.smithi152.stdout:5/777: mkdir d7/d43/d9c/d111 0 2023-12-06T15:00:35.236 INFO:tasks.workunit.client.0.smithi152.stdout:5/778: write d7/f105 [30875,81375] 0 2023-12-06T15:00:35.237 INFO:tasks.workunit.client.0.smithi152.stdout:7/558: dread dd/df/d1b/f93 [0,4194304] 0 2023-12-06T15:00:35.237 INFO:tasks.workunit.client.1.smithi190.stdout:0/878: write d0/da/d3e/d2b/d3c/d4c/f8b [904198,32691] 0 2023-12-06T15:00:35.238 INFO:tasks.workunit.client.0.smithi152.stdout:0/648: rename d8/d15/d45/d73/db9/dc4/fcd to d8/d15/d45/d73/d8c/fd9 0 2023-12-06T15:00:35.238 INFO:tasks.workunit.client.1.smithi190.stdout:0/879: truncate d0/da/fa3 1304635 0 2023-12-06T15:00:35.240 INFO:tasks.workunit.client.0.smithi152.stdout:5/779: mknod d7/dd/d26/d87/dc4/ddc/c112 0 2023-12-06T15:00:35.240 INFO:tasks.workunit.client.0.smithi152.stdout:5/780: dread - d7/d43/d6c/f10e zero size 2023-12-06T15:00:35.240 INFO:tasks.workunit.client.0.smithi152.stdout:5/781: fsync d7/d43/d9c/dfb/f5c 0 2023-12-06T15:00:35.240 INFO:tasks.workunit.client.1.smithi190.stdout:0/880: getdents d0/da/d74/da2 0 2023-12-06T15:00:35.241 INFO:tasks.workunit.client.0.smithi152.stdout:7/559: creat dd/df/fb4 x:0 0 0 2023-12-06T15:00:35.241 INFO:tasks.workunit.client.0.smithi152.stdout:1/973: dread d3/d44/d84/de2/f122 [0,4194304] 0 2023-12-06T15:00:35.241 INFO:tasks.workunit.client.0.smithi152.stdout:0/649: mkdir d8/d15/d45/d73/d8c/dda 0 2023-12-06T15:00:35.242 INFO:tasks.workunit.client.1.smithi190.stdout:0/881: mkdir d0/d126 0 2023-12-06T15:00:35.244 INFO:tasks.workunit.client.0.smithi152.stdout:6/889: dwrite d1/d69/da1/deb/f88 [0,4194304] 0 2023-12-06T15:00:35.245 INFO:tasks.workunit.client.0.smithi152.stdout:6/890: chown d1/dcf/ddc/d1a/d30/d36/d35/d49/d57/f99 1 1 2023-12-06T15:00:35.245 INFO:tasks.workunit.client.0.smithi152.stdout:5/782: mkdir d7/d43/d6c/d113 0 2023-12-06T15:00:35.245 INFO:tasks.workunit.client.0.smithi152.stdout:1/974: rename d3/da/d15/d17/f86 to d3/da/d4c/d63/d96/f15d 0 2023-12-06T15:00:35.245 INFO:tasks.workunit.client.0.smithi152.stdout:4/951: dwrite d2/d15/d32/d69/d6f/d10b/f76 [4194304,4194304] 0 2023-12-06T15:00:35.245 INFO:tasks.workunit.client.1.smithi190.stdout:0/882: creat d0/da/d3e/d2b/d3c/d46/d8e/f127 x:0 0 0 2023-12-06T15:00:35.245 INFO:tasks.workunit.client.1.smithi190.stdout:2/920: dwrite d10/d26/d5c/d49/d7e/fb8 [0,4194304] 0 2023-12-06T15:00:35.250 INFO:tasks.workunit.client.0.smithi152.stdout:6/891: truncate d1/dcf/ddc/d1a/d30/d36/d35/d63/d86/f11d 1566945 0 2023-12-06T15:00:35.250 INFO:tasks.workunit.client.0.smithi152.stdout:6/892: chown d1/d69/da1/f104 30185 1 2023-12-06T15:00:35.250 INFO:tasks.workunit.client.1.smithi190.stdout:2/921: rmdir d10/d26/d5c/d49 39 2023-12-06T15:00:35.253 INFO:tasks.workunit.client.1.smithi190.stdout:2/922: rename d10/d59/dcd/dad/f11f to d10/d26/d8a/d8f/d12b/f138 0 2023-12-06T15:00:35.253 INFO:tasks.workunit.client.0.smithi152.stdout:1/975: unlink d3/da/d15/d17/d1a/f5f 0 2023-12-06T15:00:35.255 INFO:tasks.workunit.client.1.smithi190.stdout:2/923: truncate d10/d26/d5c/f4b 339847 0 2023-12-06T15:00:35.255 INFO:tasks.workunit.client.1.smithi190.stdout:2/924: write d10/d26/d5c/d35/f124 [604777,41388] 0 2023-12-06T15:00:35.255 INFO:tasks.workunit.client.0.smithi152.stdout:9/684: dread d0/d3f/d68/d6c/d20/d38/d45/f85 [0,4194304] 0 2023-12-06T15:00:35.256 INFO:tasks.workunit.client.0.smithi152.stdout:1/976: read d3/da/d15/d17/f4f [77220,11077] 0 2023-12-06T15:00:35.256 INFO:tasks.workunit.client.0.smithi152.stdout:4/952: getdents d2/d15/d32/d54/d85 0 2023-12-06T15:00:35.257 INFO:tasks.workunit.client.1.smithi190.stdout:0/883: dread d0/da/d3e/d2b/d37/f76 [0,4194304] 0 2023-12-06T15:00:35.257 INFO:tasks.workunit.client.1.smithi190.stdout:2/925: mknod d10/d59/c139 0 2023-12-06T15:00:35.260 INFO:tasks.workunit.client.0.smithi152.stdout:6/893: symlink d1/dcf/ddc/d1a/d30/d18/d10c/l137 0 2023-12-06T15:00:35.261 INFO:tasks.workunit.client.1.smithi190.stdout:0/884: write d0/da/d3e/d2b/d37/f116 [2780017,71573] 0 2023-12-06T15:00:35.261 INFO:tasks.workunit.client.1.smithi190.stdout:0/885: chown d0/da/d74/ca7 1533612883 1 2023-12-06T15:00:35.262 INFO:tasks.workunit.client.0.smithi152.stdout:1/977: creat d3/da/f15e x:0 0 0 2023-12-06T15:00:35.263 INFO:tasks.workunit.client.1.smithi190.stdout:0/886: mknod d0/da/d3e/d2b/d3c/d46/d8e/d90/c128 0 2023-12-06T15:00:35.263 INFO:tasks.workunit.client.1.smithi190.stdout:0/887: readlink d0/da/d3e/d2b/d3c/d46/d8e/l102 0 2023-12-06T15:00:35.265 INFO:tasks.workunit.client.0.smithi152.stdout:4/953: rename d2/d10/d52/l6d to d2/d15/d32/d69/d6f/d10b/d6e/l13c 0 2023-12-06T15:00:35.267 INFO:tasks.workunit.client.0.smithi152.stdout:6/894: mkdir d1/dcf/ddc/d1a/d30/d138 0 2023-12-06T15:00:35.267 INFO:tasks.workunit.client.0.smithi152.stdout:6/895: chown d1/dcf/ddc/d1a/d30/d36/d35/d61/f85 0 1 2023-12-06T15:00:35.269 INFO:tasks.workunit.client.0.smithi152.stdout:4/954: read d2/d15/d32/d54/d85/f86 [2779427,53215] 0 2023-12-06T15:00:35.269 INFO:tasks.workunit.client.0.smithi152.stdout:6/896: mkdir d1/dcf/ddc/d1a/d30/d36/d4e/d101/d139 0 2023-12-06T15:00:35.271 INFO:tasks.workunit.client.0.smithi152.stdout:1/978: rename d3/da/d15/d17/d58/da3/c107 to d3/da/c15f 0 2023-12-06T15:00:35.272 INFO:tasks.workunit.client.0.smithi152.stdout:4/955: link d2/d15/d32/d69/d6f/d10b/f4a d2/d15/d32/d69/d6f/d10b/f13d 0 2023-12-06T15:00:35.273 INFO:tasks.workunit.client.0.smithi152.stdout:6/897: creat d1/dcf/ddc/d1a/d30/d36/d35/d63/d86/f13a x:0 0 0 2023-12-06T15:00:35.273 INFO:tasks.workunit.client.0.smithi152.stdout:1/979: mkdir d3/da/d4c/d85/d15b/d160 0 2023-12-06T15:00:35.274 INFO:tasks.workunit.client.0.smithi152.stdout:6/898: truncate d1/dcf/ddc/d1a/d30/fff 532276 0 2023-12-06T15:00:35.276 INFO:tasks.workunit.client.0.smithi152.stdout:1/980: mkdir d3/da/d4c/d63/d96/d155/d161 0 2023-12-06T15:00:35.276 INFO:tasks.workunit.client.0.smithi152.stdout:6/899: symlink d1/d69/da1/d87/d15/l13b 0 2023-12-06T15:00:35.279 INFO:tasks.workunit.client.0.smithi152.stdout:6/900: rename d1/dcf/ddc/d1a/d30/d36/ff1 to d1/dcf/ddc/d8a/f13c 0 2023-12-06T15:00:35.279 INFO:tasks.workunit.client.0.smithi152.stdout:1/981: mkdir d3/da/d15/d17/d147/d62/d162 0 2023-12-06T15:00:35.284 INFO:tasks.workunit.client.0.smithi152.stdout:1/982: rename d3/d10a/f140 to d3/da/d4c/d82/db4/f163 0 2023-12-06T15:00:35.289 INFO:tasks.workunit.client.0.smithi152.stdout:6/901: dread d1/dcf/ddc/d1a/d30/f59 [0,4194304] 0 2023-12-06T15:00:35.290 INFO:tasks.workunit.client.0.smithi152.stdout:6/902: mkdir d1/dcf/ddc/d1a/d13d 0 2023-12-06T15:00:35.290 INFO:tasks.workunit.client.0.smithi152.stdout:6/903: fdatasync d1/dcf/ddc/d1a/d30/fe 0 2023-12-06T15:00:35.291 INFO:tasks.workunit.client.0.smithi152.stdout:6/904: link d1/d89/cd5 d1/dcf/ddc/d1a/d30/da4/c13e 0 2023-12-06T15:00:35.292 INFO:tasks.workunit.client.0.smithi152.stdout:6/905: truncate d1/dcf/ddc/d1a/d30/d36/d26/f2d 574921 0 2023-12-06T15:00:35.292 INFO:tasks.workunit.client.0.smithi152.stdout:6/906: fsync d1/d69/da1/d87/f9 0 2023-12-06T15:00:35.303 INFO:tasks.workunit.client.0.smithi152.stdout:5/783: dwrite d7/dd/d26/d87/dc4/ddc/fcb [0,4194304] 0 2023-12-06T15:00:35.303 INFO:tasks.workunit.client.0.smithi152.stdout:5/784: chown d7/dd/d26/d48/l91 159 1 2023-12-06T15:00:35.307 INFO:tasks.workunit.client.0.smithi152.stdout:0/650: dwrite d8/f3f [0,4194304] 0 2023-12-06T15:00:35.308 INFO:tasks.workunit.client.0.smithi152.stdout:0/651: getdents d8/d3e/d87/d76/d6e 0 2023-12-06T15:00:35.308 INFO:tasks.workunit.client.0.smithi152.stdout:0/652: dread - d8/f20 zero size 2023-12-06T15:00:35.315 INFO:tasks.workunit.client.0.smithi152.stdout:5/785: dread d7/f18 [0,4194304] 0 2023-12-06T15:00:35.323 INFO:tasks.workunit.client.0.smithi152.stdout:0/653: dread d8/d4b/f65 [8388608,4194304] 0 2023-12-06T15:00:35.324 INFO:tasks.workunit.client.0.smithi152.stdout:4/956: dwrite d2/d10/ff3 [0,4194304] 0 2023-12-06T15:00:35.324 INFO:tasks.workunit.client.0.smithi152.stdout:4/957: getdents d2/d15/d32/d54/d85 0 2023-12-06T15:00:35.327 INFO:tasks.workunit.client.0.smithi152.stdout:4/958: write d2/d89/fa3 [1804783,128618] 0 2023-12-06T15:00:35.328 INFO:tasks.workunit.client.0.smithi152.stdout:9/685: dwrite d0/d3f/d68/d6c/d20/d38/d45/f3a [0,4194304] 0 2023-12-06T15:00:35.328 INFO:tasks.workunit.client.0.smithi152.stdout:9/686: dread - d0/d3f/d5f/d86/fc2 zero size 2023-12-06T15:00:35.329 INFO:tasks.workunit.client.1.smithi190.stdout:2/926: dwrite d10/d26/d8a/d8f/fa7 [0,4194304] 0 2023-12-06T15:00:35.329 INFO:tasks.workunit.client.1.smithi190.stdout:0/888: dwrite d0/da/d3e/d2b/d3c/d46/f123 [0,4194304] 0 2023-12-06T15:00:35.329 INFO:tasks.workunit.client.1.smithi190.stdout:0/889: write d0/da/d3e/d2b/d3c/d10f/f11b [13576,29878] 0 2023-12-06T15:00:35.329 INFO:tasks.workunit.client.1.smithi190.stdout:0/890: read - d0/f75 zero size 2023-12-06T15:00:35.330 INFO:tasks.workunit.client.0.smithi152.stdout:6/907: dwrite d1/dcf/ddc/d1a/d30/d36/d35/d49/d57/fb7 [0,4194304] 0 2023-12-06T15:00:35.334 INFO:tasks.workunit.client.1.smithi190.stdout:0/891: creat d0/da/d3e/d3a/d40/f129 x:0 0 0 2023-12-06T15:00:35.344 INFO:tasks.workunit.client.0.smithi152.stdout:6/908: dread d1/d69/da1/d87/d15/f1d [4194304,4194304] 0 2023-12-06T15:00:35.344 INFO:tasks.workunit.client.0.smithi152.stdout:6/909: readlink d1/d89/l111 0 2023-12-06T15:00:35.358 INFO:tasks.workunit.client.0.smithi152.stdout:5/786: getdents d7/dd/d26/d3a 0 2023-12-06T15:00:35.359 INFO:tasks.workunit.client.0.smithi152.stdout:0/654: creat d8/d15/d45/d83/fdb x:0 0 0 2023-12-06T15:00:35.359 INFO:tasks.workunit.client.0.smithi152.stdout:0/655: chown d8/d15/d45/l60 2210879 1 2023-12-06T15:00:35.361 INFO:tasks.workunit.client.0.smithi152.stdout:4/959: getdents d2/d15/d32/d69/d6f 0 2023-12-06T15:00:35.361 INFO:tasks.workunit.client.0.smithi152.stdout:4/960: fsync d2/d15/d32/d69/d6f/fff 0 2023-12-06T15:00:35.365 INFO:tasks.workunit.client.1.smithi190.stdout:0/892: dwrite d0/da/d3e/d2b/d37/f76 [0,4194304] 0 2023-12-06T15:00:35.367 INFO:tasks.workunit.client.1.smithi190.stdout:0/893: mknod d0/da/da4/db1/d111/c12a 0 2023-12-06T15:00:35.368 INFO:tasks.workunit.client.1.smithi190.stdout:0/894: mknod d0/da/da4/db1/c12b 0 2023-12-06T15:00:35.371 INFO:tasks.workunit.client.0.smithi152.stdout:9/687: rename d0/d3f/d68/d6c/d20/d38/d44/dc4/d69/fab to d0/d3f/d5f/fca 0 2023-12-06T15:00:35.376 INFO:tasks.workunit.client.0.smithi152.stdout:6/910: symlink d1/d69/l13f 0 2023-12-06T15:00:35.377 INFO:tasks.workunit.client.0.smithi152.stdout:5/787: mknod d7/d43/d9c/dfb/c114 0 2023-12-06T15:00:35.377 INFO:tasks.workunit.client.1.smithi190.stdout:0/895: dread d0/da/f25 [0,4194304] 0 2023-12-06T15:00:35.380 INFO:tasks.workunit.client.1.smithi190.stdout:0/896: creat d0/da/d3e/d2b/d3c/d65/f12c x:0 0 0 2023-12-06T15:00:35.380 INFO:tasks.workunit.client.0.smithi152.stdout:0/656: creat d8/fdc x:0 0 0 2023-12-06T15:00:35.380 INFO:tasks.workunit.client.0.smithi152.stdout:0/657: chown d8/f20 252866 1 2023-12-06T15:00:35.381 INFO:tasks.workunit.client.0.smithi152.stdout:4/961: mkdir d2/d15/d32/d13e 0 2023-12-06T15:00:35.382 INFO:tasks.workunit.client.0.smithi152.stdout:6/911: rename d1/d75/f81 to d1/dcf/ddc/d1a/d30/d36/d35/d49/f140 0 2023-12-06T15:00:35.383 INFO:tasks.workunit.client.1.smithi190.stdout:0/897: link d0/da/d5a/d80/l91 d0/da/d3e/d3a/d40/d6f/l12d 0 2023-12-06T15:00:35.383 INFO:tasks.workunit.client.1.smithi190.stdout:0/898: write d0/da/d3e/d3a/d40/ff9 [321262,102366] 0 2023-12-06T15:00:35.383 INFO:tasks.workunit.client.1.smithi190.stdout:0/899: dread - d0/da/d3e/d2b/d3c/d65/f12c zero size 2023-12-06T15:00:35.383 INFO:tasks.workunit.client.1.smithi190.stdout:0/900: stat d0/da/d3e/d2b/d37/l88 0 2023-12-06T15:00:35.383 INFO:tasks.workunit.client.0.smithi152.stdout:6/912: dread d1/d69/da1/deb/f10b [0,4194304] 0 2023-12-06T15:00:35.385 INFO:tasks.workunit.client.0.smithi152.stdout:0/658: mkdir d8/d15/d45/d73/ddd 0 2023-12-06T15:00:35.385 INFO:tasks.workunit.client.0.smithi152.stdout:0/659: chown d8/d3e/d87/d76/d6e/l7c 10566 1 2023-12-06T15:00:35.385 INFO:tasks.workunit.client.0.smithi152.stdout:4/962: creat d2/d10/dc8/f13f x:0 0 0 2023-12-06T15:00:35.389 INFO:tasks.workunit.client.0.smithi152.stdout:5/788: rename d7/dd/fb6 to d7/dd/d26/d87/d100/f115 0 2023-12-06T15:00:35.389 INFO:tasks.workunit.client.0.smithi152.stdout:5/789: chown d7/d43/d9c/dfb/c75 4426 1 2023-12-06T15:00:35.390 INFO:tasks.workunit.client.0.smithi152.stdout:0/660: rename d8/f67 to d8/d15/d45/da4/fde 0 2023-12-06T15:00:35.390 INFO:tasks.workunit.client.0.smithi152.stdout:0/661: chown d8/d15/d45/d99/cc5 34 1 2023-12-06T15:00:35.392 INFO:tasks.workunit.client.1.smithi190.stdout:0/901: dread d0/f50 [0,4194304] 0 2023-12-06T15:00:35.393 INFO:tasks.workunit.client.0.smithi152.stdout:5/790: write d7/dd/d26/fae [3379610,99844] 0 2023-12-06T15:00:35.394 INFO:tasks.workunit.client.0.smithi152.stdout:5/791: chown d7/d43/f7f 11 1 2023-12-06T15:00:35.396 INFO:tasks.workunit.client.0.smithi152.stdout:6/913: dread d1/dcf/ddc/d1a/d30/d36/f64 [0,4194304] 0 2023-12-06T15:00:35.396 INFO:tasks.workunit.client.0.smithi152.stdout:0/662: write d8/d15/d45/da4/fde [6276459,117579] 0 2023-12-06T15:00:35.396 INFO:tasks.workunit.client.0.smithi152.stdout:5/792: truncate d7/dd/d26/d3b/d46/d7e/fcd 1357778 0 2023-12-06T15:00:35.400 INFO:tasks.workunit.client.0.smithi152.stdout:6/914: mkdir d1/dcf/ddc/d1a/d30/d36/d35/dd1/d141 0 2023-12-06T15:00:35.400 INFO:tasks.workunit.client.0.smithi152.stdout:4/963: dread d2/d15/d32/d69/d6f/d6c/f73 [0,4194304] 0 2023-12-06T15:00:35.402 INFO:tasks.workunit.client.0.smithi152.stdout:1/983: write d3/da/d15/fd3 [3143503,87741] 0 2023-12-06T15:00:35.402 INFO:tasks.workunit.client.0.smithi152.stdout:5/793: read d7/dd/d26/fae [566115,66727] 0 2023-12-06T15:00:35.403 INFO:tasks.workunit.client.0.smithi152.stdout:5/794: readlink d7/d43/l5e 0 2023-12-06T15:00:35.406 INFO:tasks.workunit.client.0.smithi152.stdout:6/915: mkdir d1/dcf/ddc/d1a/d30/d36/d35/d49/d142 0 2023-12-06T15:00:35.406 INFO:tasks.workunit.client.0.smithi152.stdout:4/964: mknod d2/d10/dbb/dca/dbc/d103/c140 0 2023-12-06T15:00:35.406 INFO:tasks.workunit.client.0.smithi152.stdout:4/965: chown d2/d10/dbb/dca/dbc/fdc 10870 1 2023-12-06T15:00:35.406 INFO:tasks.workunit.client.0.smithi152.stdout:4/966: chown d2/d15/d32/d79/l4f 2004663 1 2023-12-06T15:00:35.406 INFO:tasks.workunit.client.0.smithi152.stdout:4/967: fsync d2/d15/d32/d69/d6f/daf/f110 0 2023-12-06T15:00:35.407 INFO:tasks.workunit.client.0.smithi152.stdout:1/984: truncate d3/da/db/d54/f92 2661964 0 2023-12-06T15:00:35.410 INFO:tasks.workunit.client.0.smithi152.stdout:6/916: creat d1/dcf/ddc/d1a/d30/d36/d35/d49/d6b/f143 x:0 0 0 2023-12-06T15:00:35.410 INFO:tasks.workunit.client.0.smithi152.stdout:6/917: truncate d1/dcf/ddc/d1a/d30/d36/d35/d49/d57/f68 436512 0 2023-12-06T15:00:35.411 INFO:tasks.workunit.client.0.smithi152.stdout:3/662: sync 2023-12-06T15:00:35.411 INFO:tasks.workunit.client.0.smithi152.stdout:2/631: sync 2023-12-06T15:00:35.411 INFO:tasks.workunit.client.0.smithi152.stdout:2/632: dread - d6/d1e/d41/d83/fc5 zero size 2023-12-06T15:00:35.411 INFO:tasks.workunit.client.0.smithi152.stdout:3/663: truncate d9/d18/d39/f4a 1158621 0 2023-12-06T15:00:35.411 INFO:tasks.workunit.client.0.smithi152.stdout:3/664: chown d9/lc0 1009607 1 2023-12-06T15:00:35.411 INFO:tasks.workunit.client.0.smithi152.stdout:3/665: chown d9/d10/d19 1604 1 2023-12-06T15:00:35.411 INFO:tasks.workunit.client.0.smithi152.stdout:3/666: write d9/f1d [5147777,26306] 0 2023-12-06T15:00:35.411 INFO:tasks.workunit.client.0.smithi152.stdout:3/667: write d9/d10/d12/d43/d52/db4/d65/f79 [587858,77945] 0 2023-12-06T15:00:35.412 INFO:tasks.workunit.client.0.smithi152.stdout:4/968: getdents d2/d10/d52 0 2023-12-06T15:00:35.412 INFO:tasks.workunit.client.0.smithi152.stdout:5/795: write d7/d47/fa0 [890108,56467] 0 2023-12-06T15:00:35.414 INFO:tasks.workunit.client.0.smithi152.stdout:1/985: rename d3/d10a/f133 to d3/da/d4c/d85/d15b/f164 0 2023-12-06T15:00:35.414 INFO:tasks.workunit.client.0.smithi152.stdout:8/616: sync 2023-12-06T15:00:35.416 INFO:tasks.workunit.client.0.smithi152.stdout:9/688: dwrite d0/d3f/d68/d6c/d20/d38/d45/f85 [4194304,4194304] 0 2023-12-06T15:00:35.417 INFO:tasks.workunit.client.0.smithi152.stdout:6/918: truncate d1/dcf/ddc/d1a/d30/d36/d4e/fb2 723561 0 2023-12-06T15:00:35.417 INFO:tasks.workunit.client.0.smithi152.stdout:5/796: getdents d7/d43/d6c/d98 0 2023-12-06T15:00:35.421 INFO:tasks.workunit.client.0.smithi152.stdout:2/633: rename d6/db/d17/f75 to d6/d18/d43/db3/db7/fc7 0 2023-12-06T15:00:35.424 INFO:tasks.workunit.client.0.smithi152.stdout:5/797: rmdir d7/d43/d6c/d98 39 2023-12-06T15:00:35.426 INFO:tasks.workunit.client.0.smithi152.stdout:1/986: dread d3/da/d15/f57 [0,4194304] 0 2023-12-06T15:00:35.427 INFO:tasks.workunit.client.0.smithi152.stdout:7/560: sync 2023-12-06T15:00:35.428 INFO:tasks.workunit.client.0.smithi152.stdout:5/798: symlink d7/dd/d26/d87/l116 0 2023-12-06T15:00:35.431 INFO:tasks.workunit.client.1.smithi190.stdout:0/902: dwrite d0/da/d3e/d3a/f7f [0,4194304] 0 2023-12-06T15:00:35.432 INFO:tasks.workunit.client.0.smithi152.stdout:1/987: symlink d3/da/d15/d17/d4d/da7/d158/l165 0 2023-12-06T15:00:35.432 INFO:tasks.workunit.client.0.smithi152.stdout:1/988: dread d3/d44/d84/fe3 [0,4194304] 0 2023-12-06T15:00:35.433 INFO:tasks.workunit.client.0.smithi152.stdout:7/561: creat dd/d17/da8/fb5 x:0 0 0 2023-12-06T15:00:35.434 INFO:tasks.workunit.client.0.smithi152.stdout:5/799: rename d7/d43/d6c/f93 to d7/dd/d26/f117 0 2023-12-06T15:00:35.434 INFO:tasks.workunit.client.0.smithi152.stdout:5/800: chown d7/d43/d6c/d98/fa8 0 1 2023-12-06T15:00:35.437 INFO:tasks.workunit.client.1.smithi190.stdout:0/903: rename d0/f75 to d0/da/da4/db1/f12e 0 2023-12-06T15:00:35.443 INFO:tasks.workunit.client.0.smithi152.stdout:1/989: creat d3/da/d15/d17/d43/f166 x:0 0 0 2023-12-06T15:00:35.443 INFO:tasks.workunit.client.0.smithi152.stdout:1/990: read - d3/d10a/f106 zero size 2023-12-06T15:00:35.445 INFO:tasks.workunit.client.0.smithi152.stdout:5/801: creat d7/dd/d26/d87/d100/f118 x:0 0 0 2023-12-06T15:00:35.445 INFO:tasks.workunit.client.0.smithi152.stdout:7/562: dread dd/df/d1b/d20/f58 [0,4194304] 0 2023-12-06T15:00:35.452 INFO:tasks.workunit.client.0.smithi152.stdout:5/802: creat d7/d43/d9c/dfb/f119 x:0 0 0 2023-12-06T15:00:35.452 INFO:tasks.workunit.client.0.smithi152.stdout:3/668: dwrite d9/d10/d12/d43/f6d [0,4194304] 0 2023-12-06T15:00:35.453 INFO:tasks.workunit.client.0.smithi152.stdout:5/803: getdents d7/d43/d6c/dde 0 2023-12-06T15:00:35.455 INFO:tasks.workunit.client.0.smithi152.stdout:5/804: creat d7/d43/d9c/dfb/f11a x:0 0 0 2023-12-06T15:00:35.457 INFO:tasks.workunit.client.0.smithi152.stdout:5/805: rename d7/dd/d26/f32 to d7/d43/d9c/d104/f11b 0 2023-12-06T15:00:35.457 INFO:tasks.workunit.client.0.smithi152.stdout:5/806: write d7/dd/d26/d48/fb3 [412458,89199] 0 2023-12-06T15:00:35.461 INFO:tasks.workunit.client.0.smithi152.stdout:7/563: dread dd/df/d1b/d20/d28/d53/f64 [0,4194304] 0 2023-12-06T15:00:35.461 INFO:tasks.workunit.client.0.smithi152.stdout:0/663: dread d8/d15/d45/da4/fde [4194304,4194304] 0 2023-12-06T15:00:35.468 INFO:tasks.workunit.client.0.smithi152.stdout:5/807: dread d7/dd/d26/d3a/fa7 [0,4194304] 0 2023-12-06T15:00:35.479 INFO:tasks.workunit.client.0.smithi152.stdout:4/969: dwrite d2/d10/dbb/dca/dbc/fdc [4194304,4194304] 0 2023-12-06T15:00:35.479 INFO:tasks.workunit.client.0.smithi152.stdout:4/970: stat d2/d10/dbb/dca/dbc/d75/lc1 0 2023-12-06T15:00:35.480 INFO:tasks.workunit.client.0.smithi152.stdout:4/971: fdatasync d2/d15/d32/d69/d6f/d10b/d6e/da8/fd5 0 2023-12-06T15:00:35.480 INFO:tasks.workunit.client.0.smithi152.stdout:4/972: read d2/d10/dbb/dca/dcb/f43 [2316847,106189] 0 2023-12-06T15:00:35.495 INFO:tasks.workunit.client.0.smithi152.stdout:9/689: dwrite d0/d3f/d68/d6c/d20/f29 [0,4194304] 0 2023-12-06T15:00:35.497 INFO:tasks.workunit.client.0.smithi152.stdout:9/690: mknod d0/d3f/d68/d6c/d20/d38/d48/d90/ccb 0 2023-12-06T15:00:35.497 INFO:tasks.workunit.client.0.smithi152.stdout:9/691: truncate d0/d3f/d68/d6c/d20/f5a 4506894 0 2023-12-06T15:00:35.500 INFO:tasks.workunit.client.1.smithi190.stdout:4/882: sync 2023-12-06T15:00:35.501 INFO:tasks.workunit.client.0.smithi152.stdout:0/664: dwrite d8/f37 [0,4194304] 0 2023-12-06T15:00:35.502 INFO:tasks.workunit.client.1.smithi190.stdout:4/883: creat d3/d76/d126/f134 x:0 0 0 2023-12-06T15:00:35.502 INFO:tasks.workunit.client.1.smithi190.stdout:4/884: chown d3/d76/d7c/d8a/ddf/cf3 551694 1 2023-12-06T15:00:35.502 INFO:tasks.workunit.client.0.smithi152.stdout:0/665: link d8/d3e/d87/fc1 d8/d15/fdf 0 2023-12-06T15:00:35.504 INFO:tasks.workunit.client.1.smithi190.stdout:4/885: rename d3/d35/d19/f79 to d3/d35/f135 0 2023-12-06T15:00:35.504 INFO:tasks.workunit.client.0.smithi152.stdout:0/666: stat d8/d3e/d87/c88 0 2023-12-06T15:00:35.505 INFO:tasks.workunit.client.0.smithi152.stdout:0/667: creat d8/d15/d45/fe0 x:0 0 0 2023-12-06T15:00:35.510 INFO:tasks.workunit.client.0.smithi152.stdout:6/919: dwrite d1/dcf/ddc/d1a/d30/d36/d35/d49/d57/fdf [0,4194304] 0 2023-12-06T15:00:35.512 INFO:tasks.workunit.client.0.smithi152.stdout:6/920: rmdir d1/dcf/ddc/d1a/d30/daa 39 2023-12-06T15:00:35.518 INFO:tasks.workunit.client.0.smithi152.stdout:1/991: dwrite d3/da/db/d54/f6a [4194304,4194304] 0 2023-12-06T15:00:35.518 INFO:tasks.workunit.client.1.smithi190.stdout:0/904: dwrite d0/da/f29 [0,4194304] 0 2023-12-06T15:00:35.518 INFO:tasks.workunit.client.1.smithi190.stdout:0/905: truncate d0/da/d3e/d3a/d40/d6f/fab 1548986 0 2023-12-06T15:00:35.518 INFO:tasks.workunit.client.1.smithi190.stdout:0/906: fsync d0/da/d3e/d3a/d40/f5e 0 2023-12-06T15:00:35.520 INFO:tasks.workunit.client.1.smithi190.stdout:0/907: symlink d0/l12f 0 2023-12-06T15:00:35.521 INFO:tasks.workunit.client.0.smithi152.stdout:5/808: dwrite d7/f28 [0,4194304] 0 2023-12-06T15:00:35.522 INFO:tasks.workunit.client.1.smithi190.stdout:0/908: rmdir d0/da/d3e/db8/d110 39 2023-12-06T15:00:35.523 INFO:tasks.workunit.client.0.smithi152.stdout:5/809: mkdir d7/d47/d11c 0 2023-12-06T15:00:35.523 INFO:tasks.workunit.client.0.smithi152.stdout:5/810: symlink d7/d43/d9c/dfb/l11d 0 2023-12-06T15:00:35.525 INFO:tasks.workunit.client.0.smithi152.stdout:5/811: mknod d7/d43/d6c/d98/c11e 0 2023-12-06T15:00:35.525 INFO:tasks.workunit.client.0.smithi152.stdout:5/812: dread - d7/dd/d26/d3b/d46/fe7 zero size 2023-12-06T15:00:35.530 INFO:tasks.workunit.client.1.smithi190.stdout:4/886: write d3/f33 [2190462,95921] 0 2023-12-06T15:00:35.533 INFO:tasks.workunit.client.1.smithi190.stdout:4/887: mknod d3/d35/d19/d67/db5/c136 0 2023-12-06T15:00:35.533 INFO:tasks.workunit.client.0.smithi152.stdout:0/668: dread d8/d3e/f42 [0,4194304] 0 2023-12-06T15:00:35.533 INFO:tasks.workunit.client.0.smithi152.stdout:0/669: write d8/d15/d45/f4f [223923,118396] 0 2023-12-06T15:00:35.533 INFO:tasks.workunit.client.0.smithi152.stdout:0/670: truncate d8/f20 241914 0 2023-12-06T15:00:35.534 INFO:tasks.workunit.client.0.smithi152.stdout:0/671: chown d8/d15/d45/l60 75269 1 2023-12-06T15:00:35.534 INFO:tasks.workunit.client.0.smithi152.stdout:0/672: stat d8/d15/d45/d73/dac 0 2023-12-06T15:00:35.534 INFO:tasks.workunit.client.0.smithi152.stdout:0/673: chown d8/d15/d45/d73/dac 31049523 1 2023-12-06T15:00:35.536 INFO:tasks.workunit.client.0.smithi152.stdout:4/973: dwrite d2/d15/d32/d69/d6f/d10b/f18 [0,4194304] 0 2023-12-06T15:00:35.537 INFO:tasks.workunit.client.0.smithi152.stdout:0/674: mkdir d8/d15/d45/d73/ddd/de1 0 2023-12-06T15:00:35.540 INFO:tasks.workunit.client.0.smithi152.stdout:0/675: link d8/f3f d8/d15/fe2 0 2023-12-06T15:00:35.540 INFO:tasks.workunit.client.0.smithi152.stdout:9/692: dwrite d0/d3f/d68/d6c/d20/db0/f99 [0,4194304] 0 2023-12-06T15:00:35.541 INFO:tasks.workunit.client.0.smithi152.stdout:0/676: read d8/d3e/d87/f8b [1854623,93748] 0 2023-12-06T15:00:35.543 INFO:tasks.workunit.client.0.smithi152.stdout:9/693: unlink d0/d3f/d68/d6c/f2f 0 2023-12-06T15:00:35.545 INFO:tasks.workunit.client.0.smithi152.stdout:0/677: mknod d8/d15/d45/d73/dac/ce3 0 2023-12-06T15:00:35.545 INFO:tasks.workunit.client.0.smithi152.stdout:0/678: write d8/d15/d45/da2/fbe [345073,71900] 0 2023-12-06T15:00:35.545 INFO:tasks.workunit.client.0.smithi152.stdout:0/679: write d8/f37 [4953906,76395] 0 2023-12-06T15:00:35.546 INFO:tasks.workunit.client.0.smithi152.stdout:7/564: dwrite dd/df/d34/f7e [0,4194304] 0 2023-12-06T15:00:35.548 INFO:tasks.workunit.client.0.smithi152.stdout:9/694: write d0/d3f/d68/d6c/f17 [90767,52066] 0 2023-12-06T15:00:35.549 INFO:tasks.workunit.client.1.smithi190.stdout:0/909: dread d0/da/d3e/d2b/d3c/d10f/f11b [0,4194304] 0 2023-12-06T15:00:35.549 INFO:tasks.workunit.client.1.smithi190.stdout:0/910: stat d0/da/d3e/d2b/d3c/d46/l58 0 2023-12-06T15:00:35.549 INFO:tasks.workunit.client.1.smithi190.stdout:0/911: chown d0/da/d3e/d2b/d3c/d10f 0 1 2023-12-06T15:00:35.551 INFO:tasks.workunit.client.0.smithi152.stdout:7/565: truncate dd/df/d1b/d20/d28/f80 1228945 0 2023-12-06T15:00:35.553 INFO:tasks.workunit.client.0.smithi152.stdout:7/566: mknod dd/d69/d89/cb6 0 2023-12-06T15:00:35.554 INFO:tasks.workunit.client.1.smithi190.stdout:8/902: sync 2023-12-06T15:00:35.554 INFO:tasks.workunit.client.1.smithi190.stdout:6/982: sync 2023-12-06T15:00:35.558 INFO:tasks.workunit.client.1.smithi190.stdout:6/983: rename d4/d12/d1a/cbc to d4/d12/d1a/d32/dab/c144 0 2023-12-06T15:00:35.558 INFO:tasks.workunit.client.1.smithi190.stdout:6/984: chown d4/d12/d1a/d32/ce7 430688337 1 2023-12-06T15:00:35.558 INFO:tasks.workunit.client.1.smithi190.stdout:6/985: fdatasync d4/d12/d40/d43/d45/f5f 0 2023-12-06T15:00:35.558 INFO:tasks.workunit.client.1.smithi190.stdout:6/986: dread - d4/d12/d40/d43/ff3 zero size 2023-12-06T15:00:35.560 INFO:tasks.workunit.client.1.smithi190.stdout:6/987: mkdir d4/d12/d40/d43/d145 0 2023-12-06T15:00:35.561 INFO:tasks.workunit.client.0.smithi152.stdout:1/992: dwrite d3/d73/ffa [0,4194304] 0 2023-12-06T15:00:35.561 INFO:tasks.workunit.client.0.smithi152.stdout:7/567: write f9 [1990368,128518] 0 2023-12-06T15:00:35.562 INFO:tasks.workunit.client.1.smithi190.stdout:6/988: link d4/d12/d40/d43/d45/f88 d4/d12/d40/d43/f146 0 2023-12-06T15:00:35.564 INFO:tasks.workunit.client.0.smithi152.stdout:1/993: creat d3/da/d15/d17/d4d/da7/d158/f167 x:0 0 0 2023-12-06T15:00:35.564 INFO:tasks.workunit.client.0.smithi152.stdout:1/994: read - d3/da/d15/d17/d147/d55/d110/f11c zero size 2023-12-06T15:00:35.564 INFO:tasks.workunit.client.0.smithi152.stdout:1/995: truncate d3/da/d15/d17/d4d/da7/d158/f167 37340 0 2023-12-06T15:00:35.565 INFO:tasks.workunit.client.1.smithi190.stdout:6/989: creat d4/d12/d40/d43/d12d/f147 x:0 0 0 2023-12-06T15:00:35.567 INFO:tasks.workunit.client.1.smithi190.stdout:6/990: creat d4/d12/d1a/d32/dab/de1/f148 x:0 0 0 2023-12-06T15:00:35.568 INFO:tasks.workunit.client.1.smithi190.stdout:8/903: dread d1/d20/d3b/d36/fbd [0,4194304] 0 2023-12-06T15:00:35.570 INFO:tasks.workunit.client.1.smithi190.stdout:6/991: unlink d4/d12/d40/lae 0 2023-12-06T15:00:35.576 INFO:tasks.workunit.client.1.smithi190.stdout:6/992: write d4/d12/d1a/d32/f5d [279928,83643] 0 2023-12-06T15:00:35.593 INFO:tasks.workunit.client.0.smithi152.stdout:5/813: dwrite d7/dd/d26/d3a/f7b [0,4194304] 0 2023-12-06T15:00:35.598 INFO:tasks.workunit.client.1.smithi190.stdout:4/888: dwrite d3/f106 [0,4194304] 0 2023-12-06T15:00:35.600 INFO:tasks.workunit.client.0.smithi152.stdout:5/814: creat d7/dd/d26/db1/f11f x:0 0 0 2023-12-06T15:00:35.601 INFO:tasks.workunit.client.0.smithi152.stdout:5/815: write d7/dd/d26/d3b/d46/f76 [294546,18010] 0 2023-12-06T15:00:35.601 INFO:tasks.workunit.client.0.smithi152.stdout:5/816: chown d7/dd/c30 63412183 1 2023-12-06T15:00:35.602 INFO:tasks.workunit.client.0.smithi152.stdout:5/817: write d7/f1e [2184404,126304] 0 2023-12-06T15:00:35.602 INFO:tasks.workunit.client.0.smithi152.stdout:5/818: chown d7/d43/d9c/dfb 5862 1 2023-12-06T15:00:35.603 INFO:tasks.workunit.client.0.smithi152.stdout:5/819: creat d7/dd/d26/d87/f120 x:0 0 0 2023-12-06T15:00:35.604 INFO:tasks.workunit.client.0.smithi152.stdout:5/820: creat d7/d43/d9c/d111/f121 x:0 0 0 2023-12-06T15:00:35.605 INFO:tasks.workunit.client.0.smithi152.stdout:5/821: mkdir d7/dd/d26/d87/d122 0 2023-12-06T15:00:35.605 INFO:tasks.workunit.client.0.smithi152.stdout:5/822: readlink d7/dd/d26/d3a/l69 0 2023-12-06T15:00:35.607 INFO:tasks.workunit.client.0.smithi152.stdout:5/823: write d7/dd/d26/d87/d100/f115 [395224,4794] 0 2023-12-06T15:00:35.608 INFO:tasks.workunit.client.0.smithi152.stdout:5/824: symlink d7/dd/d26/d48/dbb/l123 0 2023-12-06T15:00:35.609 INFO:tasks.workunit.client.0.smithi152.stdout:5/825: write d7/dd/d26/d3b/f5a [4626272,70240] 0 2023-12-06T15:00:35.610 INFO:tasks.workunit.client.0.smithi152.stdout:5/826: creat d7/dd/d103/f124 x:0 0 0 2023-12-06T15:00:35.610 INFO:tasks.workunit.client.0.smithi152.stdout:5/827: truncate d7/d43/f8e 4747119 0 2023-12-06T15:00:35.619 INFO:tasks.workunit.client.0.smithi152.stdout:4/974: dwrite d2/d15/d32/d69/d6f/d10b/d6e/fb7 [0,4194304] 0 2023-12-06T15:00:35.619 INFO:tasks.workunit.client.0.smithi152.stdout:4/975: truncate d2/d10/dbb/dca/f12a 1606366 0 2023-12-06T15:00:35.619 INFO:tasks.workunit.client.0.smithi152.stdout:0/680: dwrite d8/d15/d45/f7f [0,4194304] 0 2023-12-06T15:00:35.620 INFO:tasks.workunit.client.0.smithi152.stdout:0/681: stat d8/d15/d45/fe0 0 2023-12-06T15:00:35.620 INFO:tasks.workunit.client.0.smithi152.stdout:6/921: dwrite d1/dcf/ddc/d1a/d30/d36/d26/f2d [0,4194304] 0 2023-12-06T15:00:35.621 INFO:tasks.workunit.client.1.smithi190.stdout:0/912: dwrite d0/da/d3e/d3a/d40/d81/ff3 [0,4194304] 0 2023-12-06T15:00:35.621 INFO:tasks.workunit.client.1.smithi190.stdout:8/904: dwrite d1/d20/d3b/d34/dbc/f106 [0,4194304] 0 2023-12-06T15:00:35.621 INFO:tasks.workunit.client.1.smithi190.stdout:8/905: fsync d1/d20/d3b/d4c/d59/d7d/fe9 0 2023-12-06T15:00:35.622 INFO:tasks.workunit.client.0.smithi152.stdout:9/695: dwrite d0/d3f/d68/d6c/d20/d38/d44/dc4/f87 [0,4194304] 0 2023-12-06T15:00:35.622 INFO:tasks.workunit.client.0.smithi152.stdout:7/568: dwrite dd/df/d1b/d20/d28/d53/f3f [0,4194304] 0 2023-12-06T15:00:35.622 INFO:tasks.workunit.client.0.smithi152.stdout:4/976: link d2/d10/dbb/dca/dbc/d42/fb8 d2/d10/dbb/dca/dbc/d42/f141 0 2023-12-06T15:00:35.622 INFO:tasks.workunit.client.0.smithi152.stdout:7/569: dread dd/df/d1b/f93 [0,4194304] 0 2023-12-06T15:00:35.623 INFO:tasks.workunit.client.1.smithi190.stdout:0/913: mkdir d0/da/d3e/d3a/d130 0 2023-12-06T15:00:35.623 INFO:tasks.workunit.client.1.smithi190.stdout:0/914: readlink d0/da/d3e/d3a/d40/l54 0 2023-12-06T15:00:35.627 INFO:tasks.workunit.client.1.smithi190.stdout:8/906: mknod d1/dd1/d10b/d87/c110 0 2023-12-06T15:00:35.633 INFO:tasks.workunit.client.0.smithi152.stdout:5/828: dwrite d7/dd/d26/f117 [0,4194304] 0 2023-12-06T15:00:35.633 INFO:tasks.workunit.client.0.smithi152.stdout:8/617: sync 2023-12-06T15:00:35.633 INFO:tasks.workunit.client.0.smithi152.stdout:2/634: sync 2023-12-06T15:00:35.633 INFO:tasks.workunit.client.1.smithi190.stdout:0/915: creat d0/da/da4/db1/d111/f131 x:0 0 0 2023-12-06T15:00:35.634 INFO:tasks.workunit.client.1.smithi190.stdout:0/916: fdatasync d0/f50 0 2023-12-06T15:00:35.635 INFO:tasks.workunit.client.1.smithi190.stdout:0/917: mkdir d0/da/d3e/d3a/d132 0 2023-12-06T15:00:35.637 INFO:tasks.workunit.client.1.smithi190.stdout:0/918: creat d0/da/d5a/d80/f133 x:0 0 0 2023-12-06T15:00:35.638 INFO:tasks.workunit.client.0.smithi152.stdout:7/570: unlink dd/df/d34/d44/d49/d73/c91 0 2023-12-06T15:00:35.639 INFO:tasks.workunit.client.1.smithi190.stdout:0/919: creat d0/da/d74/da2/f134 x:0 0 0 2023-12-06T15:00:35.646 INFO:tasks.workunit.client.0.smithi152.stdout:4/977: link d2/d10/c9f d2/d15/d32/d54/d85/c142 0 2023-12-06T15:00:35.646 INFO:tasks.workunit.client.0.smithi152.stdout:4/978: chown d2/d15/d32/f92 1238922 1 2023-12-06T15:00:35.646 INFO:tasks.workunit.client.0.smithi152.stdout:9/696: dread d0/f5 [0,4194304] 0 2023-12-06T15:00:35.647 INFO:tasks.workunit.client.0.smithi152.stdout:2/635: dread d6/db/faa [0,4194304] 0 2023-12-06T15:00:35.648 INFO:tasks.workunit.client.0.smithi152.stdout:6/922: dread d1/dcf/ddc/d1a/d30/d36/d26/f2d [0,4194304] 0 2023-12-06T15:00:35.658 INFO:tasks.workunit.client.0.smithi152.stdout:5/829: dread d7/dd/d26/d48/d97/dc2/fe8 [0,4194304] 0 2023-12-06T15:00:35.662 INFO:tasks.workunit.client.0.smithi152.stdout:2/636: creat d6/d1e/d41/d92/fc8 x:0 0 0 2023-12-06T15:00:35.662 INFO:tasks.workunit.client.0.smithi152.stdout:4/979: dread d2/d10/f37 [4194304,4194304] 0 2023-12-06T15:00:35.662 INFO:tasks.workunit.client.0.smithi152.stdout:5/830: dread d7/d43/f4b [0,4194304] 0 2023-12-06T15:00:35.662 INFO:tasks.workunit.client.0.smithi152.stdout:5/831: truncate d7/dd/f3c 4556038 0 2023-12-06T15:00:35.662 INFO:tasks.workunit.client.0.smithi152.stdout:5/832: write d7/dd/d26/d87/dc4/ddc/fd6 [364138,47107] 0 2023-12-06T15:00:35.665 INFO:tasks.workunit.client.0.smithi152.stdout:2/637: mkdir d6/d18/d43/dc9 0 2023-12-06T15:00:35.665 INFO:tasks.workunit.client.0.smithi152.stdout:5/833: creat d7/d43/d6c/d98/f125 x:0 0 0 2023-12-06T15:00:35.666 INFO:tasks.workunit.client.0.smithi152.stdout:0/682: dwrite d8/d44/f46 [0,4194304] 0 2023-12-06T15:00:35.666 INFO:tasks.workunit.client.0.smithi152.stdout:0/683: dread - d8/fdc zero size 2023-12-06T15:00:35.666 INFO:tasks.workunit.client.0.smithi152.stdout:0/684: readlink d8/d15/d45/d73/d7a/l35 0 2023-12-06T15:00:35.667 INFO:tasks.workunit.client.0.smithi152.stdout:4/980: rename d2/d10/dc8/ddb/l106 to d2/d10/l143 0 2023-12-06T15:00:35.668 INFO:tasks.workunit.client.0.smithi152.stdout:5/834: creat d7/dd/d26/d3b/d46/d7e/f126 x:0 0 0 2023-12-06T15:00:35.672 INFO:tasks.workunit.client.0.smithi152.stdout:0/685: symlink d8/d3e/d87/d76/le4 0 2023-12-06T15:00:35.673 INFO:tasks.workunit.client.0.smithi152.stdout:2/638: rename d6/db/d17/f1d to d6/d18/d43/db3/db7/fca 0 2023-12-06T15:00:35.673 INFO:tasks.workunit.client.0.smithi152.stdout:4/981: mknod d2/d10/dc8/d100/c144 0 2023-12-06T15:00:35.675 INFO:tasks.workunit.client.0.smithi152.stdout:2/639: unlink d6/db/c6c 0 2023-12-06T15:00:35.675 INFO:tasks.workunit.client.0.smithi152.stdout:4/982: creat d2/d15/f145 x:0 0 0 2023-12-06T15:00:35.684 INFO:tasks.workunit.client.0.smithi152.stdout:2/640: dread d6/f6a [0,4194304] 0 2023-12-06T15:00:35.685 INFO:tasks.workunit.client.0.smithi152.stdout:2/641: mkdir d6/d1e/d41/d92/dcb 0 2023-12-06T15:00:35.696 INFO:tasks.workunit.client.1.smithi190.stdout:8/907: dwrite d1/d20/d3b/d4c/fde [4194304,4194304] 0 2023-12-06T15:00:35.696 INFO:tasks.workunit.client.0.smithi152.stdout:8/618: dwrite d1/d6/d34/d35/d66/faf [0,4194304] 0 2023-12-06T15:00:35.697 INFO:tasks.workunit.client.0.smithi152.stdout:7/571: dwrite dd/df/d1b/d20/d7c/d86/f87 [0,4194304] 0 2023-12-06T15:00:35.700 INFO:tasks.workunit.client.1.smithi190.stdout:8/908: link d1/d37/cab d1/d20/d3b/d36/c111 0 2023-12-06T15:00:35.701 INFO:tasks.workunit.client.1.smithi190.stdout:8/909: mknod d1/dd3/c112 0 2023-12-06T15:00:35.701 INFO:tasks.workunit.client.0.smithi152.stdout:8/619: creat d1/d6/d34/d6f/fc5 x:0 0 0 2023-12-06T15:00:35.701 INFO:tasks.workunit.client.0.smithi152.stdout:8/620: write d1/f96 [163190,106991] 0 2023-12-06T15:00:35.702 INFO:tasks.workunit.client.1.smithi190.stdout:8/910: creat d1/d20/d3b/d4c/d8e/d94/db6/f113 x:0 0 0 2023-12-06T15:00:35.703 INFO:tasks.workunit.client.1.smithi190.stdout:8/911: symlink d1/d20/d3b/d4c/l114 0 2023-12-06T15:00:35.705 INFO:tasks.workunit.client.0.smithi152.stdout:8/621: rename d1/d6/d34/d40/f52 to d1/d6/d34/fc6 0 2023-12-06T15:00:35.706 INFO:tasks.workunit.client.0.smithi152.stdout:8/622: read d1/d6/d34/d35/d66/f71 [3495515,86159] 0 2023-12-06T15:00:35.707 INFO:tasks.workunit.client.0.smithi152.stdout:7/572: dread dd/df/d1b/d20/f35 [0,4194304] 0 2023-12-06T15:00:35.707 INFO:tasks.workunit.client.0.smithi152.stdout:8/623: symlink d1/d6/d86/lc7 0 2023-12-06T15:00:35.708 INFO:tasks.workunit.client.0.smithi152.stdout:7/573: unlink dd/df/d1b/d20/d28/f80 0 2023-12-06T15:00:35.709 INFO:tasks.workunit.client.0.smithi152.stdout:8/624: creat d1/d6/d34/d35/d66/d82/db6/fc8 x:0 0 0 2023-12-06T15:00:35.710 INFO:tasks.workunit.client.0.smithi152.stdout:8/625: creat d1/d6/d34/d35/fc9 x:0 0 0 2023-12-06T15:00:35.711 INFO:tasks.workunit.client.0.smithi152.stdout:8/626: read d1/d6/d34/d36/f55 [1043023,19576] 0 2023-12-06T15:00:35.712 INFO:tasks.workunit.client.0.smithi152.stdout:8/627: rename d1/d6/d34/d90/f9a to d1/d6/d34/d35/fca 0 2023-12-06T15:00:35.720 INFO:tasks.workunit.client.1.smithi190.stdout:8/912: dread d1/d20/d3b/d4c/d8e/da5/fb7 [0,4194304] 0 2023-12-06T15:00:35.720 INFO:tasks.workunit.client.1.smithi190.stdout:8/913: write d1/d20/d3b/d7e/f103 [773618,86688] 0 2023-12-06T15:00:35.720 INFO:tasks.workunit.client.0.smithi152.stdout:9/697: dwrite d0/d3f/d5f/d60/f6b [0,4194304] 0 2023-12-06T15:00:35.721 INFO:tasks.workunit.client.0.smithi152.stdout:0/686: dwrite d8/fa [0,4194304] 0 2023-12-06T15:00:35.721 INFO:tasks.workunit.client.0.smithi152.stdout:0/687: dread - d8/d15/d45/d73/db9/fd0 zero size 2023-12-06T15:00:35.721 INFO:tasks.workunit.client.0.smithi152.stdout:0/688: fdatasync d8/d15/d45/d73/fbb 0 2023-12-06T15:00:35.722 INFO:tasks.workunit.client.1.smithi190.stdout:8/914: creat d1/d20/d3b/d4c/d59/daa/ddf/f115 x:0 0 0 2023-12-06T15:00:35.723 INFO:tasks.workunit.client.0.smithi152.stdout:6/923: dwrite d1/dcf/ddc/d1a/d30/da4/fec [0,4194304] 0 2023-12-06T15:00:35.726 INFO:tasks.workunit.client.0.smithi152.stdout:6/924: dread d1/dcf/ddc/d1a/d30/d18/f28 [0,4194304] 0 2023-12-06T15:00:35.727 INFO:tasks.workunit.client.0.smithi152.stdout:6/925: read d1/fea [989223,67220] 0 2023-12-06T15:00:35.727 INFO:tasks.workunit.client.0.smithi152.stdout:6/926: write d1/d69/da1/f9e [709803,121614] 0 2023-12-06T15:00:35.727 INFO:tasks.workunit.client.0.smithi152.stdout:6/927: readlink d1/dcf/ddc/d1a/d30/d36/d26/l10e 0 2023-12-06T15:00:35.728 INFO:tasks.workunit.client.0.smithi152.stdout:6/928: getdents d1/d69/da1/d87/d10a 0 2023-12-06T15:00:35.728 INFO:tasks.workunit.client.0.smithi152.stdout:6/929: chown d1/dcf/ddc/d1a/d30/d36/d35/dd1/d141 11891 1 2023-12-06T15:00:35.731 INFO:tasks.workunit.client.1.smithi190.stdout:8/915: write d1/d20/d3b/d34/d39/fa3 [747691,23738] 0 2023-12-06T15:00:35.733 INFO:tasks.workunit.client.1.smithi190.stdout:8/916: rename d1/d20/d3b/d34/f40 to d1/d20/d3b/d4c/d8e/da5/f116 0 2023-12-06T15:00:35.735 INFO:tasks.workunit.client.1.smithi190.stdout:8/917: symlink d1/d20/d3b/d4c/d8e/l117 0 2023-12-06T15:00:35.742 INFO:tasks.workunit.client.0.smithi152.stdout:9/698: dread d0/f23 [0,4194304] 0 2023-12-06T15:00:35.745 INFO:tasks.workunit.client.0.smithi152.stdout:0/689: dread d8/f37 [0,4194304] 0 2023-12-06T15:00:35.745 INFO:tasks.workunit.client.0.smithi152.stdout:0/690: chown d8/d15/d45/d73/d8c/lc2 4 1 2023-12-06T15:00:35.745 INFO:tasks.workunit.client.0.smithi152.stdout:2/642: dwrite d6/d1e/d41/f60 [0,4194304] 0 2023-12-06T15:00:35.745 INFO:tasks.workunit.client.0.smithi152.stdout:8/628: dwrite d1/d6/d34/d36/fa7 [0,4194304] 0 2023-12-06T15:00:35.747 INFO:tasks.workunit.client.0.smithi152.stdout:9/699: creat d0/d3f/d68/d6c/d92/fcc x:0 0 0 2023-12-06T15:00:35.747 INFO:tasks.workunit.client.0.smithi152.stdout:9/700: readlink d0/d3f/d5f/d60/da1/l81 0 2023-12-06T15:00:35.747 INFO:tasks.workunit.client.0.smithi152.stdout:9/701: read - d0/d3f/d5f/fa3 zero size 2023-12-06T15:00:35.748 INFO:tasks.workunit.client.0.smithi152.stdout:7/574: dwrite f1 [0,4194304] 0 2023-12-06T15:00:35.754 INFO:tasks.workunit.client.0.smithi152.stdout:0/691: getdents d8/d15/d45 0 2023-12-06T15:00:35.757 INFO:tasks.workunit.client.0.smithi152.stdout:2/643: creat d6/db/d91/fcc x:0 0 0 2023-12-06T15:00:35.757 INFO:tasks.workunit.client.0.smithi152.stdout:2/644: write d6/db/d17/f4f [372881,53834] 0 2023-12-06T15:00:35.757 INFO:tasks.workunit.client.0.smithi152.stdout:2/645: chown d6/db/d17/f23 61229 1 2023-12-06T15:00:35.759 INFO:tasks.workunit.client.0.smithi152.stdout:8/629: truncate d1/d6/d34/d35/d38/f45 1750000 0 2023-12-06T15:00:35.762 INFO:tasks.workunit.client.0.smithi152.stdout:9/702: dread d0/d3f/d68/d6c/d20/d38/d45/f64 [0,4194304] 0 2023-12-06T15:00:35.763 INFO:tasks.workunit.client.0.smithi152.stdout:7/575: write dd/df/d1b/d20/d28/d38/f56 [1283731,53617] 0 2023-12-06T15:00:35.764 INFO:tasks.workunit.client.0.smithi152.stdout:2/646: creat d6/d18/d43/db8/fcd x:0 0 0 2023-12-06T15:00:35.764 INFO:tasks.workunit.client.0.smithi152.stdout:2/647: fdatasync d6/d1e/d41/f5d 0 2023-12-06T15:00:35.764 INFO:tasks.workunit.client.0.smithi152.stdout:8/630: link d1/d6/d34/d36/l56 d1/d6/d34/d3a/lcb 0 2023-12-06T15:00:35.765 INFO:tasks.workunit.client.0.smithi152.stdout:9/703: creat d0/d3f/d68/fcd x:0 0 0 2023-12-06T15:00:35.765 INFO:tasks.workunit.client.0.smithi152.stdout:9/704: truncate d0/d3f/f53 4264273 0 2023-12-06T15:00:35.765 INFO:tasks.workunit.client.0.smithi152.stdout:7/576: mkdir dd/df/d1b/d20/d7c/db7 0 2023-12-06T15:00:35.766 INFO:tasks.workunit.client.0.smithi152.stdout:2/648: creat d6/d1e/d41/d92/dbf/fce x:0 0 0 2023-12-06T15:00:35.767 INFO:tasks.workunit.client.0.smithi152.stdout:8/631: creat d1/d6/d29/d75/fcc x:0 0 0 2023-12-06T15:00:35.768 INFO:tasks.workunit.client.0.smithi152.stdout:9/705: creat d0/d3f/d68/d6c/d92/fce x:0 0 0 2023-12-06T15:00:35.768 INFO:tasks.workunit.client.0.smithi152.stdout:9/706: fdatasync d0/d3f/d68/d6c/d20/d38/da8/fc3 0 2023-12-06T15:00:35.771 INFO:tasks.workunit.client.0.smithi152.stdout:7/577: rename dd/d17/da8 to dd/df/d34/d44/d49/d73/d77/db8 0 2023-12-06T15:00:35.772 INFO:tasks.workunit.client.0.smithi152.stdout:2/649: creat d6/db/fcf x:0 0 0 2023-12-06T15:00:35.776 INFO:tasks.workunit.client.0.smithi152.stdout:8/632: unlink d1/d6/d34/d3a/f76 0 2023-12-06T15:00:35.776 INFO:tasks.workunit.client.0.smithi152.stdout:9/707: mkdir d0/d3f/d68/d6c/dcf 0 2023-12-06T15:00:35.776 INFO:tasks.workunit.client.0.smithi152.stdout:2/650: getdents d6/d1e/d41 0 2023-12-06T15:00:35.776 INFO:tasks.workunit.client.0.smithi152.stdout:9/708: write d0/d3f/d68/d6c/d20/d38/fbe [4210851,99160] 0 2023-12-06T15:00:35.777 INFO:tasks.workunit.client.0.smithi152.stdout:8/633: mkdir d1/d6/d86/dcd 0 2023-12-06T15:00:35.777 INFO:tasks.workunit.client.0.smithi152.stdout:8/634: truncate d1/d6/d86/fc3 1011634 0 2023-12-06T15:00:35.777 INFO:tasks.workunit.client.0.smithi152.stdout:8/635: stat d1/l7d 0 2023-12-06T15:00:35.779 INFO:tasks.workunit.client.0.smithi152.stdout:2/651: getdents d6/d1e/d41/d83 0 2023-12-06T15:00:35.783 INFO:tasks.workunit.client.0.smithi152.stdout:9/709: unlink d0/f23 0 2023-12-06T15:00:35.783 INFO:tasks.workunit.client.0.smithi152.stdout:9/710: readlink d0/d3f/d68/d6c/d20/l2b 0 2023-12-06T15:00:35.783 INFO:tasks.workunit.client.0.smithi152.stdout:8/636: dread d1/d6/d34/d36/f67 [0,4194304] 0 2023-12-06T15:00:35.785 INFO:tasks.workunit.client.0.smithi152.stdout:8/637: rename d1/d6/d34/d36/fc2 to d1/d6/d34/d36/fce 0 2023-12-06T15:00:35.790 INFO:tasks.workunit.client.0.smithi152.stdout:3/669: sync 2023-12-06T15:00:35.790 INFO:tasks.workunit.client.0.smithi152.stdout:3/670: chown d9/d10/d19/l90 8008 1 2023-12-06T15:00:35.797 INFO:tasks.workunit.client.0.smithi152.stdout:0/692: dwrite d8/d3e/d87/f90 [0,4194304] 0 2023-12-06T15:00:35.798 INFO:tasks.workunit.client.1.smithi190.stdout:8/918: dwrite d1/d20/d3b/d4c/d8e/d94/d1c/f77 [0,4194304] 0 2023-12-06T15:00:35.798 INFO:tasks.workunit.client.1.smithi190.stdout:8/919: chown d1/lba 39 1 2023-12-06T15:00:35.798 INFO:tasks.workunit.client.1.smithi190.stdout:8/920: dread d1/d37/f73 [0,4194304] 0 2023-12-06T15:00:35.798 INFO:tasks.workunit.client.1.smithi190.stdout:8/921: fsync d1/f6c 0 2023-12-06T15:00:35.800 INFO:tasks.workunit.client.0.smithi152.stdout:3/671: dread d9/ff [0,4194304] 0 2023-12-06T15:00:35.800 INFO:tasks.workunit.client.0.smithi152.stdout:0/693: mknod d8/d15/ce5 0 2023-12-06T15:00:35.809 INFO:tasks.workunit.client.1.smithi190.stdout:8/922: write d1/d20/d3b/f30 [2506092,101587] 0 2023-12-06T15:00:35.809 INFO:tasks.workunit.client.1.smithi190.stdout:8/923: fsync d1/d20/d3b/d36/f3c 0 2023-12-06T15:00:35.810 INFO:tasks.workunit.client.1.smithi190.stdout:6/993: sync 2023-12-06T15:00:35.810 INFO:tasks.workunit.client.1.smithi190.stdout:2/927: sync 2023-12-06T15:00:35.810 INFO:tasks.workunit.client.1.smithi190.stdout:5/862: sync 2023-12-06T15:00:35.810 INFO:tasks.workunit.client.1.smithi190.stdout:3/968: sync 2023-12-06T15:00:35.810 INFO:tasks.workunit.client.1.smithi190.stdout:5/863: dread - d0/d1c/d85/d90/f101 zero size 2023-12-06T15:00:35.811 INFO:tasks.workunit.client.1.smithi190.stdout:2/928: dread - d10/d26/d5c/d42/d9d/f10e zero size 2023-12-06T15:00:35.811 INFO:tasks.workunit.client.1.smithi190.stdout:4/889: sync 2023-12-06T15:00:35.811 INFO:tasks.workunit.client.1.smithi190.stdout:5/864: write d0/d1c/d2b/d8b/f10c [401780,35261] 0 2023-12-06T15:00:35.811 INFO:tasks.workunit.client.0.smithi152.stdout:3/672: write d9/d10/d12/f3e [296869,88002] 0 2023-12-06T15:00:35.811 INFO:tasks.workunit.client.0.smithi152.stdout:3/673: write d9/d10/d12/d43/d52/db4/fbf [1021602,98769] 0 2023-12-06T15:00:35.812 INFO:tasks.workunit.client.1.smithi190.stdout:6/994: dread d4/d12/d1a/f28 [0,4194304] 0 2023-12-06T15:00:35.812 INFO:tasks.workunit.client.1.smithi190.stdout:6/995: write d4/d12/d40/d43/d11d/f13b [939545,65091] 0 2023-12-06T15:00:35.812 INFO:tasks.workunit.client.1.smithi190.stdout:3/969: creat d4/d70/d19/f155 x:0 0 0 2023-12-06T15:00:35.812 INFO:tasks.workunit.client.1.smithi190.stdout:3/970: chown d4/d1b/d5d/l13e 567911 1 2023-12-06T15:00:35.812 INFO:tasks.workunit.client.1.smithi190.stdout:3/971: write d4/d1b/d5d/df1/db5/f135 [372304,51451] 0 2023-12-06T15:00:35.812 INFO:tasks.workunit.client.1.smithi190.stdout:2/929: mkdir d10/d26/d5c/d37/d13a 0 2023-12-06T15:00:35.813 INFO:tasks.workunit.client.0.smithi152.stdout:3/674: mkdir d9/d18/d51/d8d/d8f/da0/dab/dc3/d91/dca 0 2023-12-06T15:00:35.814 INFO:tasks.workunit.client.0.smithi152.stdout:3/675: creat d9/d45/fcb x:0 0 0 2023-12-06T15:00:35.814 INFO:tasks.workunit.client.0.smithi152.stdout:3/676: read - d9/d18/d51/d8d/d8f/da0/dab/dc3/d91/fa5 zero size 2023-12-06T15:00:35.814 INFO:tasks.workunit.client.0.smithi152.stdout:3/677: fsync d9/d10/d12/d43/f78 0 2023-12-06T15:00:35.815 INFO:tasks.workunit.client.1.smithi190.stdout:6/996: getdents d4/d12/d40/d43/d45/d4a/d77/dca 0 2023-12-06T15:00:35.815 INFO:tasks.workunit.client.1.smithi190.stdout:3/972: creat d4/d1b/d5d/df1/db5/f156 x:0 0 0 2023-12-06T15:00:35.815 INFO:tasks.workunit.client.1.smithi190.stdout:6/997: write d4/d12/d40/d43/d45/d4a/f118 [588628,10855] 0 2023-12-06T15:00:35.815 INFO:tasks.workunit.client.1.smithi190.stdout:2/930: creat d10/d26/d5c/d35/d77/d98/dfe/ded/f13b x:0 0 0 2023-12-06T15:00:35.815 INFO:tasks.workunit.client.1.smithi190.stdout:2/931: chown d10/d26/d5c/d49/c9b 1213909 1 2023-12-06T15:00:35.816 INFO:tasks.workunit.client.0.smithi152.stdout:3/678: fdatasync d9/d10/d12/f85 0 2023-12-06T15:00:35.816 INFO:tasks.workunit.client.1.smithi190.stdout:3/973: truncate d4/d1b/d54/d9c/d68/dfc/d56/fa7 281462 0 2023-12-06T15:00:35.818 INFO:tasks.workunit.client.1.smithi190.stdout:6/998: creat d4/d12/d40/f149 x:0 0 0 2023-12-06T15:00:35.818 INFO:tasks.workunit.client.1.smithi190.stdout:3/974: truncate d4/d70/d19/d51/d109/db7/dd2/f10b 148013 0 2023-12-06T15:00:35.819 INFO:tasks.workunit.client.1.smithi190.stdout:4/890: write d3/f78 [3198007,24300] 0 2023-12-06T15:00:35.819 INFO:tasks.workunit.client.0.smithi152.stdout:3/679: symlink d9/d10/d12/lcc 0 2023-12-06T15:00:35.820 INFO:tasks.workunit.client.1.smithi190.stdout:5/865: dread d0/d1c/d85/d90/d99/f11a [0,4194304] 0 2023-12-06T15:00:35.820 INFO:tasks.workunit.client.1.smithi190.stdout:3/975: rename d4/d1b/d5d/f71 to d4/d1b/d54/d9c/d68/f157 0 2023-12-06T15:00:35.821 INFO:tasks.workunit.client.0.smithi152.stdout:3/680: mknod d9/d10/d12/d43/ccd 0 2023-12-06T15:00:35.821 INFO:tasks.workunit.client.1.smithi190.stdout:4/891: symlink d3/d76/dc4/dc5/l137 0 2023-12-06T15:00:35.822 INFO:tasks.workunit.client.1.smithi190.stdout:4/892: write d3/d4e/f73 [1074644,103714] 0 2023-12-06T15:00:35.822 INFO:tasks.workunit.client.0.smithi152.stdout:3/681: rename d9/d10/d12/d43/c7d to d9/d18/d51/d8d/d8f/da0/cce 0 2023-12-06T15:00:35.822 INFO:tasks.workunit.client.0.smithi152.stdout:3/682: write d9/fb8 [32441,109575] 0 2023-12-06T15:00:35.822 INFO:tasks.workunit.client.0.smithi152.stdout:3/683: read - d9/d10/d19/f57 zero size 2023-12-06T15:00:35.823 INFO:tasks.workunit.client.1.smithi190.stdout:5/866: mkdir d0/d1c/d2b/d2c/d12b 0 2023-12-06T15:00:35.824 INFO:tasks.workunit.client.1.smithi190.stdout:6/999: rename d4/d12/d1a/d32/dc7/f130 to d4/d12/d1a/d32/dab/de9/f14a 0 2023-12-06T15:00:35.825 INFO:tasks.workunit.client.1.smithi190.stdout:3/976: mknod d4/d70/d19/d3a/d3b/c158 0 2023-12-06T15:00:35.826 INFO:tasks.workunit.client.1.smithi190.stdout:5/867: write d0/f24 [4190867,10298] 0 2023-12-06T15:00:35.827 INFO:tasks.workunit.client.1.smithi190.stdout:3/977: mknod d4/d70/d19/d3a/d3b/c159 0 2023-12-06T15:00:35.833 INFO:tasks.workunit.client.1.smithi190.stdout:3/978: creat d4/d1b/d54/d9c/d68/dfc/dc4/dce/f15a x:0 0 0 2023-12-06T15:00:35.833 INFO:tasks.workunit.client.1.smithi190.stdout:3/979: write d4/d1b/d54/d9c/d68/dfc/dc4/dce/f120 [85426,93416] 0 2023-12-06T15:00:35.835 INFO:tasks.workunit.client.1.smithi190.stdout:3/980: creat d4/d70/d19/d51/dab/d146/f15b x:0 0 0 2023-12-06T15:00:35.840 INFO:tasks.workunit.client.1.smithi190.stdout:3/981: symlink d4/d70/d19/d3a/d3b/d72/l15c 0 2023-12-06T15:00:35.840 INFO:tasks.workunit.client.1.smithi190.stdout:2/932: dread d10/d26/d5c/f5a [0,4194304] 0 2023-12-06T15:00:35.840 INFO:tasks.workunit.client.0.smithi152.stdout:4/983: dwrite d2/d89/f83 [0,4194304] 0 2023-12-06T15:00:35.840 INFO:tasks.workunit.client.0.smithi152.stdout:4/984: readlink d2/d15/d32/d69/d6f/l119 0 2023-12-06T15:00:35.841 INFO:tasks.workunit.client.1.smithi190.stdout:3/982: unlink d4/d70/d19/d51/d109/db7/dd2/l112 0 2023-12-06T15:00:35.841 INFO:tasks.workunit.client.1.smithi190.stdout:3/983: write d4/d70/d33/d45/fef [4778449,12235] 0 2023-12-06T15:00:35.844 INFO:tasks.workunit.client.0.smithi152.stdout:7/578: dwrite dd/df/d78/f81 [0,4194304] 0 2023-12-06T15:00:35.844 INFO:tasks.workunit.client.0.smithi152.stdout:7/579: chown dd/df/ca0 257541863 1 2023-12-06T15:00:35.844 INFO:tasks.workunit.client.0.smithi152.stdout:7/580: write dd/df/d34/d44/d49/d73/d77/db8/fb5 [321443,1040] 0 2023-12-06T15:00:35.846 INFO:tasks.workunit.client.0.smithi152.stdout:4/985: creat d2/d10/dc8/f146 x:0 0 0 2023-12-06T15:00:35.846 INFO:tasks.workunit.client.1.smithi190.stdout:3/984: rename d4/d70/d33 to d4/d1b/d54/d15d 0 2023-12-06T15:00:35.846 INFO:tasks.workunit.client.1.smithi190.stdout:3/985: write d4/d70/d19/d3a/d3b/fc2 [271046,8372] 0 2023-12-06T15:00:35.847 INFO:tasks.workunit.client.0.smithi152.stdout:7/581: creat dd/df/d78/fb9 x:0 0 0 2023-12-06T15:00:35.848 INFO:tasks.workunit.client.0.smithi152.stdout:4/986: symlink d2/d15/d32/l147 0 2023-12-06T15:00:35.848 INFO:tasks.workunit.client.0.smithi152.stdout:4/987: write d2/d10/ff3 [4828253,67943] 0 2023-12-06T15:00:35.849 INFO:tasks.workunit.client.0.smithi152.stdout:4/988: creat d2/d10/dbb/dca/dbc/d75/deb/f148 x:0 0 0 2023-12-06T15:00:35.849 INFO:tasks.workunit.client.0.smithi152.stdout:4/989: readlink d2/d89/df9/dfe/d115/l12e 0 2023-12-06T15:00:35.850 INFO:tasks.workunit.client.0.smithi152.stdout:4/990: dread d2/d15/d32/d69/d6f/daf/f110 [0,4194304] 0 2023-12-06T15:00:35.850 INFO:tasks.workunit.client.0.smithi152.stdout:7/582: read dd/df/d1b/d20/f58 [4030508,84951] 0 2023-12-06T15:00:35.851 INFO:tasks.workunit.client.0.smithi152.stdout:7/583: chown dd/df/d1b/d20/d28/d38/l33 289877963 1 2023-12-06T15:00:35.851 INFO:tasks.workunit.client.0.smithi152.stdout:7/584: dread - dd/df/d34/d44/d49/d73/f75 zero size 2023-12-06T15:00:35.851 INFO:tasks.workunit.client.0.smithi152.stdout:7/585: chown dd/df/d34/d44/d49/d73/f75 172 1 2023-12-06T15:00:35.851 INFO:tasks.workunit.client.0.smithi152.stdout:7/586: truncate dd/df/d1b/d20/d7c/fa1 66000 0 2023-12-06T15:00:35.852 INFO:tasks.workunit.client.0.smithi152.stdout:8/638: dwrite d1/d6/d34/fa2 [0,4194304] 0 2023-12-06T15:00:35.853 INFO:tasks.workunit.client.0.smithi152.stdout:7/587: creat dd/df/d1b/d20/fba x:0 0 0 2023-12-06T15:00:35.853 INFO:tasks.workunit.client.0.smithi152.stdout:7/588: write dd/df/d34/d44/d49/d73/f75 [1000333,20717] 0 2023-12-06T15:00:35.858 INFO:tasks.workunit.client.0.smithi152.stdout:7/589: dread dd/df/d1b/f41 [0,4194304] 0 2023-12-06T15:00:35.858 INFO:tasks.workunit.client.0.smithi152.stdout:9/711: dwrite d0/f5 [0,4194304] 0 2023-12-06T15:00:35.858 INFO:tasks.workunit.client.0.smithi152.stdout:9/712: dread - d0/d3f/d5f/fa3 zero size 2023-12-06T15:00:35.859 INFO:tasks.workunit.client.0.smithi152.stdout:9/713: creat d0/d3f/d68/d9f/fd0 x:0 0 0 2023-12-06T15:00:35.860 INFO:tasks.workunit.client.0.smithi152.stdout:9/714: truncate d0/d3f/d68/d6c/d20/d38/d44/dc4/f5e 3465577 0 2023-12-06T15:00:35.861 INFO:tasks.workunit.client.0.smithi152.stdout:9/715: write d0/d3f/d5f/f9d [499249,96238] 0 2023-12-06T15:00:35.862 INFO:tasks.workunit.client.0.smithi152.stdout:8/639: dread d1/f77 [0,4194304] 0 2023-12-06T15:00:35.862 INFO:tasks.workunit.client.0.smithi152.stdout:7/590: dread dd/df/d34/d44/d49/f71 [0,4194304] 0 2023-12-06T15:00:35.862 INFO:tasks.workunit.client.0.smithi152.stdout:7/591: readlink dd/df/l31 0 2023-12-06T15:00:35.863 INFO:tasks.workunit.client.0.smithi152.stdout:9/716: truncate d0/d3f/d68/d6c/d20/db0/f99 2013590 0 2023-12-06T15:00:35.863 INFO:tasks.workunit.client.0.smithi152.stdout:8/640: rename d1/d6/d29/d5b/f62 to d1/d6/d29/fcf 0 2023-12-06T15:00:35.877 INFO:tasks.workunit.client.0.smithi152.stdout:4/991: dread d2/d15/d32/d69/d6f/d10b/f4d [0,4194304] 0 2023-12-06T15:00:35.878 INFO:tasks.workunit.client.0.smithi152.stdout:4/992: dread - d2/d45/d84/da4/f104 zero size 2023-12-06T15:00:35.879 INFO:tasks.workunit.client.0.smithi152.stdout:4/993: rename d2/d10/dbb/dca/dbc/fcd to d2/d45/d84/da4/f149 0 2023-12-06T15:00:35.899 INFO:tasks.workunit.client.0.smithi152.stdout:7/592: dread f9 [0,4194304] 0 2023-12-06T15:00:35.899 INFO:tasks.workunit.client.0.smithi152.stdout:7/593: fsync dd/df/d34/d44/d49/f54 0 2023-12-06T15:00:35.899 INFO:tasks.workunit.client.0.smithi152.stdout:7/594: dread dd/df/d34/d44/d49/f71 [0,4194304] 0 2023-12-06T15:00:35.901 INFO:tasks.workunit.client.0.smithi152.stdout:7/595: creat dd/df/d34/d44/d49/d73/d77/db8/fbb x:0 0 0 2023-12-06T15:00:35.902 INFO:tasks.workunit.client.0.smithi152.stdout:0/694: dwrite d8/d15/d45/da4/fbc [0,4194304] 0 2023-12-06T15:00:35.905 INFO:tasks.workunit.client.0.smithi152.stdout:0/695: rename d8/d44/c5d to d8/d15/d45/d73/db9/dc4/ce6 0 2023-12-06T15:00:35.906 INFO:tasks.workunit.client.0.smithi152.stdout:0/696: creat d8/d15/d45/da2/fe7 x:0 0 0 2023-12-06T15:00:35.908 INFO:tasks.workunit.client.1.smithi190.stdout:0/920: sync 2023-12-06T15:00:35.909 INFO:tasks.workunit.client.1.smithi190.stdout:8/924: dwrite d1/d20/d3b/d36/f68 [0,4194304] 0 2023-12-06T15:00:35.911 INFO:tasks.workunit.client.1.smithi190.stdout:8/925: creat d1/d20/d3b/d4c/d8e/d94/db6/f118 x:0 0 0 2023-12-06T15:00:35.912 INFO:tasks.workunit.client.1.smithi190.stdout:8/926: rename d1/d20/d3b/d4c/d5a/dfb/f10c to d1/d20/d3b/d34/dbc/f119 0 2023-12-06T15:00:35.912 INFO:tasks.workunit.client.1.smithi190.stdout:8/927: write d1/d20/d3b/d4c/d8e/d94/d1c/de0/ff4 [638478,99716] 0 2023-12-06T15:00:35.918 INFO:tasks.workunit.client.1.smithi190.stdout:0/921: dread d0/da/d3e/d3a/d40/d81/f92 [0,4194304] 0 2023-12-06T15:00:35.918 INFO:tasks.workunit.client.1.smithi190.stdout:0/922: chown d0/da/d5a/fcd 127 1 2023-12-06T15:00:35.918 INFO:tasks.workunit.client.1.smithi190.stdout:0/923: write d0/da/d3e/d2b/d3c/d65/f7c [1399205,99805] 0 2023-12-06T15:00:35.919 INFO:tasks.workunit.client.0.smithi152.stdout:7/596: dread dd/df/d34/d44/d49/daf/fb2 [0,4194304] 0 2023-12-06T15:00:35.921 INFO:tasks.workunit.client.1.smithi190.stdout:0/924: link d0/da/d74/da2/f134 d0/da/da4/f135 0 2023-12-06T15:00:35.921 INFO:tasks.workunit.client.1.smithi190.stdout:0/925: truncate d0/da/db7/fff 149280 0 2023-12-06T15:00:35.925 INFO:tasks.workunit.client.1.smithi190.stdout:0/926: dread d0/da/f5b [0,4194304] 0 2023-12-06T15:00:35.927 INFO:tasks.workunit.client.1.smithi190.stdout:0/927: getdents d0/da/d3e/d2b/d3c/d4c/da8 0 2023-12-06T15:00:35.927 INFO:tasks.workunit.client.1.smithi190.stdout:0/928: readlink d0/l6 0 2023-12-06T15:00:35.927 INFO:tasks.workunit.client.1.smithi190.stdout:0/929: chown d0/da/d3e/d3a/d40/d6f/ld5 215 1 2023-12-06T15:00:35.929 INFO:tasks.workunit.client.1.smithi190.stdout:0/930: mkdir d0/da/da4/db1/d111/d136 0 2023-12-06T15:00:35.930 INFO:tasks.workunit.client.0.smithi152.stdout:0/697: dread f5 [0,4194304] 0 2023-12-06T15:00:35.930 INFO:tasks.workunit.client.0.smithi152.stdout:7/597: read dd/f11 [743512,126440] 0 2023-12-06T15:00:35.930 INFO:tasks.workunit.client.0.smithi152.stdout:7/598: chown dd/df/d1b/d20 7754105 1 2023-12-06T15:00:35.930 INFO:tasks.workunit.client.0.smithi152.stdout:7/599: readlink dd/df/d1b/d20/d28/d53/l6b 0 2023-12-06T15:00:35.930 INFO:tasks.workunit.client.0.smithi152.stdout:7/600: dread - dd/df/d34/d44/d49/d73/d77/db8/fbb zero size 2023-12-06T15:00:35.931 INFO:tasks.workunit.client.1.smithi190.stdout:0/931: creat d0/da/d3e/d3a/f137 x:0 0 0 2023-12-06T15:00:35.931 INFO:tasks.workunit.client.0.smithi152.stdout:0/698: creat d8/d15/d45/d83/fe8 x:0 0 0 2023-12-06T15:00:35.931 INFO:tasks.workunit.client.0.smithi152.stdout:7/601: creat dd/df/d1b/fbc x:0 0 0 2023-12-06T15:00:35.932 INFO:tasks.workunit.client.1.smithi190.stdout:0/932: creat d0/da/d3e/d2b/d37/f138 x:0 0 0 2023-12-06T15:00:35.932 INFO:tasks.workunit.client.1.smithi190.stdout:0/933: readlink d0/da/db7/le2 0 2023-12-06T15:00:35.932 INFO:tasks.workunit.client.0.smithi152.stdout:7/602: creat dd/df/d1b/d20/d7c/d86/da4/fbd x:0 0 0 2023-12-06T15:00:35.934 INFO:tasks.workunit.client.1.smithi190.stdout:0/934: rename d0/da/d3e/d2b/d3c/d46/d8e/d90/c9f to d0/da/d74/dfc/c139 0 2023-12-06T15:00:35.936 INFO:tasks.workunit.client.1.smithi190.stdout:0/935: unlink d0/da/d3e/d3a/d40/d6f/d9e/dbb/fce 0 2023-12-06T15:00:35.936 INFO:tasks.workunit.client.1.smithi190.stdout:0/936: fdatasync d0/da/d3e/d2b/d3c/d46/d8e/fa0 0 2023-12-06T15:00:35.938 INFO:tasks.workunit.client.1.smithi190.stdout:0/937: symlink d0/da/d3e/d2b/d3c/l13a 0 2023-12-06T15:00:35.938 INFO:tasks.workunit.client.1.smithi190.stdout:0/938: chown d0/da/c67 5 1 2023-12-06T15:00:35.939 INFO:tasks.workunit.client.1.smithi190.stdout:0/939: rename d0/da/d5a/f95 to d0/da/da4/f13b 0 2023-12-06T15:00:35.940 INFO:tasks.workunit.client.1.smithi190.stdout:0/940: chown d0/da/db7/le4 13 1 2023-12-06T15:00:35.941 INFO:tasks.workunit.client.1.smithi190.stdout:0/941: rmdir d0/da/d3e/d2b/d3c/d4c/dcc 39 2023-12-06T15:00:35.945 INFO:tasks.workunit.client.0.smithi152.stdout:0/699: dread d8/d3e/f43 [0,4194304] 0 2023-12-06T15:00:35.946 INFO:tasks.workunit.client.1.smithi190.stdout:5/868: dwrite d0/df/f38 [0,4194304] 0 2023-12-06T15:00:35.946 INFO:tasks.workunit.client.1.smithi190.stdout:5/869: write d0/d1c/d3e/d7e/ffa [382404,62218] 0 2023-12-06T15:00:35.946 INFO:tasks.workunit.client.1.smithi190.stdout:4/893: dwrite d3/f9 [0,4194304] 0 2023-12-06T15:00:35.947 INFO:tasks.workunit.client.0.smithi152.stdout:3/684: dwrite d9/d10/d12/d43/d52/db4/d65/faa [0,4194304] 0 2023-12-06T15:00:35.949 INFO:tasks.workunit.client.0.smithi152.stdout:0/700: dread d8/d15/d45/f4f [0,4194304] 0 2023-12-06T15:00:35.950 INFO:tasks.workunit.client.0.smithi152.stdout:9/717: fdatasync d0/d3f/d5f/f9d 0 2023-12-06T15:00:35.950 INFO:tasks.workunit.client.1.smithi190.stdout:2/933: dwrite d10/d59/d118/f12a [0,4194304] 0 2023-12-06T15:00:35.950 INFO:tasks.workunit.client.1.smithi190.stdout:2/934: write d10/d26/d5c/d42/d9d/fe1 [526683,18234] 0 2023-12-06T15:00:35.952 INFO:tasks.workunit.client.1.smithi190.stdout:5/870: write d0/df/d50/fa4 [3415378,27048] 0 2023-12-06T15:00:35.956 INFO:tasks.workunit.client.1.smithi190.stdout:5/871: creat d0/d1c/d3e/dea/f12c x:0 0 0 2023-12-06T15:00:35.956 INFO:tasks.workunit.client.1.smithi190.stdout:5/872: chown d0/df/d50/l65 8045 1 2023-12-06T15:00:35.959 INFO:tasks.workunit.client.1.smithi190.stdout:5/873: symlink d0/d1c/d85/d90/d99/l12d 0 2023-12-06T15:00:35.960 INFO:tasks.workunit.client.1.smithi190.stdout:5/874: write d0/d1c/d85/d90/dba/fd6 [1455313,25624] 0 2023-12-06T15:00:35.960 INFO:tasks.workunit.client.0.smithi152.stdout:4/994: dwrite d2/d10/dbb/dca/dbc/d42/fb8 [0,4194304] 0 2023-12-06T15:00:35.960 INFO:tasks.workunit.client.0.smithi152.stdout:4/995: stat d2/d10/dbb/dca/dbc/d42/dba/fd4 0 2023-12-06T15:00:35.966 INFO:tasks.workunit.client.1.smithi190.stdout:3/986: dwrite d4/d1b/d54/d9c/d68/dfc/fad [4194304,4194304] 0 2023-12-06T15:00:35.967 INFO:tasks.workunit.client.0.smithi152.stdout:8/641: dwrite d1/d6/d29/f51 [4194304,4194304] 0 2023-12-06T15:00:35.980 INFO:tasks.workunit.client.1.smithi190.stdout:3/987: dread d4/d70/d19/d3a/ddf/f115 [0,4194304] 0 2023-12-06T15:00:35.981 INFO:tasks.workunit.client.1.smithi190.stdout:3/988: chown d4/d1b/d54/d9c/d68/d8a/ffb 92 1 2023-12-06T15:00:35.981 INFO:tasks.workunit.client.1.smithi190.stdout:3/989: chown d4/d70/d19/d3a/d3b/fc2 47 1 2023-12-06T15:00:35.992 INFO:tasks.workunit.client.1.smithi190.stdout:8/928: dwrite d1/d20/d3b/d4c/d8e/d94/f5e [0,4194304] 0 2023-12-06T15:00:35.992 INFO:tasks.workunit.client.0.smithi152.stdout:7/603: dwrite dd/df/d1b/d20/f35 [0,4194304] 0 2023-12-06T15:00:36.002 INFO:tasks.workunit.client.1.smithi190.stdout:4/894: dwrite d3/d76/dc4/dc5/f37 [0,4194304] 0 2023-12-06T15:00:36.004 INFO:tasks.workunit.client.1.smithi190.stdout:4/895: fdatasync d3/f78 0 2023-12-06T15:00:36.006 INFO:tasks.workunit.client.1.smithi190.stdout:5/875: dwrite d0/d1c/f36 [0,4194304] 0 2023-12-06T15:00:36.007 INFO:tasks.workunit.client.0.smithi152.stdout:3/685: dwrite d9/d18/d51/d8d/d8f/da0/dab/dc3/f8c [0,4194304] 0 2023-12-06T15:00:36.007 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:35 smithi152 ceph-mon[111954]: pgmap v29: 65 pgs: 65 active+clean; 3.4 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 237 MiB/s rd, 476 MiB/s wr, 743 op/s 2023-12-06T15:00:36.007 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:35 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:36.007 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:35 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:36.007 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:35 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-06T15:00:36.008 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:35 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-06T15:00:36.008 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:35 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-06T15:00:36.008 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:35 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:00:36.014 INFO:tasks.workunit.client.1.smithi190.stdout:8/929: dwrite d1/d20/d3b/d4c/d59/fc2 [0,4194304] 0 2023-12-06T15:00:36.014 INFO:tasks.workunit.client.1.smithi190.stdout:8/930: dread - d1/d20/d3b/d4c/d8e/da5/fa7 zero size 2023-12-06T15:00:36.014 INFO:tasks.workunit.client.1.smithi190.stdout:5/876: creat d0/d1c/d3e/dfd/f12e x:0 0 0 2023-12-06T15:00:36.017 INFO:tasks.workunit.client.1.smithi190.stdout:3/990: rmdir d4/d1b 39 2023-12-06T15:00:36.023 INFO:tasks.workunit.client.1.smithi190.stdout:5/877: rmdir d0/d1c/d2b/d8b 39 2023-12-06T15:00:36.023 INFO:tasks.workunit.client.1.smithi190.stdout:5/878: chown d0/d1c/d3e/l52 211783922 1 2023-12-06T15:00:36.023 INFO:tasks.workunit.client.1.smithi190.stdout:3/991: creat d4/d1b/d54/d15d/f15e x:0 0 0 2023-12-06T15:00:36.023 INFO:tasks.workunit.client.1.smithi190.stdout:5/879: chown d0/d1c/d2b/d2c/d5d/d73/d116/dc5/cce 164867662 1 2023-12-06T15:00:36.023 INFO:tasks.workunit.client.1.smithi190.stdout:3/992: dread - d4/d1b/d5d/f131 zero size 2023-12-06T15:00:36.024 INFO:tasks.workunit.client.1.smithi190.stdout:5/880: creat d0/d1c/f12f x:0 0 0 2023-12-06T15:00:36.025 INFO:tasks.workunit.client.0.smithi152.stdout:0/701: creat d8/d15/d45/d73/db9/fe9 x:0 0 0 2023-12-06T15:00:36.027 INFO:tasks.workunit.client.1.smithi190.stdout:3/993: creat d4/d1b/d54/d9c/d68/dfc/f15f x:0 0 0 2023-12-06T15:00:36.028 INFO:tasks.workunit.client.0.smithi152.stdout:9/718: creat d0/d3f/d5f/dbb/fd1 x:0 0 0 2023-12-06T15:00:36.029 INFO:tasks.workunit.client.1.smithi190.stdout:5/881: creat d0/d1c/d2b/d2c/d5d/d73/d116/dc5/dd5/f130 x:0 0 0 2023-12-06T15:00:36.029 INFO:tasks.workunit.client.1.smithi190.stdout:5/882: truncate d0/d1c/d2b/f7f 1736760 0 2023-12-06T15:00:36.031 INFO:tasks.workunit.client.1.smithi190.stdout:3/994: mkdir d4/d70/d19/d160 0 2023-12-06T15:00:36.034 INFO:tasks.workunit.client.1.smithi190.stdout:8/931: dwrite d1/d20/f42 [0,4194304] 0 2023-12-06T15:00:36.034 INFO:tasks.workunit.client.1.smithi190.stdout:8/932: chown d1/d20/d3b/d34/dbc/f106 18 1 2023-12-06T15:00:36.035 INFO:tasks.workunit.client.0.smithi152.stdout:9/719: write d0/d3f/d68/d6c/d20/d38/d44/dc4/f87 [1755657,7190] 0 2023-12-06T15:00:36.035 INFO:tasks.workunit.client.1.smithi190.stdout:3/995: link d4/d70/d19/d51/d109/db7/dd2/f10b d4/d1b/d69/f161 0 2023-12-06T15:00:36.035 INFO:tasks.workunit.client.1.smithi190.stdout:3/996: truncate d4/fa5 2388796 0 2023-12-06T15:00:36.035 INFO:tasks.workunit.client.1.smithi190.stdout:3/997: write d4/d1b/d5d/fe3 [1750833,81568] 0 2023-12-06T15:00:36.036 INFO:tasks.workunit.client.1.smithi190.stdout:5/883: rename d0/d6c/da7/df3/f124 to d0/d1c/d3e/f131 0 2023-12-06T15:00:36.036 INFO:tasks.workunit.client.1.smithi190.stdout:5/884: write d0/d1c/d3e/fe1 [422938,78239] 0 2023-12-06T15:00:36.036 INFO:tasks.workunit.client.1.smithi190.stdout:5/885: dread - d0/d1c/d94/ff1 zero size 2023-12-06T15:00:36.038 INFO:tasks.workunit.client.1.smithi190.stdout:5/886: truncate d0/fd 2564981 0 2023-12-06T15:00:36.038 INFO:tasks.workunit.client.1.smithi190.stdout:5/887: chown d0/d1c/d85 1271 1 2023-12-06T15:00:36.039 INFO:tasks.workunit.client.1.smithi190.stdout:5/888: mkdir d0/d1c/d2b/d2c/d5d/d73/d116/dc5/d113/d132 0 2023-12-06T15:00:36.041 INFO:tasks.workunit.client.0.smithi152.stdout:4/996: getdents d2/d10/dbb/dca/dbc/d75/deb 0 2023-12-06T15:00:36.041 INFO:tasks.workunit.client.0.smithi152.stdout:4/997: chown d2/d89/df9 1365 1 2023-12-06T15:00:36.042 INFO:tasks.workunit.client.0.smithi152.stdout:4/998: dread - d2/d45/d84/da4/f104 zero size 2023-12-06T15:00:36.042 INFO:tasks.workunit.client.0.smithi152.stdout:4/999: chown d2/l1c 89070209 1 2023-12-06T15:00:36.043 INFO:tasks.workunit.client.0.smithi152.stdout:8/642: symlink d1/d6/d34/d35/d66/d82/ld0 0 2023-12-06T15:00:36.043 INFO:tasks.workunit.client.0.smithi152.stdout:7/604: creat dd/df/d34/d44/d49/d73/d77/fbe x:0 0 0 2023-12-06T15:00:36.043 INFO:tasks.workunit.client.0.smithi152.stdout:7/605: rename dd/df to dd/df/d1b/d20/d28/d53/dbf 22 2023-12-06T15:00:36.045 INFO:tasks.workunit.client.1.smithi190.stdout:5/889: truncate d0/f18 4033621 0 2023-12-06T15:00:36.048 INFO:tasks.workunit.client.1.smithi190.stdout:8/933: dread d1/d20/d3b/f30 [0,4194304] 0 2023-12-06T15:00:36.048 INFO:tasks.workunit.client.1.smithi190.stdout:8/934: readlink d1/d20/d3b/d34/dc0/l109 0 2023-12-06T15:00:36.052 INFO:tasks.workunit.client.0.smithi152.stdout:3/686: symlink d9/d10/d12/d43/d52/dc5/lcf 0 2023-12-06T15:00:36.052 INFO:tasks.workunit.client.0.smithi152.stdout:3/687: fsync d9/d10/d12/d43/d52/d58/da9/f3d 0 2023-12-06T15:00:36.053 INFO:tasks.workunit.client.0.smithi152.stdout:0/702: creat d8/d3e/d87/fea x:0 0 0 2023-12-06T15:00:36.058 INFO:tasks.workunit.client.0.smithi152.stdout:9/720: symlink d0/ld2 0 2023-12-06T15:00:36.058 INFO:tasks.workunit.client.0.smithi152.stdout:8/643: mkdir d1/d6/d29/d74/dd1 0 2023-12-06T15:00:36.058 INFO:tasks.workunit.client.0.smithi152.stdout:9/721: stat d0/d3f/d68/d6c/d20/d38/d44/dc4/d69 0 2023-12-06T15:00:36.059 INFO:tasks.workunit.client.0.smithi152.stdout:7/606: rename dd/df/d34/d44/d49/f71 to dd/d69/d89/fc0 0 2023-12-06T15:00:36.060 INFO:tasks.workunit.client.1.smithi190.stdout:8/935: dread d1/fb [0,4194304] 0 2023-12-06T15:00:36.060 INFO:tasks.workunit.client.0.smithi152.stdout:3/688: rmdir d9/d10/d12/d43/d52/dc5 39 2023-12-06T15:00:36.060 INFO:tasks.workunit.client.0.smithi152.stdout:3/689: write d9/d10/f2e [1401690,58197] 0 2023-12-06T15:00:36.062 INFO:tasks.workunit.client.0.smithi152.stdout:9/722: mknod d0/d3f/d5f/cd3 0 2023-12-06T15:00:36.062 INFO:tasks.workunit.client.0.smithi152.stdout:9/723: fsync d0/d3f/d68/d6c/d20/f29 0 2023-12-06T15:00:36.062 INFO:tasks.workunit.client.1.smithi190.stdout:8/936: rename d1/f16 to d1/d20/d3b/d4c/d5a/f11a 0 2023-12-06T15:00:36.062 INFO:tasks.workunit.client.0.smithi152.stdout:9/724: dread d0/d3f/d68/d6c/d20/d38/d45/f7b [0,4194304] 0 2023-12-06T15:00:36.063 INFO:tasks.workunit.client.0.smithi152.stdout:8/644: symlink d1/d6/d34/d35/d66/d82/ld2 0 2023-12-06T15:00:36.063 INFO:tasks.workunit.client.0.smithi152.stdout:8/645: getdents d1/d6/d29/d74/dd1 0 2023-12-06T15:00:36.064 INFO:tasks.workunit.client.0.smithi152.stdout:7/607: mknod dd/d17/cc1 0 2023-12-06T15:00:36.067 INFO:tasks.workunit.client.0.smithi152.stdout:3/690: stat d9/d18/d51/d8d/l70 0 2023-12-06T15:00:36.068 INFO:tasks.workunit.client.0.smithi152.stdout:9/725: creat d0/d3f/d68/d6c/d20/d4a/d71/fd4 x:0 0 0 2023-12-06T15:00:36.069 INFO:tasks.workunit.client.0.smithi152.stdout:8/646: symlink d1/d6/d34/d36/ld3 0 2023-12-06T15:00:36.069 INFO:tasks.workunit.client.0.smithi152.stdout:8/647: truncate d1/d6/d34/d3a/fc0 681178 0 2023-12-06T15:00:36.069 INFO:tasks.workunit.client.1.smithi190.stdout:8/937: write d1/d20/d3b/fb9 [4115154,64263] 0 2023-12-06T15:00:36.071 INFO:tasks.workunit.client.0.smithi152.stdout:7/608: mknod dd/df/d1b/d20/d7c/d86/cc2 0 2023-12-06T15:00:36.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:35 smithi190 ceph-mon[121340]: pgmap v29: 65 pgs: 65 active+clean; 3.4 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 237 MiB/s rd, 476 MiB/s wr, 743 op/s 2023-12-06T15:00:36.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:35 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:36.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:35 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:36.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:35 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-06T15:00:36.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:35 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-06T15:00:36.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:35 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-06T15:00:36.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:35 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:00:36.074 INFO:tasks.workunit.client.0.smithi152.stdout:9/726: creat d0/d3f/d68/d9f/fd5 x:0 0 0 2023-12-06T15:00:36.074 INFO:tasks.workunit.client.1.smithi190.stdout:5/890: dwrite d0/d1c/d2b/d2c/f45 [0,4194304] 0 2023-12-06T15:00:36.074 INFO:tasks.workunit.client.1.smithi190.stdout:5/891: truncate d0/d1c/ff4 381421 0 2023-12-06T15:00:36.075 INFO:tasks.workunit.client.0.smithi152.stdout:8/648: mkdir d1/d6/dd4 0 2023-12-06T15:00:36.078 INFO:tasks.workunit.client.0.smithi152.stdout:8/649: mkdir d1/d6/d34/d90/dd5 0 2023-12-06T15:00:36.080 INFO:tasks.workunit.client.1.smithi190.stdout:5/892: mkdir d0/d1c/d85/d133 0 2023-12-06T15:00:36.084 INFO:tasks.workunit.client.0.smithi152.stdout:8/650: mkdir d1/d6/d34/d35/dd6 0 2023-12-06T15:00:36.099 INFO:tasks.workunit.client.0.smithi152.stdout:8/651: dread d1/d6/fd [0,4194304] 0 2023-12-06T15:00:36.099 INFO:tasks.workunit.client.0.smithi152.stdout:8/652: chown d1/d6/d29/d87/fb0 13949730 1 2023-12-06T15:00:36.100 INFO:tasks.workunit.client.0.smithi152.stdout:1/996: sync 2023-12-06T15:00:36.100 INFO:tasks.workunit.client.0.smithi152.stdout:5/835: sync 2023-12-06T15:00:36.100 INFO:tasks.workunit.client.0.smithi152.stdout:2/652: sync 2023-12-06T15:00:36.100 INFO:tasks.workunit.client.0.smithi152.stdout:6/930: sync 2023-12-06T15:00:36.101 INFO:tasks.workunit.client.0.smithi152.stdout:2/653: fdatasync d6/d18/d70/fba 0 2023-12-06T15:00:36.101 INFO:tasks.workunit.client.0.smithi152.stdout:2/654: fsync d6/d1e/d41/d92/dbf/fce 0 2023-12-06T15:00:36.102 INFO:tasks.workunit.client.0.smithi152.stdout:5/836: unlink d7/dd/d26/d3b/d46/dc9/fdb 0 2023-12-06T15:00:36.102 INFO:tasks.workunit.client.0.smithi152.stdout:5/837: chown d7/d43/d9c/dfb 1384 1 2023-12-06T15:00:36.102 INFO:tasks.workunit.client.0.smithi152.stdout:6/931: symlink d1/dcf/ddc/d1a/d30/d36/d35/d49/da6/da9/l144 0 2023-12-06T15:00:36.103 INFO:tasks.workunit.client.0.smithi152.stdout:2/655: creat d6/d18/d43/db8/fd0 x:0 0 0 2023-12-06T15:00:36.104 INFO:tasks.workunit.client.0.smithi152.stdout:5/838: symlink d7/dd/d103/l127 0 2023-12-06T15:00:36.104 INFO:tasks.workunit.client.0.smithi152.stdout:6/932: truncate d1/d69/da1/d87/d15/f1d 13145061 0 2023-12-06T15:00:36.104 INFO:tasks.workunit.client.0.smithi152.stdout:6/933: write d1/dcf/ddc/d1a/d30/da4/ffb [426819,32815] 0 2023-12-06T15:00:36.106 INFO:tasks.workunit.client.0.smithi152.stdout:2/656: rename d6/db/f39 to d6/db/d17/fd1 0 2023-12-06T15:00:36.106 INFO:tasks.workunit.client.0.smithi152.stdout:5/839: creat d7/d43/d6c/dde/f128 x:0 0 0 2023-12-06T15:00:36.107 INFO:tasks.workunit.client.0.smithi152.stdout:2/657: dread - d6/db/d91/fcc zero size 2023-12-06T15:00:36.107 INFO:tasks.workunit.client.0.smithi152.stdout:2/658: chown d6/d1e/d41/d83/c98 23314641 1 2023-12-06T15:00:36.107 INFO:tasks.workunit.client.0.smithi152.stdout:2/659: write d6/db/f66 [1285192,31106] 0 2023-12-06T15:00:36.109 INFO:tasks.workunit.client.0.smithi152.stdout:5/840: rename d7/dd/d26/d3a/c106 to d7/dd/d26/df6/c129 0 2023-12-06T15:00:36.109 INFO:tasks.workunit.client.0.smithi152.stdout:5/841: chown d7/d43/d6c/dde/de3 1966 1 2023-12-06T15:00:36.112 INFO:tasks.workunit.client.0.smithi152.stdout:6/934: rename d1/dcf/ddc/d1a/d30/d138 to d1/dcf/ddc/d1a/d30/d18/d10c/d145 0 2023-12-06T15:00:36.112 INFO:tasks.workunit.client.0.smithi152.stdout:2/660: link d6/d1e/d41/d83/f93 d6/d18/d43/dc9/fd2 0 2023-12-06T15:00:36.121 INFO:tasks.workunit.client.0.smithi152.stdout:2/661: dread d6/d18/d43/db3/db7/fca [0,4194304] 0 2023-12-06T15:00:36.121 INFO:tasks.workunit.client.0.smithi152.stdout:2/662: dread - d6/d18/d43/f6d zero size 2023-12-06T15:00:36.121 INFO:tasks.workunit.client.0.smithi152.stdout:2/663: chown d6/db/d17 26026413 1 2023-12-06T15:00:36.122 INFO:tasks.workunit.client.0.smithi152.stdout:3/691: dwrite d9/d10/d12/f72 [0,4194304] 0 2023-12-06T15:00:36.126 INFO:tasks.workunit.client.0.smithi152.stdout:2/664: creat d6/d1e/d7a/fd3 x:0 0 0 2023-12-06T15:00:36.126 INFO:tasks.workunit.client.0.smithi152.stdout:2/665: chown d6/d1e/d41/d55/c38 16 1 2023-12-06T15:00:36.126 INFO:tasks.workunit.client.0.smithi152.stdout:2/666: stat d6/d1e/d7a 0 2023-12-06T15:00:36.126 INFO:tasks.workunit.client.0.smithi152.stdout:2/667: write d6/db/d17/fa6 [750628,96612] 0 2023-12-06T15:00:36.126 INFO:tasks.workunit.client.0.smithi152.stdout:2/668: write d6/fab [826623,32020] 0 2023-12-06T15:00:36.128 INFO:tasks.workunit.client.0.smithi152.stdout:3/692: truncate d9/ff 881179 0 2023-12-06T15:00:36.130 INFO:tasks.workunit.client.0.smithi152.stdout:2/669: mknod d6/d18/d70/cd4 0 2023-12-06T15:00:36.130 INFO:tasks.workunit.client.0.smithi152.stdout:2/670: dread - d6/d1e/d41/d83/f99 zero size 2023-12-06T15:00:36.130 INFO:tasks.workunit.client.0.smithi152.stdout:2/671: write d6/d18/f32 [1036666,64973] 0 2023-12-06T15:00:36.131 INFO:tasks.workunit.client.0.smithi152.stdout:3/693: symlink d9/d18/d51/d8d/d8f/ld0 0 2023-12-06T15:00:36.131 INFO:tasks.workunit.client.0.smithi152.stdout:7/609: dwrite dd/df/d34/d44/d49/f54 [0,4194304] 0 2023-12-06T15:00:36.132 INFO:tasks.workunit.client.1.smithi190.stdout:8/938: dwrite d1/d20/d3b/f2d [0,4194304] 0 2023-12-06T15:00:36.132 INFO:tasks.workunit.client.0.smithi152.stdout:9/727: dwrite d0/d3f/d68/d6c/d20/d38/f3d [0,4194304] 0 2023-12-06T15:00:36.133 INFO:tasks.workunit.client.1.smithi190.stdout:8/939: creat d1/d20/f11b x:0 0 0 2023-12-06T15:00:36.134 INFO:tasks.workunit.client.0.smithi152.stdout:2/672: truncate d6/db/d17/fd1 2093834 0 2023-12-06T15:00:36.134 INFO:tasks.workunit.client.0.smithi152.stdout:3/694: creat d9/d10/d12/d43/d52/d58/da9/fd1 x:0 0 0 2023-12-06T15:00:36.135 INFO:tasks.workunit.client.1.smithi190.stdout:8/940: unlink d1/f1b 0 2023-12-06T15:00:36.136 INFO:tasks.workunit.client.0.smithi152.stdout:7/610: getdents dd/df/d34/d95 0 2023-12-06T15:00:36.136 INFO:tasks.workunit.client.0.smithi152.stdout:7/611: write dd/df/d34/d44/d49/d73/d77/fbe [293148,35830] 0 2023-12-06T15:00:36.136 INFO:tasks.workunit.client.0.smithi152.stdout:2/673: dread d6/db/f8a [0,4194304] 0 2023-12-06T15:00:36.136 INFO:tasks.workunit.client.0.smithi152.stdout:2/674: write d6/d1e/d41/d83/fc5 [33327,28463] 0 2023-12-06T15:00:36.146 INFO:tasks.workunit.client.0.smithi152.stdout:3/695: truncate d9/d10/f28 4024575 0 2023-12-06T15:00:36.151 INFO:tasks.workunit.client.0.smithi152.stdout:3/696: creat d9/d10/fd2 x:0 0 0 2023-12-06T15:00:36.154 INFO:tasks.workunit.client.0.smithi152.stdout:7/612: rename dd/d17 to dd/df/d1b/d20/d28/d38/dc3 0 2023-12-06T15:00:36.155 INFO:tasks.workunit.client.0.smithi152.stdout:8/653: dwrite d1/d6/d34/d36/f55 [0,4194304] 0 2023-12-06T15:00:36.155 INFO:tasks.workunit.client.0.smithi152.stdout:1/997: dwrite d3/da/db/fbc [0,4194304] 0 2023-12-06T15:00:36.156 INFO:tasks.workunit.client.0.smithi152.stdout:3/697: rmdir d9/d10/d12/d43/d52/d58/dc2 0 2023-12-06T15:00:36.159 INFO:tasks.workunit.client.0.smithi152.stdout:2/675: rename d6/fab to d6/d18/d43/db3/fd5 0 2023-12-06T15:00:36.160 INFO:tasks.workunit.client.0.smithi152.stdout:7/613: chown dd/df/d1b/d20/d28/d38/c51 1220069391 1 2023-12-06T15:00:36.162 INFO:tasks.workunit.client.0.smithi152.stdout:8/654: truncate d1/d6/f1b 3687250 0 2023-12-06T15:00:36.162 INFO:tasks.workunit.client.0.smithi152.stdout:8/655: write d1/d6/d34/d40/f7a [334101,105559] 0 2023-12-06T15:00:36.162 INFO:tasks.workunit.client.0.smithi152.stdout:8/656: readlink d1/d6/d29/d75/l95 0 2023-12-06T15:00:36.164 INFO:tasks.workunit.client.0.smithi152.stdout:3/698: rmdir d9/d18/d51/d8d/d8f/da0/dab/dc3/db5 0 2023-12-06T15:00:36.164 INFO:tasks.workunit.client.0.smithi152.stdout:3/699: write d9/d45/fcb [321183,25071] 0 2023-12-06T15:00:36.164 INFO:tasks.workunit.client.0.smithi152.stdout:7/614: creat dd/df/d1b/d20/d7c/d86/da4/fc4 x:0 0 0 2023-12-06T15:00:36.165 INFO:tasks.workunit.client.0.smithi152.stdout:8/657: rename d1/d6/d34/d36/f4f to d1/d6/d29/fd7 0 2023-12-06T15:00:36.166 INFO:tasks.workunit.client.0.smithi152.stdout:3/700: mkdir d9/d18/d51/d8d/d8f/da0/dab/dc3/d9f/dad/dd3 0 2023-12-06T15:00:36.166 INFO:tasks.workunit.client.0.smithi152.stdout:8/658: mkdir d1/d6/d34/d40/dd8 0 2023-12-06T15:00:36.168 INFO:tasks.workunit.client.0.smithi152.stdout:8/659: unlink d1/ca6 0 2023-12-06T15:00:36.168 INFO:tasks.workunit.client.0.smithi152.stdout:8/660: fdatasync d1/d6/d34/d35/d66/f71 0 2023-12-06T15:00:36.170 INFO:tasks.workunit.client.0.smithi152.stdout:7/615: write dd/df/d1b/d20/d28/d38/f56 [514914,23009] 0 2023-12-06T15:00:36.172 INFO:tasks.workunit.client.0.smithi152.stdout:6/935: dwrite d1/dcf/ddc/d1a/d30/d18/f124 [0,4194304] 0 2023-12-06T15:00:36.172 INFO:tasks.workunit.client.0.smithi152.stdout:8/661: write d1/d6/d34/d35/d66/faf [1892552,129880] 0 2023-12-06T15:00:36.173 INFO:tasks.workunit.client.0.smithi152.stdout:8/662: stat d1/d6/d34/d6f 0 2023-12-06T15:00:36.173 INFO:tasks.workunit.client.0.smithi152.stdout:8/663: chown d1/d6/d34/d36/f79 84393 1 2023-12-06T15:00:36.173 INFO:tasks.workunit.client.0.smithi152.stdout:8/664: chown d1/d6/d34/d35/d66/d82/db6/cbb 188 1 2023-12-06T15:00:36.177 INFO:tasks.workunit.client.0.smithi152.stdout:1/998: dread d3/da/d15/d17/d58/f64 [0,4194304] 0 2023-12-06T15:00:36.182 INFO:tasks.workunit.client.0.smithi152.stdout:1/999: mknod d3/da/d15/c168 0 2023-12-06T15:00:36.190 INFO:tasks.workunit.client.0.smithi152.stdout:5/842: dwrite d7/f28 [4194304,4194304] 0 2023-12-06T15:00:36.192 INFO:tasks.workunit.client.0.smithi152.stdout:5/843: rename d7/dd/d26/df6 to d7/dd/d26/d87/d12a 0 2023-12-06T15:00:36.193 INFO:tasks.workunit.client.0.smithi152.stdout:5/844: creat d7/d47/f12b x:0 0 0 2023-12-06T15:00:36.194 INFO:tasks.workunit.client.0.smithi152.stdout:5/845: write d7/f15 [454874,126501] 0 2023-12-06T15:00:36.198 INFO:tasks.workunit.client.0.smithi152.stdout:9/728: dwrite d0/d3f/d68/d9f/fd0 [0,4194304] 0 2023-12-06T15:00:36.207 INFO:tasks.workunit.client.0.smithi152.stdout:9/729: dread d0/d3f/d68/d6c/d20/f51 [0,4194304] 0 2023-12-06T15:00:36.208 INFO:tasks.workunit.client.0.smithi152.stdout:9/730: mkdir d0/d3f/d68/d6c/d20/d38/d44/dd6 0 2023-12-06T15:00:36.208 INFO:tasks.workunit.client.0.smithi152.stdout:9/731: fsync d0/d3f/d68/d6c/d92/fcc 0 2023-12-06T15:00:36.209 INFO:tasks.workunit.client.0.smithi152.stdout:9/732: creat d0/d3f/d68/d6c/d20/d38/d44/fd7 x:0 0 0 2023-12-06T15:00:36.209 INFO:tasks.workunit.client.0.smithi152.stdout:9/733: truncate d0/d3f/d68/d6c/d20/d38/d44/f77 1658754 0 2023-12-06T15:00:36.235 INFO:tasks.workunit.client.0.smithi152.stdout:2/676: dwrite d6/d1e/d7a/f7b [4194304,4194304] 0 2023-12-06T15:00:36.235 INFO:tasks.workunit.client.1.smithi190.stdout:8/941: dwrite d1/d20/d3b/d4c/d8e/ff7 [0,4194304] 0 2023-12-06T15:00:36.235 INFO:tasks.workunit.client.1.smithi190.stdout:8/942: dread - d1/d20/d3b/d34/fff zero size 2023-12-06T15:00:36.235 INFO:tasks.workunit.client.1.smithi190.stdout:8/943: dread - d1/d20/d3b/d7e/fa8 zero size 2023-12-06T15:00:36.236 INFO:tasks.workunit.client.0.smithi152.stdout:2/677: link d6/c12 d6/d1e/d41/d92/cd6 0 2023-12-06T15:00:36.236 INFO:tasks.workunit.client.0.smithi152.stdout:2/678: write d6/d1e/d41/d83/f99 [499304,95934] 0 2023-12-06T15:00:36.237 INFO:tasks.workunit.client.1.smithi190.stdout:8/944: creat d1/d20/d3b/d4c/d8e/f11c x:0 0 0 2023-12-06T15:00:36.238 INFO:tasks.workunit.client.1.smithi190.stdout:8/945: mknod d1/dd1/c11d 0 2023-12-06T15:00:36.238 INFO:tasks.workunit.client.1.smithi190.stdout:8/946: write d1/d20/d3b/d4c/d8e/f11c [449181,79077] 0 2023-12-06T15:00:36.238 INFO:tasks.workunit.client.1.smithi190.stdout:8/947: stat d1/dd1/d10b/d87/f10a 0 2023-12-06T15:00:36.239 INFO:tasks.workunit.client.1.smithi190.stdout:8/948: creat d1/d37/dc9/f11e x:0 0 0 2023-12-06T15:00:36.239 INFO:tasks.workunit.client.1.smithi190.stdout:8/949: dread - d1/d20/d3b/d4c/d59/daa/fc6 zero size 2023-12-06T15:00:36.239 INFO:tasks.workunit.client.1.smithi190.stdout:8/950: write d1/d20/d3b/d4c/d8e/d94/d25/f2a [4343387,129285] 0 2023-12-06T15:00:36.240 INFO:tasks.workunit.client.1.smithi190.stdout:8/951: mkdir d1/d20/d3b/d7e/dd0/d11f 0 2023-12-06T15:00:36.241 INFO:tasks.workunit.client.1.smithi190.stdout:8/952: mknod d1/d20/d3b/d36/d105/c120 0 2023-12-06T15:00:36.250 INFO:tasks.workunit.client.1.smithi190.stdout:8/953: dread d1/d20/d3b/d4c/d8e/fac [0,4194304] 0 2023-12-06T15:00:36.251 INFO:tasks.workunit.client.1.smithi190.stdout:8/954: dread d1/d20/d3b/d4c/d8e/d94/db6/fed [0,4194304] 0 2023-12-06T15:00:36.252 INFO:tasks.workunit.client.1.smithi190.stdout:8/955: rmdir d1/d20/d3b/d4c/d5a 39 2023-12-06T15:00:36.252 INFO:tasks.workunit.client.1.smithi190.stdout:8/956: rmdir d1/d20/d3b/d36/d50 39 2023-12-06T15:00:36.253 INFO:tasks.workunit.client.1.smithi190.stdout:8/957: creat d1/dd1/d10b/f121 x:0 0 0 2023-12-06T15:00:36.256 INFO:tasks.workunit.client.1.smithi190.stdout:8/958: unlink d1/dd1/d10b/f57 0 2023-12-06T15:00:36.256 INFO:tasks.workunit.client.1.smithi190.stdout:8/959: fsync d1/d20/f8b 0 2023-12-06T15:00:36.257 INFO:tasks.workunit.client.1.smithi190.stdout:8/960: dread d1/d20/d3b/d4c/d8e/d94/db6/fed [0,4194304] 0 2023-12-06T15:00:36.258 INFO:tasks.workunit.client.1.smithi190.stdout:8/961: creat d1/d20/d3b/d4c/d8e/f122 x:0 0 0 2023-12-06T15:00:36.258 INFO:tasks.workunit.client.0.smithi152.stdout:2/679: dread d6/d1e/d41/f60 [0,4194304] 0 2023-12-06T15:00:36.259 INFO:tasks.workunit.client.0.smithi152.stdout:2/680: symlink d6/d1e/d41/ld7 0 2023-12-06T15:00:36.260 INFO:tasks.workunit.client.0.smithi152.stdout:2/681: creat d6/d18/d43/fd8 x:0 0 0 2023-12-06T15:00:36.261 INFO:tasks.workunit.client.0.smithi152.stdout:2/682: truncate d6/d18/d43/f50 5802817 0 2023-12-06T15:00:36.267 INFO:tasks.workunit.client.1.smithi190.stdout:2/935: sync 2023-12-06T15:00:36.267 INFO:tasks.workunit.client.1.smithi190.stdout:4/896: sync 2023-12-06T15:00:36.267 INFO:tasks.workunit.client.1.smithi190.stdout:0/942: sync 2023-12-06T15:00:36.267 INFO:tasks.workunit.client.1.smithi190.stdout:0/943: write d0/da/d74/da2/f10b [631733,92831] 0 2023-12-06T15:00:36.268 INFO:tasks.workunit.client.0.smithi152.stdout:3/701: dwrite d9/d10/d12/d43/d52/db4/fbf [0,4194304] 0 2023-12-06T15:00:36.268 INFO:tasks.workunit.client.0.smithi152.stdout:3/702: chown d9/d10/d12/d43/d52/db4/d65/lb3 6 1 2023-12-06T15:00:36.269 INFO:tasks.workunit.client.1.smithi190.stdout:4/897: mknod d3/d35/d19/d67/db5/d12a/c138 0 2023-12-06T15:00:36.269 INFO:tasks.workunit.client.1.smithi190.stdout:0/944: read d0/da/da4/db1/fc3 [3913427,65037] 0 2023-12-06T15:00:36.271 INFO:tasks.workunit.client.1.smithi190.stdout:4/898: creat d3/d76/dc4/dc5/d3c/d116/f139 x:0 0 0 2023-12-06T15:00:36.273 INFO:tasks.workunit.client.1.smithi190.stdout:4/899: mkdir d3/d76/dc4/dc5/d3c/d116/d15/d12b/d13a 0 2023-12-06T15:00:36.275 INFO:tasks.workunit.client.0.smithi152.stdout:7/616: dwrite dd/df/d1b/d20/d28/f68 [0,4194304] 0 2023-12-06T15:00:36.275 INFO:tasks.workunit.client.0.smithi152.stdout:8/665: dwrite d1/d6/d34/d40/f9f [0,4194304] 0 2023-12-06T15:00:36.275 INFO:tasks.workunit.client.0.smithi152.stdout:5/846: dwrite d7/dd/d26/d48/d97/dc2/fd3 [0,4194304] 0 2023-12-06T15:00:36.275 INFO:tasks.workunit.client.0.smithi152.stdout:9/734: dwrite d0/d3f/d68/d6c/d20/d38/d44/dc4/fa6 [0,4194304] 0 2023-12-06T15:00:36.276 INFO:tasks.workunit.client.1.smithi190.stdout:3/998: sync 2023-12-06T15:00:36.278 INFO:tasks.workunit.client.1.smithi190.stdout:4/900: creat d3/d76/dc4/dc5/d3c/d116/d39/dc8/f13b x:0 0 0 2023-12-06T15:00:36.279 INFO:tasks.workunit.client.1.smithi190.stdout:5/893: sync 2023-12-06T15:00:36.284 INFO:tasks.workunit.client.0.smithi152.stdout:5/847: rename d7/d43/d6c/d98 to d7/d12c 0 2023-12-06T15:00:36.284 INFO:tasks.workunit.client.0.smithi152.stdout:5/848: write d7/dd/d26/d48/f85 [4488569,85816] 0 2023-12-06T15:00:36.289 INFO:tasks.workunit.client.1.smithi190.stdout:4/901: mknod d3/d35/d19/d41/d44/d11d/d129/c13c 0 2023-12-06T15:00:36.294 INFO:tasks.workunit.client.1.smithi190.stdout:4/902: symlink d3/d76/dc4/dc5/l13d 0 2023-12-06T15:00:36.294 INFO:tasks.workunit.client.0.smithi152.stdout:7/617: write dd/f2f [4152321,8031] 0 2023-12-06T15:00:36.294 INFO:tasks.workunit.client.1.smithi190.stdout:3/999: dread d4/d1b/d54/d9c/d68/d8a/ffb [0,4194304] 0 2023-12-06T15:00:36.295 INFO:tasks.workunit.client.0.smithi152.stdout:9/735: rename d0/d3f/d5f/fa3 to d0/d3f/d68/d6c/d20/db0/d94/fd8 0 2023-12-06T15:00:36.298 INFO:tasks.workunit.client.0.smithi152.stdout:5/849: unlink d7/dd/d26/d3a/f7b 0 2023-12-06T15:00:36.300 INFO:tasks.workunit.client.0.smithi152.stdout:7/618: symlink dd/df/d1b/d20/d7c/db7/lc5 0 2023-12-06T15:00:36.302 INFO:tasks.workunit.client.0.smithi152.stdout:9/736: symlink d0/d3f/d68/d6c/d20/d38/d44/ld9 0 2023-12-06T15:00:36.302 INFO:tasks.workunit.client.0.smithi152.stdout:9/737: chown d0/d3f/d68/d6c/d20/db0/db3 21238 1 2023-12-06T15:00:36.303 INFO:tasks.workunit.client.0.smithi152.stdout:5/850: creat d7/d12c/dc8/f12d x:0 0 0 2023-12-06T15:00:36.303 INFO:tasks.workunit.client.0.smithi152.stdout:5/851: fdatasync d7/f21 0 2023-12-06T15:00:36.305 INFO:tasks.workunit.client.0.smithi152.stdout:5/852: creat d7/dd/d26/d3b/d46/f12e x:0 0 0 2023-12-06T15:00:36.305 INFO:tasks.workunit.client.0.smithi152.stdout:5/853: fdatasync d7/dd/d26/d87/d100/f115 0 2023-12-06T15:00:36.305 INFO:tasks.workunit.client.0.smithi152.stdout:5/854: fdatasync d7/d47/f74 0 2023-12-06T15:00:36.306 INFO:tasks.workunit.client.0.smithi152.stdout:5/855: getdents d7/dd/d26/d87/dbd 0 2023-12-06T15:00:36.306 INFO:tasks.workunit.client.0.smithi152.stdout:5/856: write d7/d12c/fa8 [948495,51585] 0 2023-12-06T15:00:36.307 INFO:tasks.workunit.client.0.smithi152.stdout:5/857: unlink d7/dd/f35 0 2023-12-06T15:00:36.312 INFO:tasks.workunit.client.0.smithi152.stdout:3/703: dwrite d9/d45/fcb [0,4194304] 0 2023-12-06T15:00:36.313 INFO:tasks.workunit.client.0.smithi152.stdout:7/619: dread dd/df/d34/d44/f5a [0,4194304] 0 2023-12-06T15:00:36.316 INFO:tasks.workunit.client.0.smithi152.stdout:3/704: read d9/d18/f6b [4103987,115671] 0 2023-12-06T15:00:36.317 INFO:tasks.workunit.client.0.smithi152.stdout:3/705: creat d9/d10/d12/fd4 x:0 0 0 2023-12-06T15:00:36.322 INFO:tasks.workunit.client.0.smithi152.stdout:3/706: mkdir d9/d18/d51/d8d/d8f/da0/dab/dc3/d91/dd5 0 2023-12-06T15:00:36.322 INFO:tasks.workunit.client.0.smithi152.stdout:3/707: readlink d9/d18/d51/d8d/l56 0 2023-12-06T15:00:36.323 INFO:tasks.workunit.client.0.smithi152.stdout:3/708: symlink d9/d10/d12/d43/d52/db4/d65/ld6 0 2023-12-06T15:00:36.323 INFO:tasks.workunit.client.0.smithi152.stdout:3/709: symlink d9/d18/d51/ld7 0 2023-12-06T15:00:36.324 INFO:tasks.workunit.client.0.smithi152.stdout:3/710: symlink d9/d18/ld8 0 2023-12-06T15:00:36.325 INFO:tasks.workunit.client.0.smithi152.stdout:3/711: getdents d9/d18/d51/d8d/d8f 0 2023-12-06T15:00:36.325 INFO:tasks.workunit.client.0.smithi152.stdout:3/712: readlink d9/d10/d12/lcc 0 2023-12-06T15:00:36.326 INFO:tasks.workunit.client.0.smithi152.stdout:3/713: creat d9/d10/d12/d43/d52/db4/fd9 x:0 0 0 2023-12-06T15:00:36.326 INFO:tasks.workunit.client.0.smithi152.stdout:3/714: read d9/d10/d12/d43/d52/db4/d65/f79 [214463,49712] 0 2023-12-06T15:00:36.326 INFO:tasks.workunit.client.0.smithi152.stdout:3/715: dread - d9/d10/d12/d43/d52/db4/fc4 zero size 2023-12-06T15:00:36.326 INFO:tasks.workunit.client.0.smithi152.stdout:3/716: creat d9/d10/d12/d43/d52/db4/dc1/fda x:0 0 0 2023-12-06T15:00:36.328 INFO:tasks.workunit.client.0.smithi152.stdout:3/717: link d9/d10/d12/d43/d52/db4/l29 d9/d18/d51/d8d/ldb 0 2023-12-06T15:00:36.329 INFO:tasks.workunit.client.0.smithi152.stdout:3/718: rename d9/d10/d12/d43/d52/c84 to d9/d18/d51/d8d/d8f/da0/dab/dc3/d9f/dad/dd3/cdc 0 2023-12-06T15:00:36.330 INFO:tasks.workunit.client.0.smithi152.stdout:3/719: mknod d9/d18/d51/d8d/d8f/da0/dab/dc3/d9f/cdd 0 2023-12-06T15:00:36.339 INFO:tasks.workunit.client.1.smithi190.stdout:0/945: dwrite d0/da/da4/db1/fc3 [0,4194304] 0 2023-12-06T15:00:36.347 INFO:tasks.workunit.client.1.smithi190.stdout:0/946: dread d0/da/d3e/d3a/d40/f5e [0,4194304] 0 2023-12-06T15:00:36.349 INFO:tasks.workunit.client.1.smithi190.stdout:0/947: mkdir d0/da/d3e/d2b/d3c/d46/d8e/d90/d13c 0 2023-12-06T15:00:36.349 INFO:tasks.workunit.client.1.smithi190.stdout:0/948: chown d0/da/db7 148 1 2023-12-06T15:00:36.350 INFO:tasks.workunit.client.1.smithi190.stdout:5/894: dwrite d0/d1c/d3e/f76 [0,4194304] 0 2023-12-06T15:00:36.353 INFO:tasks.workunit.client.0.smithi152.stdout:8/666: dwrite d1/d6/d34/d35/d38/f4e [0,4194304] 0 2023-12-06T15:00:36.353 INFO:tasks.workunit.client.0.smithi152.stdout:8/667: stat d1/c2f 0 2023-12-06T15:00:36.354 INFO:tasks.workunit.client.0.smithi152.stdout:8/668: creat d1/d6/d34/d90/dd5/fd9 x:0 0 0 2023-12-06T15:00:36.354 INFO:tasks.workunit.client.0.smithi152.stdout:8/669: dread - d1/d6/d29/d75/fcc zero size 2023-12-06T15:00:36.356 INFO:tasks.workunit.client.0.smithi152.stdout:8/670: unlink d1/d6/d86/c8c 0 2023-12-06T15:00:36.356 INFO:tasks.workunit.client.0.smithi152.stdout:8/671: dread - d1/d6/d29/d5b/fb1 zero size 2023-12-06T15:00:36.356 INFO:tasks.workunit.client.0.smithi152.stdout:8/672: write d1/d6/d34/d40/f78 [1099669,129761] 0 2023-12-06T15:00:36.368 INFO:tasks.workunit.client.0.smithi152.stdout:5/858: dwrite d7/d47/f74 [4194304,4194304] 0 2023-12-06T15:00:36.368 INFO:tasks.workunit.client.1.smithi190.stdout:2/936: dwrite d10/d26/d5c/f33 [0,4194304] 0 2023-12-06T15:00:36.370 INFO:tasks.workunit.client.1.smithi190.stdout:2/937: mknod d10/d26/d5c/d37/c13c 0 2023-12-06T15:00:36.371 INFO:tasks.workunit.client.0.smithi152.stdout:8/673: dread d1/d6/d34/d36/f5d [0,4194304] 0 2023-12-06T15:00:36.373 INFO:tasks.workunit.client.0.smithi152.stdout:3/720: dwrite d9/d10/d12/d43/d52/d58/da9/fd1 [0,4194304] 0 2023-12-06T15:00:36.373 INFO:tasks.workunit.client.1.smithi190.stdout:2/938: link d10/d26/d5c/d35/l5f d10/d59/dcd/dad/d10a/l13d 0 2023-12-06T15:00:36.377 INFO:tasks.workunit.client.0.smithi152.stdout:7/620: dwrite dd/df/d78/f81 [0,4194304] 0 2023-12-06T15:00:36.378 INFO:tasks.workunit.client.0.smithi152.stdout:7/621: getdents dd/df/d34 0 2023-12-06T15:00:36.402 INFO:tasks.workunit.client.0.smithi152.stdout:5/859: dwrite d7/d43/d9c/f101 [0,4194304] 0 2023-12-06T15:00:36.402 INFO:tasks.workunit.client.0.smithi152.stdout:5/860: fdatasync d7/f28 0 2023-12-06T15:00:36.402 INFO:tasks.workunit.client.0.smithi152.stdout:5/861: fsync d7/dd/d26/d48/dbb/fda 0 2023-12-06T15:00:36.402 INFO:tasks.workunit.client.0.smithi152.stdout:3/721: dwrite d9/d10/f2a [0,4194304] 0 2023-12-06T15:00:36.402 INFO:tasks.workunit.client.0.smithi152.stdout:3/722: fdatasync d9/d18/d39/f8a 0 2023-12-06T15:00:36.402 INFO:tasks.workunit.client.0.smithi152.stdout:3/723: truncate d9/d10/d12/d43/f8b 4404311 0 2023-12-06T15:00:36.402 INFO:tasks.workunit.client.0.smithi152.stdout:3/724: dread - d9/d10/f94 zero size 2023-12-06T15:00:36.402 INFO:tasks.workunit.client.0.smithi152.stdout:3/725: chown d9/d45 473 1 2023-12-06T15:00:36.403 INFO:tasks.workunit.client.0.smithi152.stdout:3/726: chown d9/d18/d51/d8d/d8f/da0/dab/dc3/d91/dd5 9394 1 2023-12-06T15:00:36.414 INFO:tasks.workunit.client.0.smithi152.stdout:5/862: dread d7/dd/d26/d48/f85 [0,4194304] 0 2023-12-06T15:00:36.421 INFO:tasks.workunit.client.0.smithi152.stdout:3/727: dwrite d9/d18/fae [0,4194304] 0 2023-12-06T15:00:36.424 INFO:tasks.workunit.client.0.smithi152.stdout:3/728: creat d9/d18/d51/d8d/d8f/da0/dab/dc3/d91/dd5/fde x:0 0 0 2023-12-06T15:00:36.425 INFO:tasks.workunit.client.0.smithi152.stdout:3/729: creat d9/d18/d51/d8d/d8f/fdf x:0 0 0 2023-12-06T15:00:36.426 INFO:tasks.workunit.client.0.smithi152.stdout:3/730: link d9/fa3 d9/fe0 0 2023-12-06T15:00:36.433 INFO:tasks.workunit.client.0.smithi152.stdout:5/863: dwrite d7/d12c/dc8/f12d [0,4194304] 0 2023-12-06T15:00:36.435 INFO:tasks.workunit.client.0.smithi152.stdout:5/864: symlink d7/dd/d26/l12f 0 2023-12-06T15:00:36.437 INFO:tasks.workunit.client.0.smithi152.stdout:5/865: dread d7/d43/d6c/faf [0,4194304] 0 2023-12-06T15:00:36.437 INFO:tasks.workunit.client.0.smithi152.stdout:5/866: write d7/d43/d9c/dfb/f73 [641406,112463] 0 2023-12-06T15:00:36.438 INFO:tasks.workunit.client.0.smithi152.stdout:5/867: rmdir d7/dd/d26/d3b 39 2023-12-06T15:00:36.438 INFO:tasks.workunit.client.0.smithi152.stdout:3/731: dread d9/d10/d12/d43/d52/d58/da9/f3d [0,4194304] 0 2023-12-06T15:00:36.439 INFO:tasks.workunit.client.0.smithi152.stdout:5/868: rmdir d7/dd/d26/db1 39 2023-12-06T15:00:36.439 INFO:tasks.workunit.client.0.smithi152.stdout:5/869: chown d7/dd/d26/d48/fc1 2038 1 2023-12-06T15:00:36.440 INFO:tasks.workunit.client.0.smithi152.stdout:5/870: mkdir d7/d43/d6c/da4/d130 0 2023-12-06T15:00:36.447 INFO:tasks.workunit.client.0.smithi152.stdout:5/871: dread d7/d12c/fa8 [0,4194304] 0 2023-12-06T15:00:36.447 INFO:tasks.workunit.client.0.smithi152.stdout:5/872: stat d7/d43/f8e 0 2023-12-06T15:00:36.448 INFO:tasks.workunit.client.0.smithi152.stdout:5/873: rmdir d7/dd/d26/d87/d12a 39 2023-12-06T15:00:36.448 INFO:tasks.workunit.client.0.smithi152.stdout:5/874: fsync d7/dd/f67 0 2023-12-06T15:00:36.448 INFO:tasks.workunit.client.0.smithi152.stdout:5/875: creat d7/dd/d26/f131 x:0 0 0 2023-12-06T15:00:36.449 INFO:tasks.workunit.client.0.smithi152.stdout:5/876: mkdir d7/dd/d26/d87/d12a/d132 0 2023-12-06T15:00:36.454 INFO:tasks.workunit.client.0.smithi152.stdout:0/703: sync 2023-12-06T15:00:36.455 INFO:tasks.workunit.client.0.smithi152.stdout:0/704: creat d8/d15/d45/d73/feb x:0 0 0 2023-12-06T15:00:36.456 INFO:tasks.workunit.client.1.smithi190.stdout:2/939: mknod d10/d26/d5c/d35/d77/d98/dfe/d106/c13e 0 2023-12-06T15:00:36.456 INFO:tasks.workunit.client.0.smithi152.stdout:0/705: mknod d8/d15/d45/d73/cec 0 2023-12-06T15:00:36.457 INFO:tasks.workunit.client.0.smithi152.stdout:0/706: chown d8/f37 17520531 1 2023-12-06T15:00:36.458 INFO:tasks.workunit.client.0.smithi152.stdout:0/707: rename d8/d3e/d87/faf to d8/d15/d45/d83/fed 0 2023-12-06T15:00:36.460 INFO:tasks.workunit.client.0.smithi152.stdout:0/708: unlink d8/d3e/d87/f8b 0 2023-12-06T15:00:36.472 INFO:tasks.workunit.client.1.smithi190.stdout:2/940: dread d10/d26/d5c/d49/d54/fc2 [0,4194304] 0 2023-12-06T15:00:36.473 INFO:tasks.workunit.client.0.smithi152.stdout:3/732: dwrite d9/d18/d51/f54 [0,4194304] 0 2023-12-06T15:00:36.474 INFO:tasks.workunit.client.1.smithi190.stdout:2/941: link c0 d10/d26/d5c/d42/dfd/c13f 0 2023-12-06T15:00:36.476 INFO:tasks.workunit.client.1.smithi190.stdout:2/942: unlink c0 0 2023-12-06T15:00:36.477 INFO:tasks.workunit.client.0.smithi152.stdout:5/877: dwrite d7/d47/fa0 [0,4194304] 0 2023-12-06T15:00:36.477 INFO:tasks.workunit.client.0.smithi152.stdout:0/709: dwrite d8/d4b/f51 [0,4194304] 0 2023-12-06T15:00:36.478 INFO:tasks.workunit.client.1.smithi190.stdout:2/943: rename d10/d59/dcd/dad/df6 to d10/d26/d5c/d42/d140 0 2023-12-06T15:00:36.479 INFO:tasks.workunit.client.1.smithi190.stdout:2/944: readlink d10/d59/lba 0 2023-12-06T15:00:36.480 INFO:tasks.workunit.client.1.smithi190.stdout:2/945: getdents d10/d59/dcd/dad/dc4/d7f 0 2023-12-06T15:00:36.480 INFO:tasks.workunit.client.1.smithi190.stdout:2/946: dread - d10/d59/dcd/dad/dc4/d7f/f134 zero size 2023-12-06T15:00:36.484 INFO:tasks.workunit.client.0.smithi152.stdout:0/710: creat d8/d3e/d87/d76/d6e/fee x:0 0 0 2023-12-06T15:00:36.484 INFO:tasks.workunit.client.0.smithi152.stdout:0/711: chown d8/c1c 12576025 1 2023-12-06T15:00:36.486 INFO:tasks.workunit.client.1.smithi190.stdout:2/947: creat d10/d59/dcd/dad/dc4/d7f/f141 x:0 0 0 2023-12-06T15:00:36.487 INFO:tasks.workunit.client.1.smithi190.stdout:0/949: sync 2023-12-06T15:00:36.487 INFO:tasks.workunit.client.1.smithi190.stdout:8/962: sync 2023-12-06T15:00:36.487 INFO:tasks.workunit.client.1.smithi190.stdout:4/903: sync 2023-12-06T15:00:36.490 INFO:tasks.workunit.client.1.smithi190.stdout:2/948: truncate d10/d26/d5c/d37/d83/fa0 47936 0 2023-12-06T15:00:36.492 INFO:tasks.workunit.client.1.smithi190.stdout:0/950: unlink d0/da/d3e/d3a/d40/d6f/d9e/cd0 0 2023-12-06T15:00:36.494 INFO:tasks.workunit.client.1.smithi190.stdout:4/904: rename d3/d35/d19/d67/db5/c10b to d3/d35/d19/d41/d44/d9c/d72/c13e 0 2023-12-06T15:00:36.494 INFO:tasks.workunit.client.1.smithi190.stdout:4/905: dread - d3/d35/d19/d41/d44/d11d/de4/fce zero size 2023-12-06T15:00:36.495 INFO:tasks.workunit.client.0.smithi152.stdout:0/712: write d8/d15/d45/da4/fbc [552897,10845] 0 2023-12-06T15:00:36.496 INFO:tasks.workunit.client.0.smithi152.stdout:0/713: stat d8/d44/f91 0 2023-12-06T15:00:36.496 INFO:tasks.workunit.client.0.smithi152.stdout:0/714: readlink d8/d3e/lc7 0 2023-12-06T15:00:36.496 INFO:tasks.workunit.client.0.smithi152.stdout:0/715: unlink d8/d15/f2e 0 2023-12-06T15:00:36.498 INFO:tasks.workunit.client.1.smithi190.stdout:2/949: creat d10/d59/dcd/dde/f142 x:0 0 0 2023-12-06T15:00:36.499 INFO:tasks.workunit.client.1.smithi190.stdout:0/951: rmdir d0/da/d5a/d80 39 2023-12-06T15:00:36.500 INFO:tasks.workunit.client.1.smithi190.stdout:4/906: mkdir d3/d76/dc4/dc5/d13f 0 2023-12-06T15:00:36.501 INFO:tasks.workunit.client.1.smithi190.stdout:0/952: symlink d0/da/d74/da2/l13d 0 2023-12-06T15:00:36.502 INFO:tasks.workunit.client.1.smithi190.stdout:4/907: truncate d3/f9 1415506 0 2023-12-06T15:00:36.503 INFO:tasks.workunit.client.1.smithi190.stdout:0/953: truncate d0/f50 1829285 0 2023-12-06T15:00:36.504 INFO:tasks.workunit.client.1.smithi190.stdout:4/908: mknod d3/d76/dc4/dc5/d3c/c140 0 2023-12-06T15:00:36.504 INFO:tasks.workunit.client.1.smithi190.stdout:4/909: fdatasync d3/d76/dc4/dc5/d3c/d116/d15/f34 0 2023-12-06T15:00:36.506 INFO:tasks.workunit.client.1.smithi190.stdout:4/910: link d3/d35/d19/d41/d44/d11d/ff5 d3/d35/d19/d67/db5/dbe/f141 0 2023-12-06T15:00:36.508 INFO:tasks.workunit.client.1.smithi190.stdout:4/911: mknod d3/da4/d10d/c142 0 2023-12-06T15:00:36.509 INFO:tasks.workunit.client.1.smithi190.stdout:4/912: mkdir d3/d76/dc4/dc5/d3c/d116/d39/d54/d143 0 2023-12-06T15:00:36.510 INFO:tasks.workunit.client.1.smithi190.stdout:4/913: mknod d3/d4e/c144 0 2023-12-06T15:00:36.510 INFO:tasks.workunit.client.1.smithi190.stdout:4/914: fsync d3/d35/d19/f5e 0 2023-12-06T15:00:36.512 INFO:tasks.workunit.client.1.smithi190.stdout:4/915: truncate d3/d76/dc4/dc5/d3c/d116/d15/ffb 2165672 0 2023-12-06T15:00:36.513 INFO:tasks.workunit.client.1.smithi190.stdout:4/916: creat d3/d35/d19/d67/db5/dbe/f145 x:0 0 0 2023-12-06T15:00:36.514 INFO:tasks.workunit.client.1.smithi190.stdout:4/917: rmdir d3/d35/da5 39 2023-12-06T15:00:36.516 INFO:tasks.workunit.client.1.smithi190.stdout:4/918: unlink d3/d76/dc4/dc5/d3c/d116/d39/daf/fca 0 2023-12-06T15:00:36.516 INFO:tasks.workunit.client.1.smithi190.stdout:4/919: chown d3/d76/dc4/dc5/d3c/d116/f7b 4009 1 2023-12-06T15:00:36.517 INFO:tasks.workunit.client.1.smithi190.stdout:0/954: dread d0/da/d3e/d2b/d3c/f5f [0,4194304] 0 2023-12-06T15:00:36.518 INFO:tasks.workunit.client.0.smithi152.stdout:0/716: dwrite d8/d44/fa3 [0,4194304] 0 2023-12-06T15:00:36.518 INFO:tasks.workunit.client.0.smithi152.stdout:0/717: chown d8/d3e/d6f 107039775 1 2023-12-06T15:00:36.518 INFO:tasks.workunit.client.0.smithi152.stdout:5/878: dwrite d7/f105 [0,4194304] 0 2023-12-06T15:00:36.518 INFO:tasks.workunit.client.0.smithi152.stdout:3/733: dwrite d9/d10/f7f [0,4194304] 0 2023-12-06T15:00:36.520 INFO:tasks.workunit.client.1.smithi190.stdout:5/895: dwrite d0/d1c/d2b/d2c/d5d/d73/f13 [0,4194304] 0 2023-12-06T15:00:36.520 INFO:tasks.workunit.client.1.smithi190.stdout:0/955: creat d0/da/d3e/d3a/d40/d81/f13e x:0 0 0 2023-12-06T15:00:36.522 INFO:tasks.workunit.client.1.smithi190.stdout:0/956: write d0/da/d5a/f11e [178038,49415] 0 2023-12-06T15:00:36.523 INFO:tasks.workunit.client.1.smithi190.stdout:5/896: dread d0/d6c/da7/fbb [0,4194304] 0 2023-12-06T15:00:36.523 INFO:tasks.workunit.client.1.smithi190.stdout:5/897: truncate d0/d1c/d2b/d69/f8e 1546812 0 2023-12-06T15:00:36.524 INFO:tasks.workunit.client.0.smithi152.stdout:0/718: write d8/d3e/d87/fc1 [3605700,40968] 0 2023-12-06T15:00:36.525 INFO:tasks.workunit.client.0.smithi152.stdout:5/879: creat d7/dd/d26/d3a/f133 x:0 0 0 2023-12-06T15:00:36.527 INFO:tasks.workunit.client.1.smithi190.stdout:0/957: link d0/da/d74/da2/l13d d0/da/d3e/d3a/d40/d6f/d9e/dbb/l13f 0 2023-12-06T15:00:36.527 INFO:tasks.workunit.client.1.smithi190.stdout:0/958: stat d0/da/d5a/dc8/cfa 0 2023-12-06T15:00:36.527 INFO:tasks.workunit.client.1.smithi190.stdout:0/959: write d0/da/ff2 [900338,23204] 0 2023-12-06T15:00:36.528 INFO:tasks.workunit.client.0.smithi152.stdout:0/719: creat d8/d15/d45/da4/fef x:0 0 0 2023-12-06T15:00:36.529 INFO:tasks.workunit.client.0.smithi152.stdout:5/880: symlink d7/dd/d26/d48/l134 0 2023-12-06T15:00:36.530 INFO:tasks.workunit.client.0.smithi152.stdout:3/734: symlink d9/d10/d12/le1 0 2023-12-06T15:00:36.530 INFO:tasks.workunit.client.0.smithi152.stdout:3/735: chown d9/d10/d12/d43/d52/d58/da9/la8 78 1 2023-12-06T15:00:36.530 INFO:tasks.workunit.client.1.smithi190.stdout:5/898: mkdir d0/d1c/d2b/d2c/d5d/d73/d116/d112/d134 0 2023-12-06T15:00:36.531 INFO:tasks.workunit.client.0.smithi152.stdout:0/720: symlink d8/d44/lf0 0 2023-12-06T15:00:36.531 INFO:tasks.workunit.client.0.smithi152.stdout:0/721: dread - d8/d3e/d6f/fc0 zero size 2023-12-06T15:00:36.531 INFO:tasks.workunit.client.0.smithi152.stdout:0/722: fsync d8/f6d 0 2023-12-06T15:00:36.532 INFO:tasks.workunit.client.0.smithi152.stdout:5/881: creat d7/dd/d26/d3b/d46/dc9/f135 x:0 0 0 2023-12-06T15:00:36.532 INFO:tasks.workunit.client.0.smithi152.stdout:3/736: creat d9/d45/fe2 x:0 0 0 2023-12-06T15:00:36.533 INFO:tasks.workunit.client.0.smithi152.stdout:0/723: rename d8/d3e/f57 to d8/d3e/ff1 0 2023-12-06T15:00:36.533 INFO:tasks.workunit.client.0.smithi152.stdout:0/724: dread - d8/d15/d45/d73/fbb zero size 2023-12-06T15:00:36.533 INFO:tasks.workunit.client.0.smithi152.stdout:0/725: dread - d8/d15/d45/d83/fdb zero size 2023-12-06T15:00:36.533 INFO:tasks.workunit.client.0.smithi152.stdout:0/726: fsync d8/d15/d45/f84 0 2023-12-06T15:00:36.533 INFO:tasks.workunit.client.0.smithi152.stdout:0/727: fsync d8/d15/fe2 0 2023-12-06T15:00:36.534 INFO:tasks.workunit.client.0.smithi152.stdout:5/882: rmdir d7/dd/d26/d87/d12a/d132 0 2023-12-06T15:00:36.535 INFO:tasks.workunit.client.1.smithi190.stdout:0/960: mknod d0/da/d3e/d2b/d3c/d46/d8e/d90/c140 0 2023-12-06T15:00:36.536 INFO:tasks.workunit.client.1.smithi190.stdout:4/920: dwrite d3/d76/dc4/dc5/fbf [0,4194304] 0 2023-12-06T15:00:36.536 INFO:tasks.workunit.client.0.smithi152.stdout:3/737: rename d9/d10/d19/l5f to d9/d45/le3 0 2023-12-06T15:00:36.537 INFO:tasks.workunit.client.0.smithi152.stdout:0/728: rmdir d8/d15/d45/d73/d7a 39 2023-12-06T15:00:36.537 INFO:tasks.workunit.client.1.smithi190.stdout:5/899: symlink d0/d1c/d2b/d8b/dd7/l135 0 2023-12-06T15:00:36.540 INFO:tasks.workunit.client.0.smithi152.stdout:5/883: symlink d7/dd/d26/d87/l136 0 2023-12-06T15:00:36.540 INFO:tasks.workunit.client.0.smithi152.stdout:5/884: readlink d7/dd/d26/d48/dbb/l123 0 2023-12-06T15:00:36.546 INFO:tasks.workunit.client.0.smithi152.stdout:3/738: dread d9/d45/fcb [0,4194304] 0 2023-12-06T15:00:36.547 INFO:tasks.workunit.client.1.smithi190.stdout:4/921: symlink d3/d76/dc4/dc5/d3c/d116/d39/dc8/l146 0 2023-12-06T15:00:36.550 INFO:tasks.workunit.client.1.smithi190.stdout:5/900: rename d0/f24 to d0/d1c/d2b/d2c/d5d/d73/d114/f136 0 2023-12-06T15:00:36.554 INFO:tasks.workunit.client.1.smithi190.stdout:4/922: getdents d3/d35/d19/d41/d44/d11d 0 2023-12-06T15:00:36.555 INFO:tasks.workunit.client.0.smithi152.stdout:6/936: sync 2023-12-06T15:00:36.557 INFO:tasks.workunit.client.1.smithi190.stdout:5/901: unlink d0/c8 0 2023-12-06T15:00:36.570 INFO:tasks.workunit.client.1.smithi190.stdout:0/961: dwrite d0/da/d3e/d2b/d3c/d46/f52 [0,4194304] 0 2023-12-06T15:00:36.571 INFO:tasks.workunit.client.1.smithi190.stdout:0/962: read d0/da/f5b [840627,105314] 0 2023-12-06T15:00:36.571 INFO:tasks.workunit.client.1.smithi190.stdout:0/963: write d0/da/d3e/d2b/d3c/d46/f107 [611205,54753] 0 2023-12-06T15:00:36.572 INFO:tasks.workunit.client.0.smithi152.stdout:0/729: dwrite d8/d15/d45/d73/db9/fd0 [0,4194304] 0 2023-12-06T15:00:36.572 INFO:tasks.workunit.client.0.smithi152.stdout:5/885: dwrite d7/dd/d26/d3b/d46/d7e/fce [0,4194304] 0 2023-12-06T15:00:36.575 INFO:tasks.workunit.client.0.smithi152.stdout:0/730: getdents d8/d3e/d87 0 2023-12-06T15:00:36.577 INFO:tasks.workunit.client.0.smithi152.stdout:5/886: truncate d7/d43/f7f 1295858 0 2023-12-06T15:00:36.577 INFO:tasks.workunit.client.0.smithi152.stdout:5/887: chown d7/dd/f8a 1346051 1 2023-12-06T15:00:36.580 INFO:tasks.workunit.client.0.smithi152.stdout:0/731: truncate d8/f3f 221417 0 2023-12-06T15:00:36.580 INFO:tasks.workunit.client.0.smithi152.stdout:0/732: readlink d8/d3e/d87/l3b 0 2023-12-06T15:00:36.580 INFO:tasks.workunit.client.0.smithi152.stdout:0/733: write d8/d3e/d87/d76/f74 [1017882,128364] 0 2023-12-06T15:00:36.581 INFO:tasks.workunit.client.0.smithi152.stdout:5/888: symlink d7/dd/d26/d3b/d46/dc9/l137 0 2023-12-06T15:00:36.581 INFO:tasks.workunit.client.0.smithi152.stdout:5/889: fdatasync d7/d43/d9c/fea 0 2023-12-06T15:00:36.581 INFO:tasks.workunit.client.0.smithi152.stdout:5/890: fsync d7/dd/d26/d3b/d46/f12e 0 2023-12-06T15:00:36.582 INFO:tasks.workunit.client.0.smithi152.stdout:0/734: getdents d8/d15/d45/da4 0 2023-12-06T15:00:36.585 INFO:tasks.workunit.client.0.smithi152.stdout:5/891: link d7/dd/d26/d3b/f5a d7/dd/d26/d48/d97/dc2/f138 0 2023-12-06T15:00:36.585 INFO:tasks.workunit.client.0.smithi152.stdout:5/892: readlink d7/d43/d6c/da4/la9 0 2023-12-06T15:00:36.585 INFO:tasks.workunit.client.0.smithi152.stdout:5/893: write d7/dd/d26/db1/f11f [262222,16989] 0 2023-12-06T15:00:36.585 INFO:tasks.workunit.client.0.smithi152.stdout:5/894: chown d7/d43/d9c/d104 1325858 1 2023-12-06T15:00:36.585 INFO:tasks.workunit.client.0.smithi152.stdout:0/735: read d8/d15/d45/f54 [3755624,114181] 0 2023-12-06T15:00:36.585 INFO:tasks.workunit.client.0.smithi152.stdout:0/736: chown d8/d3e/f43 76 1 2023-12-06T15:00:36.586 INFO:tasks.workunit.client.0.smithi152.stdout:0/737: dread - d8/d44/f91 zero size 2023-12-06T15:00:36.586 INFO:tasks.workunit.client.0.smithi152.stdout:0/738: readlink d8/d15/l2d 0 2023-12-06T15:00:36.586 INFO:tasks.workunit.client.0.smithi152.stdout:0/739: chown d8/d15/d45/d73/d8c/dda 243840293 1 2023-12-06T15:00:36.592 INFO:tasks.workunit.client.0.smithi152.stdout:5/895: unlink d7/dd/d26/d87/l136 0 2023-12-06T15:00:36.592 INFO:tasks.workunit.client.0.smithi152.stdout:3/739: rmdir d9/d10 39 2023-12-06T15:00:36.597 INFO:tasks.workunit.client.0.smithi152.stdout:3/740: rename d9/d18/d39/f8a to d9/d10/d12/d43/d52/d58/da9/fe4 0 2023-12-06T15:00:36.597 INFO:tasks.workunit.client.0.smithi152.stdout:3/741: chown d9/d10/d19/c75 22777 1 2023-12-06T15:00:36.597 INFO:tasks.workunit.client.0.smithi152.stdout:5/896: creat d7/dd/d26/d48/d97/f139 x:0 0 0 2023-12-06T15:00:36.597 INFO:tasks.workunit.client.0.smithi152.stdout:5/897: fsync d7/dd/ff 0 2023-12-06T15:00:36.597 INFO:tasks.workunit.client.0.smithi152.stdout:3/742: write d9/d18/d51/d8d/d8f/da0/dab/dc3/f9a [679977,36670] 0 2023-12-06T15:00:36.597 INFO:tasks.workunit.client.0.smithi152.stdout:3/743: chown d9/d10/d12/d43/d52/l9b 34864535 1 2023-12-06T15:00:36.600 INFO:tasks.workunit.client.0.smithi152.stdout:5/898: rename d7/dd/ceb to d7/d43/d9c/dfb/c13a 0 2023-12-06T15:00:36.601 INFO:tasks.workunit.client.0.smithi152.stdout:5/899: symlink d7/d43/d6c/dde/l13b 0 2023-12-06T15:00:36.604 INFO:tasks.workunit.client.0.smithi152.stdout:5/900: creat d7/dd/d26/d87/dc4/f13c x:0 0 0 2023-12-06T15:00:36.605 INFO:tasks.workunit.client.0.smithi152.stdout:5/901: symlink d7/dd/d26/d3a/l13d 0 2023-12-06T15:00:36.606 INFO:tasks.workunit.client.0.smithi152.stdout:5/902: write d7/dd/f67 [4734199,64471] 0 2023-12-06T15:00:36.606 INFO:tasks.workunit.client.0.smithi152.stdout:0/740: dwrite d8/d44/f46 [0,4194304] 0 2023-12-06T15:00:36.606 INFO:tasks.workunit.client.0.smithi152.stdout:0/741: write d8/d3e/f58 [953033,128040] 0 2023-12-06T15:00:36.606 INFO:tasks.workunit.client.0.smithi152.stdout:0/742: dread - d8/d4b/f4e zero size 2023-12-06T15:00:36.609 INFO:tasks.workunit.client.0.smithi152.stdout:0/743: mkdir d8/d15/d45/da2/df2 0 2023-12-06T15:00:36.609 INFO:tasks.workunit.client.0.smithi152.stdout:0/744: read - d8/d15/d45/d83/fe8 zero size 2023-12-06T15:00:36.609 INFO:tasks.workunit.client.0.smithi152.stdout:5/903: write d7/d47/fa0 [2162809,19440] 0 2023-12-06T15:00:36.609 INFO:tasks.workunit.client.0.smithi152.stdout:5/904: read - d7/dd/d26/d3a/f133 zero size 2023-12-06T15:00:36.609 INFO:tasks.workunit.client.0.smithi152.stdout:5/905: dread - d7/dd/d26/d3b/fbe zero size 2023-12-06T15:00:36.609 INFO:tasks.workunit.client.0.smithi152.stdout:5/906: chown d7/d43/c8c 28 1 2023-12-06T15:00:36.610 INFO:tasks.workunit.client.0.smithi152.stdout:0/745: mkdir d8/d15/d45/da4/df3 0 2023-12-06T15:00:36.610 INFO:tasks.workunit.client.0.smithi152.stdout:0/746: write d8/d44/f48 [786825,39459] 0 2023-12-06T15:00:36.611 INFO:tasks.workunit.client.0.smithi152.stdout:5/907: symlink d7/dd/l13e 0 2023-12-06T15:00:36.611 INFO:tasks.workunit.client.0.smithi152.stdout:0/747: mkdir d8/d15/d45/d73/db9/dc4/df4 0 2023-12-06T15:00:36.612 INFO:tasks.workunit.client.0.smithi152.stdout:3/744: dread d9/d18/d51/d8d/d8f/da0/dab/dc3/f8c [0,4194304] 0 2023-12-06T15:00:36.612 INFO:tasks.workunit.client.0.smithi152.stdout:3/745: chown d9/d18/d51/d8d/d8f/da0/dab/dc3/d91/f99 86 1 2023-12-06T15:00:36.612 INFO:tasks.workunit.client.0.smithi152.stdout:5/908: creat d7/dd/dfc/f13f x:0 0 0 2023-12-06T15:00:36.612 INFO:tasks.workunit.client.0.smithi152.stdout:5/909: chown d7/dd/d26/d48/fb3 121 1 2023-12-06T15:00:36.615 INFO:tasks.workunit.client.0.smithi152.stdout:0/748: mkdir d8/d15/d45/d73/df5 0 2023-12-06T15:00:36.617 INFO:tasks.workunit.client.0.smithi152.stdout:3/746: write d9/d10/d12/d43/d52/f71 [3478331,62182] 0 2023-12-06T15:00:36.617 INFO:tasks.workunit.client.0.smithi152.stdout:3/747: chown d9/fa3 353220464 1 2023-12-06T15:00:36.617 INFO:tasks.workunit.client.0.smithi152.stdout:0/749: mknod d8/d15/d45/cf6 0 2023-12-06T15:00:36.617 INFO:tasks.workunit.client.0.smithi152.stdout:0/750: chown d8/d15/d45/cc9 162 1 2023-12-06T15:00:36.618 INFO:tasks.workunit.client.0.smithi152.stdout:6/937: dwrite d1/dcf/ddc/d1a/d30/d36/d35/d63/d86/f11d [0,4194304] 0 2023-12-06T15:00:36.619 INFO:tasks.workunit.client.0.smithi152.stdout:3/748: mknod d9/d18/ce5 0 2023-12-06T15:00:36.619 INFO:tasks.workunit.client.0.smithi152.stdout:3/749: write d9/d10/d12/d43/d52/f7a [4918606,105959] 0 2023-12-06T15:00:36.620 INFO:tasks.workunit.client.0.smithi152.stdout:0/751: creat d8/d44/ff7 x:0 0 0 2023-12-06T15:00:36.620 INFO:tasks.workunit.client.0.smithi152.stdout:0/752: write d8/d3e/d87/d76/d6e/f79 [716565,51496] 0 2023-12-06T15:00:36.626 INFO:tasks.workunit.client.0.smithi152.stdout:6/938: rename d1/d75 to d1/dcf/ddc/d1a/d30/daa/d108/d146 0 2023-12-06T15:00:36.627 INFO:tasks.workunit.client.0.smithi152.stdout:5/910: dwrite d7/dd/d26/d3b/f5a [0,4194304] 0 2023-12-06T15:00:36.628 INFO:tasks.workunit.client.0.smithi152.stdout:3/750: unlink d9/d10/d12/d43/d52/db4/f4e 0 2023-12-06T15:00:36.629 INFO:tasks.workunit.client.0.smithi152.stdout:0/753: mkdir d8/d3e/d87/d76/df8 0 2023-12-06T15:00:36.630 INFO:tasks.workunit.client.0.smithi152.stdout:6/939: symlink d1/d69/da1/l147 0 2023-12-06T15:00:36.630 INFO:tasks.workunit.client.0.smithi152.stdout:6/940: dread - d1/dcf/ddc/d1a/d30/d36/d35/d49/da6/da9/d120/fed zero size 2023-12-06T15:00:36.632 INFO:tasks.workunit.client.0.smithi152.stdout:5/911: unlink d7/d12c/fa8 0 2023-12-06T15:00:36.634 INFO:tasks.workunit.client.0.smithi152.stdout:3/751: mkdir d9/d18/d51/d8d/d8f/de6 0 2023-12-06T15:00:36.635 INFO:tasks.workunit.client.0.smithi152.stdout:0/754: creat d8/d15/d45/d99/ff9 x:0 0 0 2023-12-06T15:00:36.637 INFO:tasks.workunit.client.0.smithi152.stdout:6/941: creat d1/dcf/ddc/f148 x:0 0 0 2023-12-06T15:00:36.637 INFO:tasks.workunit.client.0.smithi152.stdout:6/942: truncate d1/dcf/ddc/d1a/d30/d36/d35/d49/d6b/fd7 486813 0 2023-12-06T15:00:36.637 INFO:tasks.workunit.client.0.smithi152.stdout:6/943: chown d1/dcf/ddc/d1a/d30/d36/d35/dd1/d141 94816 1 2023-12-06T15:00:36.637 INFO:tasks.workunit.client.0.smithi152.stdout:6/944: chown d1/dcf/ddc/d1a/d30 5876 1 2023-12-06T15:00:36.637 INFO:tasks.workunit.client.1.smithi190.stdout:5/902: mkdir d0/d1c/d85/d133/d137 0 2023-12-06T15:00:36.638 INFO:tasks.workunit.client.0.smithi152.stdout:5/912: symlink d7/dd/d26/d3a/l140 0 2023-12-06T15:00:36.641 INFO:tasks.workunit.client.0.smithi152.stdout:3/752: unlink d9/d10/d12/d43/d52/l9b 0 2023-12-06T15:00:36.652 INFO:tasks.workunit.client.0.smithi152.stdout:6/945: link d1/dcf/ddc/d1a/d30/d36/d35/f47 d1/d69/f149 0 2023-12-06T15:00:36.652 INFO:tasks.workunit.client.0.smithi152.stdout:6/946: stat d1/dcf/ddc/d8a/fee 0 2023-12-06T15:00:36.652 INFO:tasks.workunit.client.0.smithi152.stdout:5/913: truncate d7/dd/ff 3055986 0 2023-12-06T15:00:36.652 INFO:tasks.workunit.client.0.smithi152.stdout:0/755: creat d8/d15/d45/d73/ddd/de1/ffa x:0 0 0 2023-12-06T15:00:36.652 INFO:tasks.workunit.client.0.smithi152.stdout:3/753: symlink d9/d18/d51/d8d/d8f/da0/dab/dc3/d9f/dad/dd3/le7 0 2023-12-06T15:00:36.652 INFO:tasks.workunit.client.0.smithi152.stdout:3/754: truncate d9/d18/d39/f4a 1216934 0 2023-12-06T15:00:36.654 INFO:tasks.workunit.client.1.smithi190.stdout:5/903: dwrite d0/d1c/d85/d90/f97 [4194304,4194304] 0 2023-12-06T15:00:36.675 INFO:tasks.workunit.client.0.smithi152.stdout:3/755: dwrite d9/d10/d12/f85 [0,4194304] 0 2023-12-06T15:00:36.675 INFO:tasks.workunit.client.0.smithi152.stdout:3/756: write d9/d10/fd2 [987885,7864] 0 2023-12-06T15:00:36.678 INFO:tasks.workunit.client.0.smithi152.stdout:6/947: rename l0 to d1/dcf/ddc/d1a/d30/d36/d35/d49/da6/l14a 0 2023-12-06T15:00:36.678 INFO:tasks.workunit.client.0.smithi152.stdout:0/756: getdents d8/d3e/d6f 0 2023-12-06T15:00:36.678 INFO:tasks.workunit.client.0.smithi152.stdout:6/948: write d1/dcf/ddc/d1a/d30/d18/ffa [114139,127151] 0 2023-12-06T15:00:36.681 INFO:tasks.workunit.client.0.smithi152.stdout:3/757: truncate d9/d10/d12/d43/f78 3475560 0 2023-12-06T15:00:36.692 INFO:tasks.workunit.client.1.smithi190.stdout:5/904: dwrite d0/d1c/d85/fe4 [0,4194304] 0 2023-12-06T15:00:36.694 INFO:tasks.workunit.client.0.smithi152.stdout:0/757: dread d8/d15/fdf [0,4194304] 0 2023-12-06T15:00:36.695 INFO:tasks.workunit.client.1.smithi190.stdout:5/905: creat d0/d1c/d3e/d5a/f138 x:0 0 0 2023-12-06T15:00:36.697 INFO:tasks.workunit.client.0.smithi152.stdout:5/914: dread d7/dd/f2d [0,4194304] 0 2023-12-06T15:00:36.702 INFO:tasks.workunit.client.0.smithi152.stdout:6/949: dwrite d1/d69/da1/f104 [0,4194304] 0 2023-12-06T15:00:36.702 INFO:tasks.workunit.client.0.smithi152.stdout:6/950: chown d1/dcf/ddc/d1a/d30/d36/d35/d49/da6/da9/d120/c136 368431 1 2023-12-06T15:00:36.706 INFO:tasks.workunit.client.0.smithi152.stdout:6/951: symlink d1/dcf/ddc/d1a/d30/d36/d4e/l14b 0 2023-12-06T15:00:36.713 INFO:tasks.workunit.client.0.smithi152.stdout:5/915: write d7/d43/d9c/dfb/f55 [593883,89825] 0 2023-12-06T15:00:36.713 INFO:tasks.workunit.client.0.smithi152.stdout:0/758: dread d8/d3e/f42 [0,4194304] 0 2023-12-06T15:00:36.713 INFO:tasks.workunit.client.0.smithi152.stdout:0/759: write d8/d15/d45/da4/fef [389212,71886] 0 2023-12-06T15:00:36.714 INFO:tasks.workunit.client.0.smithi152.stdout:6/952: write d1/dcf/ddc/d1a/d30/d36/d35/d49/d57/f99 [2592695,71528] 0 2023-12-06T15:00:36.714 INFO:tasks.workunit.client.0.smithi152.stdout:5/916: getdents d7/dd/d26/d3b/d46/d7e 0 2023-12-06T15:00:36.716 INFO:tasks.workunit.client.0.smithi152.stdout:0/760: getdents d8/d15 0 2023-12-06T15:00:36.719 INFO:tasks.workunit.client.0.smithi152.stdout:5/917: creat d7/d12c/f141 x:0 0 0 2023-12-06T15:00:36.721 INFO:tasks.workunit.client.0.smithi152.stdout:2/683: sync 2023-12-06T15:00:36.721 INFO:tasks.workunit.client.0.smithi152.stdout:3/758: dwrite d9/d18/d51/d8d/d8f/da0/dab/dc3/f9a [0,4194304] 0 2023-12-06T15:00:36.721 INFO:tasks.workunit.client.0.smithi152.stdout:3/759: chown d9/fa3 5 1 2023-12-06T15:00:36.723 INFO:tasks.workunit.client.0.smithi152.stdout:2/684: write d6/d1e/d41/f60 [3143685,83069] 0 2023-12-06T15:00:36.725 INFO:tasks.workunit.client.1.smithi190.stdout:5/906: dwrite d0/d1c/d2b/d2c/d5d/d73/d116/dc5/dd5/fb3 [0,4194304] 0 2023-12-06T15:00:36.727 INFO:tasks.workunit.client.0.smithi152.stdout:3/760: rename d9/lb to d9/d18/d51/le8 0 2023-12-06T15:00:36.727 INFO:tasks.workunit.client.0.smithi152.stdout:3/761: fdatasync d9/d10/d19/f57 0 2023-12-06T15:00:36.728 INFO:tasks.workunit.client.0.smithi152.stdout:3/762: fdatasync d9/fb8 0 2023-12-06T15:00:36.730 INFO:tasks.workunit.client.0.smithi152.stdout:2/685: mknod d6/d1e/d41/d92/cd9 0 2023-12-06T15:00:36.730 INFO:tasks.workunit.client.1.smithi190.stdout:5/907: creat d0/d1c/d3e/f139 x:0 0 0 2023-12-06T15:00:36.731 INFO:tasks.workunit.client.1.smithi190.stdout:5/908: chown d0/d1c/d94/fb6 99911936 1 2023-12-06T15:00:36.731 INFO:tasks.workunit.client.1.smithi190.stdout:5/909: fdatasync d0/d1c/d3e/dea/f12c 0 2023-12-06T15:00:36.732 INFO:tasks.workunit.client.1.smithi190.stdout:5/910: unlink d0/d1c/d2b/d2c/l10a 0 2023-12-06T15:00:36.732 INFO:tasks.workunit.client.0.smithi152.stdout:2/686: stat d6/d1e/d41/d83/c98 0 2023-12-06T15:00:36.733 INFO:tasks.workunit.client.0.smithi152.stdout:6/953: dread d1/f13 [0,4194304] 0 2023-12-06T15:00:36.734 INFO:tasks.workunit.client.0.smithi152.stdout:0/761: write d8/d4b/f51 [1682745,23950] 0 2023-12-06T15:00:36.734 INFO:tasks.workunit.client.0.smithi152.stdout:0/762: write d8/d3e/d87/f8d [125025,109755] 0 2023-12-06T15:00:36.734 INFO:tasks.workunit.client.0.smithi152.stdout:0/763: stat d8/f20 0 2023-12-06T15:00:36.734 INFO:tasks.workunit.client.1.smithi190.stdout:5/911: symlink d0/d1c/d2b/d8b/l13a 0 2023-12-06T15:00:36.734 INFO:tasks.workunit.client.0.smithi152.stdout:2/687: rename d6/db/faa to d6/fda 0 2023-12-06T15:00:36.734 INFO:tasks.workunit.client.0.smithi152.stdout:2/688: chown d6/db/f72 32554905 1 2023-12-06T15:00:36.734 INFO:tasks.workunit.client.0.smithi152.stdout:3/763: write d9/d18/f95 [659689,31854] 0 2023-12-06T15:00:36.737 INFO:tasks.workunit.client.0.smithi152.stdout:0/764: mknod d8/d15/d45/d73/dac/cfb 0 2023-12-06T15:00:36.738 INFO:tasks.workunit.client.1.smithi190.stdout:5/912: rename d0/d6c to d0/d6c/da7/d13b 22 2023-12-06T15:00:36.739 INFO:tasks.workunit.client.0.smithi152.stdout:3/764: unlink d9/d10/d12/d43/d52/db4/fc4 0 2023-12-06T15:00:36.741 INFO:tasks.workunit.client.0.smithi152.stdout:6/954: rename d1/d69/da1/l147 to d1/l14c 0 2023-12-06T15:00:36.742 INFO:tasks.workunit.client.0.smithi152.stdout:3/765: creat d9/d18/d51/d8d/d8f/da0/dab/dc3/d91/dca/fe9 x:0 0 0 2023-12-06T15:00:36.743 INFO:tasks.workunit.client.1.smithi190.stdout:5/913: getdents d0/deb 0 2023-12-06T15:00:36.745 INFO:tasks.workunit.client.0.smithi152.stdout:3/766: link d9/d18/d39/l40 d9/d10/d12/lea 0 2023-12-06T15:00:36.748 INFO:tasks.workunit.client.0.smithi152.stdout:0/765: dread d8/f37 [0,4194304] 0 2023-12-06T15:00:36.748 INFO:tasks.workunit.client.0.smithi152.stdout:5/918: dwrite d7/dd/d26/f33 [4194304,4194304] 0 2023-12-06T15:00:36.748 INFO:tasks.workunit.client.0.smithi152.stdout:0/766: read d8/d15/d45/f4f [48655,16671] 0 2023-12-06T15:00:36.750 INFO:tasks.workunit.client.0.smithi152.stdout:3/767: rename d9/d10/d12/cb2 to d9/d18/d39/ceb 0 2023-12-06T15:00:36.750 INFO:tasks.workunit.client.0.smithi152.stdout:3/768: chown d9/d10/d12/d43/d52/db4/dc1/fda 1 1 2023-12-06T15:00:36.750 INFO:tasks.workunit.client.0.smithi152.stdout:3/769: readlink d9/d18/d51/ld7 0 2023-12-06T15:00:36.750 INFO:tasks.workunit.client.0.smithi152.stdout:2/689: dwrite d6/d18/d43/db8/fd0 [0,4194304] 0 2023-12-06T15:00:36.750 INFO:tasks.workunit.client.0.smithi152.stdout:2/690: stat d6/d1e/d41/da2 0 2023-12-06T15:00:36.751 INFO:tasks.workunit.client.0.smithi152.stdout:0/767: dread d8/d4b/f9e [0,4194304] 0 2023-12-06T15:00:36.752 INFO:tasks.workunit.client.0.smithi152.stdout:5/919: dread d7/d43/f4b [0,4194304] 0 2023-12-06T15:00:36.752 INFO:tasks.workunit.client.0.smithi152.stdout:5/920: truncate d7/dd/d26/fd8 539205 0 2023-12-06T15:00:36.752 INFO:tasks.workunit.client.0.smithi152.stdout:5/921: dread - d7/d43/d6c/f9e zero size 2023-12-06T15:00:36.754 INFO:tasks.workunit.client.0.smithi152.stdout:3/770: unlink d9/d10/c26 0 2023-12-06T15:00:36.754 INFO:tasks.workunit.client.0.smithi152.stdout:3/771: chown d9/d10/d19/f2c 518605 1 2023-12-06T15:00:36.756 INFO:tasks.workunit.client.0.smithi152.stdout:6/955: dread d1/dcf/ddc/d1a/d30/d36/d35/d49/d6b/f95 [0,4194304] 0 2023-12-06T15:00:36.759 INFO:tasks.workunit.client.0.smithi152.stdout:2/691: symlink d6/d1e/d41/ldb 0 2023-12-06T15:00:36.759 INFO:tasks.workunit.client.0.smithi152.stdout:3/772: rename d9/d10/d12/d43/d52/db4/fd9 to d9/d18/d51/d8d/d8f/da0/dab/dc3/db6/fec 0 2023-12-06T15:00:36.759 INFO:tasks.workunit.client.0.smithi152.stdout:0/768: creat d8/d15/d45/d73/ddd/de1/ffc x:0 0 0 2023-12-06T15:00:36.763 INFO:tasks.workunit.client.1.smithi190.stdout:0/964: rmdir d0/da/d5a 39 2023-12-06T15:00:36.763 INFO:tasks.workunit.client.0.smithi152.stdout:6/956: mkdir d1/dcf/ddc/d1a/d30/d36/d35/d63/d86/d14d 0 2023-12-06T15:00:36.763 INFO:tasks.workunit.client.0.smithi152.stdout:6/957: chown d1/dcf/ddc/d1a/d30/d36/d35/d49/d57 348 1 2023-12-06T15:00:36.763 INFO:tasks.workunit.client.0.smithi152.stdout:2/692: rename d6/db/d17/l3b to d6/d18/d43/d95/ldc 0 2023-12-06T15:00:36.765 INFO:tasks.workunit.client.0.smithi152.stdout:3/773: symlink d9/d18/d51/d8d/d8f/da0/dab/dc3/d91/led 0 2023-12-06T15:00:36.765 INFO:tasks.workunit.client.1.smithi190.stdout:0/965: creat d0/da/d3e/d2b/d3c/d46/d8e/d90/f141 x:0 0 0 2023-12-06T15:00:36.766 INFO:tasks.workunit.client.0.smithi152.stdout:2/693: mkdir d6/d1e/d41/da2/ddd 0 2023-12-06T15:00:36.767 INFO:tasks.workunit.client.1.smithi190.stdout:4/923: creat d3/d76/dc4/f147 x:0 0 0 2023-12-06T15:00:36.768 INFO:tasks.workunit.client.0.smithi152.stdout:2/694: unlink d6/d18/d43/l45 0 2023-12-06T15:00:36.768 INFO:tasks.workunit.client.0.smithi152.stdout:2/695: chown d6/cd 0 1 2023-12-06T15:00:36.768 INFO:tasks.workunit.client.0.smithi152.stdout:2/696: dread - d6/d1e/d41/d83/f93 zero size 2023-12-06T15:00:36.768 INFO:tasks.workunit.client.1.smithi190.stdout:0/966: write d0/da/d3e/d3a/d40/f28 [2738727,125284] 0 2023-12-06T15:00:36.769 INFO:tasks.workunit.client.1.smithi190.stdout:0/967: fdatasync d0/da/d5a/d80/f8c 0 2023-12-06T15:00:36.769 INFO:tasks.workunit.client.1.smithi190.stdout:0/968: read - d0/da/d3e/d2b/d3c/d46/d8e/d90/f141 zero size 2023-12-06T15:00:36.769 INFO:tasks.workunit.client.1.smithi190.stdout:5/914: mknod d0/d1c/d2b/d2c/d5d/d73/c13c 0 2023-12-06T15:00:36.769 INFO:tasks.workunit.client.1.smithi190.stdout:4/924: symlink d3/d35/da6/l148 0 2023-12-06T15:00:36.770 INFO:tasks.workunit.client.0.smithi152.stdout:2/697: rename d6/db/f72 to d6/d18/d43/d95/fde 0 2023-12-06T15:00:36.770 INFO:tasks.workunit.client.0.smithi152.stdout:2/698: dread - d6/d1e/d41/d92/f9d zero size 2023-12-06T15:00:36.771 INFO:tasks.workunit.client.0.smithi152.stdout:2/699: symlink d6/d1e/d41/da2/ddd/ldf 0 2023-12-06T15:00:36.772 INFO:tasks.workunit.client.0.smithi152.stdout:9/738: sync 2023-12-06T15:00:36.772 INFO:tasks.workunit.client.1.smithi190.stdout:0/969: unlink d0/da/d3e/d2b/d3c/d46/d8e/d90/f141 0 2023-12-06T15:00:36.772 INFO:tasks.workunit.client.1.smithi190.stdout:4/925: dread d3/f14 [0,4194304] 0 2023-12-06T15:00:36.773 INFO:tasks.workunit.client.0.smithi152.stdout:0/769: dread d8/d15/d45/d73/d7a/f5b [4194304,4194304] 0 2023-12-06T15:00:36.773 INFO:tasks.workunit.client.0.smithi152.stdout:0/770: fdatasync d8/fc6 0 2023-12-06T15:00:36.773 INFO:tasks.workunit.client.0.smithi152.stdout:6/958: dread d1/dcf/ddc/d1a/d30/d36/d35/d63/d86/f11d [0,4194304] 0 2023-12-06T15:00:36.773 INFO:tasks.workunit.client.0.smithi152.stdout:6/959: readlink d1/dcf/ddc/d1a/d30/d36/d35/dd1/ld4 0 2023-12-06T15:00:36.775 INFO:tasks.workunit.client.1.smithi190.stdout:5/915: unlink d0/d1c/d3e/lcb 0 2023-12-06T15:00:36.775 INFO:tasks.workunit.client.1.smithi190.stdout:5/916: write d0/d1c/d3e/f131 [549655,111321] 0 2023-12-06T15:00:36.775 INFO:tasks.workunit.client.0.smithi152.stdout:2/700: truncate d6/d18/d70/f84 978402 0 2023-12-06T15:00:36.775 INFO:tasks.workunit.client.0.smithi152.stdout:3/774: write d9/d10/d19/f7b [2664016,126066] 0 2023-12-06T15:00:36.775 INFO:tasks.workunit.client.0.smithi152.stdout:0/771: mkdir d8/d15/d45/d73/db9/dc4/dfd 0 2023-12-06T15:00:36.776 INFO:tasks.workunit.client.0.smithi152.stdout:9/739: write d0/d3f/d68/d6c/d20/d38/d45/f37 [2068630,124863] 0 2023-12-06T15:00:36.776 INFO:tasks.workunit.client.0.smithi152.stdout:5/922: dwrite d7/f15 [0,4194304] 0 2023-12-06T15:00:36.776 INFO:tasks.workunit.client.0.smithi152.stdout:5/923: chown d7/dd/d26/d3b/d46/fe7 112048163 1 2023-12-06T15:00:36.779 INFO:tasks.workunit.client.1.smithi190.stdout:4/926: unlink d3/d76/d7c/d8a/ddf/cf3 0 2023-12-06T15:00:36.779 INFO:tasks.workunit.client.1.smithi190.stdout:4/927: chown d3/d35/d19/d67/db5/dbe/f115 52 1 2023-12-06T15:00:36.779 INFO:tasks.workunit.client.1.smithi190.stdout:4/928: dread - d3/d35/d19/f11a zero size 2023-12-06T15:00:36.779 INFO:tasks.workunit.client.1.smithi190.stdout:4/929: write d3/d76/dc4/f147 [680930,92636] 0 2023-12-06T15:00:36.779 INFO:tasks.workunit.client.0.smithi152.stdout:6/960: rename d1/f2c to d1/dcf/ddc/d1a/d30/d36/d4e/d11b/f14e 0 2023-12-06T15:00:36.780 INFO:tasks.workunit.client.0.smithi152.stdout:2/701: rmdir d6/d1e/d41/d92/dcb 0 2023-12-06T15:00:36.780 INFO:tasks.workunit.client.1.smithi190.stdout:5/917: read d0/f44 [2397554,34549] 0 2023-12-06T15:00:36.781 INFO:tasks.workunit.client.1.smithi190.stdout:4/930: symlink d3/d76/dc4/dc5/d13f/l149 0 2023-12-06T15:00:36.781 INFO:tasks.workunit.client.1.smithi190.stdout:4/931: dread - d3/d76/dc4/dc5/d3c/d116/d15/d103/f10e zero size 2023-12-06T15:00:36.781 INFO:tasks.workunit.client.1.smithi190.stdout:4/932: fdatasync d3/d76/dc4/dc5/f37 0 2023-12-06T15:00:36.781 INFO:tasks.workunit.client.1.smithi190.stdout:4/933: stat d3/d76/dc4/dc5/d3c/f4f 0 2023-12-06T15:00:36.783 INFO:tasks.workunit.client.0.smithi152.stdout:3/775: link d9/d45/le3 d9/d18/lee 0 2023-12-06T15:00:36.783 INFO:tasks.workunit.client.0.smithi152.stdout:0/772: creat d8/d3e/d87/d76/ffe x:0 0 0 2023-12-06T15:00:36.789 INFO:tasks.workunit.client.0.smithi152.stdout:9/740: mkdir d0/d3f/d68/d6c/dcf/dda 0 2023-12-06T15:00:36.791 INFO:tasks.workunit.client.0.smithi152.stdout:6/961: unlink d1/dcf/ddc/d8a/cf9 0 2023-12-06T15:00:36.792 INFO:tasks.workunit.client.1.smithi190.stdout:5/918: dread d0/d1c/d85/d90/d99/fa3 [0,4194304] 0 2023-12-06T15:00:36.792 INFO:tasks.workunit.client.1.smithi190.stdout:5/919: write d0/d1c/d3e/fe1 [958814,28474] 0 2023-12-06T15:00:36.793 INFO:tasks.workunit.client.0.smithi152.stdout:2/702: rmdir d6/d18/d43/db8 39 2023-12-06T15:00:36.793 INFO:tasks.workunit.client.0.smithi152.stdout:2/703: chown d6/d1e/d41/d92/f9d 2147774 1 2023-12-06T15:00:36.797 INFO:tasks.workunit.client.0.smithi152.stdout:5/924: rename d7/dd/ff to d7/d43/d6c/dde/de3/f142 0 2023-12-06T15:00:36.800 INFO:tasks.workunit.client.0.smithi152.stdout:0/773: creat d8/d15/d45/d73/db9/dc4/fff x:0 0 0 2023-12-06T15:00:36.800 INFO:tasks.workunit.client.0.smithi152.stdout:0/774: chown f5 33273367 1 2023-12-06T15:00:36.803 INFO:tasks.workunit.client.0.smithi152.stdout:6/962: creat d1/f14f x:0 0 0 2023-12-06T15:00:36.804 INFO:tasks.workunit.client.0.smithi152.stdout:9/741: write d0/d3f/d68/d6c/f25 [4022538,86851] 0 2023-12-06T15:00:36.805 INFO:tasks.workunit.client.0.smithi152.stdout:9/742: stat d0/d3f/d68/d6c/l2c 0 2023-12-06T15:00:36.805 INFO:tasks.workunit.client.0.smithi152.stdout:2/704: symlink d6/d18/d43/db3/db7/le0 0 2023-12-06T15:00:36.805 INFO:tasks.workunit.client.0.smithi152.stdout:7/622: sync 2023-12-06T15:00:36.805 INFO:tasks.workunit.client.0.smithi152.stdout:8/674: sync 2023-12-06T15:00:36.805 INFO:tasks.workunit.client.1.smithi190.stdout:8/963: sync 2023-12-06T15:00:36.805 INFO:tasks.workunit.client.1.smithi190.stdout:2/950: sync 2023-12-06T15:00:36.805 INFO:tasks.workunit.client.1.smithi190.stdout:4/934: dwrite d3/d76/dc4/dc5/d3c/d116/f98 [0,4194304] 0 2023-12-06T15:00:36.806 INFO:tasks.workunit.client.1.smithi190.stdout:4/935: stat d3/d35/d19/d41/d44/f9f 0 2023-12-06T15:00:36.806 INFO:tasks.workunit.client.1.smithi190.stdout:8/964: mknod d1/d20/d3b/d4c/d9e/def/c123 0 2023-12-06T15:00:36.806 INFO:tasks.workunit.client.0.smithi152.stdout:5/925: truncate d7/dd/d26/d87/dc4/ddc/fcb 3818612 0 2023-12-06T15:00:36.806 INFO:tasks.workunit.client.0.smithi152.stdout:5/926: chown d7/dd/d26/d3a/l69 14093 1 2023-12-06T15:00:36.807 INFO:tasks.workunit.client.1.smithi190.stdout:2/951: mknod d10/d26/d5c/d49/d7e/dcf/c143 0 2023-12-06T15:00:36.807 INFO:tasks.workunit.client.0.smithi152.stdout:3/776: creat d9/d18/d51/d8d/d8f/da0/dab/dc3/d91/fef x:0 0 0 2023-12-06T15:00:36.809 INFO:tasks.workunit.client.0.smithi152.stdout:0/775: truncate d8/d15/d45/d73/d7a/f41 1471017 0 2023-12-06T15:00:36.809 INFO:tasks.workunit.client.0.smithi152.stdout:6/963: symlink d1/dcf/ddc/d8a/l150 0 2023-12-06T15:00:36.811 INFO:tasks.workunit.client.1.smithi190.stdout:4/936: truncate d3/d35/d19/fd3 123009 0 2023-12-06T15:00:36.811 INFO:tasks.workunit.client.1.smithi190.stdout:8/965: write d1/d20/d3b/fb9 [143995,6473] 0 2023-12-06T15:00:36.811 INFO:tasks.workunit.client.1.smithi190.stdout:8/966: write d1/d20/f8b [2853102,44526] 0 2023-12-06T15:00:36.811 INFO:tasks.workunit.client.1.smithi190.stdout:8/967: fdatasync d1/d37/fc1 0 2023-12-06T15:00:36.811 INFO:tasks.workunit.client.1.smithi190.stdout:5/920: dwrite d0/d1c/d85/d90/d99/fc3 [0,4194304] 0 2023-12-06T15:00:36.812 INFO:tasks.workunit.client.1.smithi190.stdout:4/937: read d3/d76/d7c/d8a/f92 [22003,74375] 0 2023-12-06T15:00:36.812 INFO:tasks.workunit.client.1.smithi190.stdout:8/968: rename d1/d20/d3b/d4c/d59/d7d/lc5 to d1/d20/d3b/d7e/dd0/d11f/l124 0 2023-12-06T15:00:36.812 INFO:tasks.workunit.client.0.smithi152.stdout:9/743: rename d0/f14 to d0/d3f/d68/d6c/d20/d38/da8/fdb 0 2023-12-06T15:00:36.813 INFO:tasks.workunit.client.0.smithi152.stdout:9/744: getdents d0/d3f/d68/d6c/d20/d38/d44/dd6 0 2023-12-06T15:00:36.814 INFO:tasks.workunit.client.1.smithi190.stdout:4/938: getdents d3/d76/dc4/dc5/d3c/d116/d15/d12b 0 2023-12-06T15:00:36.818 INFO:tasks.workunit.client.0.smithi152.stdout:7/623: link dd/c4a dd/df/d34/dac/cc6 0 2023-12-06T15:00:36.818 INFO:tasks.workunit.client.0.smithi152.stdout:7/624: truncate dd/df/d1b/d20/d7c/d86/da4/fc4 696400 0 2023-12-06T15:00:36.818 INFO:tasks.workunit.client.0.smithi152.stdout:8/675: creat d1/d6/d34/d36/db4/fda x:0 0 0 2023-12-06T15:00:36.818 INFO:tasks.workunit.client.0.smithi152.stdout:3/777: mkdir d9/d18/d51/d8d/d8f/da0/dab/df0 0 2023-12-06T15:00:36.819 INFO:tasks.workunit.client.1.smithi190.stdout:8/969: rename d1/d20/d3b/d4c/d59/d7d/fe9 to d1/d20/d3b/d4c/d5a/dfb/f125 0 2023-12-06T15:00:36.819 INFO:tasks.workunit.client.1.smithi190.stdout:8/970: write d1/d20/d3b/d4c/d59/daa/fc6 [153579,88075] 0 2023-12-06T15:00:36.819 INFO:tasks.workunit.client.1.smithi190.stdout:8/971: chown d1/d20/d3b/lb3 527950 1 2023-12-06T15:00:36.819 INFO:tasks.workunit.client.1.smithi190.stdout:4/939: write d3/d76/dc4/dc5/d3c/d116/d39/f48 [4754753,32312] 0 2023-12-06T15:00:36.820 INFO:tasks.workunit.client.1.smithi190.stdout:4/940: write d3/d76/dc4/dc5/d3c/d116/f139 [911138,121676] 0 2023-12-06T15:00:36.820 INFO:tasks.workunit.client.1.smithi190.stdout:8/972: getdents d1/d20/d3b/d36/d105 0 2023-12-06T15:00:36.820 INFO:tasks.workunit.client.1.smithi190.stdout:8/973: truncate d1/d37/f73 589186 0 2023-12-06T15:00:36.820 INFO:tasks.workunit.client.1.smithi190.stdout:8/974: creat d1/d20/d3b/d34/dbc/f126 x:0 0 0 2023-12-06T15:00:36.820 INFO:tasks.workunit.client.1.smithi190.stdout:4/941: write d3/d76/dc4/dc5/d3c/f5a [761996,21526] 0 2023-12-06T15:00:36.820 INFO:tasks.workunit.client.1.smithi190.stdout:4/942: truncate d3/d76/dc4/f10f 64058 0 2023-12-06T15:00:36.822 INFO:tasks.workunit.client.0.smithi152.stdout:0/776: unlink d8/d15/d45/da2/cd8 0 2023-12-06T15:00:36.822 INFO:tasks.workunit.client.0.smithi152.stdout:0/777: truncate d8/d15/d45/da2/fc8 442447 0 2023-12-06T15:00:36.823 INFO:tasks.workunit.client.1.smithi190.stdout:8/975: mkdir d1/d20/d3b/d4c/d59/d7d/d127 0 2023-12-06T15:00:36.823 INFO:tasks.workunit.client.1.smithi190.stdout:8/976: stat d1/d20/fd4 0 2023-12-06T15:00:36.823 INFO:tasks.workunit.client.1.smithi190.stdout:8/977: fdatasync d1/d20/d3b/f30 0 2023-12-06T15:00:36.823 INFO:tasks.workunit.client.0.smithi152.stdout:6/964: creat d1/dcf/ddc/d1a/d30/d36/d26/f151 x:0 0 0 2023-12-06T15:00:36.825 INFO:tasks.workunit.client.1.smithi190.stdout:4/943: mknod d3/d76/d7c/db9/def/c14a 0 2023-12-06T15:00:36.826 INFO:tasks.workunit.client.0.smithi152.stdout:9/745: mkdir d0/ddc 0 2023-12-06T15:00:36.828 INFO:tasks.workunit.client.1.smithi190.stdout:8/978: mknod d1/d20/d3b/d4c/d9e/c128 0 2023-12-06T15:00:36.831 INFO:tasks.workunit.client.0.smithi152.stdout:7/625: link dd/df/d1b/d20/d7c/d86/da4/laa dd/df/d34/d44/d49/lc7 0 2023-12-06T15:00:36.831 INFO:tasks.workunit.client.0.smithi152.stdout:3/778: link d9/d10/d19/c69 d9/d18/d51/d8d/d8f/de6/cf1 0 2023-12-06T15:00:36.831 INFO:tasks.workunit.client.1.smithi190.stdout:8/979: unlink d1/d20/d3b/d36/lbf 0 2023-12-06T15:00:36.834 INFO:tasks.workunit.client.0.smithi152.stdout:2/705: rename d6/d1e/d41/d55 to d6/d1e/de1 0 2023-12-06T15:00:36.837 INFO:tasks.workunit.client.1.smithi190.stdout:5/921: dread d0/d1c/d2b/d2c/d5d/f67 [0,4194304] 0 2023-12-06T15:00:36.840 INFO:tasks.workunit.client.0.smithi152.stdout:9/746: creat d0/d3f/d68/d6c/d20/db0/d94/fdd x:0 0 0 2023-12-06T15:00:36.840 INFO:tasks.workunit.client.0.smithi152.stdout:9/747: stat d0/f30 0 2023-12-06T15:00:36.841 INFO:tasks.workunit.client.0.smithi152.stdout:5/927: rename d7/d43/d6c/da4/fad to d7/dd/d26/d48/d97/f143 0 2023-12-06T15:00:36.842 INFO:tasks.workunit.client.0.smithi152.stdout:2/706: creat d6/d18/d43/d95/fe2 x:0 0 0 2023-12-06T15:00:36.844 INFO:tasks.workunit.client.1.smithi190.stdout:5/922: dread d0/d1c/d3e/fe1 [0,4194304] 0 2023-12-06T15:00:36.844 INFO:tasks.workunit.client.0.smithi152.stdout:9/748: symlink d0/d3f/d5f/d60/da1/lde 0 2023-12-06T15:00:36.847 INFO:tasks.workunit.client.0.smithi152.stdout:3/779: rename d9/d10/f2a to d9/d10/d12/d43/d52/d58/da9/ff2 0 2023-12-06T15:00:36.847 INFO:tasks.workunit.client.0.smithi152.stdout:3/780: truncate d9/d10/d12/f72 4911345 0 2023-12-06T15:00:36.847 INFO:tasks.workunit.client.0.smithi152.stdout:3/781: chown d9/d18/d51/d8d/d8f/da0/dab/df0 1 1 2023-12-06T15:00:36.847 INFO:tasks.workunit.client.0.smithi152.stdout:3/782: dread - d9/d18/d51/d8d/d8f/fdf zero size 2023-12-06T15:00:36.850 INFO:tasks.workunit.client.0.smithi152.stdout:9/749: mkdir d0/d3f/d68/d6c/d20/d38/d44/ddf 0 2023-12-06T15:00:36.850 INFO:tasks.workunit.client.0.smithi152.stdout:9/750: dread - d0/d3f/d68/d6c/d92/fce zero size 2023-12-06T15:00:36.852 INFO:tasks.workunit.client.0.smithi152.stdout:3/783: creat d9/d10/d12/d43/d52/d58/ff3 x:0 0 0 2023-12-06T15:00:36.852 INFO:tasks.workunit.client.0.smithi152.stdout:3/784: dread - d9/d18/d51/d8d/d8f/da0/dab/dc3/db6/fec zero size 2023-12-06T15:00:36.852 INFO:tasks.workunit.client.0.smithi152.stdout:3/785: getdents d9/d10/d12/d43/d52/dc5 0 2023-12-06T15:00:36.853 INFO:tasks.workunit.client.0.smithi152.stdout:9/751: write d0/d3f/d68/d9f/fd0 [3238113,72502] 0 2023-12-06T15:00:36.853 INFO:tasks.workunit.client.0.smithi152.stdout:9/752: stat d0/d3f/d68/d6c/d20/f29 0 2023-12-06T15:00:36.853 INFO:tasks.workunit.client.0.smithi152.stdout:9/753: chown d0/d3f/d5f/dbb/fd1 670138912 1 2023-12-06T15:00:36.853 INFO:tasks.workunit.client.0.smithi152.stdout:9/754: write d0/d3f/d68/d6c/d20/db0/d94/fd8 [786216,52158] 0 2023-12-06T15:00:36.853 INFO:tasks.workunit.client.0.smithi152.stdout:9/755: write d0/d3f/d68/d6c/d20/fc8 [670748,92552] 0 2023-12-06T15:00:36.855 INFO:tasks.workunit.client.0.smithi152.stdout:9/756: symlink d0/d3f/d68/d6c/d20/le0 0 2023-12-06T15:00:36.858 INFO:tasks.workunit.client.0.smithi152.stdout:8/676: dwrite d1/d6/d34/d35/d8d/fb5 [0,4194304] 0 2023-12-06T15:00:36.858 INFO:tasks.workunit.client.0.smithi152.stdout:8/677: fsync d1/d6/d34/d35/d66/d82/f8a 0 2023-12-06T15:00:36.861 INFO:tasks.workunit.client.0.smithi152.stdout:8/678: rename d1/d6/d34/l73 to d1/d6/d34/d90/ldb 0 2023-12-06T15:00:36.864 INFO:tasks.workunit.client.0.smithi152.stdout:8/679: mknod d1/d6/d29/d87/cdc 0 2023-12-06T15:00:36.866 INFO:tasks.workunit.client.0.smithi152.stdout:9/757: dread d0/d3f/d68/d6c/d20/d38/d45/f3a [0,4194304] 0 2023-12-06T15:00:36.867 INFO:tasks.workunit.client.0.smithi152.stdout:9/758: mkdir d0/d3f/d68/d6c/dcf/dda/de1 0 2023-12-06T15:00:36.873 INFO:tasks.workunit.client.0.smithi152.stdout:6/965: dwrite d1/dcf/ddc/d1a/d30/daa/d108/d146/d105/f118 [0,4194304] 0 2023-12-06T15:00:36.877 INFO:tasks.workunit.client.0.smithi152.stdout:8/680: dread d1/d6/f1b [0,4194304] 0 2023-12-06T15:00:36.877 INFO:tasks.workunit.client.0.smithi152.stdout:8/681: chown d1/d6/d34/d36/f79 106543880 1 2023-12-06T15:00:36.877 INFO:tasks.workunit.client.0.smithi152.stdout:6/966: read d1/dcf/ddc/d1a/d30/d18/f103 [545854,70936] 0 2023-12-06T15:00:36.877 INFO:tasks.workunit.client.0.smithi152.stdout:6/967: fsync d1/dcf/ddc/d1a/d30/da4/fe7 0 2023-12-06T15:00:36.878 INFO:tasks.workunit.client.0.smithi152.stdout:8/682: rename d1/d6/d34/d40/f78 to d1/d6/d34/d35/d66/fdd 0 2023-12-06T15:00:36.882 INFO:tasks.workunit.client.0.smithi152.stdout:6/968: dread d1/fa3 [0,4194304] 0 2023-12-06T15:00:36.883 INFO:tasks.workunit.client.0.smithi152.stdout:6/969: truncate d1/dcf/ddc/d1a/d30/d36/d35/d63/d86/f11d 3033705 0 2023-12-06T15:00:36.888 INFO:tasks.workunit.client.0.smithi152.stdout:6/970: dread d1/dcf/ddc/d8a/f94 [0,4194304] 0 2023-12-06T15:00:36.888 INFO:tasks.workunit.client.0.smithi152.stdout:6/971: chown d1/dcf/ddc/d1a/d30/da4/cbb 2387 1 2023-12-06T15:00:36.889 INFO:tasks.workunit.client.0.smithi152.stdout:0/778: dwrite d8/d3e/d87/f90 [0,4194304] 0 2023-12-06T15:00:36.890 INFO:tasks.workunit.client.0.smithi152.stdout:0/779: symlink d8/d15/d45/da2/df2/l100 0 2023-12-06T15:00:36.890 INFO:tasks.workunit.client.0.smithi152.stdout:0/780: readlink d8/d15/l2d 0 2023-12-06T15:00:36.891 INFO:tasks.workunit.client.0.smithi152.stdout:0/781: mknod d8/d44/c101 0 2023-12-06T15:00:36.891 INFO:tasks.workunit.client.0.smithi152.stdout:0/782: write d8/d3e/d87/d76/d68/f7b [412923,42149] 0 2023-12-06T15:00:36.893 INFO:tasks.workunit.client.0.smithi152.stdout:7/626: dwrite dd/df/d78/f81 [0,4194304] 0 2023-12-06T15:00:36.893 INFO:tasks.workunit.client.0.smithi152.stdout:0/783: mkdir d8/d15/d45/da4/df3/d102 0 2023-12-06T15:00:36.893 INFO:tasks.workunit.client.0.smithi152.stdout:2/707: dwrite d6/d18/f58 [0,4194304] 0 2023-12-06T15:00:36.894 INFO:tasks.workunit.client.1.smithi190.stdout:8/980: dwrite d1/d20/d3b/d7e/fa8 [0,4194304] 0 2023-12-06T15:00:36.894 INFO:tasks.workunit.client.1.smithi190.stdout:5/923: dwrite d0/d6c/da7/fbb [0,4194304] 0 2023-12-06T15:00:36.895 INFO:tasks.workunit.client.1.smithi190.stdout:5/924: chown d0/d6c/fe0 45287 1 2023-12-06T15:00:36.896 INFO:tasks.workunit.client.1.smithi190.stdout:5/925: write d0/d1c/d2b/d8b/f10c [293993,117452] 0 2023-12-06T15:00:36.896 INFO:tasks.workunit.client.1.smithi190.stdout:5/926: dread - d0/d1c/d94/ff1 zero size 2023-12-06T15:00:36.897 INFO:tasks.workunit.client.0.smithi152.stdout:0/784: creat d8/d15/d45/da2/df2/f103 x:0 0 0 2023-12-06T15:00:36.898 INFO:tasks.workunit.client.1.smithi190.stdout:8/981: link d1/d37/dc9/f11e d1/d20/d3b/d34/dbc/f129 0 2023-12-06T15:00:36.899 INFO:tasks.workunit.client.1.smithi190.stdout:8/982: mknod d1/d20/d3b/d34/d39/c12a 0 2023-12-06T15:00:36.900 INFO:tasks.workunit.client.1.smithi190.stdout:8/983: getdents d1/d20/d3b/d7e/de8 0 2023-12-06T15:00:36.900 INFO:tasks.workunit.client.0.smithi152.stdout:3/786: dwrite d9/d18/d51/d8d/d8f/da0/dab/dc3/db6/fb7 [0,4194304] 0 2023-12-06T15:00:36.900 INFO:tasks.workunit.client.0.smithi152.stdout:6/972: dread d1/dcf/ddc/d8a/f94 [4194304,4194304] 0 2023-12-06T15:00:36.900 INFO:tasks.workunit.client.0.smithi152.stdout:6/973: read d1/fa3 [1659431,102994] 0 2023-12-06T15:00:36.900 INFO:tasks.workunit.client.0.smithi152.stdout:2/708: mknod d6/d1e/d7a/ce3 0 2023-12-06T15:00:36.901 INFO:tasks.workunit.client.1.smithi190.stdout:8/984: symlink d1/d20/d3b/d4c/d8e/l12b 0 2023-12-06T15:00:36.901 INFO:tasks.workunit.client.1.smithi190.stdout:5/927: dread d0/d1c/d3e/f77 [0,4194304] 0 2023-12-06T15:00:36.901 INFO:tasks.workunit.client.1.smithi190.stdout:5/928: creat d0/d1c/d3e/d5a/f13d x:0 0 0 2023-12-06T15:00:36.902 INFO:tasks.workunit.client.0.smithi152.stdout:6/974: write d1/dcf/ddc/d8a/fc6 [2280525,78751] 0 2023-12-06T15:00:36.904 INFO:tasks.workunit.client.1.smithi190.stdout:5/929: getdents d0/d1c/d3e 0 2023-12-06T15:00:36.904 INFO:tasks.workunit.client.1.smithi190.stdout:5/930: dread - d0/d1c/d85/d90/f101 zero size 2023-12-06T15:00:36.906 INFO:tasks.workunit.client.1.smithi190.stdout:5/931: dread d0/d6c/fd4 [0,4194304] 0 2023-12-06T15:00:36.907 INFO:tasks.workunit.client.0.smithi152.stdout:0/785: rmdir d8/d15/d45/d73/d8c/dda 0 2023-12-06T15:00:36.907 INFO:tasks.workunit.client.0.smithi152.stdout:0/786: chown d8/d15/d45/d73 326810 1 2023-12-06T15:00:36.908 INFO:tasks.workunit.client.1.smithi190.stdout:5/932: mknod d0/d1c/d2b/d2c/d5d/d73/d116/dc5/d113/c13e 0 2023-12-06T15:00:36.909 INFO:tasks.workunit.client.1.smithi190.stdout:5/933: mkdir d0/d1c/d85/d90/dba/d13f 0 2023-12-06T15:00:36.911 INFO:tasks.workunit.client.1.smithi190.stdout:5/934: getdents d0/d1c/d2b/d8b 0 2023-12-06T15:00:36.911 INFO:tasks.workunit.client.1.smithi190.stdout:5/935: stat d0/f10d 0 2023-12-06T15:00:36.912 INFO:tasks.workunit.client.1.smithi190.stdout:5/936: rename d0/d1c/d2b/d2c/d5d/d73/cf7 to d0/d1c/d2b/d2c/d5d/d73/d116/d112/d134/c140 0 2023-12-06T15:00:36.913 INFO:tasks.workunit.client.0.smithi152.stdout:3/787: truncate d9/d18/d51/d8d/d8f/da0/dab/dc3/f8c 1205268 0 2023-12-06T15:00:36.913 INFO:tasks.workunit.client.0.smithi152.stdout:3/788: fdatasync f7 0 2023-12-06T15:00:36.913 INFO:tasks.workunit.client.0.smithi152.stdout:2/709: mknod d6/d18/d43/db3/db7/ce4 0 2023-12-06T15:00:36.913 INFO:tasks.workunit.client.0.smithi152.stdout:2/710: fsync d6/d1e/de1/f76 0 2023-12-06T15:00:36.913 INFO:tasks.workunit.client.0.smithi152.stdout:2/711: dread - d6/d18/d43/dc9/fd2 zero size 2023-12-06T15:00:36.914 INFO:tasks.workunit.client.0.smithi152.stdout:8/683: link d1/d6/d34/d90/ldb d1/d6/d34/d35/d66/d82/lde 0 2023-12-06T15:00:36.914 INFO:tasks.workunit.client.0.smithi152.stdout:8/684: write d1/d6/d34/fb9 [659491,2715] 0 2023-12-06T15:00:36.915 INFO:tasks.workunit.client.0.smithi152.stdout:3/789: creat d9/ff4 x:0 0 0 2023-12-06T15:00:36.915 INFO:tasks.workunit.client.0.smithi152.stdout:3/790: readlink d9/d10/d12/d43/d52/db4/d65/lb3 0 2023-12-06T15:00:36.915 INFO:tasks.workunit.client.0.smithi152.stdout:3/791: truncate d9/d18/fa1 2443408 0 2023-12-06T15:00:36.916 INFO:tasks.workunit.client.0.smithi152.stdout:2/712: mknod d6/d1e/d41/d92/dbf/ce5 0 2023-12-06T15:00:36.916 INFO:tasks.workunit.client.1.smithi190.stdout:5/937: write d0/df/d50/fa4 [589507,34605] 0 2023-12-06T15:00:36.918 INFO:tasks.workunit.client.0.smithi152.stdout:2/713: write d6/f6a [3651454,37256] 0 2023-12-06T15:00:36.918 INFO:tasks.workunit.client.0.smithi152.stdout:2/714: chown d6/db/d91/fcc 25534 1 2023-12-06T15:00:36.919 INFO:tasks.workunit.client.1.smithi190.stdout:5/938: mknod d0/d1c/d2b/d2c/d5d/d73/c141 0 2023-12-06T15:00:36.922 INFO:tasks.workunit.client.0.smithi152.stdout:0/787: getdents d8/d15/d45/da2/df2 0 2023-12-06T15:00:36.922 INFO:tasks.workunit.client.1.smithi190.stdout:8/985: dwrite d1/d20/d3b/fc3 [0,4194304] 0 2023-12-06T15:00:36.922 INFO:tasks.workunit.client.1.smithi190.stdout:8/986: chown d1/dd3/lf5 105915 1 2023-12-06T15:00:36.923 INFO:tasks.workunit.client.1.smithi190.stdout:8/987: dread - d1/d20/d3b/d4c/d59/feb zero size 2023-12-06T15:00:36.923 INFO:tasks.workunit.client.1.smithi190.stdout:8/988: chown d1/d20/d3b/d4c/d8e/d94/db6 721254 1 2023-12-06T15:00:36.924 INFO:tasks.workunit.client.1.smithi190.stdout:8/989: read d1/d20/d3b/d36/fbd [1320819,35568] 0 2023-12-06T15:00:36.928 INFO:tasks.workunit.client.1.smithi190.stdout:8/990: mknod d1/d20/d3b/d34/dbc/c12c 0 2023-12-06T15:00:36.932 INFO:tasks.workunit.client.1.smithi190.stdout:5/939: dread d0/d1c/f98 [4194304,4194304] 0 2023-12-06T15:00:36.936 INFO:tasks.workunit.client.1.smithi190.stdout:5/940: rename d0/d1c/d2b/f9a to d0/d1c/d2b/d2c/d5d/d73/d114/f142 0 2023-12-06T15:00:36.936 INFO:tasks.workunit.client.1.smithi190.stdout:5/941: read - d0/deb/f11b zero size 2023-12-06T15:00:36.939 INFO:tasks.workunit.client.1.smithi190.stdout:5/942: dread d0/d1c/d2b/fb8 [0,4194304] 0 2023-12-06T15:00:36.939 INFO:tasks.workunit.client.1.smithi190.stdout:5/943: stat d0/d1c/d3e/d7e 0 2023-12-06T15:00:36.939 INFO:tasks.workunit.client.1.smithi190.stdout:5/944: readlink d0/l42 0 2023-12-06T15:00:36.940 INFO:tasks.workunit.client.1.smithi190.stdout:5/945: creat d0/d1c/d2b/d8b/f143 x:0 0 0 2023-12-06T15:00:36.941 INFO:tasks.workunit.client.1.smithi190.stdout:5/946: creat d0/d1c/d2b/d2c/d5d/d73/d116/dc5/d113/f144 x:0 0 0 2023-12-06T15:00:36.947 INFO:tasks.workunit.client.0.smithi152.stdout:8/685: dwrite d1/d6/d34/f98 [0,4194304] 0 2023-12-06T15:00:36.952 INFO:tasks.workunit.client.0.smithi152.stdout:2/715: dwrite d6/d18/f32 [0,4194304] 0 2023-12-06T15:00:36.952 INFO:tasks.workunit.client.0.smithi152.stdout:0/788: dwrite d8/d15/d45/d73/d8c/fd9 [0,4194304] 0 2023-12-06T15:00:36.952 INFO:tasks.workunit.client.0.smithi152.stdout:3/792: dwrite d9/d18/d39/f8e [0,4194304] 0 2023-12-06T15:00:36.952 INFO:tasks.workunit.client.0.smithi152.stdout:3/793: fsync d9/d10/d12/d43/d52/db4/d65/f79 0 2023-12-06T15:00:36.953 INFO:tasks.workunit.client.1.smithi190.stdout:8/991: dwrite d1/d20/d3b/d7e/f103 [0,4194304] 0 2023-12-06T15:00:36.956 INFO:tasks.workunit.client.0.smithi152.stdout:3/794: write d9/d18/d51/d8d/d8f/da0/dab/dc3/db6/fb7 [901867,79251] 0 2023-12-06T15:00:36.959 INFO:tasks.workunit.client.0.smithi152.stdout:0/789: creat d8/d3e/f104 x:0 0 0 2023-12-06T15:00:36.960 INFO:tasks.workunit.client.1.smithi190.stdout:8/992: mkdir d1/d20/d3b/d7e/d12d 0 2023-12-06T15:00:36.965 INFO:tasks.workunit.client.1.smithi190.stdout:8/993: creat d1/d20/d3b/d4c/d8e/d94/db6/d108/f12e x:0 0 0 2023-12-06T15:00:36.969 INFO:tasks.workunit.client.1.smithi190.stdout:8/994: read d1/d20/d3b/d7e/fa8 [678092,16863] 0 2023-12-06T15:00:36.970 INFO:tasks.workunit.client.1.smithi190.stdout:8/995: creat d1/d20/d3b/d4c/d59/d7d/f12f x:0 0 0 2023-12-06T15:00:36.971 INFO:tasks.workunit.client.1.smithi190.stdout:8/996: creat d1/d20/d3b/d36/d105/f130 x:0 0 0 2023-12-06T15:00:36.973 INFO:tasks.workunit.client.1.smithi190.stdout:8/997: dread d1/d20/d3b/d4c/d8e/d94/d1c/fe4 [0,4194304] 0 2023-12-06T15:00:36.977 INFO:tasks.workunit.client.0.smithi152.stdout:2/716: dwrite d6/d18/f32 [0,4194304] 0 2023-12-06T15:00:36.977 INFO:tasks.workunit.client.1.smithi190.stdout:8/998: read d1/d20/d3b/d34/dbc/fec [2575959,51387] 0 2023-12-06T15:00:36.984 INFO:tasks.workunit.client.0.smithi152.stdout:8/686: dwrite d1/d6/d34/d35/d8d/fb5 [0,4194304] 0 2023-12-06T15:00:36.984 INFO:tasks.workunit.client.0.smithi152.stdout:0/790: dwrite d8/d3e/f58 [0,4194304] 0 2023-12-06T15:00:36.984 INFO:tasks.workunit.client.0.smithi152.stdout:0/791: chown d8/d15/d45/da2/df2 42961 1 2023-12-06T15:00:36.984 INFO:tasks.workunit.client.0.smithi152.stdout:3/795: dwrite d9/d10/d12/d43/d52/db4/fbf [4194304,4194304] 0 2023-12-06T15:00:36.985 INFO:tasks.workunit.client.0.smithi152.stdout:8/687: mkdir d1/d6/d29/ddf 0 2023-12-06T15:00:36.986 INFO:tasks.workunit.client.0.smithi152.stdout:0/792: write d8/d15/d45/f71 [952904,128672] 0 2023-12-06T15:00:36.987 INFO:tasks.workunit.client.0.smithi152.stdout:0/793: read d8/d15/d45/f71 [642824,13080] 0 2023-12-06T15:00:36.988 INFO:tasks.workunit.client.1.smithi190.stdout:8/999: dread d1/d20/d3b/d7e/fa8 [0,4194304] 0 2023-12-06T15:00:36.992 INFO:tasks.workunit.client.0.smithi152.stdout:2/717: dread d6/d18/d43/db8/fd0 [0,4194304] 0 2023-12-06T15:00:36.993 INFO:tasks.workunit.client.0.smithi152.stdout:2/718: link d6/d1e/d41/d83/fbe d6/d1e/d41/da2/ddd/fe6 0 2023-12-06T15:00:37.015 INFO:tasks.workunit.client.0.smithi152.stdout:0/794: dwrite d8/d3e/d87/f90 [0,4194304] 0 2023-12-06T15:00:37.016 INFO:tasks.workunit.client.0.smithi152.stdout:8/688: dwrite d1/d6/d29/fcf [4194304,4194304] 0 2023-12-06T15:00:37.016 INFO:tasks.workunit.client.0.smithi152.stdout:8/689: truncate d1/d6/d34/d35/fc9 498523 0 2023-12-06T15:00:37.016 INFO:tasks.workunit.client.0.smithi152.stdout:2/719: dwrite d6/d1e/d7a/f7b [0,4194304] 0 2023-12-06T15:00:37.016 INFO:tasks.workunit.client.0.smithi152.stdout:2/720: readlink d6/d18/d43/la7 0 2023-12-06T15:00:37.017 INFO:tasks.workunit.client.0.smithi152.stdout:0/795: rename d8/d15/d45/d73/fbb to d8/d15/d45/d73/db9/dc4/df4/f105 0 2023-12-06T15:00:37.022 INFO:tasks.workunit.client.0.smithi152.stdout:8/690: link d1/d6/ca9 d1/d6/d34/d40/ce0 0 2023-12-06T15:00:37.023 INFO:tasks.workunit.client.0.smithi152.stdout:8/691: mknod d1/d6/d29/d87/daa/ce1 0 2023-12-06T15:00:37.043 INFO:tasks.workunit.client.0.smithi152.stdout:8/692: dwrite d1/d6/d34/d35/fb2 [0,4194304] 0 2023-12-06T15:00:37.044 INFO:tasks.workunit.client.0.smithi152.stdout:8/693: write d1/f96 [1092509,120355] 0 2023-12-06T15:00:37.045 INFO:tasks.workunit.client.0.smithi152.stdout:8/694: mkdir d1/d6/d34/d40/de2 0 2023-12-06T15:00:37.050 INFO:tasks.workunit.client.0.smithi152.stdout:2/721: dwrite d6/db/f66 [0,4194304] 0 2023-12-06T15:00:37.050 INFO:tasks.workunit.client.0.smithi152.stdout:0/796: dwrite d8/d15/d45/d73/d7a/f39 [0,4194304] 0 2023-12-06T15:00:37.058 INFO:tasks.workunit.client.0.smithi152.stdout:2/722: dread d6/db/f96 [0,4194304] 0 2023-12-06T15:00:37.059 INFO:tasks.workunit.client.0.smithi152.stdout:2/723: truncate d6/d1e/f2e 548868 0 2023-12-06T15:00:37.060 INFO:tasks.workunit.client.0.smithi152.stdout:2/724: mknod d6/d18/d43/db3/db7/ce7 0 2023-12-06T15:00:37.061 INFO:tasks.workunit.client.0.smithi152.stdout:2/725: dread d6/db/d17/f4f [0,4194304] 0 2023-12-06T15:00:37.067 INFO:tasks.workunit.client.0.smithi152.stdout:0/797: dwrite d8/d15/d45/f4f [0,4194304] 0 2023-12-06T15:00:37.071 INFO:tasks.workunit.client.0.smithi152.stdout:0/798: symlink d8/d15/d45/d73/dac/l106 0 2023-12-06T15:00:37.071 INFO:tasks.workunit.client.0.smithi152.stdout:0/799: stat d8/d3e/d87/d76/d6e/f79 0 2023-12-06T15:00:37.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:36 smithi190 ceph-mon[121340]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-06T15:00:37.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:36 smithi190 ceph-mon[121340]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-06T15:00:37.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:36 smithi190 ceph-mon[121340]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-06T15:00:37.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:36 smithi190 ceph-mon[121340]: Upgrade: Need to upgrade myself (mgr.smithi190.ubusrr) 2023-12-06T15:00:37.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:36 smithi190 ceph-mon[121340]: Upgrade: Need to upgrade myself (mgr.smithi190.ubusrr) 2023-12-06T15:00:37.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:36 smithi190 ceph-mon[121340]: pgmap v30: 65 pgs: 65 active+clean; 3.4 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 172 MiB/s rd, 344 MiB/s wr, 533 op/s 2023-12-06T15:00:37.073 INFO:tasks.workunit.client.0.smithi152.stdout:0/800: link d8/d15/d45/da2/ca7 d8/d3e/c107 0 2023-12-06T15:00:37.074 INFO:tasks.workunit.client.0.smithi152.stdout:0/801: symlink d8/d3e/d6f/dd4/l108 0 2023-12-06T15:00:37.075 INFO:tasks.workunit.client.0.smithi152.stdout:0/802: mknod d8/d15/d45/d73/db9/dc4/c109 0 2023-12-06T15:00:37.075 INFO:tasks.workunit.client.0.smithi152.stdout:0/803: fsync d8/dcc/fd5 0 2023-12-06T15:00:37.075 INFO:tasks.workunit.client.0.smithi152.stdout:2/726: dread d6/d18/f58 [0,4194304] 0 2023-12-06T15:00:37.075 INFO:tasks.workunit.client.0.smithi152.stdout:0/804: chown d8/d15/d45/da2/fbe 12048 1 2023-12-06T15:00:37.076 INFO:tasks.workunit.client.0.smithi152.stdout:0/805: mknod d8/d15/d45/d83/c10a 0 2023-12-06T15:00:37.076 INFO:tasks.workunit.client.0.smithi152.stdout:0/806: stat d8/d3e/d87/fea 0 2023-12-06T15:00:37.099 INFO:tasks.workunit.client.0.smithi152.stdout:0/807: dwrite d8/d3e/f42 [4194304,4194304] 0 2023-12-06T15:00:37.101 INFO:tasks.workunit.client.0.smithi152.stdout:0/808: rmdir d8/d3e/d87/d76/d68 39 2023-12-06T15:00:37.101 INFO:tasks.workunit.client.0.smithi152.stdout:0/809: chown d8/d44/ff7 124285730 1 2023-12-06T15:00:37.101 INFO:tasks.workunit.client.0.smithi152.stdout:0/810: write d8/d15/d45/d83/fed [2765349,59736] 0 2023-12-06T15:00:37.102 INFO:tasks.workunit.client.0.smithi152.stdout:0/811: getdents d8/d15/d45/d73/d8c 0 2023-12-06T15:00:37.102 INFO:tasks.workunit.client.0.smithi152.stdout:0/812: write d8/d3e/ff1 [1156476,21583] 0 2023-12-06T15:00:37.103 INFO:tasks.workunit.client.0.smithi152.stdout:0/813: read d8/d15/d45/da4/fde [3907357,87994] 0 2023-12-06T15:00:37.109 INFO:tasks.workunit.client.0.smithi152.stdout:0/814: dread d8/d15/d45/d73/d8c/fd9 [0,4194304] 0 2023-12-06T15:00:37.110 INFO:tasks.workunit.client.0.smithi152.stdout:0/815: mknod d8/d3e/d87/d76/c10b 0 2023-12-06T15:00:37.110 INFO:tasks.workunit.client.0.smithi152.stdout:0/816: chown d8/d3e/d87 5697 1 2023-12-06T15:00:37.110 INFO:tasks.workunit.client.0.smithi152.stdout:0/817: dread - d8/d3e/f7e zero size 2023-12-06T15:00:37.112 INFO:tasks.workunit.client.0.smithi152.stdout:0/818: dread d8/f3f [0,4194304] 0 2023-12-06T15:00:37.112 INFO:tasks.workunit.client.0.smithi152.stdout:0/819: fdatasync d8/d3e/d87/d76/ffe 0 2023-12-06T15:00:37.112 INFO:tasks.workunit.client.0.smithi152.stdout:0/820: rmdir d8/d3e/d6f/dd4 39 2023-12-06T15:00:37.121 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:36 smithi152 ceph-mon[111954]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-06T15:00:37.121 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:36 smithi152 ceph-mon[111954]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-06T15:00:37.121 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:36 smithi152 ceph-mon[111954]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-06T15:00:37.121 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:36 smithi152 ceph-mon[111954]: Upgrade: Need to upgrade myself (mgr.smithi190.ubusrr) 2023-12-06T15:00:37.121 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:36 smithi152 ceph-mon[111954]: Upgrade: Need to upgrade myself (mgr.smithi190.ubusrr) 2023-12-06T15:00:37.121 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:36 smithi152 ceph-mon[111954]: pgmap v30: 65 pgs: 65 active+clean; 3.4 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 172 MiB/s rd, 344 MiB/s wr, 533 op/s 2023-12-06T15:00:37.130 INFO:tasks.workunit.client.0.smithi152.stdout:0/821: dwrite d8/d3e/d87/d76/d68/fa6 [0,4194304] 0 2023-12-06T15:00:37.130 INFO:tasks.workunit.client.0.smithi152.stdout:0/822: dread - d8/d44/f91 zero size 2023-12-06T15:00:37.132 INFO:tasks.workunit.client.0.smithi152.stdout:0/823: creat d8/d3e/f10c x:0 0 0 2023-12-06T15:00:37.134 INFO:tasks.workunit.client.0.smithi152.stdout:0/824: creat d8/dcc/f10d x:0 0 0 2023-12-06T15:00:37.134 INFO:tasks.workunit.client.0.smithi152.stdout:0/825: readlink d8/d3e/lcb 0 2023-12-06T15:00:37.134 INFO:tasks.workunit.client.0.smithi152.stdout:0/826: write d8/d15/d45/d73/ddd/de1/ffa [887016,97522] 0 2023-12-06T15:00:37.134 INFO:tasks.workunit.client.0.smithi152.stdout:0/827: chown d8/d3e/c49 1796729 1 2023-12-06T15:00:37.134 INFO:tasks.workunit.client.0.smithi152.stdout:0/828: fdatasync d8/d15/d45/f4f 0 2023-12-06T15:00:37.140 INFO:tasks.workunit.client.0.smithi152.stdout:0/829: dread d8/d44/f78 [0,4194304] 0 2023-12-06T15:00:37.140 INFO:tasks.workunit.client.0.smithi152.stdout:0/830: chown d8/d15/d45/d73/cb5 164999074 1 2023-12-06T15:00:37.140 INFO:tasks.workunit.client.0.smithi152.stdout:0/831: readlink d8/le 0 2023-12-06T15:00:37.241 INFO:tasks.workunit.client.0.smithi152.stdout:8/695: sync 2023-12-06T15:00:37.241 INFO:tasks.workunit.client.0.smithi152.stdout:5/928: sync 2023-12-06T15:00:37.241 INFO:tasks.workunit.client.0.smithi152.stdout:6/975: sync 2023-12-06T15:00:37.241 INFO:tasks.workunit.client.0.smithi152.stdout:0/832: sync 2023-12-06T15:00:37.241 INFO:tasks.workunit.client.0.smithi152.stdout:3/796: sync 2023-12-06T15:00:37.241 INFO:tasks.workunit.client.0.smithi152.stdout:7/627: sync 2023-12-06T15:00:37.241 INFO:tasks.workunit.client.0.smithi152.stdout:9/759: sync 2023-12-06T15:00:37.242 INFO:tasks.workunit.client.0.smithi152.stdout:2/727: sync 2023-12-06T15:00:37.242 INFO:tasks.workunit.client.0.smithi152.stdout:8/696: mknod d1/d6/d34/d90/ce3 0 2023-12-06T15:00:37.242 INFO:tasks.workunit.client.0.smithi152.stdout:8/697: dread - d1/d6/d29/d75/fcc zero size 2023-12-06T15:00:37.242 INFO:tasks.workunit.client.0.smithi152.stdout:5/929: symlink d7/dd/l144 0 2023-12-06T15:00:37.244 INFO:tasks.workunit.client.0.smithi152.stdout:3/797: mknod d9/d10/d12/d43/d52/db4/cf5 0 2023-12-06T15:00:37.245 INFO:tasks.workunit.client.0.smithi152.stdout:6/976: mkdir d1/dcf/ddc/d1a/d30/d36/d4e/d101/d152 0 2023-12-06T15:00:37.245 INFO:tasks.workunit.client.0.smithi152.stdout:6/977: truncate d1/dcf/ddc/d1a/d30/d36/d35/d49/da6/da9/d120/ff0 932847 0 2023-12-06T15:00:37.247 INFO:tasks.workunit.client.0.smithi152.stdout:2/728: rename d6/l85 to d6/d18/d43/db3/db7/le8 0 2023-12-06T15:00:37.247 INFO:tasks.workunit.client.0.smithi152.stdout:2/729: write d6/d18/d43/f5f [427534,9946] 0 2023-12-06T15:00:37.248 INFO:tasks.workunit.client.0.smithi152.stdout:5/930: link d7/d43/d9c/d111/f121 d7/d43/d6c/f145 0 2023-12-06T15:00:37.249 INFO:tasks.workunit.client.0.smithi152.stdout:3/798: mknod d9/d18/d51/d8d/d8f/da0/dab/dc3/d91/cf6 0 2023-12-06T15:00:37.252 INFO:tasks.workunit.client.0.smithi152.stdout:6/978: rename d1/dcf/ddc/d1a/d30/d36/d35/d63/d86/f11d to d1/dcf/ddc/d1a/d30/d18/d3b/f153 0 2023-12-06T15:00:37.254 INFO:tasks.workunit.client.0.smithi152.stdout:8/698: dread d1/d6/d34/fa2 [0,4194304] 0 2023-12-06T15:00:37.254 INFO:tasks.workunit.client.0.smithi152.stdout:2/730: symlink d6/db/d17/le9 0 2023-12-06T15:00:37.256 INFO:tasks.workunit.client.0.smithi152.stdout:2/731: write d6/d1e/d7a/f7b [7880594,46192] 0 2023-12-06T15:00:37.256 INFO:tasks.workunit.client.0.smithi152.stdout:2/732: write d6/d18/d43/d95/fde [4814888,118787] 0 2023-12-06T15:00:37.256 INFO:tasks.workunit.client.0.smithi152.stdout:2/733: write d6/d1e/d41/d83/fb4 [339862,34295] 0 2023-12-06T15:00:37.259 INFO:tasks.workunit.client.0.smithi152.stdout:5/931: mkdir d7/d146 0 2023-12-06T15:00:37.259 INFO:tasks.workunit.client.0.smithi152.stdout:5/932: chown d7/dd/d26/d48/d97/dc2/fd3 235550 1 2023-12-06T15:00:37.259 INFO:tasks.workunit.client.0.smithi152.stdout:8/699: read d1/d6/d29/fd7 [3195135,119185] 0 2023-12-06T15:00:37.259 INFO:tasks.workunit.client.0.smithi152.stdout:6/979: dread d1/dcf/ddc/d1a/d30/d18/ffa [0,4194304] 0 2023-12-06T15:00:37.262 INFO:tasks.workunit.client.0.smithi152.stdout:2/734: getdents d6/d18/d43/d95 0 2023-12-06T15:00:37.262 INFO:tasks.workunit.client.0.smithi152.stdout:2/735: readlink d6/d18/d43/d95/ldc 0 2023-12-06T15:00:37.262 INFO:tasks.workunit.client.0.smithi152.stdout:9/760: dread d0/d3f/d68/d6c/d20/d38/d44/f58 [0,4194304] 0 2023-12-06T15:00:37.264 INFO:tasks.workunit.client.0.smithi152.stdout:8/700: creat d1/d6/d34/d90/fe4 x:0 0 0 2023-12-06T15:00:37.266 INFO:tasks.workunit.client.0.smithi152.stdout:6/980: creat d1/d1c/d129/f154 x:0 0 0 2023-12-06T15:00:37.267 INFO:tasks.workunit.client.0.smithi152.stdout:9/761: write d0/d3f/d68/d6c/d92/d9e/fa0 [8565,128000] 0 2023-12-06T15:00:37.267 INFO:tasks.workunit.client.0.smithi152.stdout:9/762: truncate d0/d3f/d68/d9f/fba 19829 0 2023-12-06T15:00:37.268 INFO:tasks.workunit.client.0.smithi152.stdout:2/736: rename d6/d18/d43/dc9 to d6/d1e/d41/da2/dea 0 2023-12-06T15:00:37.272 INFO:tasks.workunit.client.0.smithi152.stdout:9/763: creat d0/d3f/d68/d6c/d20/db0/fe2 x:0 0 0 2023-12-06T15:00:37.276 INFO:tasks.workunit.client.0.smithi152.stdout:9/764: creat d0/d3f/d68/d6c/d20/d38/d44/dc4/d69/db5/fe3 x:0 0 0 2023-12-06T15:00:37.277 INFO:tasks.workunit.client.0.smithi152.stdout:3/799: dwrite d9/fb8 [0,4194304] 0 2023-12-06T15:00:37.277 INFO:tasks.workunit.client.0.smithi152.stdout:9/765: creat d0/d3f/d5f/d60/fe4 x:0 0 0 2023-12-06T15:00:37.278 INFO:tasks.workunit.client.0.smithi152.stdout:3/800: creat d9/d18/d51/d8d/d8f/ff7 x:0 0 0 2023-12-06T15:00:37.281 INFO:tasks.workunit.client.0.smithi152.stdout:2/737: dread d6/db/f96 [0,4194304] 0 2023-12-06T15:00:37.281 INFO:tasks.workunit.client.0.smithi152.stdout:2/738: dread - d6/db/d91/fcc zero size 2023-12-06T15:00:37.281 INFO:tasks.workunit.client.0.smithi152.stdout:2/739: chown d6/c9 724910985 1 2023-12-06T15:00:37.281 INFO:tasks.workunit.client.0.smithi152.stdout:9/766: dread d0/d3f/d68/d6c/f3b [0,4194304] 0 2023-12-06T15:00:37.282 INFO:tasks.workunit.client.0.smithi152.stdout:2/740: symlink d6/d1e/d7a/leb 0 2023-12-06T15:00:37.284 INFO:tasks.workunit.client.0.smithi152.stdout:0/833: dwrite f5 [4194304,4194304] 0 2023-12-06T15:00:37.284 INFO:tasks.workunit.client.0.smithi152.stdout:0/834: chown d8/d44/f46 14256740 1 2023-12-06T15:00:37.284 INFO:tasks.workunit.client.0.smithi152.stdout:0/835: readlink d8/l56 0 2023-12-06T15:00:37.299 INFO:tasks.workunit.client.0.smithi152.stdout:5/933: dwrite d7/dd/d26/f10b [0,4194304] 0 2023-12-06T15:00:37.299 INFO:tasks.workunit.client.0.smithi152.stdout:5/934: chown d7/dd/d26/l6a 29815 1 2023-12-06T15:00:37.300 INFO:tasks.workunit.client.0.smithi152.stdout:6/981: dwrite d1/d89/ff2 [0,4194304] 0 2023-12-06T15:00:37.300 INFO:tasks.workunit.client.0.smithi152.stdout:7/628: dwrite dd/df/d34/d44/d49/f54 [0,4194304] 0 2023-12-06T15:00:37.301 INFO:tasks.workunit.client.0.smithi152.stdout:8/701: dwrite d1/d6/fd [4194304,4194304] 0 2023-12-06T15:00:37.302 INFO:tasks.workunit.client.0.smithi152.stdout:2/741: fsync d6/d18/d43/d95/fde 0 2023-12-06T15:00:37.302 INFO:tasks.workunit.client.0.smithi152.stdout:5/935: creat d7/d12c/dc8/f147 x:0 0 0 2023-12-06T15:00:37.302 INFO:tasks.workunit.client.0.smithi152.stdout:2/742: fsync d6/d1e/f2f 0 2023-12-06T15:00:37.302 INFO:tasks.workunit.client.0.smithi152.stdout:2/743: truncate d6/d1e/de1/f4b 4481601 0 2023-12-06T15:00:37.302 INFO:tasks.workunit.client.0.smithi152.stdout:2/744: chown d6/d18/d70/f82 372616 1 2023-12-06T15:00:37.303 INFO:tasks.workunit.client.0.smithi152.stdout:7/629: truncate f9 2642196 0 2023-12-06T15:00:37.304 INFO:tasks.workunit.client.0.smithi152.stdout:8/702: creat d1/d6/d34/d35/d8d/fe5 x:0 0 0 2023-12-06T15:00:37.304 INFO:tasks.workunit.client.0.smithi152.stdout:8/703: chown d1/d6/d29/d5b 1010857299 1 2023-12-06T15:00:37.305 INFO:tasks.workunit.client.0.smithi152.stdout:6/982: dread d1/d69/da1/d87/fe4 [0,4194304] 0 2023-12-06T15:00:37.305 INFO:tasks.workunit.client.0.smithi152.stdout:6/983: write d1/dcf/ddc/d1a/d30/d36/d35/d49/da6/da9/d120/fdb [1595246,109350] 0 2023-12-06T15:00:37.306 INFO:tasks.workunit.client.0.smithi152.stdout:5/936: rename d7/dd/d26/d3a/f133 to d7/d47/f148 0 2023-12-06T15:00:37.307 INFO:tasks.workunit.client.0.smithi152.stdout:2/745: creat d6/d1e/d41/da2/fec x:0 0 0 2023-12-06T15:00:37.307 INFO:tasks.workunit.client.0.smithi152.stdout:2/746: write d6/d18/d43/fd8 [454271,95608] 0 2023-12-06T15:00:37.309 INFO:tasks.workunit.client.0.smithi152.stdout:7/630: getdents dd/df/d1b/d20/d28/d53 0 2023-12-06T15:00:37.312 INFO:tasks.workunit.client.0.smithi152.stdout:6/984: symlink d1/dcf/ddc/d1a/d30/da4/de6/l155 0 2023-12-06T15:00:37.312 INFO:tasks.workunit.client.0.smithi152.stdout:6/985: readlink d1/dcf/ddc/d1a/d30/d36/d35/lcd 0 2023-12-06T15:00:37.312 INFO:tasks.workunit.client.0.smithi152.stdout:0/836: dwrite d8/d15/fe2 [0,4194304] 0 2023-12-06T15:00:37.313 INFO:tasks.workunit.client.0.smithi152.stdout:9/767: dwrite d0/f30 [0,4194304] 0 2023-12-06T15:00:37.314 INFO:tasks.workunit.client.0.smithi152.stdout:3/801: dwrite d9/d18/d39/fb9 [0,4194304] 0 2023-12-06T15:00:37.314 INFO:tasks.workunit.client.0.smithi152.stdout:2/747: getdents d6/d18/d70 0 2023-12-06T15:00:37.314 INFO:tasks.workunit.client.0.smithi152.stdout:3/802: dread - d9/d10/d12/d43/d52/d58/ff3 zero size 2023-12-06T15:00:37.316 INFO:tasks.workunit.client.0.smithi152.stdout:7/631: unlink dd/df/d34/f8a 0 2023-12-06T15:00:37.318 INFO:tasks.workunit.client.0.smithi152.stdout:6/986: creat d1/dcf/ddc/d1a/d30/d36/d35/dd1/d141/f156 x:0 0 0 2023-12-06T15:00:37.318 INFO:tasks.workunit.client.0.smithi152.stdout:3/803: dread d9/d10/f2e [0,4194304] 0 2023-12-06T15:00:37.319 INFO:tasks.workunit.client.0.smithi152.stdout:6/987: write d1/dcf/ddc/d1a/d30/d36/d35/d49/d57/fdf [606471,90596] 0 2023-12-06T15:00:37.323 INFO:tasks.workunit.client.0.smithi152.stdout:0/837: mknod d8/d15/d45/d99/c10e 0 2023-12-06T15:00:37.325 INFO:tasks.workunit.client.0.smithi152.stdout:9/768: mkdir d0/db8/de5 0 2023-12-06T15:00:37.325 INFO:tasks.workunit.client.0.smithi152.stdout:9/769: write d0/d3f/d68/d6c/d20/d38/da8/fc3 [177487,107565] 0 2023-12-06T15:00:37.325 INFO:tasks.workunit.client.0.smithi152.stdout:9/770: write d0/d3f/d68/d6c/d20/d38/da8/fc3 [158904,127591] 0 2023-12-06T15:00:37.326 INFO:tasks.workunit.client.0.smithi152.stdout:2/748: creat d6/d1e/d41/da2/ddd/fed x:0 0 0 2023-12-06T15:00:37.330 INFO:tasks.workunit.client.0.smithi152.stdout:7/632: creat dd/df/d34/dac/fc8 x:0 0 0 2023-12-06T15:00:37.331 INFO:tasks.workunit.client.0.smithi152.stdout:0/838: unlink d8/d15/d45/da2/fc8 0 2023-12-06T15:00:37.332 INFO:tasks.workunit.client.0.smithi152.stdout:6/988: dread d1/dcf/ddc/d1a/d30/d36/f64 [0,4194304] 0 2023-12-06T15:00:37.332 INFO:tasks.workunit.client.0.smithi152.stdout:2/749: mkdir d6/d1e/d41/d92/dbf/dee 0 2023-12-06T15:00:37.334 INFO:tasks.workunit.client.0.smithi152.stdout:7/633: symlink dd/df/d1b/d20/d28/d53/lc9 0 2023-12-06T15:00:37.334 INFO:tasks.workunit.client.0.smithi152.stdout:7/634: write dd/df/d1b/fbc [332303,95816] 0 2023-12-06T15:00:37.334 INFO:tasks.workunit.client.0.smithi152.stdout:7/635: fdatasync dd/df/d34/d44/d49/d73/d77/da2/fab 0 2023-12-06T15:00:37.335 INFO:tasks.workunit.client.0.smithi152.stdout:0/839: creat d8/d15/d45/da4/df3/f10f x:0 0 0 2023-12-06T15:00:37.336 INFO:tasks.workunit.client.0.smithi152.stdout:5/937: dwrite d7/d43/d9c/dfb/f55 [0,4194304] 0 2023-12-06T15:00:37.336 INFO:tasks.workunit.client.0.smithi152.stdout:6/989: creat d1/dcf/ddc/d1a/d30/d36/d35/d49/da6/da9/d120/f157 x:0 0 0 2023-12-06T15:00:37.338 INFO:tasks.workunit.client.0.smithi152.stdout:2/750: symlink d6/db/d91/lef 0 2023-12-06T15:00:37.338 INFO:tasks.workunit.client.0.smithi152.stdout:2/751: dread - d6/d1e/d7a/fd3 zero size 2023-12-06T15:00:37.341 INFO:tasks.workunit.client.0.smithi152.stdout:3/804: dwrite d9/d18/d51/d8d/d8f/da0/dab/dc3/d9f/dad/fba [0,4194304] 0 2023-12-06T15:00:37.341 INFO:tasks.workunit.client.0.smithi152.stdout:5/938: unlink d7/d43/d6c/f145 0 2023-12-06T15:00:37.342 INFO:tasks.workunit.client.0.smithi152.stdout:9/771: dwrite d0/d3f/d68/d6c/d20/d38/d45/f7b [0,4194304] 0 2023-12-06T15:00:37.344 INFO:tasks.workunit.client.0.smithi152.stdout:6/990: rename d1/dcf/ddc/d1a/cd3 to d1/dcf/ddc/d1a/d30/daa/d108/d146/d105/c158 0 2023-12-06T15:00:37.344 INFO:tasks.workunit.client.0.smithi152.stdout:0/840: dread d8/d15/d45/d73/d8c/fd9 [0,4194304] 0 2023-12-06T15:00:37.344 INFO:tasks.workunit.client.0.smithi152.stdout:0/841: write d8/d3e/d6f/f9d [561880,42897] 0 2023-12-06T15:00:37.345 INFO:tasks.workunit.client.0.smithi152.stdout:2/752: mkdir d6/d1e/d41/da2/df0 0 2023-12-06T15:00:37.347 INFO:tasks.workunit.client.0.smithi152.stdout:0/842: read d8/fd [502394,81575] 0 2023-12-06T15:00:37.348 INFO:tasks.workunit.client.0.smithi152.stdout:3/805: mknod d9/d18/d51/cf8 0 2023-12-06T15:00:37.350 INFO:tasks.workunit.client.0.smithi152.stdout:9/772: mkdir d0/d3f/d68/d6c/d92/d9e/de6 0 2023-12-06T15:00:37.350 INFO:tasks.workunit.client.0.smithi152.stdout:9/773: readlink d0/d3f/d68/d6c/d20/d38/d48/d90/lac 0 2023-12-06T15:00:37.352 INFO:tasks.workunit.client.0.smithi152.stdout:6/991: creat d1/dcf/ddc/d1a/f159 x:0 0 0 2023-12-06T15:00:37.352 INFO:tasks.workunit.client.0.smithi152.stdout:6/992: chown d1/dcf/ddc/d1a/d30/d36/d4e/d101 469148 1 2023-12-06T15:00:37.352 INFO:tasks.workunit.client.0.smithi152.stdout:6/993: fdatasync d1/dcf/ddc/d1a/d30/d36/d35/d49/da6/da9/d120/fed 0 2023-12-06T15:00:37.358 INFO:tasks.workunit.client.0.smithi152.stdout:7/636: getdents dd/df/d1b/d20/d28/d53 0 2023-12-06T15:00:37.361 INFO:tasks.workunit.client.0.smithi152.stdout:0/843: link d8/d3e/c107 d8/d15/d45/d73/c110 0 2023-12-06T15:00:37.362 INFO:tasks.workunit.client.0.smithi152.stdout:9/774: rename d0/d3f/d68/d6c/d20/d38/d48/d90/ca7 to d0/d3f/d68/d6c/d20/db0/db3/ce7 0 2023-12-06T15:00:37.362 INFO:tasks.workunit.client.0.smithi152.stdout:9/775: dread - d0/d3f/d68/fc6 zero size 2023-12-06T15:00:37.362 INFO:tasks.workunit.client.0.smithi152.stdout:9/776: stat d0/f15 0 2023-12-06T15:00:37.371 INFO:tasks.workunit.client.0.smithi152.stdout:7/637: creat dd/df/d34/fca x:0 0 0 2023-12-06T15:00:37.371 INFO:tasks.workunit.client.0.smithi152.stdout:7/638: stat dd/df/d34/d44/d49/d73/f75 0 2023-12-06T15:00:37.372 INFO:tasks.workunit.client.0.smithi152.stdout:9/777: mknod d0/ce8 0 2023-12-06T15:00:37.372 INFO:tasks.workunit.client.0.smithi152.stdout:9/778: readlink d0/d3f/d5f/d60/da1/lbd 0 2023-12-06T15:00:37.372 INFO:tasks.workunit.client.0.smithi152.stdout:2/753: dwrite d6/d18/d70/f82 [0,4194304] 0 2023-12-06T15:00:37.373 INFO:tasks.workunit.client.0.smithi152.stdout:9/779: dread d0/d3f/d68/d6c/d20/d38/d48/f70 [0,4194304] 0 2023-12-06T15:00:37.373 INFO:tasks.workunit.client.0.smithi152.stdout:6/994: dwrite d1/dcf/ddc/d1a/d30/d36/d4e/f5e [0,4194304] 0 2023-12-06T15:00:37.373 INFO:tasks.workunit.client.0.smithi152.stdout:2/754: read d6/d18/f81 [64361,88145] 0 2023-12-06T15:00:37.374 INFO:tasks.workunit.client.0.smithi152.stdout:2/755: chown d6/d18/d43 83718567 1 2023-12-06T15:00:37.374 INFO:tasks.workunit.client.0.smithi152.stdout:2/756: chown d6/db/d17/lc6 953403 1 2023-12-06T15:00:37.374 INFO:tasks.workunit.client.0.smithi152.stdout:2/757: read - d6/db/d17/f5e zero size 2023-12-06T15:00:37.374 INFO:tasks.workunit.client.0.smithi152.stdout:7/639: rename dd/c8f to dd/df/d34/d44/ccb 0 2023-12-06T15:00:37.375 INFO:tasks.workunit.client.0.smithi152.stdout:9/780: truncate d0/d3f/d68/d6c/d20/f5a 424624 0 2023-12-06T15:00:37.375 INFO:tasks.workunit.client.0.smithi152.stdout:9/781: write d0/d3f/d5f/d60/fe4 [927763,4010] 0 2023-12-06T15:00:37.375 INFO:tasks.workunit.client.0.smithi152.stdout:9/782: chown d0/d3f/d68/d6c/d20/d38/d45/f66 34090 1 2023-12-06T15:00:37.376 INFO:tasks.workunit.client.0.smithi152.stdout:9/783: chown d0/d3f/d68/d6c/d20/d4a/cb9 227 1 2023-12-06T15:00:37.376 INFO:tasks.workunit.client.0.smithi152.stdout:9/784: stat d0/d3f/d68/d6c/d92/fcc 0 2023-12-06T15:00:37.378 INFO:tasks.workunit.client.0.smithi152.stdout:6/995: mknod d1/d69/da1/d87/d15/c15a 0 2023-12-06T15:00:37.379 INFO:tasks.workunit.client.0.smithi152.stdout:2/758: creat d6/d18/d43/d95/ff1 x:0 0 0 2023-12-06T15:00:37.379 INFO:tasks.workunit.client.0.smithi152.stdout:2/759: chown d6/d18/d43/la7 64511979 1 2023-12-06T15:00:37.381 INFO:tasks.workunit.client.0.smithi152.stdout:9/785: creat d0/d3f/d68/d6c/d20/d38/d48/d90/fe9 x:0 0 0 2023-12-06T15:00:37.381 INFO:tasks.workunit.client.0.smithi152.stdout:7/640: write dd/df/d1b/d20/d28/d38/f39 [2223934,51206] 0 2023-12-06T15:00:37.382 INFO:tasks.workunit.client.0.smithi152.stdout:6/996: mkdir d1/dcf/ddc/d1a/d30/d36/d26/d15b 0 2023-12-06T15:00:37.383 INFO:tasks.workunit.client.0.smithi152.stdout:9/786: getdents d0/d3f/d68/d6c 0 2023-12-06T15:00:37.386 INFO:tasks.workunit.client.0.smithi152.stdout:6/997: mkdir d1/dcf/ddc/d1a/d30/d36/d35/d49/d15c 0 2023-12-06T15:00:37.388 INFO:tasks.workunit.client.0.smithi152.stdout:9/787: link d0/d3f/d68/d6c/d20/d38/d44/f8a d0/d3f/d68/d6c/d20/d38/d45/fea 0 2023-12-06T15:00:37.388 INFO:tasks.workunit.client.0.smithi152.stdout:9/788: fdatasync d0/d3f/d68/d6c/d20/d38/d44/dc4/f87 0 2023-12-06T15:00:37.388 INFO:tasks.workunit.client.0.smithi152.stdout:9/789: rename d0/d3f/d68/d6c to d0/d3f/d68/d6c/d20/d38/d48/d90/deb 22 2023-12-06T15:00:37.392 INFO:tasks.workunit.client.0.smithi152.stdout:6/998: dread d1/fea [0,4194304] 0 2023-12-06T15:00:37.393 INFO:tasks.workunit.client.0.smithi152.stdout:7/641: dread f7 [0,4194304] 0 2023-12-06T15:00:37.393 INFO:tasks.workunit.client.0.smithi152.stdout:7/642: stat dd/df/d34/d44/d49 0 2023-12-06T15:00:37.393 INFO:tasks.workunit.client.0.smithi152.stdout:7/643: dread - dd/df/d34/d44/d49/d73/d77/f8b zero size 2023-12-06T15:00:37.393 INFO:tasks.workunit.client.0.smithi152.stdout:7/644: dread - dd/df/d1b/d4e/f72 zero size 2023-12-06T15:00:37.393 INFO:tasks.workunit.client.0.smithi152.stdout:7/645: truncate dd/df/d34/d44/f5a 4953660 0 2023-12-06T15:00:37.394 INFO:tasks.workunit.client.0.smithi152.stdout:7/646: mknod dd/df/d34/d44/d49/daf/ccc 0 2023-12-06T15:00:37.394 INFO:tasks.workunit.client.0.smithi152.stdout:7/647: chown dd/df/c40 114188 1 2023-12-06T15:00:37.394 INFO:tasks.workunit.client.0.smithi152.stdout:7/648: write dd/df/d1b/d4e/f72 [676894,38487] 0 2023-12-06T15:00:37.396 INFO:tasks.workunit.client.0.smithi152.stdout:7/649: write dd/df/d34/f59 [2129460,75218] 0 2023-12-06T15:00:37.397 INFO:tasks.workunit.client.0.smithi152.stdout:2/760: dwrite d6/d1e/d7a/f9f [0,4194304] 0 2023-12-06T15:00:37.398 INFO:tasks.workunit.client.0.smithi152.stdout:7/650: mkdir dd/dcd 0 2023-12-06T15:00:37.400 INFO:tasks.workunit.client.0.smithi152.stdout:2/761: symlink d6/d18/d43/lf2 0 2023-12-06T15:00:37.400 INFO:tasks.workunit.client.0.smithi152.stdout:2/762: readlink d6/d18/d43/l71 0 2023-12-06T15:00:37.400 INFO:tasks.workunit.client.0.smithi152.stdout:2/763: chown d6/d1e/de1/c1f 0 1 2023-12-06T15:00:37.400 INFO:tasks.workunit.client.0.smithi152.stdout:2/764: readlink d6/d18/la0 0 2023-12-06T15:00:37.400 INFO:tasks.workunit.client.0.smithi152.stdout:2/765: dread - d6/d1e/d41/da2/ddd/fe6 zero size 2023-12-06T15:00:37.401 INFO:tasks.workunit.client.0.smithi152.stdout:9/790: dread d0/d3f/d68/d6c/d20/d38/f3d [0,4194304] 0 2023-12-06T15:00:37.402 INFO:tasks.workunit.client.0.smithi152.stdout:2/766: write d6/d1e/d41/f60 [1399312,94977] 0 2023-12-06T15:00:37.404 INFO:tasks.workunit.client.0.smithi152.stdout:7/651: dread dd/df/f5e [0,4194304] 0 2023-12-06T15:00:37.404 INFO:tasks.workunit.client.0.smithi152.stdout:7/652: fdatasync dd/df/d1b/d20/fba 0 2023-12-06T15:00:37.404 INFO:tasks.workunit.client.0.smithi152.stdout:9/791: mknod d0/d3f/d68/d6c/d20/d38/d44/dc4/cec 0 2023-12-06T15:00:37.405 INFO:tasks.workunit.client.0.smithi152.stdout:2/767: unlink d6/d1e/d41/d92/cd6 0 2023-12-06T15:00:37.406 INFO:tasks.workunit.client.0.smithi152.stdout:9/792: creat d0/d3f/d68/d6c/d20/d38/d44/ddf/fed x:0 0 0 2023-12-06T15:00:37.407 INFO:tasks.workunit.client.0.smithi152.stdout:2/768: truncate d6/d1e/f53 1034013 0 2023-12-06T15:00:37.408 INFO:tasks.workunit.client.0.smithi152.stdout:2/769: fdatasync d6/db/d17/f4f 0 2023-12-06T15:00:37.408 INFO:tasks.workunit.client.0.smithi152.stdout:2/770: readlink d6/l63 0 2023-12-06T15:00:37.411 INFO:tasks.workunit.client.0.smithi152.stdout:2/771: rename d6/d1e/de1/ca8 to d6/d1e/de1/cf3 0 2023-12-06T15:00:37.412 INFO:tasks.workunit.client.0.smithi152.stdout:2/772: creat d6/d1e/d41/d92/ff4 x:0 0 0 2023-12-06T15:00:37.413 INFO:tasks.workunit.client.0.smithi152.stdout:2/773: chown d6/d1e/d41/da2/ddd/ldf 75 1 2023-12-06T15:00:37.414 INFO:tasks.workunit.client.0.smithi152.stdout:7/653: dread dd/df/f1a [4194304,4194304] 0 2023-12-06T15:00:37.414 INFO:tasks.workunit.client.0.smithi152.stdout:2/774: creat d6/d1e/de1/ff5 x:0 0 0 2023-12-06T15:00:37.415 INFO:tasks.workunit.client.0.smithi152.stdout:2/775: mknod d6/d1e/d41/d92/dbf/cf6 0 2023-12-06T15:00:37.416 INFO:tasks.workunit.client.0.smithi152.stdout:2/776: symlink d6/d1e/d41/d92/dbf/lf7 0 2023-12-06T15:00:37.418 INFO:tasks.workunit.client.0.smithi152.stdout:2/777: rename d6/d18/d70/f82 to d6/d1e/d41/da2/df0/ff8 0 2023-12-06T15:00:37.419 INFO:tasks.workunit.client.0.smithi152.stdout:2/778: mkdir d6/d18/d43/db8/df9 0 2023-12-06T15:00:37.419 INFO:tasks.workunit.client.0.smithi152.stdout:2/779: symlink d6/d18/d43/db3/db7/lfa 0 2023-12-06T15:00:37.421 INFO:tasks.workunit.client.0.smithi152.stdout:7/654: dread dd/df/d1b/d20/d28/d38/f5d [0,4194304] 0 2023-12-06T15:00:37.445 INFO:tasks.workunit.client.0.smithi152.stdout:2/780: dwrite d6/d18/f81 [0,4194304] 0 2023-12-06T15:00:37.445 INFO:tasks.workunit.client.0.smithi152.stdout:2/781: chown d6/d1e/f2e 314 1 2023-12-06T15:00:37.445 INFO:tasks.workunit.client.0.smithi152.stdout:7/655: dwrite dd/df/d1b/d20/d28/d53/f3f [0,4194304] 0 2023-12-06T15:00:37.456 INFO:tasks.workunit.client.0.smithi152.stdout:2/782: dread d6/d18/d43/d95/fde [0,4194304] 0 2023-12-06T15:00:37.457 INFO:tasks.workunit.client.0.smithi152.stdout:2/783: symlink d6/d1e/d41/da2/lfb 0 2023-12-06T15:00:37.458 INFO:tasks.workunit.client.0.smithi152.stdout:7/656: dwrite dd/df/d34/dac/fc8 [0,4194304] 0 2023-12-06T15:00:37.463 INFO:tasks.workunit.client.0.smithi152.stdout:7/657: mkdir dd/df/dce 0 2023-12-06T15:00:37.463 INFO:tasks.workunit.client.0.smithi152.stdout:7/658: fdatasync dd/df/d1b/d20/d28/d38/dc3/f6c 0 2023-12-06T15:00:37.482 INFO:tasks.workunit.client.0.smithi152.stdout:2/784: dwrite d6/db/fa4 [4194304,4194304] 0 2023-12-06T15:00:37.482 INFO:tasks.workunit.client.0.smithi152.stdout:2/785: chown d6/d1e/d7a 180 1 2023-12-06T15:00:37.482 INFO:tasks.workunit.client.0.smithi152.stdout:7/659: dwrite dd/df/d1b/d20/fba [0,4194304] 0 2023-12-06T15:00:37.483 INFO:tasks.workunit.client.0.smithi152.stdout:2/786: rmdir d6/d1e/d41/d92/dbf 39 2023-12-06T15:00:37.485 INFO:tasks.workunit.client.0.smithi152.stdout:7/660: symlink dd/df/d34/d44/d49/d73/lcf 0 2023-12-06T15:00:37.485 INFO:tasks.workunit.client.0.smithi152.stdout:7/661: write dd/df/d1b/d20/d28/d53/f64 [5147504,30454] 0 2023-12-06T15:00:37.487 INFO:tasks.workunit.client.0.smithi152.stdout:7/662: creat dd/d69/d89/fd0 x:0 0 0 2023-12-06T15:00:37.488 INFO:tasks.workunit.client.0.smithi152.stdout:7/663: read dd/df/d1b/d20/d28/d53/f64 [1807987,90580] 0 2023-12-06T15:00:37.489 INFO:tasks.workunit.client.0.smithi152.stdout:7/664: symlink dd/df/d34/dac/ld1 0 2023-12-06T15:00:37.490 INFO:tasks.workunit.client.0.smithi152.stdout:7/665: creat dd/df/d34/d95/fd2 x:0 0 0 2023-12-06T15:00:37.491 INFO:tasks.workunit.client.0.smithi152.stdout:7/666: mknod dd/df/d34/d44/d49/d73/d77/db8/cd3 0 2023-12-06T15:00:37.491 INFO:tasks.workunit.client.0.smithi152.stdout:7/667: fsync dd/df/f2c 0 2023-12-06T15:00:37.492 INFO:tasks.workunit.client.0.smithi152.stdout:7/668: getdents dd/df/d34/d44/d49 0 2023-12-06T15:00:37.492 INFO:tasks.workunit.client.0.smithi152.stdout:7/669: chown dd/d69/l37 32104951 1 2023-12-06T15:00:37.492 INFO:tasks.workunit.client.0.smithi152.stdout:7/670: chown dd/df/d34/d44/d49/d73 27530 1 2023-12-06T15:00:37.492 INFO:tasks.workunit.client.0.smithi152.stdout:7/671: write dd/d69/d89/fd0 [394659,94452] 0 2023-12-06T15:00:37.492 INFO:tasks.workunit.client.0.smithi152.stdout:7/672: chown dd/df/d34/d44/d49/d73/d77 34378 1 2023-12-06T15:00:37.492 INFO:tasks.workunit.client.0.smithi152.stdout:7/673: stat dd/df 0 2023-12-06T15:00:37.492 INFO:tasks.workunit.client.0.smithi152.stdout:7/674: chown dd/l27 1038 1 2023-12-06T15:00:37.494 INFO:tasks.workunit.client.0.smithi152.stdout:7/675: rename dd/df/d34/dac/cb0 to dd/df/d1b/d20/d7c/cd4 0 2023-12-06T15:00:37.494 INFO:tasks.workunit.client.0.smithi152.stdout:7/676: fsync dd/df/d1b/d20/d28/f30 0 2023-12-06T15:00:37.495 INFO:tasks.workunit.client.0.smithi152.stdout:7/677: link dd/df/d1b/d20/d7c/db7/lc5 dd/df/d34/ld5 0 2023-12-06T15:00:37.496 INFO:tasks.workunit.client.0.smithi152.stdout:2/787: dwrite d6/d1e/d41/d83/fb4 [0,4194304] 0 2023-12-06T15:00:37.499 INFO:tasks.workunit.client.0.smithi152.stdout:7/678: dread f9 [0,4194304] 0 2023-12-06T15:00:37.499 INFO:tasks.workunit.client.0.smithi152.stdout:2/788: dread d6/d18/d43/f5f [0,4194304] 0 2023-12-06T15:00:37.500 INFO:tasks.workunit.client.0.smithi152.stdout:7/679: truncate dd/df/f5e 336575 0 2023-12-06T15:00:37.501 INFO:tasks.workunit.client.0.smithi152.stdout:2/789: mkdir d6/db/d91/dfc 0 2023-12-06T15:00:37.502 INFO:tasks.workunit.client.0.smithi152.stdout:7/680: rename dd/df/d34/d44/d49/l57 to dd/df/d34/dac/ld6 0 2023-12-06T15:00:37.503 INFO:tasks.workunit.client.0.smithi152.stdout:7/681: read dd/df/d1b/d20/f58 [2583561,15708] 0 2023-12-06T15:00:37.504 INFO:tasks.workunit.client.0.smithi152.stdout:2/790: rename d6/d1e/d41/da2/ddd/fed to d6/d1e/d41/d92/ffd 0 2023-12-06T15:00:37.504 INFO:tasks.workunit.client.0.smithi152.stdout:2/791: truncate d6/d1e/d41/d92/ff4 187102 0 2023-12-06T15:00:37.505 INFO:tasks.workunit.client.0.smithi152.stdout:7/682: mkdir dd/df/d34/d95/dd7 0 2023-12-06T15:00:37.505 INFO:tasks.workunit.client.0.smithi152.stdout:7/683: chown dd/df/d34/d44/d49/d73/fb3 396 1 2023-12-06T15:00:37.505 INFO:tasks.workunit.client.0.smithi152.stdout:2/792: creat d6/d18/d43/ffe x:0 0 0 2023-12-06T15:00:37.506 INFO:tasks.workunit.client.0.smithi152.stdout:7/684: creat dd/fd8 x:0 0 0 2023-12-06T15:00:37.508 INFO:tasks.workunit.client.0.smithi152.stdout:2/793: rename d6/d1e/d7a/ce3 to d6/d1e/d41/cff 0 2023-12-06T15:00:37.526 INFO:tasks.workunit.client.0.smithi152.stdout:7/685: dwrite dd/df/d34/d44/d49/daf/fb2 [0,4194304] 0 2023-12-06T15:00:37.526 INFO:tasks.workunit.client.0.smithi152.stdout:2/794: dwrite d6/f6a [0,4194304] 0 2023-12-06T15:00:37.526 INFO:tasks.workunit.client.0.smithi152.stdout:2/795: stat d6/d1e/d41/d92/ff4 0 2023-12-06T15:00:37.528 INFO:tasks.workunit.client.0.smithi152.stdout:2/796: unlink d6/db/d17/f28 0 2023-12-06T15:00:37.528 INFO:tasks.workunit.client.0.smithi152.stdout:2/797: truncate d6/d1e/d41/d83/fbe 222209 0 2023-12-06T15:00:37.528 INFO:tasks.workunit.client.0.smithi152.stdout:5/939: sync 2023-12-06T15:00:37.529 INFO:tasks.workunit.client.0.smithi152.stdout:8/704: sync 2023-12-06T15:00:37.530 INFO:tasks.workunit.client.0.smithi152.stdout:5/940: creat d7/d146/f149 x:0 0 0 2023-12-06T15:00:37.530 INFO:tasks.workunit.client.0.smithi152.stdout:5/941: dread - d7/d43/fe9 zero size 2023-12-06T15:00:37.530 INFO:tasks.workunit.client.0.smithi152.stdout:5/942: stat d7/dd/d26/l71 0 2023-12-06T15:00:37.530 INFO:tasks.workunit.client.0.smithi152.stdout:5/943: chown d7/dd/d26/d87/f102 101 1 2023-12-06T15:00:37.530 INFO:tasks.workunit.client.0.smithi152.stdout:7/686: write dd/df/d34/f59 [2337013,42068] 0 2023-12-06T15:00:37.531 INFO:tasks.workunit.client.0.smithi152.stdout:5/944: creat d7/dd/d26/d87/f14a x:0 0 0 2023-12-06T15:00:37.533 INFO:tasks.workunit.client.0.smithi152.stdout:7/687: mkdir dd/df/d78/dd9 0 2023-12-06T15:00:37.533 INFO:tasks.workunit.client.0.smithi152.stdout:5/945: dread - d7/d43/d9c/d111/f121 zero size 2023-12-06T15:00:37.535 INFO:tasks.workunit.client.0.smithi152.stdout:7/688: truncate dd/df/f5e 161501 0 2023-12-06T15:00:37.535 INFO:tasks.workunit.client.0.smithi152.stdout:5/946: mknod d7/dd/d26/d87/dbd/c14b 0 2023-12-06T15:00:37.537 INFO:tasks.workunit.client.0.smithi152.stdout:2/798: dread d6/fda [0,4194304] 0 2023-12-06T15:00:37.537 INFO:tasks.workunit.client.0.smithi152.stdout:2/799: chown d6/d1e/d41/d83 79 1 2023-12-06T15:00:37.537 INFO:tasks.workunit.client.0.smithi152.stdout:2/800: write d6/d18/d43/db3/db7/fc7 [418642,94936] 0 2023-12-06T15:00:37.537 INFO:tasks.workunit.client.0.smithi152.stdout:7/689: symlink dd/df/d1b/d20/d7c/d86/lda 0 2023-12-06T15:00:37.537 INFO:tasks.workunit.client.0.smithi152.stdout:5/947: creat d7/d43/d9c/dfb/f14c x:0 0 0 2023-12-06T15:00:37.538 INFO:tasks.workunit.client.0.smithi152.stdout:2/801: stat d6/d18/d43/db3/db7/le8 0 2023-12-06T15:00:37.538 INFO:tasks.workunit.client.0.smithi152.stdout:2/802: fsync d6/d1e/f77 0 2023-12-06T15:00:37.538 INFO:tasks.workunit.client.0.smithi152.stdout:2/803: chown d6/d1e/d41/da2/dea/fd2 272 1 2023-12-06T15:00:37.538 INFO:tasks.workunit.client.0.smithi152.stdout:7/690: symlink dd/df/d34/d95/dd7/ldb 0 2023-12-06T15:00:37.539 INFO:tasks.workunit.client.0.smithi152.stdout:5/948: creat d7/dd/d26/d87/dbd/f14d x:0 0 0 2023-12-06T15:00:37.540 INFO:tasks.workunit.client.0.smithi152.stdout:2/804: unlink d6/d1e/d7a/fd3 0 2023-12-06T15:00:37.542 INFO:tasks.workunit.client.0.smithi152.stdout:7/691: symlink dd/df/d34/d44/d49/d73/d77/da2/ldc 0 2023-12-06T15:00:37.544 INFO:tasks.workunit.client.0.smithi152.stdout:7/692: link dd/df/d1b/fbc dd/df/d34/d44/fdd 0 2023-12-06T15:00:37.544 INFO:tasks.workunit.client.0.smithi152.stdout:5/949: write d7/f28 [1887814,45072] 0 2023-12-06T15:00:37.544 INFO:tasks.workunit.client.0.smithi152.stdout:8/705: dwrite d1/d6/d34/d35/d8d/fe5 [0,4194304] 0 2023-12-06T15:00:37.545 INFO:tasks.workunit.client.0.smithi152.stdout:7/693: rmdir dd/df/d1b/d20/d28/d53 39 2023-12-06T15:00:37.545 INFO:tasks.workunit.client.0.smithi152.stdout:7/694: readlink dd/df/d34/d44/d49/d73/d77/l8e 0 2023-12-06T15:00:37.545 INFO:tasks.workunit.client.0.smithi152.stdout:7/695: truncate dd/df/d34/d44/fdd 822536 0 2023-12-06T15:00:37.547 INFO:tasks.workunit.client.0.smithi152.stdout:8/706: truncate d1/d6/d29/f33 1085041 0 2023-12-06T15:00:37.547 INFO:tasks.workunit.client.0.smithi152.stdout:8/707: truncate d1/d6/d34/d35/fca 1024070 0 2023-12-06T15:00:37.547 INFO:tasks.workunit.client.0.smithi152.stdout:8/708: chown d1/d6/d29/fae 3 1 2023-12-06T15:00:37.553 INFO:tasks.workunit.client.0.smithi152.stdout:8/709: mknod d1/ce6 0 2023-12-06T15:00:37.569 INFO:tasks.workunit.client.0.smithi152.stdout:2/805: dwrite d6/d18/f81 [0,4194304] 0 2023-12-06T15:00:37.574 INFO:tasks.workunit.client.0.smithi152.stdout:2/806: write d6/d18/d43/db8/fd0 [1431497,97172] 0 2023-12-06T15:00:37.574 INFO:tasks.workunit.client.0.smithi152.stdout:2/807: chown d6/db/d17/lc6 238738 1 2023-12-06T15:00:37.585 INFO:tasks.workunit.client.0.smithi152.stdout:7/696: dwrite f7 [0,4194304] 0 2023-12-06T15:00:37.586 INFO:tasks.workunit.client.0.smithi152.stdout:7/697: link dd/df/d78/f81 dd/df/d34/d44/fde 0 2023-12-06T15:00:37.587 INFO:tasks.workunit.client.0.smithi152.stdout:7/698: rename dd/df/d1b/d4e/l9d to dd/df/d1b/d20/d28/d38/ldf 0 2023-12-06T15:00:37.588 INFO:tasks.workunit.client.0.smithi152.stdout:7/699: creat dd/df/d1b/fe0 x:0 0 0 2023-12-06T15:00:37.590 INFO:tasks.workunit.client.0.smithi152.stdout:7/700: rename dd/df/d1b/d20/d28/d53/f3f to dd/df/d34/d44/d49/d73/d77/db8/fe1 0 2023-12-06T15:00:37.590 INFO:tasks.workunit.client.0.smithi152.stdout:7/701: chown dd/df/d1b/d20/d7c/d86/da4/fc4 0 1 2023-12-06T15:00:37.590 INFO:tasks.workunit.client.0.smithi152.stdout:5/950: dwrite d7/dd/d26/d48/fcf [0,4194304] 0 2023-12-06T15:00:37.590 INFO:tasks.workunit.client.0.smithi152.stdout:7/702: truncate dd/df/d1b/d20/d7c/f88 559345 0 2023-12-06T15:00:37.590 INFO:tasks.workunit.client.0.smithi152.stdout:7/703: stat dd/df/d34/fca 0 2023-12-06T15:00:37.592 INFO:tasks.workunit.client.0.smithi152.stdout:5/951: symlink d7/d43/d9c/dfb/l14e 0 2023-12-06T15:00:37.592 INFO:tasks.workunit.client.0.smithi152.stdout:5/952: chown d7/dd/d26/d3b/d46/d7e/ca5 41 1 2023-12-06T15:00:37.592 INFO:tasks.workunit.client.0.smithi152.stdout:5/953: fsync d7/d146/f149 0 2023-12-06T15:00:37.593 INFO:tasks.workunit.client.0.smithi152.stdout:5/954: rmdir d7/dd/d26/d87/dc4/ddc 39 2023-12-06T15:00:37.593 INFO:tasks.workunit.client.0.smithi152.stdout:5/955: symlink d7/dd/dfc/l14f 0 2023-12-06T15:00:37.595 INFO:tasks.workunit.client.0.smithi152.stdout:8/710: dwrite d1/d6/d34/d35/d38/f45 [0,4194304] 0 2023-12-06T15:00:37.595 INFO:tasks.workunit.client.0.smithi152.stdout:2/808: dwrite d6/d18/d43/ffe [0,4194304] 0 2023-12-06T15:00:37.602 INFO:tasks.workunit.client.0.smithi152.stdout:7/704: dread f8 [0,4194304] 0 2023-12-06T15:00:37.609 INFO:tasks.workunit.client.0.smithi152.stdout:2/809: creat d6/d1e/d41/da2/ddd/f100 x:0 0 0 2023-12-06T15:00:37.609 INFO:tasks.workunit.client.0.smithi152.stdout:7/705: creat dd/df/d34/d44/d49/d73/d77/da2/fe2 x:0 0 0 2023-12-06T15:00:37.610 INFO:tasks.workunit.client.0.smithi152.stdout:7/706: dread dd/df/d1b/d20/d28/f3e [0,4194304] 0 2023-12-06T15:00:37.610 INFO:tasks.workunit.client.0.smithi152.stdout:7/707: dread - dd/fd8 zero size 2023-12-06T15:00:37.610 INFO:tasks.workunit.client.0.smithi152.stdout:7/708: stat dd/df/d1b/d4e/l92 0 2023-12-06T15:00:37.619 INFO:tasks.workunit.client.0.smithi152.stdout:5/956: dwrite d7/dd/d26/d48/d97/dc2/fe8 [0,4194304] 0 2023-12-06T15:00:37.619 INFO:tasks.workunit.client.0.smithi152.stdout:2/810: dread d6/db/d17/f74 [4194304,4194304] 0 2023-12-06T15:00:37.619 INFO:tasks.workunit.client.0.smithi152.stdout:5/957: dread - d7/fef zero size 2023-12-06T15:00:37.619 INFO:tasks.workunit.client.0.smithi152.stdout:8/711: dwrite d1/d6/d29/d87/daa/fbe [0,4194304] 0 2023-12-06T15:00:37.623 INFO:tasks.workunit.client.0.smithi152.stdout:7/709: dread dd/df/d34/d44/d49/daf/fb2 [0,4194304] 0 2023-12-06T15:00:37.623 INFO:tasks.workunit.client.0.smithi152.stdout:8/712: rename d1/d6/d29/d5b/fb1 to d1/d6/d29/d74/fe7 0 2023-12-06T15:00:37.624 INFO:tasks.workunit.client.0.smithi152.stdout:7/710: mkdir dd/df/d34/de3 0 2023-12-06T15:00:37.626 INFO:tasks.workunit.client.0.smithi152.stdout:7/711: rmdir dd/dcd 0 2023-12-06T15:00:37.626 INFO:tasks.workunit.client.0.smithi152.stdout:7/712: chown dd/df/d1b/d4e/l9f 1502 1 2023-12-06T15:00:37.626 INFO:tasks.workunit.client.0.smithi152.stdout:7/713: truncate dd/df/d1b/d20/d7c/fa1 845302 0 2023-12-06T15:00:37.627 INFO:tasks.workunit.client.0.smithi152.stdout:8/713: write d1/d6/d34/d36/f55 [663016,93202] 0 2023-12-06T15:00:37.628 INFO:tasks.workunit.client.0.smithi152.stdout:6/999: sync 2023-12-06T15:00:37.628 INFO:tasks.workunit.client.0.smithi152.stdout:3/806: sync 2023-12-06T15:00:37.628 INFO:tasks.workunit.client.0.smithi152.stdout:0/844: sync 2023-12-06T15:00:37.628 INFO:tasks.workunit.client.0.smithi152.stdout:9/793: sync 2023-12-06T15:00:37.629 INFO:tasks.workunit.client.0.smithi152.stdout:0/845: stat d8/d15/f8e 0 2023-12-06T15:00:37.630 INFO:tasks.workunit.client.0.smithi152.stdout:9/794: getdents d0 0 2023-12-06T15:00:37.630 INFO:tasks.workunit.client.0.smithi152.stdout:9/795: truncate d0/d3f/d68/d6c/d20/d4a/d71/fd4 761217 0 2023-12-06T15:00:37.631 INFO:tasks.workunit.client.0.smithi152.stdout:3/807: symlink d9/lf9 0 2023-12-06T15:00:37.632 INFO:tasks.workunit.client.0.smithi152.stdout:3/808: truncate d9/d18/d51/d8d/d8f/da0/dab/dc3/d91/fa5 930818 0 2023-12-06T15:00:37.632 INFO:tasks.workunit.client.0.smithi152.stdout:0/846: mknod d8/d15/d45/da2/df2/c111 0 2023-12-06T15:00:37.632 INFO:tasks.workunit.client.0.smithi152.stdout:0/847: truncate d8/d3e/d87/d76/d68/f7b 764190 0 2023-12-06T15:00:37.633 INFO:tasks.workunit.client.0.smithi152.stdout:8/714: dread d1/f3c [0,4194304] 0 2023-12-06T15:00:37.633 INFO:tasks.workunit.client.0.smithi152.stdout:8/715: chown d1/d6/d34/d3a 1192204 1 2023-12-06T15:00:37.633 INFO:tasks.workunit.client.0.smithi152.stdout:3/809: link d9/d45/l60 d9/d18/d51/d8d/d8f/da0/dab/df0/lfa 0 2023-12-06T15:00:37.634 INFO:tasks.workunit.client.0.smithi152.stdout:0/848: creat d8/d3e/d87/d76/f112 x:0 0 0 2023-12-06T15:00:37.634 INFO:tasks.workunit.client.0.smithi152.stdout:0/849: readlink d8/d15/d45/l60 0 2023-12-06T15:00:37.634 INFO:tasks.workunit.client.0.smithi152.stdout:0/850: write d8/d3e/d87/d76/d6e/fee [91993,109783] 0 2023-12-06T15:00:37.634 INFO:tasks.workunit.client.0.smithi152.stdout:0/851: write d8/d15/d45/d73/db9/dc4/df4/f105 [832422,94404] 0 2023-12-06T15:00:37.634 INFO:tasks.workunit.client.0.smithi152.stdout:8/716: mkdir d1/d6/d34/d36/d58/de8 0 2023-12-06T15:00:37.635 INFO:tasks.workunit.client.0.smithi152.stdout:3/810: symlink d9/d10/d19/lfb 0 2023-12-06T15:00:37.636 INFO:tasks.workunit.client.0.smithi152.stdout:5/958: dwrite d7/dd/d26/d3b/d46/f76 [0,4194304] 0 2023-12-06T15:00:37.644 INFO:tasks.workunit.client.0.smithi152.stdout:9/796: dread d0/d3f/f78 [0,4194304] 0 2023-12-06T15:00:37.645 INFO:tasks.workunit.client.0.smithi152.stdout:9/797: stat d0/d3f/d68/d6c/d20/l2b 0 2023-12-06T15:00:37.646 INFO:tasks.workunit.client.0.smithi152.stdout:9/798: read d0/d3f/d68/d6c/d20/fc8 [542003,35555] 0 2023-12-06T15:00:37.646 INFO:tasks.workunit.client.0.smithi152.stdout:9/799: fdatasync d0/d3f/d68/d6c/d20/db0/f93 0 2023-12-06T15:00:37.688 INFO:tasks.workunit.client.0.smithi152.stdout:0/852: dwrite d8/d44/f46 [4194304,4194304] 0 2023-12-06T15:00:37.689 INFO:tasks.workunit.client.0.smithi152.stdout:0/853: mkdir d8/d3e/d87/d76/d68/d113 0 2023-12-06T15:00:37.699 INFO:tasks.workunit.client.0.smithi152.stdout:9/800: dread d0/d3f/d68/d6c/d20/f29 [0,4194304] 0 2023-12-06T15:00:37.700 INFO:tasks.workunit.client.0.smithi152.stdout:0/854: dread d8/d15/d45/d73/d7a/f5b [0,4194304] 0 2023-12-06T15:00:37.700 INFO:tasks.workunit.client.0.smithi152.stdout:0/855: truncate d8/d15/d45/d73/db9/fd0 4728581 0 2023-12-06T15:00:37.703 INFO:tasks.workunit.client.0.smithi152.stdout:5/959: dwrite d7/dd/d26/d87/fbc [0,4194304] 0 2023-12-06T15:00:37.703 INFO:tasks.workunit.client.0.smithi152.stdout:5/960: chown d7/d43/d9c/d104 2 1 2023-12-06T15:00:37.704 INFO:tasks.workunit.client.0.smithi152.stdout:9/801: dread d0/d3f/d68/d6c/f17 [4194304,4194304] 0 2023-12-06T15:00:37.705 INFO:tasks.workunit.client.0.smithi152.stdout:5/961: rename d7/dd/d26/d48/d97/ff5 to d7/d43/d9c/d111/f150 0 2023-12-06T15:00:37.706 INFO:tasks.workunit.client.0.smithi152.stdout:9/802: truncate d0/f6 407015 0 2023-12-06T15:00:37.708 INFO:tasks.workunit.client.0.smithi152.stdout:9/803: mknod d0/d3f/d5f/d60/da1/cee 0 2023-12-06T15:00:37.708 INFO:tasks.workunit.client.0.smithi152.stdout:9/804: read - d0/d3f/d68/d6c/d20/d38/d44/ddf/fed zero size 2023-12-06T15:00:37.712 INFO:tasks.workunit.client.0.smithi152.stdout:3/811: dwrite d9/d10/d12/f85 [4194304,4194304] 0 2023-12-06T15:00:37.712 INFO:tasks.workunit.client.0.smithi152.stdout:3/812: write d9/f37 [2017134,129027] 0 2023-12-06T15:00:37.721 INFO:tasks.workunit.client.0.smithi152.stdout:0/856: dwrite d8/d15/d45/d73/ddd/de1/ffc [0,4194304] 0 2023-12-06T15:00:37.721 INFO:tasks.workunit.client.0.smithi152.stdout:9/805: dread d0/d3f/d68/d6c/d20/d38/f46 [0,4194304] 0 2023-12-06T15:00:37.724 INFO:tasks.workunit.client.0.smithi152.stdout:9/806: creat d0/d3f/d68/fef x:0 0 0 2023-12-06T15:00:37.726 INFO:tasks.workunit.client.0.smithi152.stdout:0/857: symlink d8/d15/d45/d73/db9/dc4/df4/l114 0 2023-12-06T15:00:37.726 INFO:tasks.workunit.client.0.smithi152.stdout:0/858: readlink d8/d3e/d87/d76/d68/lbf 0 2023-12-06T15:00:37.729 INFO:tasks.workunit.client.0.smithi152.stdout:3/813: dwrite d9/d18/d39/f8e [0,4194304] 0 2023-12-06T15:00:37.733 INFO:tasks.workunit.client.0.smithi152.stdout:3/814: mkdir d9/d10/d19/dfc 0 2023-12-06T15:00:37.734 INFO:tasks.workunit.client.0.smithi152.stdout:0/859: dread d8/d4b/f8a [0,4194304] 0 2023-12-06T15:00:37.735 INFO:tasks.workunit.client.0.smithi152.stdout:0/860: mknod d8/d3e/d87/c115 0 2023-12-06T15:00:37.736 INFO:tasks.workunit.client.0.smithi152.stdout:0/861: dread d8/d4b/f6b [0,4194304] 0 2023-12-06T15:00:37.736 INFO:tasks.workunit.client.0.smithi152.stdout:0/862: write d8/d15/d45/da4/fb4 [582274,125810] 0 2023-12-06T15:00:37.739 INFO:tasks.workunit.client.0.smithi152.stdout:0/863: dread d8/d15/d45/da2/fbe [0,4194304] 0 2023-12-06T15:00:37.739 INFO:tasks.workunit.client.0.smithi152.stdout:0/864: read - d8/d15/d45/da4/df3/f10f zero size 2023-12-06T15:00:37.739 INFO:tasks.workunit.client.0.smithi152.stdout:0/865: chown d8/d3e/d6f/fc0 289 1 2023-12-06T15:00:37.739 INFO:tasks.workunit.client.0.smithi152.stdout:9/807: dwrite d0/d3f/d68/d6c/d20/d38/d45/f7b [0,4194304] 0 2023-12-06T15:00:37.739 INFO:tasks.workunit.client.0.smithi152.stdout:9/808: write d0/d3f/d5f/dbb/fd1 [96076,17604] 0 2023-12-06T15:00:37.742 INFO:tasks.workunit.client.0.smithi152.stdout:0/866: rmdir d8/d3e/d87/d76/d68/d113 0 2023-12-06T15:00:37.744 INFO:tasks.workunit.client.0.smithi152.stdout:9/809: link d0/d3f/d5f/d60/da1/lbd d0/d3f/d68/d6c/d20/d4a/d71/lf0 0 2023-12-06T15:00:37.745 INFO:tasks.workunit.client.0.smithi152.stdout:3/815: dread d9/d10/d12/d43/d52/d58/da9/ff2 [0,4194304] 0 2023-12-06T15:00:37.745 INFO:tasks.workunit.client.0.smithi152.stdout:0/867: creat d8/d15/d45/da4/f116 x:0 0 0 2023-12-06T15:00:37.745 INFO:tasks.workunit.client.0.smithi152.stdout:0/868: chown d8/d15/d45/d73/db9/dc4/ce6 26 1 2023-12-06T15:00:37.745 INFO:tasks.workunit.client.0.smithi152.stdout:0/869: chown d8/d3e/d87/d76/c10b 178516810 1 2023-12-06T15:00:37.746 INFO:tasks.workunit.client.0.smithi152.stdout:9/810: link d0/d3f/d68/d6c/d20/d4a/d71/c9a d0/d3f/d68/d6c/d20/d38/cf1 0 2023-12-06T15:00:37.746 INFO:tasks.workunit.client.0.smithi152.stdout:9/811: chown d0/d3f/d68/d6c/d92/fcc 0 1 2023-12-06T15:00:37.746 INFO:tasks.workunit.client.0.smithi152.stdout:9/812: dread - d0/d3f/d68/d6c/d20/d38/d44/dc4/d69/db5/fe3 zero size 2023-12-06T15:00:37.747 INFO:tasks.workunit.client.0.smithi152.stdout:9/813: chown d0/d3f/d68/d6c/d20/db0/f61 4129038 1 2023-12-06T15:00:37.747 INFO:tasks.workunit.client.0.smithi152.stdout:3/816: creat d9/d18/d51/d8d/d8f/da0/dab/dc3/d91/ffd x:0 0 0 2023-12-06T15:00:37.750 INFO:tasks.workunit.client.0.smithi152.stdout:0/870: rename d8/d3e/d87/d76/d6e to d8/d15/d45/d117 0 2023-12-06T15:00:37.750 INFO:tasks.workunit.client.0.smithi152.stdout:9/814: rmdir d0/d3f/d68/d6c/dcf 39 2023-12-06T15:00:37.750 INFO:tasks.workunit.client.0.smithi152.stdout:9/815: chown d0/d3f/d68/f6a 10 1 2023-12-06T15:00:37.750 INFO:tasks.workunit.client.0.smithi152.stdout:9/816: fdatasync d0/d3f/d68/d6c/d20/d38/da8/fdb 0 2023-12-06T15:00:37.752 INFO:tasks.workunit.client.0.smithi152.stdout:0/871: rename d8/d15/c22 to d8/d15/d45/d73/ddd/c118 0 2023-12-06T15:00:37.752 INFO:tasks.workunit.client.0.smithi152.stdout:0/872: stat d8/d15/d45/da2/df2 0 2023-12-06T15:00:37.754 INFO:tasks.workunit.client.0.smithi152.stdout:0/873: getdents d8/d15/d45/d73/d7a 0 2023-12-06T15:00:37.756 INFO:tasks.workunit.client.0.smithi152.stdout:0/874: mknod d8/d15/d45/da4/df3/c119 0 2023-12-06T15:00:37.757 INFO:tasks.workunit.client.0.smithi152.stdout:0/875: symlink d8/d3e/d87/d76/d68/l11a 0 2023-12-06T15:00:37.759 INFO:tasks.workunit.client.0.smithi152.stdout:2/811: sync 2023-12-06T15:00:37.759 INFO:tasks.workunit.client.0.smithi152.stdout:0/876: link d8/d15/l2d d8/d3e/d87/l11b 0 2023-12-06T15:00:37.760 INFO:tasks.workunit.client.0.smithi152.stdout:2/812: truncate d6/d1e/f2f 3775954 0 2023-12-06T15:00:37.761 INFO:tasks.workunit.client.0.smithi152.stdout:0/877: symlink d8/d15/d45/d83/l11c 0 2023-12-06T15:00:37.762 INFO:tasks.workunit.client.0.smithi152.stdout:2/813: mknod d6/db/d91/dfc/c101 0 2023-12-06T15:00:37.762 INFO:tasks.workunit.client.0.smithi152.stdout:0/878: write d8/d3e/d87/fc1 [2917476,14210] 0 2023-12-06T15:00:37.766 INFO:tasks.workunit.client.0.smithi152.stdout:2/814: rename d6/d1e/l7f to d6/d1e/l102 0 2023-12-06T15:00:37.773 INFO:tasks.workunit.client.0.smithi152.stdout:9/817: dwrite d0/d3f/d68/d6c/d20/db0/d94/fd8 [0,4194304] 0 2023-12-06T15:00:37.777 INFO:tasks.workunit.client.0.smithi152.stdout:9/818: dread d0/d3f/d68/d6c/d20/fc8 [0,4194304] 0 2023-12-06T15:00:37.777 INFO:tasks.workunit.client.0.smithi152.stdout:9/819: readlink d0/d3f/d68/d6c/l2c 0 2023-12-06T15:00:37.778 INFO:tasks.workunit.client.0.smithi152.stdout:9/820: symlink d0/d3f/d68/d6c/d20/db0/lf2 0 2023-12-06T15:00:37.779 INFO:tasks.workunit.client.0.smithi152.stdout:9/821: mknod d0/d3f/d68/d6c/d20/d38/d44/dc4/cf3 0 2023-12-06T15:00:37.779 INFO:tasks.workunit.client.0.smithi152.stdout:9/822: chown d0/d3f/d68/d9f/fba 3575415 1 2023-12-06T15:00:37.780 INFO:tasks.workunit.client.0.smithi152.stdout:0/879: dread d8/f17 [0,4194304] 0 2023-12-06T15:00:37.781 INFO:tasks.workunit.client.0.smithi152.stdout:9/823: rmdir d0/d3f/d68/d9f 39 2023-12-06T15:00:37.782 INFO:tasks.workunit.client.0.smithi152.stdout:0/880: mknod d8/d15/d45/d99/c11d 0 2023-12-06T15:00:37.783 INFO:tasks.workunit.client.0.smithi152.stdout:0/881: mkdir d8/d11e 0 2023-12-06T15:00:37.783 INFO:tasks.workunit.client.0.smithi152.stdout:2/815: dwrite d6/d1e/d7a/f9f [0,4194304] 0 2023-12-06T15:00:37.785 INFO:tasks.workunit.client.0.smithi152.stdout:9/824: dread d0/d3f/d5f/f9d [0,4194304] 0 2023-12-06T15:00:37.786 INFO:tasks.workunit.client.0.smithi152.stdout:9/825: write d0/d3f/d68/d6c/d20/d38/d48/d90/fa2 [1486024,85024] 0 2023-12-06T15:00:37.786 INFO:tasks.workunit.client.0.smithi152.stdout:2/816: symlink d6/d18/d70/l103 0 2023-12-06T15:00:37.787 INFO:tasks.workunit.client.0.smithi152.stdout:2/817: symlink d6/d1e/d41/d83/l104 0 2023-12-06T15:00:37.788 INFO:tasks.workunit.client.0.smithi152.stdout:2/818: creat d6/d1e/d41/da2/f105 x:0 0 0 2023-12-06T15:00:37.795 INFO:tasks.workunit.client.0.smithi152.stdout:2/819: link d6/d1e/d41/da2/fec d6/d1e/f106 0 2023-12-06T15:00:37.797 INFO:tasks.workunit.client.0.smithi152.stdout:0/882: dread d8/d3e/d87/f53 [0,4194304] 0 2023-12-06T15:00:37.799 INFO:tasks.workunit.client.0.smithi152.stdout:0/883: creat d8/d15/d45/d73/d8c/f11f x:0 0 0 2023-12-06T15:00:37.799 INFO:tasks.workunit.client.0.smithi152.stdout:0/884: chown d8/d15/d45/da4/cb2 2060056 1 2023-12-06T15:00:37.801 INFO:tasks.workunit.client.0.smithi152.stdout:9/826: dwrite d0/d3f/d68/d6c/d20/db0/f61 [0,4194304] 0 2023-12-06T15:00:37.806 INFO:tasks.workunit.client.0.smithi152.stdout:9/827: rename d0/d3f/d68/d6c/d92/d9e/fa0 to d0/d3f/d68/d6c/d20/d38/d48/d90/ff4 0 2023-12-06T15:00:37.816 INFO:tasks.workunit.client.0.smithi152.stdout:9/828: dread d0/d3f/d68/d6c/d20/d38/f3d [0,4194304] 0 2023-12-06T15:00:37.817 INFO:tasks.workunit.client.0.smithi152.stdout:9/829: mkdir d0/d3f/d68/df5 0 2023-12-06T15:00:37.819 INFO:tasks.workunit.client.0.smithi152.stdout:0/885: dwrite d8/d15/fdf [0,4194304] 0 2023-12-06T15:00:37.820 INFO:tasks.workunit.client.0.smithi152.stdout:2/820: dwrite d6/db/fa4 [0,4194304] 0 2023-12-06T15:00:37.822 INFO:tasks.workunit.client.0.smithi152.stdout:2/821: getdents d6 0 2023-12-06T15:00:37.823 INFO:tasks.workunit.client.0.smithi152.stdout:2/822: mknod d6/d18/d43/db3/db7/c107 0 2023-12-06T15:00:37.824 INFO:tasks.workunit.client.0.smithi152.stdout:2/823: mknod d6/d18/c108 0 2023-12-06T15:00:37.824 INFO:tasks.workunit.client.0.smithi152.stdout:2/824: dread - d6/db/fcf zero size 2023-12-06T15:00:37.827 INFO:tasks.workunit.client.0.smithi152.stdout:2/825: unlink d6/l42 0 2023-12-06T15:00:37.828 INFO:tasks.workunit.client.0.smithi152.stdout:9/830: dread d0/d3f/d68/d6c/d20/f51 [0,4194304] 0 2023-12-06T15:00:37.828 INFO:tasks.workunit.client.0.smithi152.stdout:9/831: chown d0/d3f 495 1 2023-12-06T15:00:37.828 INFO:tasks.workunit.client.0.smithi152.stdout:9/832: write d0/f15 [4488958,117566] 0 2023-12-06T15:00:37.829 INFO:tasks.workunit.client.0.smithi152.stdout:9/833: rmdir d0/d3f 39 2023-12-06T15:00:37.832 INFO:tasks.workunit.client.0.smithi152.stdout:2/826: dread d6/d1e/d7a/f8b [0,4194304] 0 2023-12-06T15:00:37.832 INFO:tasks.workunit.client.0.smithi152.stdout:2/827: chown d6/d18/d43/c67 3447837 1 2023-12-06T15:00:37.833 INFO:tasks.workunit.client.0.smithi152.stdout:2/828: mkdir d6/d1e/d41/da2/dea/d109 0 2023-12-06T15:00:37.835 INFO:tasks.workunit.client.0.smithi152.stdout:2/829: rmdir d6/d1e/d41/da2/ddd 39 2023-12-06T15:00:37.837 INFO:tasks.workunit.client.0.smithi152.stdout:2/830: getdents d6/d1e/d7a 0 2023-12-06T15:00:37.838 INFO:tasks.workunit.client.0.smithi152.stdout:2/831: symlink d6/d1e/l10a 0 2023-12-06T15:00:37.840 INFO:tasks.workunit.client.0.smithi152.stdout:2/832: mkdir d6/d1e/d41/d92/d10b 0 2023-12-06T15:00:37.840 INFO:tasks.workunit.client.0.smithi152.stdout:2/833: stat d6/d1e/d41/d83/fb4 0 2023-12-06T15:00:37.840 INFO:tasks.workunit.client.0.smithi152.stdout:2/834: chown d6/d1e/d41/d92/dbf/cf6 14 1 2023-12-06T15:00:37.842 INFO:tasks.workunit.client.0.smithi152.stdout:0/886: dwrite d8/d15/d45/da4/fde [4194304,4194304] 0 2023-12-06T15:00:37.843 INFO:tasks.workunit.client.0.smithi152.stdout:0/887: write d8/d4b/f51 [4192646,96172] 0 2023-12-06T15:00:37.844 INFO:tasks.workunit.client.0.smithi152.stdout:0/888: unlink d8/d44/f91 0 2023-12-06T15:00:37.847 INFO:tasks.workunit.client.0.smithi152.stdout:2/835: truncate d6/db/fa4 6061872 0 2023-12-06T15:00:37.847 INFO:tasks.workunit.client.0.smithi152.stdout:2/836: fdatasync d6/f6a 0 2023-12-06T15:00:37.848 INFO:tasks.workunit.client.0.smithi152.stdout:2/837: creat d6/d1e/d7a/f10c x:0 0 0 2023-12-06T15:00:37.850 INFO:tasks.workunit.client.0.smithi152.stdout:2/838: chown d6/d1e/l19 470763 1 2023-12-06T15:00:37.850 INFO:tasks.workunit.client.0.smithi152.stdout:2/839: chown d6/d18/l1b 472 1 2023-12-06T15:00:37.850 INFO:tasks.workunit.client.0.smithi152.stdout:2/840: write d6/d1e/d41/da2/f105 [219845,35073] 0 2023-12-06T15:00:37.850 INFO:tasks.workunit.client.0.smithi152.stdout:2/841: readlink d6/d1e/d41/ld7 0 2023-12-06T15:00:37.851 INFO:tasks.workunit.client.0.smithi152.stdout:2/842: rmdir d6/d1e/d41 39 2023-12-06T15:00:37.851 INFO:tasks.workunit.client.0.smithi152.stdout:9/834: dwrite d0/d3f/d68/fc6 [0,4194304] 0 2023-12-06T15:00:37.857 INFO:tasks.workunit.client.0.smithi152.stdout:9/835: dread d0/d3f/d68/d6c/d20/d38/d44/dc4/d69/f7a [0,4194304] 0 2023-12-06T15:00:37.857 INFO:tasks.workunit.client.0.smithi152.stdout:9/836: chown d0/d3f/d68/d6c/d20/d38/d44/dc4/d69/db5 142277736 1 2023-12-06T15:00:37.870 INFO:tasks.workunit.client.0.smithi152.stdout:0/889: dwrite d8/d15/d45/d73/db9/dc4/fff [0,4194304] 0 2023-12-06T15:00:37.870 INFO:tasks.workunit.client.0.smithi152.stdout:2/843: dwrite d6/db/f96 [4194304,4194304] 0 2023-12-06T15:00:37.871 INFO:tasks.workunit.client.0.smithi152.stdout:9/837: dread d0/d3f/d68/d6c/d20/f26 [0,4194304] 0 2023-12-06T15:00:37.875 INFO:tasks.workunit.client.0.smithi152.stdout:5/962: sync 2023-12-06T15:00:37.875 INFO:tasks.workunit.client.0.smithi152.stdout:9/838: getdents d0/d3f/d68/d6c/d20/d4a/d71 0 2023-12-06T15:00:37.875 INFO:tasks.workunit.client.0.smithi152.stdout:7/714: sync 2023-12-06T15:00:37.875 INFO:tasks.workunit.client.0.smithi152.stdout:9/839: chown d0/d3f/d68/d6c/d20/d4a/d71/c9a 1010 1 2023-12-06T15:00:37.875 INFO:tasks.workunit.client.0.smithi152.stdout:8/717: sync 2023-12-06T15:00:37.875 INFO:tasks.workunit.client.0.smithi152.stdout:8/718: readlink d1/d6/d34/l8e 0 2023-12-06T15:00:37.875 INFO:tasks.workunit.client.0.smithi152.stdout:8/719: write d1/d6/d34/d36/d58/fa5 [835708,75620] 0 2023-12-06T15:00:37.875 INFO:tasks.workunit.client.0.smithi152.stdout:8/720: readlink d1/d6/l80 0 2023-12-06T15:00:37.879 INFO:tasks.workunit.client.0.smithi152.stdout:9/840: creat d0/d3f/d5f/d60/dc9/ff6 x:0 0 0 2023-12-06T15:00:37.882 INFO:tasks.workunit.client.0.smithi152.stdout:9/841: mkdir d0/d3f/d68/d9f/df7 0 2023-12-06T15:00:37.883 INFO:tasks.workunit.client.0.smithi152.stdout:8/721: dread d1/d6/d34/d35/d8d/fe5 [0,4194304] 0 2023-12-06T15:00:37.885 INFO:tasks.workunit.client.0.smithi152.stdout:9/842: mkdir d0/d3f/d68/d6c/d20/d4a/df8 0 2023-12-06T15:00:37.889 INFO:tasks.workunit.client.0.smithi152.stdout:9/843: rmdir d0/d3f/d68/d6c/d20/d38/d45 39 2023-12-06T15:00:37.908 INFO:tasks.workunit.client.0.smithi152.stdout:9/844: dread d0/d3f/d68/d6c/d20/d38/d45/f37 [0,4194304] 0 2023-12-06T15:00:37.908 INFO:tasks.workunit.client.0.smithi152.stdout:9/845: chown d0/d3f/d68/d6c/d20/db0/fe2 63982 1 2023-12-06T15:00:37.921 INFO:tasks.workunit.client.0.smithi152.stdout:9/846: dread d0/d3f/d68/d6c/d20/d38/d44/dc4/f87 [0,4194304] 0 2023-12-06T15:00:37.923 INFO:tasks.workunit.client.0.smithi152.stdout:7/715: dwrite dd/f11 [0,4194304] 0 2023-12-06T15:00:37.923 INFO:tasks.workunit.client.0.smithi152.stdout:7/716: getdents dd/df/d34/d44/d49/daf/db1 0 2023-12-06T15:00:37.923 INFO:tasks.workunit.client.0.smithi152.stdout:7/717: fsync dd/df/fb4 0 2023-12-06T15:00:37.923 INFO:tasks.workunit.client.0.smithi152.stdout:2/844: dwrite d6/d1e/f77 [0,4194304] 0 2023-12-06T15:00:37.923 INFO:tasks.workunit.client.0.smithi152.stdout:5/963: dwrite d7/dd/f2c [0,4194304] 0 2023-12-06T15:00:37.924 INFO:tasks.workunit.client.0.smithi152.stdout:5/964: fdatasync d7/d43/fd9 0 2023-12-06T15:00:37.924 INFO:tasks.workunit.client.0.smithi152.stdout:0/890: dwrite d8/d15/d45/d73/d7a/f5b [8388608,4194304] 0 2023-12-06T15:00:37.924 INFO:tasks.workunit.client.0.smithi152.stdout:0/891: truncate d8/d44/ff7 962978 0 2023-12-06T15:00:37.924 INFO:tasks.workunit.client.0.smithi152.stdout:0/892: chown d8/d15/d45/d73 471 1 2023-12-06T15:00:37.924 INFO:tasks.workunit.client.0.smithi152.stdout:0/893: readlink d8/lc 0 2023-12-06T15:00:37.924 INFO:tasks.workunit.client.0.smithi152.stdout:9/847: truncate d0/d3f/d68/f6a 1507042 0 2023-12-06T15:00:37.924 INFO:tasks.workunit.client.0.smithi152.stdout:0/894: write d8/d4b/f8a [1106264,69770] 0 2023-12-06T15:00:37.924 INFO:tasks.workunit.client.0.smithi152.stdout:0/895: write d8/d3e/d87/f8d [985273,4041] 0 2023-12-06T15:00:37.924 INFO:tasks.workunit.client.0.smithi152.stdout:0/896: stat d8/d3e/d87/d76/d68/f7b 0 2023-12-06T15:00:37.924 INFO:tasks.workunit.client.0.smithi152.stdout:7/718: symlink dd/df/d78/le4 0 2023-12-06T15:00:37.924 INFO:tasks.workunit.client.0.smithi152.stdout:0/897: write d8/d3e/d87/f90 [2281700,103762] 0 2023-12-06T15:00:37.925 INFO:tasks.workunit.client.0.smithi152.stdout:7/719: write dd/df/f2c [2834190,13809] 0 2023-12-06T15:00:37.926 INFO:tasks.workunit.client.0.smithi152.stdout:2/845: getdents d6/db/d91 0 2023-12-06T15:00:37.926 INFO:tasks.workunit.client.0.smithi152.stdout:7/720: write f7 [3541841,80082] 0 2023-12-06T15:00:37.928 INFO:tasks.workunit.client.0.smithi152.stdout:5/965: symlink d7/d12c/dc8/l151 0 2023-12-06T15:00:37.934 INFO:tasks.workunit.client.0.smithi152.stdout:9/848: symlink d0/d3f/d68/d6c/d20/d38/d44/dd6/lf9 0 2023-12-06T15:00:37.935 INFO:tasks.workunit.client.0.smithi152.stdout:9/849: dread d0/d3f/d68/d9f/fba [0,4194304] 0 2023-12-06T15:00:37.936 INFO:tasks.workunit.client.0.smithi152.stdout:0/898: creat d8/d15/d45/d73/df5/f120 x:0 0 0 2023-12-06T15:00:37.936 INFO:tasks.workunit.client.0.smithi152.stdout:0/899: write d8/d15/d45/f4f [4735138,87149] 0 2023-12-06T15:00:37.945 INFO:tasks.workunit.client.0.smithi152.stdout:9/850: symlink d0/d3f/d5f/d60/lfa 0 2023-12-06T15:00:37.946 INFO:tasks.workunit.client.0.smithi152.stdout:0/900: creat d8/d15/d45/d73/dac/f121 x:0 0 0 2023-12-06T15:00:37.946 INFO:tasks.workunit.client.0.smithi152.stdout:0/901: write d8/d4b/f9e [607244,12596] 0 2023-12-06T15:00:37.947 INFO:tasks.workunit.client.0.smithi152.stdout:5/966: rmdir d7 39 2023-12-06T15:00:37.947 INFO:tasks.workunit.client.0.smithi152.stdout:5/967: fsync d7/dd/d26/d3b/d46/d7e/f126 0 2023-12-06T15:00:37.947 INFO:tasks.workunit.client.0.smithi152.stdout:5/968: write d7/d12c/dc8/f108 [753752,93612] 0 2023-12-06T15:00:37.947 INFO:tasks.workunit.client.0.smithi152.stdout:0/902: creat d8/d3e/d87/d76/f122 x:0 0 0 2023-12-06T15:00:37.948 INFO:tasks.workunit.client.0.smithi152.stdout:5/969: mkdir d7/dd/d26/d48/d97/d152 0 2023-12-06T15:00:37.949 INFO:tasks.workunit.client.0.smithi152.stdout:0/903: mkdir d8/d15/d45/d73/d123 0 2023-12-06T15:00:37.950 INFO:tasks.workunit.client.0.smithi152.stdout:5/970: creat d7/d43/d9c/d111/f153 x:0 0 0 2023-12-06T15:00:37.951 INFO:tasks.workunit.client.0.smithi152.stdout:5/971: fdatasync d7/d43/d9c/d111/f121 0 2023-12-06T15:00:37.952 INFO:tasks.workunit.client.0.smithi152.stdout:5/972: creat d7/dd/f154 x:0 0 0 2023-12-06T15:00:37.953 INFO:tasks.workunit.client.0.smithi152.stdout:3/817: sync 2023-12-06T15:00:37.953 INFO:tasks.workunit.client.0.smithi152.stdout:9/851: dread d0/f1c [0,4194304] 0 2023-12-06T15:00:37.955 INFO:tasks.workunit.client.0.smithi152.stdout:3/818: mknod d9/d18/d51/d8d/d8f/cfe 0 2023-12-06T15:00:37.955 INFO:tasks.workunit.client.0.smithi152.stdout:2/846: dwrite d6/db/f8a [0,4194304] 0 2023-12-06T15:00:37.955 INFO:tasks.workunit.client.0.smithi152.stdout:2/847: write d6/d1e/f2e [874771,4297] 0 2023-12-06T15:00:37.955 INFO:tasks.workunit.client.0.smithi152.stdout:2/848: read - d6/d18/d43/d95/fb2 zero size 2023-12-06T15:00:37.955 INFO:tasks.workunit.client.0.smithi152.stdout:2/849: chown d6/d1e/c21 37441 1 2023-12-06T15:00:37.956 INFO:tasks.workunit.client.0.smithi152.stdout:9/852: creat d0/d3f/d68/d9f/df7/ffb x:0 0 0 2023-12-06T15:00:37.956 INFO:tasks.workunit.client.0.smithi152.stdout:7/721: dwrite dd/df/d1b/d4e/f72 [0,4194304] 0 2023-12-06T15:00:37.958 INFO:tasks.workunit.client.0.smithi152.stdout:3/819: creat d9/fff x:0 0 0 2023-12-06T15:00:37.958 INFO:tasks.workunit.client.0.smithi152.stdout:3/820: write d9/d18/d51/d8d/d8f/fdf [32553,30427] 0 2023-12-06T15:00:37.959 INFO:tasks.workunit.client.0.smithi152.stdout:3/821: fdatasync d9/d18/f92 0 2023-12-06T15:00:37.959 INFO:tasks.workunit.client.0.smithi152.stdout:3/822: write d9/d18/d39/f8e [4842881,159] 0 2023-12-06T15:00:37.960 INFO:tasks.workunit.client.0.smithi152.stdout:2/850: symlink d6/d1e/d41/da2/df0/l10d 0 2023-12-06T15:00:37.963 INFO:tasks.workunit.client.0.smithi152.stdout:9/853: mkdir d0/d3f/d68/dfc 0 2023-12-06T15:00:37.965 INFO:tasks.workunit.client.0.smithi152.stdout:7/722: mkdir dd/df/d1b/d20/de5 0 2023-12-06T15:00:37.965 INFO:tasks.workunit.client.0.smithi152.stdout:7/723: truncate dd/df/d1b/f93 438850 0 2023-12-06T15:00:37.968 INFO:tasks.workunit.client.0.smithi152.stdout:2/851: symlink d6/d18/l10e 0 2023-12-06T15:00:37.968 INFO:tasks.workunit.client.0.smithi152.stdout:2/852: chown d6/d1e/f64 48472 1 2023-12-06T15:00:37.969 INFO:tasks.workunit.client.0.smithi152.stdout:5/973: dwrite d7/dd/d26/d3b/d46/d7e/f88 [0,4194304] 0 2023-12-06T15:00:37.969 INFO:tasks.workunit.client.0.smithi152.stdout:5/974: stat d7/f105 0 2023-12-06T15:00:37.971 INFO:tasks.workunit.client.0.smithi152.stdout:9/854: unlink d0/d3f/d68/d6c/d20/f51 0 2023-12-06T15:00:37.971 INFO:tasks.workunit.client.0.smithi152.stdout:7/724: write dd/df/d1b/d20/d7c/f84 [4080604,23153] 0 2023-12-06T15:00:37.972 INFO:tasks.workunit.client.0.smithi152.stdout:2/853: mkdir d6/d18/d43/db8/d10f 0 2023-12-06T15:00:37.976 INFO:tasks.workunit.client.0.smithi152.stdout:5/975: rmdir d7/d43/d6c/da4/d130 0 2023-12-06T15:00:37.976 INFO:tasks.workunit.client.0.smithi152.stdout:9/855: getdents d0/d3f/d68/d9f 0 2023-12-06T15:00:37.977 INFO:tasks.workunit.client.0.smithi152.stdout:2/854: creat d6/d1e/d41/d92/f110 x:0 0 0 2023-12-06T15:00:37.977 INFO:tasks.workunit.client.0.smithi152.stdout:5/976: truncate d7/d12c/dc8/f12d 1230439 0 2023-12-06T15:00:37.979 INFO:tasks.workunit.client.0.smithi152.stdout:2/855: unlink d6/l1c 0 2023-12-06T15:00:37.980 INFO:tasks.workunit.client.0.smithi152.stdout:2/856: mkdir d6/d18/d70/d111 0 2023-12-06T15:00:37.981 INFO:tasks.workunit.client.0.smithi152.stdout:9/856: write d0/d3f/d68/d6c/d20/db0/f79 [2167147,101168] 0 2023-12-06T15:00:37.981 INFO:tasks.workunit.client.0.smithi152.stdout:9/857: write d0/d3f/d5f/d60/dc9/ff6 [321473,29310] 0 2023-12-06T15:00:37.982 INFO:tasks.workunit.client.0.smithi152.stdout:9/858: mknod d0/d3f/d68/d6c/d92/d9e/de6/cfd 0 2023-12-06T15:00:37.984 INFO:tasks.workunit.client.0.smithi152.stdout:9/859: creat d0/d3f/d68/d6c/dcf/dda/de1/ffe x:0 0 0 2023-12-06T15:00:37.985 INFO:tasks.workunit.client.0.smithi152.stdout:3/823: dwrite d9/d18/d51/f54 [0,4194304] 0 2023-12-06T15:00:37.986 INFO:tasks.workunit.client.0.smithi152.stdout:9/860: mkdir d0/d3f/d68/d6c/d20/d38/d44/dc4/d69/dff 0 2023-12-06T15:00:37.986 INFO:tasks.workunit.client.0.smithi152.stdout:9/861: write d0/d3f/d68/d6c/d20/d38/d44/ddf/fed [322413,28858] 0 2023-12-06T15:00:37.989 INFO:tasks.workunit.client.0.smithi152.stdout:9/862: rename d0/d3f/d68/d6c/d20/d38/d44/f58 to d0/d3f/d68/d6c/d20/d38/d44/dc4/f100 0 2023-12-06T15:00:37.989 INFO:tasks.workunit.client.0.smithi152.stdout:2/857: write d6/d1e/de1/f4b [3007663,35134] 0 2023-12-06T15:00:37.989 INFO:tasks.workunit.client.0.smithi152.stdout:2/858: write d6/d1e/d41/f5d [1879189,104971] 0 2023-12-06T15:00:37.995 INFO:tasks.workunit.client.0.smithi152.stdout:7/725: dwrite dd/df/d34/d44/d49/d73/f75 [0,4194304] 0 2023-12-06T15:00:37.998 INFO:tasks.workunit.client.0.smithi152.stdout:7/726: mknod dd/d69/d89/ce6 0 2023-12-06T15:00:38.000 INFO:tasks.workunit.client.0.smithi152.stdout:3/824: dwrite d9/d18/d51/d8d/d8f/da0/dab/dc3/d91/fef [0,4194304] 0 2023-12-06T15:00:38.003 INFO:tasks.workunit.client.0.smithi152.stdout:2/859: dread d6/d1e/d41/f60 [0,4194304] 0 2023-12-06T15:00:38.003 INFO:tasks.workunit.client.0.smithi152.stdout:2/860: chown d6/d18/d43/db3/db7 3481327 1 2023-12-06T15:00:38.004 INFO:tasks.workunit.client.0.smithi152.stdout:9/863: dread d0/f30 [4194304,4194304] 0 2023-12-06T15:00:38.004 INFO:tasks.workunit.client.0.smithi152.stdout:3/825: write d9/d10/d12/f3e [474134,68733] 0 2023-12-06T15:00:38.004 INFO:tasks.workunit.client.0.smithi152.stdout:3/826: readlink d9/d18/d51/d8d/d8f/l97 0 2023-12-06T15:00:38.007 INFO:tasks.workunit.client.0.smithi152.stdout:9/864: creat d0/d3f/d68/d6c/d20/f101 x:0 0 0 2023-12-06T15:00:38.007 INFO:tasks.workunit.client.0.smithi152.stdout:9/865: fsync d0/d3f/d68/d6c/d20/d38/d48/f70 0 2023-12-06T15:00:38.009 INFO:tasks.workunit.client.0.smithi152.stdout:3/827: dread d9/d18/f95 [0,4194304] 0 2023-12-06T15:00:38.009 INFO:tasks.workunit.client.0.smithi152.stdout:7/727: dread dd/df/d34/d44/f8c [0,4194304] 0 2023-12-06T15:00:38.010 INFO:tasks.workunit.client.0.smithi152.stdout:3/828: link d9/d18/d51/d8d/l56 d9/d10/d12/d43/l100 0 2023-12-06T15:00:38.011 INFO:tasks.workunit.client.0.smithi152.stdout:2/861: dread d6/d1e/d41/f5d [0,4194304] 0 2023-12-06T15:00:38.011 INFO:tasks.workunit.client.0.smithi152.stdout:7/728: truncate dd/df/d1b/d20/d7c/d86/da4/fc4 545965 0 2023-12-06T15:00:38.013 INFO:tasks.workunit.client.0.smithi152.stdout:3/829: creat d9/d18/d51/d8d/d8f/da0/dab/dc3/d91/dca/f101 x:0 0 0 2023-12-06T15:00:38.013 INFO:tasks.workunit.client.0.smithi152.stdout:3/830: chown d9/d10/d12/d43/d52/db4/d65/ca7 8 1 2023-12-06T15:00:38.014 INFO:tasks.workunit.client.0.smithi152.stdout:2/862: getdents d6/d18/d43/db3/db7 0 2023-12-06T15:00:38.014 INFO:tasks.workunit.client.0.smithi152.stdout:2/863: write d6/d1e/de1/f65 [4878672,91479] 0 2023-12-06T15:00:38.014 INFO:tasks.workunit.client.0.smithi152.stdout:2/864: truncate d6/d18/d43/d95/fb2 385842 0 2023-12-06T15:00:38.014 INFO:tasks.workunit.client.0.smithi152.stdout:2/865: fdatasync d6/d1e/d41/d83/fb4 0 2023-12-06T15:00:38.014 INFO:tasks.workunit.client.0.smithi152.stdout:2/866: chown d6/d1e/c88 651123902 1 2023-12-06T15:00:38.015 INFO:tasks.workunit.client.0.smithi152.stdout:7/729: mknod dd/df/d34/d44/d49/d73/ce7 0 2023-12-06T15:00:38.016 INFO:tasks.workunit.client.0.smithi152.stdout:2/867: write d6/fda [195203,73507] 0 2023-12-06T15:00:38.018 INFO:tasks.workunit.client.0.smithi152.stdout:3/831: rename d9/d18/d51/d8d/c87 to d9/d18/d51/d8d/d8f/da0/dab/dc3/db6/c102 0 2023-12-06T15:00:38.021 INFO:tasks.workunit.client.0.smithi152.stdout:7/730: symlink dd/df/d34/d44/d49/le8 0 2023-12-06T15:00:38.025 INFO:tasks.workunit.client.0.smithi152.stdout:2/868: truncate d6/db/fa4 1086769 0 2023-12-06T15:00:38.025 INFO:tasks.workunit.client.0.smithi152.stdout:2/869: getdents d6/d18/d70/d111 0 2023-12-06T15:00:38.025 INFO:tasks.workunit.client.0.smithi152.stdout:2/870: chown d6/d1e/de1/f76 281796 1 2023-12-06T15:00:38.027 INFO:tasks.workunit.client.0.smithi152.stdout:7/731: mkdir dd/df/d34/d44/d49/d73/d77/db8/de9 0 2023-12-06T15:00:38.027 INFO:tasks.workunit.client.0.smithi152.stdout:7/732: read dd/df/d1b/f93 [5410,7753] 0 2023-12-06T15:00:38.028 INFO:tasks.workunit.client.0.smithi152.stdout:2/871: write d6/d18/d43/db3/db7/fca [2051066,39687] 0 2023-12-06T15:00:38.036 INFO:tasks.workunit.client.0.smithi152.stdout:3/832: dwrite d9/d18/d51/d8d/d8f/da0/dab/dc3/d91/fef [0,4194304] 0 2023-12-06T15:00:38.036 INFO:tasks.workunit.client.0.smithi152.stdout:9/866: dwrite d0/d3f/d68/d6c/d20/d38/d44/dc4/d69/db5/fe3 [0,4194304] 0 2023-12-06T15:00:38.043 INFO:tasks.workunit.client.0.smithi152.stdout:9/867: rmdir d0/d3f/d68/d6c/d20/d38/da8 39 2023-12-06T15:00:38.043 INFO:tasks.workunit.client.0.smithi152.stdout:9/868: fsync d0/f8 0 2023-12-06T15:00:38.043 INFO:tasks.workunit.client.0.smithi152.stdout:9/869: chown d0/d3f/d68/dfc 66 1 2023-12-06T15:00:38.045 INFO:tasks.workunit.client.0.smithi152.stdout:9/870: creat d0/d3f/d68/f102 x:0 0 0 2023-12-06T15:00:38.045 INFO:tasks.workunit.client.0.smithi152.stdout:9/871: mknod d0/d3f/d68/d6c/dcf/c103 0 2023-12-06T15:00:38.046 INFO:tasks.workunit.client.0.smithi152.stdout:9/872: mkdir d0/d3f/d5f/d60/d104 0 2023-12-06T15:00:38.050 INFO:tasks.workunit.client.0.smithi152.stdout:3/833: dread d9/d18/d51/d8d/d8f/da0/dab/dc3/d9f/dad/fba [0,4194304] 0 2023-12-06T15:00:38.050 INFO:tasks.workunit.client.0.smithi152.stdout:3/834: truncate d9/d10/d12/d43/f6d 5145686 0 2023-12-06T15:00:38.051 INFO:tasks.workunit.client.0.smithi152.stdout:3/835: symlink d9/d10/d19/dfc/l103 0 2023-12-06T15:00:38.052 INFO:tasks.workunit.client.0.smithi152.stdout:2/872: dwrite d6/db/d17/f23 [0,4194304] 0 2023-12-06T15:00:38.052 INFO:tasks.workunit.client.0.smithi152.stdout:3/836: creat d9/d18/d51/d8d/f104 x:0 0 0 2023-12-06T15:00:38.054 INFO:tasks.workunit.client.0.smithi152.stdout:2/873: unlink d6/d1e/d41/d92/c97 0 2023-12-06T15:00:38.059 INFO:tasks.workunit.client.0.smithi152.stdout:2/874: symlink d6/d1e/d41/da2/df0/l112 0 2023-12-06T15:00:38.059 INFO:tasks.workunit.client.0.smithi152.stdout:2/875: truncate d6/d1e/d41/da2/df0/ff8 4545331 0 2023-12-06T15:00:38.059 INFO:tasks.workunit.client.0.smithi152.stdout:2/876: chown d6/db/c4e 7646 1 2023-12-06T15:00:38.060 INFO:tasks.workunit.client.0.smithi152.stdout:2/877: symlink d6/l113 0 2023-12-06T15:00:38.060 INFO:tasks.workunit.client.0.smithi152.stdout:7/733: dwrite dd/df/d1b/d20/f35 [0,4194304] 0 2023-12-06T15:00:38.060 INFO:tasks.workunit.client.0.smithi152.stdout:9/873: dread d0/d3f/d68/d6c/d20/d38/d45/f66 [0,4194304] 0 2023-12-06T15:00:38.060 INFO:tasks.workunit.client.0.smithi152.stdout:9/874: getdents d0/db8/de5 0 2023-12-06T15:00:38.060 INFO:tasks.workunit.client.0.smithi152.stdout:9/875: dread - d0/d3f/d5f/d60/da9/faf zero size 2023-12-06T15:00:38.061 INFO:tasks.workunit.client.0.smithi152.stdout:7/734: creat dd/df/d34/d95/fea x:0 0 0 2023-12-06T15:00:38.061 INFO:tasks.workunit.client.0.smithi152.stdout:7/735: chown dd/df/d1b/d20/d28/d38/dc3/f6c 0 1 2023-12-06T15:00:38.062 INFO:tasks.workunit.client.0.smithi152.stdout:9/876: rename d0/d3f/d68/d6c/d20/db0/f93 to d0/d3f/d5f/d60/da1/f105 0 2023-12-06T15:00:38.062 INFO:tasks.workunit.client.0.smithi152.stdout:9/877: stat d0/d3f/d68/c9b 0 2023-12-06T15:00:38.063 INFO:tasks.workunit.client.0.smithi152.stdout:7/736: link dd/df/d1b/d20/d7c/cd4 dd/df/d1b/d20/ceb 0 2023-12-06T15:00:38.064 INFO:tasks.workunit.client.0.smithi152.stdout:2/878: read d6/d1e/de1/f4b [3453078,73895] 0 2023-12-06T15:00:38.064 INFO:tasks.workunit.client.0.smithi152.stdout:2/879: chown d6/d18/la0 81797067 1 2023-12-06T15:00:38.064 INFO:tasks.workunit.client.0.smithi152.stdout:2/880: chown d6/db/lc3 2767 1 2023-12-06T15:00:38.064 INFO:tasks.workunit.client.0.smithi152.stdout:7/737: mknod dd/df/d1b/d20/d7c/cec 0 2023-12-06T15:00:38.071 INFO:tasks.workunit.client.0.smithi152.stdout:3/837: dwrite d9/d10/d12/fd4 [0,4194304] 0 2023-12-06T15:00:38.072 INFO:tasks.workunit.client.0.smithi152.stdout:8/722: sync 2023-12-06T15:00:38.074 INFO:tasks.workunit.client.0.smithi152.stdout:3/838: creat d9/d10/d12/d43/d52/d58/da9/f105 x:0 0 0 2023-12-06T15:00:38.075 INFO:tasks.workunit.client.0.smithi152.stdout:8/723: rmdir d1/d6/d86/dcd 0 2023-12-06T15:00:38.076 INFO:tasks.workunit.client.0.smithi152.stdout:9/878: dread d0/d3f/d68/d9f/fd0 [0,4194304] 0 2023-12-06T15:00:38.077 INFO:tasks.workunit.client.0.smithi152.stdout:3/839: rename d9/d10/d12/d43/d52/d58/c66 to d9/d18/d51/d8d/d8f/da0/dab/dc3/d9f/c106 0 2023-12-06T15:00:38.080 INFO:tasks.workunit.client.0.smithi152.stdout:9/879: creat d0/d3f/d68/d6c/d20/d38/d44/dc4/d69/f106 x:0 0 0 2023-12-06T15:00:38.080 INFO:tasks.workunit.client.0.smithi152.stdout:7/738: dread dd/df/d1b/d20/d28/f68 [0,4194304] 0 2023-12-06T15:00:38.080 INFO:tasks.workunit.client.0.smithi152.stdout:2/881: dwrite d6/d1e/de1/fbd [0,4194304] 0 2023-12-06T15:00:38.081 INFO:tasks.workunit.client.0.smithi152.stdout:8/724: rmdir d1/d6/d29/d74/dd1 0 2023-12-06T15:00:38.082 INFO:tasks.workunit.client.0.smithi152.stdout:7/739: dread dd/df/d34/d44/fdd [0,4194304] 0 2023-12-06T15:00:38.082 INFO:tasks.workunit.client.0.smithi152.stdout:7/740: dread - dd/df/d1b/d20/d28/d38/fa5 zero size 2023-12-06T15:00:38.085 INFO:tasks.workunit.client.0.smithi152.stdout:2/882: creat d6/d18/d70/d111/f114 x:0 0 0 2023-12-06T15:00:38.085 INFO:tasks.workunit.client.0.smithi152.stdout:2/883: write d6/d1e/d41/d83/f93 [439326,126386] 0 2023-12-06T15:00:38.087 INFO:tasks.workunit.client.0.smithi152.stdout:7/741: chown dd/df/d1b/d20/d28/d38/l7f 2558 1 2023-12-06T15:00:38.089 INFO:tasks.workunit.client.0.smithi152.stdout:7/742: symlink dd/df/d34/d44/d49/led 0 2023-12-06T15:00:38.109 INFO:tasks.workunit.client.0.smithi152.stdout:9/880: dwrite d0/d3f/d68/d9f/df7/ffb [0,4194304] 0 2023-12-06T15:00:38.110 INFO:tasks.workunit.client.0.smithi152.stdout:7/743: dwrite dd/df/d34/d44/f8c [4194304,4194304] 0 2023-12-06T15:00:38.110 INFO:tasks.workunit.client.0.smithi152.stdout:2/884: dwrite d6/d1e/d41/d92/dbf/fce [0,4194304] 0 2023-12-06T15:00:38.110 INFO:tasks.workunit.client.0.smithi152.stdout:7/744: fsync dd/df/fb4 0 2023-12-06T15:00:38.110 INFO:tasks.workunit.client.0.smithi152.stdout:2/885: truncate d6/db/fa4 1939698 0 2023-12-06T15:00:38.112 INFO:tasks.workunit.client.0.smithi152.stdout:2/886: getdents d6 0 2023-12-06T15:00:38.112 INFO:tasks.workunit.client.0.smithi152.stdout:2/887: readlink d6/d1e/d7a/l9c 0 2023-12-06T15:00:38.115 INFO:tasks.workunit.client.0.smithi152.stdout:2/888: write d6/d18/d43/d95/fde [1864269,100127] 0 2023-12-06T15:00:38.119 INFO:tasks.workunit.client.0.smithi152.stdout:9/881: dread d0/d3f/d5f/d60/da1/f52 [0,4194304] 0 2023-12-06T15:00:38.121 INFO:tasks.workunit.client.0.smithi152.stdout:7/745: dread dd/d69/f2a [0,4194304] 0 2023-12-06T15:00:38.121 INFO:tasks.workunit.client.0.smithi152.stdout:2/889: mkdir d6/d1e/de1/d115 0 2023-12-06T15:00:38.123 INFO:tasks.workunit.client.0.smithi152.stdout:9/882: write d0/f1c [1437783,75386] 0 2023-12-06T15:00:38.126 INFO:tasks.workunit.client.0.smithi152.stdout:9/883: write d0/d3f/d68/d6c/d20/d38/da8/fdb [1151608,124466] 0 2023-12-06T15:00:38.129 INFO:tasks.workunit.client.0.smithi152.stdout:9/884: dread d0/d3f/d68/d6c/d20/d38/f67 [0,4194304] 0 2023-12-06T15:00:38.129 INFO:tasks.workunit.client.0.smithi152.stdout:9/885: fdatasync d0/d3f/d68/d6c/d20/d38/d48/f70 0 2023-12-06T15:00:38.129 INFO:tasks.workunit.client.0.smithi152.stdout:9/886: truncate d0/d3f/d68/d6c/d20/d38/d44/ddf/fed 1144076 0 2023-12-06T15:00:38.134 INFO:tasks.workunit.client.0.smithi152.stdout:9/887: unlink d0/d3f/d68/d6c/d20/d4a/d71/c75 0 2023-12-06T15:00:38.136 INFO:tasks.workunit.client.0.smithi152.stdout:9/888: rename d0/d3f/d68/d6c/d20/d4a/d71/c9a to d0/d3f/d68/d6c/d20/db0/db3/c107 0 2023-12-06T15:00:38.136 INFO:tasks.workunit.client.0.smithi152.stdout:9/889: readlink d0/ld2 0 2023-12-06T15:00:38.138 INFO:tasks.workunit.client.0.smithi152.stdout:2/890: dwrite d6/d18/d43/d95/ff1 [0,4194304] 0 2023-12-06T15:00:38.138 INFO:tasks.workunit.client.0.smithi152.stdout:2/891: stat d6/d18/d70/fba 0 2023-12-06T15:00:38.140 INFO:tasks.workunit.client.0.smithi152.stdout:2/892: rename d6/d18/d70/c94 to d6/d1e/de1/c116 0 2023-12-06T15:00:38.140 INFO:tasks.workunit.client.0.smithi152.stdout:9/890: write d0/d3f/d68/d6c/d20/db0/f61 [2139438,89977] 0 2023-12-06T15:00:38.141 INFO:tasks.workunit.client.0.smithi152.stdout:2/893: mknod d6/d1e/de1/d115/c117 0 2023-12-06T15:00:38.143 INFO:tasks.workunit.client.0.smithi152.stdout:9/891: creat d0/d3f/d68/d6c/d92/d9e/de6/f108 x:0 0 0 2023-12-06T15:00:38.145 INFO:tasks.workunit.client.0.smithi152.stdout:9/892: fsync d0/d3f/d68/d6c/d20/d38/da8/fdb 0 2023-12-06T15:00:38.146 INFO:tasks.workunit.client.0.smithi152.stdout:9/893: mknod d0/db8/c109 0 2023-12-06T15:00:38.148 INFO:tasks.workunit.client.0.smithi152.stdout:9/894: write d0/d3f/d68/d6c/d20/db0/f99 [1622283,103752] 0 2023-12-06T15:00:38.150 INFO:tasks.workunit.client.0.smithi152.stdout:9/895: mknod d0/d3f/d68/d6c/d20/d38/d48/d90/c10a 0 2023-12-06T15:00:38.150 INFO:tasks.workunit.client.0.smithi152.stdout:9/896: chown d0/d3f/d68/d6c/d20/f26 27783 1 2023-12-06T15:00:38.151 INFO:tasks.workunit.client.0.smithi152.stdout:9/897: read d0/d3f/d68/fc6 [911212,3197] 0 2023-12-06T15:00:38.151 INFO:tasks.workunit.client.0.smithi152.stdout:9/898: fdatasync d0/d3f/d5f/d60/da9/faf 0 2023-12-06T15:00:38.151 INFO:tasks.workunit.client.0.smithi152.stdout:9/899: chown d0/d3f/d5f/l88 45400 1 2023-12-06T15:00:38.151 INFO:tasks.workunit.client.0.smithi152.stdout:9/900: chown d0/d3f/d5f/d60/dc9 0 1 2023-12-06T15:00:38.151 INFO:tasks.workunit.client.0.smithi152.stdout:9/901: write d0/d3f/d68/d6c/d20/d38/f67 [1313688,65391] 0 2023-12-06T15:00:38.151 INFO:tasks.workunit.client.0.smithi152.stdout:9/902: truncate d0/d3f/d5f/dbb/fd1 1056001 0 2023-12-06T15:00:38.151 INFO:tasks.workunit.client.0.smithi152.stdout:9/903: truncate d0/d3f/d68/d6c/d20/d38/d48/d90/fa2 448930 0 2023-12-06T15:00:38.152 INFO:tasks.workunit.client.0.smithi152.stdout:9/904: write d0/f15 [5153765,99668] 0 2023-12-06T15:00:38.153 INFO:tasks.workunit.client.0.smithi152.stdout:9/905: creat d0/d3f/d68/d6c/d20/d38/d44/dc4/d69/db5/f10b x:0 0 0 2023-12-06T15:00:38.154 INFO:tasks.workunit.client.0.smithi152.stdout:9/906: creat d0/d3f/d5f/d86/f10c x:0 0 0 2023-12-06T15:00:38.154 INFO:tasks.workunit.client.0.smithi152.stdout:9/907: write d0/d3f/d68/d6c/dcf/dda/de1/ffe [638674,15852] 0 2023-12-06T15:00:38.154 INFO:tasks.workunit.client.0.smithi152.stdout:9/908: write d0/d3f/d68/d6c/d20/d38/f6e [831526,65894] 0 2023-12-06T15:00:38.154 INFO:tasks.workunit.client.0.smithi152.stdout:9/909: mknod d0/d3f/d68/d6c/d20/db0/c10d 0 2023-12-06T15:00:38.156 INFO:tasks.workunit.client.0.smithi152.stdout:0/904: sync 2023-12-06T15:00:38.157 INFO:tasks.workunit.client.0.smithi152.stdout:2/894: dwrite d6/d18/d70/f84 [0,4194304] 0 2023-12-06T15:00:38.159 INFO:tasks.workunit.client.0.smithi152.stdout:2/895: rename d6/d1e/de1/ff5 to d6/d1e/d41/d83/f118 0 2023-12-06T15:00:38.165 INFO:tasks.workunit.client.0.smithi152.stdout:9/910: dread d0/d3f/d68/d6c/d20/d38/d44/dc4/f100 [0,4194304] 0 2023-12-06T15:00:38.165 INFO:tasks.workunit.client.0.smithi152.stdout:9/911: chown d0/d3f/d5f/fca 1495397 1 2023-12-06T15:00:38.165 INFO:tasks.workunit.client.0.smithi152.stdout:9/912: readlink d0/l1f 0 2023-12-06T15:00:38.165 INFO:tasks.workunit.client.0.smithi152.stdout:2/896: truncate d6/db/f8a 571213 0 2023-12-06T15:00:38.167 INFO:tasks.workunit.client.0.smithi152.stdout:2/897: mknod d6/d1e/de1/c119 0 2023-12-06T15:00:38.167 INFO:tasks.workunit.client.0.smithi152.stdout:2/898: stat d6/db/fb1 0 2023-12-06T15:00:38.170 INFO:tasks.workunit.client.0.smithi152.stdout:9/913: dread d0/d3f/d68/d6c/d20/db0/f99 [0,4194304] 0 2023-12-06T15:00:38.171 INFO:tasks.workunit.client.0.smithi152.stdout:9/914: mknod d0/d3f/d68/d6c/d20/d38/d44/dc4/d69/c10e 0 2023-12-06T15:00:38.172 INFO:tasks.workunit.client.0.smithi152.stdout:9/915: dread d0/d3f/d5f/d60/fe4 [0,4194304] 0 2023-12-06T15:00:38.174 INFO:tasks.workunit.client.0.smithi152.stdout:9/916: link d0/d3f/d5f/d86/fc2 d0/d3f/d68/d9f/df7/f10f 0 2023-12-06T15:00:38.177 INFO:tasks.workunit.client.0.smithi152.stdout:2/899: dread f5 [4194304,4194304] 0 2023-12-06T15:00:38.180 INFO:tasks.workunit.client.0.smithi152.stdout:2/900: mknod d6/d1e/c11a 0 2023-12-06T15:00:38.181 INFO:tasks.workunit.client.0.smithi152.stdout:2/901: symlink d6/d18/d43/db8/l11b 0 2023-12-06T15:00:38.182 INFO:tasks.workunit.client.0.smithi152.stdout:2/902: creat d6/d1e/d7a/f11c x:0 0 0 2023-12-06T15:00:38.182 INFO:tasks.workunit.client.0.smithi152.stdout:2/903: chown d6/c12 1480 1 2023-12-06T15:00:38.183 INFO:tasks.workunit.client.0.smithi152.stdout:2/904: creat d6/d18/d43/db8/d10f/f11d x:0 0 0 2023-12-06T15:00:38.189 INFO:tasks.workunit.client.0.smithi152.stdout:9/917: dwrite d0/d3f/d5f/dbb/fd1 [0,4194304] 0 2023-12-06T15:00:38.195 INFO:tasks.workunit.client.0.smithi152.stdout:2/905: dread d6/d18/f32 [0,4194304] 0 2023-12-06T15:00:38.209 INFO:tasks.workunit.client.0.smithi152.stdout:9/918: dwrite d0/d3f/d68/d6c/d20/d38/d44/dc4/d69/db5/f10b [0,4194304] 0 2023-12-06T15:00:38.212 INFO:tasks.workunit.client.0.smithi152.stdout:9/919: link d0/d3f/d68/d6c/l8d d0/d3f/d68/d6c/d20/db0/db3/l110 0 2023-12-06T15:00:38.214 INFO:tasks.workunit.client.0.smithi152.stdout:9/920: mknod d0/d3f/d68/d6c/d20/d4a/d71/c111 0 2023-12-06T15:00:38.214 INFO:tasks.workunit.client.0.smithi152.stdout:9/921: readlink d0/d3f/d68/d6c/d20/d38/d44/ld9 0 2023-12-06T15:00:38.214 INFO:tasks.workunit.client.0.smithi152.stdout:9/922: fsync d0/d3f/d68/d6c/d20/fc8 0 2023-12-06T15:00:38.218 INFO:tasks.workunit.client.0.smithi152.stdout:9/923: rmdir d0/d3f/d68/df5 0 2023-12-06T15:00:38.218 INFO:tasks.workunit.client.0.smithi152.stdout:9/924: link d0/d3f/c96 d0/db8/de5/c112 0 2023-12-06T15:00:38.218 INFO:tasks.workunit.client.0.smithi152.stdout:9/925: chown d0/d3f/d68/d6c/d20/d38/d48/d90/c10a 684408 1 2023-12-06T15:00:38.218 INFO:tasks.workunit.client.0.smithi152.stdout:2/906: dwrite d6/d18/d70/fba [0,4194304] 0 2023-12-06T15:00:38.221 INFO:tasks.workunit.client.0.smithi152.stdout:9/926: dread d0/d3f/d68/f6a [0,4194304] 0 2023-12-06T15:00:38.225 INFO:tasks.workunit.client.1.smithi190.stdout:2/952: sync 2023-12-06T15:00:38.225 INFO:tasks.workunit.client.1.smithi190.stdout:5/947: sync 2023-12-06T15:00:38.225 INFO:tasks.workunit.client.1.smithi190.stdout:0/970: sync 2023-12-06T15:00:38.225 INFO:tasks.workunit.client.1.smithi190.stdout:4/944: sync 2023-12-06T15:00:38.228 INFO:tasks.workunit.client.1.smithi190.stdout:2/953: getdents d10/d26/d8a/dfa 0 2023-12-06T15:00:38.229 INFO:tasks.workunit.client.1.smithi190.stdout:0/971: symlink d0/d9d/l142 0 2023-12-06T15:00:38.231 INFO:tasks.workunit.client.1.smithi190.stdout:2/954: chown d10/d59/dcd/dad/dc4/d7f/d8e/c126 25 1 2023-12-06T15:00:38.241 INFO:tasks.workunit.client.0.smithi152.stdout:9/927: dwrite d0/d3f/d68/d6c/d20/d38/d44/dc4/d69/f106 [0,4194304] 0 2023-12-06T15:00:38.241 INFO:tasks.workunit.client.0.smithi152.stdout:9/928: chown d0/c4 14 1 2023-12-06T15:00:38.245 INFO:tasks.workunit.client.1.smithi190.stdout:2/955: dread d10/d26/d5c/d42/d9d/ff0 [0,4194304] 0 2023-12-06T15:00:38.245 INFO:tasks.workunit.client.1.smithi190.stdout:5/948: dwrite d0/d1c/d3e/dfd/f119 [0,4194304] 0 2023-12-06T15:00:38.245 INFO:tasks.workunit.client.1.smithi190.stdout:5/949: truncate d0/d1c/d85/d90/dba/fff 527301 0 2023-12-06T15:00:38.247 INFO:tasks.workunit.client.1.smithi190.stdout:2/956: symlink d10/d59/dcd/dad/d10a/l144 0 2023-12-06T15:00:38.247 INFO:tasks.workunit.client.1.smithi190.stdout:2/957: readlink d10/d26/d5c/d35/l5f 0 2023-12-06T15:00:38.249 INFO:tasks.workunit.client.1.smithi190.stdout:5/950: rmdir d0/d1c/d2b/d8b/dd7 39 2023-12-06T15:00:38.250 INFO:tasks.workunit.client.1.smithi190.stdout:2/958: stat d10/d26/d5c/d42/f6c 0 2023-12-06T15:00:38.250 INFO:tasks.workunit.client.1.smithi190.stdout:2/959: chown d10/d26/d5c/d35/f124 49668 1 2023-12-06T15:00:38.252 INFO:tasks.workunit.client.1.smithi190.stdout:2/960: rename l7 to d10/d59/dcd/d12d/l145 0 2023-12-06T15:00:38.253 INFO:tasks.workunit.client.1.smithi190.stdout:2/961: dread d10/d26/d5c/d49/d54/f5d [4194304,4194304] 0 2023-12-06T15:00:38.253 INFO:tasks.workunit.client.1.smithi190.stdout:2/962: dread - d10/d59/dcd/dad/fb9 zero size 2023-12-06T15:00:38.254 INFO:tasks.workunit.client.1.smithi190.stdout:2/963: mkdir d10/d59/dcd/dad/dc9/d146 0 2023-12-06T15:00:38.259 INFO:tasks.workunit.client.1.smithi190.stdout:2/964: rmdir d10/d26 39 2023-12-06T15:00:38.261 INFO:tasks.workunit.client.1.smithi190.stdout:2/965: rmdir d10/d26/d5c/d49/d7e/dcf 39 2023-12-06T15:00:38.264 INFO:tasks.workunit.client.1.smithi190.stdout:2/966: mkdir d10/d26/d5c/d35/d77/d98/d147 0 2023-12-06T15:00:38.274 INFO:tasks.workunit.client.1.smithi190.stdout:5/951: dwrite d0/d1c/d94/fc4 [0,4194304] 0 2023-12-06T15:00:38.276 INFO:tasks.workunit.client.1.smithi190.stdout:5/952: mkdir d0/d6c/d145 0 2023-12-06T15:00:38.276 INFO:tasks.workunit.client.1.smithi190.stdout:5/953: truncate d0/d1c/d2b/d8b/dd7/fe9 27214 0 2023-12-06T15:00:38.276 INFO:tasks.workunit.client.1.smithi190.stdout:5/954: chown d0/l42 9888 1 2023-12-06T15:00:38.276 INFO:tasks.workunit.client.1.smithi190.stdout:5/955: chown d0/f18 1 1 2023-12-06T15:00:38.277 INFO:tasks.workunit.client.0.smithi152.stdout:2/907: creat d6/d18/d70/d111/f11e x:0 0 0 2023-12-06T15:00:38.279 INFO:tasks.workunit.client.1.smithi190.stdout:2/967: dread ff [4194304,4194304] 0 2023-12-06T15:00:38.281 INFO:tasks.workunit.client.1.smithi190.stdout:2/968: write d10/d26/d8a/d8f/fa7 [1816269,76754] 0 2023-12-06T15:00:38.282 INFO:tasks.workunit.client.0.smithi152.stdout:5/977: sync 2023-12-06T15:00:38.283 INFO:tasks.workunit.client.0.smithi152.stdout:2/908: dread d6/d1e/de1/f14 [0,4194304] 0 2023-12-06T15:00:38.284 INFO:tasks.workunit.client.0.smithi152.stdout:2/909: fsync d6/db/d17/fd1 0 2023-12-06T15:00:38.286 INFO:tasks.workunit.client.0.smithi152.stdout:2/910: write d6/d18/d43/ffe [314705,68277] 0 2023-12-06T15:00:38.286 INFO:tasks.workunit.client.0.smithi152.stdout:2/911: write d6/d1e/d7a/f11c [812631,26114] 0 2023-12-06T15:00:38.288 INFO:tasks.workunit.client.0.smithi152.stdout:9/929: creat d0/d3f/d68/d6c/d20/db0/f113 x:0 0 0 2023-12-06T15:00:38.289 INFO:tasks.workunit.client.1.smithi190.stdout:5/956: write d0/df/f2e [3172767,15612] 0 2023-12-06T15:00:38.290 INFO:tasks.workunit.client.0.smithi152.stdout:5/978: dread d7/dd/d26/d3a/f4f [0,4194304] 0 2023-12-06T15:00:38.293 INFO:tasks.workunit.client.0.smithi152.stdout:2/912: mknod d6/d1e/d41/d92/dbf/c11f 0 2023-12-06T15:00:38.294 INFO:tasks.workunit.client.0.smithi152.stdout:9/930: symlink d0/d3f/d5f/dbb/l114 0 2023-12-06T15:00:38.295 INFO:tasks.workunit.client.0.smithi152.stdout:5/979: symlink d7/d43/d6c/d113/l155 0 2023-12-06T15:00:38.295 INFO:tasks.workunit.client.0.smithi152.stdout:5/980: dread - d7/d43/fe9 zero size 2023-12-06T15:00:38.297 INFO:tasks.workunit.client.0.smithi152.stdout:2/913: mknod d6/d1e/d41/da2/df0/c120 0 2023-12-06T15:00:38.297 INFO:tasks.workunit.client.0.smithi152.stdout:2/914: stat d6/d1e/d41/f60 0 2023-12-06T15:00:38.298 INFO:tasks.workunit.client.0.smithi152.stdout:9/931: mknod d0/d3f/d5f/d60/dc9/c115 0 2023-12-06T15:00:38.299 INFO:tasks.workunit.client.1.smithi190.stdout:2/969: dwrite d10/d26/d5c/d8d/f113 [0,4194304] 0 2023-12-06T15:00:38.302 INFO:tasks.workunit.client.0.smithi152.stdout:2/915: rename d6/d1e/d41/da2/fec to d6/d1e/d41/da2/ddd/f121 0 2023-12-06T15:00:38.302 INFO:tasks.workunit.client.1.smithi190.stdout:5/957: dread d0/d1c/d85/d90/d99/fc3 [0,4194304] 0 2023-12-06T15:00:38.305 INFO:tasks.workunit.client.0.smithi152.stdout:9/932: creat d0/d3f/d5f/d60/dc9/f116 x:0 0 0 2023-12-06T15:00:38.305 INFO:tasks.workunit.client.0.smithi152.stdout:9/933: dread - d0/d3f/d68/d9f/fd5 zero size 2023-12-06T15:00:38.305 INFO:tasks.workunit.client.0.smithi152.stdout:9/934: write d0/d3f/d68/d6c/d20/db0/db3/fc0 [680769,54911] 0 2023-12-06T15:00:38.312 INFO:tasks.workunit.client.0.smithi152.stdout:2/916: dread d6/d1e/d7a/f9f [0,4194304] 0 2023-12-06T15:00:38.314 INFO:tasks.workunit.client.0.smithi152.stdout:2/917: creat d6/d18/d43/db8/d10f/f122 x:0 0 0 2023-12-06T15:00:38.317 INFO:tasks.workunit.client.0.smithi152.stdout:2/918: mkdir d6/db/d17/d123 0 2023-12-06T15:00:38.318 INFO:tasks.workunit.client.1.smithi190.stdout:5/958: dwrite d0/d6c/da7/fbb [0,4194304] 0 2023-12-06T15:00:38.318 INFO:tasks.workunit.client.0.smithi152.stdout:2/919: symlink d6/d1e/d41/d83/l124 0 2023-12-06T15:00:38.319 INFO:tasks.workunit.client.0.smithi152.stdout:2/920: rmdir d6/d1e/d41/da2/dea 39 2023-12-06T15:00:38.332 INFO:tasks.workunit.client.1.smithi190.stdout:5/959: dwrite d0/d1c/d3e/dfd/f12e [0,4194304] 0 2023-12-06T15:00:38.332 INFO:tasks.workunit.client.1.smithi190.stdout:5/960: fsync d0/d1c/d2b/fdf 0 2023-12-06T15:00:38.334 INFO:tasks.workunit.client.1.smithi190.stdout:5/961: truncate d0/df/d50/f86 979155 0 2023-12-06T15:00:38.335 INFO:tasks.workunit.client.1.smithi190.stdout:5/962: rmdir d0/d1c/d85/d133 39 2023-12-06T15:00:38.335 INFO:tasks.workunit.client.1.smithi190.stdout:5/963: chown d0/d1c/d2b/d2c/c7d 0 1 2023-12-06T15:00:38.335 INFO:tasks.workunit.client.1.smithi190.stdout:5/964: fdatasync d0/d1c/d85/d90/dba/fd6 0 2023-12-06T15:00:38.338 INFO:tasks.workunit.client.1.smithi190.stdout:5/965: creat d0/d1c/d2b/d2c/d5d/d73/d116/d112/d134/f146 x:0 0 0 2023-12-06T15:00:38.351 INFO:tasks.workunit.client.1.smithi190.stdout:5/966: dwrite d0/d1c/d2b/d8b/dd7/fe9 [0,4194304] 0 2023-12-06T15:00:38.359 INFO:tasks.workunit.client.1.smithi190.stdout:5/967: dread d0/d1c/d2b/d2c/f45 [0,4194304] 0 2023-12-06T15:00:38.365 INFO:tasks.workunit.client.1.smithi190.stdout:5/968: dread d0/d1c/d2b/d2c/d5d/d73/f58 [0,4194304] 0 2023-12-06T15:00:38.366 INFO:tasks.workunit.client.1.smithi190.stdout:5/969: symlink d0/d1c/d2b/d2c/d5d/d73/d116/dc5/l147 0 2023-12-06T15:00:38.367 INFO:tasks.workunit.client.0.smithi152.stdout:9/935: creat d0/d3f/d68/d6c/f117 x:0 0 0 2023-12-06T15:00:38.367 INFO:tasks.workunit.client.0.smithi152.stdout:9/936: fsync d0/d3f/d68/d6c/d20/d38/f46 0 2023-12-06T15:00:38.367 INFO:tasks.workunit.client.0.smithi152.stdout:9/937: symlink d0/d3f/d68/d6c/d20/d4a/d71/l118 0 2023-12-06T15:00:38.368 INFO:tasks.workunit.client.1.smithi190.stdout:5/970: rename d0/d1c/d3e/l40 to d0/d6c/da7/df3/l148 0 2023-12-06T15:00:38.369 INFO:tasks.workunit.client.0.smithi152.stdout:9/938: rename d0/d3f/d68/d6c/d20/d38/d48/d90/lbf to d0/d3f/d68/d6c/d92/d9e/l119 0 2023-12-06T15:00:38.369 INFO:tasks.workunit.client.0.smithi152.stdout:9/939: truncate d0/d3f/d68/f102 1374 0 2023-12-06T15:00:38.370 INFO:tasks.workunit.client.0.smithi152.stdout:9/940: write d0/d3f/d68/d6c/d20/d38/d45/f7b [449219,89687] 0 2023-12-06T15:00:38.370 INFO:tasks.workunit.client.0.smithi152.stdout:9/941: chown d0/d3f/d5f/d86/f10c 493 1 2023-12-06T15:00:38.371 INFO:tasks.workunit.client.0.smithi152.stdout:9/942: dread - d0/d3f/d68/d6c/d20/d38/d48/d90/fe9 zero size 2023-12-06T15:00:38.372 INFO:tasks.workunit.client.0.smithi152.stdout:9/943: mknod d0/d3f/d68/d6c/d20/d38/d44/dc4/c11a 0 2023-12-06T15:00:38.373 INFO:tasks.workunit.client.0.smithi152.stdout:9/944: symlink d0/d3f/d68/d6c/d20/db0/d94/l11b 0 2023-12-06T15:00:38.374 INFO:tasks.workunit.client.0.smithi152.stdout:9/945: read d0/d3f/d68/d6c/d20/d38/d44/dc4/f100 [119724,55585] 0 2023-12-06T15:00:38.374 INFO:tasks.workunit.client.0.smithi152.stdout:9/946: dread - d0/d3f/d5f/d60/da9/faf zero size 2023-12-06T15:00:38.375 INFO:tasks.workunit.client.0.smithi152.stdout:9/947: mkdir d0/d3f/d5f/d60/dc9/d11c 0 2023-12-06T15:00:38.376 INFO:tasks.workunit.client.0.smithi152.stdout:9/948: rmdir d0/d3f/d68/d6c/d20/d38/d48 39 2023-12-06T15:00:38.377 INFO:tasks.workunit.client.0.smithi152.stdout:9/949: stat d0/d3f/d68/d6c/d20/d38/f46 0 2023-12-06T15:00:38.381 INFO:tasks.workunit.client.1.smithi190.stdout:5/971: dwrite d0/df/d50/fad [0,4194304] 0 2023-12-06T15:00:38.384 INFO:tasks.workunit.client.0.smithi152.stdout:9/950: rmdir d0/d3f/d68/d6c/d20 39 2023-12-06T15:00:38.385 INFO:tasks.workunit.client.0.smithi152.stdout:9/951: creat d0/d3f/d68/d6c/d20/d38/da8/f11d x:0 0 0 2023-12-06T15:00:38.399 INFO:tasks.workunit.client.0.smithi152.stdout:9/952: dwrite d0/f15 [0,4194304] 0 2023-12-06T15:00:38.401 INFO:tasks.workunit.client.0.smithi152.stdout:9/953: unlink d0/d3f/d68/d6c/d20/d38/d44/dc4/fa6 0 2023-12-06T15:00:38.402 INFO:tasks.workunit.client.0.smithi152.stdout:9/954: symlink d0/d3f/d68/d6c/d20/d38/d44/dc4/d69/db5/l11e 0 2023-12-06T15:00:38.404 INFO:tasks.workunit.client.0.smithi152.stdout:9/955: rename d0/d3f/d68/d6c/d20/d38/d48/d90/f97 to d0/d3f/d68/d6c/d20/d4a/df8/f11f 0 2023-12-06T15:00:38.406 INFO:tasks.workunit.client.0.smithi152.stdout:9/956: rmdir d0/d3f/d5f/d60/da9 39 2023-12-06T15:00:38.408 INFO:tasks.workunit.client.0.smithi152.stdout:9/957: rename d0/d3f/d68/d6c/d20/d38/d44/fd7 to d0/d3f/d68/d6c/d20/d38/d45/f120 0 2023-12-06T15:00:38.409 INFO:tasks.workunit.client.0.smithi152.stdout:9/958: getdents d0/d3f/d68/d6c/d20/d4a 0 2023-12-06T15:00:38.410 INFO:tasks.workunit.client.0.smithi152.stdout:9/959: mkdir d0/d3f/d68/dfc/d121 0 2023-12-06T15:00:38.413 INFO:tasks.workunit.client.0.smithi152.stdout:9/960: rename d0/d3f/d5f/d60/dc9 to d0/d3f/d68/d6c/d92/d122 0 2023-12-06T15:00:38.414 INFO:tasks.workunit.client.0.smithi152.stdout:9/961: creat d0/d3f/d68/d6c/d20/d38/f123 x:0 0 0 2023-12-06T15:00:38.416 INFO:tasks.workunit.client.0.smithi152.stdout:9/962: rename d0/d3f/d68/d6c/d20/db0 to d0/db8/de5/d124 0 2023-12-06T15:00:38.416 INFO:tasks.workunit.client.0.smithi152.stdout:9/963: write d0/db8/de5/d124/db3/fc0 [778651,20386] 0 2023-12-06T15:00:38.417 INFO:tasks.workunit.client.0.smithi152.stdout:9/964: rmdir d0/d3f/d68/d6c/d20/d38/d44/dc4/d69 39 2023-12-06T15:00:38.417 INFO:tasks.workunit.client.0.smithi152.stdout:9/965: dread - d0/d3f/d68/d6c/d92/fcc zero size 2023-12-06T15:00:38.417 INFO:tasks.workunit.client.0.smithi152.stdout:9/966: write d0/d3f/d68/d6c/d92/d122/ff6 [710897,103850] 0 2023-12-06T15:00:38.417 INFO:tasks.workunit.client.0.smithi152.stdout:9/967: mknod d0/d3f/d68/d6c/d20/d4a/d71/db1/c125 0 2023-12-06T15:00:38.418 INFO:tasks.workunit.client.0.smithi152.stdout:9/968: creat d0/d3f/d68/d9f/f126 x:0 0 0 2023-12-06T15:00:38.419 INFO:tasks.workunit.client.0.smithi152.stdout:9/969: write d0/db8/de5/d124/f99 [484872,88074] 0 2023-12-06T15:00:38.421 INFO:tasks.workunit.client.0.smithi152.stdout:9/970: unlink d0/d3f/d68/d6c/d20/d38/d45/c8c 0 2023-12-06T15:00:38.421 INFO:tasks.workunit.client.0.smithi152.stdout:9/971: creat d0/d3f/d68/d9f/df7/f127 x:0 0 0 2023-12-06T15:00:38.422 INFO:tasks.workunit.client.0.smithi152.stdout:9/972: mknod d0/d3f/d68/d6c/d92/d122/c128 0 2023-12-06T15:00:38.422 INFO:tasks.workunit.client.0.smithi152.stdout:9/973: fsync d0/d3f/d5f/dbb/fd1 0 2023-12-06T15:00:38.422 INFO:tasks.workunit.client.0.smithi152.stdout:9/974: fsync d0/d3f/d5f/d60/fe4 0 2023-12-06T15:00:38.423 INFO:tasks.workunit.client.0.smithi152.stdout:9/975: rename d0/d3f/d68/d6c/d20/d4a/l7e to d0/d3f/d68/d6c/l129 0 2023-12-06T15:00:38.440 INFO:tasks.workunit.client.0.smithi152.stdout:9/976: dwrite d0/d3f/d68/d6c/d20/f3c [0,4194304] 0 2023-12-06T15:00:38.440 INFO:tasks.workunit.client.0.smithi152.stdout:9/977: write d0/db8/de5/d124/f113 [133992,85059] 0 2023-12-06T15:00:38.442 INFO:tasks.workunit.client.0.smithi152.stdout:8/725: sync 2023-12-06T15:00:38.442 INFO:tasks.workunit.client.0.smithi152.stdout:3/840: sync 2023-12-06T15:00:38.444 INFO:tasks.workunit.client.0.smithi152.stdout:3/841: getdents d9/d10/d12/d43/d52/db4 0 2023-12-06T15:00:38.444 INFO:tasks.workunit.client.0.smithi152.stdout:8/726: creat d1/d6/d34/d35/d8d/fe9 x:0 0 0 2023-12-06T15:00:38.446 INFO:tasks.workunit.client.0.smithi152.stdout:3/842: creat d9/d18/d51/d8d/d8f/da0/dab/dc3/db6/f107 x:0 0 0 2023-12-06T15:00:38.446 INFO:tasks.workunit.client.0.smithi152.stdout:3/843: dread - d9/fff zero size 2023-12-06T15:00:38.447 INFO:tasks.workunit.client.0.smithi152.stdout:3/844: symlink d9/d45/d9c/l108 0 2023-12-06T15:00:38.460 INFO:tasks.workunit.client.0.smithi152.stdout:3/845: dread d9/d10/d19/f2c [0,4194304] 0 2023-12-06T15:00:38.461 INFO:tasks.workunit.client.0.smithi152.stdout:9/978: dwrite d0/d3f/d68/d6c/d92/d9e/de6/f108 [0,4194304] 0 2023-12-06T15:00:38.462 INFO:tasks.workunit.client.0.smithi152.stdout:8/727: dwrite d1/d6/d86/fc3 [0,4194304] 0 2023-12-06T15:00:38.493 INFO:tasks.workunit.client.0.smithi152.stdout:8/728: dwrite d1/d6/d29/d87/daa/fbe [0,4194304] 0 2023-12-06T15:00:38.493 INFO:tasks.workunit.client.0.smithi152.stdout:8/729: dread - d1/d6/d34/d90/dd5/fd9 zero size 2023-12-06T15:00:38.493 INFO:tasks.workunit.client.0.smithi152.stdout:8/730: fsync d1/d6/d34/d35/d66/d82/f8a 0 2023-12-06T15:00:38.503 INFO:tasks.workunit.client.0.smithi152.stdout:3/846: dwrite d9/d18/d51/d8d/d8f/da0/dab/dc3/f9a [4194304,4194304] 0 2023-12-06T15:00:38.503 INFO:tasks.workunit.client.0.smithi152.stdout:3/847: write d9/d10/f94 [775597,126856] 0 2023-12-06T15:00:38.503 INFO:tasks.workunit.client.0.smithi152.stdout:9/979: dwrite d0/d3f/d68/d9f/df7/f10f [0,4194304] 0 2023-12-06T15:00:38.503 INFO:tasks.workunit.client.0.smithi152.stdout:9/980: fsync d0/d3f/d5f/d60/da9/faf 0 2023-12-06T15:00:38.504 INFO:tasks.workunit.client.0.smithi152.stdout:9/981: read d0/d3f/d68/d9f/fd0 [198966,108760] 0 2023-12-06T15:00:38.504 INFO:tasks.workunit.client.0.smithi152.stdout:3/848: rmdir d9/d10 39 2023-12-06T15:00:38.506 INFO:tasks.workunit.client.0.smithi152.stdout:9/982: unlink d0/c18 0 2023-12-06T15:00:38.507 INFO:tasks.workunit.client.0.smithi152.stdout:9/983: getdents d0/d3f/d68/d6c/dcf 0 2023-12-06T15:00:38.509 INFO:tasks.workunit.client.0.smithi152.stdout:9/984: creat d0/d3f/d68/f12a x:0 0 0 2023-12-06T15:00:38.510 INFO:tasks.workunit.client.0.smithi152.stdout:8/731: dwrite d1/d6/d29/d87/daa/fac [0,4194304] 0 2023-12-06T15:00:38.510 INFO:tasks.workunit.client.0.smithi152.stdout:8/732: chown d1/d6/d34/d6f/l6b 584 1 2023-12-06T15:00:38.511 INFO:tasks.workunit.client.0.smithi152.stdout:8/733: write d1/d6/d34/d35/d38/f54 [3328986,23226] 0 2023-12-06T15:00:38.514 INFO:tasks.workunit.client.0.smithi152.stdout:9/985: rename d0/d3f/d68/d6c/d20/d38/d44/dc4/d69/db5/fe3 to d0/db8/de5/f12b 0 2023-12-06T15:00:38.514 INFO:tasks.workunit.client.0.smithi152.stdout:9/986: read - d0/d3f/d68/d9f/df7/f127 zero size 2023-12-06T15:00:38.515 INFO:tasks.workunit.client.0.smithi152.stdout:9/987: write d0/d3f/d68/d6c/d20/d38/f46 [698998,124213] 0 2023-12-06T15:00:38.519 INFO:tasks.workunit.client.0.smithi152.stdout:3/849: dwrite d9/d10/d12/d43/d52/f7a [0,4194304] 0 2023-12-06T15:00:38.519 INFO:tasks.workunit.client.0.smithi152.stdout:3/850: truncate d9/d18/d51/d8d/d8f/da0/dab/dc3/d9f/dad/fba 4236345 0 2023-12-06T15:00:38.528 INFO:tasks.workunit.client.0.smithi152.stdout:9/988: dwrite d0/d3f/d5f/dbb/fd1 [0,4194304] 0 2023-12-06T15:00:38.528 INFO:tasks.workunit.client.0.smithi152.stdout:9/989: dread - d0/d3f/d68/d6c/d20/d38/d45/fea zero size 2023-12-06T15:00:38.552 INFO:tasks.workunit.client.0.smithi152.stdout:8/734: rmdir d1/d6/d86 39 2023-12-06T15:00:38.554 INFO:tasks.workunit.client.0.smithi152.stdout:3/851: truncate d9/d10/d19/f2c 9188035 0 2023-12-06T15:00:38.555 INFO:tasks.workunit.client.0.smithi152.stdout:3/852: chown d9/d10/d12/d43/d52/dc5/lcf 5949221 1 2023-12-06T15:00:38.558 INFO:tasks.workunit.client.0.smithi152.stdout:9/990: mkdir d0/d3f/d68/dfc/d12c 0 2023-12-06T15:00:38.559 INFO:tasks.workunit.client.0.smithi152.stdout:8/735: rename d1/d6/d34/d35/d66/d82/db6/cc4 to d1/d6/d34/d90/dd5/cea 0 2023-12-06T15:00:38.562 INFO:tasks.workunit.client.0.smithi152.stdout:8/736: mkdir d1/d6/d29/d74/deb 0 2023-12-06T15:00:38.569 INFO:tasks.workunit.client.0.smithi152.stdout:0/905: sync 2023-12-06T15:00:38.569 INFO:tasks.workunit.client.0.smithi152.stdout:7/746: sync 2023-12-06T15:00:38.569 INFO:tasks.workunit.client.0.smithi152.stdout:7/747: readlink dd/df/d1b/d20/la6 0 2023-12-06T15:00:38.569 INFO:tasks.workunit.client.0.smithi152.stdout:7/748: dread - dd/df/d34/d44/d49/f98 zero size 2023-12-06T15:00:38.572 INFO:tasks.workunit.client.0.smithi152.stdout:7/749: creat dd/df/d1b/d20/d28/d38/fee x:0 0 0 2023-12-06T15:00:38.574 INFO:tasks.workunit.client.0.smithi152.stdout:8/737: dread d1/d6/d29/d87/fb0 [0,4194304] 0 2023-12-06T15:00:38.575 INFO:tasks.workunit.client.0.smithi152.stdout:7/750: rmdir dd/df/d78/dd9 0 2023-12-06T15:00:38.576 INFO:tasks.workunit.client.0.smithi152.stdout:8/738: creat d1/d6/d34/fec x:0 0 0 2023-12-06T15:00:38.576 INFO:tasks.workunit.client.0.smithi152.stdout:8/739: truncate d1/d6/d29/d75/fcc 137805 0 2023-12-06T15:00:38.576 INFO:tasks.workunit.client.0.smithi152.stdout:7/751: symlink dd/df/d1b/d20/d7c/lef 0 2023-12-06T15:00:38.579 INFO:tasks.workunit.client.0.smithi152.stdout:8/740: unlink d1/d6/d34/f57 0 2023-12-06T15:00:38.579 INFO:tasks.workunit.client.0.smithi152.stdout:3/853: dwrite d9/d18/d51/d8d/d8f/da0/dab/dc3/f9a [0,4194304] 0 2023-12-06T15:00:38.579 INFO:tasks.workunit.client.0.smithi152.stdout:3/854: chown d9/d10/d19/c69 58613742 1 2023-12-06T15:00:38.582 INFO:tasks.workunit.client.0.smithi152.stdout:8/741: creat d1/d6/d29/d74/deb/fed x:0 0 0 2023-12-06T15:00:38.583 INFO:tasks.workunit.client.0.smithi152.stdout:3/855: rmdir d9/d18/d51/d8d/d8f/da0/dab/dc3/d9f/dad/dd3 39 2023-12-06T15:00:38.585 INFO:tasks.workunit.client.0.smithi152.stdout:8/742: rename d1/d6/d29/d87/fb0 to d1/d6/d34/d36/d58/de8/fee 0 2023-12-06T15:00:38.586 INFO:tasks.workunit.client.0.smithi152.stdout:3/856: truncate d9/d10/d12/f3a 5006900 0 2023-12-06T15:00:38.586 INFO:tasks.workunit.client.0.smithi152.stdout:7/752: dread dd/df/d34/d44/d49/f54 [0,4194304] 0 2023-12-06T15:00:38.586 INFO:tasks.workunit.client.0.smithi152.stdout:7/753: fdatasync dd/df/f76 0 2023-12-06T15:00:38.586 INFO:tasks.workunit.client.0.smithi152.stdout:8/743: creat d1/d6/d34/d90/dd5/fef x:0 0 0 2023-12-06T15:00:38.586 INFO:tasks.workunit.client.0.smithi152.stdout:8/744: chown d1/d6/d34/d90 6653 1 2023-12-06T15:00:38.587 INFO:tasks.workunit.client.0.smithi152.stdout:3/857: creat d9/d45/d9c/f109 x:0 0 0 2023-12-06T15:00:38.587 INFO:tasks.workunit.client.0.smithi152.stdout:0/906: dwrite d8/d3e/d87/d76/f112 [0,4194304] 0 2023-12-06T15:00:38.589 INFO:tasks.workunit.client.0.smithi152.stdout:8/745: symlink d1/d6/d34/d40/de2/lf0 0 2023-12-06T15:00:38.589 INFO:tasks.workunit.client.0.smithi152.stdout:7/754: read dd/df/d1b/d20/f35 [1330,85385] 0 2023-12-06T15:00:38.589 INFO:tasks.workunit.client.0.smithi152.stdout:3/858: symlink d9/d18/d51/l10a 0 2023-12-06T15:00:38.592 INFO:tasks.workunit.client.0.smithi152.stdout:5/981: sync 2023-12-06T15:00:38.594 INFO:tasks.workunit.client.0.smithi152.stdout:8/746: mkdir d1/d6/d29/d5b/df1 0 2023-12-06T15:00:38.594 INFO:tasks.workunit.client.0.smithi152.stdout:7/755: mknod dd/df/d1b/d20/d28/d38/dc3/cf0 0 2023-12-06T15:00:38.595 INFO:tasks.workunit.client.0.smithi152.stdout:3/859: creat d9/f10b x:0 0 0 2023-12-06T15:00:38.595 INFO:tasks.workunit.client.0.smithi152.stdout:8/747: symlink d1/d6/d29/d75/lf2 0 2023-12-06T15:00:38.597 INFO:tasks.workunit.client.0.smithi152.stdout:7/756: creat dd/df/d34/d44/d49/daf/db1/ff1 x:0 0 0 2023-12-06T15:00:38.602 INFO:tasks.workunit.client.0.smithi152.stdout:3/860: unlink d9/c15 0 2023-12-06T15:00:38.602 INFO:tasks.workunit.client.0.smithi152.stdout:7/757: mknod dd/d69/d89/cf2 0 2023-12-06T15:00:38.604 INFO:tasks.workunit.client.0.smithi152.stdout:7/758: write f1 [704981,28585] 0 2023-12-06T15:00:38.606 INFO:tasks.workunit.client.0.smithi152.stdout:7/759: rename dd/df/d78/fb9 to dd/df/d1b/ff3 0 2023-12-06T15:00:38.618 INFO:tasks.workunit.client.0.smithi152.stdout:0/907: dwrite d8/d15/d45/d73/faa [0,4194304] 0 2023-12-06T15:00:38.618 INFO:tasks.workunit.client.0.smithi152.stdout:0/908: stat d8/d15/d45/d73/d7a/f27 0 2023-12-06T15:00:38.618 INFO:tasks.workunit.client.0.smithi152.stdout:3/861: dread d9/d10/f28 [0,4194304] 0 2023-12-06T15:00:38.619 INFO:tasks.workunit.client.0.smithi152.stdout:3/862: unlink d9/f10b 0 2023-12-06T15:00:38.621 INFO:tasks.workunit.client.0.smithi152.stdout:8/748: dwrite d1/d6/d86/fc3 [0,4194304] 0 2023-12-06T15:00:38.622 INFO:tasks.workunit.client.0.smithi152.stdout:5/982: dwrite d7/dd/d26/d3b/d46/dc9/f135 [0,4194304] 0 2023-12-06T15:00:38.627 INFO:tasks.workunit.client.0.smithi152.stdout:7/760: dwrite dd/df/f76 [0,4194304] 0 2023-12-06T15:00:38.628 INFO:tasks.workunit.client.0.smithi152.stdout:8/749: rename d1/d6/d34/c3f to d1/d6/d29/d87/cf3 0 2023-12-06T15:00:38.628 INFO:tasks.workunit.client.0.smithi152.stdout:8/750: chown d1/l23 9342 1 2023-12-06T15:00:38.630 INFO:tasks.workunit.client.0.smithi152.stdout:8/751: creat d1/d6/d29/d87/daa/ff4 x:0 0 0 2023-12-06T15:00:38.637 INFO:tasks.workunit.client.0.smithi152.stdout:3/863: dwrite d9/d10/d12/d43/d52/f61 [0,4194304] 0 2023-12-06T15:00:38.637 INFO:tasks.workunit.client.0.smithi152.stdout:3/864: truncate d9/d18/d51/d8d/d8f/ff7 701245 0 2023-12-06T15:00:38.639 INFO:tasks.workunit.client.0.smithi152.stdout:3/865: mkdir d9/d10/d12/d43/d52/d58/da9/d10c 0 2023-12-06T15:00:38.639 INFO:tasks.workunit.client.0.smithi152.stdout:3/866: truncate d9/d10/d19/f49 4779859 0 2023-12-06T15:00:38.641 INFO:tasks.workunit.client.0.smithi152.stdout:3/867: link d9/d10/d12/f3e d9/d10/f10d 0 2023-12-06T15:00:38.641 INFO:tasks.workunit.client.0.smithi152.stdout:3/868: stat d9/d10/d12/d43/d52/f7a 0 2023-12-06T15:00:38.642 INFO:tasks.workunit.client.0.smithi152.stdout:3/869: chown d9/d10/d12/f3a 393284 1 2023-12-06T15:00:38.642 INFO:tasks.workunit.client.0.smithi152.stdout:3/870: truncate d9/d18/d51/d8d/d8f/da0/dab/dc3/d91/fa5 954545 0 2023-12-06T15:00:38.642 INFO:tasks.workunit.client.0.smithi152.stdout:3/871: mknod d9/d18/c10e 0 2023-12-06T15:00:38.642 INFO:tasks.workunit.client.0.smithi152.stdout:3/872: chown d9/cbe 0 1 2023-12-06T15:00:38.645 INFO:tasks.workunit.client.0.smithi152.stdout:3/873: rename d9/d10/d19/c69 to d9/d10/d12/d43/d52/db4/c10f 0 2023-12-06T15:00:38.646 INFO:tasks.workunit.client.0.smithi152.stdout:3/874: getdents d9/d18/d51/d8d/d8f 0 2023-12-06T15:00:38.646 INFO:tasks.workunit.client.0.smithi152.stdout:8/752: dread d1/d6/d34/d35/d8d/fb5 [0,4194304] 0 2023-12-06T15:00:38.647 INFO:tasks.workunit.client.0.smithi152.stdout:8/753: write d1/d6/d34/d6f/f70 [2464710,46222] 0 2023-12-06T15:00:38.651 INFO:tasks.workunit.client.0.smithi152.stdout:7/761: dwrite f9 [0,4194304] 0 2023-12-06T15:00:38.651 INFO:tasks.workunit.client.0.smithi152.stdout:7/762: chown dd/df/d1b/d4e/c9e 15 1 2023-12-06T15:00:38.652 INFO:tasks.workunit.client.0.smithi152.stdout:7/763: creat dd/df/d34/d44/d49/d73/d77/ff4 x:0 0 0 2023-12-06T15:00:38.653 INFO:tasks.workunit.client.0.smithi152.stdout:3/875: getdents d9/d10 0 2023-12-06T15:00:38.654 INFO:tasks.workunit.client.0.smithi152.stdout:7/764: mkdir dd/df/dce/df5 0 2023-12-06T15:00:38.655 INFO:tasks.workunit.client.0.smithi152.stdout:3/876: creat d9/d18/d51/d8d/d8f/da0/dab/f110 x:0 0 0 2023-12-06T15:00:38.656 INFO:tasks.workunit.client.0.smithi152.stdout:7/765: creat dd/df/d34/d44/d49/daf/db1/ff6 x:0 0 0 2023-12-06T15:00:38.657 INFO:tasks.workunit.client.0.smithi152.stdout:7/766: mknod dd/df/dce/df5/cf7 0 2023-12-06T15:00:38.657 INFO:tasks.workunit.client.0.smithi152.stdout:7/767: stat dd/df/d1b/d20/d7c 0 2023-12-06T15:00:38.665 INFO:tasks.workunit.client.0.smithi152.stdout:3/877: dread d9/d18/d51/d8d/d8f/da0/dab/dc3/db6/fb7 [0,4194304] 0 2023-12-06T15:00:38.666 INFO:tasks.workunit.client.0.smithi152.stdout:3/878: link d9/cbe d9/d18/d51/d8d/d8f/da0/dab/c111 0 2023-12-06T15:00:38.668 INFO:tasks.workunit.client.0.smithi152.stdout:8/754: dwrite d1/d6/d34/d36/f79 [0,4194304] 0 2023-12-06T15:00:38.668 INFO:tasks.workunit.client.0.smithi152.stdout:7/768: dread dd/f11 [0,4194304] 0 2023-12-06T15:00:38.672 INFO:tasks.workunit.client.0.smithi152.stdout:8/755: stat d1/d6/d34/d36/d58/c59 0 2023-12-06T15:00:38.674 INFO:tasks.workunit.client.0.smithi152.stdout:3/879: dread d9/d10/d12/fd4 [0,4194304] 0 2023-12-06T15:00:38.676 INFO:tasks.workunit.client.0.smithi152.stdout:8/756: dread d1/d6/d34/d40/f7a [0,4194304] 0 2023-12-06T15:00:38.676 INFO:tasks.workunit.client.0.smithi152.stdout:3/880: rename d9/d10/d12/d43/d52/d58/da9/ff2 to d9/d10/d12/d43/d52/db4/d65/f112 0 2023-12-06T15:00:38.676 INFO:tasks.workunit.client.0.smithi152.stdout:3/881: write d9/d10/d12/d43/d52/db4/dc1/fda [977602,115051] 0 2023-12-06T15:00:38.677 INFO:tasks.workunit.client.0.smithi152.stdout:8/757: mkdir d1/d6/d34/d40/df5 0 2023-12-06T15:00:38.681 INFO:tasks.workunit.client.0.smithi152.stdout:3/882: dread d9/d10/d12/d43/d52/d58/da9/f3d [0,4194304] 0 2023-12-06T15:00:38.683 INFO:tasks.workunit.client.0.smithi152.stdout:3/883: mknod d9/d18/d51/d8d/d8f/da0/dab/dc3/d9f/dad/dd3/c113 0 2023-12-06T15:00:38.683 INFO:tasks.workunit.client.0.smithi152.stdout:2/921: sync 2023-12-06T15:00:38.683 INFO:tasks.workunit.client.0.smithi152.stdout:2/922: read d6/db/d17/fa6 [647276,7326] 0 2023-12-06T15:00:38.683 INFO:tasks.workunit.client.0.smithi152.stdout:3/884: symlink d9/d45/l114 0 2023-12-06T15:00:38.685 INFO:tasks.workunit.client.0.smithi152.stdout:2/923: dread d6/d18/d43/fd8 [0,4194304] 0 2023-12-06T15:00:38.686 INFO:tasks.workunit.client.0.smithi152.stdout:2/924: mknod d6/db/c125 0 2023-12-06T15:00:38.688 INFO:tasks.workunit.client.0.smithi152.stdout:7/769: dwrite dd/df/d1b/d20/d7c/d86/da4/fbd [0,4194304] 0 2023-12-06T15:00:38.688 INFO:tasks.workunit.client.0.smithi152.stdout:7/770: chown dd/df/d34/d44/d49/daf 75 1 2023-12-06T15:00:38.690 INFO:tasks.workunit.client.0.smithi152.stdout:3/885: rmdir d9/d10/d12/d43/d52/d58/da9 39 2023-12-06T15:00:38.692 INFO:tasks.workunit.client.0.smithi152.stdout:7/771: creat dd/df/d1b/d20/ff8 x:0 0 0 2023-12-06T15:00:38.694 INFO:tasks.workunit.client.0.smithi152.stdout:7/772: mkdir dd/df/d34/d44/d49/d73/d77/df9 0 2023-12-06T15:00:38.694 INFO:tasks.workunit.client.0.smithi152.stdout:7/773: truncate dd/df/d1b/d20/d28/f30 539013 0 2023-12-06T15:00:38.695 INFO:tasks.workunit.client.0.smithi152.stdout:9/991: sync 2023-12-06T15:00:38.696 INFO:tasks.workunit.client.0.smithi152.stdout:9/992: write d0/d3f/f78 [763248,65037] 0 2023-12-06T15:00:38.696 INFO:tasks.workunit.client.0.smithi152.stdout:7/774: dread dd/df/d34/d44/d49/d73/d77/db8/fb5 [0,4194304] 0 2023-12-06T15:00:38.696 INFO:tasks.workunit.client.0.smithi152.stdout:7/775: write dd/df/d34/d44/fdd [1227161,120980] 0 2023-12-06T15:00:38.697 INFO:tasks.workunit.client.0.smithi152.stdout:7/776: write dd/df/d1b/d20/d28/d38/fa5 [770661,78182] 0 2023-12-06T15:00:38.697 INFO:tasks.workunit.client.0.smithi152.stdout:7/777: chown dd/df/d1b/d20/d7c/d86/da4/fc4 62205 1 2023-12-06T15:00:38.697 INFO:tasks.workunit.client.0.smithi152.stdout:8/758: dread d1/d6/d34/d35/d38/f54 [0,4194304] 0 2023-12-06T15:00:38.697 INFO:tasks.workunit.client.0.smithi152.stdout:3/886: read d9/f2d [2548225,66419] 0 2023-12-06T15:00:38.698 INFO:tasks.workunit.client.0.smithi152.stdout:9/993: rmdir d0/d3f/d68/d6c/d20/d38/d44/dc4 39 2023-12-06T15:00:38.700 INFO:tasks.workunit.client.0.smithi152.stdout:8/759: unlink d1/d6/d29/f4d 0 2023-12-06T15:00:38.700 INFO:tasks.workunit.client.0.smithi152.stdout:3/887: creat d9/d18/d51/d8d/d8f/da0/dab/dc3/d91/f115 x:0 0 0 2023-12-06T15:00:38.701 INFO:tasks.workunit.client.0.smithi152.stdout:9/994: symlink d0/d3f/d68/d6c/d20/d38/d44/dc4/d69/db5/l12d 0 2023-12-06T15:00:38.701 INFO:tasks.workunit.client.0.smithi152.stdout:8/760: creat d1/d6/d34/d35/d66/d82/db6/ff6 x:0 0 0 2023-12-06T15:00:38.703 INFO:tasks.workunit.client.0.smithi152.stdout:9/995: link d0/d3f/d68/d6c/l80 d0/d3f/d68/d6c/d20/l12e 0 2023-12-06T15:00:38.704 INFO:tasks.workunit.client.0.smithi152.stdout:3/888: link d9/d10/d12/d43/d52/db4/d65/faa d9/d18/d39/f116 0 2023-12-06T15:00:38.705 INFO:tasks.workunit.client.0.smithi152.stdout:2/925: dwrite d6/d1e/d41/f5d [0,4194304] 0 2023-12-06T15:00:38.705 INFO:tasks.workunit.client.0.smithi152.stdout:2/926: chown d6/d1e/de1/c38 1007622 1 2023-12-06T15:00:38.705 INFO:tasks.workunit.client.0.smithi152.stdout:9/996: symlink d0/d3f/d68/d6c/l12f 0 2023-12-06T15:00:38.707 INFO:tasks.workunit.client.0.smithi152.stdout:8/761: rename d1/d6/d29/d87 to d1/df7 0 2023-12-06T15:00:38.713 INFO:tasks.workunit.client.0.smithi152.stdout:3/889: mkdir d9/d18/d51/d8d/d8f/da0/dab/d117 0 2023-12-06T15:00:38.713 INFO:tasks.workunit.client.0.smithi152.stdout:9/997: link d0/d3f/d68/d6c/d20/d38/d48/d90/f95 d0/d3f/d68/d9f/df7/f130 0 2023-12-06T15:00:38.713 INFO:tasks.workunit.client.0.smithi152.stdout:9/998: chown d0/d3f/d68/d6c/d92/d122/f116 4839 1 2023-12-06T15:00:38.715 INFO:tasks.workunit.client.0.smithi152.stdout:2/927: rename d6/d18/f58 to d6/d18/d70/d111/f126 0 2023-12-06T15:00:38.715 INFO:tasks.workunit.client.0.smithi152.stdout:2/928: fsync d6/db/d17/f23 0 2023-12-06T15:00:38.715 INFO:tasks.workunit.client.0.smithi152.stdout:2/929: truncate d6/d1e/d41/da2/dea/fd2 1028303 0 2023-12-06T15:00:38.715 INFO:tasks.workunit.client.0.smithi152.stdout:3/890: creat d9/d10/d12/d43/d52/f118 x:0 0 0 2023-12-06T15:00:38.716 INFO:tasks.workunit.client.0.smithi152.stdout:3/891: read d9/d10/f2e [372005,123459] 0 2023-12-06T15:00:38.717 INFO:tasks.workunit.client.0.smithi152.stdout:9/999: mkdir d0/d3f/d68/d6c/d20/d38/d44/d131 0 2023-12-06T15:00:38.719 INFO:tasks.workunit.client.0.smithi152.stdout:2/930: link d6/d18/lc0 d6/d1e/d41/d92/dbf/l127 0 2023-12-06T15:00:38.719 INFO:tasks.workunit.client.0.smithi152.stdout:2/931: chown d6/db/d17/f46 50 1 2023-12-06T15:00:38.720 INFO:tasks.workunit.client.0.smithi152.stdout:3/892: unlink d9/d10/d19/f49 0 2023-12-06T15:00:38.721 INFO:tasks.workunit.client.0.smithi152.stdout:8/762: dwrite d1/d6/d34/d35/d66/d82/f8a [0,4194304] 0 2023-12-06T15:00:38.722 INFO:tasks.workunit.client.0.smithi152.stdout:2/932: creat d6/d1e/d41/d92/dbf/f128 x:0 0 0 2023-12-06T15:00:38.725 INFO:tasks.workunit.client.0.smithi152.stdout:8/763: creat d1/d6/d29/d5b/ff8 x:0 0 0 2023-12-06T15:00:38.725 INFO:tasks.workunit.client.0.smithi152.stdout:3/893: dread d9/d10/f28 [0,4194304] 0 2023-12-06T15:00:38.725 INFO:tasks.workunit.client.0.smithi152.stdout:2/933: creat d6/d1e/de1/d115/f129 x:0 0 0 2023-12-06T15:00:38.726 INFO:tasks.workunit.client.0.smithi152.stdout:8/764: write d1/d6/d86/fc3 [2027218,24149] 0 2023-12-06T15:00:38.726 INFO:tasks.workunit.client.0.smithi152.stdout:8/765: write d1/d6/d29/fd7 [5012000,21994] 0 2023-12-06T15:00:38.726 INFO:tasks.workunit.client.0.smithi152.stdout:3/894: dread d9/d18/f92 [4194304,4194304] 0 2023-12-06T15:00:38.727 INFO:tasks.workunit.client.0.smithi152.stdout:2/934: symlink d6/d18/l12a 0 2023-12-06T15:00:38.729 INFO:tasks.workunit.client.0.smithi152.stdout:3/895: rmdir d9/d18/d51/d8d/d8f/da0/dab/dc3 39 2023-12-06T15:00:38.730 INFO:tasks.workunit.client.0.smithi152.stdout:2/935: creat d6/d1e/d41/da2/f12b x:0 0 0 2023-12-06T15:00:38.744 INFO:tasks.workunit.client.0.smithi152.stdout:3/896: dwrite d9/d18/d51/d8d/d8f/da0/dab/dc3/db6/fec [0,4194304] 0 2023-12-06T15:00:38.745 INFO:tasks.workunit.client.0.smithi152.stdout:3/897: write d9/d10/d12/d43/d52/db4/dc1/fda [38959,2558] 0 2023-12-06T15:00:38.759 INFO:tasks.workunit.client.0.smithi152.stdout:3/898: dwrite d9/d10/d12/d43/d52/d58/f4f [0,4194304] 0 2023-12-06T15:00:38.761 INFO:tasks.workunit.client.0.smithi152.stdout:3/899: read d9/d18/d39/f8e [1653728,43762] 0 2023-12-06T15:00:38.762 INFO:tasks.workunit.client.0.smithi152.stdout:3/900: rmdir d9/d18/d51/d8d/d8f 39 2023-12-06T15:00:38.763 INFO:tasks.workunit.client.0.smithi152.stdout:3/901: mkdir d9/d18/d51/d8d/d8f/da0/dab/d119 0 2023-12-06T15:00:38.764 INFO:tasks.workunit.client.0.smithi152.stdout:3/902: mknod d9/d18/d51/d8d/d8f/da0/dab/df0/c11a 0 2023-12-06T15:00:38.764 INFO:tasks.workunit.client.1.smithi190.stdout:4/945: sync 2023-12-06T15:00:38.765 INFO:tasks.workunit.client.0.smithi152.stdout:3/903: creat d9/d18/d51/d8d/d8f/da0/dab/dc3/d9f/f11b x:0 0 0 2023-12-06T15:00:38.766 INFO:tasks.workunit.client.0.smithi152.stdout:3/904: truncate d9/d18/d39/fb9 3274453 0 2023-12-06T15:00:38.767 INFO:tasks.workunit.client.0.smithi152.stdout:3/905: symlink d9/d10/d12/d43/d52/db4/d65/l11c 0 2023-12-06T15:00:38.767 INFO:tasks.workunit.client.0.smithi152.stdout:3/906: write d9/d10/d12/d43/d52/f118 [659201,105405] 0 2023-12-06T15:00:38.768 INFO:tasks.workunit.client.0.smithi152.stdout:3/907: symlink d9/d18/d51/d8d/d8f/da0/dab/dc3/d9f/dad/dd3/l11d 0 2023-12-06T15:00:38.768 INFO:tasks.workunit.client.0.smithi152.stdout:3/908: getdents d9/d18/d51/d8d/d8f/da0/dab/d119 0 2023-12-06T15:00:38.770 INFO:tasks.workunit.client.0.smithi152.stdout:3/909: rename d9/d10/d12/d43/d52/f118 to d9/d18/d51/d8d/d8f/da0/dab/dc3/d91/dd5/f11e 0 2023-12-06T15:00:38.770 INFO:tasks.workunit.client.1.smithi190.stdout:4/946: dread d3/d4e/f73 [0,4194304] 0 2023-12-06T15:00:38.770 INFO:tasks.workunit.client.1.smithi190.stdout:4/947: dread - d3/d35/d19/d67/f102 zero size 2023-12-06T15:00:38.770 INFO:tasks.workunit.client.0.smithi152.stdout:3/910: creat d9/d10/d19/f11f x:0 0 0 2023-12-06T15:00:38.772 INFO:tasks.workunit.client.1.smithi190.stdout:4/948: symlink d3/d76/d7c/d8a/l14b 0 2023-12-06T15:00:38.773 INFO:tasks.workunit.client.1.smithi190.stdout:4/949: symlink d3/d4e/l14c 0 2023-12-06T15:00:38.783 INFO:tasks.workunit.client.1.smithi190.stdout:4/950: dread d3/d35/d19/f68 [0,4194304] 0 2023-12-06T15:00:38.783 INFO:tasks.workunit.client.1.smithi190.stdout:4/951: fsync d3/d76/fb2 0 2023-12-06T15:00:38.784 INFO:tasks.workunit.client.0.smithi152.stdout:5/983: sync 2023-12-06T15:00:38.784 INFO:tasks.workunit.client.0.smithi152.stdout:0/909: sync 2023-12-06T15:00:38.784 INFO:tasks.workunit.client.0.smithi152.stdout:5/984: readlink d7/dd/d26/l12f 0 2023-12-06T15:00:38.785 INFO:tasks.workunit.client.0.smithi152.stdout:0/910: rename d8/d15/d45/d73/db9/dc4 to d8/d15/d45/d117/d124 0 2023-12-06T15:00:38.786 INFO:tasks.workunit.client.0.smithi152.stdout:5/985: creat d7/dd/d26/d3a/f156 x:0 0 0 2023-12-06T15:00:38.786 INFO:tasks.workunit.client.0.smithi152.stdout:3/911: dwrite d9/d10/d19/f57 [0,4194304] 0 2023-12-06T15:00:38.787 INFO:tasks.workunit.client.1.smithi190.stdout:4/952: dread d3/d35/d19/d41/d44/d9c/f121 [0,4194304] 0 2023-12-06T15:00:38.787 INFO:tasks.workunit.client.1.smithi190.stdout:4/953: stat d3/d76/dc4/dc5/d3c/d116/d39/f25 0 2023-12-06T15:00:38.787 INFO:tasks.workunit.client.1.smithi190.stdout:4/954: chown d3/d35/d19/d41/d44/d11d/ff5 867 1 2023-12-06T15:00:38.787 INFO:tasks.workunit.client.0.smithi152.stdout:5/986: creat d7/dd/d26/d87/f157 x:0 0 0 2023-12-06T15:00:38.787 INFO:tasks.workunit.client.0.smithi152.stdout:5/987: write d7/dd/d26/d48/f86 [809608,109455] 0 2023-12-06T15:00:38.788 INFO:tasks.workunit.client.1.smithi190.stdout:4/955: getdents d3/d76/d7c/db9 0 2023-12-06T15:00:38.788 INFO:tasks.workunit.client.0.smithi152.stdout:3/912: truncate d9/d10/f68 2491959 0 2023-12-06T15:00:38.790 INFO:tasks.workunit.client.0.smithi152.stdout:5/988: unlink d7/d43/d9c/dfb/c75 0 2023-12-06T15:00:38.790 INFO:tasks.workunit.client.0.smithi152.stdout:5/989: chown d7/d43/d9c/d111/f121 1036304 1 2023-12-06T15:00:38.793 INFO:tasks.workunit.client.0.smithi152.stdout:5/990: creat d7/dd/d103/f158 x:0 0 0 2023-12-06T15:00:38.793 INFO:tasks.workunit.client.0.smithi152.stdout:5/991: chown d7/dd/f8a 455450973 1 2023-12-06T15:00:38.793 INFO:tasks.workunit.client.0.smithi152.stdout:5/992: fsync d7/d43/f8e 0 2023-12-06T15:00:38.795 INFO:tasks.workunit.client.0.smithi152.stdout:5/993: creat d7/dd/d26/d48/d97/dc2/f159 x:0 0 0 2023-12-06T15:00:38.796 INFO:tasks.workunit.client.1.smithi190.stdout:4/956: dread d3/f3f [0,4194304] 0 2023-12-06T15:00:38.798 INFO:tasks.workunit.client.0.smithi152.stdout:5/994: creat d7/dd/d26/f15a x:0 0 0 2023-12-06T15:00:38.798 INFO:tasks.workunit.client.0.smithi152.stdout:5/995: chown d7/dd/d26/d3b/d46/cc6 2394 1 2023-12-06T15:00:38.799 INFO:tasks.workunit.client.0.smithi152.stdout:5/996: symlink d7/dd/d26/d48/dbb/l15b 0 2023-12-06T15:00:38.800 INFO:tasks.workunit.client.1.smithi190.stdout:4/957: rename d3/d35/d19/d41/d44/d11d/ff5 to d3/d35/d19/d67/db5/f14d 0 2023-12-06T15:00:38.800 INFO:tasks.workunit.client.1.smithi190.stdout:4/958: fsync d3/d4e/f73 0 2023-12-06T15:00:38.800 INFO:tasks.workunit.client.1.smithi190.stdout:4/959: read - d3/da4/d10d/f127 zero size 2023-12-06T15:00:38.801 INFO:tasks.workunit.client.0.smithi152.stdout:5/997: symlink d7/dd/d26/d3b/d46/dc9/l15c 0 2023-12-06T15:00:38.801 INFO:tasks.workunit.client.0.smithi152.stdout:5/998: chown d7/dd/d26/fae 12880 1 2023-12-06T15:00:38.801 INFO:tasks.workunit.client.0.smithi152.stdout:5/999: mknod d7/dd/d26/d87/dc4/c15d 0 2023-12-06T15:00:38.802 INFO:tasks.workunit.client.0.smithi152.stdout:3/913: dread d9/f2d [0,4194304] 0 2023-12-06T15:00:38.802 INFO:tasks.workunit.client.1.smithi190.stdout:4/960: mkdir d3/d76/dc4/dc5/d3c/d116/d39/dc8/d14e 0 2023-12-06T15:00:38.803 INFO:tasks.workunit.client.1.smithi190.stdout:4/961: read d3/d76/d7c/d8a/f132 [684176,27798] 0 2023-12-06T15:00:38.804 INFO:tasks.workunit.client.1.smithi190.stdout:4/962: mknod d3/d35/df0/c14f 0 2023-12-06T15:00:38.805 INFO:tasks.workunit.client.1.smithi190.stdout:4/963: rename d3/d4e/d119/cf8 to d3/d76/dc4/dc5/d3c/d116/d15/d12b/c150 0 2023-12-06T15:00:38.806 INFO:tasks.workunit.client.1.smithi190.stdout:4/964: creat d3/d35/d19/d41/d44/d11d/f151 x:0 0 0 2023-12-06T15:00:38.807 INFO:tasks.workunit.client.1.smithi190.stdout:4/965: creat d3/d35/f152 x:0 0 0 2023-12-06T15:00:38.809 INFO:tasks.workunit.client.1.smithi190.stdout:4/966: rename d3/d76/dc4/dc5/d3c/f5a to d3/d76/dc4/dc5/d3c/f153 0 2023-12-06T15:00:38.809 INFO:tasks.workunit.client.0.smithi152.stdout:0/911: dwrite d8/d15/d45/d73/ddd/de1/ffa [0,4194304] 0 2023-12-06T15:00:38.809 INFO:tasks.workunit.client.0.smithi152.stdout:0/912: write d8/d15/d45/d73/db9/fd0 [5426329,512] 0 2023-12-06T15:00:38.810 INFO:tasks.workunit.client.1.smithi190.stdout:4/967: unlink d3/f14 0 2023-12-06T15:00:38.812 INFO:tasks.workunit.client.1.smithi190.stdout:4/968: creat d3/d35/d19/f154 x:0 0 0 2023-12-06T15:00:38.813 INFO:tasks.workunit.client.0.smithi152.stdout:0/913: mknod d8/d3e/d6f/dd4/c125 0 2023-12-06T15:00:38.813 INFO:tasks.workunit.client.0.smithi152.stdout:0/914: fsync d8/d4b/f8a 0 2023-12-06T15:00:38.815 INFO:tasks.workunit.client.0.smithi152.stdout:0/915: write d8/f13 [5506500,51746] 0 2023-12-06T15:00:38.815 INFO:tasks.workunit.client.0.smithi152.stdout:0/916: write d8/ff [973884,14795] 0 2023-12-06T15:00:38.816 INFO:tasks.workunit.client.0.smithi152.stdout:0/917: symlink d8/d15/d45/d99/l126 0 2023-12-06T15:00:38.818 INFO:tasks.workunit.client.0.smithi152.stdout:0/918: creat d8/d3e/d6f/dd4/f127 x:0 0 0 2023-12-06T15:00:38.820 INFO:tasks.workunit.client.0.smithi152.stdout:0/919: rmdir d8/d15/d45/da2/df2 39 2023-12-06T15:00:38.821 INFO:tasks.workunit.client.0.smithi152.stdout:0/920: mknod d8/d15/d45/dd6/c128 0 2023-12-06T15:00:38.822 INFO:tasks.workunit.client.0.smithi152.stdout:0/921: creat d8/d15/d45/d73/d7a/f129 x:0 0 0 2023-12-06T15:00:38.831 INFO:tasks.workunit.client.1.smithi190.stdout:4/969: dwrite d3/d4e/fde [0,4194304] 0 2023-12-06T15:00:38.840 INFO:tasks.workunit.client.0.smithi152.stdout:3/914: dwrite d9/d18/fa1 [0,4194304] 0 2023-12-06T15:00:38.841 INFO:tasks.workunit.client.0.smithi152.stdout:3/915: symlink d9/d18/d51/d8d/d8f/da0/dab/dc3/d91/dd5/l120 0 2023-12-06T15:00:38.843 INFO:tasks.workunit.client.0.smithi152.stdout:0/922: dwrite d8/d4b/fbd [0,4194304] 0 2023-12-06T15:00:38.844 INFO:tasks.workunit.client.0.smithi152.stdout:3/916: write d9/f1d [8415,36580] 0 2023-12-06T15:00:38.846 INFO:tasks.workunit.client.1.smithi190.stdout:2/970: sync 2023-12-06T15:00:38.846 INFO:tasks.workunit.client.1.smithi190.stdout:5/972: sync 2023-12-06T15:00:38.846 INFO:tasks.workunit.client.1.smithi190.stdout:0/972: sync 2023-12-06T15:00:38.846 INFO:tasks.workunit.client.1.smithi190.stdout:5/973: chown d0/d1c/d2b/d2c/d5d/d73/fab 6960 1 2023-12-06T15:00:38.848 INFO:tasks.workunit.client.1.smithi190.stdout:4/970: dwrite d3/d35/d19/d41/d44/d9c/f121 [0,4194304] 0 2023-12-06T15:00:38.849 INFO:tasks.workunit.client.0.smithi152.stdout:0/923: symlink d8/d15/d45/d117/l12a 0 2023-12-06T15:00:38.849 INFO:tasks.workunit.client.0.smithi152.stdout:0/924: dread d8/d4b/f6b [0,4194304] 0 2023-12-06T15:00:38.850 INFO:tasks.workunit.client.0.smithi152.stdout:0/925: read d8/d4b/f51 [4207629,63550] 0 2023-12-06T15:00:38.850 INFO:tasks.workunit.client.1.smithi190.stdout:5/974: creat d0/d1c/d94/f149 x:0 0 0 2023-12-06T15:00:38.851 INFO:tasks.workunit.client.0.smithi152.stdout:3/917: creat d9/d18/d51/d8d/d8f/da0/dab/df0/f121 x:0 0 0 2023-12-06T15:00:38.851 INFO:tasks.workunit.client.0.smithi152.stdout:3/918: stat d9/d45/c6e 0 2023-12-06T15:00:38.852 INFO:tasks.workunit.client.0.smithi152.stdout:0/926: mknod d8/d15/d45/d73/d8c/c12b 0 2023-12-06T15:00:38.853 INFO:tasks.workunit.client.1.smithi190.stdout:4/971: rename d3/fa to d3/d35/d19/d41/f155 0 2023-12-06T15:00:38.853 INFO:tasks.workunit.client.1.smithi190.stdout:4/972: fsync d3/f9 0 2023-12-06T15:00:38.854 INFO:tasks.workunit.client.1.smithi190.stdout:5/975: rename d0/d1c/d2b/d2c/d5d/d73/d116/dc5/d113/c13e to d0/d6c/da7/df3/c14a 0 2023-12-06T15:00:38.855 INFO:tasks.workunit.client.1.smithi190.stdout:5/976: write d0/d1c/d2b/d8b/f143 [388800,85264] 0 2023-12-06T15:00:38.855 INFO:tasks.workunit.client.1.smithi190.stdout:5/977: chown d0/ce2 1125184 1 2023-12-06T15:00:38.865 INFO:tasks.workunit.client.1.smithi190.stdout:0/973: dwrite d0/da/d3e/d2b/d3c/d65/f12c [0,4194304] 0 2023-12-06T15:00:38.865 INFO:tasks.workunit.client.1.smithi190.stdout:0/974: readlink d0/d9d/l142 0 2023-12-06T15:00:38.866 INFO:tasks.workunit.client.0.smithi152.stdout:7/778: sync 2023-12-06T15:00:38.866 INFO:tasks.workunit.client.0.smithi152.stdout:2/936: sync 2023-12-06T15:00:38.866 INFO:tasks.workunit.client.0.smithi152.stdout:8/766: sync 2023-12-06T15:00:38.868 INFO:tasks.workunit.client.0.smithi152.stdout:2/937: symlink d6/d18/d70/d111/l12c 0 2023-12-06T15:00:38.869 INFO:tasks.workunit.client.0.smithi152.stdout:2/938: read d6/d1e/d41/faf [409083,85220] 0 2023-12-06T15:00:38.870 INFO:tasks.workunit.client.0.smithi152.stdout:3/919: rmdir d9 39 2023-12-06T15:00:38.872 INFO:tasks.workunit.client.0.smithi152.stdout:3/920: creat d9/d45/d9c/f122 x:0 0 0 2023-12-06T15:00:38.872 INFO:tasks.workunit.client.1.smithi190.stdout:0/975: link d0/da/d3e/d2b/d3c/d46/d8e/l102 d0/da/d3e/d2b/d3c/d46/d8e/d90/l143 0 2023-12-06T15:00:38.872 INFO:tasks.workunit.client.1.smithi190.stdout:0/976: dread - d0/da/da4/db1/f12e zero size 2023-12-06T15:00:38.875 INFO:tasks.workunit.client.1.smithi190.stdout:0/977: unlink d0/da/d74/da2/l13d 0 2023-12-06T15:00:38.875 INFO:tasks.workunit.client.1.smithi190.stdout:0/978: fdatasync d0/da/d3e/d2b/f69 0 2023-12-06T15:00:38.876 INFO:tasks.workunit.client.0.smithi152.stdout:3/921: unlink d9/d10/d12/d43/d52/db4/c10f 0 2023-12-06T15:00:38.877 INFO:tasks.workunit.client.1.smithi190.stdout:0/979: dread d0/da/db7/fff [0,4194304] 0 2023-12-06T15:00:38.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:38 smithi152 ceph-mon[111954]: Upgrade: Updating mgr.smithi152.meodco 2023-12-06T15:00:38.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:38 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:38.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:38 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.meodco", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-06T15:00:38.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:38 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.meodco", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-06T15:00:38.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:38 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-06T15:00:38.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:38 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:00:38.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:38 smithi152 ceph-mon[111954]: Deploying daemon mgr.smithi152.meodco on smithi152 2023-12-06T15:00:38.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:38 smithi152 ceph-mon[111954]: pgmap v31: 65 pgs: 65 active+clean; 3.4 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 172 MiB/s rd, 344 MiB/s wr, 533 op/s 2023-12-06T15:00:38.878 INFO:tasks.workunit.client.0.smithi152.stdout:3/922: rename d9/d45/fe2 to d9/d10/d12/d43/d52/db4/d65/f123 0 2023-12-06T15:00:38.880 INFO:tasks.workunit.client.0.smithi152.stdout:3/923: unlink d9/d10/d12/d43/d52/d58/f4f 0 2023-12-06T15:00:38.887 INFO:tasks.workunit.client.0.smithi152.stdout:8/767: dread d1/d6/fd [0,4194304] 0 2023-12-06T15:00:38.887 INFO:tasks.workunit.client.0.smithi152.stdout:8/768: chown d1/f77 25 1 2023-12-06T15:00:38.888 INFO:tasks.workunit.client.0.smithi152.stdout:3/924: write d9/d10/f7f [3742211,43872] 0 2023-12-06T15:00:38.890 INFO:tasks.workunit.client.0.smithi152.stdout:8/769: truncate d1/d6/d34/d35/d38/f54 21512 0 2023-12-06T15:00:38.890 INFO:tasks.workunit.client.0.smithi152.stdout:3/925: rmdir d9/d10/d19 39 2023-12-06T15:00:38.892 INFO:tasks.workunit.client.1.smithi190.stdout:2/971: dwrite fa [0,4194304] 0 2023-12-06T15:00:38.892 INFO:tasks.workunit.client.1.smithi190.stdout:2/972: write d10/d26/d5c/d35/f124 [1378838,82624] 0 2023-12-06T15:00:38.893 INFO:tasks.workunit.client.0.smithi152.stdout:8/770: rename d1/d6/d34/d36/fa7 to d1/d6/d34/d35/dd6/ff9 0 2023-12-06T15:00:38.893 INFO:tasks.workunit.client.0.smithi152.stdout:8/771: fsync d1/d6/d34/d36/f5d 0 2023-12-06T15:00:38.893 INFO:tasks.workunit.client.0.smithi152.stdout:8/772: write d1/d6/d34/d36/f67 [997648,10219] 0 2023-12-06T15:00:38.894 INFO:tasks.workunit.client.0.smithi152.stdout:0/927: dwrite d8/d15/d45/d73/d7a/f39 [0,4194304] 0 2023-12-06T15:00:38.894 INFO:tasks.workunit.client.0.smithi152.stdout:7/779: dwrite dd/df/d1b/d20/d28/f68 [0,4194304] 0 2023-12-06T15:00:38.894 INFO:tasks.workunit.client.0.smithi152.stdout:0/928: readlink d8/lc 0 2023-12-06T15:00:38.894 INFO:tasks.workunit.client.0.smithi152.stdout:8/773: creat d1/d6/d29/ddf/ffa x:0 0 0 2023-12-06T15:00:38.897 INFO:tasks.workunit.client.1.smithi190.stdout:5/978: dwrite d0/d1c/d2b/d2c/d5d/d73/d116/d112/d134/f146 [0,4194304] 0 2023-12-06T15:00:38.902 INFO:tasks.workunit.client.1.smithi190.stdout:5/979: rename d0/d1c/d2b/d2c/d5d/d73/fb1 to d0/d1c/f14b 0 2023-12-06T15:00:38.907 INFO:tasks.workunit.client.0.smithi152.stdout:3/926: dread d9/d10/f10d [0,4194304] 0 2023-12-06T15:00:38.907 INFO:tasks.workunit.client.0.smithi152.stdout:3/927: chown d9/d18/d51/d8d/d8f/ff7 18315680 1 2023-12-06T15:00:38.907 INFO:tasks.workunit.client.1.smithi190.stdout:0/980: dwrite d0/da/d3e/d2b/d37/f116 [0,4194304] 0 2023-12-06T15:00:38.907 INFO:tasks.workunit.client.0.smithi152.stdout:7/780: dread dd/f2f [0,4194304] 0 2023-12-06T15:00:38.909 INFO:tasks.workunit.client.0.smithi152.stdout:3/928: link d9/d10/d12/d43/d52/dc5/lcf d9/d18/d51/d8d/d8f/da0/dab/d117/l124 0 2023-12-06T15:00:38.909 INFO:tasks.workunit.client.0.smithi152.stdout:3/929: dread - d9/d18/d51/d8d/d8f/da0/dab/dc3/d91/dca/f101 zero size 2023-12-06T15:00:38.909 INFO:tasks.workunit.client.0.smithi152.stdout:3/930: readlink d9/d10/d12/le1 0 2023-12-06T15:00:38.910 INFO:tasks.workunit.client.0.smithi152.stdout:3/931: getdents d9 0 2023-12-06T15:00:38.910 INFO:tasks.workunit.client.0.smithi152.stdout:3/932: write d9/d10/d19/f33 [1044400,116141] 0 2023-12-06T15:00:38.910 INFO:tasks.workunit.client.0.smithi152.stdout:3/933: truncate d9/d18/d51/d8d/d8f/da0/dab/f110 791343 0 2023-12-06T15:00:38.911 INFO:tasks.workunit.client.0.smithi152.stdout:3/934: write d9/d10/d12/d43/d52/db4/dc1/fda [109829,19335] 0 2023-12-06T15:00:38.917 INFO:tasks.workunit.client.0.smithi152.stdout:3/935: dread d9/d18/d51/d8d/d8f/da0/dab/dc3/f8c [0,4194304] 0 2023-12-06T15:00:38.918 INFO:tasks.workunit.client.0.smithi152.stdout:0/929: dwrite d8/d15/d45/d73/faa [0,4194304] 0 2023-12-06T15:00:38.918 INFO:tasks.workunit.client.1.smithi190.stdout:2/973: dwrite d10/d26/d5c/d42/d9d/fae [0,4194304] 0 2023-12-06T15:00:38.919 INFO:tasks.workunit.client.0.smithi152.stdout:3/936: unlink d9/d18/d51/d8d/d8f/da0/dab/dc3/d91/fa5 0 2023-12-06T15:00:38.919 INFO:tasks.workunit.client.0.smithi152.stdout:3/937: stat d9/f1d 0 2023-12-06T15:00:38.920 INFO:tasks.workunit.client.0.smithi152.stdout:7/781: dread f8 [0,4194304] 0 2023-12-06T15:00:38.921 INFO:tasks.workunit.client.0.smithi152.stdout:0/930: symlink d8/d15/d45/dd6/l12c 0 2023-12-06T15:00:38.921 INFO:tasks.workunit.client.0.smithi152.stdout:0/931: write d8/d15/d45/d73/faa [4732690,125833] 0 2023-12-06T15:00:38.921 INFO:tasks.workunit.client.0.smithi152.stdout:0/932: truncate d8/fd 1700621 0 2023-12-06T15:00:38.923 INFO:tasks.workunit.client.1.smithi190.stdout:2/974: mknod d10/d59/dcd/c148 0 2023-12-06T15:00:38.926 INFO:tasks.workunit.client.0.smithi152.stdout:7/782: rename dd/df/d1b/d20/d7c/f88 to dd/df/d1b/ffa 0 2023-12-06T15:00:38.932 INFO:tasks.workunit.client.0.smithi152.stdout:3/938: mkdir d9/d10/d12/d125 0 2023-12-06T15:00:38.933 INFO:tasks.workunit.client.0.smithi152.stdout:7/783: mknod dd/df/d1b/d20/de5/cfb 0 2023-12-06T15:00:38.942 INFO:tasks.workunit.client.0.smithi152.stdout:7/784: write dd/df/f2c [3424486,52683] 0 2023-12-06T15:00:38.942 INFO:tasks.workunit.client.0.smithi152.stdout:7/785: readlink dd/df/d1b/d20/d28/d38/l7f 0 2023-12-06T15:00:38.944 INFO:tasks.workunit.client.1.smithi190.stdout:2/975: dwrite d10/d26/d5c/d49/d54/f61 [0,4194304] 0 2023-12-06T15:00:38.946 INFO:tasks.workunit.client.0.smithi152.stdout:7/786: write dd/df/f76 [2668162,26540] 0 2023-12-06T15:00:38.947 INFO:tasks.workunit.client.0.smithi152.stdout:7/787: creat dd/df/d1b/d20/d7c/d86/da4/ffc x:0 0 0 2023-12-06T15:00:38.948 INFO:tasks.workunit.client.0.smithi152.stdout:0/933: dwrite d8/d3e/d87/f59 [0,4194304] 0 2023-12-06T15:00:38.948 INFO:tasks.workunit.client.0.smithi152.stdout:7/788: rmdir dd/df/d34/de3 0 2023-12-06T15:00:38.948 INFO:tasks.workunit.client.1.smithi190.stdout:2/976: write d10/d26/d5c/f5a [2219061,92817] 0 2023-12-06T15:00:38.949 INFO:tasks.workunit.client.1.smithi190.stdout:2/977: fdatasync d10/d59/d5e/f13 0 2023-12-06T15:00:38.949 INFO:tasks.workunit.client.1.smithi190.stdout:2/978: stat d10/d59/dcd/dad/c102 0 2023-12-06T15:00:38.950 INFO:tasks.workunit.client.1.smithi190.stdout:2/979: creat d10/d26/d5c/d42/d9d/f149 x:0 0 0 2023-12-06T15:00:38.951 INFO:tasks.workunit.client.0.smithi152.stdout:3/939: dwrite d9/d10/d19/f2c [4194304,4194304] 0 2023-12-06T15:00:38.951 INFO:tasks.workunit.client.0.smithi152.stdout:3/940: readlink d9/d45/l60 0 2023-12-06T15:00:38.952 INFO:tasks.workunit.client.1.smithi190.stdout:2/980: unlink d10/d59/dcd/dad/dc4/d7f/cb2 0 2023-12-06T15:00:38.952 INFO:tasks.workunit.client.1.smithi190.stdout:2/981: chown d10/d59/dcd/dad/dc4/d7f/d8e/fa2 19255 1 2023-12-06T15:00:38.953 INFO:tasks.workunit.client.0.smithi152.stdout:3/941: rename d9/d18/d51/d8d/d8f/da0/dab/dc3/d91/dd5/l120 to d9/d18/d51/d8d/d8f/da0/dab/dc3/d91/l126 0 2023-12-06T15:00:38.953 INFO:tasks.workunit.client.0.smithi152.stdout:3/942: chown d9/d18/ce5 65283 1 2023-12-06T15:00:38.955 INFO:tasks.workunit.client.0.smithi152.stdout:0/934: write d8/d15/f8e [1457398,83303] 0 2023-12-06T15:00:38.960 INFO:tasks.workunit.client.0.smithi152.stdout:0/935: rename d8/d15/d45/d83/lb6 to d8/d3e/d6f/dd4/l12d 0 2023-12-06T15:00:38.972 INFO:tasks.workunit.client.0.smithi152.stdout:7/789: dwrite dd/df/d1b/d20/d7c/d86/da4/fbd [0,4194304] 0 2023-12-06T15:00:38.972 INFO:tasks.workunit.client.0.smithi152.stdout:7/790: dread - dd/df/d1b/d20/ff8 zero size 2023-12-06T15:00:38.974 INFO:tasks.workunit.client.0.smithi152.stdout:3/943: dwrite d9/d10/d12/d43/d52/db4/dc1/fda [0,4194304] 0 2023-12-06T15:00:38.974 INFO:tasks.workunit.client.0.smithi152.stdout:3/944: write d9/d18/d51/d8d/f104 [185298,34307] 0 2023-12-06T15:00:38.993 INFO:tasks.workunit.client.0.smithi152.stdout:3/945: dwrite d9/d10/d12/d43/d52/f61 [0,4194304] 0 2023-12-06T15:00:38.993 INFO:tasks.workunit.client.0.smithi152.stdout:7/791: dwrite f1 [0,4194304] 0 2023-12-06T15:00:38.996 INFO:tasks.workunit.client.0.smithi152.stdout:7/792: read dd/df/d1b/d20/f58 [45902,98619] 0 2023-12-06T15:00:38.996 INFO:tasks.workunit.client.0.smithi152.stdout:3/946: write d9/d18/fa1 [313396,31168] 0 2023-12-06T15:00:38.997 INFO:tasks.workunit.client.0.smithi152.stdout:7/793: truncate dd/df/f2c 1636688 0 2023-12-06T15:00:38.998 INFO:tasks.workunit.client.0.smithi152.stdout:3/947: creat d9/d18/d51/d8d/d8f/da0/f127 x:0 0 0 2023-12-06T15:00:39.000 INFO:tasks.workunit.client.0.smithi152.stdout:7/794: creat dd/df/d1b/d20/d7c/d86/ffd x:0 0 0 2023-12-06T15:00:39.000 INFO:tasks.workunit.client.0.smithi152.stdout:7/795: fdatasync dd/f11 0 2023-12-06T15:00:39.000 INFO:tasks.workunit.client.0.smithi152.stdout:7/796: write dd/df/d1b/d20/d7c/d86/da4/ffc [836562,90647] 0 2023-12-06T15:00:39.000 INFO:tasks.workunit.client.0.smithi152.stdout:7/797: chown dd/df/d1b/d20/d28/l85 122 1 2023-12-06T15:00:39.000 INFO:tasks.workunit.client.0.smithi152.stdout:7/798: write dd/df/d1b/d20/d28/d38/f82 [260796,117264] 0 2023-12-06T15:00:39.000 INFO:tasks.workunit.client.0.smithi152.stdout:7/799: dread - dd/df/d1b/ff3 zero size 2023-12-06T15:00:39.001 INFO:tasks.workunit.client.0.smithi152.stdout:3/948: mknod d9/d18/d51/d8d/d8f/da0/dab/d117/c128 0 2023-12-06T15:00:39.002 INFO:tasks.workunit.client.1.smithi190.stdout:2/982: creat d10/d26/d5c/d8d/f14a x:0 0 0 2023-12-06T15:00:39.003 INFO:tasks.workunit.client.0.smithi152.stdout:7/800: mknod dd/df/d1b/d20/d7c/d86/cfe 0 2023-12-06T15:00:39.003 INFO:tasks.workunit.client.1.smithi190.stdout:2/983: rmdir d10/d59/dcd/dad/d116 39 2023-12-06T15:00:39.005 INFO:tasks.workunit.client.1.smithi190.stdout:2/984: link d10/d26/d5c/d35/d77/d98/fa8 d10/d59/dcd/dad/dc4/d76/db1/f14b 0 2023-12-06T15:00:39.005 INFO:tasks.workunit.client.1.smithi190.stdout:2/985: stat d10/d26/d5c/d8d/f113 0 2023-12-06T15:00:39.005 INFO:tasks.workunit.client.1.smithi190.stdout:2/986: stat d10/d59/dcd/dad/c102 0 2023-12-06T15:00:39.005 INFO:tasks.workunit.client.0.smithi152.stdout:7/801: link dd/df/d34/d44/d49/led dd/df/d34/d44/d49/d73/d77/df9/lff 0 2023-12-06T15:00:39.006 INFO:tasks.workunit.client.1.smithi190.stdout:2/987: mknod d10/d59/dcd/dad/dc4/d7f/d8e/c14c 0 2023-12-06T15:00:39.006 INFO:tasks.workunit.client.0.smithi152.stdout:7/802: symlink dd/df/d34/dac/l100 0 2023-12-06T15:00:39.006 INFO:tasks.workunit.client.0.smithi152.stdout:7/803: write dd/df/d34/d95/fea [690757,90933] 0 2023-12-06T15:00:39.007 INFO:tasks.workunit.client.0.smithi152.stdout:7/804: symlink dd/df/d1b/d20/d7c/db7/l101 0 2023-12-06T15:00:39.007 INFO:tasks.workunit.client.0.smithi152.stdout:7/805: fsync dd/df/f76 0 2023-12-06T15:00:39.009 INFO:tasks.workunit.client.1.smithi190.stdout:2/988: unlink d10/d26/d5c/d35/d77/d98/dfe/le6 0 2023-12-06T15:00:39.009 INFO:tasks.workunit.client.1.smithi190.stdout:2/989: chown d10/d26/d5c/d8d/l125 0 1 2023-12-06T15:00:39.009 INFO:tasks.workunit.client.0.smithi152.stdout:3/949: truncate d9/d10/d12/d43/d52/f61 1468809 0 2023-12-06T15:00:39.009 INFO:tasks.workunit.client.0.smithi152.stdout:3/950: write d9/d18/d51/d8d/d8f/da0/dab/dc3/d91/dca/f101 [612087,107130] 0 2023-12-06T15:00:39.010 INFO:tasks.workunit.client.1.smithi190.stdout:2/990: rename d10/d26/d5c/d35/d77/d98/d147 to d10/d59/dcd/dad/dc4/d76/d14d 0 2023-12-06T15:00:39.011 INFO:tasks.workunit.client.0.smithi152.stdout:3/951: rename d9/d18/f92 to d9/d18/d51/d8d/d8f/de6/f129 0 2023-12-06T15:00:39.012 INFO:tasks.workunit.client.1.smithi190.stdout:2/991: rename d10/d26/l3b to d10/d59/d5e/l14e 0 2023-12-06T15:00:39.013 INFO:tasks.workunit.client.1.smithi190.stdout:2/992: mknod d10/d59/dcd/dad/dc4/d7f/d8e/c14f 0 2023-12-06T15:00:39.017 INFO:tasks.workunit.client.0.smithi152.stdout:7/806: dread dd/df/d1b/d20/d7c/d86/da4/fbd [0,4194304] 0 2023-12-06T15:00:39.018 INFO:tasks.workunit.client.0.smithi152.stdout:7/807: getdents dd/df/d34/d44/d49/d73/d77 0 2023-12-06T15:00:39.020 INFO:tasks.workunit.client.0.smithi152.stdout:7/808: creat dd/d69/f102 x:0 0 0 2023-12-06T15:00:39.029 INFO:tasks.workunit.client.1.smithi190.stdout:2/993: dread d10/f39 [0,4194304] 0 2023-12-06T15:00:39.031 INFO:tasks.workunit.client.1.smithi190.stdout:2/994: read d10/d59/dcd/dad/fc0 [2378689,1228] 0 2023-12-06T15:00:39.031 INFO:tasks.workunit.client.1.smithi190.stdout:2/995: dread - d10/d26/d8a/d8f/f12c zero size 2023-12-06T15:00:39.031 INFO:tasks.workunit.client.1.smithi190.stdout:2/996: fdatasync d10/d59/dcd/dad/dc9/f117 0 2023-12-06T15:00:39.031 INFO:tasks.workunit.client.1.smithi190.stdout:2/997: mkdir d10/d59/dcd/dad/dc9/d146/d150 0 2023-12-06T15:00:39.033 INFO:tasks.workunit.client.0.smithi152.stdout:3/952: dwrite d9/d10/d12/d43/d52/d58/ff3 [0,4194304] 0 2023-12-06T15:00:39.034 INFO:tasks.workunit.client.0.smithi152.stdout:3/953: readlink d9/d10/d19/lfb 0 2023-12-06T15:00:39.034 INFO:tasks.workunit.client.0.smithi152.stdout:3/954: fdatasync d9/d10/d19/f57 0 2023-12-06T15:00:39.034 INFO:tasks.workunit.client.0.smithi152.stdout:3/955: chown d9/d18/d51/d8d/d8f/da0/dab/dc3/d91/cf6 47 1 2023-12-06T15:00:39.034 INFO:tasks.workunit.client.1.smithi190.stdout:2/998: write d10/d59/dcd/dad/dc4/fca [410666,116167] 0 2023-12-06T15:00:39.034 INFO:tasks.workunit.client.1.smithi190.stdout:2/999: rmdir d10/d26/d8a/d8f 39 2023-12-06T15:00:39.043 INFO:tasks.workunit.client.0.smithi152.stdout:7/809: dwrite f7 [0,4194304] 0 2023-12-06T15:00:39.048 INFO:tasks.workunit.client.0.smithi152.stdout:3/956: dwrite d9/f1d [4194304,4194304] 0 2023-12-06T15:00:39.050 INFO:tasks.workunit.client.0.smithi152.stdout:3/957: getdents d9/d10/d12/d43 0 2023-12-06T15:00:39.069 INFO:tasks.workunit.client.0.smithi152.stdout:3/958: dwrite d9/d10/d12/d43/d52/f61 [0,4194304] 0 2023-12-06T15:00:39.070 INFO:tasks.workunit.client.0.smithi152.stdout:7/810: dwrite dd/df/f2c [0,4194304] 0 2023-12-06T15:00:39.070 INFO:tasks.workunit.client.0.smithi152.stdout:7/811: symlink dd/df/d1b/l103 0 2023-12-06T15:00:39.070 INFO:tasks.workunit.client.0.smithi152.stdout:7/812: dread dd/df/f5e [0,4194304] 0 2023-12-06T15:00:39.072 INFO:tasks.workunit.client.0.smithi152.stdout:7/813: creat dd/df/d1b/d20/d28/f104 x:0 0 0 2023-12-06T15:00:39.072 INFO:tasks.workunit.client.0.smithi152.stdout:7/814: fsync f7 0 2023-12-06T15:00:39.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:38 smithi190 ceph-mon[121340]: Upgrade: Updating mgr.smithi152.meodco 2023-12-06T15:00:39.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:38 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:39.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:38 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.meodco", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-06T15:00:39.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:38 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.meodco", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-06T15:00:39.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:38 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-06T15:00:39.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:38 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:00:39.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:38 smithi190 ceph-mon[121340]: Deploying daemon mgr.smithi152.meodco on smithi152 2023-12-06T15:00:39.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:38 smithi190 ceph-mon[121340]: pgmap v31: 65 pgs: 65 active+clean; 3.4 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 172 MiB/s rd, 344 MiB/s wr, 533 op/s 2023-12-06T15:00:39.073 INFO:tasks.workunit.client.0.smithi152.stdout:7/815: creat dd/df/d1b/d20/d28/d38/f105 x:0 0 0 2023-12-06T15:00:39.074 INFO:tasks.workunit.client.0.smithi152.stdout:7/816: mkdir dd/df/dce/df5/d106 0 2023-12-06T15:00:39.080 INFO:tasks.workunit.client.0.smithi152.stdout:7/817: write dd/df/f76 [3358505,98877] 0 2023-12-06T15:00:39.080 INFO:tasks.workunit.client.0.smithi152.stdout:7/818: dread - dd/df/d34/d44/d49/f98 zero size 2023-12-06T15:00:39.081 INFO:tasks.workunit.client.0.smithi152.stdout:7/819: truncate dd/df/d1b/d20/d7c/d86/f87 2702102 0 2023-12-06T15:00:39.081 INFO:tasks.workunit.client.0.smithi152.stdout:7/820: fdatasync dd/df/d1b/d20/d28/d38/f39 0 2023-12-06T15:00:39.081 INFO:tasks.workunit.client.0.smithi152.stdout:3/959: dwrite d9/f37 [4194304,4194304] 0 2023-12-06T15:00:39.081 INFO:tasks.workunit.client.0.smithi152.stdout:3/960: chown d9/d10/d12/d43/d52/d58/da9 90 1 2023-12-06T15:00:39.082 INFO:tasks.workunit.client.0.smithi152.stdout:7/821: unlink dd/df/d34/d44/d49/d73/ce7 0 2023-12-06T15:00:39.083 INFO:tasks.workunit.client.0.smithi152.stdout:3/961: mknod d9/d10/d12/d43/c12a 0 2023-12-06T15:00:39.083 INFO:tasks.workunit.client.0.smithi152.stdout:3/962: write d9/ff [117108,1209] 0 2023-12-06T15:00:39.084 INFO:tasks.workunit.client.0.smithi152.stdout:7/822: unlink dd/df/d1b/d20/d28/d38/c51 0 2023-12-06T15:00:39.085 INFO:tasks.workunit.client.0.smithi152.stdout:7/823: write dd/df/d34/d44/f5a [3233857,119278] 0 2023-12-06T15:00:39.085 INFO:tasks.workunit.client.0.smithi152.stdout:7/824: readlink dd/df/d1b/d20/d28/d53/l6b 0 2023-12-06T15:00:39.086 INFO:tasks.workunit.client.0.smithi152.stdout:3/963: creat d9/d18/d51/d8d/d8f/da0/dab/dc3/d9f/dad/f12b x:0 0 0 2023-12-06T15:00:39.086 INFO:tasks.workunit.client.0.smithi152.stdout:3/964: dread - d9/d18/d51/d8d/d8f/da0/dab/dc3/d9f/dad/f12b zero size 2023-12-06T15:00:39.089 INFO:tasks.workunit.client.0.smithi152.stdout:7/825: mknod dd/df/d1b/d20/de5/c107 0 2023-12-06T15:00:39.090 INFO:tasks.workunit.client.0.smithi152.stdout:3/965: creat d9/d18/d51/d8d/f12c x:0 0 0 2023-12-06T15:00:39.090 INFO:tasks.workunit.client.0.smithi152.stdout:3/966: chown d9/d18/d51/d8d 205730870 1 2023-12-06T15:00:39.091 INFO:tasks.workunit.client.0.smithi152.stdout:3/967: dread - d9/ff4 zero size 2023-12-06T15:00:39.091 INFO:tasks.workunit.client.0.smithi152.stdout:3/968: chown d9/d18/f95 110161 1 2023-12-06T15:00:39.091 INFO:tasks.workunit.client.1.smithi190.stdout:4/973: sync 2023-12-06T15:00:39.091 INFO:tasks.workunit.client.1.smithi190.stdout:4/974: write d3/d35/d19/f11a [373023,126406] 0 2023-12-06T15:00:39.092 INFO:tasks.workunit.client.0.smithi152.stdout:3/969: mkdir d9/d18/d51/d8d/d8f/da0/dab/dc3/d91/d12d 0 2023-12-06T15:00:39.092 INFO:tasks.workunit.client.0.smithi152.stdout:3/970: chown d9/d45/d9c 1 1 2023-12-06T15:00:39.092 INFO:tasks.workunit.client.1.smithi190.stdout:4/975: mkdir d3/d4e/d119/d156 0 2023-12-06T15:00:39.093 INFO:tasks.workunit.client.1.smithi190.stdout:4/976: mkdir d3/d35/d19/d67/db5/d12a/d157 0 2023-12-06T15:00:39.093 INFO:tasks.workunit.client.1.smithi190.stdout:4/977: fdatasync d3/d35/d19/d41/d44/d5b/f61 0 2023-12-06T15:00:39.096 INFO:tasks.workunit.client.1.smithi190.stdout:4/978: mkdir d3/d76/dc4/dc5/d3c/d116/d39/dc8/d14e/d158 0 2023-12-06T15:00:39.096 INFO:tasks.workunit.client.1.smithi190.stdout:4/979: fsync d3/fb8 0 2023-12-06T15:00:39.096 INFO:tasks.workunit.client.1.smithi190.stdout:4/980: truncate d3/d76/dc4/dc5/d3c/d116/d39/d54/f60 34493 0 2023-12-06T15:00:39.101 INFO:tasks.workunit.client.0.smithi152.stdout:3/971: dread d9/d10/d19/f7b [0,4194304] 0 2023-12-06T15:00:39.101 INFO:tasks.workunit.client.1.smithi190.stdout:4/981: dread d3/d76/dc4/dc5/d3c/d116/d15/ffb [0,4194304] 0 2023-12-06T15:00:39.102 INFO:tasks.workunit.client.0.smithi152.stdout:7/826: dread dd/d69/f2a [8388608,4194304] 0 2023-12-06T15:00:39.103 INFO:tasks.workunit.client.1.smithi190.stdout:4/982: mkdir d3/d76/d159 0 2023-12-06T15:00:39.103 INFO:tasks.workunit.client.0.smithi152.stdout:7/827: creat dd/f108 x:0 0 0 2023-12-06T15:00:39.104 INFO:tasks.workunit.client.0.smithi152.stdout:7/828: mknod dd/d69/c109 0 2023-12-06T15:00:39.104 INFO:tasks.workunit.client.1.smithi190.stdout:4/983: unlink d3/d4e/cea 0 2023-12-06T15:00:39.105 INFO:tasks.workunit.client.0.smithi152.stdout:7/829: mkdir dd/df/d34/d44/d49/d10a 0 2023-12-06T15:00:39.106 INFO:tasks.workunit.client.0.smithi152.stdout:7/830: mknod dd/df/d34/d95/c10b 0 2023-12-06T15:00:39.106 INFO:tasks.workunit.client.0.smithi152.stdout:7/831: truncate dd/df/f5e 1411700 0 2023-12-06T15:00:39.107 INFO:tasks.workunit.client.1.smithi190.stdout:4/984: write d3/d76/dc4/dc5/d3c/d116/d39/f25 [2759465,76863] 0 2023-12-06T15:00:39.107 INFO:tasks.workunit.client.1.smithi190.stdout:4/985: chown d3/da4/cba 3 1 2023-12-06T15:00:39.107 INFO:tasks.workunit.client.1.smithi190.stdout:4/986: fdatasync d3/d76/d7c/d8a/f132 0 2023-12-06T15:00:39.109 INFO:tasks.workunit.client.1.smithi190.stdout:4/987: stat d3/lc 0 2023-12-06T15:00:39.109 INFO:tasks.workunit.client.0.smithi152.stdout:7/832: mknod dd/df/d34/d44/c10c 0 2023-12-06T15:00:39.109 INFO:tasks.workunit.client.0.smithi152.stdout:7/833: fsync dd/df/d1b/d20/ff8 0 2023-12-06T15:00:39.109 INFO:tasks.workunit.client.0.smithi152.stdout:7/834: write dd/df/d34/d95/fd2 [459028,25289] 0 2023-12-06T15:00:39.109 INFO:tasks.workunit.client.0.smithi152.stdout:7/835: rename dd/d69/la7 to dd/d69/d89/l10d 0 2023-12-06T15:00:39.110 INFO:tasks.workunit.client.0.smithi152.stdout:7/836: write dd/df/d1b/d4e/f72 [3238951,124951] 0 2023-12-06T15:00:39.110 INFO:tasks.workunit.client.0.smithi152.stdout:7/837: write dd/df/d34/d44/f8c [1497003,111137] 0 2023-12-06T15:00:39.112 INFO:tasks.workunit.client.1.smithi190.stdout:4/988: creat d3/d76/dc4/dc5/d3c/d116/d7a/f15a x:0 0 0 2023-12-06T15:00:39.112 INFO:tasks.workunit.client.0.smithi152.stdout:7/838: getdents dd/df/d34/d44/d49/d73/d77/da2 0 2023-12-06T15:00:39.113 INFO:tasks.workunit.client.1.smithi190.stdout:4/989: symlink d3/d76/d7c/db9/def/l15b 0 2023-12-06T15:00:39.118 INFO:tasks.workunit.client.0.smithi152.stdout:3/972: dwrite d9/d18/f95 [0,4194304] 0 2023-12-06T15:00:39.124 INFO:tasks.workunit.client.0.smithi152.stdout:3/973: unlink d9/d18/d51/d8d/d8f/da0/dab/df0/lfa 0 2023-12-06T15:00:39.125 INFO:tasks.workunit.client.0.smithi152.stdout:3/974: mkdir d9/d10/d12/d43/d52/db4/d65/d12e 0 2023-12-06T15:00:39.143 INFO:tasks.workunit.client.1.smithi190.stdout:4/990: dwrite d3/da4/f123 [0,4194304] 0 2023-12-06T15:00:39.143 INFO:tasks.workunit.client.1.smithi190.stdout:4/991: chown d3/d76/dc4/dc5/d3c/d116/d15 180 1 2023-12-06T15:00:39.144 INFO:tasks.workunit.client.0.smithi152.stdout:3/975: dwrite d9/d10/d19/f11f [0,4194304] 0 2023-12-06T15:00:39.146 INFO:tasks.workunit.client.0.smithi152.stdout:3/976: unlink d9/d18/d51/ld7 0 2023-12-06T15:00:39.149 INFO:tasks.workunit.client.0.smithi152.stdout:3/977: dread d9/d10/d12/d43/d52/d58/da9/fe4 [4194304,4194304] 0 2023-12-06T15:00:39.150 INFO:tasks.workunit.client.0.smithi152.stdout:3/978: mknod d9/d10/d12/d43/d52/d58/da9/c12f 0 2023-12-06T15:00:39.150 INFO:tasks.workunit.client.0.smithi152.stdout:3/979: mknod d9/d10/d12/d43/c130 0 2023-12-06T15:00:39.152 INFO:tasks.workunit.client.1.smithi190.stdout:4/992: dread d3/d76/d8b/fd4 [0,4194304] 0 2023-12-06T15:00:39.152 INFO:tasks.workunit.client.1.smithi190.stdout:4/993: readlink d3/d35/d19/d67/l133 0 2023-12-06T15:00:39.153 INFO:tasks.workunit.client.1.smithi190.stdout:4/994: truncate d3/d76/dc4/dc5/d3c/f153 1392736 0 2023-12-06T15:00:39.153 INFO:tasks.workunit.client.1.smithi190.stdout:0/981: sync 2023-12-06T15:00:39.153 INFO:tasks.workunit.client.1.smithi190.stdout:5/980: sync 2023-12-06T15:00:39.155 INFO:tasks.workunit.client.1.smithi190.stdout:4/995: truncate d3/d76/dc4/dc5/f86 2369589 0 2023-12-06T15:00:39.155 INFO:tasks.workunit.client.1.smithi190.stdout:4/996: stat d3/d35/da9 0 2023-12-06T15:00:39.155 INFO:tasks.workunit.client.1.smithi190.stdout:4/997: chown d3/d76/d7c/db9/def/c14a 106877349 1 2023-12-06T15:00:39.156 INFO:tasks.workunit.client.1.smithi190.stdout:5/981: unlink d0/d1c/d2b/f9e 0 2023-12-06T15:00:39.162 INFO:tasks.workunit.client.1.smithi190.stdout:0/982: creat d0/da/d5a/de7/f144 x:0 0 0 2023-12-06T15:00:39.162 INFO:tasks.workunit.client.1.smithi190.stdout:4/998: link d3/d4e/l14c d3/d76/dc4/dc5/d3c/l15c 0 2023-12-06T15:00:39.162 INFO:tasks.workunit.client.1.smithi190.stdout:0/983: readlink d0/da/d3e/d2b/d3c/l6b 0 2023-12-06T15:00:39.163 INFO:tasks.workunit.client.1.smithi190.stdout:4/999: truncate d3/d76/dc4/dc5/d3c/d116/d15/ffb 947631 0 2023-12-06T15:00:39.164 INFO:tasks.workunit.client.1.smithi190.stdout:0/984: mknod d0/da/d3e/d2b/c145 0 2023-12-06T15:00:39.165 INFO:tasks.workunit.client.0.smithi152.stdout:3/980: dwrite d9/d10/d12/d43/f8b [0,4194304] 0 2023-12-06T15:00:39.168 INFO:tasks.workunit.client.0.smithi152.stdout:3/981: truncate d9/d10/d12/d43/d52/d58/da9/fe4 637589 0 2023-12-06T15:00:39.170 INFO:tasks.workunit.client.0.smithi152.stdout:3/982: symlink d9/d10/d12/d43/l131 0 2023-12-06T15:00:39.170 INFO:tasks.workunit.client.0.smithi152.stdout:3/983: fsync d9/d10/d12/d43/d52/db4/d65/f79 0 2023-12-06T15:00:39.181 INFO:tasks.workunit.client.1.smithi190.stdout:5/982: dwrite d0/d1c/d85/d90/f97 [8388608,4194304] 0 2023-12-06T15:00:39.183 INFO:tasks.workunit.client.1.smithi190.stdout:5/983: creat d0/d1c/d2b/d2c/d5d/d73/d116/d112/d134/f14c x:0 0 0 2023-12-06T15:00:39.183 INFO:tasks.workunit.client.1.smithi190.stdout:5/984: fsync d0/d1c/d85/d90/d99/f11a 0 2023-12-06T15:00:39.183 INFO:tasks.workunit.client.1.smithi190.stdout:5/985: chown d0 127266142 1 2023-12-06T15:00:39.183 INFO:tasks.workunit.client.1.smithi190.stdout:5/986: read d0/d1c/d2b/d8b/f143 [445651,26031] 0 2023-12-06T15:00:39.184 INFO:tasks.workunit.client.1.smithi190.stdout:5/987: symlink d0/d1c/d94/l14d 0 2023-12-06T15:00:39.184 INFO:tasks.workunit.client.1.smithi190.stdout:5/988: chown d0/d1c/d2b/f7f 1 1 2023-12-06T15:00:39.184 INFO:tasks.workunit.client.0.smithi152.stdout:3/984: dread d9/d18/d51/d8d/d8f/da0/dab/dc3/db6/fec [0,4194304] 0 2023-12-06T15:00:39.187 INFO:tasks.workunit.client.0.smithi152.stdout:3/985: read d9/d10/d12/d43/f8b [1911053,121106] 0 2023-12-06T15:00:39.187 INFO:tasks.workunit.client.1.smithi190.stdout:0/985: dwrite d0/da/d3e/d2b/d3c/d46/f107 [0,4194304] 0 2023-12-06T15:00:39.191 INFO:tasks.workunit.client.0.smithi152.stdout:3/986: link d9/d18/d51/d8d/d8f/da0/dab/dc3/d91/fef d9/d45/f132 0 2023-12-06T15:00:39.191 INFO:tasks.workunit.client.0.smithi152.stdout:3/987: chown d9/d10/d12/d43/d52/db4/c27 10 1 2023-12-06T15:00:39.193 INFO:tasks.workunit.client.0.smithi152.stdout:3/988: mknod d9/d10/d19/dfc/c133 0 2023-12-06T15:00:39.198 INFO:tasks.workunit.client.0.smithi152.stdout:3/989: read d9/d10/f10d [1946142,18166] 0 2023-12-06T15:00:39.199 INFO:tasks.workunit.client.0.smithi152.stdout:3/990: link d9/fe0 d9/d18/d39/f134 0 2023-12-06T15:00:39.200 INFO:tasks.workunit.client.0.smithi152.stdout:3/991: truncate d9/d18/d51/d8d/d8f/da0/dab/dc3/d91/dca/f101 385508 0 2023-12-06T15:00:39.211 INFO:tasks.workunit.client.1.smithi190.stdout:5/989: dwrite d0/d1c/d94/fc4 [0,4194304] 0 2023-12-06T15:00:39.211 INFO:tasks.workunit.client.1.smithi190.stdout:5/990: truncate d0/d1c/d85/d90/dba/f103 612871 0 2023-12-06T15:00:39.222 INFO:tasks.workunit.client.0.smithi152.stdout:3/992: dwrite d9/d18/d51/d8d/d8f/da0/dab/dc3/d91/dca/fe9 [0,4194304] 0 2023-12-06T15:00:39.223 INFO:tasks.workunit.client.0.smithi152.stdout:3/993: chown d9/d18/d51/d8d/d8f/da0/dab/dc3/f8c 99197958 1 2023-12-06T15:00:39.223 INFO:tasks.workunit.client.0.smithi152.stdout:3/994: write d9/d10/d19/f2c [969637,5081] 0 2023-12-06T15:00:39.223 INFO:tasks.workunit.client.0.smithi152.stdout:3/995: fdatasync d9/d10/d12/f3a 0 2023-12-06T15:00:39.224 INFO:tasks.workunit.client.0.smithi152.stdout:3/996: getdents d9/d10/d12/d43 0 2023-12-06T15:00:39.225 INFO:tasks.workunit.client.0.smithi152.stdout:3/997: getdents d9/d18/d51/d8d/d8f/da0/dab/dc3 0 2023-12-06T15:00:39.226 INFO:tasks.workunit.client.0.smithi152.stdout:3/998: creat d9/d18/d51/d8d/d8f/de6/f135 x:0 0 0 2023-12-06T15:00:39.236 INFO:tasks.workunit.client.0.smithi152.stdout:3/999: dread d9/d10/d12/d43/f78 [0,4194304] 0 2023-12-06T15:00:39.236 INFO:tasks.workunit.client.1.smithi190.stdout:5/991: dwrite d0/df/d50/f75 [0,4194304] 0 2023-12-06T15:00:39.238 INFO:tasks.workunit.client.1.smithi190.stdout:5/992: truncate d0/d1c/d2b/d2c/d5d/d73/d116/dc5/dd5/fb3 2478716 0 2023-12-06T15:00:39.239 INFO:tasks.workunit.client.1.smithi190.stdout:5/993: symlink d0/d1c/d2b/d2c/l14e 0 2023-12-06T15:00:39.240 INFO:tasks.workunit.client.1.smithi190.stdout:5/994: truncate d0/d1c/d3e/dfd/f12e 1882607 0 2023-12-06T15:00:39.241 INFO:tasks.workunit.client.1.smithi190.stdout:5/995: stat d0/d1c/d2b/d8b/ced 0 2023-12-06T15:00:39.242 INFO:tasks.workunit.client.1.smithi190.stdout:5/996: rename d0/d1c/d85/d90/d99/ldc to d0/d6c/d145/l14f 0 2023-12-06T15:00:39.258 INFO:tasks.workunit.client.1.smithi190.stdout:5/997: dwrite d0/d1c/d2b/d8b/f10c [0,4194304] 0 2023-12-06T15:00:39.258 INFO:tasks.workunit.client.1.smithi190.stdout:5/998: chown d0/d1c/d2b/d2c/d5d/d73/d116/d112/d134/f14c 134241076 1 2023-12-06T15:00:39.259 INFO:tasks.workunit.client.1.smithi190.stdout:5/999: dread - d0/d1c/d3e/dea/f106 zero size 2023-12-06T15:00:39.268 INFO:tasks.workunit.client.0.smithi152.stdout:2/939: sync 2023-12-06T15:00:39.270 INFO:tasks.workunit.client.0.smithi152.stdout:2/940: getdents d6/d1e/d41/d92 0 2023-12-06T15:00:39.270 INFO:tasks.workunit.client.0.smithi152.stdout:2/941: fsync d6/db/d17/fd1 0 2023-12-06T15:00:39.270 INFO:tasks.workunit.client.0.smithi152.stdout:2/942: fsync d6/d1e/de1/f89 0 2023-12-06T15:00:39.270 INFO:tasks.workunit.client.0.smithi152.stdout:2/943: fdatasync d6/d1e/f62 0 2023-12-06T15:00:39.270 INFO:tasks.workunit.client.0.smithi152.stdout:0/936: sync 2023-12-06T15:00:39.270 INFO:tasks.workunit.client.0.smithi152.stdout:8/774: sync 2023-12-06T15:00:39.270 INFO:tasks.workunit.client.0.smithi152.stdout:7/839: sync 2023-12-06T15:00:39.271 INFO:tasks.workunit.client.0.smithi152.stdout:0/937: fsync d8/d15/d45/da4/fef 0 2023-12-06T15:00:39.271 INFO:tasks.workunit.client.0.smithi152.stdout:0/938: readlink d8/d15/d45/d83/l11c 0 2023-12-06T15:00:39.271 INFO:tasks.workunit.client.0.smithi152.stdout:0/939: chown d8/d3e/d6f/dd4/l108 88114225 1 2023-12-06T15:00:39.271 INFO:tasks.workunit.client.0.smithi152.stdout:8/775: write d1/d6/d29/fcf [2970996,109240] 0 2023-12-06T15:00:39.271 INFO:tasks.workunit.client.0.smithi152.stdout:7/840: unlink dd/l1d 0 2023-12-06T15:00:39.272 INFO:tasks.workunit.client.0.smithi152.stdout:0/940: mknod d8/d3e/d87/d76/c12e 0 2023-12-06T15:00:39.272 INFO:tasks.workunit.client.0.smithi152.stdout:0/941: dread - d8/d3e/d87/d76/ffe zero size 2023-12-06T15:00:39.272 INFO:tasks.workunit.client.0.smithi152.stdout:0/942: chown d8/d15/d45/d73/d7a/l4c 0 1 2023-12-06T15:00:39.272 INFO:tasks.workunit.client.0.smithi152.stdout:0/943: write d8/d4b/f51 [4422788,5801] 0 2023-12-06T15:00:39.273 INFO:tasks.workunit.client.0.smithi152.stdout:8/776: mknod d1/d6/d34/d40/cfb 0 2023-12-06T15:00:39.274 INFO:tasks.workunit.client.0.smithi152.stdout:7/841: unlink dd/df/d1b/d20/d28/d53/f64 0 2023-12-06T15:00:39.275 INFO:tasks.workunit.client.0.smithi152.stdout:7/842: read dd/df/d1b/f93 [74059,40372] 0 2023-12-06T15:00:39.275 INFO:tasks.workunit.client.0.smithi152.stdout:7/843: chown dd/df/d1b/d20/d28/d38/f82 1061939478 1 2023-12-06T15:00:39.278 INFO:tasks.workunit.client.0.smithi152.stdout:0/944: rename d8/d15/d45/dd6 to d8/d4b/d12f 0 2023-12-06T15:00:39.278 INFO:tasks.workunit.client.0.smithi152.stdout:0/945: fsync d8/d3e/d87/d76/d68/fa6 0 2023-12-06T15:00:39.279 INFO:tasks.workunit.client.0.smithi152.stdout:8/777: stat d1/d6/d34/d90/ldb 0 2023-12-06T15:00:39.281 INFO:tasks.workunit.client.0.smithi152.stdout:0/946: unlink d8/fa 0 2023-12-06T15:00:39.282 INFO:tasks.workunit.client.0.smithi152.stdout:8/778: rmdir d1/d6/d34/d35/d38 39 2023-12-06T15:00:39.285 INFO:tasks.workunit.client.0.smithi152.stdout:8/779: creat d1/d6/d34/d6f/ffc x:0 0 0 2023-12-06T15:00:39.285 INFO:tasks.workunit.client.0.smithi152.stdout:8/780: write d1/d6/d34/d3a/fc0 [1353351,96819] 0 2023-12-06T15:00:39.291 INFO:tasks.workunit.client.0.smithi152.stdout:2/944: dwrite d6/d1e/d41/d92/fc8 [0,4194304] 0 2023-12-06T15:00:39.291 INFO:tasks.workunit.client.0.smithi152.stdout:2/945: read - d6/d18/d70/d111/f114 zero size 2023-12-06T15:00:39.294 INFO:tasks.workunit.client.0.smithi152.stdout:2/946: creat d6/d18/d43/f12d x:0 0 0 2023-12-06T15:00:39.295 INFO:tasks.workunit.client.0.smithi152.stdout:2/947: creat d6/db/d91/f12e x:0 0 0 2023-12-06T15:00:39.300 INFO:tasks.workunit.client.0.smithi152.stdout:2/948: write d6/d18/d70/fba [2628824,5806] 0 2023-12-06T15:00:39.300 INFO:tasks.workunit.client.0.smithi152.stdout:2/949: write d6/db/d17/f5e [712431,130558] 0 2023-12-06T15:00:39.301 INFO:tasks.workunit.client.0.smithi152.stdout:7/844: dwrite dd/df/d34/d44/d49/d73/d77/db8/fa9 [0,4194304] 0 2023-12-06T15:00:39.301 INFO:tasks.workunit.client.0.smithi152.stdout:2/950: creat d6/d18/d43/f12f x:0 0 0 2023-12-06T15:00:39.306 INFO:tasks.workunit.client.0.smithi152.stdout:7/845: unlink dd/df/d1b/d20/de5/cfb 0 2023-12-06T15:00:39.307 INFO:tasks.workunit.client.0.smithi152.stdout:8/781: dwrite d1/f77 [4194304,4194304] 0 2023-12-06T15:00:39.308 INFO:tasks.workunit.client.0.smithi152.stdout:0/947: dwrite d8/d15/d45/d73/db9/fe9 [0,4194304] 0 2023-12-06T15:00:39.308 INFO:tasks.workunit.client.0.smithi152.stdout:0/948: stat d8/d15/f33 0 2023-12-06T15:00:39.314 INFO:tasks.workunit.client.0.smithi152.stdout:8/782: symlink d1/d6/d34/d36/d58/de8/lfd 0 2023-12-06T15:00:39.315 INFO:tasks.workunit.client.0.smithi152.stdout:7/846: symlink dd/df/d1b/d20/d28/l10e 0 2023-12-06T15:00:39.317 INFO:tasks.workunit.client.0.smithi152.stdout:8/783: unlink d1/d6/d34/d36/d58/de8/fee 0 2023-12-06T15:00:39.320 INFO:tasks.workunit.client.0.smithi152.stdout:0/949: write d8/d15/d45/d73/d7a/f5b [2867841,82032] 0 2023-12-06T15:00:39.322 INFO:tasks.workunit.client.0.smithi152.stdout:2/951: dwrite d6/db/fb1 [0,4194304] 0 2023-12-06T15:00:39.322 INFO:tasks.workunit.client.0.smithi152.stdout:2/952: write d6/d1e/d41/d92/dbf/fce [4914287,37355] 0 2023-12-06T15:00:39.322 INFO:tasks.workunit.client.0.smithi152.stdout:2/953: stat d6 0 2023-12-06T15:00:39.322 INFO:tasks.workunit.client.0.smithi152.stdout:0/950: creat d8/d3e/d6f/f130 x:0 0 0 2023-12-06T15:00:39.322 INFO:tasks.workunit.client.0.smithi152.stdout:0/951: stat d8/d3e/d87/f53 0 2023-12-06T15:00:39.326 INFO:tasks.workunit.client.0.smithi152.stdout:2/954: unlink d6/l113 0 2023-12-06T15:00:39.328 INFO:tasks.workunit.client.0.smithi152.stdout:2/955: symlink d6/db/l130 0 2023-12-06T15:00:39.329 INFO:tasks.workunit.client.0.smithi152.stdout:2/956: mknod d6/d1e/d41/d83/c131 0 2023-12-06T15:00:39.329 INFO:tasks.workunit.client.0.smithi152.stdout:2/957: dread - d6/d18/d43/f12f zero size 2023-12-06T15:00:39.330 INFO:tasks.workunit.client.0.smithi152.stdout:2/958: readlink d6/db/d17/lc6 0 2023-12-06T15:00:39.330 INFO:tasks.workunit.client.0.smithi152.stdout:2/959: write d6/db/f61 [1472240,116811] 0 2023-12-06T15:00:39.330 INFO:tasks.workunit.client.0.smithi152.stdout:0/952: dread d8/d15/fdf [0,4194304] 0 2023-12-06T15:00:39.330 INFO:tasks.workunit.client.0.smithi152.stdout:2/960: chown d6/d18/d43/db8/d10f/f11d 22727 1 2023-12-06T15:00:39.330 INFO:tasks.workunit.client.0.smithi152.stdout:7/847: dread f8 [0,4194304] 0 2023-12-06T15:00:39.331 INFO:tasks.workunit.client.0.smithi152.stdout:8/784: dread d1/d6/d34/fa2 [0,4194304] 0 2023-12-06T15:00:39.331 INFO:tasks.workunit.client.0.smithi152.stdout:2/961: rmdir d6/d18/d43/db8 39 2023-12-06T15:00:39.331 INFO:tasks.workunit.client.0.smithi152.stdout:7/848: write dd/df/d1b/d20/d28/d38/f105 [505513,57867] 0 2023-12-06T15:00:39.331 INFO:tasks.workunit.client.0.smithi152.stdout:8/785: symlink d1/d6/d34/d40/de2/lfe 0 2023-12-06T15:00:39.335 INFO:tasks.workunit.client.0.smithi152.stdout:2/962: rename d6/d18/d43/c67 to d6/d1e/d41/da2/dea/d109/c132 0 2023-12-06T15:00:39.335 INFO:tasks.workunit.client.0.smithi152.stdout:2/963: fdatasync d6/d1e/d41/d83/fbe 0 2023-12-06T15:00:39.337 INFO:tasks.workunit.client.0.smithi152.stdout:7/849: creat dd/d69/f10f x:0 0 0 2023-12-06T15:00:39.339 INFO:tasks.workunit.client.0.smithi152.stdout:0/953: dread d8/f3f [0,4194304] 0 2023-12-06T15:00:39.339 INFO:tasks.workunit.client.0.smithi152.stdout:0/954: truncate d8/d15/d45/d73/feb 722089 0 2023-12-06T15:00:39.339 INFO:tasks.workunit.client.0.smithi152.stdout:7/850: symlink dd/df/d1b/d20/d7c/d86/da4/l110 0 2023-12-06T15:00:39.341 INFO:tasks.workunit.client.0.smithi152.stdout:0/955: rename d8/d15/l19 to d8/d4b/l131 0 2023-12-06T15:00:39.341 INFO:tasks.workunit.client.0.smithi152.stdout:0/956: chown d8/d15/d45/d99 523259794 1 2023-12-06T15:00:39.341 INFO:tasks.workunit.client.0.smithi152.stdout:0/957: fsync d8/d3e/d87/d76/d68/fa6 0 2023-12-06T15:00:39.341 INFO:tasks.workunit.client.0.smithi152.stdout:0/958: dread - d8/d4b/f4e zero size 2023-12-06T15:00:39.342 INFO:tasks.workunit.client.0.smithi152.stdout:7/851: mkdir dd/df/d34/d44/d49/d10a/d111 0 2023-12-06T15:00:39.342 INFO:tasks.workunit.client.0.smithi152.stdout:2/964: dread d6/d1e/d7a/f7b [4194304,4194304] 0 2023-12-06T15:00:39.342 INFO:tasks.workunit.client.0.smithi152.stdout:2/965: chown d6/d1e/d41/da2/dea 9806456 1 2023-12-06T15:00:39.343 INFO:tasks.workunit.client.0.smithi152.stdout:2/966: stat d6/d1e/d7a/f8b 0 2023-12-06T15:00:39.343 INFO:tasks.workunit.client.0.smithi152.stdout:0/959: creat d8/d15/d45/d73/ddd/de1/f132 x:0 0 0 2023-12-06T15:00:39.344 INFO:tasks.workunit.client.0.smithi152.stdout:2/967: creat d6/d1e/d41/da2/ddd/f133 x:0 0 0 2023-12-06T15:00:39.344 INFO:tasks.workunit.client.0.smithi152.stdout:2/968: chown d6/d18/l7d 233 1 2023-12-06T15:00:39.344 INFO:tasks.workunit.client.0.smithi152.stdout:2/969: chown d6/l63 4 1 2023-12-06T15:00:39.345 INFO:tasks.workunit.client.0.smithi152.stdout:7/852: link dd/df/l66 dd/df/d1b/d20/d28/l112 0 2023-12-06T15:00:39.349 INFO:tasks.workunit.client.0.smithi152.stdout:7/853: getdents dd 0 2023-12-06T15:00:39.351 INFO:tasks.workunit.client.0.smithi152.stdout:7/854: truncate dd/df/d1b/d20/d7c/f84 2346576 0 2023-12-06T15:00:39.352 INFO:tasks.workunit.client.0.smithi152.stdout:7/855: read f8 [1010344,89042] 0 2023-12-06T15:00:39.354 INFO:tasks.workunit.client.0.smithi152.stdout:2/970: rmdir d6/d18/d43 39 2023-12-06T15:00:39.355 INFO:tasks.workunit.client.0.smithi152.stdout:2/971: creat d6/d18/d43/db8/df9/f134 x:0 0 0 2023-12-06T15:00:39.356 INFO:tasks.workunit.client.0.smithi152.stdout:8/786: dwrite d1/d6/d29/d74/fe7 [0,4194304] 0 2023-12-06T15:00:39.356 INFO:tasks.workunit.client.0.smithi152.stdout:8/787: chown d1/d6/d34/d35/d8d/fbf 1890956 1 2023-12-06T15:00:39.356 INFO:tasks.workunit.client.0.smithi152.stdout:8/788: dread - d1/d6/d34/d90/fe4 zero size 2023-12-06T15:00:39.356 INFO:tasks.workunit.client.0.smithi152.stdout:8/789: readlink d1/d6/d34/d36/ld3 0 2023-12-06T15:00:39.357 INFO:tasks.workunit.client.0.smithi152.stdout:7/856: write dd/df/f1a [2372763,54305] 0 2023-12-06T15:00:39.358 INFO:tasks.workunit.client.0.smithi152.stdout:2/972: rmdir d6/d1e/de1 39 2023-12-06T15:00:39.361 INFO:tasks.workunit.client.0.smithi152.stdout:8/790: symlink d1/d6/d34/d40/dd8/lff 0 2023-12-06T15:00:39.362 INFO:tasks.workunit.client.0.smithi152.stdout:8/791: chown d1/d6/d34/fa2 2519880 1 2023-12-06T15:00:39.362 INFO:tasks.workunit.client.0.smithi152.stdout:8/792: dread - d1/d6/d34/d35/d66/d82/db6/ff6 zero size 2023-12-06T15:00:39.362 INFO:tasks.workunit.client.0.smithi152.stdout:8/793: read - d1/d6/d29/fae zero size 2023-12-06T15:00:39.363 INFO:tasks.workunit.client.0.smithi152.stdout:2/973: dread d6/d1e/d7a/f11c [0,4194304] 0 2023-12-06T15:00:39.363 INFO:tasks.workunit.client.0.smithi152.stdout:2/974: readlink d6/d18/d43/d95/ldc 0 2023-12-06T15:00:39.363 INFO:tasks.workunit.client.0.smithi152.stdout:2/975: read - d6/d18/d43/d95/fe2 zero size 2023-12-06T15:00:39.363 INFO:tasks.workunit.client.0.smithi152.stdout:8/794: getdents d1/d6/d34 0 2023-12-06T15:00:39.363 INFO:tasks.workunit.client.0.smithi152.stdout:8/795: chown d1/d6/d34/d35/d66/faf 11 1 2023-12-06T15:00:39.363 INFO:tasks.workunit.client.0.smithi152.stdout:2/976: creat d6/d18/f135 x:0 0 0 2023-12-06T15:00:39.364 INFO:tasks.workunit.client.0.smithi152.stdout:8/796: mkdir d1/d6/d34/d35/dd6/d100 0 2023-12-06T15:00:39.365 INFO:tasks.workunit.client.0.smithi152.stdout:0/960: dwrite d8/d15/d45/d73/d7a/f41 [0,4194304] 0 2023-12-06T15:00:39.366 INFO:tasks.workunit.client.0.smithi152.stdout:2/977: truncate d6/d1e/f53 457980 0 2023-12-06T15:00:39.366 INFO:tasks.workunit.client.0.smithi152.stdout:2/978: dread - d6/db/d91/fcc zero size 2023-12-06T15:00:39.366 INFO:tasks.workunit.client.0.smithi152.stdout:2/979: write d6/d1e/de1/f65 [5941409,56857] 0 2023-12-06T15:00:39.366 INFO:tasks.workunit.client.0.smithi152.stdout:0/961: mkdir d8/d15/d45/d73/dac/d133 0 2023-12-06T15:00:39.366 INFO:tasks.workunit.client.0.smithi152.stdout:0/962: chown d8/d4b/f65 41 1 2023-12-06T15:00:39.368 INFO:tasks.workunit.client.0.smithi152.stdout:2/980: mkdir d6/d1e/d41/d83/d136 0 2023-12-06T15:00:39.369 INFO:tasks.workunit.client.0.smithi152.stdout:2/981: truncate d6/d18/d43/f5f 686857 0 2023-12-06T15:00:39.380 INFO:tasks.workunit.client.0.smithi152.stdout:7/857: dwrite f1 [4194304,4194304] 0 2023-12-06T15:00:39.402 INFO:tasks.workunit.client.0.smithi152.stdout:0/963: dwrite d8/d4b/f8a [0,4194304] 0 2023-12-06T15:00:39.402 INFO:tasks.workunit.client.0.smithi152.stdout:0/964: chown d8/c11 22187 1 2023-12-06T15:00:39.403 INFO:tasks.workunit.client.0.smithi152.stdout:0/965: creat d8/d15/d45/d73/dac/d133/f134 x:0 0 0 2023-12-06T15:00:39.404 INFO:tasks.workunit.client.0.smithi152.stdout:0/966: write d8/d15/d45/d73/d7a/f34 [1837929,77357] 0 2023-12-06T15:00:39.405 INFO:tasks.workunit.client.0.smithi152.stdout:8/797: dwrite d1/d6/d34/d35/d8d/fb5 [0,4194304] 0 2023-12-06T15:00:39.405 INFO:tasks.workunit.client.0.smithi152.stdout:8/798: fdatasync d1/d6/d29/f51 0 2023-12-06T15:00:39.405 INFO:tasks.workunit.client.0.smithi152.stdout:8/799: truncate d1/d6/d34/d90/f9e 4734005 0 2023-12-06T15:00:39.405 INFO:tasks.workunit.client.0.smithi152.stdout:7/858: dwrite dd/fd8 [0,4194304] 0 2023-12-06T15:00:39.405 INFO:tasks.workunit.client.0.smithi152.stdout:0/967: rmdir d8/d15/d45/d73/df5 39 2023-12-06T15:00:39.405 INFO:tasks.workunit.client.0.smithi152.stdout:0/968: readlink d8/d44/lf0 0 2023-12-06T15:00:39.406 INFO:tasks.workunit.client.0.smithi152.stdout:2/982: dwrite d6/d1e/f53 [0,4194304] 0 2023-12-06T15:00:39.406 INFO:tasks.workunit.client.0.smithi152.stdout:8/800: mkdir d1/d6/d29/d5b/df1/d101 0 2023-12-06T15:00:39.409 INFO:tasks.workunit.client.0.smithi152.stdout:7/859: rename dd/df/d1b/f7d to dd/df/d1b/d20/de5/f113 0 2023-12-06T15:00:39.410 INFO:tasks.workunit.client.0.smithi152.stdout:7/860: write dd/df/d1b/d20/d7c/d86/da4/ffc [610871,76097] 0 2023-12-06T15:00:39.410 INFO:tasks.workunit.client.0.smithi152.stdout:0/969: mkdir d8/d3e/d87/d76/df8/d135 0 2023-12-06T15:00:39.411 INFO:tasks.workunit.client.0.smithi152.stdout:2/983: link d6/d1e/d41/da2/dea/d109/c132 d6/d1e/d41/d92/c137 0 2023-12-06T15:00:39.415 INFO:tasks.workunit.client.0.smithi152.stdout:7/861: rename dd/df/d34/d44/d49/d73/d77/db8/fe1 to dd/df/dce/f114 0 2023-12-06T15:00:39.415 INFO:tasks.workunit.client.0.smithi152.stdout:7/862: write f3 [13550723,59227] 0 2023-12-06T15:00:39.419 INFO:tasks.workunit.client.0.smithi152.stdout:0/970: link d8/d15/d45/d73/d8c/fd9 d8/d3e/d87/f136 0 2023-12-06T15:00:39.419 INFO:tasks.workunit.client.0.smithi152.stdout:2/984: creat d6/f138 x:0 0 0 2023-12-06T15:00:39.419 INFO:tasks.workunit.client.0.smithi152.stdout:7/863: rmdir dd/df/d78 39 2023-12-06T15:00:39.420 INFO:tasks.workunit.client.0.smithi152.stdout:0/971: rmdir d8/d15/d45/d73/d123 0 2023-12-06T15:00:39.420 INFO:tasks.workunit.client.0.smithi152.stdout:0/972: readlink d8/d3e/d87/d76/d68/la0 0 2023-12-06T15:00:39.420 INFO:tasks.workunit.client.0.smithi152.stdout:0/973: chown d8/d15/d45/d99/lba 2 1 2023-12-06T15:00:39.421 INFO:tasks.workunit.client.0.smithi152.stdout:2/985: mkdir d6/d18/d43/db3/db7/d139 0 2023-12-06T15:00:39.421 INFO:tasks.workunit.client.0.smithi152.stdout:7/864: symlink dd/df/dce/df5/l115 0 2023-12-06T15:00:39.422 INFO:tasks.workunit.client.0.smithi152.stdout:0/974: truncate d8/d15/f33 3000389 0 2023-12-06T15:00:39.422 INFO:tasks.workunit.client.0.smithi152.stdout:0/975: fsync d8/d15/d45/d73/df5/f120 0 2023-12-06T15:00:39.425 INFO:tasks.workunit.client.0.smithi152.stdout:7/865: creat dd/df/d34/dac/f116 x:0 0 0 2023-12-06T15:00:39.427 INFO:tasks.workunit.client.0.smithi152.stdout:7/866: creat dd/df/d1b/d20/d7c/db7/f117 x:0 0 0 2023-12-06T15:00:39.427 INFO:tasks.workunit.client.0.smithi152.stdout:2/986: dread d6/d18/d43/db3/fd5 [0,4194304] 0 2023-12-06T15:00:39.428 INFO:tasks.workunit.client.0.smithi152.stdout:8/801: dwrite d1/d6/d34/fa [0,4194304] 0 2023-12-06T15:00:39.429 INFO:tasks.workunit.client.0.smithi152.stdout:2/987: mknod d6/d18/d43/c13a 0 2023-12-06T15:00:39.429 INFO:tasks.workunit.client.0.smithi152.stdout:2/988: chown d6/d18/d43/c13a 1 1 2023-12-06T15:00:39.429 INFO:tasks.workunit.client.0.smithi152.stdout:2/989: dread - d6/d18/d43/db8/d10f/f122 zero size 2023-12-06T15:00:39.431 INFO:tasks.workunit.client.0.smithi152.stdout:8/802: creat d1/f102 x:0 0 0 2023-12-06T15:00:39.439 INFO:tasks.workunit.client.0.smithi152.stdout:2/990: link d6/d1e/d41/da2/ddd/f133 d6/d1e/d41/f13b 0 2023-12-06T15:00:39.439 INFO:tasks.workunit.client.0.smithi152.stdout:2/991: fdatasync d6/db/d91/fcc 0 2023-12-06T15:00:39.440 INFO:tasks.workunit.client.0.smithi152.stdout:2/992: creat d6/d1e/d7a/f13c x:0 0 0 2023-12-06T15:00:39.440 INFO:tasks.workunit.client.0.smithi152.stdout:2/993: write d6/d18/d43/f5f [1070221,26962] 0 2023-12-06T15:00:39.442 INFO:tasks.workunit.client.0.smithi152.stdout:2/994: rename d6/d1e/de1/fbd to d6/d18/d70/f13d 0 2023-12-06T15:00:39.443 INFO:tasks.workunit.client.0.smithi152.stdout:2/995: symlink d6/d1e/d41/d92/l13e 0 2023-12-06T15:00:39.443 INFO:tasks.workunit.client.0.smithi152.stdout:2/996: stat d6/d1e/d41/d92/dbf/lf7 0 2023-12-06T15:00:39.443 INFO:tasks.workunit.client.0.smithi152.stdout:2/997: truncate d6/db/d17/fa6 1630754 0 2023-12-06T15:00:39.443 INFO:tasks.workunit.client.0.smithi152.stdout:2/998: truncate d6/db/f2b 3861005 0 2023-12-06T15:00:39.448 INFO:tasks.workunit.client.0.smithi152.stdout:7/867: dwrite dd/df/d34/f59 [0,4194304] 0 2023-12-06T15:00:39.448 INFO:tasks.workunit.client.0.smithi152.stdout:2/999: dread d6/d1e/d41/faf [0,4194304] 0 2023-12-06T15:00:39.449 INFO:tasks.workunit.client.0.smithi152.stdout:8/803: dwrite d1/d6/d34/fec [0,4194304] 0 2023-12-06T15:00:39.469 INFO:tasks.workunit.client.0.smithi152.stdout:8/804: dwrite d1/d6/d34/d35/fc9 [0,4194304] 0 2023-12-06T15:00:39.469 INFO:tasks.workunit.client.0.smithi152.stdout:8/805: fdatasync d1/d6/d29/fcf 0 2023-12-06T15:00:39.469 INFO:tasks.workunit.client.0.smithi152.stdout:7/868: dwrite dd/df/d1b/d20/d28/d38/fee [0,4194304] 0 2023-12-06T15:00:39.472 INFO:tasks.workunit.client.0.smithi152.stdout:7/869: creat dd/d69/d89/f118 x:0 0 0 2023-12-06T15:00:39.472 INFO:tasks.workunit.client.0.smithi152.stdout:8/806: dread d1/d6/d29/fd7 [4194304,4194304] 0 2023-12-06T15:00:39.474 INFO:tasks.workunit.client.0.smithi152.stdout:7/870: unlink dd/df/f3b 0 2023-12-06T15:00:39.478 INFO:tasks.workunit.client.0.smithi152.stdout:7/871: rmdir dd/df/d34/dac 39 2023-12-06T15:00:39.492 INFO:tasks.workunit.client.0.smithi152.stdout:8/807: dwrite d1/d6/d34/d35/d66/faf [4194304,4194304] 0 2023-12-06T15:00:39.494 INFO:tasks.workunit.client.0.smithi152.stdout:8/808: link d1/d6/d34/l18 d1/d6/d34/d6f/l103 0 2023-12-06T15:00:39.495 INFO:tasks.workunit.client.0.smithi152.stdout:8/809: rename d1/d6/d34/d40/de2/lfe to d1/d6/d29/d5b/df1/l104 0 2023-12-06T15:00:39.495 INFO:tasks.workunit.client.0.smithi152.stdout:8/810: dread - d1/d6/d29/d5b/ff8 zero size 2023-12-06T15:00:39.496 INFO:tasks.workunit.client.0.smithi152.stdout:8/811: rename d1/df7/cdc to d1/df7/c105 0 2023-12-06T15:00:39.497 INFO:tasks.workunit.client.0.smithi152.stdout:8/812: write d1/d6/d29/fcf [3543169,118629] 0 2023-12-06T15:00:39.497 INFO:tasks.workunit.client.0.smithi152.stdout:8/813: fsync d1/d6/d34/d36/f55 0 2023-12-06T15:00:39.499 INFO:tasks.workunit.client.0.smithi152.stdout:8/814: rename d1/d6/d34/d40/f9f to d1/d6/d34/d35/d38/f106 0 2023-12-06T15:00:39.500 INFO:tasks.workunit.client.0.smithi152.stdout:8/815: write d1/d6/d86/fc3 [3304339,85674] 0 2023-12-06T15:00:39.500 INFO:tasks.workunit.client.0.smithi152.stdout:8/816: dread - d1/d6/d29/ddf/ffa zero size 2023-12-06T15:00:39.500 INFO:tasks.workunit.client.0.smithi152.stdout:8/817: fdatasync d1/d6/d34/fa2 0 2023-12-06T15:00:39.500 INFO:tasks.workunit.client.0.smithi152.stdout:8/818: creat d1/d6/d34/d3a/f107 x:0 0 0 2023-12-06T15:00:39.501 INFO:tasks.workunit.client.0.smithi152.stdout:8/819: mknod d1/d6/d34/d90/c108 0 2023-12-06T15:00:39.502 INFO:tasks.workunit.client.0.smithi152.stdout:8/820: mkdir d1/d6/d34/d36/d58/de8/d109 0 2023-12-06T15:00:39.503 INFO:tasks.workunit.client.0.smithi152.stdout:8/821: symlink d1/d6/d34/d35/d38/l10a 0 2023-12-06T15:00:39.503 INFO:tasks.workunit.client.0.smithi152.stdout:8/822: fsync d1/d6/d34/fec 0 2023-12-06T15:00:39.503 INFO:tasks.workunit.client.0.smithi152.stdout:8/823: fdatasync d1/d6/d34/d36/f55 0 2023-12-06T15:00:39.504 INFO:tasks.workunit.client.0.smithi152.stdout:8/824: write d1/d6/d34/d35/dd6/ff9 [1874060,6836] 0 2023-12-06T15:00:39.517 INFO:tasks.workunit.client.0.smithi152.stdout:8/825: dwrite d1/d6/d29/f51 [0,4194304] 0 2023-12-06T15:00:39.538 INFO:tasks.workunit.client.0.smithi152.stdout:8/826: dwrite d1/d6/d34/d36/f55 [0,4194304] 0 2023-12-06T15:00:39.558 INFO:tasks.workunit.client.0.smithi152.stdout:8/827: dwrite d1/d6/d34/d36/db4/f68 [0,4194304] 0 2023-12-06T15:00:39.560 INFO:tasks.workunit.client.0.smithi152.stdout:8/828: write d1/d6/d34/d36/db4/f94 [2698904,64797] 0 2023-12-06T15:00:39.572 INFO:tasks.workunit.client.0.smithi152.stdout:8/829: dwrite d1/d6/d34/fc6 [4194304,4194304] 0 2023-12-06T15:00:39.574 INFO:tasks.workunit.client.0.smithi152.stdout:8/830: mkdir d1/d6/d29/d74/d10b 0 2023-12-06T15:00:39.574 INFO:tasks.workunit.client.0.smithi152.stdout:8/831: readlink d1/d6/d34/l16 0 2023-12-06T15:00:39.587 INFO:tasks.workunit.client.0.smithi152.stdout:8/832: dwrite d1/d6/d34/fec [0,4194304] 0 2023-12-06T15:00:39.588 INFO:tasks.workunit.client.0.smithi152.stdout:8/833: symlink d1/d6/d29/ddf/l10c 0 2023-12-06T15:00:39.589 INFO:tasks.workunit.client.0.smithi152.stdout:8/834: symlink d1/d6/d34/d35/l10d 0 2023-12-06T15:00:39.589 INFO:tasks.workunit.client.0.smithi152.stdout:8/835: chown d1/f96 0 1 2023-12-06T15:00:39.590 INFO:tasks.workunit.client.0.smithi152.stdout:8/836: truncate d1/d6/d34/d36/f2b 270245 0 2023-12-06T15:00:39.590 INFO:tasks.workunit.client.0.smithi152.stdout:8/837: creat d1/d6/d29/ddf/f10e x:0 0 0 2023-12-06T15:00:39.591 INFO:tasks.workunit.client.0.smithi152.stdout:8/838: read d1/d6/d34/d35/d66/d82/f8a [2272590,129760] 0 2023-12-06T15:00:39.592 INFO:tasks.workunit.client.0.smithi152.stdout:8/839: link d1/d6/fd d1/d6/d34/d35/d66/d82/f10f 0 2023-12-06T15:00:39.593 INFO:tasks.workunit.client.0.smithi152.stdout:8/840: creat d1/d6/d29/ddf/f110 x:0 0 0 2023-12-06T15:00:39.594 INFO:tasks.workunit.client.0.smithi152.stdout:8/841: mknod d1/df7/c111 0 2023-12-06T15:00:39.595 INFO:tasks.workunit.client.0.smithi152.stdout:8/842: rmdir d1/d6/d29/d74/d10b 0 2023-12-06T15:00:39.596 INFO:tasks.workunit.client.0.smithi152.stdout:8/843: unlink d1/df7/daa/fac 0 2023-12-06T15:00:39.597 INFO:tasks.workunit.client.0.smithi152.stdout:8/844: read d1/d6/d34/d35/d66/faf [2277242,117767] 0 2023-12-06T15:00:39.598 INFO:tasks.workunit.client.0.smithi152.stdout:8/845: rename d1/d6/d34/f98 to d1/d6/d86/f112 0 2023-12-06T15:00:39.643 INFO:tasks.workunit.client.0.smithi152.stdout:0/976: sync 2023-12-06T15:00:39.643 INFO:tasks.workunit.client.0.smithi152.stdout:7/872: sync 2023-12-06T15:00:39.643 INFO:tasks.workunit.client.0.smithi152.stdout:0/977: write d8/d3e/fa1 [1223178,73485] 0 2023-12-06T15:00:39.643 INFO:tasks.workunit.client.0.smithi152.stdout:0/978: chown d8/d4b/f65 1282879 1 2023-12-06T15:00:39.644 INFO:tasks.workunit.client.0.smithi152.stdout:7/873: symlink dd/df/d34/dac/l119 0 2023-12-06T15:00:39.645 INFO:tasks.workunit.client.0.smithi152.stdout:0/979: mkdir d8/d4b/d137 0 2023-12-06T15:00:39.645 INFO:tasks.workunit.client.0.smithi152.stdout:7/874: truncate dd/df/d1b/f93 384291 0 2023-12-06T15:00:39.646 INFO:tasks.workunit.client.0.smithi152.stdout:0/980: creat d8/d15/d45/f138 x:0 0 0 2023-12-06T15:00:39.648 INFO:tasks.workunit.client.0.smithi152.stdout:7/875: mknod dd/df/d1b/c11a 0 2023-12-06T15:00:39.648 INFO:tasks.workunit.client.0.smithi152.stdout:7/876: fdatasync dd/d69/f102 0 2023-12-06T15:00:39.649 INFO:tasks.workunit.client.0.smithi152.stdout:7/877: mknod dd/df/d34/d95/c11b 0 2023-12-06T15:00:39.651 INFO:tasks.workunit.client.0.smithi152.stdout:7/878: mkdir dd/df/d34/d44/d49/d73/d77/df9/d11c 0 2023-12-06T15:00:39.660 INFO:tasks.workunit.client.0.smithi152.stdout:0/981: dwrite d8/d15/d45/da4/fef [0,4194304] 0 2023-12-06T15:00:39.662 INFO:tasks.workunit.client.0.smithi152.stdout:0/982: mknod d8/d15/d45/c139 0 2023-12-06T15:00:39.662 INFO:tasks.workunit.client.0.smithi152.stdout:0/983: creat d8/d15/d45/d99/f13a x:0 0 0 2023-12-06T15:00:39.668 INFO:tasks.workunit.client.0.smithi152.stdout:7/879: dwrite dd/df/d34/d44/d49/d73/fb3 [0,4194304] 0 2023-12-06T15:00:39.670 INFO:tasks.workunit.client.0.smithi152.stdout:7/880: dread dd/df/d1b/d20/d28/d38/f105 [0,4194304] 0 2023-12-06T15:00:39.677 INFO:tasks.workunit.client.0.smithi152.stdout:0/984: dwrite d8/d3e/ff1 [0,4194304] 0 2023-12-06T15:00:39.678 INFO:tasks.workunit.client.0.smithi152.stdout:0/985: mknod d8/d4b/d12f/c13b 0 2023-12-06T15:00:39.685 INFO:tasks.workunit.client.0.smithi152.stdout:7/881: dwrite dd/df/d34/d44/f5a [0,4194304] 0 2023-12-06T15:00:39.686 INFO:tasks.workunit.client.0.smithi152.stdout:7/882: creat dd/df/d1b/d20/d7c/db7/f11d x:0 0 0 2023-12-06T15:00:39.688 INFO:tasks.workunit.client.0.smithi152.stdout:7/883: rename dd/df/d1b/d20/d7c/db7/lc5 to dd/df/d34/d44/d49/l11e 0 2023-12-06T15:00:39.692 INFO:tasks.workunit.client.0.smithi152.stdout:7/884: read dd/df/d1b/d20/d28/d38/dc3/f6c [2186275,77201] 0 2023-12-06T15:00:39.692 INFO:tasks.workunit.client.0.smithi152.stdout:7/885: chown dd/df/d34/d44/d49/d73/d77 129 1 2023-12-06T15:00:39.692 INFO:tasks.workunit.client.0.smithi152.stdout:7/886: truncate dd/df/d34/f59 4983288 0 2023-12-06T15:00:39.692 INFO:tasks.workunit.client.0.smithi152.stdout:7/887: chown dd/d69/d89/cf2 127969952 1 2023-12-06T15:00:39.692 INFO:tasks.workunit.client.0.smithi152.stdout:7/888: truncate dd/df/f2c 2833078 0 2023-12-06T15:00:39.692 INFO:tasks.workunit.client.0.smithi152.stdout:7/889: fsync dd/df/fb4 0 2023-12-06T15:00:39.694 INFO:tasks.workunit.client.0.smithi152.stdout:7/890: read dd/df/d1b/d20/d7c/d86/da4/fbd [307443,15265] 0 2023-12-06T15:00:39.697 INFO:tasks.workunit.client.0.smithi152.stdout:0/986: dwrite d8/d4b/fbd [0,4194304] 0 2023-12-06T15:00:39.706 INFO:tasks.workunit.client.0.smithi152.stdout:0/987: dread d8/d15/d45/da4/fde [8388608,4194304] 0 2023-12-06T15:00:39.707 INFO:tasks.workunit.client.0.smithi152.stdout:7/891: dwrite dd/df/f76 [0,4194304] 0 2023-12-06T15:00:39.709 INFO:tasks.workunit.client.0.smithi152.stdout:7/892: rename dd/df/d1b/f93 to dd/df/d1b/d20/de5/f11f 0 2023-12-06T15:00:39.710 INFO:tasks.workunit.client.0.smithi152.stdout:7/893: rmdir dd/df/d34/d95 39 2023-12-06T15:00:39.710 INFO:tasks.workunit.client.0.smithi152.stdout:7/894: mknod dd/c120 0 2023-12-06T15:00:39.719 INFO:tasks.workunit.client.0.smithi152.stdout:0/988: dread d8/d15/d45/d73/db9/fe9 [0,4194304] 0 2023-12-06T15:00:39.719 INFO:tasks.workunit.client.0.smithi152.stdout:0/989: dread - d8/d3e/f10c zero size 2023-12-06T15:00:39.719 INFO:tasks.workunit.client.0.smithi152.stdout:7/895: dread dd/df/d34/d44/d49/d73/d77/fbe [0,4194304] 0 2023-12-06T15:00:39.720 INFO:tasks.workunit.client.0.smithi152.stdout:0/990: rmdir d8/d4b/d137 0 2023-12-06T15:00:39.720 INFO:tasks.workunit.client.0.smithi152.stdout:7/896: getdents dd/df/d34/d44/d49/daf 0 2023-12-06T15:00:39.721 INFO:tasks.workunit.client.0.smithi152.stdout:7/897: chown dd/d69 66855 1 2023-12-06T15:00:39.721 INFO:tasks.workunit.client.0.smithi152.stdout:7/898: truncate dd/df/d1b/d4e/f72 5117123 0 2023-12-06T15:00:39.721 INFO:tasks.workunit.client.0.smithi152.stdout:7/899: creat dd/df/d34/dac/f121 x:0 0 0 2023-12-06T15:00:39.722 INFO:tasks.workunit.client.0.smithi152.stdout:7/900: write dd/df/d1b/d20/d7c/d86/f87 [2112081,43523] 0 2023-12-06T15:00:39.723 INFO:tasks.workunit.client.0.smithi152.stdout:7/901: symlink dd/df/d34/dac/l122 0 2023-12-06T15:00:39.724 INFO:tasks.workunit.client.0.smithi152.stdout:7/902: chown dd/df/d1b/d20/d28/d53/l83 121911 1 2023-12-06T15:00:39.725 INFO:tasks.workunit.client.0.smithi152.stdout:7/903: mknod dd/df/d34/d44/d49/c123 0 2023-12-06T15:00:39.727 INFO:tasks.workunit.client.0.smithi152.stdout:0/991: dread d8/f37 [0,4194304] 0 2023-12-06T15:00:39.727 INFO:tasks.workunit.client.0.smithi152.stdout:0/992: readlink d8/le 0 2023-12-06T15:00:39.728 INFO:tasks.workunit.client.0.smithi152.stdout:7/904: write dd/df/d34/d44/d49/daf/fb2 [2481255,124169] 0 2023-12-06T15:00:39.728 INFO:tasks.workunit.client.0.smithi152.stdout:7/905: chown dd/df/d34/d44/d49/d73/d77/f8b 3096016 1 2023-12-06T15:00:39.728 INFO:tasks.workunit.client.0.smithi152.stdout:0/993: truncate d8/d15/fdf 1368125 0 2023-12-06T15:00:39.731 INFO:tasks.workunit.client.0.smithi152.stdout:0/994: dread d8/ff [0,4194304] 0 2023-12-06T15:00:39.731 INFO:tasks.workunit.client.0.smithi152.stdout:0/995: creat d8/d3e/d87/d76/f13c x:0 0 0 2023-12-06T15:00:39.733 INFO:tasks.workunit.client.0.smithi152.stdout:0/996: rename d8/d15/d45/d117/d124/df4/f105 to d8/d3e/d6f/dd4/f13d 0 2023-12-06T15:00:39.734 INFO:tasks.workunit.client.0.smithi152.stdout:0/997: getdents d8/d4b/d12f 0 2023-12-06T15:00:39.734 INFO:tasks.workunit.client.0.smithi152.stdout:0/998: stat d8/fd 0 2023-12-06T15:00:39.737 INFO:tasks.workunit.client.0.smithi152.stdout:7/906: truncate dd/df/d1b/d20/d28/d38/f5d 3875595 0 2023-12-06T15:00:39.744 INFO:tasks.workunit.client.0.smithi152.stdout:0/999: dread d8/d3e/d87/f53 [0,4194304] 0 2023-12-06T15:00:39.744 INFO:tasks.workunit.client.0.smithi152.stdout:8/846: sync 2023-12-06T15:00:39.746 INFO:tasks.workunit.client.0.smithi152.stdout:8/847: symlink d1/l113 0 2023-12-06T15:00:39.748 INFO:tasks.workunit.client.0.smithi152.stdout:8/848: truncate d1/d6/d34/d35/d66/f71 3457708 0 2023-12-06T15:00:39.748 INFO:tasks.workunit.client.0.smithi152.stdout:8/849: read d1/d6/d34/d6f/fab [616872,41535] 0 2023-12-06T15:00:39.748 INFO:tasks.workunit.client.0.smithi152.stdout:8/850: dread - d1/df7/daa/ff4 zero size 2023-12-06T15:00:39.748 INFO:tasks.workunit.client.0.smithi152.stdout:8/851: stat d1/d6/d34/d40/dd8 0 2023-12-06T15:00:39.760 INFO:tasks.workunit.client.0.smithi152.stdout:8/852: dwrite d1/d6/d34/d35/d8d/fa1 [4194304,4194304] 0 2023-12-06T15:00:39.762 INFO:tasks.workunit.client.0.smithi152.stdout:8/853: mknod d1/d6/d34/d35/d8d/c114 0 2023-12-06T15:00:39.770 INFO:tasks.workunit.client.0.smithi152.stdout:8/854: dread d1/d6/d34/d36/f5d [0,4194304] 0 2023-12-06T15:00:39.771 INFO:tasks.workunit.client.0.smithi152.stdout:8/855: chown d1/d6/d34/d35/d66/ca4 0 1 2023-12-06T15:00:39.794 INFO:tasks.workunit.client.0.smithi152.stdout:8/856: dwrite d1/d6/d34/d35/d38/f45 [0,4194304] 0 2023-12-06T15:00:39.794 INFO:tasks.workunit.client.0.smithi152.stdout:8/857: fdatasync d1/d6/d34/d90/f9e 0 2023-12-06T15:00:39.796 INFO:tasks.workunit.client.0.smithi152.stdout:8/858: rename d1/d6/dd4 to d1/d6/d34/d36/d58/de8/d109/d115 0 2023-12-06T15:00:39.796 INFO:tasks.workunit.client.0.smithi152.stdout:8/859: readlink d1/d6/d34/d36/ld3 0 2023-12-06T15:00:39.797 INFO:tasks.workunit.client.0.smithi152.stdout:8/860: mknod d1/d6/d34/d36/d58/de8/d109/c116 0 2023-12-06T15:00:39.798 INFO:tasks.workunit.client.0.smithi152.stdout:8/861: truncate d1/d6/d34/fc6 727332 0 2023-12-06T15:00:39.799 INFO:tasks.workunit.client.0.smithi152.stdout:8/862: getdents d1/d6/d34/d40/dd8 0 2023-12-06T15:00:39.799 INFO:tasks.workunit.client.0.smithi152.stdout:8/863: rmdir d1/d6/d34/d35/d66 39 2023-12-06T15:00:39.799 INFO:tasks.workunit.client.0.smithi152.stdout:8/864: stat d1/d6/d29/ddf/f110 0 2023-12-06T15:00:39.800 INFO:tasks.workunit.client.0.smithi152.stdout:8/865: fsync d1/d6/d34/d35/d66/faf 0 2023-12-06T15:00:39.808 INFO:tasks.workunit.client.0.smithi152.stdout:8/866: dread d1/d6/d34/d35/d8d/fb5 [0,4194304] 0 2023-12-06T15:00:39.808 INFO:tasks.workunit.client.0.smithi152.stdout:8/867: chown d1/d6/d34/d90/c108 24 1 2023-12-06T15:00:39.808 INFO:tasks.workunit.client.0.smithi152.stdout:8/868: truncate d1/d6/d34/d36/db4/f68 3124198 0 2023-12-06T15:00:39.811 INFO:tasks.workunit.client.0.smithi152.stdout:8/869: rmdir d1/d6/d29 39 2023-12-06T15:00:39.811 INFO:tasks.workunit.client.0.smithi152.stdout:8/870: truncate d1/d6/fd 8416334 0 2023-12-06T15:00:39.813 INFO:tasks.workunit.client.0.smithi152.stdout:8/871: rename d1/d6/d34/d6f/l6b to d1/d6/d34/d40/df5/l117 0 2023-12-06T15:00:39.814 INFO:tasks.workunit.client.0.smithi152.stdout:8/872: symlink d1/d6/d34/d35/l118 0 2023-12-06T15:00:39.816 INFO:tasks.workunit.client.0.smithi152.stdout:8/873: creat d1/d6/d34/d36/d58/f119 x:0 0 0 2023-12-06T15:00:39.816 INFO:tasks.workunit.client.0.smithi152.stdout:8/874: chown d1/d6/d29/d5b 6084296 1 2023-12-06T15:00:39.831 INFO:tasks.workunit.client.0.smithi152.stdout:8/875: dwrite d1/f2d [0,4194304] 0 2023-12-06T15:00:39.833 INFO:tasks.workunit.client.0.smithi152.stdout:8/876: unlink d1/d6/d29/d74/deb/fed 0 2023-12-06T15:00:39.836 INFO:tasks.workunit.client.0.smithi152.stdout:8/877: unlink d1/d6/d34/d3a/f48 0 2023-12-06T15:00:39.836 INFO:tasks.workunit.client.0.smithi152.stdout:8/878: write d1/d6/d29/fcf [6673295,14471] 0 2023-12-06T15:00:39.849 INFO:tasks.workunit.client.0.smithi152.stdout:8/879: dwrite d1/d6/d86/f112 [0,4194304] 0 2023-12-06T15:00:39.850 INFO:tasks.workunit.client.0.smithi152.stdout:8/880: chown d1/d6/d34/d36/db4/l6c 198902473 1 2023-12-06T15:00:39.851 INFO:tasks.workunit.client.0.smithi152.stdout:8/881: write d1/d6/d34/fc6 [334952,104312] 0 2023-12-06T15:00:39.853 INFO:tasks.workunit.client.0.smithi152.stdout:8/882: getdents d1/df7 0 2023-12-06T15:00:39.854 INFO:tasks.workunit.client.0.smithi152.stdout:7/907: sync 2023-12-06T15:00:39.855 INFO:tasks.workunit.client.0.smithi152.stdout:7/908: creat dd/df/d78/f124 x:0 0 0 2023-12-06T15:00:39.857 INFO:tasks.workunit.client.0.smithi152.stdout:7/909: rename dd/d69/d89/l10d to dd/df/d34/d44/d49/d73/d77/df9/l125 0 2023-12-06T15:00:39.857 INFO:tasks.workunit.client.0.smithi152.stdout:7/910: rmdir dd/df/d34/dac 39 2023-12-06T15:00:39.857 INFO:tasks.workunit.client.0.smithi152.stdout:7/911: chown dd/df/d78/le4 2783 1 2023-12-06T15:00:39.858 INFO:tasks.workunit.client.0.smithi152.stdout:7/912: mknod dd/df/d34/c126 0 2023-12-06T15:00:39.858 INFO:tasks.workunit.client.0.smithi152.stdout:7/913: truncate dd/f108 993576 0 2023-12-06T15:00:39.867 INFO:tasks.workunit.client.0.smithi152.stdout:7/914: dread f9 [0,4194304] 0 2023-12-06T15:00:39.873 INFO:tasks.workunit.client.0.smithi152.stdout:8/883: dwrite d1/d6/d34/d40/f7a [0,4194304] 0 2023-12-06T15:00:39.873 INFO:tasks.workunit.client.0.smithi152.stdout:8/884: write d1/d6/d34/d35/d66/d82/f8a [4924517,96588] 0 2023-12-06T15:00:39.880 INFO:tasks.workunit.client.0.smithi152.stdout:7/915: dwrite dd/df/d1b/d20/d28/d38/f5d [0,4194304] 0 2023-12-06T15:00:39.881 INFO:tasks.workunit.client.0.smithi152.stdout:7/916: symlink dd/df/d1b/d20/d28/d53/l127 0 2023-12-06T15:00:39.883 INFO:tasks.workunit.client.0.smithi152.stdout:7/917: mkdir dd/df/d78/d128 0 2023-12-06T15:00:39.883 INFO:tasks.workunit.client.0.smithi152.stdout:7/918: chown dd/df/d1b/d20/d28/d38 6362 1 2023-12-06T15:00:39.884 INFO:tasks.workunit.client.0.smithi152.stdout:7/919: read dd/df/d1b/d20/d28/d38/f5d [2273529,39543] 0 2023-12-06T15:00:39.885 INFO:tasks.workunit.client.0.smithi152.stdout:7/920: mkdir dd/d69/d129 0 2023-12-06T15:00:39.886 INFO:tasks.workunit.client.0.smithi152.stdout:7/921: mknod dd/df/d34/d44/d49/d73/c12a 0 2023-12-06T15:00:39.886 INFO:tasks.workunit.client.0.smithi152.stdout:7/922: write f8 [1039535,54800] 0 2023-12-06T15:00:39.889 INFO:tasks.workunit.client.0.smithi152.stdout:8/885: dwrite d1/d6/d34/d35/d38/fad [0,4194304] 0 2023-12-06T15:00:39.890 INFO:tasks.workunit.client.0.smithi152.stdout:7/923: write dd/df/d1b/d20/de5/f113 [2469363,111890] 0 2023-12-06T15:00:39.890 INFO:tasks.workunit.client.0.smithi152.stdout:8/886: truncate d1/d6/d34/fb9 259448 0 2023-12-06T15:00:39.891 INFO:tasks.workunit.client.0.smithi152.stdout:7/924: link dd/df/d1b/c2e dd/df/d1b/d20/c12b 0 2023-12-06T15:00:39.892 INFO:tasks.workunit.client.0.smithi152.stdout:7/925: write dd/df/d34/f59 [1362311,21058] 0 2023-12-06T15:00:39.893 INFO:tasks.workunit.client.0.smithi152.stdout:8/887: rename d1/d6/d34/d35/d8d/fa1 to d1/d6/f11a 0 2023-12-06T15:00:39.894 INFO:tasks.workunit.client.0.smithi152.stdout:7/926: creat dd/df/d1b/d20/f12c x:0 0 0 2023-12-06T15:00:39.895 INFO:tasks.workunit.client.0.smithi152.stdout:7/927: truncate dd/df/d78/f81 3070642 0 2023-12-06T15:00:39.896 INFO:tasks.workunit.client.0.smithi152.stdout:7/928: symlink dd/df/d34/d44/l12d 0 2023-12-06T15:00:39.896 INFO:tasks.workunit.client.0.smithi152.stdout:7/929: dread - dd/df/d1b/fe0 zero size 2023-12-06T15:00:39.910 INFO:tasks.workunit.client.0.smithi152.stdout:8/888: dwrite d1/d6/d34/d3a/f107 [0,4194304] 0 2023-12-06T15:00:39.910 INFO:tasks.workunit.client.0.smithi152.stdout:8/889: chown d1/df7/daa/fbe 14936797 1 2023-12-06T15:00:39.910 INFO:tasks.workunit.client.0.smithi152.stdout:8/890: dread - d1/d6/d34/d36/db4/fda zero size 2023-12-06T15:00:39.910 INFO:tasks.workunit.client.0.smithi152.stdout:8/891: write d1/d6/d34/d6f/fc5 [438892,98608] 0 2023-12-06T15:00:39.926 INFO:tasks.workunit.client.0.smithi152.stdout:8/892: dwrite d1/d6/d29/d74/fe7 [4194304,4194304] 0 2023-12-06T15:00:39.931 INFO:tasks.workunit.client.0.smithi152.stdout:8/893: write d1/d6/d29/f33 [714453,129349] 0 2023-12-06T15:00:39.931 INFO:tasks.workunit.client.0.smithi152.stdout:8/894: truncate d1/d6/d34/d35/d66/fdd 1869893 0 2023-12-06T15:00:39.931 INFO:tasks.workunit.client.0.smithi152.stdout:8/895: mknod d1/d6/d34/d36/d58/de8/c11b 0 2023-12-06T15:00:39.933 INFO:tasks.workunit.client.0.smithi152.stdout:8/896: unlink d1/d6/d29/f51 0 2023-12-06T15:00:39.933 INFO:tasks.workunit.client.0.smithi152.stdout:8/897: symlink d1/d6/d34/d36/d58/de8/d109/d115/l11c 0 2023-12-06T15:00:39.934 INFO:tasks.workunit.client.0.smithi152.stdout:8/898: rmdir d1 39 2023-12-06T15:00:39.935 INFO:tasks.workunit.client.0.smithi152.stdout:8/899: mknod d1/d6/d34/d36/c11d 0 2023-12-06T15:00:39.956 INFO:tasks.workunit.client.0.smithi152.stdout:8/900: dwrite d1/d6/d29/fd7 [0,4194304] 0 2023-12-06T15:00:39.956 INFO:tasks.workunit.client.0.smithi152.stdout:8/901: fsync d1/d6/d34/d35/fb2 0 2023-12-06T15:00:39.956 INFO:tasks.workunit.client.0.smithi152.stdout:8/902: mknod d1/d6/d34/d90/dd5/c11e 0 2023-12-06T15:00:39.974 INFO:tasks.workunit.client.0.smithi152.stdout:8/903: dwrite d1/d6/d29/fae [0,4194304] 0 2023-12-06T15:00:39.976 INFO:tasks.workunit.client.0.smithi152.stdout:8/904: creat d1/d6/d34/d36/d58/de8/d109/d115/f11f x:0 0 0 2023-12-06T15:00:39.977 INFO:tasks.workunit.client.0.smithi152.stdout:8/905: creat d1/d6/d29/d5b/df1/f120 x:0 0 0 2023-12-06T15:00:39.978 INFO:tasks.workunit.client.0.smithi152.stdout:8/906: read d1/d6/d34/fec [2600123,44962] 0 2023-12-06T15:00:39.980 INFO:tasks.workunit.client.0.smithi152.stdout:8/907: truncate d1/d6/d29/fcf 1134864 0 2023-12-06T15:00:40.001 INFO:tasks.workunit.client.0.smithi152.stdout:8/908: dwrite d1/f102 [0,4194304] 0 2023-12-06T15:00:40.001 INFO:tasks.workunit.client.0.smithi152.stdout:8/909: read d1/d6/d34/d40/f7a [523280,13858] 0 2023-12-06T15:00:40.008 INFO:tasks.workunit.client.0.smithi152.stdout:8/910: dread d1/d6/f11a [4194304,4194304] 0 2023-12-06T15:00:40.009 INFO:tasks.workunit.client.0.smithi152.stdout:8/911: dread d1/d6/d34/fb9 [0,4194304] 0 2023-12-06T15:00:40.010 INFO:tasks.workunit.client.0.smithi152.stdout:8/912: creat d1/d6/d29/f121 x:0 0 0 2023-12-06T15:00:40.011 INFO:tasks.workunit.client.0.smithi152.stdout:8/913: truncate d1/d6/d34/d36/f2e 1132090 0 2023-12-06T15:00:40.011 INFO:tasks.workunit.client.0.smithi152.stdout:8/914: write d1/d6/d34/d35/d38/f54 [306413,21253] 0 2023-12-06T15:00:40.033 INFO:tasks.workunit.client.0.smithi152.stdout:8/915: dwrite d1/d6/d34/d35/d38/f106 [0,4194304] 0 2023-12-06T15:00:40.033 INFO:tasks.workunit.client.0.smithi152.stdout:8/916: read d1/d6/d34/d3a/f107 [2008104,48520] 0 2023-12-06T15:00:40.036 INFO:tasks.workunit.client.0.smithi152.stdout:8/917: mknod d1/d6/d34/d36/db4/c122 0 2023-12-06T15:00:40.049 INFO:tasks.workunit.client.0.smithi152.stdout:7/930: sync 2023-12-06T15:00:40.050 INFO:tasks.workunit.client.0.smithi152.stdout:8/918: dwrite d1/d6/d34/d35/d66/f71 [0,4194304] 0 2023-12-06T15:00:40.052 INFO:tasks.workunit.client.0.smithi152.stdout:8/919: fsync d1/f96 0 2023-12-06T15:00:40.054 INFO:tasks.workunit.client.0.smithi152.stdout:8/920: mkdir d1/d6/d34/d35/dd6/d100/d123 0 2023-12-06T15:00:40.055 INFO:tasks.workunit.client.0.smithi152.stdout:8/921: creat d1/d6/d86/f124 x:0 0 0 2023-12-06T15:00:40.057 INFO:tasks.workunit.client.0.smithi152.stdout:8/922: creat d1/d6/d34/d36/f125 x:0 0 0 2023-12-06T15:00:40.058 INFO:tasks.workunit.client.0.smithi152.stdout:8/923: link d1/d6/d34/d35/d38/f45 d1/d6/d34/d36/d58/de8/d109/f126 0 2023-12-06T15:00:40.059 INFO:tasks.workunit.client.0.smithi152.stdout:8/924: mkdir d1/d6/d29/d75/d127 0 2023-12-06T15:00:40.062 INFO:tasks.workunit.client.0.smithi152.stdout:8/925: rename d1/d6/d34/fa to d1/d6/d34/d35/f128 0 2023-12-06T15:00:40.070 INFO:tasks.workunit.client.0.smithi152.stdout:7/931: dwrite dd/df/d34/d44/f8c [0,4194304] 0 2023-12-06T15:00:40.071 INFO:tasks.workunit.client.0.smithi152.stdout:7/932: symlink dd/d69/d129/l12e 0 2023-12-06T15:00:40.078 INFO:tasks.workunit.client.0.smithi152.stdout:8/926: dwrite d1/d6/d29/d75/fcc [0,4194304] 0 2023-12-06T15:00:40.098 INFO:tasks.workunit.client.0.smithi152.stdout:8/927: dwrite d1/d6/fd [0,4194304] 0 2023-12-06T15:00:40.098 INFO:tasks.workunit.client.0.smithi152.stdout:8/928: creat d1/d6/d29/f129 x:0 0 0 2023-12-06T15:00:40.098 INFO:tasks.workunit.client.0.smithi152.stdout:8/929: symlink d1/d6/d34/d35/dd6/d100/d123/l12a 0 2023-12-06T15:00:40.098 INFO:tasks.workunit.client.0.smithi152.stdout:8/930: creat d1/d6/d29/ddf/f12b x:0 0 0 2023-12-06T15:00:40.099 INFO:tasks.workunit.client.0.smithi152.stdout:8/931: mknod d1/d6/d34/d35/d66/d82/c12c 0 2023-12-06T15:00:40.099 INFO:tasks.workunit.client.0.smithi152.stdout:8/932: readlink d1/d6/d34/l16 0 2023-12-06T15:00:40.100 INFO:tasks.workunit.client.0.smithi152.stdout:8/933: truncate d1/d6/d34/d3a/fc0 1233641 0 2023-12-06T15:00:40.100 INFO:tasks.workunit.client.0.smithi152.stdout:8/934: fsync d1/d6/d29/d5b/df1/f120 0 2023-12-06T15:00:40.100 INFO:tasks.workunit.client.0.smithi152.stdout:8/935: chown d1/df7/daa/ce1 4 1 2023-12-06T15:00:40.100 INFO:tasks.workunit.client.0.smithi152.stdout:8/936: creat d1/d6/d34/d36/f12d x:0 0 0 2023-12-06T15:00:40.101 INFO:tasks.workunit.client.0.smithi152.stdout:8/937: creat d1/d6/d34/d35/d66/d82/f12e x:0 0 0 2023-12-06T15:00:40.102 INFO:tasks.workunit.client.0.smithi152.stdout:8/938: read d1/d6/d34/d6f/fab [278805,85611] 0 2023-12-06T15:00:40.103 INFO:tasks.workunit.client.0.smithi152.stdout:8/939: symlink d1/d6/d86/l12f 0 2023-12-06T15:00:40.104 INFO:tasks.workunit.client.0.smithi152.stdout:8/940: mkdir d1/d6/d29/d75/d130 0 2023-12-06T15:00:40.106 INFO:tasks.workunit.client.0.smithi152.stdout:8/941: creat d1/d6/d34/d35/dd6/f131 x:0 0 0 2023-12-06T15:00:40.107 INFO:tasks.workunit.client.0.smithi152.stdout:8/942: creat d1/d6/d34/d90/dd5/f132 x:0 0 0 2023-12-06T15:00:40.107 INFO:tasks.workunit.client.0.smithi152.stdout:8/943: fdatasync d1/d6/d34/d36/f55 0 2023-12-06T15:00:40.107 INFO:tasks.workunit.client.0.smithi152.stdout:8/944: stat d1/d6/d34/d36/ld3 0 2023-12-06T15:00:40.108 INFO:tasks.workunit.client.0.smithi152.stdout:8/945: truncate d1/d6/f1b 2664080 0 2023-12-06T15:00:40.109 INFO:tasks.workunit.client.0.smithi152.stdout:8/946: mkdir d1/d6/d34/d35/d66/d82/db6/d133 0 2023-12-06T15:00:40.110 INFO:tasks.workunit.client.0.smithi152.stdout:8/947: symlink d1/d6/d29/l134 0 2023-12-06T15:00:40.110 INFO:tasks.workunit.client.0.smithi152.stdout:8/948: readlink d1/d6/d34/d36/ld3 0 2023-12-06T15:00:40.110 INFO:tasks.workunit.client.0.smithi152.stdout:8/949: readlink d1/d6/d34/d36/l2c 0 2023-12-06T15:00:40.111 INFO:tasks.workunit.client.0.smithi152.stdout:8/950: rename d1/d6/c2a to d1/d6/d34/d40/df5/c135 0 2023-12-06T15:00:40.112 INFO:tasks.workunit.client.0.smithi152.stdout:8/951: symlink d1/d6/d34/d35/d66/l136 0 2023-12-06T15:00:40.113 INFO:tasks.workunit.client.0.smithi152.stdout:8/952: write d1/d6/d34/d35/fb2 [1329078,106753] 0 2023-12-06T15:00:40.114 INFO:tasks.workunit.client.0.smithi152.stdout:8/953: dread d1/d6/d34/d35/d8d/fbf [0,4194304] 0 2023-12-06T15:00:40.114 INFO:tasks.workunit.client.0.smithi152.stdout:8/954: truncate d1/d6/d86/f124 49025 0 2023-12-06T15:00:40.115 INFO:tasks.workunit.client.0.smithi152.stdout:8/955: mkdir d1/d6/d34/d3a/d137 0 2023-12-06T15:00:40.118 INFO:tasks.workunit.client.0.smithi152.stdout:8/956: read d1/d6/f1b [1203396,58009] 0 2023-12-06T15:00:40.119 INFO:tasks.workunit.client.0.smithi152.stdout:8/957: truncate d1/d6/d34/d35/d38/f4e 716968 0 2023-12-06T15:00:40.120 INFO:tasks.workunit.client.0.smithi152.stdout:8/958: creat d1/d6/d34/d36/d58/de8/d109/f138 x:0 0 0 2023-12-06T15:00:40.121 INFO:tasks.workunit.client.0.smithi152.stdout:8/959: mkdir d1/d6/d34/d40/de2/d139 0 2023-12-06T15:00:40.122 INFO:tasks.workunit.client.0.smithi152.stdout:8/960: dread d1/d6/d34/d35/fca [0,4194304] 0 2023-12-06T15:00:40.124 INFO:tasks.workunit.client.0.smithi152.stdout:8/961: truncate d1/d6/d34/d35/d38/f4e 1536381 0 2023-12-06T15:00:40.125 INFO:tasks.workunit.client.0.smithi152.stdout:8/962: fdatasync d1/d6/d34/d36/f55 0 2023-12-06T15:00:40.131 INFO:tasks.workunit.client.0.smithi152.stdout:8/963: write d1/d6/d34/d36/f2e [131116,3991] 0 2023-12-06T15:00:40.146 INFO:tasks.workunit.client.0.smithi152.stdout:8/964: dwrite d1/d6/d34/d35/f128 [0,4194304] 0 2023-12-06T15:00:40.147 INFO:tasks.workunit.client.0.smithi152.stdout:8/965: symlink d1/d6/d34/d35/d8d/l13a 0 2023-12-06T15:00:40.149 INFO:tasks.workunit.client.0.smithi152.stdout:8/966: mkdir d1/d6/d34/d36/d13b 0 2023-12-06T15:00:40.158 INFO:tasks.workunit.client.0.smithi152.stdout:8/967: dread d1/d6/f69 [0,4194304] 0 2023-12-06T15:00:40.160 INFO:tasks.workunit.client.0.smithi152.stdout:8/968: unlink d1/d6/d34/d35/d38/f106 0 2023-12-06T15:00:40.161 INFO:tasks.workunit.client.0.smithi152.stdout:8/969: mknod d1/d6/d34/d90/c13c 0 2023-12-06T15:00:40.163 INFO:tasks.workunit.client.0.smithi152.stdout:8/970: mknod d1/d6/d34/d40/de2/d139/c13d 0 2023-12-06T15:00:40.163 INFO:tasks.workunit.client.0.smithi152.stdout:8/971: stat d1/d6/f11a 0 2023-12-06T15:00:40.164 INFO:tasks.workunit.client.0.smithi152.stdout:8/972: getdents d1/d6/d34/d36/db4 0 2023-12-06T15:00:40.165 INFO:tasks.workunit.client.0.smithi152.stdout:8/973: write d1/d6/d34/fa2 [787919,41944] 0 2023-12-06T15:00:40.173 INFO:tasks.workunit.client.0.smithi152.stdout:8/974: dread d1/d6/d34/d36/db4/f94 [0,4194304] 0 2023-12-06T15:00:40.176 INFO:tasks.workunit.client.0.smithi152.stdout:8/975: unlink d1/d6/d34/fa2 0 2023-12-06T15:00:40.176 INFO:tasks.workunit.client.0.smithi152.stdout:8/976: write d1/d6/d34/d35/d66/fdd [2397554,56821] 0 2023-12-06T15:00:40.176 INFO:tasks.workunit.client.0.smithi152.stdout:8/977: write d1/d6/d34/d35/d38/f4e [2382473,6959] 0 2023-12-06T15:00:40.177 INFO:tasks.workunit.client.0.smithi152.stdout:8/978: unlink d1/d6/ca9 0 2023-12-06T15:00:40.183 INFO:tasks.workunit.client.0.smithi152.stdout:8/979: dread d1/d6/f11a [4194304,4194304] 0 2023-12-06T15:00:40.184 INFO:tasks.workunit.client.0.smithi152.stdout:8/980: symlink d1/d6/d34/d35/d8d/l13e 0 2023-12-06T15:00:40.184 INFO:tasks.workunit.client.0.smithi152.stdout:8/981: truncate d1/d6/d34/d35/d66/f71 5049272 0 2023-12-06T15:00:40.185 INFO:tasks.workunit.client.0.smithi152.stdout:8/982: write d1/d6/d29/ddf/f110 [409129,43035] 0 2023-12-06T15:00:40.185 INFO:tasks.workunit.client.0.smithi152.stdout:8/983: chown d1/d6/d34/d6f 0 1 2023-12-06T15:00:40.186 INFO:tasks.workunit.client.0.smithi152.stdout:8/984: mkdir d1/d6/d13f 0 2023-12-06T15:00:40.186 INFO:tasks.workunit.client.0.smithi152.stdout:8/985: symlink d1/d6/d34/d3a/d137/l140 0 2023-12-06T15:00:40.187 INFO:tasks.workunit.client.0.smithi152.stdout:8/986: creat d1/d6/d29/d75/d130/f141 x:0 0 0 2023-12-06T15:00:40.188 INFO:tasks.workunit.client.0.smithi152.stdout:8/987: mkdir d1/d6/d29/d142 0 2023-12-06T15:00:40.194 INFO:tasks.workunit.client.0.smithi152.stdout:8/988: dread d1/d6/d86/fc3 [0,4194304] 0 2023-12-06T15:00:40.196 INFO:tasks.workunit.client.0.smithi152.stdout:8/989: creat d1/d6/d34/d40/df5/f143 x:0 0 0 2023-12-06T15:00:40.196 INFO:tasks.workunit.client.0.smithi152.stdout:8/990: chown d1/d6/d86/f124 38082 1 2023-12-06T15:00:40.196 INFO:tasks.workunit.client.0.smithi152.stdout:8/991: truncate d1/d6/d34/d36/d58/de8/d109/d115/f11f 219260 0 2023-12-06T15:00:40.212 INFO:tasks.workunit.client.0.smithi152.stdout:8/992: dwrite d1/d6/d34/d35/d66/d82/f10f [0,4194304] 0 2023-12-06T15:00:40.214 INFO:tasks.workunit.client.0.smithi152.stdout:8/993: creat d1/d6/d34/d35/d8d/f144 x:0 0 0 2023-12-06T15:00:40.216 INFO:tasks.workunit.client.0.smithi152.stdout:8/994: creat d1/d6/d34/d35/d8d/f145 x:0 0 0 2023-12-06T15:00:40.216 INFO:tasks.workunit.client.0.smithi152.stdout:8/995: getdents d1/df7 0 2023-12-06T15:00:40.229 INFO:tasks.workunit.client.0.smithi152.stdout:8/996: dwrite d1/d6/d34/d40/df5/f143 [0,4194304] 0 2023-12-06T15:00:40.230 INFO:tasks.workunit.client.0.smithi152.stdout:8/997: mknod d1/d6/d29/d142/c146 0 2023-12-06T15:00:40.230 INFO:tasks.workunit.client.0.smithi152.stdout:8/998: dread - d1/d6/d34/d36/f125 zero size 2023-12-06T15:00:40.232 INFO:tasks.workunit.client.0.smithi152.stdout:8/999: truncate d1/d6/d34/d36/f2b 887648 0 2023-12-06T15:00:40.256 INFO:tasks.workunit.client.0.smithi152.stdout:7/933: sync 2023-12-06T15:00:40.256 INFO:tasks.workunit.client.0.smithi152.stdout:7/934: fdatasync dd/df/d34/fca 0 2023-12-06T15:00:40.256 INFO:tasks.workunit.client.0.smithi152.stdout:7/935: mkdir dd/df/d34/d44/d49/d73/d12f 0 2023-12-06T15:00:40.257 INFO:tasks.workunit.client.0.smithi152.stdout:7/936: mkdir dd/df/d34/d95/dd7/d130 0 2023-12-06T15:00:40.258 INFO:tasks.workunit.client.0.smithi152.stdout:7/937: mknod dd/df/d34/d44/d49/c131 0 2023-12-06T15:00:40.260 INFO:tasks.workunit.client.0.smithi152.stdout:7/938: rename dd/df/d34/d44/d49/l11e to dd/df/d34/d44/d49/d73/d77/df9/l132 0 2023-12-06T15:00:40.260 INFO:tasks.workunit.client.0.smithi152.stdout:7/939: chown dd/df/d34/d44/d49/d73/d77/db8 16094645 1 2023-12-06T15:00:40.260 INFO:tasks.workunit.client.0.smithi152.stdout:7/940: chown dd/df/d1b/d20/d28/d38/f82 71513 1 2023-12-06T15:00:40.261 INFO:tasks.workunit.client.0.smithi152.stdout:7/941: rename dd/df/d1b/d20/d28/d38/ldf to dd/df/d34/d44/d49/d73/d77/l133 0 2023-12-06T15:00:40.263 INFO:tasks.workunit.client.0.smithi152.stdout:7/942: dread dd/d69/d89/fd0 [0,4194304] 0 2023-12-06T15:00:40.263 INFO:tasks.workunit.client.0.smithi152.stdout:7/943: fsync dd/df/d34/d44/d49/d73/d77/db8/fbb 0 2023-12-06T15:00:40.264 INFO:tasks.workunit.client.0.smithi152.stdout:7/944: dread dd/df/d1b/ffa [0,4194304] 0 2023-12-06T15:00:40.265 INFO:tasks.workunit.client.0.smithi152.stdout:7/945: mkdir dd/df/d1b/d4e/d134 0 2023-12-06T15:00:40.265 INFO:tasks.workunit.client.0.smithi152.stdout:7/946: mknod dd/df/d1b/d20/de5/c135 0 2023-12-06T15:00:40.266 INFO:tasks.workunit.client.0.smithi152.stdout:7/947: readlink dd/df/d1b/d20/d28/l47 0 2023-12-06T15:00:40.266 INFO:tasks.workunit.client.0.smithi152.stdout:7/948: fsync dd/d69/d89/fc0 0 2023-12-06T15:00:40.274 INFO:tasks.workunit.client.0.smithi152.stdout:7/949: dread dd/df/dce/f114 [0,4194304] 0 2023-12-06T15:00:40.275 INFO:tasks.workunit.client.0.smithi152.stdout:7/950: fsync dd/df/d1b/d20/d28/f30 0 2023-12-06T15:00:40.275 INFO:tasks.workunit.client.0.smithi152.stdout:7/951: fdatasync f1 0 2023-12-06T15:00:40.276 INFO:tasks.workunit.client.0.smithi152.stdout:7/952: truncate dd/df/f43 3650650 0 2023-12-06T15:00:40.276 INFO:tasks.workunit.client.0.smithi152.stdout:7/953: chown dd/df/d1b/fe0 25 1 2023-12-06T15:00:40.276 INFO:tasks.workunit.client.0.smithi152.stdout:7/954: truncate dd/df/d1b/d20/d7c/f84 971846 0 2023-12-06T15:00:40.277 INFO:tasks.workunit.client.0.smithi152.stdout:7/955: getdents dd/df/d1b/d20/d7c/d86/da4 0 2023-12-06T15:00:40.280 INFO:tasks.workunit.client.0.smithi152.stdout:7/956: dread dd/df/d1b/d20/d7c/d86/da4/ffc [0,4194304] 0 2023-12-06T15:00:40.280 INFO:tasks.workunit.client.0.smithi152.stdout:7/957: chown dd/df/l31 208578 1 2023-12-06T15:00:40.281 INFO:tasks.workunit.client.0.smithi152.stdout:7/958: mknod dd/df/d34/d44/d49/d73/c136 0 2023-12-06T15:00:40.282 INFO:tasks.workunit.client.0.smithi152.stdout:7/959: stat dd/df/d1b/d20/d28/f3e 0 2023-12-06T15:00:40.282 INFO:tasks.workunit.client.0.smithi152.stdout:7/960: chown dd/c4a 68704 1 2023-12-06T15:00:40.295 INFO:tasks.workunit.client.0.smithi152.stdout:7/961: dwrite f8 [4194304,4194304] 0 2023-12-06T15:00:40.308 INFO:tasks.workunit.client.0.smithi152.stdout:7/962: dwrite dd/df/d1b/d20/d7c/f84 [0,4194304] 0 2023-12-06T15:00:40.333 INFO:tasks.workunit.client.0.smithi152.stdout:7/963: dwrite f9 [0,4194304] 0 2023-12-06T15:00:40.336 INFO:tasks.workunit.client.0.smithi152.stdout:7/964: creat dd/df/d34/d44/d49/d10a/d111/f137 x:0 0 0 2023-12-06T15:00:40.339 INFO:tasks.workunit.client.0.smithi152.stdout:7/965: rename dd/df/f43 to dd/df/d1b/d20/f138 0 2023-12-06T15:00:40.340 INFO:tasks.workunit.client.0.smithi152.stdout:7/966: write dd/df/d1b/ffa [34866,118751] 0 2023-12-06T15:00:40.341 INFO:tasks.workunit.client.0.smithi152.stdout:7/967: mkdir dd/df/d34/d95/dd7/d139 0 2023-12-06T15:00:40.341 INFO:tasks.workunit.client.0.smithi152.stdout:7/968: truncate dd/df/d1b/d20/de5/f11f 762885 0 2023-12-06T15:00:40.342 INFO:tasks.workunit.client.0.smithi152.stdout:7/969: creat dd/df/d34/d44/d49/d73/d77/f13a x:0 0 0 2023-12-06T15:00:40.347 INFO:tasks.workunit.client.0.smithi152.stdout:7/970: creat dd/df/d34/d44/d49/d73/d77/db8/de9/f13b x:0 0 0 2023-12-06T15:00:40.349 INFO:tasks.workunit.client.0.smithi152.stdout:7/971: dread dd/df/d1b/d20/d28/d38/f82 [0,4194304] 0 2023-12-06T15:00:40.353 INFO:tasks.workunit.client.0.smithi152.stdout:7/972: creat dd/df/d1b/d20/d7c/d86/f13c x:0 0 0 2023-12-06T15:00:40.360 INFO:tasks.workunit.client.0.smithi152.stdout:7/973: symlink dd/df/d1b/d20/l13d 0 2023-12-06T15:00:40.361 INFO:tasks.workunit.client.0.smithi152.stdout:7/974: mkdir dd/df/d1b/d20/d13e 0 2023-12-06T15:00:40.363 INFO:tasks.workunit.client.0.smithi152.stdout:7/975: creat dd/f13f x:0 0 0 2023-12-06T15:00:40.363 INFO:tasks.workunit.client.0.smithi152.stdout:7/976: readlink dd/df/d1b/d20/la6 0 2023-12-06T15:00:40.363 INFO:tasks.workunit.client.0.smithi152.stdout:7/977: truncate dd/d69/f2a 12585428 0 2023-12-06T15:00:40.364 INFO:tasks.workunit.client.0.smithi152.stdout:7/978: rename dd/df/d34/d44/d49/d73/d77/da2/fe2 to dd/df/d1b/f140 0 2023-12-06T15:00:40.366 INFO:tasks.workunit.client.0.smithi152.stdout:7/979: mkdir dd/df/d34/d44/d49/d10a/d141 0 2023-12-06T15:00:40.366 INFO:tasks.workunit.client.0.smithi152.stdout:7/980: readlink dd/df/d34/dac/l119 0 2023-12-06T15:00:40.367 INFO:tasks.workunit.client.0.smithi152.stdout:7/981: mknod dd/df/d34/d95/dd7/c142 0 2023-12-06T15:00:40.367 INFO:tasks.workunit.client.0.smithi152.stdout:7/982: chown dd/df/d1b/d20/d28/l112 798 1 2023-12-06T15:00:40.385 INFO:tasks.workunit.client.0.smithi152.stdout:7/983: dwrite dd/df/d34/d44/d49/d73/fb3 [0,4194304] 0 2023-12-06T15:00:40.385 INFO:tasks.workunit.client.0.smithi152.stdout:7/984: write dd/df/d1b/d20/d28/d38/f105 [1323800,28534] 0 2023-12-06T15:00:40.385 INFO:tasks.workunit.client.0.smithi152.stdout:7/985: stat dd/df/d34/d44/d49 0 2023-12-06T15:00:40.385 INFO:tasks.workunit.client.0.smithi152.stdout:7/986: readlink dd/df/d1b/d20/d28/d38/l7f 0 2023-12-06T15:00:40.386 INFO:tasks.workunit.client.0.smithi152.stdout:7/987: mkdir dd/df/d34/d44/d49/d10a/d141/d143 0 2023-12-06T15:00:40.386 INFO:tasks.workunit.client.0.smithi152.stdout:7/988: truncate dd/df/d34/d44/d49/d73/d77/db8/de9/f13b 916302 0 2023-12-06T15:00:40.386 INFO:tasks.workunit.client.0.smithi152.stdout:7/989: mknod dd/df/dce/c144 0 2023-12-06T15:00:40.386 INFO:tasks.workunit.client.0.smithi152.stdout:7/990: write dd/df/d34/dac/f116 [382148,112994] 0 2023-12-06T15:00:40.386 INFO:tasks.workunit.client.0.smithi152.stdout:7/991: write dd/df/d1b/d20/d7c/d86/da4/fc4 [1119506,12113] 0 2023-12-06T15:00:40.387 INFO:tasks.workunit.client.0.smithi152.stdout:7/992: symlink dd/d69/l145 0 2023-12-06T15:00:40.388 INFO:tasks.workunit.client.0.smithi152.stdout:7/993: link dd/d69/l79 dd/df/d1b/d20/de5/l146 0 2023-12-06T15:00:40.388 INFO:tasks.workunit.client.0.smithi152.stdout:7/994: chown dd/df/dce/df5/d106 64516 1 2023-12-06T15:00:40.398 INFO:tasks.workunit.client.0.smithi152.stdout:7/995: write dd/df/d1b/d20/f138 [91763,65953] 0 2023-12-06T15:00:40.398 INFO:tasks.workunit.client.0.smithi152.stdout:7/996: getdents dd/df/d34/d44/d49/d73/d77/df9/d11c 0 2023-12-06T15:00:40.399 INFO:tasks.workunit.client.0.smithi152.stdout:7/997: mknod dd/df/d34/d44/d49/daf/c147 0 2023-12-06T15:00:40.399 INFO:tasks.workunit.client.0.smithi152.stdout:7/998: chown dd/df/d34/d44/d49 0 1 2023-12-06T15:00:40.400 INFO:tasks.workunit.client.0.smithi152.stdout:7/999: mkdir dd/df/d1b/d20/d13e/d148 0 2023-12-06T15:00:40.403 INFO:tasks.workunit.client.0.smithi152.stderr:+ rm -rf -- ./tmp.3iFOkx2sIG 2023-12-06T15:00:41.270 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:41 smithi152 ceph-mon[111954]: pgmap v32: 65 pgs: 65 active+clean; 4.0 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 241 MiB/s rd, 474 MiB/s wr, 746 op/s 2023-12-06T15:00:41.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:41 smithi190 ceph-mon[121340]: pgmap v32: 65 pgs: 65 active+clean; 4.0 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 241 MiB/s rd, 474 MiB/s wr, 746 op/s 2023-12-06T15:00:41.612 INFO:tasks.workunit.client.1.smithi190.stdout:0/986: sync 2023-12-06T15:00:41.665 INFO:tasks.workunit.client.1.smithi190.stdout:0/987: rename d0/da/da4/db1/ca5 to d0/c146 0 2023-12-06T15:00:41.673 INFO:tasks.workunit.client.1.smithi190.stdout:0/988: dread d0/da/d3e/d3a/d40/ff5 [0,4194304] 0 2023-12-06T15:00:41.686 INFO:tasks.workunit.client.1.smithi190.stdout:0/989: rename d0/da/d3e/l2f to d0/da/d3e/d3a/d40/d6f/d9e/l147 0 2023-12-06T15:00:41.686 INFO:tasks.workunit.client.1.smithi190.stdout:0/990: chown d0/da/d3e/d2b/c145 1 1 2023-12-06T15:00:41.689 INFO:tasks.workunit.client.1.smithi190.stdout:0/991: write d0/da/d3e/d2b/d3c/d65/fcb [916765,6879] 0 2023-12-06T15:00:41.696 INFO:tasks.workunit.client.1.smithi190.stdout:0/992: link d0/da/d3e/d2b/d3c/d65/fcb d0/da/d3e/d3a/d40/d6f/d9e/de8/f148 0 2023-12-06T15:00:41.696 INFO:tasks.workunit.client.1.smithi190.stdout:0/993: read d0/da/d3e/d2b/f69 [354520,58763] 0 2023-12-06T15:00:41.707 INFO:tasks.workunit.client.1.smithi190.stdout:0/994: mkdir d0/da/d3e/d2b/d3c/d46/d149 0 2023-12-06T15:00:41.709 INFO:tasks.workunit.client.1.smithi190.stdout:0/995: symlink d0/da/d3e/d2b/l14a 0 2023-12-06T15:00:41.710 INFO:tasks.workunit.client.1.smithi190.stdout:0/996: stat d0/da/d3e/d3a/d40/l54 0 2023-12-06T15:00:41.715 INFO:tasks.workunit.client.1.smithi190.stdout:0/997: rename d0/da/d3e/d2b/c57 to d0/da/d3e/d3a/d40/d6f/d9e/dbb/c14b 0 2023-12-06T15:00:41.737 INFO:tasks.workunit.client.1.smithi190.stdout:0/998: dwrite d0/da/d3e/d3a/d40/d81/ff3 [0,4194304] 0 2023-12-06T15:00:41.737 INFO:tasks.workunit.client.1.smithi190.stdout:0/999: readlink d0/da/d3e/d2b/d37/lea 0 2023-12-06T15:00:41.741 INFO:tasks.workunit.client.1.smithi190.stderr:+ rm -rf -- ./tmp.6ERj4rYCIq 2023-12-06T15:00:42.717 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:42 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:42.717 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:42 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:42.717 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:42 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:00:42.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:42 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:42.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:42 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:42.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:42 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:00:43.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:43 smithi190 ceph-mon[121340]: pgmap v33: 65 pgs: 65 active+clean; 4.0 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 156 MiB/s rd, 303 MiB/s wr, 473 op/s 2023-12-06T15:00:43.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:43 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:00:43.808 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:43 smithi152 ceph-mon[111954]: pgmap v33: 65 pgs: 65 active+clean; 4.0 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 156 MiB/s rd, 303 MiB/s wr, 473 op/s 2023-12-06T15:00:43.808 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:43 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:00:44.865 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:44 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:44.865 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:44 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:44.865 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:44 smithi152 ceph-mon[111954]: pgmap v34: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 171 MiB/s rd, 339 MiB/s wr, 592 op/s 2023-12-06T15:00:45.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:44 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:45.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:44 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:45.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:44 smithi190 ceph-mon[121340]: pgmap v34: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 171 MiB/s rd, 339 MiB/s wr, 592 op/s 2023-12-06T15:00:46.606 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:46 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:46.606 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:46 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:46.607 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:46 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:46.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:46 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:46.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:46 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:46.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:46 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:47.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:47 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:47.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:47 smithi190 ceph-mon[121340]: pgmap v35: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 83 MiB/s rd, 165 MiB/s wr, 332 op/s 2023-12-06T15:00:47.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:47 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:47.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:47 smithi152 ceph-mon[111954]: pgmap v35: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 83 MiB/s rd, 165 MiB/s wr, 332 op/s 2023-12-06T15:00:49.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:49 smithi152 ceph-mon[111954]: pgmap v36: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 83 MiB/s rd, 165 MiB/s wr, 332 op/s 2023-12-06T15:00:49.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:49 smithi190 ceph-mon[121340]: pgmap v36: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 83 MiB/s rd, 165 MiB/s wr, 332 op/s 2023-12-06T15:00:49.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:49.938+0000 7f8dc7917700 1 -- 172.21.15.152:0/1420644711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8dc00fbf80 msgr2=0x7f8dc00fc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:49.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:49.938+0000 7f8dc7917700 1 --2- 172.21.15.152:0/1420644711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8dc00fbf80 0x7f8dc00fc390 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc004880 tx=0x7f8dbc009e30 comp rx=0 tx=0).stop 2023-12-06T15:00:49.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:49.939+0000 7f8dc7917700 1 -- 172.21.15.152:0/1420644711 shutdown_connections 2023-12-06T15:00:49.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:49.939+0000 7f8dc7917700 1 --2- 172.21.15.152:0/1420644711 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8dc00fac40 0x7f8dc00fb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:49.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:49.939+0000 7f8dc7917700 1 --2- 172.21.15.152:0/1420644711 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8dc00fbf80 0x7f8dc00fc390 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:49.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:49.939+0000 7f8dc7917700 1 -- 172.21.15.152:0/1420644711 >> 172.21.15.152:0/1420644711 conn(0x7f8dc00f6950 msgr2=0x7f8dc00f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:00:49.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:49.943+0000 7f8dc7917700 1 -- 172.21.15.152:0/1420644711 shutdown_connections 2023-12-06T15:00:49.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:49.944+0000 7f8dc7917700 1 -- 172.21.15.152:0/1420644711 wait complete. 2023-12-06T15:00:49.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:49.944+0000 7f8dc7917700 1 Processor -- start 2023-12-06T15:00:49.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:49.944+0000 7f8dc7917700 1 -- start start 2023-12-06T15:00:49.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:49.945+0000 7f8dc7917700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8dc00fac40 0x7f8dc0109980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:49.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:49.945+0000 7f8dc7917700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8dc00fbf80 0x7f8dc0109ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:49.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:49.945+0000 7f8dc7917700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc010a510 con 0x7f8dc00fbf80 2023-12-06T15:00:49.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:49.945+0000 7f8dc7917700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc011d700 con 0x7f8dc00fac40 2023-12-06T15:00:49.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:49.945+0000 7f8dc4eb2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8dc00fbf80 0x7f8dc0109ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:49.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:49.945+0000 7f8dc56b3700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8dc00fac40 0x7f8dc0109980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:49.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:49.945+0000 7f8dc56b3700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8dc00fac40 0x7f8dc0109980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.152:46926/0 (socket says 172.21.15.152:46926) 2023-12-06T15:00:49.948 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:49.945+0000 7f8dc56b3700 1 -- 172.21.15.152:0/2723366438 learned_addr learned my addr 172.21.15.152:0/2723366438 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:00:49.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:49.945+0000 7f8dc4eb2700 1 -- 172.21.15.152:0/2723366438 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8dc00fac40 msgr2=0x7f8dc0109980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:49.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:49.945+0000 7f8dc4eb2700 1 --2- 172.21.15.152:0/2723366438 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8dc00fac40 0x7f8dc0109980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:49.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:49.945+0000 7f8dc4eb2700 1 -- 172.21.15.152:0/2723366438 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db0005040 con 0x7f8dc00fbf80 2023-12-06T15:00:49.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:49.946+0000 7f8dc4eb2700 1 --2- 172.21.15.152:0/2723366438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8dc00fbf80 0x7f8dc0109ec0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8db00096d0 tx=0x7f8db0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:00:49.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:49.946+0000 7f8db5ffb700 1 -- 172.21.15.152:0/2723366438 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8db0017070 con 0x7f8dc00fbf80 2023-12-06T15:00:49.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:49.946+0000 7f8dc7917700 1 -- 172.21.15.152:0/2723366438 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dbc005040 con 0x7f8dc00fbf80 2023-12-06T15:00:49.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:49.946+0000 7f8db5ffb700 1 -- 172.21.15.152:0/2723366438 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8db000f040 con 0x7f8dc00fbf80 2023-12-06T15:00:49.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:49.946+0000 7f8db5ffb700 1 -- 172.21.15.152:0/2723366438 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8db0013ac0 con 0x7f8dc00fbf80 2023-12-06T15:00:49.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:49.946+0000 7f8dc7917700 1 -- 172.21.15.152:0/2723366438 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc011dd30 con 0x7f8dc00fbf80 2023-12-06T15:00:49.949 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:49.947+0000 7f8dc7917700 1 -- 172.21.15.152:0/2723366438 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dc004bb80 con 0x7f8dc00fbf80 2023-12-06T15:00:49.950 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:49.948+0000 7f8db5ffb700 1 -- 172.21.15.152:0/2723366438 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 25) v1 ==== 88726+0+0 (secure 0 0 0) 0x7f8db000e840 con 0x7f8dc00fbf80 2023-12-06T15:00:49.950 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:49.949+0000 7f8db5ffb700 1 --2- 172.21.15.152:0/2723366438 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f8dac06ae40 0x7f8dac06d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:49.952 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:49.952+0000 7f8dc56b3700 1 --2- 172.21.15.152:0/2723366438 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f8dac06ae40 0x7f8dac06d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:49.956 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:49.955+0000 7f8db5ffb700 1 -- 172.21.15.152:0/2723366438 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f8db0013400 con 0x7f8dc00fbf80 2023-12-06T15:00:49.956 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:49.956+0000 7f8db5ffb700 1 -- 172.21.15.152:0/2723366438 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f8db008e060 con 0x7f8dc00fbf80 2023-12-06T15:00:49.969 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:49.968+0000 7f8dc56b3700 1 --2- 172.21.15.152:0/2723366438 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f8dac06ae40 0x7f8dac06d2f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc013670 tx=0x7f8dbc009e30 comp rx=0 tx=0).ready entity=mgr.14612 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:00:50.139 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:50.138+0000 7f8db5ffb700 1 -- 172.21.15.152:0/2723366438 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mgrmap(e 26) v1 ==== 43075+0+0 (secure 0 0 0) 0x7f8db00533d0 con 0x7f8dc00fbf80 2023-12-06T15:00:50.139 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:50.139+0000 7f8db5ffb700 1 -- 172.21.15.152:0/2723366438 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f8dac06ae40 msgr2=0x7f8dac06d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:50.139 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:50.139+0000 7f8db5ffb700 1 --2- 172.21.15.152:0/2723366438 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f8dac06ae40 0x7f8dac06d2f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc013670 tx=0x7f8dbc009e30 comp rx=0 tx=0).stop 2023-12-06T15:00:50.562 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-06T15:00:50.562 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-06T15:00:50.968 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:50.967+0000 7f8db5ffb700 1 -- 172.21.15.152:0/2723366438 <== mon.0 v2:172.21.15.152:3300/0 8 ==== mgrmap(e 27) v1 ==== 45250+0+0 (secure 0 0 0) 0x7f8db0072f50 con 0x7f8dc00fbf80 2023-12-06T15:00:51.066 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:50 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:51.066 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:50 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:51.066 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:50 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:00:51.066 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:50 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T15:00:51.066 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:50 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:51.066 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:50 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:00:51.066 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:50 smithi152 ceph-mon[111954]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "mgr fail", "who": "smithi190.ubusrr"}]: dispatch 2023-12-06T15:00:51.067 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:50 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "mgr fail", "who": "smithi190.ubusrr"}]: dispatch 2023-12-06T15:00:51.067 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:50 smithi152 ceph-mon[111954]: osdmap e46: 6 total, 6 up, 6 in 2023-12-06T15:00:51.067 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:50 smithi152 ceph-mon[111954]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' cmd='[{"prefix": "mgr fail", "who": "smithi190.ubusrr"}]': finished 2023-12-06T15:00:51.067 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:50 smithi152 ceph-mon[111954]: mgrmap e26: smithi152.meodco(active, starting, since 0.00717483s) 2023-12-06T15:00:51.250 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:50 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:51.250 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:50 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:51.250 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:50 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:00:51.250 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:50 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T15:00:51.250 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:50 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' 2023-12-06T15:00:51.250 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:50 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:00:51.250 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:50 smithi190 ceph-mon[121340]: from='mgr.14612 172.21.15.190:0/1124827146' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "mgr fail", "who": "smithi190.ubusrr"}]: dispatch 2023-12-06T15:00:51.250 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:50 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "mgr fail", "who": "smithi190.ubusrr"}]: dispatch 2023-12-06T15:00:51.251 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:50 smithi190 ceph-mon[121340]: osdmap e46: 6 total, 6 up, 6 in 2023-12-06T15:00:51.251 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:50 smithi190 ceph-mon[121340]: from='mgr.14612 ' entity='mgr.smithi190.ubusrr' cmd='[{"prefix": "mgr fail", "who": "smithi190.ubusrr"}]': finished 2023-12-06T15:00:51.251 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:50 smithi190 ceph-mon[121340]: mgrmap e26: smithi152.meodco(active, starting, since 0.00717483s) 2023-12-06T15:00:51.979 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:51.977+0000 7f8db5ffb700 1 -- 172.21.15.152:0/2723366438 <== mon.0 v2:172.21.15.152:3300/0 9 ==== mgrmap(e 28) v1 ==== 45377+0+0 (secure 0 0 0) 0x7f8db0056620 con 0x7f8dc00fbf80 2023-12-06T15:00:51.979 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:51.977+0000 7f8db5ffb700 1 --2- 172.21.15.152:0/2723366438 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f8dac005dc0 0x7f8dac033d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:51.979 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:51.977+0000 7f8db5ffb700 1 -- 172.21.15.152:0/2723366438 --> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8dac030880 con 0x7f8dac005dc0 2023-12-06T15:00:51.979 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:51.977+0000 7f8dc56b3700 1 --2- 172.21.15.152:0/2723366438 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f8dac005dc0 0x7f8dac033d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:51.984 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:51.981+0000 7f8dc56b3700 1 --2- 172.21.15.152:0/2723366438 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f8dac005dc0 0x7f8dac033d80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc007df0 tx=0x7f8dbc009e30 comp rx=0 tx=0).ready entity=mgr.24443 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:00:51.993 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:51.992+0000 7f8db5ffb700 1 -- 172.21.15.152:0/2723366438 <== mgr.24443 v2:172.21.15.152:6800/4105588516 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f8dac030880 con 0x7f8dac005dc0 2023-12-06T15:00:51.998 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:51.998+0000 7f8dc7917700 1 -- 172.21.15.152:0/2723366438 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f8dac005dc0 msgr2=0x7f8dac033d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:51.998 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:51.998+0000 7f8dc7917700 1 --2- 172.21.15.152:0/2723366438 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f8dac005dc0 0x7f8dac033d80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc007df0 tx=0x7f8dbc009e30 comp rx=0 tx=0).stop 2023-12-06T15:00:51.998 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:51.998+0000 7f8dc7917700 1 -- 172.21.15.152:0/2723366438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8dc00fbf80 msgr2=0x7f8dc0109ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:51.998 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:51.998+0000 7f8dc7917700 1 --2- 172.21.15.152:0/2723366438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8dc00fbf80 0x7f8dc0109ec0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8db00096d0 tx=0x7f8db0009e30 comp rx=0 tx=0).stop 2023-12-06T15:00:52.004 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.004+0000 7f8dc7917700 1 -- 172.21.15.152:0/2723366438 shutdown_connections 2023-12-06T15:00:52.004 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.004+0000 7f8dc7917700 1 --2- 172.21.15.152:0/2723366438 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f8dac005dc0 0x7f8dac033d80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:52.004 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.004+0000 7f8dc7917700 1 --2- 172.21.15.152:0/2723366438 >> [v2:172.21.15.190:6828/3047155534,v1:172.21.15.190:6829/3047155534] conn(0x7f8dac06ae40 0x7f8dac06d2f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:52.004 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.004+0000 7f8dc7917700 1 --2- 172.21.15.152:0/2723366438 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8dc00fac40 0x7f8dc0109980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:52.004 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.004+0000 7f8dc7917700 1 --2- 172.21.15.152:0/2723366438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8dc00fbf80 0x7f8dc0109ec0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:52.004 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.004+0000 7f8dc7917700 1 -- 172.21.15.152:0/2723366438 >> 172.21.15.152:0/2723366438 conn(0x7f8dc00f6950 msgr2=0x7f8dc00fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:00:52.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.015+0000 7f8dc7917700 1 -- 172.21.15.152:0/2723366438 shutdown_connections 2023-12-06T15:00:52.015 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.015+0000 7f8dc7917700 1 -- 172.21.15.152:0/2723366438 wait complete. 2023-12-06T15:00:52.046 INFO:teuthology.orchestra.run.smithi152.stdout:true 2023-12-06T15:00:52.187 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.186+0000 7f69db513700 1 -- 172.21.15.152:0/2242412723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69d40fcd00 msgr2=0x7f69d40fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:52.187 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.186+0000 7f69db513700 1 --2- 172.21.15.152:0/2242412723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69d40fcd00 0x7f69d40fd150 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f69c40049c0 tx=0x7f69c4009e30 comp rx=0 tx=0).stop 2023-12-06T15:00:52.187 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.187+0000 7f69db513700 1 -- 172.21.15.152:0/2242412723 shutdown_connections 2023-12-06T15:00:52.187 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.187+0000 7f69db513700 1 --2- 172.21.15.152:0/2242412723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69d40fcd00 0x7f69d40fd150 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:52.187 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.187+0000 7f69db513700 1 --2- 172.21.15.152:0/2242412723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69d40fbaf0 0x7f69d40fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:52.187 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.187+0000 7f69db513700 1 -- 172.21.15.152:0/2242412723 >> 172.21.15.152:0/2242412723 conn(0x7f69d40f7190 msgr2=0x7f69d40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:00:52.188 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.187+0000 7f69db513700 1 -- 172.21.15.152:0/2242412723 shutdown_connections 2023-12-06T15:00:52.188 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.187+0000 7f69db513700 1 -- 172.21.15.152:0/2242412723 wait complete. 2023-12-06T15:00:52.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.187+0000 7f69db513700 1 Processor -- start 2023-12-06T15:00:52.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.187+0000 7f69db513700 1 -- start start 2023-12-06T15:00:52.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.188+0000 7f69db513700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69d40fbaf0 0x7f69d410b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:52.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.188+0000 7f69db513700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69d40fcd00 0x7f69d410b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:52.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.188+0000 7f69db513700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d410bf40 con 0x7f69d40fcd00 2023-12-06T15:00:52.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.188+0000 7f69db513700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d410c780 con 0x7f69d40fbaf0 2023-12-06T15:00:52.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.188+0000 7f69d8aae700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69d40fcd00 0x7f69d410b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:52.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.188+0000 7f69d8aae700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69d40fcd00 0x7f69d410b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35712/0 (socket says 172.21.15.152:35712) 2023-12-06T15:00:52.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.188+0000 7f69d8aae700 1 -- 172.21.15.152:0/3747355225 learned_addr learned my addr 172.21.15.152:0/3747355225 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:00:52.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.188+0000 7f69d92af700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69d40fbaf0 0x7f69d410b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:52.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.188+0000 7f69d8aae700 1 -- 172.21.15.152:0/3747355225 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69d40fbaf0 msgr2=0x7f69d410b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:52.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.188+0000 7f69d8aae700 1 --2- 172.21.15.152:0/3747355225 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69d40fbaf0 0x7f69d410b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:52.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.188+0000 7f69d8aae700 1 -- 172.21.15.152:0/3747355225 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c4005040 con 0x7f69d40fcd00 2023-12-06T15:00:52.189 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.188+0000 7f69d8aae700 1 --2- 172.21.15.152:0/3747355225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69d40fcd00 0x7f69d410b8b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f69c4009fd0 tx=0x7f69c400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:00:52.190 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.189+0000 7f69c9ffb700 1 -- 172.21.15.152:0/3747355225 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69c400dc40 con 0x7f69d40fcd00 2023-12-06T15:00:52.190 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.189+0000 7f69c9ffb700 1 -- 172.21.15.152:0/3747355225 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f69c4009af0 con 0x7f69d40fcd00 2023-12-06T15:00:52.190 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.189+0000 7f69c9ffb700 1 -- 172.21.15.152:0/3747355225 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69c401d7e0 con 0x7f69d40fcd00 2023-12-06T15:00:52.190 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.189+0000 7f69db513700 1 -- 172.21.15.152:0/3747355225 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69d410ca00 con 0x7f69d40fcd00 2023-12-06T15:00:52.190 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.189+0000 7f69db513700 1 -- 172.21.15.152:0/3747355225 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d410cf40 con 0x7f69d40fcd00 2023-12-06T15:00:52.196 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.190+0000 7f69db513700 1 -- 172.21.15.152:0/3747355225 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69d404bb80 con 0x7f69d40fcd00 2023-12-06T15:00:52.274 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.191+0000 7f69c9ffb700 1 -- 172.21.15.152:0/3747355225 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 28) v1 ==== 45377+0+0 (secure 0 0 0) 0x7f69c4023020 con 0x7f69d40fcd00 2023-12-06T15:00:52.274 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.191+0000 7f69c9ffb700 1 --2- 172.21.15.152:0/3747355225 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f69c0038350 0x7f69c003a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:52.274 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.191+0000 7f69c9ffb700 1 -- 172.21.15.152:0/3747355225 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f69c4051580 con 0x7f69d40fcd00 2023-12-06T15:00:52.275 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.191+0000 7f69d92af700 1 --2- 172.21.15.152:0/3747355225 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f69c0038350 0x7f69c003a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:52.275 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.192+0000 7f69d92af700 1 --2- 172.21.15.152:0/3747355225 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f69c0038350 0x7f69c003a800 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f69d40fcb60 tx=0x7f69d00091a0 comp rx=0 tx=0).ready entity=mgr.24443 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:00:52.275 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.196+0000 7f69c9ffb700 1 -- 172.21.15.152:0/3747355225 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f69c4009610 con 0x7f69d40fcd00 2023-12-06T15:00:52.326 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:51 smithi190 ceph-mon[121340]: Active manager daemon smithi152.meodco restarted 2023-12-06T15:00:52.326 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:51 smithi190 ceph-mon[121340]: Activating manager daemon smithi152.meodco 2023-12-06T15:00:52.326 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:51 smithi190 ceph-mon[121340]: from='mgr.? 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.meodco/crt"}]: dispatch 2023-12-06T15:00:52.326 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:51 smithi190 ceph-mon[121340]: osdmap e47: 6 total, 6 up, 6 in 2023-12-06T15:00:52.326 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:51 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.meodco/crt"}]: dispatch 2023-12-06T15:00:52.327 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:51 smithi190 ceph-mon[121340]: mgrmap e27: smithi152.meodco(active, starting, since 0.00804572s) 2023-12-06T15:00:52.327 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:51 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-06T15:00:52.327 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:51 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi190"}]: dispatch 2023-12-06T15:00:52.327 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:51 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.acqswy"}]: dispatch 2023-12-06T15:00:52.327 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:51 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.ypivwc"}]: dispatch 2023-12-06T15:00:52.327 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:51 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi190.uucxzu"}]: dispatch 2023-12-06T15:00:52.327 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:51 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi190.edwtqj"}]: dispatch 2023-12-06T15:00:52.327 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:51 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mgr metadata", "who": "smithi152.meodco", "id": "smithi152.meodco"}]: dispatch 2023-12-06T15:00:52.327 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:51 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-06T15:00:52.327 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:51 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-06T15:00:52.327 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:51 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-06T15:00:52.327 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:51 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-06T15:00:52.327 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:51 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-06T15:00:52.327 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:51 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-06T15:00:52.328 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:51 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-06T15:00:52.328 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:51 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-06T15:00:52.328 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:51 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-06T15:00:52.328 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:51 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-06T15:00:52.328 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:51 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.meodco/key"}]: dispatch 2023-12-06T15:00:52.328 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:51 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-06T15:00:52.328 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:51 smithi190 ceph-mon[121340]: Manager daemon smithi152.meodco is now available 2023-12-06T15:00:52.328 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:51 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:00:52.328 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:51 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:00:52.328 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:51 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:00:52.328 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:51 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.meodco/mirror_snapshot_schedule"}]: dispatch 2023-12-06T15:00:52.328 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:51 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='mgr.smithi152.meodco' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.meodco/mirror_snapshot_schedule"}]: dispatch 2023-12-06T15:00:52.328 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:51 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.meodco/trash_purge_schedule"}]: dispatch 2023-12-06T15:00:52.328 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:51 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='mgr.smithi152.meodco' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.meodco/trash_purge_schedule"}]: dispatch 2023-12-06T15:00:52.341 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:51 smithi152 ceph-mon[111954]: Active manager daemon smithi152.meodco restarted 2023-12-06T15:00:52.341 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:51 smithi152 ceph-mon[111954]: Activating manager daemon smithi152.meodco 2023-12-06T15:00:52.341 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:51 smithi152 ceph-mon[111954]: from='mgr.? 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.meodco/crt"}]: dispatch 2023-12-06T15:00:52.342 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:51 smithi152 ceph-mon[111954]: osdmap e47: 6 total, 6 up, 6 in 2023-12-06T15:00:52.342 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:51 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.meodco/crt"}]: dispatch 2023-12-06T15:00:52.342 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:51 smithi152 ceph-mon[111954]: mgrmap e27: smithi152.meodco(active, starting, since 0.00804572s) 2023-12-06T15:00:52.342 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:51 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-06T15:00:52.342 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:51 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi190"}]: dispatch 2023-12-06T15:00:52.342 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:51 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.acqswy"}]: dispatch 2023-12-06T15:00:52.342 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:51 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.ypivwc"}]: dispatch 2023-12-06T15:00:52.342 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:51 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi190.uucxzu"}]: dispatch 2023-12-06T15:00:52.342 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:51 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi190.edwtqj"}]: dispatch 2023-12-06T15:00:52.342 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:51 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mgr metadata", "who": "smithi152.meodco", "id": "smithi152.meodco"}]: dispatch 2023-12-06T15:00:52.342 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:51 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-06T15:00:52.342 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:51 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-06T15:00:52.342 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:51 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-06T15:00:52.342 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:51 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-06T15:00:52.342 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:51 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-06T15:00:52.343 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:51 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-06T15:00:52.343 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:51 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-06T15:00:52.343 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:51 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-06T15:00:52.343 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:51 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-06T15:00:52.343 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:51 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-06T15:00:52.343 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:51 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi152.meodco/key"}]: dispatch 2023-12-06T15:00:52.343 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:51 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-06T15:00:52.343 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:51 smithi152 ceph-mon[111954]: Manager daemon smithi152.meodco is now available 2023-12-06T15:00:52.343 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:51 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:00:52.343 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:51 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:00:52.343 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:51 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:00:52.343 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:51 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.meodco/mirror_snapshot_schedule"}]: dispatch 2023-12-06T15:00:52.343 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:51 smithi152 ceph-mon[111954]: from='mgr.24443 ' entity='mgr.smithi152.meodco' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.meodco/mirror_snapshot_schedule"}]: dispatch 2023-12-06T15:00:52.343 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:51 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.meodco/trash_purge_schedule"}]: dispatch 2023-12-06T15:00:52.344 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:51 smithi152 ceph-mon[111954]: from='mgr.24443 ' entity='mgr.smithi152.meodco' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.meodco/trash_purge_schedule"}]: dispatch 2023-12-06T15:00:52.480 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.479+0000 7f69db513700 1 -- 172.21.15.152:0/3747355225 --> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f69d410d420 con 0x7f69c0038350 2023-12-06T15:00:52.480 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.480+0000 7f69c9ffb700 1 -- 172.21.15.152:0/3747355225 <== mgr.24443 v2:172.21.15.152:6800/4105588516 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f69d410d420 con 0x7f69c0038350 2023-12-06T15:00:52.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.484+0000 7f69db513700 1 -- 172.21.15.152:0/3747355225 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f69c0038350 msgr2=0x7f69c003a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:52.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.484+0000 7f69db513700 1 --2- 172.21.15.152:0/3747355225 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f69c0038350 0x7f69c003a800 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f69d40fcb60 tx=0x7f69d00091a0 comp rx=0 tx=0).stop 2023-12-06T15:00:52.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.484+0000 7f69db513700 1 -- 172.21.15.152:0/3747355225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69d40fcd00 msgr2=0x7f69d410b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:52.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.484+0000 7f69db513700 1 --2- 172.21.15.152:0/3747355225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69d40fcd00 0x7f69d410b8b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f69c4009fd0 tx=0x7f69c400b040 comp rx=0 tx=0).stop 2023-12-06T15:00:52.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.484+0000 7f69db513700 1 -- 172.21.15.152:0/3747355225 shutdown_connections 2023-12-06T15:00:52.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.484+0000 7f69db513700 1 --2- 172.21.15.152:0/3747355225 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f69c0038350 0x7f69c003a800 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:52.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.484+0000 7f69db513700 1 --2- 172.21.15.152:0/3747355225 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69d40fbaf0 0x7f69d410b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:52.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.484+0000 7f69db513700 1 --2- 172.21.15.152:0/3747355225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69d40fcd00 0x7f69d410b8b0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:52.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.484+0000 7f69db513700 1 -- 172.21.15.152:0/3747355225 >> 172.21.15.152:0/3747355225 conn(0x7f69d40f7190 msgr2=0x7f69d40fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:00:52.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.484+0000 7f69db513700 1 -- 172.21.15.152:0/3747355225 shutdown_connections 2023-12-06T15:00:52.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.484+0000 7f69db513700 1 -- 172.21.15.152:0/3747355225 wait complete. 2023-12-06T15:00:52.607 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.606+0000 7f6474ef1700 1 -- 172.21.15.152:0/3030551399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64700fbaf0 msgr2=0x7f64700fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:52.607 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.606+0000 7f6474ef1700 1 --2- 172.21.15.152:0/3030551399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64700fbaf0 0x7f64700fbf00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6460004940 tx=0x7f6460009e30 comp rx=0 tx=0).stop 2023-12-06T15:00:52.607 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.607+0000 7f6474ef1700 1 -- 172.21.15.152:0/3030551399 shutdown_connections 2023-12-06T15:00:52.607 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.607+0000 7f6474ef1700 1 --2- 172.21.15.152:0/3030551399 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64700fcd00 0x7f64700fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:52.607 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.607+0000 7f6474ef1700 1 --2- 172.21.15.152:0/3030551399 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64700fbaf0 0x7f64700fbf00 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:52.607 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.607+0000 7f6474ef1700 1 -- 172.21.15.152:0/3030551399 >> 172.21.15.152:0/3030551399 conn(0x7f64700f71b0 msgr2=0x7f64700f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:00:52.607 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.607+0000 7f6474ef1700 1 -- 172.21.15.152:0/3030551399 shutdown_connections 2023-12-06T15:00:52.608 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.607+0000 7f6474ef1700 1 -- 172.21.15.152:0/3030551399 wait complete. 2023-12-06T15:00:52.609 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.607+0000 7f6474ef1700 1 Processor -- start 2023-12-06T15:00:52.609 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.607+0000 7f6474ef1700 1 -- start start 2023-12-06T15:00:52.609 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.608+0000 7f6474ef1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64700fbaf0 0x7f6470110190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:52.609 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.608+0000 7f6474ef1700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64700fcd00 0x7f64701126e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:52.609 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.608+0000 7f6474ef1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6470066a00 con 0x7f64700fbaf0 2023-12-06T15:00:52.609 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.608+0000 7f6474ef1700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6470066b40 con 0x7f64700fcd00 2023-12-06T15:00:52.609 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.608+0000 7f646e59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64700fbaf0 0x7f6470110190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:52.609 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.608+0000 7f646e59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64700fbaf0 0x7f6470110190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35728/0 (socket says 172.21.15.152:35728) 2023-12-06T15:00:52.609 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.608+0000 7f646e59c700 1 -- 172.21.15.152:0/2324678668 learned_addr learned my addr 172.21.15.152:0/2324678668 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:00:52.609 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.608+0000 7f646dd9b700 1 --2- 172.21.15.152:0/2324678668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64700fcd00 0x7f64701126e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:52.609 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.608+0000 7f646e59c700 1 -- 172.21.15.152:0/2324678668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64700fcd00 msgr2=0x7f64701126e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:52.609 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.608+0000 7f646e59c700 1 --2- 172.21.15.152:0/2324678668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64700fcd00 0x7f64701126e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:52.609 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.608+0000 7f646e59c700 1 -- 172.21.15.152:0/2324678668 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6460005040 con 0x7f64700fbaf0 2023-12-06T15:00:52.610 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.608+0000 7f646e59c700 1 --2- 172.21.15.152:0/2324678668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64700fbaf0 0x7f6470110190 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6460005010 tx=0x7f6460009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:00:52.610 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.608+0000 7f645effd700 1 -- 172.21.15.152:0/2324678668 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6460021070 con 0x7f64700fbaf0 2023-12-06T15:00:52.610 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.608+0000 7f6474ef1700 1 -- 172.21.15.152:0/2324678668 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6470112ce0 con 0x7f64700fbaf0 2023-12-06T15:00:52.610 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.608+0000 7f645effd700 1 -- 172.21.15.152:0/2324678668 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f646001c400 con 0x7f64700fbaf0 2023-12-06T15:00:52.610 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.609+0000 7f645effd700 1 -- 172.21.15.152:0/2324678668 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f646000e070 con 0x7f64700fbaf0 2023-12-06T15:00:52.611 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.609+0000 7f6474ef1700 1 -- 172.21.15.152:0/2324678668 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6470113170 con 0x7f64700fbaf0 2023-12-06T15:00:52.611 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.610+0000 7f645effd700 1 -- 172.21.15.152:0/2324678668 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 28) v1 ==== 45377+0+0 (secure 0 0 0) 0x7f646000b760 con 0x7f64700fbaf0 2023-12-06T15:00:52.611 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.610+0000 7f6474ef1700 1 -- 172.21.15.152:0/2324678668 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f647004bb80 con 0x7f64700fbaf0 2023-12-06T15:00:52.611 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.610+0000 7f645effd700 1 --2- 172.21.15.152:0/2324678668 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f6458038350 0x7f645803a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:52.611 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.610+0000 7f645effd700 1 -- 172.21.15.152:0/2324678668 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f646004cd50 con 0x7f64700fbaf0 2023-12-06T15:00:52.611 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.610+0000 7f646dd9b700 1 --2- 172.21.15.152:0/2324678668 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f6458038350 0x7f645803a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:52.611 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.610+0000 7f646dd9b700 1 --2- 172.21.15.152:0/2324678668 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f6458038350 0x7f645803a800 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6464009b80 tx=0x7f646400b040 comp rx=0 tx=0).ready entity=mgr.24443 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:00:52.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.615+0000 7f645effd700 1 -- 172.21.15.152:0/2324678668 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f6460024310 con 0x7f64700fbaf0 2023-12-06T15:00:52.866 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-06T15:00:52.866 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2023-12-06T15:00:52.875 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.875+0000 7f6474ef1700 1 -- 172.21.15.152:0/2324678668 --> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6470113390 con 0x7f6458038350 2023-12-06T15:00:52.886 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.886+0000 7f645effd700 1 -- 172.21.15.152:0/2324678668 <== mgr.24443 v2:172.21.15.152:6800/4105588516 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f6470113390 con 0x7f6458038350 2023-12-06T15:00:52.886 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-06T15:00:52.886 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 running (53s) 7s ago 6m 15.0M - 0.25.0 c8568f914cd2 b1a46cc95546 2023-12-06T15:00:52.886 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (6m) 7s ago 6m 7436k - 17.2.7-113-gece0d607 a5c6421f1c5f 40d5cebbdb93 2023-12-06T15:00:52.886 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi190 smithi190 running (6m) 9s ago 6m 7457k - 17.2.7-113-gece0d607 a5c6421f1c5f 3a387cddf7e6 2023-12-06T15:00:52.886 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (49s) 7s ago 6m 80.3M - 9.4.7 954c08fa6188 5c6a52d58144 2023-12-06T15:00:52.886 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.acqswy smithi152 running (2m) 7s ago 2m 2623M - 17.2.7-113-gece0d607 a5c6421f1c5f ff9375cec192 2023-12-06T15:00:52.887 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.ypivwc smithi152 running (2m) 7s ago 2m 263M - 17.2.7-113-gece0d607 a5c6421f1c5f d809a681491b 2023-12-06T15:00:52.887 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi190.edwtqj smithi190 running (2m) 9s ago 2m 352M - 17.2.7-113-gece0d607 a5c6421f1c5f f3b7ebd93b04 2023-12-06T15:00:52.887 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi190.uucxzu smithi190 running (2m) 9s ago 2m 1881M - 17.2.7-113-gece0d607 a5c6421f1c5f c01be1409c5f 2023-12-06T15:00:52.887 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.meodco smithi152 *:8443,9283,8765 running (11s) 7s ago 7m 50.4M - 19.0.0-26-g0482646f 26bb7d89db2e 16ed2af8a3d0 2023-12-06T15:00:52.887 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi190.ubusrr smithi190 *:8443,9283 running (78s) 9s ago 5m 506M - 19.0.0-26-g0482646f 26bb7d89db2e 80c6d3654b71 2023-12-06T15:00:52.887 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (7m) 7s ago 7m 87.0M 2048M 17.2.7-113-gece0d607 a5c6421f1c5f 2b9f6058715d 2023-12-06T15:00:52.887 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi190 smithi190 running (5m) 9s ago 5m 61.2M 2048M 17.2.7-113-gece0d607 a5c6421f1c5f 3a81d140940b 2023-12-06T15:00:52.887 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 running (56s) 7s ago 6m 13.1M - 1.5.0 0da6a335fe13 81be696b9be8 2023-12-06T15:00:52.887 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi190 smithi190 *:9100 running (18s) 9s ago 6m 4068k - 1.5.0 0da6a335fe13 2e521e235bf7 2023-12-06T15:00:52.887 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (5m) 7s ago 5m 455M 1568M 17.2.7-113-gece0d607 a5c6421f1c5f 499f740f966e 2023-12-06T15:00:52.887 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (5m) 7s ago 5m 525M 1568M 17.2.7-113-gece0d607 a5c6421f1c5f 3942f134581a 2023-12-06T15:00:52.887 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (4m) 7s ago 4m 407M 1568M 17.2.7-113-gece0d607 a5c6421f1c5f 80bcc4927bb2 2023-12-06T15:00:52.887 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi190 running (4m) 9s ago 4m 574M 2592M 17.2.7-113-gece0d607 a5c6421f1c5f f0281d01fec4 2023-12-06T15:00:52.887 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi190 running (4m) 9s ago 4m 442M 2592M 17.2.7-113-gece0d607 a5c6421f1c5f a415b29ad9c7 2023-12-06T15:00:52.887 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi190 running (3m) 9s ago 3m 571M 2592M 17.2.7-113-gece0d607 a5c6421f1c5f b0f2767055a5 2023-12-06T15:00:52.888 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi152 smithi152 *:9095 running (22s) 7s ago 6m 42.6M - 2.43.0 a07b618ecd1d 90ef0750f707 2023-12-06T15:00:52.888 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.888+0000 7f6474ef1700 1 -- 172.21.15.152:0/2324678668 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f6458038350 msgr2=0x7f645803a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:52.888 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.888+0000 7f6474ef1700 1 --2- 172.21.15.152:0/2324678668 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f6458038350 0x7f645803a800 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6464009b80 tx=0x7f646400b040 comp rx=0 tx=0).stop 2023-12-06T15:00:52.888 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.888+0000 7f6474ef1700 1 -- 172.21.15.152:0/2324678668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64700fbaf0 msgr2=0x7f6470110190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:52.888 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.888+0000 7f6474ef1700 1 --2- 172.21.15.152:0/2324678668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64700fbaf0 0x7f6470110190 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6460005010 tx=0x7f6460009e30 comp rx=0 tx=0).stop 2023-12-06T15:00:52.889 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.888+0000 7f6474ef1700 1 -- 172.21.15.152:0/2324678668 shutdown_connections 2023-12-06T15:00:52.889 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.888+0000 7f6474ef1700 1 --2- 172.21.15.152:0/2324678668 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f6458038350 0x7f645803a800 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:52.889 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.888+0000 7f6474ef1700 1 --2- 172.21.15.152:0/2324678668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64700fbaf0 0x7f6470110190 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:52.889 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.888+0000 7f6474ef1700 1 --2- 172.21.15.152:0/2324678668 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64700fcd00 0x7f64701126e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:52.889 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.888+0000 7f6474ef1700 1 -- 172.21.15.152:0/2324678668 >> 172.21.15.152:0/2324678668 conn(0x7f64700f71b0 msgr2=0x7f64700fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:00:52.889 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.888+0000 7f6474ef1700 1 -- 172.21.15.152:0/2324678668 shutdown_connections 2023-12-06T15:00:52.889 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:52.888+0000 7f6474ef1700 1 -- 172.21.15.152:0/2324678668 wait complete. 2023-12-06T15:00:53.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.018+0000 7f27deb4e700 1 -- 172.21.15.152:0/2819482667 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27d8066070 msgr2=0x7f27d80ff7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:53.018 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.018+0000 7f27deb4e700 1 --2- 172.21.15.152:0/2819482667 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27d8066070 0x7f27d80ff7c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f27cc004940 tx=0x7f27cc009e30 comp rx=0 tx=0).stop 2023-12-06T15:00:53.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.018+0000 7f27deb4e700 1 -- 172.21.15.152:0/2819482667 shutdown_connections 2023-12-06T15:00:53.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.018+0000 7f27deb4e700 1 --2- 172.21.15.152:0/2819482667 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27d80ffd90 0x7f27d81021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:53.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.018+0000 7f27deb4e700 1 --2- 172.21.15.152:0/2819482667 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27d8066070 0x7f27d80ff7c0 secure :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f27cc004940 tx=0x7f27cc009e30 comp rx=0 tx=0).stop 2023-12-06T15:00:53.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.018+0000 7f27deb4e700 1 -- 172.21.15.152:0/2819482667 >> 172.21.15.152:0/2819482667 conn(0x7f27d80f7190 msgr2=0x7f27d80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:00:53.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.018+0000 7f27deb4e700 1 -- 172.21.15.152:0/2819482667 shutdown_connections 2023-12-06T15:00:53.019 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.018+0000 7f27deb4e700 1 -- 172.21.15.152:0/2819482667 wait complete. 2023-12-06T15:00:53.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.019+0000 7f27deb4e700 1 Processor -- start 2023-12-06T15:00:53.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.019+0000 7f27deb4e700 1 -- start start 2023-12-06T15:00:53.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.019+0000 7f27deb4e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27d80ffd90 0x7f27d810d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:53.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.019+0000 7f27deb4e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27d810dbc0 0x7f27d810ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:53.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.019+0000 7f27deb4e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d810e080 con 0x7f27d810dbc0 2023-12-06T15:00:53.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.019+0000 7f27deb4e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d810e1c0 con 0x7f27d80ffd90 2023-12-06T15:00:53.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.020+0000 7f27dc8ea700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27d80ffd90 0x7f27d810d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:53.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.020+0000 7f27d7fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27d810dbc0 0x7f27d810ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:53.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.020+0000 7f27dc8ea700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27d80ffd90 0x7f27d810d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.152:47076/0 (socket says 172.21.15.152:47076) 2023-12-06T15:00:53.020 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.020+0000 7f27dc8ea700 1 -- 172.21.15.152:0/1096582321 learned_addr learned my addr 172.21.15.152:0/1096582321 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:00:53.021 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.020+0000 7f27dc8ea700 1 -- 172.21.15.152:0/1096582321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27d810dbc0 msgr2=0x7f27d810ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:53.021 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.020+0000 7f27dc8ea700 1 --2- 172.21.15.152:0/1096582321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27d810dbc0 0x7f27d810ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:53.021 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.020+0000 7f27dc8ea700 1 -- 172.21.15.152:0/1096582321 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27cc005040 con 0x7f27d80ffd90 2023-12-06T15:00:53.021 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.020+0000 7f27dc8ea700 1 --2- 172.21.15.152:0/1096582321 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27d80ffd90 0x7f27d810d680 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f27cc000c00 tx=0x7f27cc009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:00:53.021 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.020+0000 7f27d57fa700 1 -- 172.21.15.152:0/1096582321 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27cc021070 con 0x7f27d80ffd90 2023-12-06T15:00:53.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.020+0000 7f27d57fa700 1 -- 172.21.15.152:0/1096582321 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f27cc01c400 con 0x7f27d80ffd90 2023-12-06T15:00:53.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.021+0000 7f27d57fa700 1 -- 172.21.15.152:0/1096582321 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27cc00e030 con 0x7f27d80ffd90 2023-12-06T15:00:53.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.021+0000 7f27deb4e700 1 -- 172.21.15.152:0/1096582321 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d810f060 con 0x7f27d80ffd90 2023-12-06T15:00:53.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.021+0000 7f27deb4e700 1 -- 172.21.15.152:0/1096582321 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d810f570 con 0x7f27d80ffd90 2023-12-06T15:00:53.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.022+0000 7f27d57fa700 1 -- 172.21.15.152:0/1096582321 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 28) v1 ==== 45377+0+0 (secure 0 0 0) 0x7f27cc00b650 con 0x7f27d80ffd90 2023-12-06T15:00:53.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.022+0000 7f27deb4e700 1 -- 172.21.15.152:0/1096582321 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d81075f0 con 0x7f27d80ffd90 2023-12-06T15:00:53.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.022+0000 7f27d57fa700 1 --2- 172.21.15.152:0/1096582321 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f27c8038350 0x7f27c803a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:53.022 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.022+0000 7f27d57fa700 1 -- 172.21.15.152:0/1096582321 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f27cc04cec0 con 0x7f27d80ffd90 2023-12-06T15:00:53.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.022+0000 7f27d7fff700 1 --2- 172.21.15.152:0/1096582321 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f27c8038350 0x7f27c803a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:53.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.023+0000 7f27d7fff700 1 --2- 172.21.15.152:0/1096582321 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f27c8038350 0x7f27c803a800 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f27c4004600 tx=0x7f27c400b040 comp rx=0 tx=0).ready entity=mgr.24443 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:00:53.031 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.031+0000 7f27d57fa700 1 -- 172.21.15.152:0/1096582321 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7f27cc011d40 con 0x7f27d80ffd90 2023-12-06T15:00:53.230 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:52 smithi152 ceph-mon[111954]: mgrmap e28: smithi152.meodco(active, since 1.01457s) 2023-12-06T15:00:53.230 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:52 smithi152 ceph-mon[111954]: [06/Dec/2023:15:00:52] ENGINE Bus STARTING 2023-12-06T15:00:53.230 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:52 smithi152 ceph-mon[111954]: [06/Dec/2023:15:00:52] ENGINE Serving on https://172.21.15.152:7150 2023-12-06T15:00:53.230 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:52 smithi152 ceph-mon[111954]: [06/Dec/2023:15:00:52] ENGINE Serving on http://172.21.15.152:8765 2023-12-06T15:00:53.231 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:52 smithi152 ceph-mon[111954]: [06/Dec/2023:15:00:52] ENGINE Bus STARTED 2023-12-06T15:00:53.279 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:52 smithi190 ceph-mon[121340]: mgrmap e28: smithi152.meodco(active, since 1.01457s) 2023-12-06T15:00:53.279 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:52 smithi190 ceph-mon[121340]: [06/Dec/2023:15:00:52] ENGINE Bus STARTING 2023-12-06T15:00:53.279 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:52 smithi190 ceph-mon[121340]: [06/Dec/2023:15:00:52] ENGINE Serving on https://172.21.15.152:7150 2023-12-06T15:00:53.279 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:52 smithi190 ceph-mon[121340]: [06/Dec/2023:15:00:52] ENGINE Serving on http://172.21.15.152:8765 2023-12-06T15:00:53.279 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:52 smithi190 ceph-mon[121340]: [06/Dec/2023:15:00:52] ENGINE Bus STARTED 2023-12-06T15:00:53.383 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.383+0000 7f27deb4e700 1 -- 172.21.15.152:0/1096582321 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f27d8107010 con 0x7f27d80ffd90 2023-12-06T15:00:53.383 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.383+0000 7f27d57fa700 1 -- 172.21.15.152:0/1096582321 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f27cc011b60 con 0x7f27d80ffd90 2023-12-06T15:00:53.384 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-12-06T15:00:53.384 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": { 2023-12-06T15:00:53.384 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 2 2023-12-06T15:00:53.384 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:00:53.384 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": { 2023-12-06T15:00:53.384 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 1 2023-12-06T15:00:53.384 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:00:53.384 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": { 2023-12-06T15:00:53.384 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 6 2023-12-06T15:00:53.384 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:00:53.384 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2023-12-06T15:00:53.384 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 4 2023-12-06T15:00:53.385 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:00:53.385 INFO:teuthology.orchestra.run.smithi152.stdout: "overall": { 2023-12-06T15:00:53.385 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 12, 2023-12-06T15:00:53.385 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 1 2023-12-06T15:00:53.385 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-12-06T15:00:53.385 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-12-06T15:00:53.386 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.386+0000 7f27deb4e700 1 -- 172.21.15.152:0/1096582321 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f27c8038350 msgr2=0x7f27c803a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:53.386 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.386+0000 7f27deb4e700 1 --2- 172.21.15.152:0/1096582321 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f27c8038350 0x7f27c803a800 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f27c4004600 tx=0x7f27c400b040 comp rx=0 tx=0).stop 2023-12-06T15:00:53.386 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.386+0000 7f27deb4e700 1 -- 172.21.15.152:0/1096582321 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27d80ffd90 msgr2=0x7f27d810d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:53.386 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.386+0000 7f27deb4e700 1 --2- 172.21.15.152:0/1096582321 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27d80ffd90 0x7f27d810d680 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f27cc000c00 tx=0x7f27cc009e30 comp rx=0 tx=0).stop 2023-12-06T15:00:53.386 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.386+0000 7f27deb4e700 1 -- 172.21.15.152:0/1096582321 shutdown_connections 2023-12-06T15:00:53.386 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.386+0000 7f27deb4e700 1 --2- 172.21.15.152:0/1096582321 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f27c8038350 0x7f27c803a800 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:53.386 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.386+0000 7f27deb4e700 1 --2- 172.21.15.152:0/1096582321 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27d80ffd90 0x7f27d810d680 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:53.386 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.386+0000 7f27deb4e700 1 --2- 172.21.15.152:0/1096582321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27d810dbc0 0x7f27d810ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:53.386 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.386+0000 7f27deb4e700 1 -- 172.21.15.152:0/1096582321 >> 172.21.15.152:0/1096582321 conn(0x7f27d80f7190 msgr2=0x7f27d80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:00:53.386 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.386+0000 7f27deb4e700 1 -- 172.21.15.152:0/1096582321 shutdown_connections 2023-12-06T15:00:53.386 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.386+0000 7f27deb4e700 1 -- 172.21.15.152:0/1096582321 wait complete. 2023-12-06T15:00:53.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.511+0000 7fb55f41b700 1 -- 172.21.15.152:0/895402749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5580fbb00 msgr2=0x7fb5580fbf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:53.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.511+0000 7fb55f41b700 1 --2- 172.21.15.152:0/895402749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5580fbb00 0x7fb5580fbf10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb554004940 tx=0x7fb554009e30 comp rx=0 tx=0).stop 2023-12-06T15:00:53.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.511+0000 7fb55f41b700 1 -- 172.21.15.152:0/895402749 shutdown_connections 2023-12-06T15:00:53.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.511+0000 7fb55f41b700 1 --2- 172.21.15.152:0/895402749 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5580fcd10 0x7fb5580fd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:53.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.511+0000 7fb55f41b700 1 --2- 172.21.15.152:0/895402749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5580fbb00 0x7fb5580fbf10 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:53.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.511+0000 7fb55f41b700 1 -- 172.21.15.152:0/895402749 >> 172.21.15.152:0/895402749 conn(0x7fb5580f71c0 msgr2=0x7fb5580f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:00:53.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.512+0000 7fb55f41b700 1 -- 172.21.15.152:0/895402749 shutdown_connections 2023-12-06T15:00:53.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.512+0000 7fb55f41b700 1 -- 172.21.15.152:0/895402749 wait complete. 2023-12-06T15:00:53.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.513+0000 7fb55f41b700 1 Processor -- start 2023-12-06T15:00:53.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.513+0000 7fb55f41b700 1 -- start start 2023-12-06T15:00:53.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.513+0000 7fb55f41b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5580fbb00 0x7fb558110200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:53.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.513+0000 7fb55f41b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5580fcd10 0x7fb558112750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:53.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.513+0000 7fb55f41b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5580669a0 con 0x7fb5580fbb00 2023-12-06T15:00:53.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.513+0000 7fb55f41b700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb558066ae0 con 0x7fb5580fcd10 2023-12-06T15:00:53.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.513+0000 7fb55d1b7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5580fbb00 0x7fb558110200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:53.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.513+0000 7fb55d1b7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5580fbb00 0x7fb558110200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35786/0 (socket says 172.21.15.152:35786) 2023-12-06T15:00:53.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.513+0000 7fb55d1b7700 1 -- 172.21.15.152:0/2306373733 learned_addr learned my addr 172.21.15.152:0/2306373733 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:00:53.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.513+0000 7fb55c9b6700 1 --2- 172.21.15.152:0/2306373733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5580fcd10 0x7fb558112750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:53.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.514+0000 7fb55d1b7700 1 -- 172.21.15.152:0/2306373733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5580fcd10 msgr2=0x7fb558112750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:53.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.514+0000 7fb55d1b7700 1 --2- 172.21.15.152:0/2306373733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5580fcd10 0x7fb558112750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:53.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.514+0000 7fb55d1b7700 1 -- 172.21.15.152:0/2306373733 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb554005040 con 0x7fb5580fbb00 2023-12-06T15:00:53.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.514+0000 7fb55c9b6700 1 --2- 172.21.15.152:0/2306373733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5580fcd10 0x7fb558112750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-06T15:00:53.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.514+0000 7fb55d1b7700 1 --2- 172.21.15.152:0/2306373733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5580fbb00 0x7fb558110200 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb554000c00 tx=0x7fb554009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:00:53.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.514+0000 7fb54dffb700 1 -- 172.21.15.152:0/2306373733 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb554021070 con 0x7fb5580fbb00 2023-12-06T15:00:53.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.514+0000 7fb54dffb700 1 -- 172.21.15.152:0/2306373733 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb55401c400 con 0x7fb5580fbb00 2023-12-06T15:00:53.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.514+0000 7fb55f41b700 1 -- 172.21.15.152:0/2306373733 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb558112d50 con 0x7fb5580fbb00 2023-12-06T15:00:53.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.514+0000 7fb54dffb700 1 -- 172.21.15.152:0/2306373733 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb55400e030 con 0x7fb5580fbb00 2023-12-06T15:00:53.516 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.514+0000 7fb55f41b700 1 -- 172.21.15.152:0/2306373733 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5581131d0 con 0x7fb5580fbb00 2023-12-06T15:00:53.516 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.515+0000 7fb54dffb700 1 -- 172.21.15.152:0/2306373733 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 28) v1 ==== 45377+0+0 (secure 0 0 0) 0x7fb55400b650 con 0x7fb5580fbb00 2023-12-06T15:00:53.516 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.515+0000 7fb54dffb700 1 --2- 172.21.15.152:0/2306373733 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7fb544038350 0x7fb54403a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:53.516 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.515+0000 7fb54dffb700 1 -- 172.21.15.152:0/2306373733 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fb55404dd00 con 0x7fb5580fbb00 2023-12-06T15:00:53.516 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.515+0000 7fb55f41b700 1 -- 172.21.15.152:0/2306373733 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb55804bb80 con 0x7fb5580fbb00 2023-12-06T15:00:53.516 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.516+0000 7fb55c9b6700 1 --2- 172.21.15.152:0/2306373733 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7fb544038350 0x7fb54403a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:53.517 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.516+0000 7fb55c9b6700 1 --2- 172.21.15.152:0/2306373733 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7fb544038350 0x7fb54403a800 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb548004600 tx=0x7fb54800b040 comp rx=0 tx=0).ready entity=mgr.24443 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:00:53.522 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.522+0000 7fb54dffb700 1 -- 172.21.15.152:0/2306373733 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fb554024310 con 0x7fb5580fbb00 2023-12-06T15:00:53.879 INFO:teuthology.orchestra.run.smithi152.stdout:e15 2023-12-06T15:00:53.879 INFO:teuthology.orchestra.run.smithi152.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-06T15:00:53.879 INFO:teuthology.orchestra.run.smithi152.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-06T15:00:53.879 INFO:teuthology.orchestra.run.smithi152.stdout:legacy client fscid: 1 2023-12-06T15:00:53.879 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T15:00:53.879 INFO:teuthology.orchestra.run.smithi152.stdout:Filesystem 'cephfs' (1) 2023-12-06T15:00:53.879 INFO:teuthology.orchestra.run.smithi152.stdout:fs_name cephfs 2023-12-06T15:00:53.879 INFO:teuthology.orchestra.run.smithi152.stdout:epoch 15 2023-12-06T15:00:53.879 INFO:teuthology.orchestra.run.smithi152.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-06T15:00:53.879 INFO:teuthology.orchestra.run.smithi152.stdout:created 2023-12-06T14:57:59.352201+0000 2023-12-06T15:00:53.879 INFO:teuthology.orchestra.run.smithi152.stdout:modified 2023-12-06T14:59:52.365348+0000 2023-12-06T15:00:53.880 INFO:teuthology.orchestra.run.smithi152.stdout:tableserver 0 2023-12-06T15:00:53.880 INFO:teuthology.orchestra.run.smithi152.stdout:root 0 2023-12-06T15:00:53.880 INFO:teuthology.orchestra.run.smithi152.stdout:session_timeout 60 2023-12-06T15:00:53.880 INFO:teuthology.orchestra.run.smithi152.stdout:session_autoclose 300 2023-12-06T15:00:53.880 INFO:teuthology.orchestra.run.smithi152.stdout:max_file_size 1099511627776 2023-12-06T15:00:53.880 INFO:teuthology.orchestra.run.smithi152.stdout:required_client_features {} 2023-12-06T15:00:53.880 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure 0 2023-12-06T15:00:53.880 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure_osd_epoch 0 2023-12-06T15:00:53.880 INFO:teuthology.orchestra.run.smithi152.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-06T15:00:53.880 INFO:teuthology.orchestra.run.smithi152.stdout:max_mds 2 2023-12-06T15:00:53.880 INFO:teuthology.orchestra.run.smithi152.stdout:in 0,1 2023-12-06T15:00:53.880 INFO:teuthology.orchestra.run.smithi152.stdout:up {0=14464,1=24255} 2023-12-06T15:00:53.880 INFO:teuthology.orchestra.run.smithi152.stdout:failed 2023-12-06T15:00:53.880 INFO:teuthology.orchestra.run.smithi152.stdout:damaged 2023-12-06T15:00:53.881 INFO:teuthology.orchestra.run.smithi152.stdout:stopped 2023-12-06T15:00:53.881 INFO:teuthology.orchestra.run.smithi152.stdout:data_pools [3] 2023-12-06T15:00:53.881 INFO:teuthology.orchestra.run.smithi152.stdout:metadata_pool 2 2023-12-06T15:00:53.881 INFO:teuthology.orchestra.run.smithi152.stdout:inline_data disabled 2023-12-06T15:00:53.881 INFO:teuthology.orchestra.run.smithi152.stdout:balancer 2023-12-06T15:00:53.881 INFO:teuthology.orchestra.run.smithi152.stdout:standby_count_wanted 1 2023-12-06T15:00:53.881 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.acqswy{0:14464} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.152:6826/2467413186,v1:172.21.15.152:6827/2467413186] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:00:53.881 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi190.edwtqj{0:24271} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.190:6826/2256465065,v1:172.21.15.190:6827/2256465065] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:00:53.881 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi190.uucxzu{1:24255} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.190:6824/3250692478,v1:172.21.15.190:6825/3250692478] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:00:53.881 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.ypivwc{1:14480} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.152:6828/697313573,v1:172.21.15.152:6829/697313573] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:00:53.881 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T15:00:53.881 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T15:00:53.882 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.874+0000 7fb55f41b700 1 -- 172.21.15.152:0/2306373733 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb5581136f0 con 0x7fb5580fbb00 2023-12-06T15:00:53.882 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.874+0000 7fb54dffb700 1 -- 172.21.15.152:0/2306373733 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1852 (secure 0 0 0) 0x7fb554011b60 con 0x7fb5580fbb00 2023-12-06T15:00:53.882 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.880+0000 7fb55f41b700 1 -- 172.21.15.152:0/2306373733 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7fb544038350 msgr2=0x7fb54403a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:53.882 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.880+0000 7fb55f41b700 1 --2- 172.21.15.152:0/2306373733 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7fb544038350 0x7fb54403a800 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb548004600 tx=0x7fb54800b040 comp rx=0 tx=0).stop 2023-12-06T15:00:53.882 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.880+0000 7fb55f41b700 1 -- 172.21.15.152:0/2306373733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5580fbb00 msgr2=0x7fb558110200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:53.882 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.880+0000 7fb55f41b700 1 --2- 172.21.15.152:0/2306373733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5580fbb00 0x7fb558110200 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb554000c00 tx=0x7fb554009e30 comp rx=0 tx=0).stop 2023-12-06T15:00:53.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.882+0000 7fb55f41b700 1 -- 172.21.15.152:0/2306373733 shutdown_connections 2023-12-06T15:00:53.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.882+0000 7fb55f41b700 1 --2- 172.21.15.152:0/2306373733 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7fb544038350 0x7fb54403a800 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:53.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.882+0000 7fb55f41b700 1 --2- 172.21.15.152:0/2306373733 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5580fbb00 0x7fb558110200 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:53.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.882+0000 7fb55f41b700 1 --2- 172.21.15.152:0/2306373733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5580fcd10 0x7fb558112750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:53.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.882+0000 7fb55f41b700 1 -- 172.21.15.152:0/2306373733 >> 172.21.15.152:0/2306373733 conn(0x7fb5580f71c0 msgr2=0x7fb5580fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:00:53.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.882+0000 7fb55f41b700 1 -- 172.21.15.152:0/2306373733 shutdown_connections 2023-12-06T15:00:53.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:53.882+0000 7fb55f41b700 1 -- 172.21.15.152:0/2306373733 wait complete. 2023-12-06T15:00:53.885 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 15 2023-12-06T15:00:54.052 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.052+0000 7fd97d6cd700 1 -- 172.21.15.152:0/3614369304 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd97806ee20 msgr2=0x7fd97806f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:54.053 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.052+0000 7fd97d6cd700 1 --2- 172.21.15.152:0/3614369304 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd97806ee20 0x7fd97806f230 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd968004940 tx=0x7fd968009e30 comp rx=0 tx=0).stop 2023-12-06T15:00:54.053 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.053+0000 7fd97d6cd700 1 -- 172.21.15.152:0/3614369304 shutdown_connections 2023-12-06T15:00:54.053 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.053+0000 7fd97d6cd700 1 --2- 172.21.15.152:0/3614369304 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd978104ce0 0x7fd978105150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:54.053 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.053+0000 7fd97d6cd700 1 --2- 172.21.15.152:0/3614369304 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd97806ee20 0x7fd97806f230 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:54.053 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.053+0000 7fd97d6cd700 1 -- 172.21.15.152:0/3614369304 >> 172.21.15.152:0/3614369304 conn(0x7fd978069b20 msgr2=0x7fd97806bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:00:54.056 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.056+0000 7fd97d6cd700 1 -- 172.21.15.152:0/3614369304 shutdown_connections 2023-12-06T15:00:54.057 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.057+0000 7fd97d6cd700 1 -- 172.21.15.152:0/3614369304 wait complete. 2023-12-06T15:00:54.057 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.057+0000 7fd97d6cd700 1 Processor -- start 2023-12-06T15:00:54.058 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.058+0000 7fd97d6cd700 1 -- start start 2023-12-06T15:00:54.058 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.058+0000 7fd97d6cd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd97806ee20 0x7fd97811c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:54.058 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.058+0000 7fd97d6cd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd97811cad0 0x7fd97811d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:54.058 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.058+0000 7fd97d6cd700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97811d020 con 0x7fd97806ee20 2023-12-06T15:00:54.058 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.058+0000 7fd97d6cd700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97811d160 con 0x7fd97811cad0 2023-12-06T15:00:54.061 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.060+0000 7fd976ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd97806ee20 0x7fd97811c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:54.061 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.060+0000 7fd976ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd97806ee20 0x7fd97811c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35794/0 (socket says 172.21.15.152:35794) 2023-12-06T15:00:54.061 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.060+0000 7fd976ffd700 1 -- 172.21.15.152:0/1937639035 learned_addr learned my addr 172.21.15.152:0/1937639035 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:00:54.061 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.060+0000 7fd9767fc700 1 --2- 172.21.15.152:0/1937639035 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd97811cad0 0x7fd97811d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:54.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.062+0000 7fd976ffd700 1 -- 172.21.15.152:0/1937639035 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd97811cad0 msgr2=0x7fd97811d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:54.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.062+0000 7fd976ffd700 1 --2- 172.21.15.152:0/1937639035 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd97811cad0 0x7fd97811d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:54.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.062+0000 7fd976ffd700 1 -- 172.21.15.152:0/1937639035 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd968005040 con 0x7fd97806ee20 2023-12-06T15:00:54.063 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.063+0000 7fd976ffd700 1 --2- 172.21.15.152:0/1937639035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd97806ee20 0x7fd97811c590 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd968004f90 tx=0x7fd968009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:00:54.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.064+0000 7fd95f7fe700 1 -- 172.21.15.152:0/1937639035 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd96800e030 con 0x7fd97806ee20 2023-12-06T15:00:54.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.064+0000 7fd95f7fe700 1 -- 172.21.15.152:0/1937639035 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd9680093b0 con 0x7fd97806ee20 2023-12-06T15:00:54.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.064+0000 7fd95f7fe700 1 -- 172.21.15.152:0/1937639035 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd968013e30 con 0x7fd97806ee20 2023-12-06T15:00:54.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.064+0000 7fd97d6cd700 1 -- 172.21.15.152:0/1937639035 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd97811dff0 con 0x7fd97806ee20 2023-12-06T15:00:54.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.064+0000 7fd97d6cd700 1 -- 172.21.15.152:0/1937639035 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd97811e4e0 con 0x7fd97806ee20 2023-12-06T15:00:54.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.065+0000 7fd97d6cd700 1 -- 172.21.15.152:0/1937639035 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd97810dca0 con 0x7fd97806ee20 2023-12-06T15:00:54.077 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.076+0000 7fd95f7fe700 1 -- 172.21.15.152:0/1937639035 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 29) v1 ==== 45673+0+0 (secure 0 0 0) 0x7fd968013690 con 0x7fd97806ee20 2023-12-06T15:00:54.077 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.077+0000 7fd95f7fe700 1 --2- 172.21.15.152:0/1937639035 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7fd960038770 0x7fd96003ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:54.077 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.077+0000 7fd95f7fe700 1 -- 172.21.15.152:0/1937639035 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fd96804e170 con 0x7fd97806ee20 2023-12-06T15:00:54.078 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.077+0000 7fd95f7fe700 1 -- 172.21.15.152:0/1937639035 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fd96804e590 con 0x7fd97806ee20 2023-12-06T15:00:54.079 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.079+0000 7fd9767fc700 1 --2- 172.21.15.152:0/1937639035 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7fd960038770 0x7fd96003ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:54.081 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.080+0000 7fd9767fc700 1 --2- 172.21.15.152:0/1937639035 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7fd960038770 0x7fd96003ac20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd97806fd80 tx=0x7fd96c0090f0 comp rx=0 tx=0).ready entity=mgr.24443 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:00:54.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:53 smithi190 ceph-mon[121340]: from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:00:54.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:53 smithi190 ceph-mon[121340]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:00:54.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:53 smithi190 ceph-mon[121340]: pgmap v4: 65 pgs: 65 active+clean; 581 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2023-12-06T15:00:54.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:53 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/1096582321' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:00:54.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:53 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:00:54.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:53 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:00:54.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:53 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/2306373733' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-06T15:00:54.363 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.362+0000 7fd97d6cd700 1 -- 172.21.15.152:0/1937639035 --> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd97805e080 con 0x7fd960038770 2023-12-06T15:00:54.364 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.364+0000 7fd95f7fe700 1 -- 172.21.15.152:0/1937639035 <== mgr.24443 v2:172.21.15.152:6800/4105588516 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fd97805e080 con 0x7fd960038770 2023-12-06T15:00:54.365 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-12-06T15:00:54.365 INFO:teuthology.orchestra.run.smithi152.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e331a81036b9c4be9167bdaf54e458c7294ca3446212b9c6126786d23318b1cf", 2023-12-06T15:00:54.365 INFO:teuthology.orchestra.run.smithi152.stdout: "in_progress": true, 2023-12-06T15:00:54.365 INFO:teuthology.orchestra.run.smithi152.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-06T15:00:54.365 INFO:teuthology.orchestra.run.smithi152.stdout: "services_complete": [ 2023-12-06T15:00:54.366 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr" 2023-12-06T15:00:54.366 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2023-12-06T15:00:54.366 INFO:teuthology.orchestra.run.smithi152.stdout: "progress": "2/21 daemons upgraded", 2023-12-06T15:00:54.366 INFO:teuthology.orchestra.run.smithi152.stdout: "message": "", 2023-12-06T15:00:54.367 INFO:teuthology.orchestra.run.smithi152.stdout: "is_paused": false 2023-12-06T15:00:54.367 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-12-06T15:00:54.368 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.367+0000 7fd97d6cd700 1 -- 172.21.15.152:0/1937639035 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7fd960038770 msgr2=0x7fd96003ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:54.368 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.367+0000 7fd97d6cd700 1 --2- 172.21.15.152:0/1937639035 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7fd960038770 0x7fd96003ac20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd97806fd80 tx=0x7fd96c0090f0 comp rx=0 tx=0).stop 2023-12-06T15:00:54.368 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.367+0000 7fd97d6cd700 1 -- 172.21.15.152:0/1937639035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd97806ee20 msgr2=0x7fd97811c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:54.368 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.367+0000 7fd97d6cd700 1 --2- 172.21.15.152:0/1937639035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd97806ee20 0x7fd97811c590 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd968004f90 tx=0x7fd968009e30 comp rx=0 tx=0).stop 2023-12-06T15:00:54.369 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.367+0000 7fd97d6cd700 1 -- 172.21.15.152:0/1937639035 shutdown_connections 2023-12-06T15:00:54.369 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.367+0000 7fd97d6cd700 1 --2- 172.21.15.152:0/1937639035 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7fd960038770 0x7fd96003ac20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:54.369 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.367+0000 7fd97d6cd700 1 --2- 172.21.15.152:0/1937639035 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd97806ee20 0x7fd97811c590 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:54.369 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.367+0000 7fd97d6cd700 1 --2- 172.21.15.152:0/1937639035 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd97811cad0 0x7fd97811d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:54.369 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.367+0000 7fd97d6cd700 1 -- 172.21.15.152:0/1937639035 >> 172.21.15.152:0/1937639035 conn(0x7fd978069b20 msgr2=0x7fd97806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:00:54.370 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.367+0000 7fd97d6cd700 1 -- 172.21.15.152:0/1937639035 shutdown_connections 2023-12-06T15:00:54.370 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.367+0000 7fd97d6cd700 1 -- 172.21.15.152:0/1937639035 wait complete. 2023-12-06T15:00:54.372 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:53 smithi152 ceph-mon[111954]: from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:00:54.372 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:53 smithi152 ceph-mon[111954]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:00:54.372 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:53 smithi152 ceph-mon[111954]: pgmap v4: 65 pgs: 65 active+clean; 581 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2023-12-06T15:00:54.372 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:53 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/1096582321' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:00:54.372 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:53 smithi152 ceph-mon[111954]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:00:54.372 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:53 smithi152 ceph-mon[111954]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:00:54.372 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:53 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/2306373733' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-06T15:00:54.491 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.491+0000 7fe435fad700 1 -- 172.21.15.152:0/218300037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe430066070 msgr2=0x7fe4300ff7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:54.491 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.491+0000 7fe435fad700 1 --2- 172.21.15.152:0/218300037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe430066070 0x7fe4300ff7c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe420009ce0 tx=0x7fe420004d10 comp rx=0 tx=0).stop 2023-12-06T15:00:54.491 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.491+0000 7fe435fad700 1 -- 172.21.15.152:0/218300037 shutdown_connections 2023-12-06T15:00:54.492 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.491+0000 7fe435fad700 1 --2- 172.21.15.152:0/218300037 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4300ffd90 0x7fe4301021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:54.492 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.491+0000 7fe435fad700 1 --2- 172.21.15.152:0/218300037 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe430066070 0x7fe4300ff7c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:54.492 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.491+0000 7fe435fad700 1 -- 172.21.15.152:0/218300037 >> 172.21.15.152:0/218300037 conn(0x7fe4300f7190 msgr2=0x7fe4300f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:00:54.492 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.491+0000 7fe435fad700 1 -- 172.21.15.152:0/218300037 shutdown_connections 2023-12-06T15:00:54.492 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.491+0000 7fe435fad700 1 -- 172.21.15.152:0/218300037 wait complete. 2023-12-06T15:00:54.493 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.492+0000 7fe435fad700 1 Processor -- start 2023-12-06T15:00:54.493 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.492+0000 7fe435fad700 1 -- start start 2023-12-06T15:00:54.493 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.492+0000 7fe435fad700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe430066070 0x7fe43010d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:54.493 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.492+0000 7fe435fad700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4300ffd90 0x7fe43010da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:54.493 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.492+0000 7fe435fad700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43010e070 con 0x7fe430066070 2023-12-06T15:00:54.494 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.492+0000 7fe435fad700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43010e910 con 0x7fe4300ffd90 2023-12-06T15:00:54.494 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.492+0000 7fe42f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe430066070 0x7fe43010d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:54.494 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.492+0000 7fe42f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe430066070 0x7fe43010d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35812/0 (socket says 172.21.15.152:35812) 2023-12-06T15:00:54.494 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.492+0000 7fe42f7fe700 1 -- 172.21.15.152:0/3379988630 learned_addr learned my addr 172.21.15.152:0/3379988630 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:00:54.494 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.492+0000 7fe42effd700 1 --2- 172.21.15.152:0/3379988630 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4300ffd90 0x7fe43010da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:54.494 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.493+0000 7fe42f7fe700 1 -- 172.21.15.152:0/3379988630 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4300ffd90 msgr2=0x7fe43010da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:54.494 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.493+0000 7fe42f7fe700 1 --2- 172.21.15.152:0/3379988630 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4300ffd90 0x7fe43010da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:54.494 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.493+0000 7fe42f7fe700 1 -- 172.21.15.152:0/3379988630 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe420009940 con 0x7fe430066070 2023-12-06T15:00:54.494 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.493+0000 7fe42f7fe700 1 --2- 172.21.15.152:0/3379988630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe430066070 0x7fe43010d530 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe42000bf70 tx=0x7fe420004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:00:54.494 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.493+0000 7fe417fff700 1 -- 172.21.15.152:0/3379988630 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe42000e040 con 0x7fe430066070 2023-12-06T15:00:54.494 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.493+0000 7fe435fad700 1 -- 172.21.15.152:0/3379988630 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe43010eb90 con 0x7fe430066070 2023-12-06T15:00:54.494 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.493+0000 7fe417fff700 1 -- 172.21.15.152:0/3379988630 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe42001cce0 con 0x7fe430066070 2023-12-06T15:00:54.495 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.493+0000 7fe417fff700 1 -- 172.21.15.152:0/3379988630 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe420012be0 con 0x7fe430066070 2023-12-06T15:00:54.495 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.493+0000 7fe435fad700 1 -- 172.21.15.152:0/3379988630 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe43010f0d0 con 0x7fe430066070 2023-12-06T15:00:54.495 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.494+0000 7fe417fff700 1 -- 172.21.15.152:0/3379988630 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 29) v1 ==== 45673+0+0 (secure 0 0 0) 0x7fe420025400 con 0x7fe430066070 2023-12-06T15:00:54.495 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.494+0000 7fe435fad700 1 -- 172.21.15.152:0/3379988630 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4301075f0 con 0x7fe430066070 2023-12-06T15:00:54.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.494+0000 7fe417fff700 1 --2- 172.21.15.152:0/3379988630 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7fe4180386e0 0x7fe41803ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:00:54.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.495+0000 7fe417fff700 1 -- 172.21.15.152:0/3379988630 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fe42004e540 con 0x7fe430066070 2023-12-06T15:00:54.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.495+0000 7fe42effd700 1 --2- 172.21.15.152:0/3379988630 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7fe4180386e0 0x7fe41803ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:00:54.496 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.495+0000 7fe42effd700 1 --2- 172.21.15.152:0/3379988630 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7fe4180386e0 0x7fe41803ab90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe424009b80 tx=0x7fe42400b040 comp rx=0 tx=0).ready entity=mgr.24443 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:00:54.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.500+0000 7fe417fff700 1 -- 172.21.15.152:0/3379988630 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179400 (secure 0 0 0) 0x7fe420023ac0 con 0x7fe430066070 2023-12-06T15:00:54.914 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.914+0000 7fe435fad700 1 -- 172.21.15.152:0/3379988630 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe4301055b0 con 0x7fe430066070 2023-12-06T15:00:54.917 INFO:teuthology.orchestra.run.smithi152.stdout:HEALTH_OK 2023-12-06T15:00:54.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.915+0000 7fe417fff700 1 -- 172.21.15.152:0/3379988630 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fe420017020 con 0x7fe430066070 2023-12-06T15:00:54.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.918+0000 7fe435fad700 1 -- 172.21.15.152:0/3379988630 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7fe4180386e0 msgr2=0x7fe41803ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:54.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.918+0000 7fe435fad700 1 --2- 172.21.15.152:0/3379988630 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7fe4180386e0 0x7fe41803ab90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe424009b80 tx=0x7fe42400b040 comp rx=0 tx=0).stop 2023-12-06T15:00:54.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.918+0000 7fe435fad700 1 -- 172.21.15.152:0/3379988630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe430066070 msgr2=0x7fe43010d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:00:54.918 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.918+0000 7fe435fad700 1 --2- 172.21.15.152:0/3379988630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe430066070 0x7fe43010d530 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe42000bf70 tx=0x7fe420004d10 comp rx=0 tx=0).stop 2023-12-06T15:00:54.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.919+0000 7fe435fad700 1 -- 172.21.15.152:0/3379988630 shutdown_connections 2023-12-06T15:00:54.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.919+0000 7fe435fad700 1 --2- 172.21.15.152:0/3379988630 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7fe4180386e0 0x7fe41803ab90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:54.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.919+0000 7fe435fad700 1 --2- 172.21.15.152:0/3379988630 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe430066070 0x7fe43010d530 secure :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe42000bf70 tx=0x7fe420004d10 comp rx=0 tx=0).stop 2023-12-06T15:00:54.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.919+0000 7fe435fad700 1 --2- 172.21.15.152:0/3379988630 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4300ffd90 0x7fe43010da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:00:54.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.919+0000 7fe435fad700 1 -- 172.21.15.152:0/3379988630 >> 172.21.15.152:0/3379988630 conn(0x7fe4300f7190 msgr2=0x7fe4300f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:00:54.919 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.919+0000 7fe435fad700 1 -- 172.21.15.152:0/3379988630 shutdown_connections 2023-12-06T15:00:54.924 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:00:54.919+0000 7fe435fad700 1 -- 172.21.15.152:0/3379988630 wait complete. 2023-12-06T15:00:55.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:54 smithi152 ceph-mon[111954]: mgrmap e29: smithi152.meodco(active, since 3s) 2023-12-06T15:00:55.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:54 smithi152 ceph-mon[111954]: from='client.14744 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:00:55.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:54 smithi152 ceph-mon[111954]: from='client.? 172.21.15.152:0/3379988630' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-06T15:00:55.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:54 smithi152 ceph-mon[111954]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:00:55.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:54 smithi152 ceph-mon[111954]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:00:55.198 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:54 smithi190 ceph-mon[121340]: mgrmap e29: smithi152.meodco(active, since 3s) 2023-12-06T15:00:55.199 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:54 smithi190 ceph-mon[121340]: from='client.14744 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:00:55.199 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:54 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/3379988630' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-06T15:00:55.199 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:54 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:00:55.199 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:54 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:00:56.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:56 smithi152 ceph-mon[111954]: pgmap v5: 65 pgs: 65 active+clean; 581 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2023-12-06T15:00:56.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:56 smithi152 ceph-mon[111954]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:00:56.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:56 smithi152 ceph-mon[111954]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:00:56.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:56 smithi152 ceph-mon[111954]: mgrmap e30: smithi152.meodco(active, since 5s) 2023-12-06T15:00:56.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:56 smithi152 ceph-mon[111954]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:00:56.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:56 smithi152 ceph-mon[111954]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:00:56.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:56 smithi190 ceph-mon[121340]: pgmap v5: 65 pgs: 65 active+clean; 581 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2023-12-06T15:00:56.824 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:56 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:00:56.824 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:56 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:00:56.824 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:56 smithi190 ceph-mon[121340]: mgrmap e30: smithi152.meodco(active, since 5s) 2023-12-06T15:00:56.824 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:56 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:00:56.824 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:56 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:00:58.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:00:58 smithi152 ceph-mon[111954]: pgmap v6: 65 pgs: 65 active+clean; 581 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2023-12-06T15:00:58.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:00:58 smithi190 ceph-mon[121340]: pgmap v6: 65 pgs: 65 active+clean; 581 MiB data, 4.0 GiB used, 532 GiB / 536 GiB avail 2023-12-06T15:01:00.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:00 smithi190 ceph-mon[121340]: pgmap v7: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 401 op/s 2023-12-06T15:01:00.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:00 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:00.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:00 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:00.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:00 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:01:00.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:00 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T15:01:00.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:00 smithi190 ceph-mon[121340]: Updating smithi152:/etc/ceph/ceph.conf 2023-12-06T15:01:00.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:00 smithi190 ceph-mon[121340]: Updating smithi190:/etc/ceph/ceph.conf 2023-12-06T15:01:00.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:00 smithi190 ceph-mon[121340]: Standby manager daemon smithi190.ubusrr started 2023-12-06T15:01:00.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:00 smithi190 ceph-mon[121340]: from='mgr.? 172.21.15.190:0/1959795915' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi190.ubusrr/crt"}]: dispatch 2023-12-06T15:01:00.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:00 smithi190 ceph-mon[121340]: from='mgr.? 172.21.15.190:0/1959795915' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-06T15:01:00.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:00 smithi190 ceph-mon[121340]: from='mgr.? 172.21.15.190:0/1959795915' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi190.ubusrr/key"}]: dispatch 2023-12-06T15:01:00.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:00 smithi190 ceph-mon[121340]: from='mgr.? 172.21.15.190:0/1959795915' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-06T15:01:00.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:00 smithi152 ceph-mon[111954]: pgmap v7: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 401 op/s 2023-12-06T15:01:00.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:00 smithi152 ceph-mon[111954]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:00.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:00 smithi152 ceph-mon[111954]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:00.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:00 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:01:00.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:00 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T15:01:00.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:00 smithi152 ceph-mon[111954]: Updating smithi152:/etc/ceph/ceph.conf 2023-12-06T15:01:00.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:00 smithi152 ceph-mon[111954]: Updating smithi190:/etc/ceph/ceph.conf 2023-12-06T15:01:00.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:00 smithi152 ceph-mon[111954]: Standby manager daemon smithi190.ubusrr started 2023-12-06T15:01:00.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:00 smithi152 ceph-mon[111954]: from='mgr.? 172.21.15.190:0/1959795915' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi190.ubusrr/crt"}]: dispatch 2023-12-06T15:01:00.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:00 smithi152 ceph-mon[111954]: from='mgr.? 172.21.15.190:0/1959795915' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-06T15:01:00.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:00 smithi152 ceph-mon[111954]: from='mgr.? 172.21.15.190:0/1959795915' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi190.ubusrr/key"}]: dispatch 2023-12-06T15:01:00.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:00 smithi152 ceph-mon[111954]: from='mgr.? 172.21.15.190:0/1959795915' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-06T15:01:01.533 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:01 smithi190 ceph-mon[121340]: Updating smithi152:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-06T15:01:01.534 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:01 smithi190 ceph-mon[121340]: Updating smithi190:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-06T15:01:01.534 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:01 smithi190 ceph-mon[121340]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2023-12-06T15:01:01.534 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:01 smithi190 ceph-mon[121340]: Updating smithi190:/etc/ceph/ceph.client.admin.keyring 2023-12-06T15:01:01.534 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:01 smithi190 ceph-mon[121340]: Updating smithi190:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-06T15:01:01.534 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:01 smithi190 ceph-mon[121340]: Updating smithi152:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-06T15:01:01.534 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:01 smithi190 ceph-mon[121340]: mgrmap e31: smithi152.meodco(active, since 9s), standbys: smithi190.ubusrr 2023-12-06T15:01:01.534 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:01 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mgr metadata", "who": "smithi190.ubusrr", "id": "smithi190.ubusrr"}]: dispatch 2023-12-06T15:01:01.534 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:01 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:01.534 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:01 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:01.534 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:01 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:01.534 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:01 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:01.534 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:01 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:01.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:01 smithi152 ceph-mon[111954]: Updating smithi152:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-06T15:01:01.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:01 smithi152 ceph-mon[111954]: Updating smithi190:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-06T15:01:01.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:01 smithi152 ceph-mon[111954]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2023-12-06T15:01:01.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:01 smithi152 ceph-mon[111954]: Updating smithi190:/etc/ceph/ceph.client.admin.keyring 2023-12-06T15:01:01.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:01 smithi152 ceph-mon[111954]: Updating smithi190:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-06T15:01:01.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:01 smithi152 ceph-mon[111954]: Updating smithi152:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-06T15:01:01.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:01 smithi152 ceph-mon[111954]: mgrmap e31: smithi152.meodco(active, since 9s), standbys: smithi190.ubusrr 2023-12-06T15:01:01.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:01 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mgr metadata", "who": "smithi190.ubusrr", "id": "smithi190.ubusrr"}]: dispatch 2023-12-06T15:01:01.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:01 smithi152 ceph-mon[111954]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:01.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:01 smithi152 ceph-mon[111954]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:01.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:01 smithi152 ceph-mon[111954]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:01.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:01 smithi152 ceph-mon[111954]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:01.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:01 smithi152 ceph-mon[111954]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:02.473 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:02 smithi152 ceph-mon[111954]: Reconfiguring prometheus.smithi152 (dependencies changed)... 2023-12-06T15:01:02.473 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:02 smithi152 ceph-mon[111954]: Reconfiguring daemon prometheus.smithi152 on smithi152 2023-12-06T15:01:02.473 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:02 smithi152 ceph-mon[111954]: pgmap v8: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 312 op/s 2023-12-06T15:01:02.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:02 smithi190 ceph-mon[121340]: Reconfiguring prometheus.smithi152 (dependencies changed)... 2023-12-06T15:01:02.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:02 smithi190 ceph-mon[121340]: Reconfiguring daemon prometheus.smithi152 on smithi152 2023-12-06T15:01:02.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:02 smithi190 ceph-mon[121340]: pgmap v8: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 312 op/s 2023-12-06T15:01:04.206 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:04 smithi152 ceph-mon[111954]: pgmap v9: 65 pgs: 65 active+clean; 296 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 538 op/s 2023-12-06T15:01:04.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:04 smithi190 ceph-mon[121340]: pgmap v9: 65 pgs: 65 active+clean; 296 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 538 op/s 2023-12-06T15:01:06.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:06 smithi190 ceph-mon[121340]: pgmap v10: 65 pgs: 65 active+clean; 296 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 492 op/s 2023-12-06T15:01:06.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:06 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:06.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:06 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:06.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:06 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-06T15:01:06.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:06 smithi190 ceph-mon[121340]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-06T15:01:06.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:06 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:01:06.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:06 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:01:06.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:06 smithi152 ceph-mon[111954]: pgmap v10: 65 pgs: 65 active+clean; 296 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 492 op/s 2023-12-06T15:01:06.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:06 smithi152 ceph-mon[111954]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:06.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:06 smithi152 ceph-mon[111954]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:06.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:06 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-06T15:01:06.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:06 smithi152 ceph-mon[111954]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2023-12-06T15:01:06.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:06 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:01:06.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:06 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:01:08.545 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:08 smithi190 ceph-mon[121340]: pgmap v11: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 524 op/s 2023-12-06T15:01:08.545 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:08 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi190.ubusrr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-06T15:01:08.545 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:08 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi190.ubusrr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-06T15:01:08.545 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:08 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-06T15:01:08.546 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:08 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:01:08.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:08 smithi152 ceph-mon[111954]: pgmap v11: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 524 op/s 2023-12-06T15:01:08.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:08 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi190.ubusrr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-06T15:01:08.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:08 smithi152 ceph-mon[111954]: from='mgr.24443 ' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi190.ubusrr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-06T15:01:08.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:08 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-06T15:01:08.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:08 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:01:09.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:09 smithi190 ceph-mon[121340]: Upgrade: Updating mgr.smithi190.ubusrr 2023-12-06T15:01:09.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:09 smithi190 ceph-mon[121340]: Deploying daemon mgr.smithi190.ubusrr on smithi190 2023-12-06T15:01:09.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:09 smithi152 ceph-mon[111954]: Upgrade: Updating mgr.smithi190.ubusrr 2023-12-06T15:01:09.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:09 smithi152 ceph-mon[111954]: Deploying daemon mgr.smithi190.ubusrr on smithi190 2023-12-06T15:01:10.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:10 smithi190 ceph-mon[121340]: pgmap v12: 65 pgs: 65 active+clean; 290 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 3.2 MiB/s wr, 768 op/s 2023-12-06T15:01:10.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:10 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:10.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:10 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:10.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:10 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:01:10.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:10 smithi152 ceph-mon[111954]: pgmap v12: 65 pgs: 65 active+clean; 290 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 3.2 MiB/s wr, 768 op/s 2023-12-06T15:01:10.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:10 smithi152 ceph-mon[111954]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:10.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:10 smithi152 ceph-mon[111954]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:10.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:10 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:01:12.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:12 smithi190 ceph-mon[121340]: pgmap v13: 65 pgs: 65 active+clean; 290 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 534 op/s 2023-12-06T15:01:12.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:12 smithi152 ceph-mon[111954]: pgmap v13: 65 pgs: 65 active+clean; 290 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 534 op/s 2023-12-06T15:01:13.553 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:13 smithi152 ceph-mon[111954]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:13.553 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:13 smithi152 ceph-mon[111954]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:13.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:13 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:13.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:13 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:14.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:14 smithi190 ceph-mon[121340]: pgmap v14: 65 pgs: 65 active+clean; 290 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 694 op/s 2023-12-06T15:01:14.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:14 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:14.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:14 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:14.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:14 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:14.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:14 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:14.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:14 smithi152 ceph-mon[111954]: pgmap v14: 65 pgs: 65 active+clean; 290 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 694 op/s 2023-12-06T15:01:14.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:14 smithi152 ceph-mon[111954]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:14.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:14 smithi152 ceph-mon[111954]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:14.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:14 smithi152 ceph-mon[111954]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:14.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:14 smithi152 ceph-mon[111954]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:16.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:16 smithi190 ceph-mon[121340]: pgmap v15: 65 pgs: 65 active+clean; 290 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 436 op/s 2023-12-06T15:01:16.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:16 smithi152 ceph-mon[111954]: pgmap v15: 65 pgs: 65 active+clean; 290 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 436 op/s 2023-12-06T15:01:17.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:17 smithi152 ceph-mon[111954]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:17.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:17 smithi152 ceph-mon[111954]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:17.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:17 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:01:17.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:17 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T15:01:17.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:17 smithi152 ceph-mon[111954]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:17.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:17 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:01:17.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:17 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:01:17.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:17 smithi152 ceph-mon[111954]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:17.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:17 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi152.meodco"}]: dispatch 2023-12-06T15:01:17.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:17 smithi152 ceph-mon[111954]: from='mgr.24443 ' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi152.meodco"}]: dispatch 2023-12-06T15:01:17.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:17 smithi152 ceph-mon[111954]: from='mgr.24443 ' entity='mgr.smithi152.meodco' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi152.meodco"}]': finished 2023-12-06T15:01:17.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:17 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi190.ubusrr"}]: dispatch 2023-12-06T15:01:17.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:17 smithi152 ceph-mon[111954]: from='mgr.24443 ' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi190.ubusrr"}]: dispatch 2023-12-06T15:01:17.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:17 smithi152 ceph-mon[111954]: from='mgr.24443 ' entity='mgr.smithi152.meodco' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi190.ubusrr"}]': finished 2023-12-06T15:01:17.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:17 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-06T15:01:17.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:17 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:17.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:17 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:17.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:17 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:01:17.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:17 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T15:01:17.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:17 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:17.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:17 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:01:17.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:17 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:01:17.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:17 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:17.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:17 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi152.meodco"}]: dispatch 2023-12-06T15:01:17.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:17 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi152.meodco"}]: dispatch 2023-12-06T15:01:17.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:17 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='mgr.smithi152.meodco' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi152.meodco"}]': finished 2023-12-06T15:01:17.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:17 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi190.ubusrr"}]: dispatch 2023-12-06T15:01:17.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:17 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi190.ubusrr"}]: dispatch 2023-12-06T15:01:17.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:17 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='mgr.smithi152.meodco' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi190.ubusrr"}]': finished 2023-12-06T15:01:17.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:17 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-06T15:01:18.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:18 smithi152 ceph-mon[111954]: Upgrade: Setting container_image for all mgr 2023-12-06T15:01:18.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:18 smithi152 ceph-mon[111954]: pgmap v16: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.9 MiB/s rd, 3.0 MiB/s wr, 474 op/s 2023-12-06T15:01:18.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:18 smithi152 ceph-mon[111954]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:18.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:18 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-06T15:01:18.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:18 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-06T15:01:18.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:18 smithi152 ceph-mon[111954]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:01:18.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:18 smithi190 ceph-mon[121340]: Upgrade: Setting container_image for all mgr 2023-12-06T15:01:18.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:18 smithi190 ceph-mon[121340]: pgmap v16: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.9 MiB/s rd, 3.0 MiB/s wr, 474 op/s 2023-12-06T15:01:18.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:18 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='mgr.smithi152.meodco' 2023-12-06T15:01:18.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:18 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-06T15:01:18.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:18 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-06T15:01:18.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:18 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:01:19.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:19 smithi190 ceph-mon[121340]: Upgrade: Updating mon.smithi152 2023-12-06T15:01:19.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:19 smithi190 ceph-mon[121340]: Deploying daemon mon.smithi152 on smithi152 2023-12-06T15:01:19.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:19 smithi190 ceph-mon[121340]: Standby manager daemon smithi190.ubusrr restarted 2023-12-06T15:01:19.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:19 smithi190 ceph-mon[121340]: Standby manager daemon smithi190.ubusrr started 2023-12-06T15:01:19.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:19 smithi190 ceph-mon[121340]: from='mgr.? 172.21.15.190:0/251300327' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi190.ubusrr/crt"}]: dispatch 2023-12-06T15:01:19.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:19 smithi190 ceph-mon[121340]: from='mgr.? 172.21.15.190:0/251300327' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-06T15:01:19.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:19 smithi190 ceph-mon[121340]: from='mgr.? 172.21.15.190:0/251300327' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi190.ubusrr/key"}]: dispatch 2023-12-06T15:01:19.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:19 smithi190 ceph-mon[121340]: from='mgr.? 172.21.15.190:0/251300327' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-06T15:01:19.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:19 smithi152 ceph-mon[111954]: Upgrade: Updating mon.smithi152 2023-12-06T15:01:19.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:19 smithi152 ceph-mon[111954]: Deploying daemon mon.smithi152 on smithi152 2023-12-06T15:01:19.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:19 smithi152 ceph-mon[111954]: Standby manager daemon smithi190.ubusrr restarted 2023-12-06T15:01:19.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:19 smithi152 ceph-mon[111954]: Standby manager daemon smithi190.ubusrr started 2023-12-06T15:01:19.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:19 smithi152 ceph-mon[111954]: from='mgr.? 172.21.15.190:0/251300327' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi190.ubusrr/crt"}]: dispatch 2023-12-06T15:01:19.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:19 smithi152 ceph-mon[111954]: from='mgr.? 172.21.15.190:0/251300327' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-06T15:01:19.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:19 smithi152 ceph-mon[111954]: from='mgr.? 172.21.15.190:0/251300327' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi190.ubusrr/key"}]: dispatch 2023-12-06T15:01:19.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:19 smithi152 ceph-mon[111954]: from='mgr.? 172.21.15.190:0/251300327' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-06T15:01:20.065 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:19 smithi152 systemd[1]: Stopping Ceph mon.smithi152 for 062f0e3c-9447-11ee-95a2-87774f69a715... 2023-12-06T15:01:20.065 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:19 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-mon-smithi152[111931]: 2023-12-06T15:01:19.918+0000 7f67cc180700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi152 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-06T15:01:20.066 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:19 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-mon-smithi152[111931]: 2023-12-06T15:01:19.918+0000 7f67cc180700 -1 mon.smithi152@0(leader) e2 *** Got Signal Terminated *** 2023-12-06T15:01:20.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 bash[192475]: ceph-062f0e3c-9447-11ee-95a2-87774f69a715-mon-smithi152 2023-12-06T15:01:20.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 systemd[1]: ceph-062f0e3c-9447-11ee-95a2-87774f69a715@mon.smithi152.service: Succeeded. 2023-12-06T15:01:20.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 systemd[1]: Stopped Ceph mon.smithi152 for 062f0e3c-9447-11ee-95a2-87774f69a715. 2023-12-06T15:01:20.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 systemd[1]: Starting Ceph mon.smithi152 for 062f0e3c-9447-11ee-95a2-87774f69a715... 2023-12-06T15:01:21.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: set uid:gid to 167:167 (ceph:ceph) 2023-12-06T15:01:21.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev), process ceph-mon, pid 7 2023-12-06T15:01:21.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: pidfile_write: ignore empty --pid-file 2023-12-06T15:01:21.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 bash[192615]: f5163d3b0f5fa07acf0a2ebda4a94658fd02d24a9868f099955dbcb42d6d5221 2023-12-06T15:01:21.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: load: jerasure load: lrc 2023-12-06T15:01:21.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 systemd[1]: Started Ceph mon.smithi152 for 062f0e3c-9447-11ee-95a2-87774f69a715. 2023-12-06T15:01:21.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: RocksDB version: 7.9.2 2023-12-06T15:01:21.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Git sha 0 2023-12-06T15:01:21.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Compile date 2023-12-06 02:25:46 2023-12-06T15:01:21.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: DB SUMMARY 2023-12-06T15:01:21.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: DB Session ID: C2NYU9RZ9YMMY4XQJOJZ 2023-12-06T15:01:21.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: CURRENT file: CURRENT 2023-12-06T15:01:21.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: IDENTITY file: IDENTITY 2023-12-06T15:01:21.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: MANIFEST file: MANIFEST-000015 size: 782 Bytes 2023-12-06T15:01:21.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi152/store.db dir, Total Num: 1, files: 000027.sst 2023-12-06T15:01:21.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi152/store.db: 000025.log size: 1926603 ; 2023-12-06T15:01:21.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.error_if_exists: 0 2023-12-06T15:01:21.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.create_if_missing: 0 2023-12-06T15:01:21.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.paranoid_checks: 1 2023-12-06T15:01:21.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-06T15:01:21.380 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-06T15:01:21.380 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-06T15:01:21.380 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.env: 0x55bb0bcd3a60 2023-12-06T15:01:21.380 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.fs: PosixFileSystem 2023-12-06T15:01:21.380 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.info_log: 0x55bb0e0e5600 2023-12-06T15:01:21.380 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.max_file_opening_threads: 16 2023-12-06T15:01:21.380 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.statistics: (nil) 2023-12-06T15:01:21.380 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.use_fsync: 0 2023-12-06T15:01:21.380 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.max_log_file_size: 0 2023-12-06T15:01:21.380 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-06T15:01:21.380 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-06T15:01:21.380 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.keep_log_file_num: 1000 2023-12-06T15:01:21.380 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.recycle_log_file_num: 0 2023-12-06T15:01:21.380 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.allow_fallocate: 1 2023-12-06T15:01:21.380 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.allow_mmap_reads: 0 2023-12-06T15:01:21.381 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.allow_mmap_writes: 0 2023-12-06T15:01:21.381 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.use_direct_reads: 0 2023-12-06T15:01:21.381 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-06T15:01:21.381 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.create_missing_column_families: 0 2023-12-06T15:01:21.382 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.db_log_dir: 2023-12-06T15:01:21.382 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.wal_dir: 2023-12-06T15:01:21.382 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-06T15:01:21.383 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-06T15:01:21.383 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-06T15:01:21.383 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-06T15:01:21.383 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-06T15:01:21.383 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-06T15:01:21.383 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.advise_random_on_open: 1 2023-12-06T15:01:21.383 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.db_write_buffer_size: 0 2023-12-06T15:01:21.383 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.write_buffer_manager: 0x55bb0e09b360 2023-12-06T15:01:21.383 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-06T15:01:21.383 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-06T15:01:21.383 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-06T15:01:21.383 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.rate_limiter: (nil) 2023-12-06T15:01:21.383 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-06T15:01:21.383 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.wal_recovery_mode: 2 2023-12-06T15:01:21.384 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.enable_thread_tracking: 0 2023-12-06T15:01:21.384 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.enable_pipelined_write: 0 2023-12-06T15:01:21.384 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.unordered_write: 0 2023-12-06T15:01:21.384 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-06T15:01:21.384 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-06T15:01:21.384 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-06T15:01:21.384 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-06T15:01:21.384 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.row_cache: None 2023-12-06T15:01:21.384 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.wal_filter: None 2023-12-06T15:01:21.384 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-06T15:01:21.384 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.allow_ingest_behind: 0 2023-12-06T15:01:21.384 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.two_write_queues: 0 2023-12-06T15:01:21.384 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.manual_wal_flush: 0 2023-12-06T15:01:21.384 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.wal_compression: 0 2023-12-06T15:01:21.385 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.atomic_flush: 0 2023-12-06T15:01:21.385 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-06T15:01:21.385 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-06T15:01:21.385 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-06T15:01:21.385 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.log_readahead_size: 0 2023-12-06T15:01:21.385 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-06T15:01:21.385 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.best_efforts_recovery: 0 2023-12-06T15:01:21.385 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-06T15:01:21.385 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-06T15:01:21.385 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.allow_data_in_errors: 0 2023-12-06T15:01:21.385 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.db_host_id: __hostname__ 2023-12-06T15:01:21.385 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-06T15:01:21.385 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.max_background_jobs: 2 2023-12-06T15:01:21.385 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.max_background_compactions: -1 2023-12-06T15:01:21.385 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.max_subcompactions: 1 2023-12-06T15:01:21.385 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-06T15:01:21.386 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-06T15:01:21.386 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-06T15:01:21.386 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.max_total_wal_size: 0 2023-12-06T15:01:21.386 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-06T15:01:21.386 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-06T15:01:21.386 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-06T15:01:21.386 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-06T15:01:21.386 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.max_open_files: -1 2023-12-06T15:01:21.386 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.bytes_per_sync: 0 2023-12-06T15:01:21.386 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-06T15:01:21.386 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-06T15:01:21.386 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.compaction_readahead_size: 0 2023-12-06T15:01:21.386 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.max_background_flushes: -1 2023-12-06T15:01:21.386 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Compression algorithms supported: 2023-12-06T15:01:21.386 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-06T15:01:21.387 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: kZSTD supported: 0 2023-12-06T15:01:21.387 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: kXpressCompression supported: 0 2023-12-06T15:01:21.387 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: kLZ4HCCompression supported: 1 2023-12-06T15:01:21.387 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: kZlibCompression supported: 1 2023-12-06T15:01:21.387 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: kSnappyCompression supported: 1 2023-12-06T15:01:21.387 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: kLZ4Compression supported: 1 2023-12-06T15:01:21.387 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: kBZip2Compression supported: 0 2023-12-06T15:01:21.387 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-06T15:01:21.387 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-06T15:01:21.387 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi152/store.db/MANIFEST-000015 2023-12-06T15:01:21.387 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-06T15:01:21.387 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-06T15:01:21.387 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.merge_operator: 2023-12-06T15:01:21.387 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.compaction_filter: None 2023-12-06T15:01:21.387 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.compaction_filter_factory: None 2023-12-06T15:01:21.388 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.sst_partitioner_factory: None 2023-12-06T15:01:21.388 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-06T15:01:21.388 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-06T15:01:21.388 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55bb0e0e5700) 2023-12-06T15:01:21.388 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: cache_index_and_filter_blocks: 1 2023-12-06T15:01:21.388 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-06T15:01:21.388 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-06T15:01:21.388 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: pin_top_level_index_and_filter: 1 2023-12-06T15:01:21.388 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: index_type: 0 2023-12-06T15:01:21.388 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: data_block_index_type: 0 2023-12-06T15:01:21.388 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: index_shortening: 1 2023-12-06T15:01:21.388 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-06T15:01:21.388 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: checksum: 4 2023-12-06T15:01:21.388 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: no_block_cache: 0 2023-12-06T15:01:21.389 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_cache: 0x55bb0e13b1f0 2023-12-06T15:01:21.389 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_cache_name: BinnedLRUCache 2023-12-06T15:01:21.389 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_cache_options: 2023-12-06T15:01:21.389 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: capacity : 536870912 2023-12-06T15:01:21.389 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: num_shard_bits : 4 2023-12-06T15:01:21.389 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: strict_capacity_limit : 0 2023-12-06T15:01:21.389 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: high_pri_pool_ratio: 0.000 2023-12-06T15:01:21.389 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_cache_compressed: (nil) 2023-12-06T15:01:21.389 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: persistent_cache: (nil) 2023-12-06T15:01:21.389 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_size: 4096 2023-12-06T15:01:21.389 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_size_deviation: 10 2023-12-06T15:01:21.389 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_restart_interval: 16 2023-12-06T15:01:21.389 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: index_block_restart_interval: 1 2023-12-06T15:01:21.389 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: metadata_block_size: 4096 2023-12-06T15:01:21.389 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: partition_filters: 0 2023-12-06T15:01:21.390 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: use_delta_encoding: 1 2023-12-06T15:01:21.390 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: filter_policy: bloomfilter 2023-12-06T15:01:21.390 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: whole_key_filtering: 1 2023-12-06T15:01:21.390 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: verify_compression: 0 2023-12-06T15:01:21.390 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: read_amp_bytes_per_bit: 0 2023-12-06T15:01:21.390 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: format_version: 5 2023-12-06T15:01:21.390 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: enable_index_compression: 1 2023-12-06T15:01:21.390 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: block_align: 0 2023-12-06T15:01:21.390 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: max_auto_readahead_size: 262144 2023-12-06T15:01:21.390 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: prepopulate_block_cache: 0 2023-12-06T15:01:21.390 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: initial_auto_readahead_size: 8192 2023-12-06T15:01:21.390 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: num_file_reads_for_auto_readahead: 2 2023-12-06T15:01:21.390 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.write_buffer_size: 33554432 2023-12-06T15:01:21.390 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.max_write_buffer_number: 2 2023-12-06T15:01:21.390 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.compression: NoCompression 2023-12-06T15:01:21.391 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.bottommost_compression: Disabled 2023-12-06T15:01:21.391 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.prefix_extractor: nullptr 2023-12-06T15:01:21.391 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-06T15:01:21.391 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.num_levels: 7 2023-12-06T15:01:21.391 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-06T15:01:21.391 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-06T15:01:21.391 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-06T15:01:21.391 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-06T15:01:21.391 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-06T15:01:21.391 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-06T15:01:21.391 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-06T15:01:21.391 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-06T15:01:21.391 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-06T15:01:21.391 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-06T15:01:21.391 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-06T15:01:21.392 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-06T15:01:21.392 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-06T15:01:21.392 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.compression_opts.level: 32767 2023-12-06T15:01:21.392 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.compression_opts.strategy: 0 2023-12-06T15:01:21.392 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-06T15:01:21.392 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-06T15:01:21.392 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-06T15:01:21.392 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-06T15:01:21.392 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.compression_opts.enabled: false 2023-12-06T15:01:21.392 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-06T15:01:21.392 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-06T15:01:21.392 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-06T15:01:21.392 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-06T15:01:21.392 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.target_file_size_base: 67108864 2023-12-06T15:01:21.392 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-06T15:01:21.392 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-06T15:01:21.393 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-06T15:01:21.393 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-06T15:01:21.393 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-06T15:01:21.393 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-06T15:01:21.393 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-06T15:01:21.393 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-06T15:01:21.393 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-06T15:01:21.393 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-06T15:01:21.393 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-06T15:01:21.393 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-06T15:01:21.393 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-06T15:01:21.393 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-06T15:01:21.393 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.arena_block_size: 1048576 2023-12-06T15:01:21.393 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-06T15:01:21.393 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-06T15:01:21.393 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.disable_auto_compactions: 0 2023-12-06T15:01:21.394 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-06T15:01:21.394 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-06T15:01:21.394 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-06T15:01:21.394 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-06T15:01:21.394 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-06T15:01:21.394 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-06T15:01:21.394 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-06T15:01:21.394 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-06T15:01:21.394 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-06T15:01:21.394 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-06T15:01:21.394 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.table_properties_collectors: 2023-12-06T15:01:21.394 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.inplace_update_support: 0 2023-12-06T15:01:21.394 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-06T15:01:21.394 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-06T15:01:21.394 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-06T15:01:21.395 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-06T15:01:21.395 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.bloom_locality: 0 2023-12-06T15:01:21.395 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.max_successive_merges: 0 2023-12-06T15:01:21.395 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-06T15:01:21.395 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.paranoid_file_checks: 0 2023-12-06T15:01:21.395 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.force_consistency_checks: 1 2023-12-06T15:01:21.395 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.report_bg_io_stats: 0 2023-12-06T15:01:21.395 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.ttl: 2592000 2023-12-06T15:01:21.395 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-06T15:01:21.395 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-06T15:01:21.395 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-06T15:01:21.395 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.enable_blob_files: false 2023-12-06T15:01:21.395 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.min_blob_size: 0 2023-12-06T15:01:21.395 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.blob_file_size: 268435456 2023-12-06T15:01:21.396 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-06T15:01:21.396 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-06T15:01:21.396 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-06T15:01:21.396 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-06T15:01:21.396 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-06T15:01:21.396 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.blob_file_starting_level: 0 2023-12-06T15:01:21.396 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-06T15:01:21.396 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 27.sst 2023-12-06T15:01:21.396 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-06T15:01:21.396 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi152/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 29, last_sequence is 9642, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-06T15:01:21.396 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2023-12-06T15:01:21.396 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 678a2c97-dbc7-4ced-b25b-cacf5a5b7e85 2023-12-06T15:01:21.396 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701874880984830, "job": 1, "event": "recovery_started", "wal_files": [25]} 2023-12-06T15:01:21.396 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2023-12-06T15:01:21.396 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701874880992297, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 1777920, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 9643, "largest_seqno": 10376, "table_properties": {"data_size": 1773744, "index_size": 2266, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 901, "raw_key_size": 8583, "raw_average_key_size": 24, "raw_value_size": 1766002, "raw_average_value_size": 4960, "num_data_blocks": 103, "num_entries": 356, "num_filter_entries": 356, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1701874880, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "678a2c97-dbc7-4ced-b25b-cacf5a5b7e85", "db_session_id": "C2NYU9RZ9YMMY4XQJOJZ", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2023-12-06T15:01:21.397 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701874880992459, "job": 1, "event": "recovery_finished"} 2023-12-06T15:01:21.397 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2023-12-06T15:01:21.397 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-06T15:01:21.397 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi152/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-06T15:01:21.397 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55bb0e1d6000 2023-12-06T15:01:21.397 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: DB pointer 0x55bb0e1c2000 2023-12-06T15:01:21.397 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-06T15:01:21.397 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-06T15:01:21.397 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ** DB Stats ** 2023-12-06T15:01:21.397 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-06T15:01:21.397 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-06T15:01:21.397 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-06T15:01:21.397 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-06T15:01:21.397 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-06T15:01:21.397 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-06T15:01:21.398 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-06T15:01:21.398 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2023-12-06T15:01:21.398 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ** Compaction Stats [default] ** 2023-12-06T15:01:21.398 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-06T15:01:21.398 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-06T15:01:21.398 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: L0 1/0 1.70 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 473.8 0.00 0.00 1 0.004 0 0 0.0 0.0 2023-12-06T15:01:21.398 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: L6 1/0 5.35 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2023-12-06T15:01:21.398 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Sum 2/0 7.05 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 473.8 0.00 0.00 1 0.004 0 0 0.0 0.0 2023-12-06T15:01:21.398 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 473.8 0.00 0.00 1 0.004 0 0 0.0 0.0 2023-12-06T15:01:21.398 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2023-12-06T15:01:21.398 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ** Compaction Stats [default] ** 2023-12-06T15:01:21.398 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-06T15:01:21.398 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-06T15:01:21.398 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 473.8 0.00 0.00 1 0.004 0 0 0.0 0.0 2023-12-06T15:01:21.399 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2023-12-06T15:01:21.399 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-06T15:01:21.399 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2023-12-06T15:01:21.399 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-06T15:01:21.399 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Flush(GB): cumulative 0.002, interval 0.002 2023-12-06T15:01:21.399 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-06T15:01:21.399 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-06T15:01:21.399 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-06T15:01:21.399 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-06T15:01:21.399 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Cumulative compaction: 0.00 GB write, 154.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-06T15:01:21.399 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Interval compaction: 0.00 GB write, 154.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-06T15:01:21.399 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-06T15:01:21.399 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Block cache BinnedLRUCache@0x55bb0e13b1f0#7 capacity: 512.00 MB usage: 3.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2023-12-06T15:01:21.399 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.03 KB,0.000196695%) IndexBlock(1,2.33 KB,0.000444055%) Misc(1,0.00 KB,0%) 2023-12-06T15:01:21.399 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2023-12-06T15:01:21.400 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-06T15:01:21.400 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: starting mon.smithi152 rank 0 at public addrs [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] at bind addrs [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi152 fsid 062f0e3c-9447-11ee-95a2-87774f69a715 2023-12-06T15:01:21.400 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: mon.smithi152@-1(???) e2 preinit fsid 062f0e3c-9447-11ee-95a2-87774f69a715 2023-12-06T15:01:21.400 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: mon.smithi152@-1(???).mds e15 new map 2023-12-06T15:01:21.400 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: mon.smithi152@-1(???).mds e15 print_map 2023-12-06T15:01:21.400 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: e15 2023-12-06T15:01:21.400 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-06T15:01:21.400 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-06T15:01:21.400 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: legacy client fscid: 1 2023-12-06T15:01:21.400 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2023-12-06T15:01:21.400 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: Filesystem 'cephfs' (1) 2023-12-06T15:01:21.400 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: fs_name cephfs 2023-12-06T15:01:21.400 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: epoch 15 2023-12-06T15:01:21.400 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-06T15:01:21.400 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: created 2023-12-06T14:57:59.352201+0000 2023-12-06T15:01:21.400 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: modified 2023-12-06T14:59:52.365348+0000 2023-12-06T15:01:21.401 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: tableserver 0 2023-12-06T15:01:21.401 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: root 0 2023-12-06T15:01:21.401 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: session_timeout 60 2023-12-06T15:01:21.401 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: session_autoclose 300 2023-12-06T15:01:21.401 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: max_file_size 1099511627776 2023-12-06T15:01:21.401 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: max_xattr_size 65536 2023-12-06T15:01:21.401 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: required_client_features {} 2023-12-06T15:01:21.401 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: last_failure 0 2023-12-06T15:01:21.401 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: last_failure_osd_epoch 0 2023-12-06T15:01:21.401 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-06T15:01:21.401 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: max_mds 2 2023-12-06T15:01:21.401 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: in 0,1 2023-12-06T15:01:21.401 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: up {0=14464,1=24255} 2023-12-06T15:01:21.401 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: failed 2023-12-06T15:01:21.401 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: damaged 2023-12-06T15:01:21.402 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: stopped 2023-12-06T15:01:21.402 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: data_pools [3] 2023-12-06T15:01:21.402 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: metadata_pool 2 2023-12-06T15:01:21.402 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: inline_data disabled 2023-12-06T15:01:21.402 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: balancer 2023-12-06T15:01:21.402 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: bal_rank_mask -1 2023-12-06T15:01:21.402 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: standby_count_wanted 1 2023-12-06T15:01:21.402 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: [mds.cephfs.smithi152.acqswy{0:14464} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.152:6826/2467413186,v1:172.21.15.152:6827/2467413186] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:01:21.402 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: [mds.cephfs.smithi190.edwtqj{0:24271} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.190:6826/2256465065,v1:172.21.15.190:6827/2256465065] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:01:21.402 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: [mds.cephfs.smithi190.uucxzu{1:24255} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.190:6824/3250692478,v1:172.21.15.190:6825/3250692478] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:01:21.402 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: [mds.cephfs.smithi152.ypivwc{1:14480} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.152:6828/697313573,v1:172.21.15.152:6829/697313573] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:01:21.402 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2023-12-06T15:01:21.402 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout: 2023-12-06T15:01:21.402 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: mon.smithi152@-1(???).osd e47 crush map has features 3314933000852226048, adjusting msgr requires 2023-12-06T15:01:21.402 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: mon.smithi152@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2023-12-06T15:01:21.403 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: mon.smithi152@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2023-12-06T15:01:21.403 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: mon.smithi152@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2023-12-06T15:01:21.403 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:20 smithi152 ceph-mon[192652]: mon.smithi152@-1(???).paxosservice(auth 1..20) refresh upgraded, format 0 -> 3 2023-12-06T15:01:22.038 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:21 smithi190 ceph-mon[121340]: pgmap v18: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 391 op/s 2023-12-06T15:01:22.038 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:21 smithi190 ceph-mon[121340]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:01:22.038 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:21 smithi190 ceph-mon[121340]: mon.smithi152 calling monitor election 2023-12-06T15:01:22.038 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:21 smithi190 ceph-mon[121340]: mon.smithi152 is new leader, mons smithi152,smithi190 in quorum (ranks 0,1) 2023-12-06T15:01:22.038 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:21 smithi190 ceph-mon[121340]: monmap e2: 2 mons at {smithi152=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0],smithi190=[v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-06T15:01:22.038 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:21 smithi190 ceph-mon[121340]: fsmap cephfs:2 {0=cephfs.smithi152.acqswy=up:active,1=cephfs.smithi190.uucxzu=up:active} 2 up:standby-replay 2023-12-06T15:01:22.038 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:21 smithi190 ceph-mon[121340]: osdmap e47: 6 total, 6 up, 6 in 2023-12-06T15:01:22.039 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:21 smithi190 ceph-mon[121340]: mgrmap e32: smithi152.meodco(active, since 30s), standbys: smithi190.ubusrr 2023-12-06T15:01:22.039 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:21 smithi190 ceph-mon[121340]: from='mgr.24443 ' entity='' 2023-12-06T15:01:22.039 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:21 smithi190 ceph-mon[121340]: mgrmap e33: smithi152.meodco(active, since 30s), standbys: smithi190.ubusrr 2023-12-06T15:01:22.039 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:21 smithi190 ceph-mon[121340]: overall HEALTH_OK 2023-12-06T15:01:22.092 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:21 smithi152 ceph-mon[192652]: pgmap v18: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 391 op/s 2023-12-06T15:01:22.092 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:21 smithi152 ceph-mon[192652]: from='mgr.24443 172.21.15.152:0/4248686764' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:01:22.092 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:21 smithi152 ceph-mon[192652]: mon.smithi152 calling monitor election 2023-12-06T15:01:22.092 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:21 smithi152 ceph-mon[192652]: mon.smithi152 is new leader, mons smithi152,smithi190 in quorum (ranks 0,1) 2023-12-06T15:01:22.092 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:21 smithi152 ceph-mon[192652]: monmap e2: 2 mons at {smithi152=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0],smithi190=[v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-06T15:01:22.092 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:21 smithi152 ceph-mon[192652]: fsmap cephfs:2 {0=cephfs.smithi152.acqswy=up:active,1=cephfs.smithi190.uucxzu=up:active} 2 up:standby-replay 2023-12-06T15:01:22.092 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:21 smithi152 ceph-mon[192652]: osdmap e47: 6 total, 6 up, 6 in 2023-12-06T15:01:22.093 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:21 smithi152 ceph-mon[192652]: mgrmap e32: smithi152.meodco(active, since 30s), standbys: smithi190.ubusrr 2023-12-06T15:01:22.093 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:21 smithi152 ceph-mon[192652]: from='mgr.24443 ' entity='' 2023-12-06T15:01:22.093 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:21 smithi152 ceph-mon[192652]: mgrmap e33: smithi152.meodco(active, since 30s), standbys: smithi190.ubusrr 2023-12-06T15:01:22.093 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:21 smithi152 ceph-mon[192652]: overall HEALTH_OK 2023-12-06T15:01:25.087 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.084+0000 7f05cb0e0700 1 -- 172.21.15.152:0/3272258136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05c40fbaf0 msgr2=0x7f05c40fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:01:25.087 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.084+0000 7f05cb0e0700 1 --2- 172.21.15.152:0/3272258136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05c40fbaf0 0x7f05c40fbf00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f05b8004940 tx=0x7f05b8009e30 comp rx=0 tx=0).stop 2023-12-06T15:01:25.087 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.085+0000 7f05cb0e0700 1 -- 172.21.15.152:0/3272258136 shutdown_connections 2023-12-06T15:01:25.087 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.085+0000 7f05cb0e0700 1 --2- 172.21.15.152:0/3272258136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05c40fcd00 0x7f05c40fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:25.087 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.085+0000 7f05cb0e0700 1 --2- 172.21.15.152:0/3272258136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05c40fbaf0 0x7f05c40fbf00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:25.087 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.085+0000 7f05cb0e0700 1 -- 172.21.15.152:0/3272258136 >> 172.21.15.152:0/3272258136 conn(0x7f05c40f7190 msgr2=0x7f05c40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:01:25.087 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.086+0000 7f05cb0e0700 1 -- 172.21.15.152:0/3272258136 shutdown_connections 2023-12-06T15:01:25.087 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.086+0000 7f05cb0e0700 1 -- 172.21.15.152:0/3272258136 wait complete. 2023-12-06T15:01:25.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.087+0000 7f05cb0e0700 1 Processor -- start 2023-12-06T15:01:25.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.087+0000 7f05cb0e0700 1 -- start start 2023-12-06T15:01:25.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.087+0000 7f05cb0e0700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05c40fbaf0 0x7f05c41036b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:01:25.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.087+0000 7f05cb0e0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05c40fcd00 0x7f05c4103bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:01:25.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.087+0000 7f05cb0e0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c411b090 con 0x7f05c40fcd00 2023-12-06T15:01:25.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.087+0000 7f05cb0e0700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c4102190 con 0x7f05c40fbaf0 2023-12-06T15:01:25.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.088+0000 7f05c3fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05c40fcd00 0x7f05c4103bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:01:25.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.088+0000 7f05c3fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05c40fcd00 0x7f05c4103bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32898/0 (socket says 172.21.15.152:32898) 2023-12-06T15:01:25.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.088+0000 7f05c3fff700 1 -- 172.21.15.152:0/4060425351 learned_addr learned my addr 172.21.15.152:0/4060425351 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:01:25.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.088+0000 7f05c8e7c700 1 --2- 172.21.15.152:0/4060425351 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05c40fbaf0 0x7f05c41036b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:01:25.092 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.092+0000 7f05c3fff700 1 -- 172.21.15.152:0/4060425351 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05c40fbaf0 msgr2=0x7f05c41036b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:01:25.092 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.092+0000 7f05c3fff700 1 --2- 172.21.15.152:0/4060425351 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05c40fbaf0 0x7f05c41036b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:25.092 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.092+0000 7f05c3fff700 1 -- 172.21.15.152:0/4060425351 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b8005040 con 0x7f05c40fcd00 2023-12-06T15:01:25.093 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.092+0000 7f05c3fff700 1 --2- 172.21.15.152:0/4060425351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05c40fcd00 0x7f05c4103bf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f05b000b790 tx=0x7f05b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:01:25.093 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.092+0000 7f05c17fa700 1 -- 172.21.15.152:0/4060425351 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05b000f770 con 0x7f05c40fcd00 2023-12-06T15:01:25.093 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.093+0000 7f05c17fa700 1 -- 172.21.15.152:0/4060425351 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f05b000fd80 con 0x7f05c40fcd00 2023-12-06T15:01:25.093 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.093+0000 7f05c17fa700 1 -- 172.21.15.152:0/4060425351 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05b0010e80 con 0x7f05c40fcd00 2023-12-06T15:01:25.093 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.093+0000 7f05cb0e0700 1 -- 172.21.15.152:0/4060425351 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c4102410 con 0x7f05c40fcd00 2023-12-06T15:01:25.093 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.093+0000 7f05cb0e0700 1 -- 172.21.15.152:0/4060425351 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c4102950 con 0x7f05c40fcd00 2023-12-06T15:01:25.094 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.094+0000 7f05cb0e0700 1 -- 172.21.15.152:0/4060425351 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c404bb80 con 0x7f05c40fcd00 2023-12-06T15:01:25.102 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.095+0000 7f05c17fa700 1 -- 172.21.15.152:0/4060425351 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 33) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f05b00106b0 con 0x7f05c40fcd00 2023-12-06T15:01:25.102 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.096+0000 7f05c17fa700 1 --2- 172.21.15.152:0/4060425351 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f05b406d160 0x7f05b406f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:01:25.103 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.096+0000 7f05c17fa700 1 -- 172.21.15.152:0/4060425351 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f05b008c250 con 0x7f05c40fcd00 2023-12-06T15:01:25.103 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.096+0000 7f05c8e7c700 1 -- 172.21.15.152:0/4060425351 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f05b406d160 msgr2=0x7f05b406f610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/4105588516 2023-12-06T15:01:25.103 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.096+0000 7f05c8e7c700 1 --2- 172.21.15.152:0/4060425351 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f05b406d160 0x7f05b406f610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-06T15:01:25.103 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.103+0000 7f05c17fa700 1 -- 172.21.15.152:0/4060425351 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f05b00561d0 con 0x7f05c40fcd00 2023-12-06T15:01:25.297 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.297+0000 7f05c8e7c700 1 -- 172.21.15.152:0/4060425351 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f05b406d160 msgr2=0x7f05b406f610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/4105588516 2023-12-06T15:01:25.297 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.297+0000 7f05c8e7c700 1 --2- 172.21.15.152:0/4060425351 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f05b406d160 0x7f05b406f610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-06T15:01:25.394 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.394+0000 7f05cb0e0700 1 -- 172.21.15.152:0/4060425351 --> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f05c4102f40 con 0x7f05b406d160 2023-12-06T15:01:25.698 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.698+0000 7f05c8e7c700 1 -- 172.21.15.152:0/4060425351 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f05b406d160 msgr2=0x7f05b406f610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/4105588516 2023-12-06T15:01:25.698 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:25.698+0000 7f05c8e7c700 1 --2- 172.21.15.152:0/4060425351 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f05b406d160 0x7f05b406f610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-06T15:01:26.499 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:26.499+0000 7f05c8e7c700 1 -- 172.21.15.152:0/4060425351 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f05b406d160 msgr2=0x7f05b406f610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/4105588516 2023-12-06T15:01:26.499 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:26.499+0000 7f05c8e7c700 1 --2- 172.21.15.152:0/4060425351 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f05b406d160 0x7f05b406f610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-06T15:01:28.100 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:28.100+0000 7f05c8e7c700 1 -- 172.21.15.152:0/4060425351 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f05b406d160 msgr2=0x7f05b406f610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.152:6800/4105588516 2023-12-06T15:01:28.100 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:28.100+0000 7f05c8e7c700 1 --2- 172.21.15.152:0/4060425351 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f05b406d160 0x7f05b406f610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-06T15:01:30.578 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:30.578+0000 7f05c17fa700 1 -- 172.21.15.152:0/4060425351 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mgrmap(e 34) v1 ==== 90561+0+0 (secure 0 0 0) 0x7f05b00565a0 con 0x7f05c40fcd00 2023-12-06T15:01:30.578 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:30.578+0000 7f05c17fa700 1 -- 172.21.15.152:0/4060425351 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f05b406d160 msgr2=0x7f05b406f610 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-06T15:01:30.578 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:30.578+0000 7f05c17fa700 1 --2- 172.21.15.152:0/4060425351 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f05b406d160 0x7f05b406f610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:30.658 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:30 smithi152 ceph-mon[192652]: Standby manager daemon smithi190.ubusrr restarted 2023-12-06T15:01:30.658 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:30 smithi152 ceph-mon[192652]: Standby manager daemon smithi190.ubusrr started 2023-12-06T15:01:30.658 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:30 smithi152 ceph-mon[192652]: from='mgr.? 172.21.15.190:0/4077519901' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi190.ubusrr/crt"}]: dispatch 2023-12-06T15:01:30.658 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:30 smithi152 ceph-mon[192652]: from='mgr.? 172.21.15.190:0/4077519901' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-06T15:01:30.658 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:30 smithi152 ceph-mon[192652]: Active manager daemon smithi152.meodco restarted 2023-12-06T15:01:30.659 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:30 smithi152 ceph-mon[192652]: Activating manager daemon smithi152.meodco 2023-12-06T15:01:30.659 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:30 smithi152 ceph-mon[192652]: from='mgr.? 172.21.15.190:0/4077519901' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi190.ubusrr/key"}]: dispatch 2023-12-06T15:01:30.659 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:30 smithi152 ceph-mon[192652]: from='mgr.? 172.21.15.190:0/4077519901' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-06T15:01:30.659 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:30 smithi152 ceph-mon[192652]: osdmap e48: 6 total, 6 up, 6 in 2023-12-06T15:01:30.659 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:30 smithi152 ceph-mon[192652]: mgrmap e34: smithi152.meodco(active, starting, since 0.00635548s), standbys: smithi190.ubusrr 2023-12-06T15:01:30.659 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:30 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-06T15:01:30.659 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:30 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi190"}]: dispatch 2023-12-06T15:01:30.659 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:30 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.acqswy"}]: dispatch 2023-12-06T15:01:30.659 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:30 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.ypivwc"}]: dispatch 2023-12-06T15:01:30.659 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:30 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi190.uucxzu"}]: dispatch 2023-12-06T15:01:30.659 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:30 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi190.edwtqj"}]: dispatch 2023-12-06T15:01:30.659 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:30 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mgr metadata", "who": "smithi152.meodco", "id": "smithi152.meodco"}]: dispatch 2023-12-06T15:01:30.660 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:30 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mgr metadata", "who": "smithi190.ubusrr", "id": "smithi190.ubusrr"}]: dispatch 2023-12-06T15:01:30.660 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:30 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-06T15:01:30.660 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:30 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-06T15:01:30.660 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:30 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-06T15:01:30.660 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:30 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-06T15:01:30.660 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:30 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-06T15:01:30.660 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:30 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-06T15:01:30.660 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:30 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-06T15:01:30.660 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:30 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-06T15:01:30.660 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:30 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-06T15:01:30.660 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:30 smithi152 ceph-mon[192652]: Manager daemon smithi152.meodco is now available 2023-12-06T15:01:30.676 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:30 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-mon-smithi190[121316]: 2023-12-06T15:01:30.575+0000 7f46b2fe3700 -1 mon.smithi190@1(peon).osd e48 update_from_paxos full map CRC mismatch, resetting to canonical 2023-12-06T15:01:30.677 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:30 smithi190 ceph-mon[121340]: Standby manager daemon smithi190.ubusrr restarted 2023-12-06T15:01:30.677 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:30 smithi190 ceph-mon[121340]: Standby manager daemon smithi190.ubusrr started 2023-12-06T15:01:30.677 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:30 smithi190 ceph-mon[121340]: from='mgr.? 172.21.15.190:0/4077519901' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi190.ubusrr/crt"}]: dispatch 2023-12-06T15:01:30.677 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:30 smithi190 ceph-mon[121340]: from='mgr.? 172.21.15.190:0/4077519901' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-06T15:01:30.677 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:30 smithi190 ceph-mon[121340]: Active manager daemon smithi152.meodco restarted 2023-12-06T15:01:30.677 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:30 smithi190 ceph-mon[121340]: Activating manager daemon smithi152.meodco 2023-12-06T15:01:30.677 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:30 smithi190 ceph-mon[121340]: from='mgr.? 172.21.15.190:0/4077519901' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi190.ubusrr/key"}]: dispatch 2023-12-06T15:01:30.677 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:30 smithi190 ceph-mon[121340]: from='mgr.? 172.21.15.190:0/4077519901' entity='mgr.smithi190.ubusrr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-06T15:01:30.677 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:30 smithi190 ceph-mon[121340]: osdmap e48: 6 total, 6 up, 6 in 2023-12-06T15:01:30.677 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:30 smithi190 ceph-mon[121340]: mgrmap e34: smithi152.meodco(active, starting, since 0.00635548s), standbys: smithi190.ubusrr 2023-12-06T15:01:30.677 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:30 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-06T15:01:30.677 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:30 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi190"}]: dispatch 2023-12-06T15:01:30.677 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:30 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.acqswy"}]: dispatch 2023-12-06T15:01:30.678 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:30 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi152.ypivwc"}]: dispatch 2023-12-06T15:01:30.678 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:30 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi190.uucxzu"}]: dispatch 2023-12-06T15:01:30.678 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:30 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi190.edwtqj"}]: dispatch 2023-12-06T15:01:30.678 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:30 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mgr metadata", "who": "smithi152.meodco", "id": "smithi152.meodco"}]: dispatch 2023-12-06T15:01:30.678 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:30 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mgr metadata", "who": "smithi190.ubusrr", "id": "smithi190.ubusrr"}]: dispatch 2023-12-06T15:01:30.678 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:30 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-06T15:01:30.678 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:30 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-06T15:01:30.678 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:30 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-06T15:01:30.678 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:30 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-06T15:01:30.678 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:30 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-06T15:01:30.678 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:30 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-06T15:01:30.678 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:30 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-06T15:01:30.679 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:30 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-06T15:01:30.679 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:30 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-06T15:01:30.679 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:30 smithi190 ceph-mon[121340]: Manager daemon smithi152.meodco is now available 2023-12-06T15:01:31.589 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.588+0000 7f05c17fa700 1 -- 172.21.15.152:0/4060425351 <== mon.0 v2:172.21.15.152:3300/0 8 ==== mgrmap(e 35) v1 ==== 90688+0+0 (secure 0 0 0) 0x7f05b005a820 con 0x7f05c40fcd00 2023-12-06T15:01:31.589 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.588+0000 7f05c17fa700 1 --2- 172.21.15.152:0/4060425351 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f05b401d1d0 0x7f05b4076dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:01:31.589 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.588+0000 7f05c17fa700 1 -- 172.21.15.152:0/4060425351 --> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f05c4102f40 con 0x7f05b401d1d0 2023-12-06T15:01:31.590 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.590+0000 7f05c8e7c700 1 --2- 172.21.15.152:0/4060425351 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f05b401d1d0 0x7f05b4076dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:01:31.594 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.594+0000 7f05c8e7c700 1 --2- 172.21.15.152:0/4060425351 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f05b401d1d0 0x7f05b4076dc0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f05b800b7d0 tx=0x7f05b8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:01:31.598 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.597+0000 7f05c17fa700 1 -- 172.21.15.152:0/4060425351 <== mgr.34104 v2:172.21.15.152:6800/2427836422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f05c4102f40 con 0x7f05b401d1d0 2023-12-06T15:01:31.603 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.603+0000 7f05cb0e0700 1 -- 172.21.15.152:0/4060425351 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f05b401d1d0 msgr2=0x7f05b4076dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:01:31.603 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.603+0000 7f05cb0e0700 1 --2- 172.21.15.152:0/4060425351 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f05b401d1d0 0x7f05b4076dc0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f05b800b7d0 tx=0x7f05b8009e30 comp rx=0 tx=0).stop 2023-12-06T15:01:31.603 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.603+0000 7f05cb0e0700 1 -- 172.21.15.152:0/4060425351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05c40fcd00 msgr2=0x7f05c4103bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:01:31.603 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.603+0000 7f05cb0e0700 1 --2- 172.21.15.152:0/4060425351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05c40fcd00 0x7f05c4103bf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f05b000b790 tx=0x7f05b0009250 comp rx=0 tx=0).stop 2023-12-06T15:01:31.604 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.604+0000 7f05cb0e0700 1 -- 172.21.15.152:0/4060425351 shutdown_connections 2023-12-06T15:01:31.604 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.604+0000 7f05cb0e0700 1 --2- 172.21.15.152:0/4060425351 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f05b401d1d0 0x7f05b4076dc0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:31.604 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.604+0000 7f05cb0e0700 1 --2- 172.21.15.152:0/4060425351 >> [v2:172.21.15.152:6800/4105588516,v1:172.21.15.152:6801/4105588516] conn(0x7f05b406d160 0x7f05b406f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:31.604 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.604+0000 7f05cb0e0700 1 --2- 172.21.15.152:0/4060425351 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05c40fbaf0 0x7f05c41036b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:31.604 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.604+0000 7f05cb0e0700 1 --2- 172.21.15.152:0/4060425351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05c40fcd00 0x7f05c4103bf0 secure :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f05b000b790 tx=0x7f05b0009250 comp rx=0 tx=0).stop 2023-12-06T15:01:31.604 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.604+0000 7f05cb0e0700 1 -- 172.21.15.152:0/4060425351 >> 172.21.15.152:0/4060425351 conn(0x7f05c40f7190 msgr2=0x7f05c40fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:01:31.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.605+0000 7f05cb0e0700 1 -- 172.21.15.152:0/4060425351 shutdown_connections 2023-12-06T15:01:31.607 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.607+0000 7f05cb0e0700 1 -- 172.21.15.152:0/4060425351 wait complete. 2023-12-06T15:01:31.621 INFO:teuthology.orchestra.run.smithi152.stdout:true 2023-12-06T15:01:31.730 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.730+0000 7f3d7352c700 1 -- 172.21.15.152:0/2582538207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d6c066920 msgr2=0x7f3d6c0ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:01:31.730 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.730+0000 7f3d7352c700 1 --2- 172.21.15.152:0/2582538207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d6c066920 0x7f3d6c0ff7a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3d60004940 tx=0x7f3d60009e30 comp rx=0 tx=0).stop 2023-12-06T15:01:31.731 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.730+0000 7f3d7352c700 1 -- 172.21.15.152:0/2582538207 shutdown_connections 2023-12-06T15:01:31.731 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.730+0000 7f3d7352c700 1 --2- 172.21.15.152:0/2582538207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d6c0ffd70 0x7f3d6c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:31.731 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.730+0000 7f3d7352c700 1 --2- 172.21.15.152:0/2582538207 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d6c066920 0x7f3d6c0ff7a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:31.731 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.730+0000 7f3d7352c700 1 -- 172.21.15.152:0/2582538207 >> 172.21.15.152:0/2582538207 conn(0x7f3d6c0f71b0 msgr2=0x7f3d6c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:01:31.731 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.730+0000 7f3d7352c700 1 -- 172.21.15.152:0/2582538207 shutdown_connections 2023-12-06T15:01:31.731 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.730+0000 7f3d7352c700 1 -- 172.21.15.152:0/2582538207 wait complete. 2023-12-06T15:01:31.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.731+0000 7f3d7352c700 1 Processor -- start 2023-12-06T15:01:31.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.731+0000 7f3d7352c700 1 -- start start 2023-12-06T15:01:31.733 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.731+0000 7f3d7352c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d6c066920 0x7f3d6c10d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:01:31.733 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.731+0000 7f3d7352c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d6c0ffd70 0x7f3d6c10da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:01:31.733 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.731+0000 7f3d7352c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c10e090 con 0x7f3d6c0ffd70 2023-12-06T15:01:31.733 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.731+0000 7f3d7352c700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c10e930 con 0x7f3d6c066920 2023-12-06T15:01:31.733 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.731+0000 7f3d70ac7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d6c0ffd70 0x7f3d6c10da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:01:31.733 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.731+0000 7f3d70ac7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d6c0ffd70 0x7f3d6c10da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45620/0 (socket says 172.21.15.152:45620) 2023-12-06T15:01:31.733 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.731+0000 7f3d70ac7700 1 -- 172.21.15.152:0/3633501878 learned_addr learned my addr 172.21.15.152:0/3633501878 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:01:31.733 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.731+0000 7f3d712c8700 1 --2- 172.21.15.152:0/3633501878 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d6c066920 0x7f3d6c10d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:01:31.733 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.731+0000 7f3d70ac7700 1 -- 172.21.15.152:0/3633501878 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d6c066920 msgr2=0x7f3d6c10d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:01:31.733 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.731+0000 7f3d70ac7700 1 --2- 172.21.15.152:0/3633501878 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d6c066920 0x7f3d6c10d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:31.733 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.731+0000 7f3d70ac7700 1 -- 172.21.15.152:0/3633501878 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d60005040 con 0x7f3d6c0ffd70 2023-12-06T15:01:31.733 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.732+0000 7f3d70ac7700 1 --2- 172.21.15.152:0/3633501878 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d6c0ffd70 0x7f3d6c10da90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3d68002a50 tx=0x7f3d68004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:01:31.734 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.732+0000 7f3d5dffb700 1 -- 172.21.15.152:0/3633501878 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d68007cc0 con 0x7f3d6c0ffd70 2023-12-06T15:01:31.734 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.732+0000 7f3d5dffb700 1 -- 172.21.15.152:0/3633501878 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3d6800f040 con 0x7f3d6c0ffd70 2023-12-06T15:01:31.734 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.732+0000 7f3d7352c700 1 -- 172.21.15.152:0/3633501878 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d6c10ec10 con 0x7f3d6c0ffd70 2023-12-06T15:01:31.734 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.732+0000 7f3d5dffb700 1 -- 172.21.15.152:0/3633501878 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d6800d920 con 0x7f3d6c0ffd70 2023-12-06T15:01:31.734 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.732+0000 7f3d7352c700 1 -- 172.21.15.152:0/3633501878 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d6c10f150 con 0x7f3d6c0ffd70 2023-12-06T15:01:31.735 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.733+0000 7f3d7352c700 1 -- 172.21.15.152:0/3633501878 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d6c1075e0 con 0x7f3d6c0ffd70 2023-12-06T15:01:31.735 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.733+0000 7f3d5dffb700 1 -- 172.21.15.152:0/3633501878 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 35) v1 ==== 90688+0+0 (secure 0 0 0) 0x7f3d68009680 con 0x7f3d6c0ffd70 2023-12-06T15:01:31.735 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.733+0000 7f3d5dffb700 1 --2- 172.21.15.152:0/3633501878 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f3d5806cb60 0x7f3d5806f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:01:31.735 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.734+0000 7f3d5dffb700 1 -- 172.21.15.152:0/3633501878 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f3d6808baa0 con 0x7f3d6c0ffd70 2023-12-06T15:01:31.735 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.734+0000 7f3d712c8700 1 --2- 172.21.15.152:0/3633501878 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f3d5806cb60 0x7f3d5806f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:01:31.735 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.734+0000 7f3d712c8700 1 --2- 172.21.15.152:0/3633501878 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f3d5806cb60 0x7f3d5806f010 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3d6000b3b0 tx=0x7f3d60009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:01:31.738 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.738+0000 7f3d5dffb700 1 -- 172.21.15.152:0/3633501878 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f3d68055c60 con 0x7f3d6c0ffd70 2023-12-06T15:01:31.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:31 smithi152 ceph-mon[192652]: failed to encode map e48 with expected crc 2023-12-06T15:01:31.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:31 smithi152 ceph-mon[192652]: failed to encode map e48 with expected crc 2023-12-06T15:01:31.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:31 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:01:31.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:31 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:01:31.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:31 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:01:31.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:31 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.meodco/mirror_snapshot_schedule"}]: dispatch 2023-12-06T15:01:31.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:31 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.meodco/trash_purge_schedule"}]: dispatch 2023-12-06T15:01:31.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:31 smithi152 ceph-mon[192652]: mgrmap e35: smithi152.meodco(active, since 1.01318s), standbys: smithi190.ubusrr 2023-12-06T15:01:31.950 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.949+0000 7f3d7352c700 1 -- 172.21.15.152:0/3633501878 --> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3d6c10f430 con 0x7f3d5806cb60 2023-12-06T15:01:31.951 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.951+0000 7f3d5dffb700 1 -- 172.21.15.152:0/3633501878 <== mgr.34104 v2:172.21.15.152:6800/2427836422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f3d6c10f430 con 0x7f3d5806cb60 2023-12-06T15:01:31.953 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.953+0000 7f3d7352c700 1 -- 172.21.15.152:0/3633501878 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f3d5806cb60 msgr2=0x7f3d5806f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:01:31.953 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.953+0000 7f3d7352c700 1 --2- 172.21.15.152:0/3633501878 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f3d5806cb60 0x7f3d5806f010 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3d6000b3b0 tx=0x7f3d60009e30 comp rx=0 tx=0).stop 2023-12-06T15:01:31.953 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.953+0000 7f3d7352c700 1 -- 172.21.15.152:0/3633501878 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d6c0ffd70 msgr2=0x7f3d6c10da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:01:31.953 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.953+0000 7f3d7352c700 1 --2- 172.21.15.152:0/3633501878 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d6c0ffd70 0x7f3d6c10da90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3d68002a50 tx=0x7f3d68004600 comp rx=0 tx=0).stop 2023-12-06T15:01:31.953 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.953+0000 7f3d7352c700 1 -- 172.21.15.152:0/3633501878 shutdown_connections 2023-12-06T15:01:31.953 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.953+0000 7f3d7352c700 1 --2- 172.21.15.152:0/3633501878 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f3d5806cb60 0x7f3d5806f010 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:31.953 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.953+0000 7f3d7352c700 1 --2- 172.21.15.152:0/3633501878 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d6c066920 0x7f3d6c10d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:31.953 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.953+0000 7f3d7352c700 1 --2- 172.21.15.152:0/3633501878 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d6c0ffd70 0x7f3d6c10da90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:31.954 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.953+0000 7f3d7352c700 1 -- 172.21.15.152:0/3633501878 >> 172.21.15.152:0/3633501878 conn(0x7f3d6c0f71b0 msgr2=0x7f3d6c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:01:31.954 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.953+0000 7f3d7352c700 1 -- 172.21.15.152:0/3633501878 shutdown_connections 2023-12-06T15:01:31.954 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:31.953+0000 7f3d7352c700 1 -- 172.21.15.152:0/3633501878 wait complete. 2023-12-06T15:01:32.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.064+0000 7f123ab4a700 1 -- 172.21.15.152:0/3569578250 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1234066920 msgr2=0x7f12340ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:01:32.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.064+0000 7f123ab4a700 1 --2- 172.21.15.152:0/3569578250 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1234066920 0x7f12340ff7a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1228004940 tx=0x7f1228009e30 comp rx=0 tx=0).stop 2023-12-06T15:01:32.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.064+0000 7f123ab4a700 1 -- 172.21.15.152:0/3569578250 shutdown_connections 2023-12-06T15:01:32.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.064+0000 7f123ab4a700 1 --2- 172.21.15.152:0/3569578250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12340ffd70 0x7f12341021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:32.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.064+0000 7f123ab4a700 1 --2- 172.21.15.152:0/3569578250 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1234066920 0x7f12340ff7a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:32.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.064+0000 7f123ab4a700 1 -- 172.21.15.152:0/3569578250 >> 172.21.15.152:0/3569578250 conn(0x7f12340f71d0 msgr2=0x7f12340f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:01:32.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.064+0000 7f123ab4a700 1 -- 172.21.15.152:0/3569578250 shutdown_connections 2023-12-06T15:01:32.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.064+0000 7f123ab4a700 1 -- 172.21.15.152:0/3569578250 wait complete. 2023-12-06T15:01:32.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.065+0000 7f123ab4a700 1 Processor -- start 2023-12-06T15:01:32.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.065+0000 7f123ab4a700 1 -- start start 2023-12-06T15:01:32.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.065+0000 7f123ab4a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1234066920 0x7f12340fd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:01:32.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.065+0000 7f123ab4a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12340ffd70 0x7f12340fb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:01:32.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.065+0000 7f123ab4a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12340fbca0 con 0x7f1234066920 2023-12-06T15:01:32.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.065+0000 7f123ab4a700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12340fbe10 con 0x7f12340ffd70 2023-12-06T15:01:32.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.066+0000 7f12388e6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1234066920 0x7f12340fd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:01:32.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.066+0000 7f1233fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12340ffd70 0x7f12340fb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:01:32.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.066+0000 7f12388e6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1234066920 0x7f12340fd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45630/0 (socket says 172.21.15.152:45630) 2023-12-06T15:01:32.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.066+0000 7f12388e6700 1 -- 172.21.15.152:0/912287346 learned_addr learned my addr 172.21.15.152:0/912287346 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:01:32.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.066+0000 7f1233fff700 1 -- 172.21.15.152:0/912287346 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1234066920 msgr2=0x7f12340fd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:01:32.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.066+0000 7f1233fff700 1 --2- 172.21.15.152:0/912287346 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1234066920 0x7f12340fd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:32.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.066+0000 7f1233fff700 1 -- 172.21.15.152:0/912287346 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1228005040 con 0x7f12340ffd70 2023-12-06T15:01:32.067 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.066+0000 7f12388e6700 1 --2- 172.21.15.152:0/912287346 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1234066920 0x7f12340fd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-06T15:01:32.068 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.066+0000 7f1233fff700 1 --2- 172.21.15.152:0/912287346 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12340ffd70 0x7f12340fb6a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1234066660 tx=0x7f122000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:01:32.068 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.066+0000 7f12317fa700 1 -- 172.21.15.152:0/912287346 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1220004e90 con 0x7f12340ffd70 2023-12-06T15:01:32.068 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.066+0000 7f123ab4a700 1 -- 172.21.15.152:0/912287346 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12340fc090 con 0x7f12340ffd70 2023-12-06T15:01:32.068 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.066+0000 7f12317fa700 1 -- 172.21.15.152:0/912287346 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f122000f040 con 0x7f12340ffd70 2023-12-06T15:01:32.068 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.066+0000 7f12317fa700 1 -- 172.21.15.152:0/912287346 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f122000c980 con 0x7f12340ffd70 2023-12-06T15:01:32.068 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.066+0000 7f123ab4a700 1 -- 172.21.15.152:0/912287346 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12341154e0 con 0x7f12340ffd70 2023-12-06T15:01:32.069 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.067+0000 7f123ab4a700 1 -- 172.21.15.152:0/912287346 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f123404bb80 con 0x7f12340ffd70 2023-12-06T15:01:32.069 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.068+0000 7f12317fa700 1 -- 172.21.15.152:0/912287346 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 35) v1 ==== 90688+0+0 (secure 0 0 0) 0x7f1220007cc0 con 0x7f12340ffd70 2023-12-06T15:01:32.069 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.069+0000 7f12317fa700 1 --2- 172.21.15.152:0/912287346 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f122406cb60 0x7f122406f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:01:32.069 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.069+0000 7f12317fa700 1 -- 172.21.15.152:0/912287346 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f122008bac0 con 0x7f12340ffd70 2023-12-06T15:01:32.069 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.069+0000 7f12388e6700 1 --2- 172.21.15.152:0/912287346 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f122406cb60 0x7f122406f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:01:32.069 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.069+0000 7f12388e6700 1 --2- 172.21.15.152:0/912287346 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f122406cb60 0x7f122406f010 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f122800b0d0 tx=0x7f1228009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:01:32.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:31 smithi190 ceph-mon[121340]: failed to encode map e48 with expected crc 2023-12-06T15:01:32.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:31 smithi190 ceph-mon[121340]: failed to encode map e48 with expected crc 2023-12-06T15:01:32.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:31 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:01:32.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:31 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:01:32.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:31 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:01:32.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:31 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.meodco/mirror_snapshot_schedule"}]: dispatch 2023-12-06T15:01:32.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:31 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi152.meodco/trash_purge_schedule"}]: dispatch 2023-12-06T15:01:32.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:31 smithi190 ceph-mon[121340]: mgrmap e35: smithi152.meodco(active, since 1.01318s), standbys: smithi190.ubusrr 2023-12-06T15:01:32.077 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.076+0000 7f12317fa700 1 -- 172.21.15.152:0/912287346 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1220055cb0 con 0x7f12340ffd70 2023-12-06T15:01:32.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.374+0000 7f123ab4a700 1 -- 172.21.15.152:0/912287346 --> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1234100a20 con 0x7f122406cb60 2023-12-06T15:01:32.388 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.388+0000 7f12317fa700 1 -- 172.21.15.152:0/912287346 <== mgr.34104 v2:172.21.15.152:6800/2427836422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f1234100a20 con 0x7f122406cb60 2023-12-06T15:01:32.388 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-06T15:01:32.388 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 running (92s) 18s ago 7m 15.1M - 0.25.0 c8568f914cd2 b1a46cc95546 2023-12-06T15:01:32.389 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (7m) 18s ago 7m 7436k - 17.2.7-113-gece0d607 a5c6421f1c5f 40d5cebbdb93 2023-12-06T15:01:32.389 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi190 smithi190 running (6m) 20s ago 6m 7461k - 17.2.7-113-gece0d607 a5c6421f1c5f 3a387cddf7e6 2023-12-06T15:01:32.389 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (89s) 18s ago 7m 80.9M - 9.4.7 954c08fa6188 5c6a52d58144 2023-12-06T15:01:32.389 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.acqswy smithi152 running (3m) 18s ago 3m 4190M - 17.2.7-113-gece0d607 a5c6421f1c5f ff9375cec192 2023-12-06T15:01:32.389 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.ypivwc smithi152 running (3m) 18s ago 3m 405M - 17.2.7-113-gece0d607 a5c6421f1c5f d809a681491b 2023-12-06T15:01:32.389 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi190.edwtqj smithi190 running (3m) 20s ago 3m 495M - 17.2.7-113-gece0d607 a5c6421f1c5f f3b7ebd93b04 2023-12-06T15:01:32.389 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi190.uucxzu smithi190 running (3m) 20s ago 3m 3445M - 17.2.7-113-gece0d607 a5c6421f1c5f c01be1409c5f 2023-12-06T15:01:32.389 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.meodco smithi152 *:8443,9283,8765 running (51s) 18s ago 8m 497M - 19.0.0-26-g0482646f 26bb7d89db2e 16ed2af8a3d0 2023-12-06T15:01:32.389 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi190.ubusrr smithi190 *:8443,9283,8765 running (22s) 20s ago 6m 50.9M - 19.0.0-26-g0482646f 26bb7d89db2e cfae14b9324d 2023-12-06T15:01:32.389 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (8m) 18s ago 8m 91.7M 2048M 17.2.7-113-gece0d607 a5c6421f1c5f 2b9f6058715d 2023-12-06T15:01:32.389 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi190 smithi190 running (6m) 20s ago 6m 65.2M 2048M 17.2.7-113-gece0d607 a5c6421f1c5f 3a81d140940b 2023-12-06T15:01:32.389 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 running (95s) 18s ago 7m 18.3M - 1.5.0 0da6a335fe13 81be696b9be8 2023-12-06T15:01:32.389 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi190 smithi190 *:9100 running (57s) 20s ago 6m 8456k - 1.5.0 0da6a335fe13 2e521e235bf7 2023-12-06T15:01:32.390 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (6m) 18s ago 6m 610M 1568M 17.2.7-113-gece0d607 a5c6421f1c5f 499f740f966e 2023-12-06T15:01:32.390 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (5m) 18s ago 5m 681M 1568M 17.2.7-113-gece0d607 a5c6421f1c5f 3942f134581a 2023-12-06T15:01:32.390 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (5m) 18s ago 5m 509M 1568M 17.2.7-113-gece0d607 a5c6421f1c5f 80bcc4927bb2 2023-12-06T15:01:32.390 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi190 running (5m) 20s ago 5m 763M 2592M 17.2.7-113-gece0d607 a5c6421f1c5f f0281d01fec4 2023-12-06T15:01:32.390 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi190 running (4m) 20s ago 4m 584M 2592M 17.2.7-113-gece0d607 a5c6421f1c5f a415b29ad9c7 2023-12-06T15:01:32.390 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi190 running (4m) 20s ago 4m 709M 2592M 17.2.7-113-gece0d607 a5c6421f1c5f b0f2767055a5 2023-12-06T15:01:32.390 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi152 smithi152 *:9095 running (27s) 18s ago 6m 38.6M - 2.43.0 a07b618ecd1d 5f7e5860a419 2023-12-06T15:01:32.391 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.391+0000 7f123ab4a700 1 -- 172.21.15.152:0/912287346 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f122406cb60 msgr2=0x7f122406f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:01:32.391 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.391+0000 7f123ab4a700 1 --2- 172.21.15.152:0/912287346 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f122406cb60 0x7f122406f010 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f122800b0d0 tx=0x7f1228009e30 comp rx=0 tx=0).stop 2023-12-06T15:01:32.391 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.391+0000 7f123ab4a700 1 -- 172.21.15.152:0/912287346 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12340ffd70 msgr2=0x7f12340fb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:01:32.391 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.391+0000 7f123ab4a700 1 --2- 172.21.15.152:0/912287346 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12340ffd70 0x7f12340fb6a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1234066660 tx=0x7f122000b040 comp rx=0 tx=0).stop 2023-12-06T15:01:32.391 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.391+0000 7f123ab4a700 1 -- 172.21.15.152:0/912287346 shutdown_connections 2023-12-06T15:01:32.391 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.391+0000 7f123ab4a700 1 --2- 172.21.15.152:0/912287346 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f122406cb60 0x7f122406f010 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:32.391 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.391+0000 7f123ab4a700 1 --2- 172.21.15.152:0/912287346 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1234066920 0x7f12340fd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:32.391 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.391+0000 7f123ab4a700 1 --2- 172.21.15.152:0/912287346 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12340ffd70 0x7f12340fb6a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:32.392 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.391+0000 7f123ab4a700 1 -- 172.21.15.152:0/912287346 >> 172.21.15.152:0/912287346 conn(0x7f12340f71d0 msgr2=0x7f12340f95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:01:32.392 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.391+0000 7f123ab4a700 1 -- 172.21.15.152:0/912287346 shutdown_connections 2023-12-06T15:01:32.392 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.391+0000 7f123ab4a700 1 -- 172.21.15.152:0/912287346 wait complete. 2023-12-06T15:01:32.516 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.515+0000 7f5c590c0700 1 -- 172.21.15.152:0/1969247698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c540fb290 msgr2=0x7f5c540fb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:01:32.516 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.515+0000 7f5c590c0700 1 --2- 172.21.15.152:0/1969247698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c540fb290 0x7f5c540fb6a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5c44004880 tx=0x7f5c44009e30 comp rx=0 tx=0).stop 2023-12-06T15:01:32.516 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.516+0000 7f5c590c0700 1 -- 172.21.15.152:0/1969247698 shutdown_connections 2023-12-06T15:01:32.516 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.516+0000 7f5c590c0700 1 --2- 172.21.15.152:0/1969247698 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c540fc4a0 0x7f5c540fc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:32.516 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.516+0000 7f5c590c0700 1 --2- 172.21.15.152:0/1969247698 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c540fb290 0x7f5c540fb6a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:32.517 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.516+0000 7f5c590c0700 1 -- 172.21.15.152:0/1969247698 >> 172.21.15.152:0/1969247698 conn(0x7f5c540f6950 msgr2=0x7f5c540f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:01:32.517 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.516+0000 7f5c590c0700 1 -- 172.21.15.152:0/1969247698 shutdown_connections 2023-12-06T15:01:32.517 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.516+0000 7f5c590c0700 1 -- 172.21.15.152:0/1969247698 wait complete. 2023-12-06T15:01:32.518 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.516+0000 7f5c590c0700 1 Processor -- start 2023-12-06T15:01:32.518 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.516+0000 7f5c590c0700 1 -- start start 2023-12-06T15:01:32.518 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.517+0000 7f5c590c0700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c540fb290 0x7f5c54067a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:01:32.518 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.517+0000 7f5c590c0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c540fc4a0 0x7f5c54067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:01:32.518 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.517+0000 7f5c590c0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c540685c0 con 0x7f5c540fc4a0 2023-12-06T15:01:32.518 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.517+0000 7f5c590c0700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c54068e60 con 0x7f5c540fb290 2023-12-06T15:01:32.518 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.517+0000 7f5c52d9d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c540fb290 0x7f5c54067a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:01:32.519 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.517+0000 7f5c52d9d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c540fb290 0x7f5c54067a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.152:47604/0 (socket says 172.21.15.152:47604) 2023-12-06T15:01:32.519 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.517+0000 7f5c52d9d700 1 -- 172.21.15.152:0/3903925237 learned_addr learned my addr 172.21.15.152:0/3903925237 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:01:32.519 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.517+0000 7f5c5259c700 1 --2- 172.21.15.152:0/3903925237 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c540fc4a0 0x7f5c54067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:01:32.519 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.517+0000 7f5c52d9d700 1 -- 172.21.15.152:0/3903925237 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c540fc4a0 msgr2=0x7f5c54067f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:01:32.519 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.517+0000 7f5c52d9d700 1 --2- 172.21.15.152:0/3903925237 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c540fc4a0 0x7f5c54067f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:32.519 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.517+0000 7f5c52d9d700 1 -- 172.21.15.152:0/3903925237 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c48005040 con 0x7f5c540fb290 2023-12-06T15:01:32.519 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.517+0000 7f5c52d9d700 1 --2- 172.21.15.152:0/3903925237 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c540fb290 0x7f5c54067a30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5c44007f50 tx=0x7f5c44009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:01:32.519 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.518+0000 7f5c3b7fe700 1 -- 172.21.15.152:0/3903925237 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c4400e030 con 0x7f5c540fb290 2023-12-06T15:01:32.519 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.518+0000 7f5c3b7fe700 1 -- 172.21.15.152:0/3903925237 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5c4401c400 con 0x7f5c540fb290 2023-12-06T15:01:32.519 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.518+0000 7f5c3b7fe700 1 -- 172.21.15.152:0/3903925237 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c440125e0 con 0x7f5c540fb290 2023-12-06T15:01:32.519 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.518+0000 7f5c590c0700 1 -- 172.21.15.152:0/3903925237 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c44005040 con 0x7f5c540fb290 2023-12-06T15:01:32.519 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.518+0000 7f5c590c0700 1 -- 172.21.15.152:0/3903925237 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c54069440 con 0x7f5c540fb290 2023-12-06T15:01:32.520 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.519+0000 7f5c590c0700 1 -- 172.21.15.152:0/3903925237 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c5404bb80 con 0x7f5c540fb290 2023-12-06T15:01:32.520 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.520+0000 7f5c3b7fe700 1 -- 172.21.15.152:0/3903925237 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 35) v1 ==== 90688+0+0 (secure 0 0 0) 0x7f5c4401c570 con 0x7f5c540fb290 2023-12-06T15:01:32.520 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.520+0000 7f5c3b7fe700 1 --2- 172.21.15.152:0/3903925237 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f5c3c06cb60 0x7f5c3c06f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:01:32.521 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.520+0000 7f5c3b7fe700 1 -- 172.21.15.152:0/3903925237 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f5c4408d700 con 0x7f5c540fb290 2023-12-06T15:01:32.521 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.520+0000 7f5c5259c700 1 --2- 172.21.15.152:0/3903925237 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f5c3c06cb60 0x7f5c3c06f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:01:32.521 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.521+0000 7f5c5259c700 1 --2- 172.21.15.152:0/3903925237 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f5c3c06cb60 0x7f5c3c06f010 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5c48009fd0 tx=0x7f5c4800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:01:32.525 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.525+0000 7f5c3b7fe700 1 -- 172.21.15.152:0/3903925237 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f5c44057930 con 0x7f5c540fb290 2023-12-06T15:01:32.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:32 smithi152 ceph-mon[192652]: [06/Dec/2023:15:01:31] ENGINE Bus STARTING 2023-12-06T15:01:32.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:32 smithi152 ceph-mon[192652]: from='client.34106 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:01:32.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:32 smithi152 ceph-mon[192652]: pgmap v3: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-06T15:01:32.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:32 smithi152 ceph-mon[192652]: [06/Dec/2023:15:01:31] ENGINE Serving on https://172.21.15.152:7150 2023-12-06T15:01:32.927 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.927+0000 7f5c590c0700 1 -- 172.21.15.152:0/3903925237 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5c541044c0 con 0x7f5c540fb290 2023-12-06T15:01:32.928 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.928+0000 7f5c3b7fe700 1 -- 172.21.15.152:0/3903925237 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+834 (secure 0 0 0) 0x7f5c4401c820 con 0x7f5c540fb290 2023-12-06T15:01:32.928 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-12-06T15:01:32.928 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": { 2023-12-06T15:01:32.928 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 1, 2023-12-06T15:01:32.928 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 1 2023-12-06T15:01:32.928 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:01:32.928 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": { 2023-12-06T15:01:32.928 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 2 2023-12-06T15:01:32.928 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:01:32.928 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": { 2023-12-06T15:01:32.928 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 6 2023-12-06T15:01:32.929 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:01:32.929 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2023-12-06T15:01:32.929 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 4 2023-12-06T15:01:32.929 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:01:32.929 INFO:teuthology.orchestra.run.smithi152.stdout: "overall": { 2023-12-06T15:01:32.929 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 11, 2023-12-06T15:01:32.929 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 3 2023-12-06T15:01:32.929 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-12-06T15:01:32.929 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-12-06T15:01:32.930 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.930+0000 7f5c590c0700 1 -- 172.21.15.152:0/3903925237 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f5c3c06cb60 msgr2=0x7f5c3c06f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:01:32.931 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.930+0000 7f5c590c0700 1 --2- 172.21.15.152:0/3903925237 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f5c3c06cb60 0x7f5c3c06f010 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5c48009fd0 tx=0x7f5c4800b040 comp rx=0 tx=0).stop 2023-12-06T15:01:32.931 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.930+0000 7f5c590c0700 1 -- 172.21.15.152:0/3903925237 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c540fb290 msgr2=0x7f5c54067a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:01:32.931 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.930+0000 7f5c590c0700 1 --2- 172.21.15.152:0/3903925237 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c540fb290 0x7f5c54067a30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5c44007f50 tx=0x7f5c44009e30 comp rx=0 tx=0).stop 2023-12-06T15:01:32.931 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.930+0000 7f5c590c0700 1 -- 172.21.15.152:0/3903925237 shutdown_connections 2023-12-06T15:01:32.931 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.930+0000 7f5c590c0700 1 --2- 172.21.15.152:0/3903925237 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f5c3c06cb60 0x7f5c3c06f010 secure :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5c48009fd0 tx=0x7f5c4800b040 comp rx=0 tx=0).stop 2023-12-06T15:01:32.931 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.930+0000 7f5c590c0700 1 --2- 172.21.15.152:0/3903925237 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c540fb290 0x7f5c54067a30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:32.931 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.930+0000 7f5c590c0700 1 --2- 172.21.15.152:0/3903925237 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c540fc4a0 0x7f5c54067f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:32.931 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.930+0000 7f5c590c0700 1 -- 172.21.15.152:0/3903925237 >> 172.21.15.152:0/3903925237 conn(0x7f5c540f6950 msgr2=0x7f5c540ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:01:32.931 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.931+0000 7f5c590c0700 1 -- 172.21.15.152:0/3903925237 shutdown_connections 2023-12-06T15:01:32.931 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:32.931+0000 7f5c590c0700 1 -- 172.21.15.152:0/3903925237 wait complete. 2023-12-06T15:01:33.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:32 smithi190 ceph-mon[121340]: [06/Dec/2023:15:01:31] ENGINE Bus STARTING 2023-12-06T15:01:33.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:32 smithi190 ceph-mon[121340]: from='client.34106 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:01:33.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:32 smithi190 ceph-mon[121340]: pgmap v3: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-06T15:01:33.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:32 smithi190 ceph-mon[121340]: [06/Dec/2023:15:01:31] ENGINE Serving on https://172.21.15.152:7150 2023-12-06T15:01:33.074 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.074+0000 7f18e0ca5700 1 -- 172.21.15.152:0/3383442613 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18dc0fcd00 msgr2=0x7f18dc0fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:01:33.074 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.074+0000 7f18e0ca5700 1 --2- 172.21.15.152:0/3383442613 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18dc0fcd00 0x7f18dc0fd150 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f18d0004940 tx=0x7f18d0009e30 comp rx=0 tx=0).stop 2023-12-06T15:01:33.075 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.074+0000 7f18e0ca5700 1 -- 172.21.15.152:0/3383442613 shutdown_connections 2023-12-06T15:01:33.075 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.075+0000 7f18e0ca5700 1 --2- 172.21.15.152:0/3383442613 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18dc0fcd00 0x7f18dc0fd150 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:33.075 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.075+0000 7f18e0ca5700 1 --2- 172.21.15.152:0/3383442613 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18dc0fbaf0 0x7f18dc0fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:33.075 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.075+0000 7f18e0ca5700 1 -- 172.21.15.152:0/3383442613 >> 172.21.15.152:0/3383442613 conn(0x7f18dc0f7190 msgr2=0x7f18dc0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:01:33.077 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.075+0000 7f18e0ca5700 1 -- 172.21.15.152:0/3383442613 shutdown_connections 2023-12-06T15:01:33.077 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.075+0000 7f18e0ca5700 1 -- 172.21.15.152:0/3383442613 wait complete. 2023-12-06T15:01:33.077 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.075+0000 7f18e0ca5700 1 Processor -- start 2023-12-06T15:01:33.077 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.075+0000 7f18e0ca5700 1 -- start start 2023-12-06T15:01:33.077 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.076+0000 7f18e0ca5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18dc0fbaf0 0x7f18dc06ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:01:33.077 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.076+0000 7f18e0ca5700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18dc0fcd00 0x7f18dc06f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:01:33.077 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.076+0000 7f18e0ca5700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc06f800 con 0x7f18dc0fbaf0 2023-12-06T15:01:33.077 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.076+0000 7f18e0ca5700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc115fd0 con 0x7f18dc0fcd00 2023-12-06T15:01:33.077 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.076+0000 7f18d9d9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18dc0fcd00 0x7f18dc06f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:01:33.077 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.076+0000 7f18d9d9b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18dc0fcd00 0x7f18dc06f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.152:47642/0 (socket says 172.21.15.152:47642) 2023-12-06T15:01:33.077 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.076+0000 7f18d9d9b700 1 -- 172.21.15.152:0/1362760832 learned_addr learned my addr 172.21.15.152:0/1362760832 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:01:33.077 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.076+0000 7f18da59c700 1 --2- 172.21.15.152:0/1362760832 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18dc0fbaf0 0x7f18dc06ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:01:33.078 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.076+0000 7f18d9d9b700 1 -- 172.21.15.152:0/1362760832 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18dc0fbaf0 msgr2=0x7f18dc06ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:01:33.078 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.076+0000 7f18d9d9b700 1 --2- 172.21.15.152:0/1362760832 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18dc0fbaf0 0x7f18dc06ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:33.078 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.076+0000 7f18d9d9b700 1 -- 172.21.15.152:0/1362760832 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d0005040 con 0x7f18dc0fcd00 2023-12-06T15:01:33.078 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.076+0000 7f18d9d9b700 1 --2- 172.21.15.152:0/1362760832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18dc0fcd00 0x7f18dc06f1b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f18d0008f90 tx=0x7f18d0009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:01:33.078 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.077+0000 7f18caffd700 1 -- 172.21.15.152:0/1362760832 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18d0021070 con 0x7f18dc0fcd00 2023-12-06T15:01:33.078 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.077+0000 7f18caffd700 1 -- 172.21.15.152:0/1362760832 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f18d001c400 con 0x7f18dc0fcd00 2023-12-06T15:01:33.079 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.077+0000 7f18e0ca5700 1 -- 172.21.15.152:0/1362760832 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18dc116250 con 0x7f18dc0fcd00 2023-12-06T15:01:33.079 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.077+0000 7f18caffd700 1 -- 172.21.15.152:0/1362760832 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18d000e030 con 0x7f18dc0fcd00 2023-12-06T15:01:33.079 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.077+0000 7f18e0ca5700 1 -- 172.21.15.152:0/1362760832 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18dc116790 con 0x7f18dc0fcd00 2023-12-06T15:01:33.079 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.078+0000 7f18e0ca5700 1 -- 172.21.15.152:0/1362760832 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18dc04bb80 con 0x7f18dc0fcd00 2023-12-06T15:01:33.079 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.078+0000 7f18caffd700 1 -- 172.21.15.152:0/1362760832 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 35) v1 ==== 90688+0+0 (secure 0 0 0) 0x7f18d0013a30 con 0x7f18dc0fcd00 2023-12-06T15:01:33.080 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.079+0000 7f18caffd700 1 --2- 172.21.15.152:0/1362760832 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f18c406cc30 0x7f18c406f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:01:33.080 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.079+0000 7f18caffd700 1 -- 172.21.15.152:0/1362760832 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f18d008cea0 con 0x7f18dc0fcd00 2023-12-06T15:01:33.080 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.079+0000 7f18da59c700 1 --2- 172.21.15.152:0/1362760832 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f18c406cc30 0x7f18c406f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:01:33.080 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.080+0000 7f18da59c700 1 --2- 172.21.15.152:0/1362760832 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f18c406cc30 0x7f18c406f0e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f18dc06ea00 tx=0x7f18cc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:01:33.083 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.083+0000 7f18caffd700 1 -- 172.21.15.152:0/1362760832 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f18d00570e0 con 0x7f18dc0fcd00 2023-12-06T15:01:33.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.445+0000 7f18e0ca5700 1 -- 172.21.15.152:0/1362760832 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f18dc104490 con 0x7f18dc0fcd00 2023-12-06T15:01:33.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.446+0000 7f18caffd700 1 -- 172.21.15.152:0/1362760832 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1852 (secure 0 0 0) 0x7f18d005a700 con 0x7f18dc0fcd00 2023-12-06T15:01:33.446 INFO:teuthology.orchestra.run.smithi152.stdout:e15 2023-12-06T15:01:33.446 INFO:teuthology.orchestra.run.smithi152.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-06T15:01:33.446 INFO:teuthology.orchestra.run.smithi152.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-06T15:01:33.447 INFO:teuthology.orchestra.run.smithi152.stdout:legacy client fscid: 1 2023-12-06T15:01:33.447 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T15:01:33.447 INFO:teuthology.orchestra.run.smithi152.stdout:Filesystem 'cephfs' (1) 2023-12-06T15:01:33.447 INFO:teuthology.orchestra.run.smithi152.stdout:fs_name cephfs 2023-12-06T15:01:33.447 INFO:teuthology.orchestra.run.smithi152.stdout:epoch 15 2023-12-06T15:01:33.447 INFO:teuthology.orchestra.run.smithi152.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-06T15:01:33.447 INFO:teuthology.orchestra.run.smithi152.stdout:created 2023-12-06T14:57:59.352201+0000 2023-12-06T15:01:33.447 INFO:teuthology.orchestra.run.smithi152.stdout:modified 2023-12-06T14:59:52.365348+0000 2023-12-06T15:01:33.447 INFO:teuthology.orchestra.run.smithi152.stdout:tableserver 0 2023-12-06T15:01:33.447 INFO:teuthology.orchestra.run.smithi152.stdout:root 0 2023-12-06T15:01:33.447 INFO:teuthology.orchestra.run.smithi152.stdout:session_timeout 60 2023-12-06T15:01:33.447 INFO:teuthology.orchestra.run.smithi152.stdout:session_autoclose 300 2023-12-06T15:01:33.447 INFO:teuthology.orchestra.run.smithi152.stdout:max_file_size 1099511627776 2023-12-06T15:01:33.447 INFO:teuthology.orchestra.run.smithi152.stdout:required_client_features {} 2023-12-06T15:01:33.447 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure 0 2023-12-06T15:01:33.447 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure_osd_epoch 0 2023-12-06T15:01:33.448 INFO:teuthology.orchestra.run.smithi152.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-06T15:01:33.448 INFO:teuthology.orchestra.run.smithi152.stdout:max_mds 2 2023-12-06T15:01:33.448 INFO:teuthology.orchestra.run.smithi152.stdout:in 0,1 2023-12-06T15:01:33.448 INFO:teuthology.orchestra.run.smithi152.stdout:up {0=14464,1=24255} 2023-12-06T15:01:33.448 INFO:teuthology.orchestra.run.smithi152.stdout:failed 2023-12-06T15:01:33.448 INFO:teuthology.orchestra.run.smithi152.stdout:damaged 2023-12-06T15:01:33.448 INFO:teuthology.orchestra.run.smithi152.stdout:stopped 2023-12-06T15:01:33.448 INFO:teuthology.orchestra.run.smithi152.stdout:data_pools [3] 2023-12-06T15:01:33.448 INFO:teuthology.orchestra.run.smithi152.stdout:metadata_pool 2 2023-12-06T15:01:33.448 INFO:teuthology.orchestra.run.smithi152.stdout:inline_data disabled 2023-12-06T15:01:33.448 INFO:teuthology.orchestra.run.smithi152.stdout:balancer 2023-12-06T15:01:33.448 INFO:teuthology.orchestra.run.smithi152.stdout:standby_count_wanted 1 2023-12-06T15:01:33.448 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.acqswy{0:14464} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.152:6826/2467413186,v1:172.21.15.152:6827/2467413186] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:01:33.448 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi190.edwtqj{0:24271} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.190:6826/2256465065,v1:172.21.15.190:6827/2256465065] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:01:33.448 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi190.uucxzu{1:24255} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.190:6824/3250692478,v1:172.21.15.190:6825/3250692478] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:01:33.449 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.ypivwc{1:14480} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.152:6828/697313573,v1:172.21.15.152:6829/697313573] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:01:33.449 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T15:01:33.449 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T15:01:33.449 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.449+0000 7f18e0ca5700 1 -- 172.21.15.152:0/1362760832 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f18c406cc30 msgr2=0x7f18c406f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:01:33.449 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.449+0000 7f18e0ca5700 1 --2- 172.21.15.152:0/1362760832 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f18c406cc30 0x7f18c406f0e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f18dc06ea00 tx=0x7f18cc00b040 comp rx=0 tx=0).stop 2023-12-06T15:01:33.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.449+0000 7f18e0ca5700 1 -- 172.21.15.152:0/1362760832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18dc0fcd00 msgr2=0x7f18dc06f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:01:33.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.449+0000 7f18e0ca5700 1 --2- 172.21.15.152:0/1362760832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18dc0fcd00 0x7f18dc06f1b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f18d0008f90 tx=0x7f18d0009e30 comp rx=0 tx=0).stop 2023-12-06T15:01:33.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.449+0000 7f18e0ca5700 1 -- 172.21.15.152:0/1362760832 shutdown_connections 2023-12-06T15:01:33.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.449+0000 7f18e0ca5700 1 --2- 172.21.15.152:0/1362760832 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f18c406cc30 0x7f18c406f0e0 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f18dc06ea00 tx=0x7f18cc00b040 comp rx=0 tx=0).stop 2023-12-06T15:01:33.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.449+0000 7f18e0ca5700 1 --2- 172.21.15.152:0/1362760832 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18dc0fbaf0 0x7f18dc06ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:33.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.449+0000 7f18e0ca5700 1 --2- 172.21.15.152:0/1362760832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18dc0fcd00 0x7f18dc06f1b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:33.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.449+0000 7f18e0ca5700 1 -- 172.21.15.152:0/1362760832 >> 172.21.15.152:0/1362760832 conn(0x7f18dc0f7190 msgr2=0x7f18dc0fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:01:33.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.449+0000 7f18e0ca5700 1 -- 172.21.15.152:0/1362760832 shutdown_connections 2023-12-06T15:01:33.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.449+0000 7f18e0ca5700 1 -- 172.21.15.152:0/1362760832 wait complete. 2023-12-06T15:01:33.450 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 15 2023-12-06T15:01:33.594 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.594+0000 7faa596a8700 1 -- 172.21.15.152:0/1136528593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa540fb520 msgr2=0x7faa540fd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:01:33.594 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.594+0000 7faa596a8700 1 --2- 172.21.15.152:0/1136528593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa540fb520 0x7faa540fd940 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7faa4c009ce0 tx=0x7faa4c004d10 comp rx=0 tx=0).stop 2023-12-06T15:01:33.594 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.594+0000 7faa596a8700 1 -- 172.21.15.152:0/1136528593 shutdown_connections 2023-12-06T15:01:33.595 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.594+0000 7faa596a8700 1 --2- 172.21.15.152:0/1136528593 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa540fde80 0x7faa54100300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:33.595 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.594+0000 7faa596a8700 1 --2- 172.21.15.152:0/1136528593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa540fb520 0x7faa540fd940 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:33.595 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.594+0000 7faa596a8700 1 -- 172.21.15.152:0/1136528593 >> 172.21.15.152:0/1136528593 conn(0x7faa540f7190 msgr2=0x7faa540f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:01:33.595 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.594+0000 7faa596a8700 1 -- 172.21.15.152:0/1136528593 shutdown_connections 2023-12-06T15:01:33.595 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.594+0000 7faa596a8700 1 -- 172.21.15.152:0/1136528593 wait complete. 2023-12-06T15:01:33.595 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.595+0000 7faa596a8700 1 Processor -- start 2023-12-06T15:01:33.596 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.595+0000 7faa596a8700 1 -- start start 2023-12-06T15:01:33.596 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.595+0000 7faa596a8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa540fb520 0x7faa54109350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:01:33.596 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.595+0000 7faa596a8700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa540fde80 0x7faa54109890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:01:33.596 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.595+0000 7faa596a8700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5411d8d0 con 0x7faa540fb520 2023-12-06T15:01:33.596 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.595+0000 7faa596a8700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5411da40 con 0x7faa540fde80 2023-12-06T15:01:33.597 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.596+0000 7faa52ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa540fb520 0x7faa54109350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:01:33.597 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.596+0000 7faa52ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa540fb520 0x7faa54109350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45736/0 (socket says 172.21.15.152:45736) 2023-12-06T15:01:33.597 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.596+0000 7faa52ffd700 1 -- 172.21.15.152:0/2403374108 learned_addr learned my addr 172.21.15.152:0/2403374108 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:01:33.597 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.597+0000 7faa527fc700 1 --2- 172.21.15.152:0/2403374108 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa540fde80 0x7faa54109890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:01:33.598 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.597+0000 7faa52ffd700 1 -- 172.21.15.152:0/2403374108 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa540fde80 msgr2=0x7faa54109890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:01:33.598 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.597+0000 7faa52ffd700 1 --2- 172.21.15.152:0/2403374108 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa540fde80 0x7faa54109890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:33.598 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.597+0000 7faa52ffd700 1 -- 172.21.15.152:0/2403374108 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4c009940 con 0x7faa540fb520 2023-12-06T15:01:33.598 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.598+0000 7faa52ffd700 1 --2- 172.21.15.152:0/2403374108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa540fb520 0x7faa54109350 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7faa4c015040 tx=0x7faa4c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:01:33.598 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.598+0000 7faa3b7fe700 1 -- 172.21.15.152:0/2403374108 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa4c00e040 con 0x7faa540fb520 2023-12-06T15:01:33.598 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.598+0000 7faa3b7fe700 1 -- 172.21.15.152:0/2403374108 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faa4c004610 con 0x7faa540fb520 2023-12-06T15:01:33.598 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.598+0000 7faa3b7fe700 1 -- 172.21.15.152:0/2403374108 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa4c01c7a0 con 0x7faa540fb520 2023-12-06T15:01:33.599 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.599+0000 7faa596a8700 1 -- 172.21.15.152:0/2403374108 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa5411dbe0 con 0x7faa540fb520 2023-12-06T15:01:33.601 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.599+0000 7faa596a8700 1 -- 172.21.15.152:0/2403374108 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa5411e0f0 con 0x7faa540fb520 2023-12-06T15:01:33.601 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.600+0000 7faa596a8700 1 -- 172.21.15.152:0/2403374108 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa541032a0 con 0x7faa540fb520 2023-12-06T15:01:33.601 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.601+0000 7faa3b7fe700 1 -- 172.21.15.152:0/2403374108 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 36) v1 ==== 90984+0+0 (secure 0 0 0) 0x7faa4c012410 con 0x7faa540fb520 2023-12-06T15:01:33.601 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.601+0000 7faa3b7fe700 1 --2- 172.21.15.152:0/2403374108 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7faa3c06cfb0 0x7faa3c06f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:01:33.601 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.601+0000 7faa3b7fe700 1 -- 172.21.15.152:0/2403374108 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7faa4c08da50 con 0x7faa540fb520 2023-12-06T15:01:33.602 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.601+0000 7faa527fc700 1 --2- 172.21.15.152:0/2403374108 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7faa3c06cfb0 0x7faa3c06f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:01:33.602 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.602+0000 7faa527fc700 1 --2- 172.21.15.152:0/2403374108 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7faa3c06cfb0 0x7faa3c06f460 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faa44006fd0 tx=0x7faa44008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:01:33.607 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.607+0000 7faa3b7fe700 1 -- 172.21.15.152:0/2403374108 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7faa4c05b380 con 0x7faa540fb520 2023-12-06T15:01:33.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:33 smithi152 ceph-mon[192652]: [06/Dec/2023:15:01:31] ENGINE Serving on http://172.21.15.152:8765 2023-12-06T15:01:33.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:33 smithi152 ceph-mon[192652]: [06/Dec/2023:15:01:31] ENGINE Bus STARTED 2023-12-06T15:01:33.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:33 smithi152 ceph-mon[192652]: from='client.34128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:01:33.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:33 smithi152 ceph-mon[192652]: from='client.24537 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:01:33.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:33 smithi152 ceph-mon[192652]: pgmap v4: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-06T15:01:33.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:33 smithi152 ceph-mon[192652]: from='client.? 172.21.15.152:0/3903925237' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:01:33.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:33 smithi152 ceph-mon[192652]: from='client.? 172.21.15.152:0/1362760832' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-06T15:01:33.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:33 smithi152 ceph-mon[192652]: mgrmap e36: smithi152.meodco(active, since 3s), standbys: smithi190.ubusrr 2023-12-06T15:01:33.921 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.921+0000 7faa596a8700 1 -- 172.21.15.152:0/2403374108 --> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faa5411e590 con 0x7faa3c06cfb0 2023-12-06T15:01:33.922 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.922+0000 7faa3b7fe700 1 -- 172.21.15.152:0/2403374108 <== mgr.34104 v2:172.21.15.152:6800/2427836422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7faa5411e590 con 0x7faa3c06cfb0 2023-12-06T15:01:33.922 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-12-06T15:01:33.923 INFO:teuthology.orchestra.run.smithi152.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e331a81036b9c4be9167bdaf54e458c7294ca3446212b9c6126786d23318b1cf", 2023-12-06T15:01:33.923 INFO:teuthology.orchestra.run.smithi152.stdout: "in_progress": true, 2023-12-06T15:01:33.923 INFO:teuthology.orchestra.run.smithi152.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-06T15:01:33.923 INFO:teuthology.orchestra.run.smithi152.stdout: "services_complete": [ 2023-12-06T15:01:33.923 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr" 2023-12-06T15:01:33.923 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2023-12-06T15:01:33.923 INFO:teuthology.orchestra.run.smithi152.stdout: "progress": "2/21 daemons upgraded", 2023-12-06T15:01:33.923 INFO:teuthology.orchestra.run.smithi152.stdout: "message": "", 2023-12-06T15:01:33.923 INFO:teuthology.orchestra.run.smithi152.stdout: "is_paused": false 2023-12-06T15:01:33.923 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-12-06T15:01:33.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.924+0000 7faa596a8700 1 -- 172.21.15.152:0/2403374108 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7faa3c06cfb0 msgr2=0x7faa3c06f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:01:33.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.924+0000 7faa596a8700 1 --2- 172.21.15.152:0/2403374108 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7faa3c06cfb0 0x7faa3c06f460 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faa44006fd0 tx=0x7faa44008040 comp rx=0 tx=0).stop 2023-12-06T15:01:33.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.924+0000 7faa596a8700 1 -- 172.21.15.152:0/2403374108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa540fb520 msgr2=0x7faa54109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:01:33.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.924+0000 7faa596a8700 1 --2- 172.21.15.152:0/2403374108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa540fb520 0x7faa54109350 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7faa4c015040 tx=0x7faa4c004d10 comp rx=0 tx=0).stop 2023-12-06T15:01:33.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.924+0000 7faa596a8700 1 -- 172.21.15.152:0/2403374108 shutdown_connections 2023-12-06T15:01:33.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.924+0000 7faa596a8700 1 --2- 172.21.15.152:0/2403374108 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7faa3c06cfb0 0x7faa3c06f460 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:33.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.924+0000 7faa596a8700 1 --2- 172.21.15.152:0/2403374108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa540fb520 0x7faa54109350 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:33.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.925+0000 7faa596a8700 1 --2- 172.21.15.152:0/2403374108 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa540fde80 0x7faa54109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:33.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.925+0000 7faa596a8700 1 -- 172.21.15.152:0/2403374108 >> 172.21.15.152:0/2403374108 conn(0x7faa540f7190 msgr2=0x7faa540f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:01:33.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.925+0000 7faa596a8700 1 -- 172.21.15.152:0/2403374108 shutdown_connections 2023-12-06T15:01:33.925 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:33.925+0000 7faa596a8700 1 -- 172.21.15.152:0/2403374108 wait complete. 2023-12-06T15:01:34.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.061+0000 7fd46b99d700 1 -- 172.21.15.152:0/1019148041 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4640fdf60 msgr2=0x7fd4640fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:01:34.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.061+0000 7fd46b99d700 1 --2- 172.21.15.152:0/1019148041 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4640fdf60 0x7fd4640fe3b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd454004940 tx=0x7fd454009e30 comp rx=0 tx=0).stop 2023-12-06T15:01:34.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.061+0000 7fd46b99d700 1 -- 172.21.15.152:0/1019148041 shutdown_connections 2023-12-06T15:01:34.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.061+0000 7fd46b99d700 1 --2- 172.21.15.152:0/1019148041 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4640fdf60 0x7fd4640fe3b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:34.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.061+0000 7fd46b99d700 1 --2- 172.21.15.152:0/1019148041 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd4640faed0 0x7fd4640fb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:34.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.061+0000 7fd46b99d700 1 -- 172.21.15.152:0/1019148041 >> 172.21.15.152:0/1019148041 conn(0x7fd4640f6950 msgr2=0x7fd4640f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:01:34.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.062+0000 7fd46b99d700 1 -- 172.21.15.152:0/1019148041 shutdown_connections 2023-12-06T15:01:34.062 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.062+0000 7fd46b99d700 1 -- 172.21.15.152:0/1019148041 wait complete. 2023-12-06T15:01:34.063 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.062+0000 7fd46b99d700 1 Processor -- start 2023-12-06T15:01:34.063 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.062+0000 7fd46b99d700 1 -- start start 2023-12-06T15:01:34.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.062+0000 7fd46b99d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd4640faed0 0x7fd46410d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:01:34.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.062+0000 7fd46b99d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4640fdf60 0x7fd46410da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:01:34.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.062+0000 7fd46b99d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46410e090 con 0x7fd4640fdf60 2023-12-06T15:01:34.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.062+0000 7fd46b99d700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46410e930 con 0x7fd4640faed0 2023-12-06T15:01:34.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.062+0000 7fd468f38700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4640fdf60 0x7fd46410da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:01:34.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.062+0000 7fd468f38700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4640fdf60 0x7fd46410da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45758/0 (socket says 172.21.15.152:45758) 2023-12-06T15:01:34.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.062+0000 7fd468f38700 1 -- 172.21.15.152:0/840997734 learned_addr learned my addr 172.21.15.152:0/840997734 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:01:34.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.062+0000 7fd469739700 1 --2- 172.21.15.152:0/840997734 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd4640faed0 0x7fd46410d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:01:34.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.063+0000 7fd468f38700 1 -- 172.21.15.152:0/840997734 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd4640faed0 msgr2=0x7fd46410d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:01:34.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.063+0000 7fd468f38700 1 --2- 172.21.15.152:0/840997734 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd4640faed0 0x7fd46410d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:34.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.063+0000 7fd468f38700 1 -- 172.21.15.152:0/840997734 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd454005040 con 0x7fd4640fdf60 2023-12-06T15:01:34.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.063+0000 7fd468f38700 1 --2- 172.21.15.152:0/840997734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4640fdf60 0x7fd46410da90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd454000c00 tx=0x7fd454009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:01:34.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.063+0000 7fd459ffb700 1 -- 172.21.15.152:0/840997734 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd454021070 con 0x7fd4640fdf60 2023-12-06T15:01:34.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.063+0000 7fd459ffb700 1 -- 172.21.15.152:0/840997734 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd45401c400 con 0x7fd4640fdf60 2023-12-06T15:01:34.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.063+0000 7fd46b99d700 1 -- 172.21.15.152:0/840997734 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd46410ebb0 con 0x7fd4640fdf60 2023-12-06T15:01:34.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.063+0000 7fd459ffb700 1 -- 172.21.15.152:0/840997734 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd45400e070 con 0x7fd4640fdf60 2023-12-06T15:01:34.065 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.063+0000 7fd46b99d700 1 -- 172.21.15.152:0/840997734 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd46410f090 con 0x7fd4640fdf60 2023-12-06T15:01:34.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.064+0000 7fd46b99d700 1 -- 172.21.15.152:0/840997734 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd46404bb80 con 0x7fd4640fdf60 2023-12-06T15:01:34.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.065+0000 7fd459ffb700 1 -- 172.21.15.152:0/840997734 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 36) v1 ==== 90984+0+0 (secure 0 0 0) 0x7fd45401c9e0 con 0x7fd4640fdf60 2023-12-06T15:01:34.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.065+0000 7fd459ffb700 1 --2- 172.21.15.152:0/840997734 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fd45006cf00 0x7fd45006f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:01:34.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.065+0000 7fd459ffb700 1 -- 172.21.15.152:0/840997734 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fd45408d5f0 con 0x7fd4640fdf60 2023-12-06T15:01:34.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.066+0000 7fd469739700 1 --2- 172.21.15.152:0/840997734 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fd45006cf00 0x7fd45006f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:01:34.066 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.066+0000 7fd469739700 1 --2- 172.21.15.152:0/840997734 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fd45006cf00 0x7fd45006f3b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd460009b80 tx=0x7fd46000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:01:34.070 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.070+0000 7fd459ffb700 1 -- 172.21.15.152:0/840997734 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fd45405aea0 con 0x7fd4640fdf60 2023-12-06T15:01:34.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:33 smithi190 ceph-mon[121340]: [06/Dec/2023:15:01:31] ENGINE Serving on http://172.21.15.152:8765 2023-12-06T15:01:34.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:33 smithi190 ceph-mon[121340]: [06/Dec/2023:15:01:31] ENGINE Bus STARTED 2023-12-06T15:01:34.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:33 smithi190 ceph-mon[121340]: from='client.34128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:01:34.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:33 smithi190 ceph-mon[121340]: from='client.24537 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:01:34.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:33 smithi190 ceph-mon[121340]: pgmap v4: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-06T15:01:34.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:33 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/3903925237' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:01:34.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:33 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/1362760832' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-06T15:01:34.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:33 smithi190 ceph-mon[121340]: mgrmap e36: smithi152.meodco(active, since 3s), standbys: smithi190.ubusrr 2023-12-06T15:01:34.551 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.551+0000 7fd46b99d700 1 -- 172.21.15.152:0/840997734 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd4641055b0 con 0x7fd4640fdf60 2023-12-06T15:01:34.552 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.552+0000 7fd459ffb700 1 -- 172.21.15.152:0/840997734 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fd45405aa30 con 0x7fd4640fdf60 2023-12-06T15:01:34.552 INFO:teuthology.orchestra.run.smithi152.stdout:HEALTH_OK 2023-12-06T15:01:34.555 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.555+0000 7fd46b99d700 1 -- 172.21.15.152:0/840997734 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fd45006cf00 msgr2=0x7fd45006f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:01:34.555 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.555+0000 7fd46b99d700 1 --2- 172.21.15.152:0/840997734 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fd45006cf00 0x7fd45006f3b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd460009b80 tx=0x7fd46000b040 comp rx=0 tx=0).stop 2023-12-06T15:01:34.555 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.555+0000 7fd46b99d700 1 -- 172.21.15.152:0/840997734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4640fdf60 msgr2=0x7fd46410da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:01:34.555 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.555+0000 7fd46b99d700 1 --2- 172.21.15.152:0/840997734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4640fdf60 0x7fd46410da90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd454000c00 tx=0x7fd454009e30 comp rx=0 tx=0).stop 2023-12-06T15:01:34.556 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.555+0000 7fd46b99d700 1 -- 172.21.15.152:0/840997734 shutdown_connections 2023-12-06T15:01:34.556 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.555+0000 7fd46b99d700 1 --2- 172.21.15.152:0/840997734 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fd45006cf00 0x7fd45006f3b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:34.556 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.555+0000 7fd46b99d700 1 --2- 172.21.15.152:0/840997734 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd4640faed0 0x7fd46410d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:34.556 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.555+0000 7fd46b99d700 1 --2- 172.21.15.152:0/840997734 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4640fdf60 0x7fd46410da90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:01:34.556 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.555+0000 7fd46b99d700 1 -- 172.21.15.152:0/840997734 >> 172.21.15.152:0/840997734 conn(0x7fd4640f6950 msgr2=0x7fd464101190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:01:34.556 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.555+0000 7fd46b99d700 1 -- 172.21.15.152:0/840997734 shutdown_connections 2023-12-06T15:01:34.556 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:01:34.555+0000 7fd46b99d700 1 -- 172.21.15.152:0/840997734 wait complete. 2023-12-06T15:01:35.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:35 smithi152 ceph-mon[192652]: from='client.34148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:01:35.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:35 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:35.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:35 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:35.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:35 smithi152 ceph-mon[192652]: from='client.? 172.21.15.152:0/840997734' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-06T15:01:35.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:35 smithi152 ceph-mon[192652]: pgmap v5: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-06T15:01:35.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:35 smithi190 ceph-mon[121340]: from='client.34148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:01:35.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:35 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:35.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:35 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:35.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:35 smithi190 ceph-mon[121340]: from='client.? 172.21.15.152:0/840997734' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-06T15:01:35.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:35 smithi190 ceph-mon[121340]: pgmap v5: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-06T15:01:36.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:36 smithi190 ceph-mon[121340]: mgrmap e37: smithi152.meodco(active, since 4s), standbys: smithi190.ubusrr 2023-12-06T15:01:36.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:36 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:36.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:36 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:36.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:36 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:36.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:36 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:36.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:36 smithi152 ceph-mon[192652]: mgrmap e37: smithi152.meodco(active, since 4s), standbys: smithi190.ubusrr 2023-12-06T15:01:36.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:36 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:36.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:36 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:36.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:36 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:36.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:36 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:37.595 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2023-12-06T15:01:37.595 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2023-12-06T15:01:37.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:37 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:37.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:37 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:37.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:37 smithi190 ceph-mon[121340]: pgmap v6: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-06T15:01:37.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:37 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:37.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:37 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:37.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:37 smithi152 ceph-mon[192652]: pgmap v6: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2023-12-06T15:01:37.963 DEBUG:teuthology.parallel:result is None 2023-12-06T15:01:39.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:39 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:39.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:39 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:39.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:39 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:01:39.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:39 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T15:01:39.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:39 smithi190 ceph-mon[121340]: Updating smithi152:/etc/ceph/ceph.conf 2023-12-06T15:01:39.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:39 smithi190 ceph-mon[121340]: Updating smithi190:/etc/ceph/ceph.conf 2023-12-06T15:01:39.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:39 smithi190 ceph-mon[121340]: pgmap v7: 65 pgs: 65 active+clean; 296 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 400 op/s 2023-12-06T15:01:39.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:39 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:39.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:39 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:39.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:39 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:01:39.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:39 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T15:01:39.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:39 smithi152 ceph-mon[192652]: Updating smithi152:/etc/ceph/ceph.conf 2023-12-06T15:01:39.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:39 smithi152 ceph-mon[192652]: Updating smithi190:/etc/ceph/ceph.conf 2023-12-06T15:01:39.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:39 smithi152 ceph-mon[192652]: pgmap v7: 65 pgs: 65 active+clean; 296 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 400 op/s 2023-12-06T15:01:40.752 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:40 smithi190 ceph-mon[121340]: Updating smithi152:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-06T15:01:40.752 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:40 smithi190 ceph-mon[121340]: Updating smithi190:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-06T15:01:40.752 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:40 smithi190 ceph-mon[121340]: Updating smithi190:/etc/ceph/ceph.client.admin.keyring 2023-12-06T15:01:40.752 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:40 smithi190 ceph-mon[121340]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2023-12-06T15:01:40.752 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:40 smithi190 ceph-mon[121340]: Updating smithi190:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-06T15:01:40.752 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:40 smithi190 ceph-mon[121340]: Updating smithi152:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-06T15:01:40.752 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:40 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:40.753 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:40 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:40.753 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:40 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:40.753 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:40 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:40.753 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:40 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:40.753 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:40 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:01:40.753 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:40 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:01:40.753 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:40 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-06T15:01:40.817 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:40 smithi152 ceph-mon[192652]: Updating smithi152:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-06T15:01:40.817 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:40 smithi152 ceph-mon[192652]: Updating smithi190:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-06T15:01:40.817 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:40 smithi152 ceph-mon[192652]: Updating smithi190:/etc/ceph/ceph.client.admin.keyring 2023-12-06T15:01:40.817 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:40 smithi152 ceph-mon[192652]: Updating smithi152:/etc/ceph/ceph.client.admin.keyring 2023-12-06T15:01:40.818 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:40 smithi152 ceph-mon[192652]: Updating smithi190:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-06T15:01:40.818 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:40 smithi152 ceph-mon[192652]: Updating smithi152:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-06T15:01:40.818 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:40 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:40.818 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:40 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:40.818 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:40 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:40.818 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:40 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:40.818 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:40 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:40.818 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:40 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:01:40.818 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:40 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:01:40.818 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:40 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "quorum_status"}]: dispatch 2023-12-06T15:01:40.819 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2023-12-06T15:01:40.820 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-06T15:01:41.130 DEBUG:teuthology.parallel:result is None 2023-12-06T15:01:41.131 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-12-06T15:01:41.219 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-12-06T15:01:41.220 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2023-12-06T15:01:41.257 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2023-12-06T15:01:41.257 DEBUG:teuthology.parallel:result is None 2023-12-06T15:01:41.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:41 smithi190 ceph-mon[121340]: pgmap v8: 65 pgs: 65 active+clean; 296 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 311 op/s 2023-12-06T15:01:41.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:41 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:41.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:41 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-06T15:01:41.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:41 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-06T15:01:41.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:41 smithi190 ceph-mon[121340]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:01:41.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:41 smithi152 ceph-mon[192652]: pgmap v8: 65 pgs: 65 active+clean; 296 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 311 op/s 2023-12-06T15:01:41.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:41 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:41.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:41 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-06T15:01:41.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:41 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-06T15:01:41.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:41 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:01:42.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:41 smithi190 systemd[1]: Stopping Ceph mon.smithi190 for 062f0e3c-9447-11ee-95a2-87774f69a715... 2023-12-06T15:01:42.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:42 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-mon-smithi190[121316]: 2023-12-06T15:01:42.077+0000 7f46b87ee700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi190 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-06T15:01:42.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:42 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-mon-smithi190[121316]: 2023-12-06T15:01:42.077+0000 7f46b87ee700 -1 mon.smithi190@1(peon) e2 *** Got Signal Terminated *** 2023-12-06T15:01:42.797 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:42 smithi190 bash[178211]: ceph-062f0e3c-9447-11ee-95a2-87774f69a715-mon-smithi190 2023-12-06T15:01:43.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:42 smithi190 systemd[1]: ceph-062f0e3c-9447-11ee-95a2-87774f69a715@mon.smithi190.service: Succeeded. 2023-12-06T15:01:43.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:42 smithi190 systemd[1]: Stopped Ceph mon.smithi190 for 062f0e3c-9447-11ee-95a2-87774f69a715. 2023-12-06T15:01:43.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:42 smithi190 systemd[1]: Starting Ceph mon.smithi190 for 062f0e3c-9447-11ee-95a2-87774f69a715... 2023-12-06T15:01:43.978 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: set uid:gid to 167:167 (ceph:ceph) 2023-12-06T15:01:43.978 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev), process ceph-mon, pid 7 2023-12-06T15:01:43.978 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: pidfile_write: ignore empty --pid-file 2023-12-06T15:01:43.978 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: load: jerasure load: lrc 2023-12-06T15:01:43.978 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: RocksDB version: 7.9.2 2023-12-06T15:01:43.978 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Git sha 0 2023-12-06T15:01:43.978 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Compile date 2023-12-06 02:25:46 2023-12-06T15:01:43.978 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: DB SUMMARY 2023-12-06T15:01:43.978 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: DB Session ID: 3RV5MNYETELVDI5E8A5O 2023-12-06T15:01:43.978 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: CURRENT file: CURRENT 2023-12-06T15:01:43.979 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: IDENTITY file: IDENTITY 2023-12-06T15:01:43.979 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: MANIFEST file: MANIFEST-000009 size: 707 Bytes 2023-12-06T15:01:43.979 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi190/store.db dir, Total Num: 1, files: 000021.sst 2023-12-06T15:01:43.979 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi190/store.db: 000019.log size: 5386606 ; 2023-12-06T15:01:43.979 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.error_if_exists: 0 2023-12-06T15:01:43.979 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.create_if_missing: 0 2023-12-06T15:01:43.979 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.paranoid_checks: 1 2023-12-06T15:01:43.979 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-06T15:01:43.979 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-06T15:01:43.979 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-06T15:01:43.979 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.env: 0x55ffc7940a60 2023-12-06T15:01:43.979 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.fs: PosixFileSystem 2023-12-06T15:01:43.979 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.info_log: 0x55ffc9ddd600 2023-12-06T15:01:43.979 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.max_file_opening_threads: 16 2023-12-06T15:01:43.979 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.statistics: (nil) 2023-12-06T15:01:43.980 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.use_fsync: 0 2023-12-06T15:01:43.980 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.max_log_file_size: 0 2023-12-06T15:01:43.980 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-06T15:01:43.980 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-06T15:01:43.980 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.keep_log_file_num: 1000 2023-12-06T15:01:43.980 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.recycle_log_file_num: 0 2023-12-06T15:01:43.980 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.allow_fallocate: 1 2023-12-06T15:01:43.980 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.allow_mmap_reads: 0 2023-12-06T15:01:43.980 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.allow_mmap_writes: 0 2023-12-06T15:01:43.980 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.use_direct_reads: 0 2023-12-06T15:01:43.980 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-06T15:01:43.980 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.create_missing_column_families: 0 2023-12-06T15:01:43.980 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.db_log_dir: 2023-12-06T15:01:43.980 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.wal_dir: 2023-12-06T15:01:43.980 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-06T15:01:43.981 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-06T15:01:43.981 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-06T15:01:43.981 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-06T15:01:43.981 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-06T15:01:43.981 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-06T15:01:43.981 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.advise_random_on_open: 1 2023-12-06T15:01:43.981 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.db_write_buffer_size: 0 2023-12-06T15:01:43.981 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.write_buffer_manager: 0x55ffc9d93360 2023-12-06T15:01:43.981 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-06T15:01:43.981 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-06T15:01:43.981 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-06T15:01:43.981 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.rate_limiter: (nil) 2023-12-06T15:01:43.981 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-06T15:01:43.981 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.wal_recovery_mode: 2 2023-12-06T15:01:43.981 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.enable_thread_tracking: 0 2023-12-06T15:01:43.982 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.enable_pipelined_write: 0 2023-12-06T15:01:43.982 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.unordered_write: 0 2023-12-06T15:01:43.982 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-06T15:01:43.982 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-06T15:01:43.982 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-06T15:01:43.982 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-06T15:01:43.982 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.row_cache: None 2023-12-06T15:01:43.982 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.wal_filter: None 2023-12-06T15:01:43.982 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-06T15:01:43.982 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.allow_ingest_behind: 0 2023-12-06T15:01:43.982 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.two_write_queues: 0 2023-12-06T15:01:43.982 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.manual_wal_flush: 0 2023-12-06T15:01:43.982 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.wal_compression: 0 2023-12-06T15:01:43.982 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.atomic_flush: 0 2023-12-06T15:01:43.983 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-06T15:01:43.983 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-06T15:01:43.983 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-06T15:01:43.983 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.log_readahead_size: 0 2023-12-06T15:01:43.983 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-06T15:01:43.983 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.best_efforts_recovery: 0 2023-12-06T15:01:43.983 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-06T15:01:43.983 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-06T15:01:43.983 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.allow_data_in_errors: 0 2023-12-06T15:01:43.984 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.db_host_id: __hostname__ 2023-12-06T15:01:43.984 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-06T15:01:43.984 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.max_background_jobs: 2 2023-12-06T15:01:43.984 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.max_background_compactions: -1 2023-12-06T15:01:43.984 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.max_subcompactions: 1 2023-12-06T15:01:43.984 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-06T15:01:43.985 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-06T15:01:43.985 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-06T15:01:43.985 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.max_total_wal_size: 0 2023-12-06T15:01:43.985 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-06T15:01:43.985 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-06T15:01:43.985 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-06T15:01:43.985 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-06T15:01:43.986 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.max_open_files: -1 2023-12-06T15:01:43.986 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.bytes_per_sync: 0 2023-12-06T15:01:43.986 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-06T15:01:43.986 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-06T15:01:43.986 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.compaction_readahead_size: 0 2023-12-06T15:01:43.986 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.max_background_flushes: -1 2023-12-06T15:01:43.986 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Compression algorithms supported: 2023-12-06T15:01:43.987 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-06T15:01:43.987 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: kZSTD supported: 0 2023-12-06T15:01:43.987 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: kXpressCompression supported: 0 2023-12-06T15:01:43.987 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: kLZ4HCCompression supported: 1 2023-12-06T15:01:43.987 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: kZlibCompression supported: 1 2023-12-06T15:01:43.987 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: kSnappyCompression supported: 1 2023-12-06T15:01:43.987 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: kLZ4Compression supported: 1 2023-12-06T15:01:43.987 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: kBZip2Compression supported: 0 2023-12-06T15:01:43.988 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-06T15:01:43.988 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-06T15:01:43.988 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi190/store.db/MANIFEST-000009 2023-12-06T15:01:43.988 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-06T15:01:43.988 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-06T15:01:43.988 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.merge_operator: 2023-12-06T15:01:43.988 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.compaction_filter: None 2023-12-06T15:01:43.989 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.compaction_filter_factory: None 2023-12-06T15:01:43.989 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.sst_partitioner_factory: None 2023-12-06T15:01:43.989 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-06T15:01:43.989 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-06T15:01:43.989 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ffc9ddd700) 2023-12-06T15:01:43.989 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: cache_index_and_filter_blocks: 1 2023-12-06T15:01:43.990 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-06T15:01:43.990 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-06T15:01:43.990 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: pin_top_level_index_and_filter: 1 2023-12-06T15:01:43.990 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: index_type: 0 2023-12-06T15:01:43.990 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: data_block_index_type: 0 2023-12-06T15:01:43.990 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: index_shortening: 1 2023-12-06T15:01:43.990 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-06T15:01:43.990 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: checksum: 4 2023-12-06T15:01:43.991 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: no_block_cache: 0 2023-12-06T15:01:43.991 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: block_cache: 0x55ffc9e33090 2023-12-06T15:01:43.991 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: block_cache_name: BinnedLRUCache 2023-12-06T15:01:43.991 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: block_cache_options: 2023-12-06T15:01:43.991 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: capacity : 536870912 2023-12-06T15:01:43.991 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: num_shard_bits : 4 2023-12-06T15:01:43.991 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: strict_capacity_limit : 0 2023-12-06T15:01:43.991 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: high_pri_pool_ratio: 0.000 2023-12-06T15:01:43.991 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: block_cache_compressed: (nil) 2023-12-06T15:01:43.991 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: persistent_cache: (nil) 2023-12-06T15:01:43.991 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: block_size: 4096 2023-12-06T15:01:43.992 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: block_size_deviation: 10 2023-12-06T15:01:43.992 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: block_restart_interval: 16 2023-12-06T15:01:43.992 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: index_block_restart_interval: 1 2023-12-06T15:01:43.992 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: metadata_block_size: 4096 2023-12-06T15:01:43.992 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: partition_filters: 0 2023-12-06T15:01:43.992 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: use_delta_encoding: 1 2023-12-06T15:01:43.992 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: filter_policy: bloomfilter 2023-12-06T15:01:43.992 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: whole_key_filtering: 1 2023-12-06T15:01:43.992 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: verify_compression: 0 2023-12-06T15:01:43.992 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: read_amp_bytes_per_bit: 0 2023-12-06T15:01:43.992 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: format_version: 5 2023-12-06T15:01:43.992 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: enable_index_compression: 1 2023-12-06T15:01:43.992 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: block_align: 0 2023-12-06T15:01:43.992 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: max_auto_readahead_size: 262144 2023-12-06T15:01:43.993 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: prepopulate_block_cache: 0 2023-12-06T15:01:43.993 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: initial_auto_readahead_size: 8192 2023-12-06T15:01:43.993 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: num_file_reads_for_auto_readahead: 2 2023-12-06T15:01:43.993 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.write_buffer_size: 33554432 2023-12-06T15:01:43.993 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.max_write_buffer_number: 2 2023-12-06T15:01:43.993 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.compression: NoCompression 2023-12-06T15:01:43.993 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.bottommost_compression: Disabled 2023-12-06T15:01:43.993 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.prefix_extractor: nullptr 2023-12-06T15:01:43.993 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-06T15:01:43.993 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.num_levels: 7 2023-12-06T15:01:43.993 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-06T15:01:43.993 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-06T15:01:43.993 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-06T15:01:43.993 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-06T15:01:43.994 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-06T15:01:43.994 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-06T15:01:43.994 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-06T15:01:43.994 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-06T15:01:43.994 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-06T15:01:43.994 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-06T15:01:43.994 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-06T15:01:43.994 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-06T15:01:43.994 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-06T15:01:43.994 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.compression_opts.level: 32767 2023-12-06T15:01:43.994 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.compression_opts.strategy: 0 2023-12-06T15:01:43.994 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-06T15:01:43.994 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-06T15:01:43.995 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-06T15:01:43.995 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-06T15:01:43.995 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.compression_opts.enabled: false 2023-12-06T15:01:43.995 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-06T15:01:43.995 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-06T15:01:43.995 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-06T15:01:43.995 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-06T15:01:43.995 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.target_file_size_base: 67108864 2023-12-06T15:01:43.995 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-06T15:01:43.995 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-06T15:01:43.995 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-06T15:01:43.995 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-06T15:01:43.995 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-06T15:01:43.995 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-06T15:01:43.995 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-06T15:01:43.995 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-06T15:01:43.996 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-06T15:01:43.996 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-06T15:01:43.996 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-06T15:01:43.996 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-06T15:01:43.996 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-06T15:01:43.996 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-06T15:01:43.996 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.arena_block_size: 1048576 2023-12-06T15:01:43.996 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-06T15:01:43.996 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-06T15:01:43.996 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.disable_auto_compactions: 0 2023-12-06T15:01:43.996 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-06T15:01:43.996 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-06T15:01:43.996 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-06T15:01:43.996 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-06T15:01:43.996 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-06T15:01:43.996 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-06T15:01:43.997 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-06T15:01:43.997 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-06T15:01:43.997 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-06T15:01:43.997 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-06T15:01:43.997 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.table_properties_collectors: 2023-12-06T15:01:43.997 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.inplace_update_support: 0 2023-12-06T15:01:43.997 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-06T15:01:43.997 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-06T15:01:43.997 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-06T15:01:43.997 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-06T15:01:43.997 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.bloom_locality: 0 2023-12-06T15:01:43.997 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.max_successive_merges: 0 2023-12-06T15:01:43.998 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-06T15:01:43.998 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.paranoid_file_checks: 0 2023-12-06T15:01:43.998 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.force_consistency_checks: 1 2023-12-06T15:01:43.998 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.report_bg_io_stats: 0 2023-12-06T15:01:43.998 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.ttl: 2592000 2023-12-06T15:01:43.998 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-06T15:01:43.998 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-06T15:01:43.998 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-06T15:01:43.998 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.enable_blob_files: false 2023-12-06T15:01:43.998 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.min_blob_size: 0 2023-12-06T15:01:43.998 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.blob_file_size: 268435456 2023-12-06T15:01:43.998 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-06T15:01:43.998 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-06T15:01:43.999 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-06T15:01:43.999 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-06T15:01:43.999 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-06T15:01:43.999 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.blob_file_starting_level: 0 2023-12-06T15:01:43.999 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-06T15:01:43.999 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 21.sst 2023-12-06T15:01:43.999 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-06T15:01:44.000 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi190/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 23, last_sequence is 9673, log_number is 19,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-06T15:01:44.000 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 19 2023-12-06T15:01:44.000 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: d427bb1b-f860-414a-a9b7-a2024b47eed6 2023-12-06T15:01:44.000 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701874903695118, "job": 1, "event": "recovery_started", "wal_files": [19]} 2023-12-06T15:01:44.000 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #19 mode 2 2023-12-06T15:01:44.000 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701874903706221, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 24, "file_size": 3247585, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 9678, "largest_seqno": 10968, "table_properties": {"data_size": 3241654, "index_size": 3504, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1413, "raw_key_size": 13031, "raw_average_key_size": 23, "raw_value_size": 3230004, "raw_average_value_size": 5904, "num_data_blocks": 160, "num_entries": 547, "num_filter_entries": 547, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1701874903, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d427bb1b-f860-414a-a9b7-a2024b47eed6", "db_session_id": "3RV5MNYETELVDI5E8A5O", "orig_file_number": 24, "seqno_to_time_mapping": "N/A"}} 2023-12-06T15:01:44.000 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701874903706343, "job": 1, "event": "recovery_finished"} 2023-12-06T15:01:44.000 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: [db/version_set.cc:5047] Creating manifest 26 2023-12-06T15:01:44.000 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2023-12-06T15:01:44.001 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi190/store.db/000019.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-06T15:01:44.001 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55ffc9ece000 2023-12-06T15:01:44.001 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: DB pointer 0x55ffc9eba000 2023-12-06T15:01:44.001 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-06T15:01:44.001 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-06T15:01:44.001 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: ** DB Stats ** 2023-12-06T15:01:44.001 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-06T15:01:44.001 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-06T15:01:44.001 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-06T15:01:44.001 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-06T15:01:44.001 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-06T15:01:44.001 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-06T15:01:44.001 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-06T15:01:44.001 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: 2023-12-06T15:01:44.002 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: ** Compaction Stats [default] ** 2023-12-06T15:01:44.002 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-06T15:01:44.002 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-06T15:01:44.002 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: L0 1/0 3.10 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 715.3 0.00 0.00 1 0.004 0 0 0.0 0.0 2023-12-06T15:01:44.002 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: L6 1/0 5.35 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2023-12-06T15:01:44.002 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: Sum 2/0 8.45 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 715.3 0.00 0.00 1 0.004 0 0 0.0 0.0 2023-12-06T15:01:44.002 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 715.3 0.00 0.00 1 0.004 0 0 0.0 0.0 2023-12-06T15:01:44.002 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: 2023-12-06T15:01:44.002 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: ** Compaction Stats [default] ** 2023-12-06T15:01:44.002 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-06T15:01:44.002 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-06T15:01:44.002 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 715.3 0.00 0.00 1 0.004 0 0 0.0 0.0 2023-12-06T15:01:44.002 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: 2023-12-06T15:01:44.003 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-06T15:01:44.003 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: 2023-12-06T15:01:44.003 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-06T15:01:44.003 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: Flush(GB): cumulative 0.003, interval 0.003 2023-12-06T15:01:44.003 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-06T15:01:44.003 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-06T15:01:44.003 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-06T15:01:44.003 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-06T15:01:44.003 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: Cumulative compaction: 0.00 GB write, 170.50 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-06T15:01:44.003 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: Interval compaction: 0.00 GB write, 170.50 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-06T15:01:44.003 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-06T15:01:44.003 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: Block cache BinnedLRUCache@0x55ffc9e33090#7 capacity: 512.00 MB usage: 5.61 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2023-12-06T15:01:44.003 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.53 KB,0.000292063%) IndexBlock(1,4.08 KB,0.000777841%) Misc(1,0.00 KB,0%) 2023-12-06T15:01:44.003 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: 2023-12-06T15:01:44.004 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-06T15:01:44.004 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: starting mon.smithi190 rank 1 at public addrs [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] at bind addrs [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi190 fsid 062f0e3c-9447-11ee-95a2-87774f69a715 2023-12-06T15:01:44.004 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: mon.smithi190@-1(???) e2 preinit fsid 062f0e3c-9447-11ee-95a2-87774f69a715 2023-12-06T15:01:44.004 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: mon.smithi190@-1(???).mds e15 new map 2023-12-06T15:01:44.004 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: mon.smithi190@-1(???).mds e15 print_map 2023-12-06T15:01:44.004 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: e15 2023-12-06T15:01:44.004 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-06T15:01:44.004 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-06T15:01:44.004 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: legacy client fscid: 1 2023-12-06T15:01:44.004 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: 2023-12-06T15:01:44.004 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: Filesystem 'cephfs' (1) 2023-12-06T15:01:44.004 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: fs_name cephfs 2023-12-06T15:01:44.004 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: epoch 15 2023-12-06T15:01:44.004 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-06T15:01:44.004 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: created 2023-12-06T14:57:59.352201+0000 2023-12-06T15:01:44.005 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: modified 2023-12-06T14:59:52.365348+0000 2023-12-06T15:01:44.005 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: tableserver 0 2023-12-06T15:01:44.005 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: root 0 2023-12-06T15:01:44.005 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: session_timeout 60 2023-12-06T15:01:44.005 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: session_autoclose 300 2023-12-06T15:01:44.005 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: max_file_size 1099511627776 2023-12-06T15:01:44.005 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: max_xattr_size 65536 2023-12-06T15:01:44.005 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: required_client_features {} 2023-12-06T15:01:44.005 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: last_failure 0 2023-12-06T15:01:44.005 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: last_failure_osd_epoch 0 2023-12-06T15:01:44.005 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-06T15:01:44.005 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: max_mds 2 2023-12-06T15:01:44.005 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: in 0,1 2023-12-06T15:01:44.005 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: up {0=14464,1=24255} 2023-12-06T15:01:44.005 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: failed 2023-12-06T15:01:44.005 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: damaged 2023-12-06T15:01:44.006 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: stopped 2023-12-06T15:01:44.006 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: data_pools [3] 2023-12-06T15:01:44.006 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: metadata_pool 2 2023-12-06T15:01:44.006 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: inline_data disabled 2023-12-06T15:01:44.006 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: balancer 2023-12-06T15:01:44.006 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: bal_rank_mask -1 2023-12-06T15:01:44.006 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: standby_count_wanted 1 2023-12-06T15:01:44.006 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: [mds.cephfs.smithi152.acqswy{0:14464} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.152:6826/2467413186,v1:172.21.15.152:6827/2467413186] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:01:44.006 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: [mds.cephfs.smithi190.edwtqj{0:24271} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.190:6826/2256465065,v1:172.21.15.190:6827/2256465065] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:01:44.006 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: [mds.cephfs.smithi190.uucxzu{1:24255} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.190:6824/3250692478,v1:172.21.15.190:6825/3250692478] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:01:44.006 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: [mds.cephfs.smithi152.ypivwc{1:14480} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.152:6828/697313573,v1:172.21.15.152:6829/697313573] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:01:44.006 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: 2023-12-06T15:01:44.006 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout: 2023-12-06T15:01:44.007 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: mon.smithi190@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2023-12-06T15:01:44.007 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: mon.smithi190@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2023-12-06T15:01:44.007 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: mon.smithi190@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2023-12-06T15:01:44.007 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: mon.smithi190@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2023-12-06T15:01:44.007 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: mon.smithi190@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2023-12-06T15:01:44.007 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 bash[178361]: b25040d5fdfeecf00c38b3fc601f9b61142200b4809ff3cf8e68e4e871d11e66 2023-12-06T15:01:44.007 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 systemd[1]: Started Ceph mon.smithi190 for 062f0e3c-9447-11ee-95a2-87774f69a715. 2023-12-06T15:01:44.007 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: Upgrade: Updating mon.smithi190 2023-12-06T15:01:44.007 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:43 smithi190 ceph-mon[178398]: Deploying daemon mon.smithi190 on smithi190 2023-12-06T15:01:44.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:43 smithi152 ceph-mon[192652]: Upgrade: Updating mon.smithi190 2023-12-06T15:01:44.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:43 smithi152 ceph-mon[192652]: Deploying daemon mon.smithi190 on smithi190 2023-12-06T15:01:45.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:44 smithi190 ceph-mon[178398]: overall HEALTH_OK 2023-12-06T15:01:45.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:44 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-06T15:01:45.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:44 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi190"}]: dispatch 2023-12-06T15:01:45.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:44 smithi190 ceph-mon[178398]: mon.smithi152 calling monitor election 2023-12-06T15:01:45.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:44 smithi190 ceph-mon[178398]: mon.smithi190 calling monitor election 2023-12-06T15:01:45.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:44 smithi190 ceph-mon[178398]: mon.smithi152 is new leader, mons smithi152,smithi190 in quorum (ranks 0,1) 2023-12-06T15:01:45.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:44 smithi190 ceph-mon[178398]: monmap e3: 2 mons at {smithi152=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0],smithi190=[v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-06T15:01:45.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:44 smithi190 ceph-mon[178398]: fsmap cephfs:2 {0=cephfs.smithi152.acqswy=up:active,1=cephfs.smithi190.uucxzu=up:active} 2 up:standby-replay 2023-12-06T15:01:45.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:44 smithi190 ceph-mon[178398]: osdmap e48: 6 total, 6 up, 6 in 2023-12-06T15:01:45.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:44 smithi190 ceph-mon[178398]: mgrmap e37: smithi152.meodco(active, since 13s), standbys: smithi190.ubusrr 2023-12-06T15:01:45.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:44 smithi190 ceph-mon[178398]: overall HEALTH_OK 2023-12-06T15:01:45.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:44 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:45.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:44 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:45.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:44 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:01:45.324 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:44 smithi190 ceph-mon[178398]: pgmap v10: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 409 op/s 2023-12-06T15:01:45.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:44 smithi152 ceph-mon[192652]: overall HEALTH_OK 2023-12-06T15:01:45.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:44 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi152"}]: dispatch 2023-12-06T15:01:45.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:44 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mon metadata", "id": "smithi190"}]: dispatch 2023-12-06T15:01:45.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:44 smithi152 ceph-mon[192652]: mon.smithi152 calling monitor election 2023-12-06T15:01:45.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:44 smithi152 ceph-mon[192652]: mon.smithi190 calling monitor election 2023-12-06T15:01:45.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:44 smithi152 ceph-mon[192652]: mon.smithi152 is new leader, mons smithi152,smithi190 in quorum (ranks 0,1) 2023-12-06T15:01:45.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:44 smithi152 ceph-mon[192652]: monmap e3: 2 mons at {smithi152=[v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0],smithi190=[v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-06T15:01:45.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:44 smithi152 ceph-mon[192652]: fsmap cephfs:2 {0=cephfs.smithi152.acqswy=up:active,1=cephfs.smithi190.uucxzu=up:active} 2 up:standby-replay 2023-12-06T15:01:45.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:44 smithi152 ceph-mon[192652]: osdmap e48: 6 total, 6 up, 6 in 2023-12-06T15:01:45.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:44 smithi152 ceph-mon[192652]: mgrmap e37: smithi152.meodco(active, since 13s), standbys: smithi190.ubusrr 2023-12-06T15:01:45.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:44 smithi152 ceph-mon[192652]: overall HEALTH_OK 2023-12-06T15:01:45.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:44 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:45.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:44 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:45.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:44 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:01:45.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:44 smithi152 ceph-mon[192652]: pgmap v10: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 409 op/s 2023-12-06T15:01:46.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:46 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:01:46.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:46 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:46.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:46 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:46.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:46 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:01:46.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:46 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:46.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:46 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:47.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:47 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:47.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:47 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:47.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:47 smithi190 ceph-mon[178398]: pgmap v11: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 409 op/s 2023-12-06T15:01:47.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:47 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:47.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:47 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:47.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:47 smithi152 ceph-mon[192652]: pgmap v11: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 409 op/s 2023-12-06T15:01:49.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:49 smithi190 ceph-mon[178398]: fsmap cephfs:2 {0=cephfs.smithi152.acqswy=up:active,1=cephfs.smithi190.uucxzu=up:active} 2 up:standby-replay 2023-12-06T15:01:49.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:49 smithi190 ceph-mon[178398]: pgmap v12: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 418 op/s 2023-12-06T15:01:49.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:49 smithi152 ceph-mon[192652]: fsmap cephfs:2 {0=cephfs.smithi152.acqswy=up:active,1=cephfs.smithi190.uucxzu=up:active} 2 up:standby-replay 2023-12-06T15:01:49.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:49 smithi152 ceph-mon[192652]: pgmap v12: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 418 op/s 2023-12-06T15:01:51.898 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:51 smithi152 ceph-mon[192652]: pgmap v13: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 764 KiB/s rd, 683 KiB/s wr, 185 op/s 2023-12-06T15:01:51.898 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:51 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:51.899 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:51 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:51.899 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:51 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:01:51.899 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:51 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T15:01:51.899 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:51 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:51.899 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:51 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-06T15:01:51.899 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:51 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-06T15:01:51.899 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:51 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:01:52.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:51 smithi190 ceph-mon[178398]: pgmap v13: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 764 KiB/s rd, 683 KiB/s wr, 185 op/s 2023-12-06T15:01:52.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:51 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:52.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:51 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:52.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:51 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:01:52.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:51 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T15:01:52.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:51 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:52.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:51 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-06T15:01:52.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:51 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-06T15:01:52.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:51 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:01:52.964 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:52 smithi152 ceph-mon[192652]: Reconfiguring mon.smithi152 (monmap changed)... 2023-12-06T15:01:52.964 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:52 smithi152 ceph-mon[192652]: Reconfiguring daemon mon.smithi152 on smithi152 2023-12-06T15:01:52.964 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:52 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:52.964 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:52 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:52.964 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:52 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.meodco", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-06T15:01:52.964 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:52 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-06T15:01:52.965 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:52 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:01:53.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:52 smithi190 ceph-mon[178398]: Reconfiguring mon.smithi152 (monmap changed)... 2023-12-06T15:01:53.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:52 smithi190 ceph-mon[178398]: Reconfiguring daemon mon.smithi152 on smithi152 2023-12-06T15:01:53.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:52 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:53.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:52 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:53.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:52 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi152.meodco", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-06T15:01:53.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:52 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-06T15:01:53.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:52 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:01:53.979 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:53 smithi152 ceph-mon[192652]: Reconfiguring mgr.smithi152.meodco (monmap changed)... 2023-12-06T15:01:53.979 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:53 smithi152 ceph-mon[192652]: Reconfiguring daemon mgr.smithi152.meodco on smithi152 2023-12-06T15:01:53.979 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:53 smithi152 ceph-mon[192652]: pgmap v14: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 766 KiB/s rd, 684 KiB/s wr, 187 op/s 2023-12-06T15:01:54.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:53 smithi190 ceph-mon[178398]: Reconfiguring mgr.smithi152.meodco (monmap changed)... 2023-12-06T15:01:54.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:53 smithi190 ceph-mon[178398]: Reconfiguring daemon mgr.smithi152.meodco on smithi152 2023-12-06T15:01:54.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:53 smithi190 ceph-mon[178398]: pgmap v14: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 766 KiB/s rd, 684 KiB/s wr, 187 op/s 2023-12-06T15:01:55.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:55 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:55.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:55 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:55.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:55 smithi152 ceph-mon[192652]: Reconfiguring crash.smithi152 (monmap changed)... 2023-12-06T15:01:55.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:55 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-06T15:01:55.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:55 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:01:55.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:55 smithi152 ceph-mon[192652]: Reconfiguring daemon crash.smithi152 on smithi152 2023-12-06T15:01:55.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:55 smithi152 ceph-mon[192652]: pgmap v15: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 14 KiB/s wr, 11 op/s 2023-12-06T15:01:55.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:55 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:55.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:55 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:55.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:55 smithi190 ceph-mon[178398]: Reconfiguring crash.smithi152 (monmap changed)... 2023-12-06T15:01:55.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:55 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-06T15:01:55.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:55 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:01:55.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:55 smithi190 ceph-mon[178398]: Reconfiguring daemon crash.smithi152 on smithi152 2023-12-06T15:01:55.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:55 smithi190 ceph-mon[178398]: pgmap v15: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 14 KiB/s wr, 11 op/s 2023-12-06T15:01:56.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:56 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:56.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:56 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:56.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:56 smithi152 ceph-mon[192652]: Reconfiguring osd.0 (monmap changed)... 2023-12-06T15:01:56.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:56 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-06T15:01:56.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:56 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:01:56.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:56 smithi152 ceph-mon[192652]: Reconfiguring daemon osd.0 on smithi152 2023-12-06T15:01:56.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:56 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:56.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:56 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:56.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:56 smithi190 ceph-mon[178398]: Reconfiguring osd.0 (monmap changed)... 2023-12-06T15:01:56.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:56 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-06T15:01:56.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:56 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:01:56.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:56 smithi190 ceph-mon[178398]: Reconfiguring daemon osd.0 on smithi152 2023-12-06T15:01:57.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:57 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:57.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:57 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:57.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:57 smithi152 ceph-mon[192652]: Reconfiguring osd.1 (monmap changed)... 2023-12-06T15:01:57.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:57 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-06T15:01:57.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:57 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:01:57.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:57 smithi152 ceph-mon[192652]: Reconfiguring daemon osd.1 on smithi152 2023-12-06T15:01:57.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:57 smithi152 ceph-mon[192652]: pgmap v16: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 14 KiB/s wr, 11 op/s 2023-12-06T15:01:57.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:57 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:57.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:57 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:57.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:57 smithi190 ceph-mon[178398]: Reconfiguring osd.1 (monmap changed)... 2023-12-06T15:01:57.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:57 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-06T15:01:57.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:57 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:01:57.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:57 smithi190 ceph-mon[178398]: Reconfiguring daemon osd.1 on smithi152 2023-12-06T15:01:57.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:57 smithi190 ceph-mon[178398]: pgmap v16: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 14 KiB/s wr, 11 op/s 2023-12-06T15:01:58.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:58 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:58.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:58 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:58.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:58 smithi152 ceph-mon[192652]: Reconfiguring osd.2 (monmap changed)... 2023-12-06T15:01:58.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:58 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-06T15:01:58.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:58 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:01:58.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:58 smithi152 ceph-mon[192652]: Reconfiguring daemon osd.2 on smithi152 2023-12-06T15:01:58.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:58 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:58.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:58 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:58.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:58 smithi190 ceph-mon[178398]: Reconfiguring osd.2 (monmap changed)... 2023-12-06T15:01:58.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:58 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-06T15:01:58.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:58 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:01:58.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:58 smithi190 ceph-mon[178398]: Reconfiguring daemon osd.2 on smithi152 2023-12-06T15:01:59.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:59 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:59.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:59 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:59.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:59 smithi190 ceph-mon[178398]: Reconfiguring mds.cephfs.smithi152.acqswy (monmap changed)... 2023-12-06T15:01:59.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:59 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.acqswy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-06T15:01:59.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:59 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:01:59.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:59 smithi190 ceph-mon[178398]: Reconfiguring daemon mds.cephfs.smithi152.acqswy on smithi152 2023-12-06T15:01:59.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:01:59 smithi190 ceph-mon[178398]: pgmap v17: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 14 KiB/s wr, 12 op/s 2023-12-06T15:01:59.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:59 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:59.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:59 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:01:59.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:59 smithi152 ceph-mon[192652]: Reconfiguring mds.cephfs.smithi152.acqswy (monmap changed)... 2023-12-06T15:01:59.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:59 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.acqswy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-06T15:01:59.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:59 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:01:59.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:59 smithi152 ceph-mon[192652]: Reconfiguring daemon mds.cephfs.smithi152.acqswy on smithi152 2023-12-06T15:01:59.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:01:59 smithi152 ceph-mon[192652]: pgmap v17: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 14 KiB/s wr, 12 op/s 2023-12-06T15:02:01.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:01.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:01.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:01 smithi152 ceph-mon[192652]: Reconfiguring mds.cephfs.smithi152.ypivwc (monmap changed)... 2023-12-06T15:02:01.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.ypivwc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-06T15:02:01.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:02:01.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:01 smithi152 ceph-mon[192652]: Reconfiguring daemon mds.cephfs.smithi152.ypivwc on smithi152 2023-12-06T15:02:01.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:01 smithi152 ceph-mon[192652]: pgmap v18: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.6 KiB/s rd, 767 B/s wr, 4 op/s 2023-12-06T15:02:01.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:02:01.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:01.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:01.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:01 smithi190 ceph-mon[178398]: Reconfiguring mds.cephfs.smithi152.ypivwc (monmap changed)... 2023-12-06T15:02:01.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi152.ypivwc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-06T15:02:01.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:02:01.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:01 smithi190 ceph-mon[178398]: Reconfiguring daemon mds.cephfs.smithi152.ypivwc on smithi152 2023-12-06T15:02:01.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:01 smithi190 ceph-mon[178398]: pgmap v18: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.6 KiB/s rd, 767 B/s wr, 4 op/s 2023-12-06T15:02:01.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:02:02.720 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:02 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:02.720 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:02 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:02.720 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:02 smithi190 ceph-mon[178398]: Reconfiguring crash.smithi190 (monmap changed)... 2023-12-06T15:02:02.720 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:02 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi190", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-06T15:02:02.720 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:02 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:02:02.720 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:02 smithi190 ceph-mon[178398]: Reconfiguring daemon crash.smithi190 on smithi190 2023-12-06T15:02:02.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:02 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:02.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:02 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:02.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:02 smithi152 ceph-mon[192652]: Reconfiguring crash.smithi190 (monmap changed)... 2023-12-06T15:02:02.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:02 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi190", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-06T15:02:02.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:02 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:02:02.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:02 smithi152 ceph-mon[192652]: Reconfiguring daemon crash.smithi190 on smithi190 2023-12-06T15:02:03.703 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:03 smithi190 ceph-mon[178398]: pgmap v19: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 3.4 KiB/s rd, 767 B/s wr, 6 op/s 2023-12-06T15:02:03.703 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:03 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:03.703 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:03 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:03.703 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:03 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi190.ubusrr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-06T15:02:03.703 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:03 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-06T15:02:03.703 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:03 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:02:03.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:03 smithi152 ceph-mon[192652]: pgmap v19: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 3.4 KiB/s rd, 767 B/s wr, 6 op/s 2023-12-06T15:02:03.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:03 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:03.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:03 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:03.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:03 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi190.ubusrr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-06T15:02:03.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:03 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-06T15:02:03.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:03 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:02:04.678 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.678+0000 7fca1a43f700 1 -- 172.21.15.152:0/52215665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca140fcbf0 msgr2=0x7fca140fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:04.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.678+0000 7fca1a43f700 1 --2- 172.21.15.152:0/52215665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca140fcbf0 0x7fca140fd000 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fca04004880 tx=0x7fca04009e30 comp rx=0 tx=0).stop 2023-12-06T15:02:04.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.678+0000 7fca1a43f700 1 -- 172.21.15.152:0/52215665 shutdown_connections 2023-12-06T15:02:04.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.678+0000 7fca1a43f700 1 --2- 172.21.15.152:0/52215665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fca140fde00 0x7fca140fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:04.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.678+0000 7fca1a43f700 1 --2- 172.21.15.152:0/52215665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca140fcbf0 0x7fca140fd000 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:04.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.678+0000 7fca1a43f700 1 -- 172.21.15.152:0/52215665 >> 172.21.15.152:0/52215665 conn(0x7fca140f82d0 msgr2=0x7fca140fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:02:04.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.678+0000 7fca1a43f700 1 -- 172.21.15.152:0/52215665 shutdown_connections 2023-12-06T15:02:04.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.678+0000 7fca1a43f700 1 -- 172.21.15.152:0/52215665 wait complete. 2023-12-06T15:02:04.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.678+0000 7fca1a43f700 1 Processor -- start 2023-12-06T15:02:04.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.679+0000 7fca1a43f700 1 -- start start 2023-12-06T15:02:04.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.679+0000 7fca1a43f700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fca140fcbf0 0x7fca1410d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:04.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.679+0000 7fca1a43f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca140fde00 0x7fca1410da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:04.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.679+0000 7fca1a43f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1410e010 con 0x7fca140fde00 2023-12-06T15:02:04.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.679+0000 7fca1a43f700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1410e8b0 con 0x7fca140fcbf0 2023-12-06T15:02:04.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.679+0000 7fca137fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca140fde00 0x7fca1410da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:04.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.679+0000 7fca137fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca140fde00 0x7fca1410da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48312/0 (socket says 172.21.15.152:48312) 2023-12-06T15:02:04.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.679+0000 7fca137fe700 1 -- 172.21.15.152:0/1808870551 learned_addr learned my addr 172.21.15.152:0/1808870551 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:02:04.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.679+0000 7fca137fe700 1 -- 172.21.15.152:0/1808870551 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fca140fcbf0 msgr2=0x7fca1410d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:04.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.679+0000 7fca137fe700 1 --2- 172.21.15.152:0/1808870551 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fca140fcbf0 0x7fca1410d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:04.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.679+0000 7fca137fe700 1 -- 172.21.15.152:0/1808870551 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca08005040 con 0x7fca140fde00 2023-12-06T15:02:04.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.679+0000 7fca137fe700 1 --2- 172.21.15.152:0/1808870551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca140fde00 0x7fca1410da10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fca080096b0 tx=0x7fca08009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:02:04.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.679+0000 7fca10ff9700 1 -- 172.21.15.152:0/1808870551 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca08017070 con 0x7fca140fde00 2023-12-06T15:02:04.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.680+0000 7fca10ff9700 1 -- 172.21.15.152:0/1808870551 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fca0800f040 con 0x7fca140fde00 2023-12-06T15:02:04.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.680+0000 7fca10ff9700 1 -- 172.21.15.152:0/1808870551 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca08013b70 con 0x7fca140fde00 2023-12-06T15:02:04.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.680+0000 7fca1a43f700 1 -- 172.21.15.152:0/1808870551 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca04005040 con 0x7fca140fde00 2023-12-06T15:02:04.682 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.680+0000 7fca1a43f700 1 -- 172.21.15.152:0/1808870551 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca1410eee0 con 0x7fca140fde00 2023-12-06T15:02:04.682 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.680+0000 7fca1a43f700 1 -- 172.21.15.152:0/1808870551 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca1404bb80 con 0x7fca140fde00 2023-12-06T15:02:04.682 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.681+0000 7fca10ff9700 1 -- 172.21.15.152:0/1808870551 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 37) v1 ==== 91040+0+0 (secure 0 0 0) 0x7fca0800e840 con 0x7fca140fde00 2023-12-06T15:02:04.682 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.681+0000 7fca10ff9700 1 --2- 172.21.15.152:0/1808870551 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fc9fc06cf80 0x7fc9fc06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:04.682 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.682+0000 7fca10ff9700 1 -- 172.21.15.152:0/1808870551 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fca0808c380 con 0x7fca140fde00 2023-12-06T15:02:04.683 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.682+0000 7fca13fff700 1 --2- 172.21.15.152:0/1808870551 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fc9fc06cf80 0x7fc9fc06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:04.683 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.682+0000 7fca13fff700 1 --2- 172.21.15.152:0/1808870551 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fc9fc06cf80 0x7fc9fc06f430 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fca04000c00 tx=0x7fca04009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:02:04.686 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.686+0000 7fca10ff9700 1 -- 172.21.15.152:0/1808870551 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fca08059ad0 con 0x7fca140fde00 2023-12-06T15:02:04.711 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:04 smithi190 ceph-mon[178398]: Reconfiguring mgr.smithi190.ubusrr (monmap changed)... 2023-12-06T15:02:04.711 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:04 smithi190 ceph-mon[178398]: Reconfiguring daemon mgr.smithi190.ubusrr on smithi190 2023-12-06T15:02:04.711 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:04 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:04.711 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:04 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:04.711 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:04 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-06T15:02:04.712 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:04 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-06T15:02:04.712 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:04 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:02:04.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:04 smithi152 ceph-mon[192652]: Reconfiguring mgr.smithi190.ubusrr (monmap changed)... 2023-12-06T15:02:04.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:04 smithi152 ceph-mon[192652]: Reconfiguring daemon mgr.smithi190.ubusrr on smithi190 2023-12-06T15:02:04.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:04 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:04.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:04 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:04.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:04 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-06T15:02:04.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:04 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-06T15:02:04.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:04 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:02:04.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.897+0000 7fca1a43f700 1 -- 172.21.15.152:0/1808870551 --> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fca1410f370 con 0x7fc9fc06cf80 2023-12-06T15:02:04.898 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.898+0000 7fca10ff9700 1 -- 172.21.15.152:0/1808870551 <== mgr.34104 v2:172.21.15.152:6800/2427836422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fca1410f370 con 0x7fc9fc06cf80 2023-12-06T15:02:04.900 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.900+0000 7fca1a43f700 1 -- 172.21.15.152:0/1808870551 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fc9fc06cf80 msgr2=0x7fc9fc06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:04.900 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.900+0000 7fca1a43f700 1 --2- 172.21.15.152:0/1808870551 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fc9fc06cf80 0x7fc9fc06f430 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fca04000c00 tx=0x7fca04009e30 comp rx=0 tx=0).stop 2023-12-06T15:02:04.900 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.900+0000 7fca1a43f700 1 -- 172.21.15.152:0/1808870551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca140fde00 msgr2=0x7fca1410da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:04.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.900+0000 7fca1a43f700 1 --2- 172.21.15.152:0/1808870551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca140fde00 0x7fca1410da10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fca080096b0 tx=0x7fca08009e30 comp rx=0 tx=0).stop 2023-12-06T15:02:04.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.900+0000 7fca1a43f700 1 -- 172.21.15.152:0/1808870551 shutdown_connections 2023-12-06T15:02:04.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.900+0000 7fca1a43f700 1 --2- 172.21.15.152:0/1808870551 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fc9fc06cf80 0x7fc9fc06f430 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:04.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.900+0000 7fca1a43f700 1 --2- 172.21.15.152:0/1808870551 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fca140fcbf0 0x7fca1410d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:04.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.900+0000 7fca1a43f700 1 --2- 172.21.15.152:0/1808870551 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca140fde00 0x7fca1410da10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:04.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.900+0000 7fca1a43f700 1 -- 172.21.15.152:0/1808870551 >> 172.21.15.152:0/1808870551 conn(0x7fca140f82d0 msgr2=0x7fca14101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:02:04.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.900+0000 7fca1a43f700 1 -- 172.21.15.152:0/1808870551 shutdown_connections 2023-12-06T15:02:04.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:04.900+0000 7fca1a43f700 1 -- 172.21.15.152:0/1808870551 wait complete. 2023-12-06T15:02:04.911 INFO:teuthology.orchestra.run.smithi152.stdout:true 2023-12-06T15:02:05.005 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.004+0000 7efddab2b700 1 -- 172.21.15.152:0/585070944 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdd40ffdb0 msgr2=0x7efdd41021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:05.005 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.004+0000 7efddab2b700 1 --2- 172.21.15.152:0/585070944 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdd40ffdb0 0x7efdd41021d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efdc0004940 tx=0x7efdc0009e30 comp rx=0 tx=0).stop 2023-12-06T15:02:05.005 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.004+0000 7efddab2b700 1 -- 172.21.15.152:0/585070944 shutdown_connections 2023-12-06T15:02:05.005 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.004+0000 7efddab2b700 1 --2- 172.21.15.152:0/585070944 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdd40ffdb0 0x7efdd41021d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:05.005 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.004+0000 7efddab2b700 1 --2- 172.21.15.152:0/585070944 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efdd4066050 0x7efdd40ff7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:05.005 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.004+0000 7efddab2b700 1 -- 172.21.15.152:0/585070944 >> 172.21.15.152:0/585070944 conn(0x7efdd40f7190 msgr2=0x7efdd40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:02:05.005 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.004+0000 7efddab2b700 1 -- 172.21.15.152:0/585070944 shutdown_connections 2023-12-06T15:02:05.005 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.004+0000 7efddab2b700 1 -- 172.21.15.152:0/585070944 wait complete. 2023-12-06T15:02:05.005 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.005+0000 7efddab2b700 1 Processor -- start 2023-12-06T15:02:05.005 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.005+0000 7efddab2b700 1 -- start start 2023-12-06T15:02:05.007 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.005+0000 7efddab2b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efdd4066050 0x7efdd410d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:05.007 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.005+0000 7efddab2b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdd40ffdb0 0x7efdd410dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:05.007 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.005+0000 7efddab2b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd410e0b0 con 0x7efdd40ffdb0 2023-12-06T15:02:05.007 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.005+0000 7efddab2b700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd410e950 con 0x7efdd4066050 2023-12-06T15:02:05.007 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.005+0000 7efdd3fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdd40ffdb0 0x7efdd410dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:05.007 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.005+0000 7efdd3fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdd40ffdb0 0x7efdd410dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48338/0 (socket says 172.21.15.152:48338) 2023-12-06T15:02:05.007 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.005+0000 7efdd3fff700 1 -- 172.21.15.152:0/3418834823 learned_addr learned my addr 172.21.15.152:0/3418834823 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:02:05.007 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.005+0000 7efdd88c7700 1 --2- 172.21.15.152:0/3418834823 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efdd4066050 0x7efdd410d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:05.007 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.006+0000 7efdd3fff700 1 -- 172.21.15.152:0/3418834823 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efdd4066050 msgr2=0x7efdd410d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:05.008 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.006+0000 7efdd3fff700 1 --2- 172.21.15.152:0/3418834823 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efdd4066050 0x7efdd410d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:05.008 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.006+0000 7efdd3fff700 1 -- 172.21.15.152:0/3418834823 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc0005040 con 0x7efdd40ffdb0 2023-12-06T15:02:05.008 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.006+0000 7efdd3fff700 1 --2- 172.21.15.152:0/3418834823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdd40ffdb0 0x7efdd410dab0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efdc0004f90 tx=0x7efdc0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:02:05.008 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.006+0000 7efdd17fa700 1 -- 172.21.15.152:0/3418834823 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdc000e040 con 0x7efdd40ffdb0 2023-12-06T15:02:05.008 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.006+0000 7efdd17fa700 1 -- 172.21.15.152:0/3418834823 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efdc000bc50 con 0x7efdd40ffdb0 2023-12-06T15:02:05.008 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.006+0000 7efddab2b700 1 -- 172.21.15.152:0/3418834823 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd410ebd0 con 0x7efdd40ffdb0 2023-12-06T15:02:05.008 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.006+0000 7efdd17fa700 1 -- 172.21.15.152:0/3418834823 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdc001c630 con 0x7efdd40ffdb0 2023-12-06T15:02:05.008 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.006+0000 7efddab2b700 1 -- 172.21.15.152:0/3418834823 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd410f110 con 0x7efdd40ffdb0 2023-12-06T15:02:05.008 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.007+0000 7efddab2b700 1 -- 172.21.15.152:0/3418834823 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd41075c0 con 0x7efdd40ffdb0 2023-12-06T15:02:05.009 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.007+0000 7efdd17fa700 1 -- 172.21.15.152:0/3418834823 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 37) v1 ==== 91040+0+0 (secure 0 0 0) 0x7efdc0013420 con 0x7efdd40ffdb0 2023-12-06T15:02:05.009 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.008+0000 7efdd17fa700 1 --2- 172.21.15.152:0/3418834823 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7efdc406cf80 0x7efdc406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:05.009 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.008+0000 7efdd17fa700 1 -- 172.21.15.152:0/3418834823 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7efdc008d900 con 0x7efdd40ffdb0 2023-12-06T15:02:05.009 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.008+0000 7efdd88c7700 1 --2- 172.21.15.152:0/3418834823 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7efdc406cf80 0x7efdc406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:05.009 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.008+0000 7efdd88c7700 1 --2- 172.21.15.152:0/3418834823 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7efdc406cf80 0x7efdc406f430 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efdc8004f40 tx=0x7efdc800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:02:05.012 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.012+0000 7efdd17fa700 1 -- 172.21.15.152:0/3418834823 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7efdc005b0d0 con 0x7efdd40ffdb0 2023-12-06T15:02:05.234 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.234+0000 7efddab2b700 1 -- 172.21.15.152:0/3418834823 --> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efdd410f460 con 0x7efdc406cf80 2023-12-06T15:02:05.235 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.235+0000 7efdd17fa700 1 -- 172.21.15.152:0/3418834823 <== mgr.34104 v2:172.21.15.152:6800/2427836422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7efdd410f460 con 0x7efdc406cf80 2023-12-06T15:02:05.238 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.237+0000 7efddab2b700 1 -- 172.21.15.152:0/3418834823 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7efdc406cf80 msgr2=0x7efdc406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:05.238 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.238+0000 7efddab2b700 1 --2- 172.21.15.152:0/3418834823 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7efdc406cf80 0x7efdc406f430 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efdc8004f40 tx=0x7efdc800b040 comp rx=0 tx=0).stop 2023-12-06T15:02:05.238 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.238+0000 7efddab2b700 1 -- 172.21.15.152:0/3418834823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdd40ffdb0 msgr2=0x7efdd410dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:05.238 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.238+0000 7efddab2b700 1 --2- 172.21.15.152:0/3418834823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdd40ffdb0 0x7efdd410dab0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efdc0004f90 tx=0x7efdc0009e30 comp rx=0 tx=0).stop 2023-12-06T15:02:05.238 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.238+0000 7efddab2b700 1 -- 172.21.15.152:0/3418834823 shutdown_connections 2023-12-06T15:02:05.238 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.238+0000 7efddab2b700 1 --2- 172.21.15.152:0/3418834823 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7efdc406cf80 0x7efdc406f430 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:05.239 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.238+0000 7efddab2b700 1 --2- 172.21.15.152:0/3418834823 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efdd4066050 0x7efdd410d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:05.239 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.238+0000 7efddab2b700 1 --2- 172.21.15.152:0/3418834823 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdd40ffdb0 0x7efdd410dab0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:05.239 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.238+0000 7efddab2b700 1 -- 172.21.15.152:0/3418834823 >> 172.21.15.152:0/3418834823 conn(0x7efdd40f7190 msgr2=0x7efdd40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:02:05.239 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.238+0000 7efddab2b700 1 -- 172.21.15.152:0/3418834823 shutdown_connections 2023-12-06T15:02:05.239 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.238+0000 7efddab2b700 1 -- 172.21.15.152:0/3418834823 wait complete. 2023-12-06T15:02:05.342 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.339+0000 7f5452690700 1 -- 172.21.15.152:0/1635002995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f544c0fbaf0 msgr2=0x7f544c0fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:05.343 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.339+0000 7f5452690700 1 --2- 172.21.15.152:0/1635002995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f544c0fbaf0 0x7f544c0fbf00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f543c004940 tx=0x7f543c009e30 comp rx=0 tx=0).stop 2023-12-06T15:02:05.343 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.339+0000 7f5452690700 1 -- 172.21.15.152:0/1635002995 shutdown_connections 2023-12-06T15:02:05.343 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.339+0000 7f5452690700 1 --2- 172.21.15.152:0/1635002995 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f544c0fcd00 0x7f544c0fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:05.343 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.339+0000 7f5452690700 1 --2- 172.21.15.152:0/1635002995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f544c0fbaf0 0x7f544c0fbf00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:05.343 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.339+0000 7f5452690700 1 -- 172.21.15.152:0/1635002995 >> 172.21.15.152:0/1635002995 conn(0x7f544c0f7190 msgr2=0x7f544c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:02:05.343 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.339+0000 7f5452690700 1 -- 172.21.15.152:0/1635002995 shutdown_connections 2023-12-06T15:02:05.344 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.339+0000 7f5452690700 1 -- 172.21.15.152:0/1635002995 wait complete. 2023-12-06T15:02:05.344 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.340+0000 7f5452690700 1 Processor -- start 2023-12-06T15:02:05.344 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.340+0000 7f5452690700 1 -- start start 2023-12-06T15:02:05.344 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.340+0000 7f5452690700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f544c0fbaf0 0x7f544c1101b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:05.344 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.340+0000 7f5452690700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f544c0fcd00 0x7f544c112700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:05.345 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.340+0000 7f5452690700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544c066170 con 0x7f544c0fcd00 2023-12-06T15:02:05.345 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.340+0000 7f5452690700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544c0662b0 con 0x7f544c0fbaf0 2023-12-06T15:02:05.345 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.340+0000 7f544b7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f544c0fcd00 0x7f544c112700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:05.345 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.340+0000 7f544b7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f544c0fcd00 0x7f544c112700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48352/0 (socket says 172.21.15.152:48352) 2023-12-06T15:02:05.345 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.340+0000 7f544b7fe700 1 -- 172.21.15.152:0/2204115801 learned_addr learned my addr 172.21.15.152:0/2204115801 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:02:05.345 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.340+0000 7f544bfff700 1 --2- 172.21.15.152:0/2204115801 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f544c0fbaf0 0x7f544c1101b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:05.345 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.340+0000 7f544b7fe700 1 -- 172.21.15.152:0/2204115801 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f544c0fbaf0 msgr2=0x7f544c1101b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:05.345 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.340+0000 7f544b7fe700 1 --2- 172.21.15.152:0/2204115801 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f544c0fbaf0 0x7f544c1101b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:05.345 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.340+0000 7f544b7fe700 1 -- 172.21.15.152:0/2204115801 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543c005040 con 0x7f544c0fcd00 2023-12-06T15:02:05.346 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.340+0000 7f544bfff700 1 --2- 172.21.15.152:0/2204115801 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f544c0fbaf0 0x7f544c1101b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-06T15:02:05.346 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.341+0000 7f544b7fe700 1 --2- 172.21.15.152:0/2204115801 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f544c0fcd00 0x7f544c112700 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f544000eb70 tx=0x7f544000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:02:05.346 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.341+0000 7f5448ff9700 1 -- 172.21.15.152:0/2204115801 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5440007e60 con 0x7f544c0fcd00 2023-12-06T15:02:05.346 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.341+0000 7f5448ff9700 1 -- 172.21.15.152:0/2204115801 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f544000f040 con 0x7f544c0fcd00 2023-12-06T15:02:05.346 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.341+0000 7f5448ff9700 1 -- 172.21.15.152:0/2204115801 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f544000cb80 con 0x7f544c0fcd00 2023-12-06T15:02:05.346 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.341+0000 7f5452690700 1 -- 172.21.15.152:0/2204115801 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f544c112d00 con 0x7f544c0fcd00 2023-12-06T15:02:05.346 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.341+0000 7f5452690700 1 -- 172.21.15.152:0/2204115801 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f544c113240 con 0x7f544c0fcd00 2023-12-06T15:02:05.347 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.342+0000 7f5452690700 1 -- 172.21.15.152:0/2204115801 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f544c04bb80 con 0x7f544c0fcd00 2023-12-06T15:02:05.347 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.342+0000 7f5448ff9700 1 -- 172.21.15.152:0/2204115801 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 37) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f54400090d0 con 0x7f544c0fcd00 2023-12-06T15:02:05.348 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.343+0000 7f5448ff9700 1 --2- 172.21.15.152:0/2204115801 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f543406cf80 0x7f543406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:05.348 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.343+0000 7f5448ff9700 1 -- 172.21.15.152:0/2204115801 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f544008c2a0 con 0x7f544c0fcd00 2023-12-06T15:02:05.348 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.343+0000 7f544bfff700 1 --2- 172.21.15.152:0/2204115801 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f543406cf80 0x7f543406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:05.348 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.343+0000 7f544bfff700 1 --2- 172.21.15.152:0/2204115801 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f543406cf80 0x7f543406f430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f543c009fd0 tx=0x7f543c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:02:05.348 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.347+0000 7f5448ff9700 1 -- 172.21.15.152:0/2204115801 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f5440056010 con 0x7f544c0fcd00 2023-12-06T15:02:05.550 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.549+0000 7f5452690700 1 -- 172.21.15.152:0/2204115801 --> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f544c101650 con 0x7f543406cf80 2023-12-06T15:02:05.559 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.559+0000 7f5448ff9700 1 -- 172.21.15.152:0/2204115801 <== mgr.34104 v2:172.21.15.152:6800/2427836422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f544c101650 con 0x7f543406cf80 2023-12-06T15:02:05.559 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-06T15:02:05.559 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 running (2m) 29s ago 7m 24.2M - 0.25.0 c8568f914cd2 b1a46cc95546 2023-12-06T15:02:05.559 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (8m) 29s ago 8m 7436k - 17.2.7-113-gece0d607 a5c6421f1c5f 40d5cebbdb93 2023-12-06T15:02:05.559 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi190 smithi190 running (7m) 19s ago 7m 7457k - 17.2.7-113-gece0d607 a5c6421f1c5f 3a387cddf7e6 2023-12-06T15:02:05.559 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (2m) 29s ago 7m 81.3M - 9.4.7 954c08fa6188 5c6a52d58144 2023-12-06T15:02:05.560 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.acqswy smithi152 running (4m) 29s ago 4m 5295M - 17.2.7-113-gece0d607 a5c6421f1c5f ff9375cec192 2023-12-06T15:02:05.560 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.ypivwc smithi152 running (4m) 29s ago 4m 501M - 17.2.7-113-gece0d607 a5c6421f1c5f d809a681491b 2023-12-06T15:02:05.560 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi190.edwtqj smithi190 running (3m) 19s ago 3m 626M - 17.2.7-113-gece0d607 a5c6421f1c5f f3b7ebd93b04 2023-12-06T15:02:05.560 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi190.uucxzu smithi190 running (4m) 19s ago 4m 4862M - 17.2.7-113-gece0d607 a5c6421f1c5f c01be1409c5f 2023-12-06T15:02:05.560 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.meodco smithi152 *:8443,9283,8765 running (84s) 29s ago 8m 476M - 19.0.0-26-g0482646f 26bb7d89db2e 16ed2af8a3d0 2023-12-06T15:02:05.560 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi190.ubusrr smithi190 *:8443,9283,8765 running (55s) 19s ago 7m 446M - 19.0.0-26-g0482646f 26bb7d89db2e cfae14b9324d 2023-12-06T15:02:05.560 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (44s) 29s ago 9m 31.8M 2048M 19.0.0-26-g0482646f 26bb7d89db2e f5163d3b0f5f 2023-12-06T15:02:05.560 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi190 smithi190 running (22s) 19s ago 7m 27.7M 2048M 19.0.0-26-g0482646f 26bb7d89db2e b25040d5fdfe 2023-12-06T15:02:05.560 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 running (2m) 29s ago 7m 18.3M - 1.5.0 0da6a335fe13 81be696b9be8 2023-12-06T15:02:05.560 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi190 smithi190 *:9100 running (91s) 19s ago 7m 18.2M - 1.5.0 0da6a335fe13 2e521e235bf7 2023-12-06T15:02:05.560 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (6m) 29s ago 6m 724M 1568M 17.2.7-113-gece0d607 a5c6421f1c5f 499f740f966e 2023-12-06T15:02:05.560 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (6m) 29s ago 6m 800M 1568M 17.2.7-113-gece0d607 a5c6421f1c5f 3942f134581a 2023-12-06T15:02:05.560 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (5m) 29s ago 5m 629M 1568M 17.2.7-113-gece0d607 a5c6421f1c5f 80bcc4927bb2 2023-12-06T15:02:05.561 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi190 running (5m) 19s ago 5m 960M 2592M 17.2.7-113-gece0d607 a5c6421f1c5f f0281d01fec4 2023-12-06T15:02:05.561 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi190 running (5m) 19s ago 5m 724M 2592M 17.2.7-113-gece0d607 a5c6421f1c5f a415b29ad9c7 2023-12-06T15:02:05.561 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi190 running (5m) 19s ago 5m 852M 2592M 17.2.7-113-gece0d607 a5c6421f1c5f b0f2767055a5 2023-12-06T15:02:05.561 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi152 smithi152 *:9095 running (60s) 29s ago 7m 45.6M - 2.43.0 a07b618ecd1d 5f7e5860a419 2023-12-06T15:02:05.561 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.561+0000 7f5452690700 1 -- 172.21.15.152:0/2204115801 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f543406cf80 msgr2=0x7f543406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:05.561 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.561+0000 7f5452690700 1 --2- 172.21.15.152:0/2204115801 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f543406cf80 0x7f543406f430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f543c009fd0 tx=0x7f543c009e30 comp rx=0 tx=0).stop 2023-12-06T15:02:05.562 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.561+0000 7f5452690700 1 -- 172.21.15.152:0/2204115801 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f544c0fcd00 msgr2=0x7f544c112700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:05.562 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.561+0000 7f5452690700 1 --2- 172.21.15.152:0/2204115801 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f544c0fcd00 0x7f544c112700 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f544000eb70 tx=0x7f544000b040 comp rx=0 tx=0).stop 2023-12-06T15:02:05.562 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.561+0000 7f5452690700 1 -- 172.21.15.152:0/2204115801 shutdown_connections 2023-12-06T15:02:05.562 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.561+0000 7f5452690700 1 --2- 172.21.15.152:0/2204115801 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f543406cf80 0x7f543406f430 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:05.562 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.561+0000 7f5452690700 1 --2- 172.21.15.152:0/2204115801 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f544c0fbaf0 0x7f544c1101b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:05.562 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.561+0000 7f5452690700 1 --2- 172.21.15.152:0/2204115801 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f544c0fcd00 0x7f544c112700 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:05.562 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.561+0000 7f5452690700 1 -- 172.21.15.152:0/2204115801 >> 172.21.15.152:0/2204115801 conn(0x7f544c0f7190 msgr2=0x7f544c0fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:02:05.562 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.561+0000 7f5452690700 1 -- 172.21.15.152:0/2204115801 shutdown_connections 2023-12-06T15:02:05.562 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.561+0000 7f5452690700 1 -- 172.21.15.152:0/2204115801 wait complete. 2023-12-06T15:02:05.664 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.663+0000 7f42ade1e700 1 -- 172.21.15.152:0/3721928017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42a80fcbf0 msgr2=0x7f42a80fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:05.664 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.663+0000 7f42ade1e700 1 --2- 172.21.15.152:0/3721928017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42a80fcbf0 0x7f42a80fd000 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4298004940 tx=0x7f4298009e30 comp rx=0 tx=0).stop 2023-12-06T15:02:05.664 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.663+0000 7f42ade1e700 1 -- 172.21.15.152:0/3721928017 shutdown_connections 2023-12-06T15:02:05.664 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.663+0000 7f42ade1e700 1 --2- 172.21.15.152:0/3721928017 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42a80fde00 0x7f42a80fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:05.664 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.663+0000 7f42ade1e700 1 --2- 172.21.15.152:0/3721928017 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42a80fcbf0 0x7f42a80fd000 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:05.664 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.663+0000 7f42ade1e700 1 -- 172.21.15.152:0/3721928017 >> 172.21.15.152:0/3721928017 conn(0x7f42a80f82d0 msgr2=0x7f42a80fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:02:05.664 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.663+0000 7f42ade1e700 1 -- 172.21.15.152:0/3721928017 shutdown_connections 2023-12-06T15:02:05.664 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.663+0000 7f42ade1e700 1 -- 172.21.15.152:0/3721928017 wait complete. 2023-12-06T15:02:05.666 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.664+0000 7f42ade1e700 1 Processor -- start 2023-12-06T15:02:05.666 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.664+0000 7f42ade1e700 1 -- start start 2023-12-06T15:02:05.666 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.664+0000 7f42ade1e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42a80fcbf0 0x7f42a810d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:05.666 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.664+0000 7f42ade1e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42a80fde00 0x7f42a810da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:05.666 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.664+0000 7f42ade1e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a810e010 con 0x7f42a80fcbf0 2023-12-06T15:02:05.666 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.664+0000 7f42ade1e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a810e8b0 con 0x7f42a80fde00 2023-12-06T15:02:05.666 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.665+0000 7f42a77fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42a80fcbf0 0x7f42a810d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:05.666 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.665+0000 7f42a77fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42a80fcbf0 0x7f42a810d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48376/0 (socket says 172.21.15.152:48376) 2023-12-06T15:02:05.666 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.665+0000 7f42a77fe700 1 -- 172.21.15.152:0/344343781 learned_addr learned my addr 172.21.15.152:0/344343781 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:02:05.667 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.665+0000 7f42a6ffd700 1 --2- 172.21.15.152:0/344343781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42a80fde00 0x7f42a810da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:05.667 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.665+0000 7f42a77fe700 1 -- 172.21.15.152:0/344343781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42a80fde00 msgr2=0x7f42a810da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:05.667 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.665+0000 7f42a77fe700 1 --2- 172.21.15.152:0/344343781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42a80fde00 0x7f42a810da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:05.667 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.665+0000 7f42a77fe700 1 -- 172.21.15.152:0/344343781 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4298005040 con 0x7f42a80fcbf0 2023-12-06T15:02:05.667 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.665+0000 7f42a6ffd700 1 --2- 172.21.15.152:0/344343781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42a80fde00 0x7f42a810da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-06T15:02:05.667 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.665+0000 7f42a77fe700 1 --2- 172.21.15.152:0/344343781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42a80fcbf0 0x7f42a810d4d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4298000c00 tx=0x7f4298009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:02:05.667 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.665+0000 7f428ffff700 1 -- 172.21.15.152:0/344343781 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4298021070 con 0x7f42a80fcbf0 2023-12-06T15:02:05.667 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.665+0000 7f428ffff700 1 -- 172.21.15.152:0/344343781 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f429801c400 con 0x7f42a80fcbf0 2023-12-06T15:02:05.667 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.665+0000 7f42ade1e700 1 -- 172.21.15.152:0/344343781 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42a810eb30 con 0x7f42a80fcbf0 2023-12-06T15:02:05.667 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.665+0000 7f428ffff700 1 -- 172.21.15.152:0/344343781 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f429800e070 con 0x7f42a80fcbf0 2023-12-06T15:02:05.667 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.665+0000 7f42ade1e700 1 -- 172.21.15.152:0/344343781 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42a810f010 con 0x7f42a80fcbf0 2023-12-06T15:02:05.668 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.666+0000 7f42ade1e700 1 -- 172.21.15.152:0/344343781 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42a804bb80 con 0x7f42a80fcbf0 2023-12-06T15:02:05.668 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.667+0000 7f428ffff700 1 -- 172.21.15.152:0/344343781 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 37) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f429801c9e0 con 0x7f42a80fcbf0 2023-12-06T15:02:05.668 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.667+0000 7f428ffff700 1 --2- 172.21.15.152:0/344343781 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f429006cf80 0x7f429006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:05.668 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.667+0000 7f428ffff700 1 -- 172.21.15.152:0/344343781 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f429808d780 con 0x7f42a80fcbf0 2023-12-06T15:02:05.668 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.667+0000 7f42a6ffd700 1 --2- 172.21.15.152:0/344343781 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f429006cf80 0x7f429006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:05.668 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.668+0000 7f42a6ffd700 1 --2- 172.21.15.152:0/344343781 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f429006cf80 0x7f429006f430 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f429c004600 tx=0x7f429c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:02:05.669 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:05 smithi190 ceph-mon[178398]: Reconfiguring mon.smithi190 (monmap changed)... 2023-12-06T15:02:05.669 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:05 smithi190 ceph-mon[178398]: Reconfiguring daemon mon.smithi190 on smithi190 2023-12-06T15:02:05.669 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:05 smithi190 ceph-mon[178398]: pgmap v20: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:02:05.669 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:05 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:05.669 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:05 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:05.669 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:05 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-06T15:02:05.669 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:05 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:02:05.671 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.672+0000 7f428ffff700 1 -- 172.21.15.152:0/344343781 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f429805af50 con 0x7f42a80fcbf0 2023-12-06T15:02:05.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:05 smithi152 ceph-mon[192652]: Reconfiguring mon.smithi190 (monmap changed)... 2023-12-06T15:02:05.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:05 smithi152 ceph-mon[192652]: Reconfiguring daemon mon.smithi190 on smithi190 2023-12-06T15:02:05.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:05 smithi152 ceph-mon[192652]: pgmap v20: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:02:05.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:05 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:05.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:05 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:05.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:05 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-06T15:02:05.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:05 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:02:05.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.939+0000 7f42ade1e700 1 -- 172.21.15.152:0/344343781 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f42a810f310 con 0x7f42a80fcbf0 2023-12-06T15:02:05.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.940+0000 7f428ffff700 1 -- 172.21.15.152:0/344343781 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+727 (secure 0 0 0) 0x7f429805aae0 con 0x7f42a80fcbf0 2023-12-06T15:02:05.940 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-12-06T15:02:05.940 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": { 2023-12-06T15:02:05.940 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 2 2023-12-06T15:02:05.940 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:02:05.940 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": { 2023-12-06T15:02:05.941 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 2 2023-12-06T15:02:05.941 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:02:05.941 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": { 2023-12-06T15:02:05.941 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 6 2023-12-06T15:02:05.941 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:02:05.941 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2023-12-06T15:02:05.941 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 4 2023-12-06T15:02:05.941 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:02:05.941 INFO:teuthology.orchestra.run.smithi152.stdout: "overall": { 2023-12-06T15:02:05.941 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 10, 2023-12-06T15:02:05.941 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 4 2023-12-06T15:02:05.941 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-12-06T15:02:05.941 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-12-06T15:02:05.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.942+0000 7f42ade1e700 1 -- 172.21.15.152:0/344343781 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f429006cf80 msgr2=0x7f429006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:05.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.942+0000 7f42ade1e700 1 --2- 172.21.15.152:0/344343781 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f429006cf80 0x7f429006f430 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f429c004600 tx=0x7f429c00b040 comp rx=0 tx=0).stop 2023-12-06T15:02:05.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.942+0000 7f42ade1e700 1 -- 172.21.15.152:0/344343781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42a80fcbf0 msgr2=0x7f42a810d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:05.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.942+0000 7f42ade1e700 1 --2- 172.21.15.152:0/344343781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42a80fcbf0 0x7f42a810d4d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4298000c00 tx=0x7f4298009e30 comp rx=0 tx=0).stop 2023-12-06T15:02:05.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.942+0000 7f42ade1e700 1 -- 172.21.15.152:0/344343781 shutdown_connections 2023-12-06T15:02:05.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.942+0000 7f42ade1e700 1 --2- 172.21.15.152:0/344343781 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f429006cf80 0x7f429006f430 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:05.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.942+0000 7f42ade1e700 1 --2- 172.21.15.152:0/344343781 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42a80fcbf0 0x7f42a810d4d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:05.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.942+0000 7f42ade1e700 1 --2- 172.21.15.152:0/344343781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42a80fde00 0x7f42a810da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:05.943 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.942+0000 7f42ade1e700 1 -- 172.21.15.152:0/344343781 >> 172.21.15.152:0/344343781 conn(0x7f42a80f82d0 msgr2=0x7f42a8101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:02:05.943 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.942+0000 7f42ade1e700 1 -- 172.21.15.152:0/344343781 shutdown_connections 2023-12-06T15:02:05.943 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:05.942+0000 7f42ade1e700 1 -- 172.21.15.152:0/344343781 wait complete. 2023-12-06T15:02:06.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.046+0000 7f6289255700 1 -- 172.21.15.152:0/762210902 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62840fbaf0 msgr2=0x7f62840fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:06.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.046+0000 7f6289255700 1 --2- 172.21.15.152:0/762210902 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62840fbaf0 0x7f62840fbf00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6278004940 tx=0x7f6278009e30 comp rx=0 tx=0).stop 2023-12-06T15:02:06.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.046+0000 7f6289255700 1 -- 172.21.15.152:0/762210902 shutdown_connections 2023-12-06T15:02:06.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.046+0000 7f6289255700 1 --2- 172.21.15.152:0/762210902 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62840fcd00 0x7f62840fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:06.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.046+0000 7f6289255700 1 --2- 172.21.15.152:0/762210902 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62840fbaf0 0x7f62840fbf00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:06.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.046+0000 7f6289255700 1 -- 172.21.15.152:0/762210902 >> 172.21.15.152:0/762210902 conn(0x7f62840f7190 msgr2=0x7f62840f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:02:06.048 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.047+0000 7f6289255700 1 -- 172.21.15.152:0/762210902 shutdown_connections 2023-12-06T15:02:06.048 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.047+0000 7f6289255700 1 -- 172.21.15.152:0/762210902 wait complete. 2023-12-06T15:02:06.049 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.047+0000 7f6289255700 1 Processor -- start 2023-12-06T15:02:06.050 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.047+0000 7f6289255700 1 -- start start 2023-12-06T15:02:06.050 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.048+0000 7f6289255700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62840fbaf0 0x7f628410c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:06.050 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.048+0000 7f6289255700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62840fcd00 0x7f628410c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:06.050 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.048+0000 7f6289255700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628410cf30 con 0x7f62840fbaf0 2023-12-06T15:02:06.050 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.048+0000 7f6289255700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628410d7d0 con 0x7f62840fcd00 2023-12-06T15:02:06.050 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.048+0000 7f6282d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62840fbaf0 0x7f628410c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:06.050 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.048+0000 7f6282d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62840fbaf0 0x7f628410c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48390/0 (socket says 172.21.15.152:48390) 2023-12-06T15:02:06.050 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.048+0000 7f6282d9d700 1 -- 172.21.15.152:0/1974527321 learned_addr learned my addr 172.21.15.152:0/1974527321 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:02:06.050 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.048+0000 7f628259c700 1 --2- 172.21.15.152:0/1974527321 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62840fcd00 0x7f628410c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:06.050 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.048+0000 7f6282d9d700 1 -- 172.21.15.152:0/1974527321 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62840fcd00 msgr2=0x7f628410c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:06.050 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.048+0000 7f6282d9d700 1 --2- 172.21.15.152:0/1974527321 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62840fcd00 0x7f628410c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:06.051 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.048+0000 7f6282d9d700 1 -- 172.21.15.152:0/1974527321 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6278005040 con 0x7f62840fbaf0 2023-12-06T15:02:06.051 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.048+0000 7f628259c700 1 --2- 172.21.15.152:0/1974527321 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62840fcd00 0x7f628410c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-06T15:02:06.051 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.048+0000 7f6282d9d700 1 --2- 172.21.15.152:0/1974527321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62840fbaf0 0x7f628410c3f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6278009fd0 tx=0x7f6278009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:02:06.051 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.048+0000 7f626b7fe700 1 -- 172.21.15.152:0/1974527321 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6278021070 con 0x7f62840fbaf0 2023-12-06T15:02:06.051 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.048+0000 7f6289255700 1 -- 172.21.15.152:0/1974527321 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f628410da50 con 0x7f62840fbaf0 2023-12-06T15:02:06.051 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.048+0000 7f626b7fe700 1 -- 172.21.15.152:0/1974527321 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f627801c400 con 0x7f62840fbaf0 2023-12-06T15:02:06.051 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.048+0000 7f626b7fe700 1 -- 172.21.15.152:0/1974527321 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f627800e070 con 0x7f62840fbaf0 2023-12-06T15:02:06.051 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.049+0000 7f6289255700 1 -- 172.21.15.152:0/1974527321 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f628410df90 con 0x7f62840fbaf0 2023-12-06T15:02:06.051 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.049+0000 7f6289255700 1 -- 172.21.15.152:0/1974527321 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f628404bb80 con 0x7f62840fbaf0 2023-12-06T15:02:06.052 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.050+0000 7f626b7fe700 1 -- 172.21.15.152:0/1974527321 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 37) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f627801c9c0 con 0x7f62840fbaf0 2023-12-06T15:02:06.052 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.050+0000 7f626b7fe700 1 --2- 172.21.15.152:0/1974527321 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f626c06cf80 0x7f626c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:06.052 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.050+0000 7f626b7fe700 1 -- 172.21.15.152:0/1974527321 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f627808d7a0 con 0x7f62840fbaf0 2023-12-06T15:02:06.052 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.050+0000 7f628259c700 1 --2- 172.21.15.152:0/1974527321 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f626c06cf80 0x7f626c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:06.052 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.051+0000 7f628259c700 1 --2- 172.21.15.152:0/1974527321 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f626c06cf80 0x7f626c06f430 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6274009b80 tx=0x7f627400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:02:06.055 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.055+0000 7f626b7fe700 1 -- 172.21.15.152:0/1974527321 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f627805af70 con 0x7f62840fbaf0 2023-12-06T15:02:06.287 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.287+0000 7f6289255700 1 -- 172.21.15.152:0/1974527321 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f628410e290 con 0x7f62840fbaf0 2023-12-06T15:02:06.288 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.288+0000 7f626b7fe700 1 -- 172.21.15.152:0/1974527321 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1907 (secure 0 0 0) 0x7f627805ab00 con 0x7f62840fbaf0 2023-12-06T15:02:06.288 INFO:teuthology.orchestra.run.smithi152.stdout:e16 2023-12-06T15:02:06.288 INFO:teuthology.orchestra.run.smithi152.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-06T15:02:06.288 INFO:teuthology.orchestra.run.smithi152.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-06T15:02:06.288 INFO:teuthology.orchestra.run.smithi152.stdout:legacy client fscid: 1 2023-12-06T15:02:06.288 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T15:02:06.288 INFO:teuthology.orchestra.run.smithi152.stdout:Filesystem 'cephfs' (1) 2023-12-06T15:02:06.289 INFO:teuthology.orchestra.run.smithi152.stdout:fs_name cephfs 2023-12-06T15:02:06.289 INFO:teuthology.orchestra.run.smithi152.stdout:epoch 16 2023-12-06T15:02:06.289 INFO:teuthology.orchestra.run.smithi152.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-06T15:02:06.289 INFO:teuthology.orchestra.run.smithi152.stdout:created 2023-12-06T14:57:59.352201+0000 2023-12-06T15:02:06.289 INFO:teuthology.orchestra.run.smithi152.stdout:modified 2023-12-06T15:01:48.235717+0000 2023-12-06T15:02:06.289 INFO:teuthology.orchestra.run.smithi152.stdout:tableserver 0 2023-12-06T15:02:06.289 INFO:teuthology.orchestra.run.smithi152.stdout:root 0 2023-12-06T15:02:06.289 INFO:teuthology.orchestra.run.smithi152.stdout:session_timeout 60 2023-12-06T15:02:06.289 INFO:teuthology.orchestra.run.smithi152.stdout:session_autoclose 300 2023-12-06T15:02:06.289 INFO:teuthology.orchestra.run.smithi152.stdout:max_file_size 1099511627776 2023-12-06T15:02:06.289 INFO:teuthology.orchestra.run.smithi152.stdout:max_xattr_size 65536 2023-12-06T15:02:06.289 INFO:teuthology.orchestra.run.smithi152.stdout:required_client_features {} 2023-12-06T15:02:06.289 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure 0 2023-12-06T15:02:06.289 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure_osd_epoch 0 2023-12-06T15:02:06.290 INFO:teuthology.orchestra.run.smithi152.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-06T15:02:06.290 INFO:teuthology.orchestra.run.smithi152.stdout:max_mds 2 2023-12-06T15:02:06.290 INFO:teuthology.orchestra.run.smithi152.stdout:in 0,1 2023-12-06T15:02:06.290 INFO:teuthology.orchestra.run.smithi152.stdout:up {0=14464,1=24255} 2023-12-06T15:02:06.290 INFO:teuthology.orchestra.run.smithi152.stdout:failed 2023-12-06T15:02:06.290 INFO:teuthology.orchestra.run.smithi152.stdout:damaged 2023-12-06T15:02:06.290 INFO:teuthology.orchestra.run.smithi152.stdout:stopped 2023-12-06T15:02:06.290 INFO:teuthology.orchestra.run.smithi152.stdout:data_pools [3] 2023-12-06T15:02:06.290 INFO:teuthology.orchestra.run.smithi152.stdout:metadata_pool 2 2023-12-06T15:02:06.290 INFO:teuthology.orchestra.run.smithi152.stdout:inline_data disabled 2023-12-06T15:02:06.290 INFO:teuthology.orchestra.run.smithi152.stdout:balancer 2023-12-06T15:02:06.290 INFO:teuthology.orchestra.run.smithi152.stdout:bal_rank_mask -1 2023-12-06T15:02:06.290 INFO:teuthology.orchestra.run.smithi152.stdout:standby_count_wanted 1 2023-12-06T15:02:06.290 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.acqswy{0:14464} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.152:6826/2467413186,v1:172.21.15.152:6827/2467413186] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:02:06.291 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi190.edwtqj{0:24271} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.190:6826/2256465065,v1:172.21.15.190:6827/2256465065] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:02:06.291 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi190.uucxzu{1:24255} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.190:6824/3250692478,v1:172.21.15.190:6825/3250692478] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:02:06.291 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.ypivwc{1:14480} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.152:6828/697313573,v1:172.21.15.152:6829/697313573] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:02:06.291 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T15:02:06.291 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T15:02:06.292 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.290+0000 7f6289255700 1 -- 172.21.15.152:0/1974527321 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f626c06cf80 msgr2=0x7f626c06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:06.292 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.290+0000 7f6289255700 1 --2- 172.21.15.152:0/1974527321 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f626c06cf80 0x7f626c06f430 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6274009b80 tx=0x7f627400b040 comp rx=0 tx=0).stop 2023-12-06T15:02:06.292 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.290+0000 7f6289255700 1 -- 172.21.15.152:0/1974527321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62840fbaf0 msgr2=0x7f628410c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:06.292 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.290+0000 7f6289255700 1 --2- 172.21.15.152:0/1974527321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62840fbaf0 0x7f628410c3f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6278009fd0 tx=0x7f6278009e30 comp rx=0 tx=0).stop 2023-12-06T15:02:06.292 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.290+0000 7f6289255700 1 -- 172.21.15.152:0/1974527321 shutdown_connections 2023-12-06T15:02:06.292 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.290+0000 7f6289255700 1 --2- 172.21.15.152:0/1974527321 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f626c06cf80 0x7f626c06f430 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:06.292 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.290+0000 7f6289255700 1 --2- 172.21.15.152:0/1974527321 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f62840fbaf0 0x7f628410c3f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:06.292 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.290+0000 7f6289255700 1 --2- 172.21.15.152:0/1974527321 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62840fcd00 0x7f628410c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:06.292 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.290+0000 7f6289255700 1 -- 172.21.15.152:0/1974527321 >> 172.21.15.152:0/1974527321 conn(0x7f62840f7190 msgr2=0x7f62840fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:02:06.292 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.290+0000 7f6289255700 1 -- 172.21.15.152:0/1974527321 shutdown_connections 2023-12-06T15:02:06.292 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.290+0000 7f6289255700 1 -- 172.21.15.152:0/1974527321 wait complete. 2023-12-06T15:02:06.292 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 16 2023-12-06T15:02:06.393 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.393+0000 7fbac5d0f700 1 -- 172.21.15.152:0/2815757957 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbac00fcd00 msgr2=0x7fbac00fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:06.393 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.393+0000 7fbac5d0f700 1 --2- 172.21.15.152:0/2815757957 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbac00fcd00 0x7fbac00fd150 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbab4004940 tx=0x7fbab4009e30 comp rx=0 tx=0).stop 2023-12-06T15:02:06.394 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.393+0000 7fbac5d0f700 1 -- 172.21.15.152:0/2815757957 shutdown_connections 2023-12-06T15:02:06.394 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.393+0000 7fbac5d0f700 1 --2- 172.21.15.152:0/2815757957 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbac00fcd00 0x7fbac00fd150 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:06.394 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.393+0000 7fbac5d0f700 1 --2- 172.21.15.152:0/2815757957 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbac00fbaf0 0x7fbac00fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:06.394 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.393+0000 7fbac5d0f700 1 -- 172.21.15.152:0/2815757957 >> 172.21.15.152:0/2815757957 conn(0x7fbac00f7190 msgr2=0x7fbac00f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:02:06.394 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.393+0000 7fbac5d0f700 1 -- 172.21.15.152:0/2815757957 shutdown_connections 2023-12-06T15:02:06.394 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.393+0000 7fbac5d0f700 1 -- 172.21.15.152:0/2815757957 wait complete. 2023-12-06T15:02:06.394 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.393+0000 7fbac5d0f700 1 Processor -- start 2023-12-06T15:02:06.395 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.394+0000 7fbac5d0f700 1 -- start start 2023-12-06T15:02:06.395 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.394+0000 7fbac5d0f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbac00fbaf0 0x7fbac01101d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:06.396 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.394+0000 7fbac5d0f700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbac00fcd00 0x7fbac0112720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:06.396 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.394+0000 7fbac5d0f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac0066130 con 0x7fbac00fbaf0 2023-12-06T15:02:06.396 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.394+0000 7fbac5d0f700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac0066270 con 0x7fbac00fcd00 2023-12-06T15:02:06.396 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.394+0000 7fbabf7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbac00fbaf0 0x7fbac01101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:06.396 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.394+0000 7fbabf7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbac00fbaf0 0x7fbac01101d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48414/0 (socket says 172.21.15.152:48414) 2023-12-06T15:02:06.396 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.394+0000 7fbabf7fe700 1 -- 172.21.15.152:0/2791282566 learned_addr learned my addr 172.21.15.152:0/2791282566 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:02:06.396 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.394+0000 7fbabeffd700 1 --2- 172.21.15.152:0/2791282566 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbac00fcd00 0x7fbac0112720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:06.397 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.394+0000 7fbabf7fe700 1 -- 172.21.15.152:0/2791282566 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbac00fcd00 msgr2=0x7fbac0112720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:06.397 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.394+0000 7fbabf7fe700 1 --2- 172.21.15.152:0/2791282566 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbac00fcd00 0x7fbac0112720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:06.397 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.394+0000 7fbabf7fe700 1 -- 172.21.15.152:0/2791282566 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab4005040 con 0x7fbac00fbaf0 2023-12-06T15:02:06.397 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.395+0000 7fbabf7fe700 1 --2- 172.21.15.152:0/2791282566 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbac00fbaf0 0x7fbac01101d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbab0002a80 tx=0x7fbab00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:02:06.397 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.395+0000 7fbaa7fff700 1 -- 172.21.15.152:0/2791282566 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbab0007cc0 con 0x7fbac00fbaf0 2023-12-06T15:02:06.397 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.395+0000 7fbaa7fff700 1 -- 172.21.15.152:0/2791282566 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbab000f040 con 0x7fbac00fbaf0 2023-12-06T15:02:06.397 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.395+0000 7fbac5d0f700 1 -- 172.21.15.152:0/2791282566 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac0112d80 con 0x7fbac00fbaf0 2023-12-06T15:02:06.398 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.395+0000 7fbaa7fff700 1 -- 172.21.15.152:0/2791282566 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbab000d9e0 con 0x7fbac00fbaf0 2023-12-06T15:02:06.398 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.395+0000 7fbac5d0f700 1 -- 172.21.15.152:0/2791282566 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac0113210 con 0x7fbac00fbaf0 2023-12-06T15:02:06.399 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.396+0000 7fbac5d0f700 1 -- 172.21.15.152:0/2791282566 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac004bb80 con 0x7fbac00fbaf0 2023-12-06T15:02:06.399 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.396+0000 7fbaa7fff700 1 -- 172.21.15.152:0/2791282566 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 37) v1 ==== 91040+0+0 (secure 0 0 0) 0x7fbab000db40 con 0x7fbac00fbaf0 2023-12-06T15:02:06.399 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.397+0000 7fbaa7fff700 1 --2- 172.21.15.152:0/2791282566 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fbaa806cf80 0x7fbaa806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:06.400 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.397+0000 7fbaa7fff700 1 -- 172.21.15.152:0/2791282566 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fbab008bc30 con 0x7fbac00fbaf0 2023-12-06T15:02:06.400 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.397+0000 7fbabeffd700 1 --2- 172.21.15.152:0/2791282566 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fbaa806cf80 0x7fbaa806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:06.400 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.397+0000 7fbabeffd700 1 --2- 172.21.15.152:0/2791282566 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fbaa806cf80 0x7fbaa806f430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbab4004890 tx=0x7fbab4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:02:06.402 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.402+0000 7fbaa7fff700 1 -- 172.21.15.152:0/2791282566 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fbab0055970 con 0x7fbac00fbaf0 2023-12-06T15:02:06.612 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.612+0000 7fbac5d0f700 1 -- 172.21.15.152:0/2791282566 --> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbac0101650 con 0x7fbaa806cf80 2023-12-06T15:02:06.613 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.613+0000 7fbaa7fff700 1 -- 172.21.15.152:0/2791282566 <== mgr.34104 v2:172.21.15.152:6800/2427836422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fbac0101650 con 0x7fbaa806cf80 2023-12-06T15:02:06.613 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-12-06T15:02:06.613 INFO:teuthology.orchestra.run.smithi152.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e331a81036b9c4be9167bdaf54e458c7294ca3446212b9c6126786d23318b1cf", 2023-12-06T15:02:06.613 INFO:teuthology.orchestra.run.smithi152.stdout: "in_progress": true, 2023-12-06T15:02:06.613 INFO:teuthology.orchestra.run.smithi152.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-06T15:02:06.614 INFO:teuthology.orchestra.run.smithi152.stdout: "services_complete": [ 2023-12-06T15:02:06.614 INFO:teuthology.orchestra.run.smithi152.stdout: "mon", 2023-12-06T15:02:06.614 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr" 2023-12-06T15:02:06.614 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2023-12-06T15:02:06.614 INFO:teuthology.orchestra.run.smithi152.stdout: "progress": "4/21 daemons upgraded", 2023-12-06T15:02:06.614 INFO:teuthology.orchestra.run.smithi152.stdout: "message": "Currently upgrading mon daemons", 2023-12-06T15:02:06.614 INFO:teuthology.orchestra.run.smithi152.stdout: "is_paused": false 2023-12-06T15:02:06.614 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-12-06T15:02:06.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.615+0000 7fbac5d0f700 1 -- 172.21.15.152:0/2791282566 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fbaa806cf80 msgr2=0x7fbaa806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:06.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.615+0000 7fbac5d0f700 1 --2- 172.21.15.152:0/2791282566 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fbaa806cf80 0x7fbaa806f430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbab4004890 tx=0x7fbab4009e30 comp rx=0 tx=0).stop 2023-12-06T15:02:06.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.615+0000 7fbac5d0f700 1 -- 172.21.15.152:0/2791282566 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbac00fbaf0 msgr2=0x7fbac01101d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:06.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.615+0000 7fbac5d0f700 1 --2- 172.21.15.152:0/2791282566 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbac00fbaf0 0x7fbac01101d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbab0002a80 tx=0x7fbab00046b0 comp rx=0 tx=0).stop 2023-12-06T15:02:06.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.615+0000 7fbac5d0f700 1 -- 172.21.15.152:0/2791282566 shutdown_connections 2023-12-06T15:02:06.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.615+0000 7fbac5d0f700 1 --2- 172.21.15.152:0/2791282566 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fbaa806cf80 0x7fbaa806f430 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:06.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.615+0000 7fbac5d0f700 1 --2- 172.21.15.152:0/2791282566 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbac00fbaf0 0x7fbac01101d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:06.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.615+0000 7fbac5d0f700 1 --2- 172.21.15.152:0/2791282566 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbac00fcd00 0x7fbac0112720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:06.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.615+0000 7fbac5d0f700 1 -- 172.21.15.152:0/2791282566 >> 172.21.15.152:0/2791282566 conn(0x7fbac00f7190 msgr2=0x7fbac00fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:02:06.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.615+0000 7fbac5d0f700 1 -- 172.21.15.152:0/2791282566 shutdown_connections 2023-12-06T15:02:06.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.615+0000 7fbac5d0f700 1 -- 172.21.15.152:0/2791282566 wait complete. 2023-12-06T15:02:06.717 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.717+0000 7f1c4580f700 1 -- 172.21.15.152:0/1034404641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c400feb80 msgr2=0x7f1c400facc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:06.718 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.717+0000 7f1c4580f700 1 --2- 172.21.15.152:0/1034404641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c400feb80 0x7f1c400facc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1c30004940 tx=0x7f1c30009e30 comp rx=0 tx=0).stop 2023-12-06T15:02:06.718 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.717+0000 7f1c4580f700 1 -- 172.21.15.152:0/1034404641 shutdown_connections 2023-12-06T15:02:06.718 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.717+0000 7f1c4580f700 1 --2- 172.21.15.152:0/1034404641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c400feb80 0x7f1c400facc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:06.718 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.717+0000 7f1c4580f700 1 --2- 172.21.15.152:0/1034404641 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c400fe230 0x7f1c400fe640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:06.718 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.717+0000 7f1c4580f700 1 -- 172.21.15.152:0/1034404641 >> 172.21.15.152:0/1034404641 conn(0x7f1c400f69d0 msgr2=0x7f1c400f8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:02:06.718 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.717+0000 7f1c4580f700 1 -- 172.21.15.152:0/1034404641 shutdown_connections 2023-12-06T15:02:06.718 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.717+0000 7f1c4580f700 1 -- 172.21.15.152:0/1034404641 wait complete. 2023-12-06T15:02:06.720 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.718+0000 7f1c4580f700 1 Processor -- start 2023-12-06T15:02:06.720 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.718+0000 7f1c4580f700 1 -- start start 2023-12-06T15:02:06.720 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.718+0000 7f1c4580f700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c400fe230 0x7f1c4010d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:06.720 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.718+0000 7f1c4580f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c400feb80 0x7f1c4010dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:06.720 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.718+0000 7f1c4580f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4010e300 con 0x7f1c400feb80 2023-12-06T15:02:06.720 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.718+0000 7f1c4580f700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4010eba0 con 0x7f1c400fe230 2023-12-06T15:02:06.720 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.718+0000 7f1c3e7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c400feb80 0x7f1c4010dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:06.720 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.718+0000 7f1c3e7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c400feb80 0x7f1c4010dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48426/0 (socket says 172.21.15.152:48426) 2023-12-06T15:02:06.720 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.718+0000 7f1c3e7fc700 1 -- 172.21.15.152:0/1618355323 learned_addr learned my addr 172.21.15.152:0/1618355323 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:02:06.720 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.718+0000 7f1c3effd700 1 --2- 172.21.15.152:0/1618355323 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c400fe230 0x7f1c4010d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:06.720 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.719+0000 7f1c3e7fc700 1 -- 172.21.15.152:0/1618355323 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c400fe230 msgr2=0x7f1c4010d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:06.720 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.719+0000 7f1c3e7fc700 1 --2- 172.21.15.152:0/1618355323 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c400fe230 0x7f1c4010d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:06.720 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.719+0000 7f1c3e7fc700 1 -- 172.21.15.152:0/1618355323 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c30005040 con 0x7f1c400feb80 2023-12-06T15:02:06.721 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.719+0000 7f1c3e7fc700 1 --2- 172.21.15.152:0/1618355323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c400feb80 0x7f1c4010dd00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1c30000c00 tx=0x7f1c30009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:02:06.721 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.719+0000 7f1c277fe700 1 -- 172.21.15.152:0/1618355323 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c30021070 con 0x7f1c400feb80 2023-12-06T15:02:06.721 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.719+0000 7f1c4580f700 1 -- 172.21.15.152:0/1618355323 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c4010ee20 con 0x7f1c400feb80 2023-12-06T15:02:06.721 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.719+0000 7f1c277fe700 1 -- 172.21.15.152:0/1618355323 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1c3001c400 con 0x7f1c400feb80 2023-12-06T15:02:06.721 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.719+0000 7f1c277fe700 1 -- 172.21.15.152:0/1618355323 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c3000e070 con 0x7f1c400feb80 2023-12-06T15:02:06.721 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.719+0000 7f1c4580f700 1 -- 172.21.15.152:0/1618355323 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c4010f300 con 0x7f1c400feb80 2023-12-06T15:02:06.721 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.720+0000 7f1c4580f700 1 -- 172.21.15.152:0/1618355323 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c401075e0 con 0x7f1c400feb80 2023-12-06T15:02:06.722 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.720+0000 7f1c277fe700 1 -- 172.21.15.152:0/1618355323 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 37) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f1c3001c9c0 con 0x7f1c400feb80 2023-12-06T15:02:06.722 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.721+0000 7f1c277fe700 1 --2- 172.21.15.152:0/1618355323 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f1c2806cf80 0x7f1c2806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:06.722 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.721+0000 7f1c277fe700 1 -- 172.21.15.152:0/1618355323 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f1c3008d6f0 con 0x7f1c400feb80 2023-12-06T15:02:06.722 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.721+0000 7f1c3effd700 1 --2- 172.21.15.152:0/1618355323 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f1c2806cf80 0x7f1c2806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:06.722 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.721+0000 7f1c3effd700 1 --2- 172.21.15.152:0/1618355323 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f1c2806cf80 0x7f1c2806f430 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1c34009b80 tx=0x7f1c3400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:02:06.725 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:06.725+0000 7f1c277fe700 1 -- 172.21.15.152:0/1618355323 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1c3005aec0 con 0x7f1c400feb80 2023-12-06T15:02:06.736 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:06 smithi190 ceph-mon[178398]: from='client.34156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:02:06.736 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:06 smithi190 ceph-mon[178398]: Reconfiguring osd.3 (monmap changed)... 2023-12-06T15:02:06.736 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:06 smithi190 ceph-mon[178398]: Reconfiguring daemon osd.3 on smithi190 2023-12-06T15:02:06.736 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:06 smithi190 ceph-mon[178398]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:02:06.736 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:06 smithi190 ceph-mon[178398]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:02:06.736 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:06 smithi190 ceph-mon[178398]: from='client.? 172.21.15.152:0/344343781' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:02:06.736 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:06 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:06.736 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:06 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:06.736 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:06 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-06T15:02:06.736 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:06 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:02:06.736 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:06 smithi190 ceph-mon[178398]: from='client.? 172.21.15.152:0/1974527321' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-06T15:02:06.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:06 smithi152 ceph-mon[192652]: from='client.34156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:02:06.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:06 smithi152 ceph-mon[192652]: Reconfiguring osd.3 (monmap changed)... 2023-12-06T15:02:06.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:06 smithi152 ceph-mon[192652]: Reconfiguring daemon osd.3 on smithi190 2023-12-06T15:02:06.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:06 smithi152 ceph-mon[192652]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:02:06.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:06 smithi152 ceph-mon[192652]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:02:06.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:06 smithi152 ceph-mon[192652]: from='client.? 172.21.15.152:0/344343781' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:02:06.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:06 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:06.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:06 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:06.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:06 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-06T15:02:06.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:06 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:02:06.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:06 smithi152 ceph-mon[192652]: from='client.? 172.21.15.152:0/1974527321' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-06T15:02:07.002 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:07.002+0000 7f1c4580f700 1 -- 172.21.15.152:0/1618355323 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1c4004bb80 con 0x7f1c400feb80 2023-12-06T15:02:07.002 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:07.002+0000 7f1c277fe700 1 -- 172.21.15.152:0/1618355323 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f1c3005aa50 con 0x7f1c400feb80 2023-12-06T15:02:07.002 INFO:teuthology.orchestra.run.smithi152.stdout:HEALTH_OK 2023-12-06T15:02:07.004 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:07.004+0000 7f1c4580f700 1 -- 172.21.15.152:0/1618355323 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f1c2806cf80 msgr2=0x7f1c2806f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:07.004 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:07.004+0000 7f1c4580f700 1 --2- 172.21.15.152:0/1618355323 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f1c2806cf80 0x7f1c2806f430 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1c34009b80 tx=0x7f1c3400b040 comp rx=0 tx=0).stop 2023-12-06T15:02:07.004 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:07.004+0000 7f1c4580f700 1 -- 172.21.15.152:0/1618355323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c400feb80 msgr2=0x7f1c4010dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:07.005 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:07.004+0000 7f1c4580f700 1 --2- 172.21.15.152:0/1618355323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c400feb80 0x7f1c4010dd00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1c30000c00 tx=0x7f1c30009e30 comp rx=0 tx=0).stop 2023-12-06T15:02:07.005 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:07.004+0000 7f1c4580f700 1 -- 172.21.15.152:0/1618355323 shutdown_connections 2023-12-06T15:02:07.005 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:07.004+0000 7f1c4580f700 1 --2- 172.21.15.152:0/1618355323 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f1c2806cf80 0x7f1c2806f430 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:07.005 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:07.004+0000 7f1c4580f700 1 --2- 172.21.15.152:0/1618355323 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c400fe230 0x7f1c4010d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:07.005 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:07.004+0000 7f1c4580f700 1 --2- 172.21.15.152:0/1618355323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c400feb80 0x7f1c4010dd00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:07.005 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:07.004+0000 7f1c4580f700 1 -- 172.21.15.152:0/1618355323 >> 172.21.15.152:0/1618355323 conn(0x7f1c400f69d0 msgr2=0x7f1c40101370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:02:07.005 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:07.004+0000 7f1c4580f700 1 -- 172.21.15.152:0/1618355323 shutdown_connections 2023-12-06T15:02:07.005 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:07.004+0000 7f1c4580f700 1 -- 172.21.15.152:0/1618355323 wait complete. 2023-12-06T15:02:07.802 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:07 smithi190 ceph-mon[178398]: Reconfiguring osd.4 (monmap changed)... 2023-12-06T15:02:07.802 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:07 smithi190 ceph-mon[178398]: Reconfiguring daemon osd.4 on smithi190 2023-12-06T15:02:07.802 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:07 smithi190 ceph-mon[178398]: pgmap v21: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:02:07.802 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:07 smithi190 ceph-mon[178398]: from='client.34176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:02:07.802 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:07 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:07.803 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:07 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:07.803 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:07 smithi190 ceph-mon[178398]: from='client.? 172.21.15.152:0/1618355323' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-06T15:02:07.803 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:07 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-06T15:02:07.803 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:07 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:02:07.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:07 smithi152 ceph-mon[192652]: Reconfiguring osd.4 (monmap changed)... 2023-12-06T15:02:07.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:07 smithi152 ceph-mon[192652]: Reconfiguring daemon osd.4 on smithi190 2023-12-06T15:02:07.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:07 smithi152 ceph-mon[192652]: pgmap v21: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:02:07.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:07 smithi152 ceph-mon[192652]: from='client.34176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:02:07.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:07 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:07.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:07 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:07.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:07 smithi152 ceph-mon[192652]: from='client.? 172.21.15.152:0/1618355323' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-06T15:02:07.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:07 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-06T15:02:07.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:07 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:02:08.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:08 smithi190 ceph-mon[178398]: Reconfiguring osd.5 (monmap changed)... 2023-12-06T15:02:08.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:08 smithi190 ceph-mon[178398]: Reconfiguring daemon osd.5 on smithi190 2023-12-06T15:02:08.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:08 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:08.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:08 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:08.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:08 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi190.uucxzu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-06T15:02:08.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:08 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:02:08.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:08 smithi152 ceph-mon[192652]: Reconfiguring osd.5 (monmap changed)... 2023-12-06T15:02:08.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:08 smithi152 ceph-mon[192652]: Reconfiguring daemon osd.5 on smithi190 2023-12-06T15:02:08.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:08 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:08.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:08 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:08.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:08 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi190.uucxzu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-06T15:02:08.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:08 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:02:09.810 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:09 smithi190 ceph-mon[178398]: Reconfiguring mds.cephfs.smithi190.uucxzu (monmap changed)... 2023-12-06T15:02:09.811 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:09 smithi190 ceph-mon[178398]: Reconfiguring daemon mds.cephfs.smithi190.uucxzu on smithi190 2023-12-06T15:02:09.811 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:09 smithi190 ceph-mon[178398]: pgmap v22: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.6 KiB/s rd, 5 op/s 2023-12-06T15:02:09.811 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:09 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:09.811 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:09 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:09.811 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:09 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi190.edwtqj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-06T15:02:09.811 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:09 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:02:09.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:09 smithi152 ceph-mon[192652]: Reconfiguring mds.cephfs.smithi190.uucxzu (monmap changed)... 2023-12-06T15:02:09.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:09 smithi152 ceph-mon[192652]: Reconfiguring daemon mds.cephfs.smithi190.uucxzu on smithi190 2023-12-06T15:02:09.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:09 smithi152 ceph-mon[192652]: pgmap v22: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.6 KiB/s rd, 5 op/s 2023-12-06T15:02:09.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:09 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:09.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:09 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:09.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:09 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi190.edwtqj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-06T15:02:09.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:09 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:02:10.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:10 smithi190 ceph-mon[178398]: Reconfiguring mds.cephfs.smithi190.edwtqj (monmap changed)... 2023-12-06T15:02:10.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:10 smithi190 ceph-mon[178398]: Reconfiguring daemon mds.cephfs.smithi190.edwtqj on smithi190 2023-12-06T15:02:10.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:10 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:10.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:10 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:10.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:10 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:02:10.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:10 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:02:10.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:10 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:02:10.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:10 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:10.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:10 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi152"}]: dispatch 2023-12-06T15:02:10.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:10 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi152"}]': finished 2023-12-06T15:02:10.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:10 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi190"}]: dispatch 2023-12-06T15:02:10.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:10 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi190"}]': finished 2023-12-06T15:02:10.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:10 smithi152 ceph-mon[192652]: Reconfiguring mds.cephfs.smithi190.edwtqj (monmap changed)... 2023-12-06T15:02:10.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:10 smithi152 ceph-mon[192652]: Reconfiguring daemon mds.cephfs.smithi190.edwtqj on smithi190 2023-12-06T15:02:10.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:10 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:10.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:10 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:10.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:10 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:02:10.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:10 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:02:10.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:10 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:02:10.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:10 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:10.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:10 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi152"}]: dispatch 2023-12-06T15:02:10.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:10 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi152"}]': finished 2023-12-06T15:02:10.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:10 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi190"}]: dispatch 2023-12-06T15:02:10.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:10 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi190"}]': finished 2023-12-06T15:02:11.577 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:11 smithi152 ceph-mon[192652]: Upgrade: Setting container_image for all mon 2023-12-06T15:02:11.577 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:11 smithi152 ceph-mon[192652]: pgmap v23: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:02:11.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:11 smithi190 ceph-mon[178398]: Upgrade: Setting container_image for all mon 2023-12-06T15:02:11.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:11 smithi190 ceph-mon[178398]: pgmap v23: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:02:13.304 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:12 smithi152 ceph-mon[192652]: Upgrade: Updating crash.smithi152 (1/2) 2023-12-06T15:02:13.305 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:12 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:13.305 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:12 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-06T15:02:13.305 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:12 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:02:13.305 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:12 smithi152 ceph-mon[192652]: Deploying daemon crash.smithi152 on smithi152 2023-12-06T15:02:13.306 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:12 smithi152 ceph-mon[192652]: pgmap v24: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:02:13.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:12 smithi190 ceph-mon[178398]: Upgrade: Updating crash.smithi152 (1/2) 2023-12-06T15:02:13.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:12 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:13.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:12 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi152", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-06T15:02:13.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:12 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:02:13.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:12 smithi190 ceph-mon[178398]: Deploying daemon crash.smithi152 on smithi152 2023-12-06T15:02:13.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:12 smithi190 ceph-mon[178398]: pgmap v24: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:02:15.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:15 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:15.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:15 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:15.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:15 smithi190 ceph-mon[178398]: pgmap v25: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:02:15.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:15 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:15.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:15 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:15.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:15 smithi152 ceph-mon[192652]: pgmap v25: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:02:16.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:16 smithi190 ceph-mon[178398]: Upgrade: Updating crash.smithi190 (2/2) 2023-12-06T15:02:16.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:16 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:16.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:16 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi190", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-06T15:02:16.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:16 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:02:16.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:16 smithi190 ceph-mon[178398]: Deploying daemon crash.smithi190 on smithi190 2023-12-06T15:02:16.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:16 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:02:16.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:16 smithi152 ceph-mon[192652]: Upgrade: Updating crash.smithi190 (2/2) 2023-12-06T15:02:16.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:16 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:16.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:16 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi190", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-06T15:02:16.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:16 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:02:16.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:16 smithi152 ceph-mon[192652]: Deploying daemon crash.smithi190 on smithi190 2023-12-06T15:02:16.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:16 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:02:17.748 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:17 smithi190 ceph-mon[178398]: pgmap v26: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:02:17.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:17 smithi152 ceph-mon[192652]: pgmap v26: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:02:19.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:18 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:19.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:18 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:19.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:18 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:02:19.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:18 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:19.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:18 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:19.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:18 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:02:20.063 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:19 smithi152 ceph-mon[192652]: pgmap v27: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:02:20.063 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:19 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:20.063 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:19 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:20.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:19 smithi190 ceph-mon[178398]: pgmap v27: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:02:20.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:19 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:20.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:19 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:21.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:21 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:21.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:21 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:21.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:21 smithi190 ceph-mon[178398]: pgmap v28: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:02:21.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:21 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:21.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:21 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:21.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:21 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:21.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:21 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:21.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:21 smithi152 ceph-mon[192652]: pgmap v28: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:02:21.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:21 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:21.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:21 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:22.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:22 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:22.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:22 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:23.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:22 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:23.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:22 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:23.979 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:23 smithi152 ceph-mon[192652]: pgmap v29: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:02:23.979 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:23 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:23.979 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:23 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:24.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:23 smithi190 ceph-mon[178398]: pgmap v29: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:02:24.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:23 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:24.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:23 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:25.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:25 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:25.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:25 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:25.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:25 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:02:25.381 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:25 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T15:02:25.381 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:25 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:25.381 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:25 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:02:25.381 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:25 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:02:25.381 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:25 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:02:25.381 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:25 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:02:25.381 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:25 smithi152 ceph-mon[192652]: Upgrade: Setting container_image for all crash 2023-12-06T15:02:25.381 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:25 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:25.381 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:25 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi152"}]: dispatch 2023-12-06T15:02:25.382 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:25 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi152"}]': finished 2023-12-06T15:02:25.382 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:25 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi190"}]: dispatch 2023-12-06T15:02:25.382 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:25 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi190"}]': finished 2023-12-06T15:02:25.382 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:25 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-06T15:02:25.382 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:25 smithi152 ceph-mon[192652]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-06T15:02:25.382 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:25 smithi152 ceph-mon[192652]: Upgrade: osd.0 is safe to restart 2023-12-06T15:02:25.382 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:25 smithi152 ceph-mon[192652]: pgmap v30: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:02:25.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:25 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:25.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:25 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:25.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:25 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:02:25.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:25 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T15:02:25.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:25 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:25.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:25 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:02:25.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:25 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:02:25.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:25 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:02:25.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:25 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:02:25.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:25 smithi190 ceph-mon[178398]: Upgrade: Setting container_image for all crash 2023-12-06T15:02:25.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:25 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:25.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:25 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi152"}]: dispatch 2023-12-06T15:02:25.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:25 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi152"}]': finished 2023-12-06T15:02:25.574 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:25 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi190"}]: dispatch 2023-12-06T15:02:25.574 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:25 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi190"}]': finished 2023-12-06T15:02:25.574 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:25 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-06T15:02:25.574 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:25 smithi190 ceph-mon[178398]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2023-12-06T15:02:25.574 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:25 smithi190 ceph-mon[178398]: Upgrade: osd.0 is safe to restart 2023-12-06T15:02:25.574 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:25 smithi190 ceph-mon[178398]: pgmap v30: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:02:26.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:26 smithi190 ceph-mon[178398]: Upgrade: Updating osd.0 2023-12-06T15:02:26.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:26 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:26.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:26 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-06T15:02:26.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:26 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:02:26.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:26 smithi190 ceph-mon[178398]: Deploying daemon osd.0 on smithi152 2023-12-06T15:02:26.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:26 smithi152 ceph-mon[192652]: Upgrade: Updating osd.0 2023-12-06T15:02:26.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:26 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:26.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:26 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-06T15:02:26.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:26 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:02:26.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:26 smithi152 ceph-mon[192652]: Deploying daemon osd.0 on smithi152 2023-12-06T15:02:27.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:27 smithi152 ceph-mon[192652]: pgmap v31: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:02:27.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:27 smithi190 ceph-mon[178398]: pgmap v31: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:02:27.985 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 15:02:27 smithi152 systemd[1]: Stopping Ceph osd.0 for 062f0e3c-9447-11ee-95a2-87774f69a715... 2023-12-06T15:02:28.378 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 15:02:27 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-0[135495]: 2023-12-06T15:02:27.984+0000 7f4fa8534700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-06T15:02:28.378 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 15:02:27 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-0[135495]: 2023-12-06T15:02:27.984+0000 7f4fa8534700 -1 osd.0 48 *** Got signal Terminated *** 2023-12-06T15:02:28.378 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 15:02:27 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-0[135495]: 2023-12-06T15:02:27.984+0000 7f4fa8534700 -1 osd.0 48 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-06T15:02:28.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:28 smithi190 ceph-mon[178398]: osd.0 marked itself down and dead 2023-12-06T15:02:28.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:28 smithi152 ceph-mon[192652]: osd.0 marked itself down and dead 2023-12-06T15:02:29.464 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 15:02:29 smithi152 bash[202260]: ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-0 2023-12-06T15:02:29.741 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:29 smithi152 ceph-mon[192652]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-06T15:02:29.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:29 smithi152 ceph-mon[192652]: failed to encode map e49 with expected crc 2023-12-06T15:02:29.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:29 smithi152 ceph-mon[192652]: osdmap e49: 6 total, 5 up, 6 in 2023-12-06T15:02:29.742 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:29 smithi152 ceph-mon[192652]: pgmap v33: 65 pgs: 9 stale+active+clean, 56 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2023-12-06T15:02:29.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:29 smithi190 ceph-mon[178398]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-06T15:02:29.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:29 smithi190 ceph-mon[178398]: failed to encode map e49 with expected crc 2023-12-06T15:02:29.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:29 smithi190 ceph-mon[178398]: osdmap e49: 6 total, 5 up, 6 in 2023-12-06T15:02:29.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:29 smithi190 ceph-mon[178398]: pgmap v33: 65 pgs: 9 stale+active+clean, 56 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2023-12-06T15:02:30.796 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 15:02:30 smithi152 systemd[1]: ceph-062f0e3c-9447-11ee-95a2-87774f69a715@osd.0.service: Succeeded. 2023-12-06T15:02:30.796 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 15:02:30 smithi152 systemd[1]: Stopped Ceph osd.0 for 062f0e3c-9447-11ee-95a2-87774f69a715. 2023-12-06T15:02:30.796 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 15:02:30 smithi152 systemd[1]: Starting Ceph osd.0 for 062f0e3c-9447-11ee-95a2-87774f69a715... 2023-12-06T15:02:30.797 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:30 smithi152 ceph-mon[192652]: failed to encode map e50 with expected crc 2023-12-06T15:02:30.797 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:30 smithi152 ceph-mon[192652]: osdmap e50: 6 total, 5 up, 6 in 2023-12-06T15:02:30.797 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:30 smithi152 ceph-mon[192652]: failed to encode map e50 with expected crc 2023-12-06T15:02:30.797 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:30 smithi152 ceph-mon[192652]: failed to encode map e50 with expected crc 2023-12-06T15:02:30.797 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:30 smithi152 ceph-mon[192652]: failed to encode map e50 with expected crc 2023-12-06T15:02:30.797 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:30 smithi152 ceph-mon[192652]: failed to encode map e50 with expected crc 2023-12-06T15:02:30.797 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:30 smithi152 ceph-mon[192652]: failed to encode map e50 with expected crc 2023-12-06T15:02:30.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:30 smithi190 ceph-mon[178398]: failed to encode map e50 with expected crc 2023-12-06T15:02:30.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:30 smithi190 ceph-mon[178398]: osdmap e50: 6 total, 5 up, 6 in 2023-12-06T15:02:30.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:30 smithi190 ceph-mon[178398]: failed to encode map e50 with expected crc 2023-12-06T15:02:30.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:30 smithi190 ceph-mon[178398]: failed to encode map e50 with expected crc 2023-12-06T15:02:30.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:30 smithi190 ceph-mon[178398]: failed to encode map e50 with expected crc 2023-12-06T15:02:30.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:30 smithi190 ceph-mon[178398]: failed to encode map e50 with expected crc 2023-12-06T15:02:30.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:30 smithi190 ceph-mon[178398]: failed to encode map e50 with expected crc 2023-12-06T15:02:31.628 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 15:02:31 smithi152 bash[202525]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-06T15:02:31.628 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 15:02:31 smithi152 bash[202525]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2023-12-06T15:02:31.628 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 15:02:31 smithi152 bash[202525]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2023-12-06T15:02:31.628 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 15:02:31 smithi152 bash[202525]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2023-12-06T15:02:31.628 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 15:02:31 smithi152 bash[202525]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2023-12-06T15:02:31.629 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 15:02:31 smithi152 bash[202525]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-06T15:02:31.629 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 15:02:31 smithi152 bash[202525]: --> ceph-volume raw activate successful for osd ID: 0 2023-12-06T15:02:31.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:31 smithi152 ceph-mon[192652]: pgmap v35: 65 pgs: 9 stale+active+clean, 56 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-12-06T15:02:31.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:31 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [3, 2]}]: dispatch 2023-12-06T15:02:31.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:31 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [3, 5]}]: dispatch 2023-12-06T15:02:31.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:31 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [3, 2]}]: dispatch 2023-12-06T15:02:31.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:31 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 5]}]: dispatch 2023-12-06T15:02:31.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:31 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.4", "id": [1, 0]}]: dispatch 2023-12-06T15:02:31.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:31 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [1, 2]}]: dispatch 2023-12-06T15:02:31.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:31 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 2]}]: dispatch 2023-12-06T15:02:31.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:31 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 0]}]: dispatch 2023-12-06T15:02:31.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:31 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [3, 0]}]: dispatch 2023-12-06T15:02:31.630 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:31 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:31.630 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:31 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:02:31.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:31 smithi190 ceph-mon[178398]: pgmap v35: 65 pgs: 9 stale+active+clean, 56 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-12-06T15:02:31.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:31 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [3, 2]}]: dispatch 2023-12-06T15:02:31.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:31 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [3, 5]}]: dispatch 2023-12-06T15:02:31.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:31 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [3, 2]}]: dispatch 2023-12-06T15:02:31.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:31 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 5]}]: dispatch 2023-12-06T15:02:31.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:31 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.4", "id": [1, 0]}]: dispatch 2023-12-06T15:02:31.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:31 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [1, 2]}]: dispatch 2023-12-06T15:02:31.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:31 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 2]}]: dispatch 2023-12-06T15:02:31.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:31 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 0]}]: dispatch 2023-12-06T15:02:31.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:31 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [3, 0]}]: dispatch 2023-12-06T15:02:31.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:31 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:31.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:31 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:02:32.378 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 15:02:32 smithi152 ceph-osd[202845]: -- 172.21.15.152:0/1605510321 <== mon.0 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f5b59f51e0 con 0x55f5b59c4c00 2023-12-06T15:02:32.378 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 15:02:32 smithi152 bash[202807]: 05e00966036e50a2ba0fb86db45f4aa2b6152cd5ced9542b37be6c1050c81b41 2023-12-06T15:02:32.378 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 15:02:32 smithi152 systemd[1]: Started Ceph osd.0 for 062f0e3c-9447-11ee-95a2-87774f69a715. 2023-12-06T15:02:32.812 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 15:02:32 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-0[202821]: 2023-12-06T15:02:32.565+0000 7fce0cf62640 -1 Falling back to public interface 2023-12-06T15:02:32.813 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:32 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [3, 2]}]': finished 2023-12-06T15:02:32.813 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:32 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [3, 5]}]': finished 2023-12-06T15:02:32.813 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:32 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [3, 2]}]': finished 2023-12-06T15:02:32.813 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:32 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 5]}]': finished 2023-12-06T15:02:32.813 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:32 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.4", "id": [1, 0]}]': finished 2023-12-06T15:02:32.813 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:32 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [1, 2]}]': finished 2023-12-06T15:02:32.813 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:32 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 2]}]': finished 2023-12-06T15:02:32.813 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:32 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 0]}]': finished 2023-12-06T15:02:32.813 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:32 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [3, 0]}]': finished 2023-12-06T15:02:32.813 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:32 smithi152 ceph-mon[192652]: failed to encode map e51 with expected crc 2023-12-06T15:02:32.813 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:32 smithi152 ceph-mon[192652]: osdmap e51: 6 total, 5 up, 6 in 2023-12-06T15:02:32.813 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:32 smithi152 ceph-mon[192652]: failed to encode map e51 with expected crc 2023-12-06T15:02:32.813 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:32 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:32.813 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:32 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:32.814 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:32 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:02:32.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:32 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [3, 2]}]': finished 2023-12-06T15:02:32.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:32 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [3, 5]}]': finished 2023-12-06T15:02:32.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:32 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [3, 2]}]': finished 2023-12-06T15:02:32.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:32 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 5]}]': finished 2023-12-06T15:02:32.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:32 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.4", "id": [1, 0]}]': finished 2023-12-06T15:02:32.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:32 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [1, 2]}]': finished 2023-12-06T15:02:32.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:32 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 2]}]': finished 2023-12-06T15:02:32.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:32 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 0]}]': finished 2023-12-06T15:02:32.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:32 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [3, 0]}]': finished 2023-12-06T15:02:32.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:32 smithi190 ceph-mon[178398]: failed to encode map e51 with expected crc 2023-12-06T15:02:32.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:32 smithi190 ceph-mon[178398]: osdmap e51: 6 total, 5 up, 6 in 2023-12-06T15:02:32.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:32 smithi190 ceph-mon[178398]: failed to encode map e51 with expected crc 2023-12-06T15:02:32.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:32 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:32.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:32 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:32.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:32 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:02:33.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:33 smithi190 ceph-mon[178398]: failed to encode map e52 with expected crc 2023-12-06T15:02:33.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:33 smithi190 ceph-mon[178398]: osdmap e52: 6 total, 5 up, 6 in 2023-12-06T15:02:33.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:33 smithi190 ceph-mon[178398]: failed to encode map e52 with expected crc 2023-12-06T15:02:33.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:33 smithi190 ceph-mon[178398]: failed to encode map e52 with expected crc 2023-12-06T15:02:33.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:33 smithi190 ceph-mon[178398]: failed to encode map e52 with expected crc 2023-12-06T15:02:33.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:33 smithi190 ceph-mon[178398]: pgmap v38: 65 pgs: 5 peering, 16 active+undersized+degraded, 12 active+undersized, 31 active+clean, 1 stale+active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 55/348 objects degraded (15.805%) 2023-12-06T15:02:33.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:33 smithi152 ceph-mon[192652]: failed to encode map e52 with expected crc 2023-12-06T15:02:33.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:33 smithi152 ceph-mon[192652]: osdmap e52: 6 total, 5 up, 6 in 2023-12-06T15:02:33.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:33 smithi152 ceph-mon[192652]: failed to encode map e52 with expected crc 2023-12-06T15:02:33.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:33 smithi152 ceph-mon[192652]: failed to encode map e52 with expected crc 2023-12-06T15:02:33.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:33 smithi152 ceph-mon[192652]: failed to encode map e52 with expected crc 2023-12-06T15:02:33.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:33 smithi152 ceph-mon[192652]: pgmap v38: 65 pgs: 5 peering, 16 active+undersized+degraded, 12 active+undersized, 31 active+clean, 1 stale+active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 55/348 objects degraded (15.805%) 2023-12-06T15:02:34.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:34 smithi152 ceph-mon[192652]: Health check failed: Degraded data redundancy: 55/348 objects degraded (15.805%), 16 pgs degraded (PG_DEGRADED) 2023-12-06T15:02:34.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:34 smithi152 ceph-mon[192652]: failed to encode map e53 with expected crc 2023-12-06T15:02:34.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:34 smithi152 ceph-mon[192652]: osdmap e53: 6 total, 5 up, 6 in 2023-12-06T15:02:34.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:34 smithi152 ceph-mon[192652]: failed to encode map e53 with expected crc 2023-12-06T15:02:34.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:34 smithi152 ceph-mon[192652]: failed to encode map e53 with expected crc 2023-12-06T15:02:34.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:34 smithi152 ceph-mon[192652]: failed to encode map e53 with expected crc 2023-12-06T15:02:34.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:34 smithi152 ceph-mon[192652]: failed to encode map e53 with expected crc 2023-12-06T15:02:34.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:34 smithi152 ceph-mon[192652]: failed to encode map e53 with expected crc 2023-12-06T15:02:34.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:34 smithi190 ceph-mon[178398]: Health check failed: Degraded data redundancy: 55/348 objects degraded (15.805%), 16 pgs degraded (PG_DEGRADED) 2023-12-06T15:02:34.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:34 smithi190 ceph-mon[178398]: failed to encode map e53 with expected crc 2023-12-06T15:02:34.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:34 smithi190 ceph-mon[178398]: osdmap e53: 6 total, 5 up, 6 in 2023-12-06T15:02:34.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:34 smithi190 ceph-mon[178398]: failed to encode map e53 with expected crc 2023-12-06T15:02:34.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:34 smithi190 ceph-mon[178398]: failed to encode map e53 with expected crc 2023-12-06T15:02:34.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:34 smithi190 ceph-mon[178398]: failed to encode map e53 with expected crc 2023-12-06T15:02:34.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:34 smithi190 ceph-mon[178398]: failed to encode map e53 with expected crc 2023-12-06T15:02:34.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:34 smithi190 ceph-mon[178398]: failed to encode map e53 with expected crc 2023-12-06T15:02:35.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:35 smithi190 ceph-mon[178398]: failed to encode map e54 with expected crc 2023-12-06T15:02:35.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:35 smithi190 ceph-mon[178398]: osdmap e54: 6 total, 5 up, 6 in 2023-12-06T15:02:35.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:35 smithi190 ceph-mon[178398]: failed to encode map e54 with expected crc 2023-12-06T15:02:35.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:35 smithi190 ceph-mon[178398]: failed to encode map e54 with expected crc 2023-12-06T15:02:35.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:35 smithi190 ceph-mon[178398]: pgmap v41: 65 pgs: 5 peering, 16 active+undersized+degraded, 12 active+undersized, 31 active+clean, 1 stale+active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 55/348 objects degraded (15.805%) 2023-12-06T15:02:35.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:35 smithi152 ceph-mon[192652]: failed to encode map e54 with expected crc 2023-12-06T15:02:35.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:35 smithi152 ceph-mon[192652]: osdmap e54: 6 total, 5 up, 6 in 2023-12-06T15:02:35.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:35 smithi152 ceph-mon[192652]: failed to encode map e54 with expected crc 2023-12-06T15:02:35.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:35 smithi152 ceph-mon[192652]: failed to encode map e54 with expected crc 2023-12-06T15:02:35.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:35 smithi152 ceph-mon[192652]: pgmap v41: 65 pgs: 5 peering, 16 active+undersized+degraded, 12 active+undersized, 31 active+clean, 1 stale+active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 55/348 objects degraded (15.805%) 2023-12-06T15:02:36.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:36 smithi190 ceph-mon[178398]: failed to encode map e55 with expected crc 2023-12-06T15:02:36.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:36 smithi190 ceph-mon[178398]: osdmap e55: 6 total, 5 up, 6 in 2023-12-06T15:02:36.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:36 smithi190 ceph-mon[178398]: failed to encode map e55 with expected crc 2023-12-06T15:02:36.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:36 smithi190 ceph-mon[178398]: failed to encode map e55 with expected crc 2023-12-06T15:02:36.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:36 smithi190 ceph-mon[178398]: failed to encode map e55 with expected crc 2023-12-06T15:02:36.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:36 smithi190 ceph-mon[178398]: failed to encode map e55 with expected crc 2023-12-06T15:02:36.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:36 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:36.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:36 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:36.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:36 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:36.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:36 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:36.825 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 15:02:36 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-0[202821]: 2023-12-06T15:02:36.766+0000 7fce0cf62640 -1 osd.0 0 read_superblock omap replica is missing. 2023-12-06T15:02:36.825 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:36 smithi152 ceph-mon[192652]: failed to encode map e55 with expected crc 2023-12-06T15:02:36.825 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:36 smithi152 ceph-mon[192652]: osdmap e55: 6 total, 5 up, 6 in 2023-12-06T15:02:36.825 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:36 smithi152 ceph-mon[192652]: failed to encode map e55 with expected crc 2023-12-06T15:02:36.825 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:36 smithi152 ceph-mon[192652]: failed to encode map e55 with expected crc 2023-12-06T15:02:36.825 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:36 smithi152 ceph-mon[192652]: failed to encode map e55 with expected crc 2023-12-06T15:02:36.826 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:36 smithi152 ceph-mon[192652]: failed to encode map e55 with expected crc 2023-12-06T15:02:36.826 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:36 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:36.826 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:36 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:36.826 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:36 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:36.826 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:36 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:37.129 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.128+0000 7fb051da4700 1 -- 172.21.15.152:0/4283581007 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb04c0fbaf0 msgr2=0x7fb04c0fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:37.129 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.128+0000 7fb051da4700 1 --2- 172.21.15.152:0/4283581007 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb04c0fbaf0 0x7fb04c0fbf00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb03c004940 tx=0x7fb03c009e30 comp rx=0 tx=0).stop 2023-12-06T15:02:37.129 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.128+0000 7fb051da4700 1 -- 172.21.15.152:0/4283581007 shutdown_connections 2023-12-06T15:02:37.129 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.128+0000 7fb051da4700 1 --2- 172.21.15.152:0/4283581007 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb04c0fcd00 0x7fb04c0fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:37.129 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.128+0000 7fb051da4700 1 --2- 172.21.15.152:0/4283581007 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb04c0fbaf0 0x7fb04c0fbf00 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb03c004940 tx=0x7fb03c009e30 comp rx=0 tx=0).stop 2023-12-06T15:02:37.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.128+0000 7fb051da4700 1 -- 172.21.15.152:0/4283581007 >> 172.21.15.152:0/4283581007 conn(0x7fb04c0f7190 msgr2=0x7fb04c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:02:37.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.130+0000 7fb051da4700 1 -- 172.21.15.152:0/4283581007 shutdown_connections 2023-12-06T15:02:37.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.130+0000 7fb051da4700 1 -- 172.21.15.152:0/4283581007 wait complete. 2023-12-06T15:02:37.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.130+0000 7fb051da4700 1 Processor -- start 2023-12-06T15:02:37.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.131+0000 7fb051da4700 1 -- start start 2023-12-06T15:02:37.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.131+0000 7fb051da4700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb04c0fcd00 0x7fb04c10c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:37.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.131+0000 7fb051da4700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb04c10cb10 0x7fb04c10d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:37.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.131+0000 7fb051da4700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c10cfd0 con 0x7fb04c0fcd00 2023-12-06T15:02:37.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.131+0000 7fb051da4700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c10d110 con 0x7fb04c10cb10 2023-12-06T15:02:37.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.131+0000 7fb04b7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb04c0fcd00 0x7fb04c10c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:37.131 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.131+0000 7fb04b7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb04c0fcd00 0x7fb04c10c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51178/0 (socket says 172.21.15.152:51178) 2023-12-06T15:02:37.132 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.131+0000 7fb04b7fe700 1 -- 172.21.15.152:0/1451578518 learned_addr learned my addr 172.21.15.152:0/1451578518 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:02:37.132 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.131+0000 7fb04affd700 1 --2- 172.21.15.152:0/1451578518 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb04c10cb10 0x7fb04c10d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:37.132 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.131+0000 7fb04b7fe700 1 -- 172.21.15.152:0/1451578518 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb04c10cb10 msgr2=0x7fb04c10d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:37.132 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.131+0000 7fb04b7fe700 1 --2- 172.21.15.152:0/1451578518 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb04c10cb10 0x7fb04c10d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:37.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.131+0000 7fb04b7fe700 1 -- 172.21.15.152:0/1451578518 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03c005040 con 0x7fb04c0fcd00 2023-12-06T15:02:37.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.132+0000 7fb04affd700 1 --2- 172.21.15.152:0/1451578518 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb04c10cb10 0x7fb04c10d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-06T15:02:37.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.132+0000 7fb04b7fe700 1 --2- 172.21.15.152:0/1451578518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb04c0fcd00 0x7fb04c10c5d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb03c000c00 tx=0x7fb03c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:02:37.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.132+0000 7fb033fff700 1 -- 172.21.15.152:0/1451578518 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb03c00e070 con 0x7fb04c0fcd00 2023-12-06T15:02:37.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.132+0000 7fb051da4700 1 -- 172.21.15.152:0/1451578518 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb04c10dfb0 con 0x7fb04c0fcd00 2023-12-06T15:02:37.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.132+0000 7fb033fff700 1 -- 172.21.15.152:0/1451578518 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb03c00b410 con 0x7fb04c0fcd00 2023-12-06T15:02:37.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.132+0000 7fb033fff700 1 -- 172.21.15.152:0/1451578518 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb03c012600 con 0x7fb04c0fcd00 2023-12-06T15:02:37.133 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.132+0000 7fb051da4700 1 -- 172.21.15.152:0/1451578518 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb04c10e4c0 con 0x7fb04c0fcd00 2023-12-06T15:02:37.135 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.134+0000 7fb051da4700 1 -- 172.21.15.152:0/1451578518 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb04c10e7a0 con 0x7fb04c0fcd00 2023-12-06T15:02:37.135 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.134+0000 7fb033fff700 1 -- 172.21.15.152:0/1451578518 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 37) v1 ==== 91040+0+0 (secure 0 0 0) 0x7fb03c00b9d0 con 0x7fb04c0fcd00 2023-12-06T15:02:37.135 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.134+0000 7fb033fff700 1 --2- 172.21.15.152:0/1451578518 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fb03406cf80 0x7fb03406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:37.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.134+0000 7fb033fff700 1 -- 172.21.15.152:0/1451578518 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6972+0+0 (secure 0 0 0) 0x7fb03c08d100 con 0x7fb04c0fcd00 2023-12-06T15:02:37.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.135+0000 7fb04affd700 1 --2- 172.21.15.152:0/1451578518 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fb03406cf80 0x7fb03406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:37.136 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.135+0000 7fb04affd700 1 --2- 172.21.15.152:0/1451578518 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fb03406cf80 0x7fb03406f430 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb040009b80 tx=0x7fb04000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:02:37.139 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.139+0000 7fb033fff700 1 -- 172.21.15.152:0/1451578518 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fb03c05a680 con 0x7fb04c0fcd00 2023-12-06T15:02:37.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.375+0000 7fb051da4700 1 -- 172.21.15.152:0/1451578518 --> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb04c065370 con 0x7fb03406cf80 2023-12-06T15:02:37.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.376+0000 7fb033fff700 1 -- 172.21.15.152:0/1451578518 <== mgr.34104 v2:172.21.15.152:6800/2427836422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fb04c065370 con 0x7fb03406cf80 2023-12-06T15:02:37.378 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.378+0000 7fb051da4700 1 -- 172.21.15.152:0/1451578518 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fb03406cf80 msgr2=0x7fb03406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:37.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.378+0000 7fb051da4700 1 --2- 172.21.15.152:0/1451578518 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fb03406cf80 0x7fb03406f430 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb040009b80 tx=0x7fb04000b040 comp rx=0 tx=0).stop 2023-12-06T15:02:37.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.378+0000 7fb051da4700 1 -- 172.21.15.152:0/1451578518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb04c0fcd00 msgr2=0x7fb04c10c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:37.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.378+0000 7fb051da4700 1 --2- 172.21.15.152:0/1451578518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb04c0fcd00 0x7fb04c10c5d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb03c000c00 tx=0x7fb03c009e30 comp rx=0 tx=0).stop 2023-12-06T15:02:37.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.378+0000 7fb051da4700 1 -- 172.21.15.152:0/1451578518 shutdown_connections 2023-12-06T15:02:37.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.378+0000 7fb051da4700 1 --2- 172.21.15.152:0/1451578518 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fb03406cf80 0x7fb03406f430 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:37.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.378+0000 7fb051da4700 1 --2- 172.21.15.152:0/1451578518 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb04c0fcd00 0x7fb04c10c5d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:37.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.379+0000 7fb051da4700 1 --2- 172.21.15.152:0/1451578518 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb04c10cb10 0x7fb04c10d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:37.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.379+0000 7fb051da4700 1 -- 172.21.15.152:0/1451578518 >> 172.21.15.152:0/1451578518 conn(0x7fb04c0f7190 msgr2=0x7fb04c0f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:02:37.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.379+0000 7fb051da4700 1 -- 172.21.15.152:0/1451578518 shutdown_connections 2023-12-06T15:02:37.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.379+0000 7fb051da4700 1 -- 172.21.15.152:0/1451578518 wait complete. 2023-12-06T15:02:37.389 INFO:teuthology.orchestra.run.smithi152.stdout:true 2023-12-06T15:02:37.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.481+0000 7f9d109f3700 1 -- 172.21.15.152:0/2801838109 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d0c0fbaf0 msgr2=0x7f9d0c0fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:37.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.481+0000 7f9d109f3700 1 --2- 172.21.15.152:0/2801838109 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d0c0fbaf0 0x7f9d0c0fbf00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc004940 tx=0x7f9cfc009e30 comp rx=0 tx=0).stop 2023-12-06T15:02:37.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.481+0000 7f9d109f3700 1 -- 172.21.15.152:0/2801838109 shutdown_connections 2023-12-06T15:02:37.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.481+0000 7f9d109f3700 1 --2- 172.21.15.152:0/2801838109 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d0c0fcd00 0x7f9d0c0fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:37.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.481+0000 7f9d109f3700 1 --2- 172.21.15.152:0/2801838109 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d0c0fbaf0 0x7f9d0c0fbf00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:37.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.481+0000 7f9d109f3700 1 -- 172.21.15.152:0/2801838109 >> 172.21.15.152:0/2801838109 conn(0x7f9d0c0f7190 msgr2=0x7f9d0c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:02:37.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.481+0000 7f9d109f3700 1 -- 172.21.15.152:0/2801838109 shutdown_connections 2023-12-06T15:02:37.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.481+0000 7f9d109f3700 1 -- 172.21.15.152:0/2801838109 wait complete. 2023-12-06T15:02:37.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.482+0000 7f9d109f3700 1 Processor -- start 2023-12-06T15:02:37.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.482+0000 7f9d109f3700 1 -- start start 2023-12-06T15:02:37.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.482+0000 7f9d109f3700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d0c0fbaf0 0x7f9d0c10c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:37.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.482+0000 7f9d109f3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d0c0fcd00 0x7f9d0c10c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:37.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.482+0000 7f9d109f3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0c10cfc0 con 0x7f9d0c0fcd00 2023-12-06T15:02:37.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.482+0000 7f9d109f3700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0c10d860 con 0x7f9d0c0fbaf0 2023-12-06T15:02:37.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.482+0000 7f9d09d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d0c0fcd00 0x7f9d0c10c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:37.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.482+0000 7f9d09d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d0c0fcd00 0x7f9d0c10c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51208/0 (socket says 172.21.15.152:51208) 2023-12-06T15:02:37.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.482+0000 7f9d09d9b700 1 -- 172.21.15.152:0/830616533 learned_addr learned my addr 172.21.15.152:0/830616533 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:02:37.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.482+0000 7f9d0a59c700 1 --2- 172.21.15.152:0/830616533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d0c0fbaf0 0x7f9d0c10c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:37.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.483+0000 7f9d09d9b700 1 -- 172.21.15.152:0/830616533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d0c0fbaf0 msgr2=0x7f9d0c10c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:37.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.483+0000 7f9d09d9b700 1 --2- 172.21.15.152:0/830616533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d0c0fbaf0 0x7f9d0c10c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:37.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.483+0000 7f9d09d9b700 1 -- 172.21.15.152:0/830616533 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cfc005040 con 0x7f9d0c0fcd00 2023-12-06T15:02:37.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.483+0000 7f9d0a59c700 1 --2- 172.21.15.152:0/830616533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d0c0fbaf0 0x7f9d0c10c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-06T15:02:37.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.483+0000 7f9d09d9b700 1 --2- 172.21.15.152:0/830616533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d0c0fcd00 0x7f9d0c10c9c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9d0000c830 tx=0x7f9d00004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:02:37.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.483+0000 7f9cfaffd700 1 -- 172.21.15.152:0/830616533 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d000106f0 con 0x7f9d0c0fcd00 2023-12-06T15:02:37.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.483+0000 7f9cfaffd700 1 -- 172.21.15.152:0/830616533 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9d00010d00 con 0x7f9d0c0fcd00 2023-12-06T15:02:37.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.483+0000 7f9d109f3700 1 -- 172.21.15.152:0/830616533 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d0c10db40 con 0x7f9d0c0fcd00 2023-12-06T15:02:37.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.483+0000 7f9cfaffd700 1 -- 172.21.15.152:0/830616533 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d00012e90 con 0x7f9d0c0fcd00 2023-12-06T15:02:37.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.483+0000 7f9d109f3700 1 -- 172.21.15.152:0/830616533 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d0c10e080 con 0x7f9d0c0fcd00 2023-12-06T15:02:37.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.484+0000 7f9d109f3700 1 -- 172.21.15.152:0/830616533 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d0c04bb80 con 0x7f9d0c0fcd00 2023-12-06T15:02:37.489 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.484+0000 7f9cfaffd700 1 -- 172.21.15.152:0/830616533 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 37) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f9d00010850 con 0x7f9d0c0fcd00 2023-12-06T15:02:37.489 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.485+0000 7f9cfaffd700 1 --2- 172.21.15.152:0/830616533 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f9cf406cf80 0x7f9cf406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:37.489 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.485+0000 7f9cfaffd700 1 -- 172.21.15.152:0/830616533 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6972+0+0 (secure 0 0 0) 0x7f9d0008c5b0 con 0x7f9d0c0fcd00 2023-12-06T15:02:37.489 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.485+0000 7f9d0a59c700 1 --2- 172.21.15.152:0/830616533 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f9cf406cf80 0x7f9cf406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:37.489 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.485+0000 7f9d0a59c700 1 --2- 172.21.15.152:0/830616533 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f9cf406cf80 0x7f9cf406f430 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc004890 tx=0x7f9cfc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:02:37.489 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.490+0000 7f9cfaffd700 1 -- 172.21.15.152:0/830616533 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f9d00059d00 con 0x7f9d0c0fcd00 2023-12-06T15:02:37.521 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 15:02:37 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-0[202821]: 2023-12-06T15:02:37.244+0000 7fce0cf62640 -1 osd.0 48 log_to_monitors true 2023-12-06T15:02:37.735 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.734+0000 7f9d109f3700 1 -- 172.21.15.152:0/830616533 --> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d0c10e530 con 0x7f9cf406cf80 2023-12-06T15:02:37.735 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.735+0000 7f9cfaffd700 1 -- 172.21.15.152:0/830616533 <== mgr.34104 v2:172.21.15.152:6800/2427836422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9d0c10e530 con 0x7f9cf406cf80 2023-12-06T15:02:37.739 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.738+0000 7f9d109f3700 1 -- 172.21.15.152:0/830616533 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f9cf406cf80 msgr2=0x7f9cf406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:37.739 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.738+0000 7f9d109f3700 1 --2- 172.21.15.152:0/830616533 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f9cf406cf80 0x7f9cf406f430 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc004890 tx=0x7f9cfc009e30 comp rx=0 tx=0).stop 2023-12-06T15:02:37.739 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.738+0000 7f9d109f3700 1 -- 172.21.15.152:0/830616533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d0c0fcd00 msgr2=0x7f9d0c10c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:37.739 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.738+0000 7f9d109f3700 1 --2- 172.21.15.152:0/830616533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d0c0fcd00 0x7f9d0c10c9c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9d0000c830 tx=0x7f9d00004470 comp rx=0 tx=0).stop 2023-12-06T15:02:37.739 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.738+0000 7f9d109f3700 1 -- 172.21.15.152:0/830616533 shutdown_connections 2023-12-06T15:02:37.739 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.738+0000 7f9d109f3700 1 --2- 172.21.15.152:0/830616533 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f9cf406cf80 0x7f9cf406f430 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:37.739 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.738+0000 7f9d109f3700 1 --2- 172.21.15.152:0/830616533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d0c0fbaf0 0x7f9d0c10c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:37.739 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.738+0000 7f9d109f3700 1 --2- 172.21.15.152:0/830616533 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9d0c0fcd00 0x7f9d0c10c9c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:37.739 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.738+0000 7f9d109f3700 1 -- 172.21.15.152:0/830616533 >> 172.21.15.152:0/830616533 conn(0x7f9d0c0f7190 msgr2=0x7f9d0c0fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:02:37.739 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.739+0000 7f9d109f3700 1 -- 172.21.15.152:0/830616533 shutdown_connections 2023-12-06T15:02:37.739 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.739+0000 7f9d109f3700 1 -- 172.21.15.152:0/830616533 wait complete. 2023-12-06T15:02:37.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:37 smithi190 ceph-mon[178398]: failed to encode map e56 with expected crc 2023-12-06T15:02:37.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:37 smithi190 ceph-mon[178398]: osdmap e56: 6 total, 5 up, 6 in 2023-12-06T15:02:37.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:37 smithi190 ceph-mon[178398]: failed to encode map e56 with expected crc 2023-12-06T15:02:37.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:37 smithi190 ceph-mon[178398]: failed to encode map e56 with expected crc 2023-12-06T15:02:37.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:37 smithi190 ceph-mon[178398]: failed to encode map e56 with expected crc 2023-12-06T15:02:37.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:37 smithi190 ceph-mon[178398]: pgmap v44: 65 pgs: 5 peering, 16 active+undersized+degraded, 12 active+undersized, 31 active+clean, 1 stale+active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 55/348 objects degraded (15.805%) 2023-12-06T15:02:37.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:37 smithi190 ceph-mon[178398]: from='osd.0 [v2:172.21.15.152:6802/2356689289,v1:172.21.15.152:6803/2356689289]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-06T15:02:37.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:37 smithi190 ceph-mon[178398]: from='osd.0 [v2:172.21.15.152:6802/2356689289,v1:172.21.15.152:6803/2356689289]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-06T15:02:37.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:37 smithi190 ceph-mon[178398]: osdmap e57: 6 total, 5 up, 6 in 2023-12-06T15:02:37.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:37 smithi190 ceph-mon[178398]: from='osd.0 [v2:172.21.15.152:6802/2356689289,v1:172.21.15.152:6803/2356689289]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-06T15:02:37.836 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 15:02:37 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-0[202821]: 2023-12-06T15:02:37.521+0000 7fcdfa3cb700 -1 osd.0 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-06T15:02:37.836 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:37 smithi152 ceph-mon[192652]: failed to encode map e56 with expected crc 2023-12-06T15:02:37.837 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:37 smithi152 ceph-mon[192652]: osdmap e56: 6 total, 5 up, 6 in 2023-12-06T15:02:37.837 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:37 smithi152 ceph-mon[192652]: failed to encode map e56 with expected crc 2023-12-06T15:02:37.837 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:37 smithi152 ceph-mon[192652]: failed to encode map e56 with expected crc 2023-12-06T15:02:37.837 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:37 smithi152 ceph-mon[192652]: failed to encode map e56 with expected crc 2023-12-06T15:02:37.837 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:37 smithi152 ceph-mon[192652]: pgmap v44: 65 pgs: 5 peering, 16 active+undersized+degraded, 12 active+undersized, 31 active+clean, 1 stale+active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 55/348 objects degraded (15.805%) 2023-12-06T15:02:37.837 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:37 smithi152 ceph-mon[192652]: from='osd.0 [v2:172.21.15.152:6802/2356689289,v1:172.21.15.152:6803/2356689289]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-06T15:02:37.837 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:37 smithi152 ceph-mon[192652]: from='osd.0 [v2:172.21.15.152:6802/2356689289,v1:172.21.15.152:6803/2356689289]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-06T15:02:37.837 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:37 smithi152 ceph-mon[192652]: osdmap e57: 6 total, 5 up, 6 in 2023-12-06T15:02:37.837 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:37 smithi152 ceph-mon[192652]: from='osd.0 [v2:172.21.15.152:6802/2356689289,v1:172.21.15.152:6803/2356689289]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-06T15:02:37.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.846+0000 7ff54445d700 1 -- 172.21.15.152:0/1381692151 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff53c0fde00 msgr2=0x7ff53c0fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:37.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.846+0000 7ff54445d700 1 --2- 172.21.15.152:0/1381692151 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff53c0fde00 0x7ff53c0fe250 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff52c004880 tx=0x7ff52c009e30 comp rx=0 tx=0).stop 2023-12-06T15:02:37.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.846+0000 7ff54445d700 1 -- 172.21.15.152:0/1381692151 shutdown_connections 2023-12-06T15:02:37.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.846+0000 7ff54445d700 1 --2- 172.21.15.152:0/1381692151 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff53c0fde00 0x7ff53c0fe250 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:37.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.846+0000 7ff54445d700 1 --2- 172.21.15.152:0/1381692151 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff53c0fcbf0 0x7ff53c0fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:37.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.846+0000 7ff54445d700 1 -- 172.21.15.152:0/1381692151 >> 172.21.15.152:0/1381692151 conn(0x7ff53c0f82d0 msgr2=0x7ff53c0fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:02:37.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.847+0000 7ff54445d700 1 -- 172.21.15.152:0/1381692151 shutdown_connections 2023-12-06T15:02:37.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.847+0000 7ff54445d700 1 -- 172.21.15.152:0/1381692151 wait complete. 2023-12-06T15:02:37.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.847+0000 7ff54445d700 1 Processor -- start 2023-12-06T15:02:37.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.847+0000 7ff54445d700 1 -- start start 2023-12-06T15:02:37.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.847+0000 7ff54445d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff53c0fcbf0 0x7ff53c10d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:37.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.847+0000 7ff54445d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff53c0fde00 0x7ff53c10daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:37.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.847+0000 7ff54445d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c10e0a0 con 0x7ff53c0fcbf0 2023-12-06T15:02:37.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.847+0000 7ff54445d700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c10e940 con 0x7ff53c0fde00 2023-12-06T15:02:37.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.847+0000 7ff5421f9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff53c0fcbf0 0x7ff53c10d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:37.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.848+0000 7ff5421f9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff53c0fcbf0 0x7ff53c10d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51222/0 (socket says 172.21.15.152:51222) 2023-12-06T15:02:37.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.848+0000 7ff5421f9700 1 -- 172.21.15.152:0/3120018949 learned_addr learned my addr 172.21.15.152:0/3120018949 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:02:37.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.848+0000 7ff5421f9700 1 -- 172.21.15.152:0/3120018949 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff53c0fde00 msgr2=0x7ff53c10daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:37.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.848+0000 7ff5421f9700 1 --2- 172.21.15.152:0/3120018949 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff53c0fde00 0x7ff53c10daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:37.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.848+0000 7ff5421f9700 1 -- 172.21.15.152:0/3120018949 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff538005040 con 0x7ff53c0fcbf0 2023-12-06T15:02:37.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.848+0000 7ff5421f9700 1 --2- 172.21.15.152:0/3120018949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff53c0fcbf0 0x7ff53c10d560 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff5380096b0 tx=0x7ff538009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:02:37.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.848+0000 7ff532ffd700 1 -- 172.21.15.152:0/3120018949 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff53800e840 con 0x7ff53c0fcbf0 2023-12-06T15:02:37.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.848+0000 7ff532ffd700 1 -- 172.21.15.152:0/3120018949 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff53800f040 con 0x7ff53c0fcbf0 2023-12-06T15:02:37.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.848+0000 7ff532ffd700 1 -- 172.21.15.152:0/3120018949 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff538013d60 con 0x7ff53c0fcbf0 2023-12-06T15:02:37.850 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.849+0000 7ff54445d700 1 -- 172.21.15.152:0/3120018949 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff52c005040 con 0x7ff53c0fcbf0 2023-12-06T15:02:37.850 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.849+0000 7ff54445d700 1 -- 172.21.15.152:0/3120018949 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff53c10eea0 con 0x7ff53c0fcbf0 2023-12-06T15:02:37.850 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.850+0000 7ff532ffd700 1 -- 172.21.15.152:0/3120018949 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 37) v1 ==== 91040+0+0 (secure 0 0 0) 0x7ff538013590 con 0x7ff53c0fcbf0 2023-12-06T15:02:37.850 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.850+0000 7ff54445d700 1 -- 172.21.15.152:0/3120018949 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff53c04bb80 con 0x7ff53c0fcbf0 2023-12-06T15:02:37.851 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.851+0000 7ff532ffd700 1 --2- 172.21.15.152:0/3120018949 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7ff5280713e0 0x7ff528073890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:37.851 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.851+0000 7ff532ffd700 1 -- 172.21.15.152:0/3120018949 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6972+0+0 (secure 0 0 0) 0x7ff53808c6b0 con 0x7ff53c0fcbf0 2023-12-06T15:02:37.851 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.851+0000 7ff5419f8700 1 --2- 172.21.15.152:0/3120018949 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7ff5280713e0 0x7ff528073890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:37.851 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.851+0000 7ff5419f8700 1 --2- 172.21.15.152:0/3120018949 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7ff5280713e0 0x7ff528073890 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff52c000c00 tx=0x7ff52c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:02:37.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:37.856+0000 7ff532ffd700 1 -- 172.21.15.152:0/3120018949 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ff538059b30 con 0x7ff53c0fcbf0 2023-12-06T15:02:38.063 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.063+0000 7ff54445d700 1 -- 172.21.15.152:0/3120018949 --> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff53c10f560 con 0x7ff5280713e0 2023-12-06T15:02:38.073 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.073+0000 7ff532ffd700 1 -- 172.21.15.152:0/3120018949 <== mgr.34104 v2:172.21.15.152:6800/2427836422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7ff53c10f560 con 0x7ff5280713e0 2023-12-06T15:02:38.074 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-06T15:02:38.074 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 running (2m) 2s ago 8m 26.3M - 0.25.0 c8568f914cd2 b1a46cc95546 2023-12-06T15:02:38.074 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (24s) 2s ago 8m 7470k - 19.0.0-26-g0482646f 26bb7d89db2e 222039c21ee0 2023-12-06T15:02:38.074 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi190 smithi190 running (20s) 18s ago 7m 7457k - 19.0.0-26-g0482646f 26bb7d89db2e 8841ae485b70 2023-12-06T15:02:38.074 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (2m) 2s ago 8m 81.8M - 9.4.7 954c08fa6188 5c6a52d58144 2023-12-06T15:02:38.074 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.acqswy smithi152 running (4m) 2s ago 4m 5565M - 17.2.7-113-gece0d607 a5c6421f1c5f ff9375cec192 2023-12-06T15:02:38.074 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.ypivwc smithi152 running (4m) 2s ago 4m 538M - 17.2.7-113-gece0d607 a5c6421f1c5f d809a681491b 2023-12-06T15:02:38.074 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi190.edwtqj smithi190 running (4m) 18s ago 4m 626M - 17.2.7-113-gece0d607 a5c6421f1c5f f3b7ebd93b04 2023-12-06T15:02:38.074 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi190.uucxzu smithi190 running (4m) 18s ago 4m 4860M - 17.2.7-113-gece0d607 a5c6421f1c5f c01be1409c5f 2023-12-06T15:02:38.074 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.meodco smithi152 *:8443,9283,8765 running (116s) 2s ago 9m 506M - 19.0.0-26-g0482646f 26bb7d89db2e 16ed2af8a3d0 2023-12-06T15:02:38.074 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi190.ubusrr smithi190 *:8443,9283,8765 running (88s) 18s ago 7m 447M - 19.0.0-26-g0482646f 26bb7d89db2e cfae14b9324d 2023-12-06T15:02:38.074 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (77s) 2s ago 9m 58.9M 2048M 19.0.0-26-g0482646f 26bb7d89db2e f5163d3b0f5f 2023-12-06T15:02:38.075 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi190 smithi190 running (55s) 18s ago 7m 41.2M 2048M 19.0.0-26-g0482646f 26bb7d89db2e b25040d5fdfe 2023-12-06T15:02:38.075 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 running (2m) 2s ago 8m 18.5M - 1.5.0 0da6a335fe13 81be696b9be8 2023-12-06T15:02:38.075 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi190 smithi190 *:9100 running (2m) 18s ago 7m 18.3M - 1.5.0 0da6a335fe13 2e521e235bf7 2023-12-06T15:02:38.075 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (6s) 2s ago 7m 17.0M 1568M 19.0.0-26-g0482646f 26bb7d89db2e 05e00966036e 2023-12-06T15:02:38.075 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (6m) 2s ago 6m 851M 1568M 17.2.7-113-gece0d607 a5c6421f1c5f 3942f134581a 2023-12-06T15:02:38.075 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (6m) 2s ago 6m 669M 1568M 17.2.7-113-gece0d607 a5c6421f1c5f 80bcc4927bb2 2023-12-06T15:02:38.075 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi190 running (6m) 18s ago 6m 962M 2592M 17.2.7-113-gece0d607 a5c6421f1c5f f0281d01fec4 2023-12-06T15:02:38.075 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi190 running (5m) 18s ago 5m 726M 2592M 17.2.7-113-gece0d607 a5c6421f1c5f a415b29ad9c7 2023-12-06T15:02:38.075 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi190 running (5m) 18s ago 5m 856M 2592M 17.2.7-113-gece0d607 a5c6421f1c5f b0f2767055a5 2023-12-06T15:02:38.075 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi152 smithi152 *:9095 running (93s) 2s ago 8m 48.3M - 2.43.0 a07b618ecd1d 5f7e5860a419 2023-12-06T15:02:38.076 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.075+0000 7ff54445d700 1 -- 172.21.15.152:0/3120018949 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7ff5280713e0 msgr2=0x7ff528073890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:38.076 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.075+0000 7ff54445d700 1 --2- 172.21.15.152:0/3120018949 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7ff5280713e0 0x7ff528073890 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff52c000c00 tx=0x7ff52c009e30 comp rx=0 tx=0).stop 2023-12-06T15:02:38.076 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.075+0000 7ff54445d700 1 -- 172.21.15.152:0/3120018949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff53c0fcbf0 msgr2=0x7ff53c10d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:38.076 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.075+0000 7ff54445d700 1 --2- 172.21.15.152:0/3120018949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff53c0fcbf0 0x7ff53c10d560 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff5380096b0 tx=0x7ff538009e30 comp rx=0 tx=0).stop 2023-12-06T15:02:38.076 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.075+0000 7ff54445d700 1 -- 172.21.15.152:0/3120018949 shutdown_connections 2023-12-06T15:02:38.076 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.075+0000 7ff54445d700 1 --2- 172.21.15.152:0/3120018949 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7ff5280713e0 0x7ff528073890 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:38.076 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.075+0000 7ff54445d700 1 --2- 172.21.15.152:0/3120018949 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff53c0fcbf0 0x7ff53c10d560 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:38.076 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.075+0000 7ff54445d700 1 --2- 172.21.15.152:0/3120018949 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff53c0fde00 0x7ff53c10daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:38.076 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.075+0000 7ff54445d700 1 -- 172.21.15.152:0/3120018949 >> 172.21.15.152:0/3120018949 conn(0x7ff53c0f82d0 msgr2=0x7ff53c101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:02:38.076 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.076+0000 7ff54445d700 1 -- 172.21.15.152:0/3120018949 shutdown_connections 2023-12-06T15:02:38.077 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.076+0000 7ff54445d700 1 -- 172.21.15.152:0/3120018949 wait complete. 2023-12-06T15:02:38.180 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.179+0000 7fca4f9a6700 1 -- 172.21.15.152:0/386438785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca480fcbf0 msgr2=0x7fca480fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:38.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.179+0000 7fca4f9a6700 1 --2- 172.21.15.152:0/386438785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca480fcbf0 0x7fca480fd000 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fca44004940 tx=0x7fca44009e30 comp rx=0 tx=0).stop 2023-12-06T15:02:38.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.179+0000 7fca4f9a6700 1 -- 172.21.15.152:0/386438785 shutdown_connections 2023-12-06T15:02:38.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.179+0000 7fca4f9a6700 1 --2- 172.21.15.152:0/386438785 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fca480fde00 0x7fca480fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:38.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.179+0000 7fca4f9a6700 1 --2- 172.21.15.152:0/386438785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca480fcbf0 0x7fca480fd000 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:38.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.179+0000 7fca4f9a6700 1 -- 172.21.15.152:0/386438785 >> 172.21.15.152:0/386438785 conn(0x7fca480f82d0 msgr2=0x7fca480fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:02:38.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.179+0000 7fca4f9a6700 1 -- 172.21.15.152:0/386438785 shutdown_connections 2023-12-06T15:02:38.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.179+0000 7fca4f9a6700 1 -- 172.21.15.152:0/386438785 wait complete. 2023-12-06T15:02:38.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.180+0000 7fca4f9a6700 1 Processor -- start 2023-12-06T15:02:38.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.180+0000 7fca4f9a6700 1 -- start start 2023-12-06T15:02:38.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.180+0000 7fca4f9a6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca480fcbf0 0x7fca4810d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:38.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.180+0000 7fca4f9a6700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fca480fde00 0x7fca4810d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:38.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.180+0000 7fca4f9a6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4810dfc0 con 0x7fca480fcbf0 2023-12-06T15:02:38.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.180+0000 7fca4f9a6700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4810e860 con 0x7fca480fde00 2023-12-06T15:02:38.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.180+0000 7fca4d742700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca480fcbf0 0x7fca4810d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:38.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.180+0000 7fca4d742700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca480fcbf0 0x7fca4810d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51236/0 (socket says 172.21.15.152:51236) 2023-12-06T15:02:38.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.180+0000 7fca4d742700 1 -- 172.21.15.152:0/1869503836 learned_addr learned my addr 172.21.15.152:0/1869503836 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:02:38.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.180+0000 7fca4cf41700 1 --2- 172.21.15.152:0/1869503836 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fca480fde00 0x7fca4810d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:38.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.180+0000 7fca4d742700 1 -- 172.21.15.152:0/1869503836 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fca480fde00 msgr2=0x7fca4810d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:38.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.180+0000 7fca4d742700 1 --2- 172.21.15.152:0/1869503836 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fca480fde00 0x7fca4810d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:38.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.180+0000 7fca4d742700 1 -- 172.21.15.152:0/1869503836 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca44005040 con 0x7fca480fcbf0 2023-12-06T15:02:38.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.181+0000 7fca4d742700 1 --2- 172.21.15.152:0/1869503836 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca480fcbf0 0x7fca4810d480 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fca44000c00 tx=0x7fca44009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:02:38.183 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.181+0000 7fca3dffb700 1 -- 172.21.15.152:0/1869503836 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca44021070 con 0x7fca480fcbf0 2023-12-06T15:02:38.183 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.181+0000 7fca3dffb700 1 -- 172.21.15.152:0/1869503836 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fca4401c400 con 0x7fca480fcbf0 2023-12-06T15:02:38.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.181+0000 7fca4f9a6700 1 -- 172.21.15.152:0/1869503836 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca4810eae0 con 0x7fca480fcbf0 2023-12-06T15:02:38.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.181+0000 7fca3dffb700 1 -- 172.21.15.152:0/1869503836 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca4400e070 con 0x7fca480fcbf0 2023-12-06T15:02:38.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.181+0000 7fca4f9a6700 1 -- 172.21.15.152:0/1869503836 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca4810efc0 con 0x7fca480fcbf0 2023-12-06T15:02:38.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.182+0000 7fca4f9a6700 1 -- 172.21.15.152:0/1869503836 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca4804bb80 con 0x7fca480fcbf0 2023-12-06T15:02:38.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.183+0000 7fca3dffb700 1 -- 172.21.15.152:0/1869503836 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 37) v1 ==== 91040+0+0 (secure 0 0 0) 0x7fca4401ca00 con 0x7fca480fcbf0 2023-12-06T15:02:38.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.183+0000 7fca3dffb700 1 --2- 172.21.15.152:0/1869503836 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fca3406cf80 0x7fca3406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:38.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.183+0000 7fca3dffb700 1 -- 172.21.15.152:0/1869503836 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6972+0+0 (secure 0 0 0) 0x7fca4408d8f0 con 0x7fca480fcbf0 2023-12-06T15:02:38.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.183+0000 7fca4cf41700 1 --2- 172.21.15.152:0/1869503836 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fca3406cf80 0x7fca3406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:38.184 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.184+0000 7fca4cf41700 1 --2- 172.21.15.152:0/1869503836 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fca3406cf80 0x7fca3406f430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fca38009b80 tx=0x7fca3800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:02:38.188 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.188+0000 7fca3dffb700 1 -- 172.21.15.152:0/1869503836 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fca4405ae90 con 0x7fca480fcbf0 2023-12-06T15:02:38.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.485+0000 7fca4f9a6700 1 -- 172.21.15.152:0/1869503836 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fca481055b0 con 0x7fca480fcbf0 2023-12-06T15:02:38.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.485+0000 7fca3dffb700 1 -- 172.21.15.152:0/1869503836 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+726 (secure 0 0 0) 0x7fca4405aa20 con 0x7fca480fcbf0 2023-12-06T15:02:38.486 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-12-06T15:02:38.486 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": { 2023-12-06T15:02:38.486 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 2 2023-12-06T15:02:38.486 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:02:38.486 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": { 2023-12-06T15:02:38.486 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 2 2023-12-06T15:02:38.486 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:02:38.486 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": { 2023-12-06T15:02:38.486 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 5 2023-12-06T15:02:38.487 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:02:38.487 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2023-12-06T15:02:38.487 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 4 2023-12-06T15:02:38.487 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:02:38.487 INFO:teuthology.orchestra.run.smithi152.stdout: "overall": { 2023-12-06T15:02:38.487 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 9, 2023-12-06T15:02:38.487 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 4 2023-12-06T15:02:38.487 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-12-06T15:02:38.487 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-12-06T15:02:38.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.488+0000 7fca4f9a6700 1 -- 172.21.15.152:0/1869503836 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fca3406cf80 msgr2=0x7fca3406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:38.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.488+0000 7fca4f9a6700 1 --2- 172.21.15.152:0/1869503836 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fca3406cf80 0x7fca3406f430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fca38009b80 tx=0x7fca3800b040 comp rx=0 tx=0).stop 2023-12-06T15:02:38.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.488+0000 7fca4f9a6700 1 -- 172.21.15.152:0/1869503836 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca480fcbf0 msgr2=0x7fca4810d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:38.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.488+0000 7fca4f9a6700 1 --2- 172.21.15.152:0/1869503836 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca480fcbf0 0x7fca4810d480 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fca44000c00 tx=0x7fca44009e30 comp rx=0 tx=0).stop 2023-12-06T15:02:38.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.488+0000 7fca4f9a6700 1 -- 172.21.15.152:0/1869503836 shutdown_connections 2023-12-06T15:02:38.489 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.488+0000 7fca4f9a6700 1 --2- 172.21.15.152:0/1869503836 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fca3406cf80 0x7fca3406f430 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:38.489 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.488+0000 7fca4f9a6700 1 --2- 172.21.15.152:0/1869503836 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca480fcbf0 0x7fca4810d480 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:38.489 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.488+0000 7fca4f9a6700 1 --2- 172.21.15.152:0/1869503836 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fca480fde00 0x7fca4810d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:38.489 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.488+0000 7fca4f9a6700 1 -- 172.21.15.152:0/1869503836 >> 172.21.15.152:0/1869503836 conn(0x7fca480f82d0 msgr2=0x7fca48101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:02:38.489 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.488+0000 7fca4f9a6700 1 -- 172.21.15.152:0/1869503836 shutdown_connections 2023-12-06T15:02:38.489 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.488+0000 7fca4f9a6700 1 -- 172.21.15.152:0/1869503836 wait complete. 2023-12-06T15:02:38.612 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.611+0000 7f4081326700 1 -- 172.21.15.152:0/4021973803 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f407c0660b0 msgr2=0x7f407c0ff780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:38.612 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.611+0000 7f4081326700 1 --2- 172.21.15.152:0/4021973803 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f407c0660b0 0x7f407c0ff780 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f406c004940 tx=0x7f406c009e30 comp rx=0 tx=0).stop 2023-12-06T15:02:38.612 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.611+0000 7f4081326700 1 -- 172.21.15.152:0/4021973803 shutdown_connections 2023-12-06T15:02:38.612 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.611+0000 7f4081326700 1 --2- 172.21.15.152:0/4021973803 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f407c0ffd50 0x7f407c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:38.612 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.611+0000 7f4081326700 1 --2- 172.21.15.152:0/4021973803 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f407c0660b0 0x7f407c0ff780 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:38.612 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.611+0000 7f4081326700 1 -- 172.21.15.152:0/4021973803 >> 172.21.15.152:0/4021973803 conn(0x7f407c0f7190 msgr2=0x7f407c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:02:38.612 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.611+0000 7f4081326700 1 -- 172.21.15.152:0/4021973803 shutdown_connections 2023-12-06T15:02:38.612 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.611+0000 7f4081326700 1 -- 172.21.15.152:0/4021973803 wait complete. 2023-12-06T15:02:38.612 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.612+0000 7f4081326700 1 Processor -- start 2023-12-06T15:02:38.612 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.612+0000 7f4081326700 1 -- start start 2023-12-06T15:02:38.613 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.612+0000 7f4081326700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f407c0660b0 0x7f407c10d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:38.614 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.612+0000 7f4081326700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f407c0ffd50 0x7f407c10da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:38.614 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.612+0000 7f4081326700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407c10e070 con 0x7f407c0ffd50 2023-12-06T15:02:38.614 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.612+0000 7f4081326700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407c10e910 con 0x7f407c0660b0 2023-12-06T15:02:38.614 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.612+0000 7f407a7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f407c0ffd50 0x7f407c10da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:38.614 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.612+0000 7f407a7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f407c0ffd50 0x7f407c10da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51254/0 (socket says 172.21.15.152:51254) 2023-12-06T15:02:38.614 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.612+0000 7f407a7fc700 1 -- 172.21.15.152:0/4217957573 learned_addr learned my addr 172.21.15.152:0/4217957573 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:02:38.614 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.612+0000 7f407affd700 1 --2- 172.21.15.152:0/4217957573 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f407c0660b0 0x7f407c10d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:38.614 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.612+0000 7f407a7fc700 1 -- 172.21.15.152:0/4217957573 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f407c0660b0 msgr2=0x7f407c10d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:38.614 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.612+0000 7f407a7fc700 1 --2- 172.21.15.152:0/4217957573 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f407c0660b0 0x7f407c10d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:38.614 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.612+0000 7f407a7fc700 1 -- 172.21.15.152:0/4217957573 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f406c005040 con 0x7f407c0ffd50 2023-12-06T15:02:38.614 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.613+0000 7f407a7fc700 1 --2- 172.21.15.152:0/4217957573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f407c0ffd50 0x7f407c10da70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f407000c830 tx=0x7f4070004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:02:38.614 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.613+0000 7f40637fe700 1 -- 172.21.15.152:0/4217957573 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f407000a760 con 0x7f407c0ffd50 2023-12-06T15:02:38.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.613+0000 7f4081326700 1 -- 172.21.15.152:0/4217957573 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f407c10ebf0 con 0x7f407c0ffd50 2023-12-06T15:02:38.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.613+0000 7f40637fe700 1 -- 172.21.15.152:0/4217957573 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f407000ad70 con 0x7f407c0ffd50 2023-12-06T15:02:38.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.613+0000 7f40637fe700 1 -- 172.21.15.152:0/4217957573 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40700113a0 con 0x7f407c0ffd50 2023-12-06T15:02:38.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.613+0000 7f4081326700 1 -- 172.21.15.152:0/4217957573 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f407c10f130 con 0x7f407c0ffd50 2023-12-06T15:02:38.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.614+0000 7f4081326700 1 -- 172.21.15.152:0/4217957573 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f407c1075c0 con 0x7f407c0ffd50 2023-12-06T15:02:38.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.614+0000 7f40637fe700 1 -- 172.21.15.152:0/4217957573 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 37) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f4070012400 con 0x7f407c0ffd50 2023-12-06T15:02:38.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.615+0000 7f40637fe700 1 --2- 172.21.15.152:0/4217957573 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f406406cf80 0x7f406406f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:38.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.615+0000 7f40637fe700 1 -- 172.21.15.152:0/4217957573 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6972+0+0 (secure 0 0 0) 0x7f407008c6a0 con 0x7f407c0ffd50 2023-12-06T15:02:38.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.616+0000 7f407affd700 1 --2- 172.21.15.152:0/4217957573 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f406406cf80 0x7f406406f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:38.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.616+0000 7f407affd700 1 --2- 172.21.15.152:0/4217957573 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f406406cf80 0x7f406406f430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f406c00b3b0 tx=0x7f406c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:02:38.620 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.620+0000 7f40637fe700 1 -- 172.21.15.152:0/4217957573 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4070059d50 con 0x7f407c0ffd50 2023-12-06T15:02:38.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:38 smithi190 ceph-mon[178398]: from='client.34186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:02:38.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:38 smithi190 ceph-mon[178398]: failed to encode map e57 with expected crc 2023-12-06T15:02:38.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:38 smithi190 ceph-mon[178398]: failed to encode map e57 with expected crc 2023-12-06T15:02:38.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:38 smithi190 ceph-mon[178398]: failed to encode map e57 with expected crc 2023-12-06T15:02:38.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:38 smithi190 ceph-mon[178398]: from='client.? 172.21.15.152:0/1869503836' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:02:38.865 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.864+0000 7f4081326700 1 -- 172.21.15.152:0/4217957573 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f407c04bb80 con 0x7f407c0ffd50 2023-12-06T15:02:38.865 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.865+0000 7f40637fe700 1 -- 172.21.15.152:0/4217957573 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1907 (secure 0 0 0) 0x7f40700598e0 con 0x7f407c0ffd50 2023-12-06T15:02:38.865 INFO:teuthology.orchestra.run.smithi152.stdout:e16 2023-12-06T15:02:38.865 INFO:teuthology.orchestra.run.smithi152.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-06T15:02:38.865 INFO:teuthology.orchestra.run.smithi152.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-06T15:02:38.865 INFO:teuthology.orchestra.run.smithi152.stdout:legacy client fscid: 1 2023-12-06T15:02:38.865 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T15:02:38.865 INFO:teuthology.orchestra.run.smithi152.stdout:Filesystem 'cephfs' (1) 2023-12-06T15:02:38.866 INFO:teuthology.orchestra.run.smithi152.stdout:fs_name cephfs 2023-12-06T15:02:38.866 INFO:teuthology.orchestra.run.smithi152.stdout:epoch 16 2023-12-06T15:02:38.866 INFO:teuthology.orchestra.run.smithi152.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-06T15:02:38.866 INFO:teuthology.orchestra.run.smithi152.stdout:created 2023-12-06T14:57:59.352201+0000 2023-12-06T15:02:38.866 INFO:teuthology.orchestra.run.smithi152.stdout:modified 2023-12-06T15:01:48.235717+0000 2023-12-06T15:02:38.866 INFO:teuthology.orchestra.run.smithi152.stdout:tableserver 0 2023-12-06T15:02:38.866 INFO:teuthology.orchestra.run.smithi152.stdout:root 0 2023-12-06T15:02:38.866 INFO:teuthology.orchestra.run.smithi152.stdout:session_timeout 60 2023-12-06T15:02:38.866 INFO:teuthology.orchestra.run.smithi152.stdout:session_autoclose 300 2023-12-06T15:02:38.866 INFO:teuthology.orchestra.run.smithi152.stdout:max_file_size 1099511627776 2023-12-06T15:02:38.866 INFO:teuthology.orchestra.run.smithi152.stdout:max_xattr_size 65536 2023-12-06T15:02:38.866 INFO:teuthology.orchestra.run.smithi152.stdout:required_client_features {} 2023-12-06T15:02:38.866 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure 0 2023-12-06T15:02:38.866 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure_osd_epoch 0 2023-12-06T15:02:38.866 INFO:teuthology.orchestra.run.smithi152.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-06T15:02:38.867 INFO:teuthology.orchestra.run.smithi152.stdout:max_mds 2 2023-12-06T15:02:38.867 INFO:teuthology.orchestra.run.smithi152.stdout:in 0,1 2023-12-06T15:02:38.867 INFO:teuthology.orchestra.run.smithi152.stdout:up {0=14464,1=24255} 2023-12-06T15:02:38.867 INFO:teuthology.orchestra.run.smithi152.stdout:failed 2023-12-06T15:02:38.867 INFO:teuthology.orchestra.run.smithi152.stdout:damaged 2023-12-06T15:02:38.867 INFO:teuthology.orchestra.run.smithi152.stdout:stopped 2023-12-06T15:02:38.867 INFO:teuthology.orchestra.run.smithi152.stdout:data_pools [3] 2023-12-06T15:02:38.867 INFO:teuthology.orchestra.run.smithi152.stdout:metadata_pool 2 2023-12-06T15:02:38.867 INFO:teuthology.orchestra.run.smithi152.stdout:inline_data disabled 2023-12-06T15:02:38.867 INFO:teuthology.orchestra.run.smithi152.stdout:balancer 2023-12-06T15:02:38.867 INFO:teuthology.orchestra.run.smithi152.stdout:bal_rank_mask -1 2023-12-06T15:02:38.867 INFO:teuthology.orchestra.run.smithi152.stdout:standby_count_wanted 1 2023-12-06T15:02:38.867 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.acqswy{0:14464} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.152:6826/2467413186,v1:172.21.15.152:6827/2467413186] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:02:38.868 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi190.edwtqj{0:24271} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.190:6826/2256465065,v1:172.21.15.190:6827/2256465065] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:02:38.868 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi190.uucxzu{1:24255} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.190:6824/3250692478,v1:172.21.15.190:6825/3250692478] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:02:38.868 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.ypivwc{1:14480} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.152:6828/697313573,v1:172.21.15.152:6829/697313573] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:02:38.868 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T15:02:38.868 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T15:02:38.868 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.867+0000 7f4081326700 1 -- 172.21.15.152:0/4217957573 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f406406cf80 msgr2=0x7f406406f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:38.869 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.867+0000 7f4081326700 1 --2- 172.21.15.152:0/4217957573 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f406406cf80 0x7f406406f430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f406c00b3b0 tx=0x7f406c009e30 comp rx=0 tx=0).stop 2023-12-06T15:02:38.869 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.867+0000 7f4081326700 1 -- 172.21.15.152:0/4217957573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f407c0ffd50 msgr2=0x7f407c10da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:38.869 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.867+0000 7f4081326700 1 --2- 172.21.15.152:0/4217957573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f407c0ffd50 0x7f407c10da70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f407000c830 tx=0x7f4070004470 comp rx=0 tx=0).stop 2023-12-06T15:02:38.869 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.867+0000 7f4081326700 1 -- 172.21.15.152:0/4217957573 shutdown_connections 2023-12-06T15:02:38.869 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.867+0000 7f4081326700 1 --2- 172.21.15.152:0/4217957573 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f406406cf80 0x7f406406f430 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:38.869 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.867+0000 7f4081326700 1 --2- 172.21.15.152:0/4217957573 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f407c0660b0 0x7f407c10d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:38.869 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.867+0000 7f4081326700 1 --2- 172.21.15.152:0/4217957573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f407c0ffd50 0x7f407c10da70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:38.869 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.867+0000 7f4081326700 1 -- 172.21.15.152:0/4217957573 >> 172.21.15.152:0/4217957573 conn(0x7f407c0f7190 msgr2=0x7f407c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:02:38.869 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.867+0000 7f4081326700 1 -- 172.21.15.152:0/4217957573 shutdown_connections 2023-12-06T15:02:38.869 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.867+0000 7f4081326700 1 -- 172.21.15.152:0/4217957573 wait complete. 2023-12-06T15:02:38.869 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 16 2023-12-06T15:02:38.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:38 smithi152 ceph-mon[192652]: from='client.34186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:02:38.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:38 smithi152 ceph-mon[192652]: failed to encode map e57 with expected crc 2023-12-06T15:02:38.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:38 smithi152 ceph-mon[192652]: failed to encode map e57 with expected crc 2023-12-06T15:02:38.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:38 smithi152 ceph-mon[192652]: failed to encode map e57 with expected crc 2023-12-06T15:02:38.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:38 smithi152 ceph-mon[192652]: from='client.? 172.21.15.152:0/1869503836' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:02:38.974 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.973+0000 7f329e5bc700 1 -- 172.21.15.152:0/4283817676 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32980ffd70 msgr2=0x7f32981021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:38.974 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.973+0000 7f329e5bc700 1 --2- 172.21.15.152:0/4283817676 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32980ffd70 0x7f32981021d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f328c004940 tx=0x7f328c009e30 comp rx=0 tx=0).stop 2023-12-06T15:02:38.974 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.973+0000 7f329e5bc700 1 -- 172.21.15.152:0/4283817676 shutdown_connections 2023-12-06T15:02:38.974 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.973+0000 7f329e5bc700 1 --2- 172.21.15.152:0/4283817676 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f32980ffd70 0x7f32981021d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:38.974 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.973+0000 7f329e5bc700 1 --2- 172.21.15.152:0/4283817676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3298066920 0x7f32980ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:38.974 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.973+0000 7f329e5bc700 1 -- 172.21.15.152:0/4283817676 >> 172.21.15.152:0/4283817676 conn(0x7f32980f71b0 msgr2=0x7f32980f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:02:38.974 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.973+0000 7f329e5bc700 1 -- 172.21.15.152:0/4283817676 shutdown_connections 2023-12-06T15:02:38.974 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.973+0000 7f329e5bc700 1 -- 172.21.15.152:0/4283817676 wait complete. 2023-12-06T15:02:38.974 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.974+0000 7f329e5bc700 1 Processor -- start 2023-12-06T15:02:38.975 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.974+0000 7f329e5bc700 1 -- start start 2023-12-06T15:02:38.976 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.974+0000 7f329e5bc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3298066920 0x7f32980fd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:38.976 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.974+0000 7f329e5bc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32980ffd70 0x7f32980fb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:38.976 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.974+0000 7f329e5bc700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32980fbd30 con 0x7f3298066920 2023-12-06T15:02:38.976 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.974+0000 7f329e5bc700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32980fbea0 con 0x7f32980ffd70 2023-12-06T15:02:38.977 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.974+0000 7f3297fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3298066920 0x7f32980fd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:38.977 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.974+0000 7f3297fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3298066920 0x7f32980fd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51280/0 (socket says 172.21.15.152:51280) 2023-12-06T15:02:38.977 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.974+0000 7f3297fff700 1 -- 172.21.15.152:0/3926524483 learned_addr learned my addr 172.21.15.152:0/3926524483 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:02:38.977 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.974+0000 7f32977fe700 1 --2- 172.21.15.152:0/3926524483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32980ffd70 0x7f32980fb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:38.977 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.975+0000 7f3297fff700 1 -- 172.21.15.152:0/3926524483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32980ffd70 msgr2=0x7f32980fb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:38.977 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.975+0000 7f3297fff700 1 --2- 172.21.15.152:0/3926524483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32980ffd70 0x7f32980fb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:38.977 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.975+0000 7f3297fff700 1 -- 172.21.15.152:0/3926524483 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f328c005040 con 0x7f3298066920 2023-12-06T15:02:38.977 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.975+0000 7f3297fff700 1 --2- 172.21.15.152:0/3926524483 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3298066920 0x7f32980fd220 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f328800b790 tx=0x7f3288009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:02:38.977 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.975+0000 7f3294ff9700 1 -- 172.21.15.152:0/3926524483 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f328800f6f0 con 0x7f3298066920 2023-12-06T15:02:38.977 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.975+0000 7f3294ff9700 1 -- 172.21.15.152:0/3926524483 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f328800fd00 con 0x7f3298066920 2023-12-06T15:02:38.977 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.975+0000 7f329e5bc700 1 -- 172.21.15.152:0/3926524483 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32980fc180 con 0x7f3298066920 2023-12-06T15:02:38.977 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.975+0000 7f3294ff9700 1 -- 172.21.15.152:0/3926524483 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32880103a0 con 0x7f3298066920 2023-12-06T15:02:38.977 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.975+0000 7f329e5bc700 1 -- 172.21.15.152:0/3926524483 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32980fc500 con 0x7f3298066920 2023-12-06T15:02:38.977 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.976+0000 7f329e5bc700 1 -- 172.21.15.152:0/3926524483 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f329804bb80 con 0x7f3298066920 2023-12-06T15:02:38.978 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.976+0000 7f3294ff9700 1 -- 172.21.15.152:0/3926524483 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 37) v1 ==== 91040+0+0 (secure 0 0 0) 0x7f328800f850 con 0x7f3298066920 2023-12-06T15:02:38.978 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.977+0000 7f3294ff9700 1 --2- 172.21.15.152:0/3926524483 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f328006cfd0 0x7f328006f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:38.978 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.977+0000 7f3294ff9700 1 -- 172.21.15.152:0/3926524483 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6972+0+0 (secure 0 0 0) 0x7f328808c530 con 0x7f3298066920 2023-12-06T15:02:38.978 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.977+0000 7f32977fe700 1 --2- 172.21.15.152:0/3926524483 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f328006cfd0 0x7f328006f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:38.978 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.977+0000 7f32977fe700 1 --2- 172.21.15.152:0/3926524483 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f328006cfd0 0x7f328006f480 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f328c00b7d0 tx=0x7f328c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:02:38.981 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:38.981+0000 7f3294ff9700 1 -- 172.21.15.152:0/3926524483 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f3288059b40 con 0x7f3298066920 2023-12-06T15:02:39.197 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.197+0000 7f329e5bc700 1 -- 172.21.15.152:0/3926524483 --> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3298100a10 con 0x7f328006cfd0 2023-12-06T15:02:39.199 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.198+0000 7f3294ff9700 1 -- 172.21.15.152:0/3926524483 <== mgr.34104 v2:172.21.15.152:6800/2427836422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f3298100a10 con 0x7f328006cfd0 2023-12-06T15:02:39.199 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-12-06T15:02:39.199 INFO:teuthology.orchestra.run.smithi152.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e331a81036b9c4be9167bdaf54e458c7294ca3446212b9c6126786d23318b1cf", 2023-12-06T15:02:39.199 INFO:teuthology.orchestra.run.smithi152.stdout: "in_progress": true, 2023-12-06T15:02:39.199 INFO:teuthology.orchestra.run.smithi152.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-06T15:02:39.199 INFO:teuthology.orchestra.run.smithi152.stdout: "services_complete": [ 2023-12-06T15:02:39.199 INFO:teuthology.orchestra.run.smithi152.stdout: "crash", 2023-12-06T15:02:39.199 INFO:teuthology.orchestra.run.smithi152.stdout: "mon", 2023-12-06T15:02:39.199 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr" 2023-12-06T15:02:39.199 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2023-12-06T15:02:39.200 INFO:teuthology.orchestra.run.smithi152.stdout: "progress": "7/21 daemons upgraded", 2023-12-06T15:02:39.200 INFO:teuthology.orchestra.run.smithi152.stdout: "message": "Currently upgrading osd daemons", 2023-12-06T15:02:39.200 INFO:teuthology.orchestra.run.smithi152.stdout: "is_paused": false 2023-12-06T15:02:39.200 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-12-06T15:02:39.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.200+0000 7f329e5bc700 1 -- 172.21.15.152:0/3926524483 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f328006cfd0 msgr2=0x7f328006f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:39.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.200+0000 7f329e5bc700 1 --2- 172.21.15.152:0/3926524483 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f328006cfd0 0x7f328006f480 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f328c00b7d0 tx=0x7f328c009e30 comp rx=0 tx=0).stop 2023-12-06T15:02:39.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.201+0000 7f329e5bc700 1 -- 172.21.15.152:0/3926524483 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3298066920 msgr2=0x7f32980fd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:39.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.201+0000 7f329e5bc700 1 --2- 172.21.15.152:0/3926524483 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3298066920 0x7f32980fd220 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f328800b790 tx=0x7f3288009250 comp rx=0 tx=0).stop 2023-12-06T15:02:39.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.201+0000 7f329e5bc700 1 -- 172.21.15.152:0/3926524483 shutdown_connections 2023-12-06T15:02:39.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.201+0000 7f329e5bc700 1 --2- 172.21.15.152:0/3926524483 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f328006cfd0 0x7f328006f480 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:39.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.201+0000 7f329e5bc700 1 --2- 172.21.15.152:0/3926524483 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3298066920 0x7f32980fd220 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:39.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.201+0000 7f329e5bc700 1 --2- 172.21.15.152:0/3926524483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32980ffd70 0x7f32980fb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:39.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.201+0000 7f329e5bc700 1 -- 172.21.15.152:0/3926524483 >> 172.21.15.152:0/3926524483 conn(0x7f32980f71b0 msgr2=0x7f32980f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:02:39.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.201+0000 7f329e5bc700 1 -- 172.21.15.152:0/3926524483 shutdown_connections 2023-12-06T15:02:39.201 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.201+0000 7f329e5bc700 1 -- 172.21.15.152:0/3926524483 wait complete. 2023-12-06T15:02:39.306 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.306+0000 7fed96e30700 1 -- 172.21.15.152:0/2777584963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed900fbaf0 msgr2=0x7fed900fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:39.306 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.306+0000 7fed96e30700 1 --2- 172.21.15.152:0/2777584963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed900fbaf0 0x7fed900fbf00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fed84004940 tx=0x7fed84009e30 comp rx=0 tx=0).stop 2023-12-06T15:02:39.306 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.306+0000 7fed96e30700 1 -- 172.21.15.152:0/2777584963 shutdown_connections 2023-12-06T15:02:39.306 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.306+0000 7fed96e30700 1 --2- 172.21.15.152:0/2777584963 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed900fcd00 0x7fed900fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:39.307 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.306+0000 7fed96e30700 1 --2- 172.21.15.152:0/2777584963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed900fbaf0 0x7fed900fbf00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:39.307 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.306+0000 7fed96e30700 1 -- 172.21.15.152:0/2777584963 >> 172.21.15.152:0/2777584963 conn(0x7fed900f7190 msgr2=0x7fed900f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:02:39.307 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.306+0000 7fed96e30700 1 -- 172.21.15.152:0/2777584963 shutdown_connections 2023-12-06T15:02:39.307 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.306+0000 7fed96e30700 1 -- 172.21.15.152:0/2777584963 wait complete. 2023-12-06T15:02:39.307 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.306+0000 7fed96e30700 1 Processor -- start 2023-12-06T15:02:39.307 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.306+0000 7fed96e30700 1 -- start start 2023-12-06T15:02:39.308 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.307+0000 7fed96e30700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed900fbaf0 0x7fed9010d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:39.308 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.307+0000 7fed96e30700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed900fcd00 0x7fed9010dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:39.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.307+0000 7fed96e30700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9010e0c0 con 0x7fed900fbaf0 2023-12-06T15:02:39.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.307+0000 7fed96e30700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9010e960 con 0x7fed900fcd00 2023-12-06T15:02:39.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.307+0000 7fed94bcc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed900fbaf0 0x7fed9010d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:39.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.307+0000 7fed94bcc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed900fbaf0 0x7fed9010d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53390/0 (socket says 172.21.15.152:53390) 2023-12-06T15:02:39.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.307+0000 7fed94bcc700 1 -- 172.21.15.152:0/1893636922 learned_addr learned my addr 172.21.15.152:0/1893636922 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:02:39.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.307+0000 7fed8ffff700 1 --2- 172.21.15.152:0/1893636922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed900fcd00 0x7fed9010dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:39.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.307+0000 7fed94bcc700 1 -- 172.21.15.152:0/1893636922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed900fcd00 msgr2=0x7fed9010dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:39.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.307+0000 7fed94bcc700 1 --2- 172.21.15.152:0/1893636922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed900fcd00 0x7fed9010dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:39.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.307+0000 7fed94bcc700 1 -- 172.21.15.152:0/1893636922 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed84005040 con 0x7fed900fbaf0 2023-12-06T15:02:39.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.307+0000 7fed8ffff700 1 --2- 172.21.15.152:0/1893636922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed900fcd00 0x7fed9010dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-06T15:02:39.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.307+0000 7fed94bcc700 1 --2- 172.21.15.152:0/1893636922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed900fbaf0 0x7fed9010d580 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fed84004f90 tx=0x7fed84009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:02:39.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.308+0000 7fed8d7fa700 1 -- 172.21.15.152:0/1893636922 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed8400e040 con 0x7fed900fbaf0 2023-12-06T15:02:39.309 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.308+0000 7fed96e30700 1 -- 172.21.15.152:0/1893636922 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed9010ebe0 con 0x7fed900fbaf0 2023-12-06T15:02:39.310 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.308+0000 7fed8d7fa700 1 -- 172.21.15.152:0/1893636922 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fed8400bcd0 con 0x7fed900fbaf0 2023-12-06T15:02:39.310 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.308+0000 7fed8d7fa700 1 -- 172.21.15.152:0/1893636922 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed8401c630 con 0x7fed900fbaf0 2023-12-06T15:02:39.310 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.308+0000 7fed96e30700 1 -- 172.21.15.152:0/1893636922 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed9010f120 con 0x7fed900fbaf0 2023-12-06T15:02:39.310 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.309+0000 7fed96e30700 1 -- 172.21.15.152:0/1893636922 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed9004bb80 con 0x7fed900fbaf0 2023-12-06T15:02:39.310 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.309+0000 7fed8d7fa700 1 -- 172.21.15.152:0/1893636922 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 37) v1 ==== 91040+0+0 (secure 0 0 0) 0x7fed84013420 con 0x7fed900fbaf0 2023-12-06T15:02:39.310 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.309+0000 7fed8d7fa700 1 --2- 172.21.15.152:0/1893636922 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fed8006cf80 0x7fed8006f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:02:39.311 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.309+0000 7fed8d7fa700 1 -- 172.21.15.152:0/1893636922 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6972+0+0 (secure 0 0 0) 0x7fed8408dc20 con 0x7fed900fbaf0 2023-12-06T15:02:39.311 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.309+0000 7fed8ffff700 1 --2- 172.21.15.152:0/1893636922 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fed8006cf80 0x7fed8006f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:02:39.311 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.310+0000 7fed8ffff700 1 --2- 172.21.15.152:0/1893636922 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fed8006cf80 0x7fed8006f430 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fed7c0041d0 tx=0x7fed7c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:02:39.314 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.314+0000 7fed8d7fa700 1 -- 172.21.15.152:0/1893636922 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fed8405b1c0 con 0x7fed900fbaf0 2023-12-06T15:02:39.612 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.612+0000 7fed96e30700 1 -- 172.21.15.152:0/1893636922 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fed90104490 con 0x7fed900fbaf0 2023-12-06T15:02:39.613 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.612+0000 7fed8d7fa700 1 -- 172.21.15.152:0/1893636922 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1073 (secure 0 0 0) 0x7fed8405ad50 con 0x7fed900fbaf0 2023-12-06T15:02:39.613 INFO:teuthology.orchestra.run.smithi152.stdout:HEALTH_WARN Degraded data redundancy: 55/348 objects degraded (15.805%), 16 pgs degraded 2023-12-06T15:02:39.613 INFO:teuthology.orchestra.run.smithi152.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 55/348 objects degraded (15.805%), 16 pgs degraded 2023-12-06T15:02:39.613 INFO:teuthology.orchestra.run.smithi152.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2023-12-06T15:02:39.613 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2023-12-06T15:02:39.613 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2023-12-06T15:02:39.613 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2023-12-06T15:02:39.613 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2023-12-06T15:02:39.613 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2023-12-06T15:02:39.613 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2023-12-06T15:02:39.614 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2023-12-06T15:02:39.614 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2023-12-06T15:02:39.614 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.12 is active+undersized+degraded, acting [3,1] 2023-12-06T15:02:39.614 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2023-12-06T15:02:39.614 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2023-12-06T15:02:39.614 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2023-12-06T15:02:39.614 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2023-12-06T15:02:39.614 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2023-12-06T15:02:39.614 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2023-12-06T15:02:39.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.614+0000 7fed96e30700 1 -- 172.21.15.152:0/1893636922 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fed8006cf80 msgr2=0x7fed8006f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:39.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.614+0000 7fed96e30700 1 --2- 172.21.15.152:0/1893636922 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fed8006cf80 0x7fed8006f430 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fed7c0041d0 tx=0x7fed7c009040 comp rx=0 tx=0).stop 2023-12-06T15:02:39.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.614+0000 7fed96e30700 1 -- 172.21.15.152:0/1893636922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed900fbaf0 msgr2=0x7fed9010d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:02:39.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.614+0000 7fed96e30700 1 --2- 172.21.15.152:0/1893636922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed900fbaf0 0x7fed9010d580 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fed84004f90 tx=0x7fed84009e30 comp rx=0 tx=0).stop 2023-12-06T15:02:39.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.614+0000 7fed96e30700 1 -- 172.21.15.152:0/1893636922 shutdown_connections 2023-12-06T15:02:39.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.614+0000 7fed96e30700 1 --2- 172.21.15.152:0/1893636922 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fed8006cf80 0x7fed8006f430 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:39.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.614+0000 7fed96e30700 1 --2- 172.21.15.152:0/1893636922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fed900fbaf0 0x7fed9010d580 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:39.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.614+0000 7fed96e30700 1 --2- 172.21.15.152:0/1893636922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed900fcd00 0x7fed9010dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:02:39.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.614+0000 7fed96e30700 1 -- 172.21.15.152:0/1893636922 >> 172.21.15.152:0/1893636922 conn(0x7fed900f7190 msgr2=0x7fed90065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:02:39.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.615+0000 7fed96e30700 1 -- 172.21.15.152:0/1893636922 shutdown_connections 2023-12-06T15:02:39.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:02:39.615+0000 7fed96e30700 1 -- 172.21.15.152:0/1893636922 wait complete. 2023-12-06T15:02:39.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:39 smithi152 ceph-mon[192652]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:02:39.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:39 smithi152 ceph-mon[192652]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:02:39.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:39 smithi152 ceph-mon[192652]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-06T15:02:39.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:39 smithi152 ceph-mon[192652]: failed to encode map e58 with expected crc 2023-12-06T15:02:39.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:39 smithi152 ceph-mon[192652]: osd.0 [v2:172.21.15.152:6802/2356689289,v1:172.21.15.152:6803/2356689289] boot 2023-12-06T15:02:39.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:39 smithi152 ceph-mon[192652]: osdmap e58: 6 total, 6 up, 6 in 2023-12-06T15:02:39.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:39 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-06T15:02:39.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:39 smithi152 ceph-mon[192652]: failed to encode map e58 with expected crc 2023-12-06T15:02:39.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:39 smithi152 ceph-mon[192652]: pgmap v47: 65 pgs: 1 remapped+peering, 28 active+clean, 12 active+undersized, 16 active+undersized+degraded, 8 active+clean+remapped; 290 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 55/348 objects degraded (15.805%); 12/348 objects misplaced (3.448%); 9.0 MiB/s, 380 objects/s recovering 2023-12-06T15:02:39.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:39 smithi152 ceph-mon[192652]: from='client.? 172.21.15.152:0/4217957573' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-06T15:02:39.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:39 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:39.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:39 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:39.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:39 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:02:39.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:39 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T15:02:39.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:39 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:39.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:39 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:02:39.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:39 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:02:39.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:39 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:02:39.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:39 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:02:39.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:39 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-06T15:02:39.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:39 smithi152 ceph-mon[192652]: osdmap e59: 6 total, 6 up, 6 in 2023-12-06T15:02:39.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:39 smithi190 ceph-mon[178398]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:02:39.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:39 smithi190 ceph-mon[178398]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:02:39.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:39 smithi190 ceph-mon[178398]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-06T15:02:39.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:39 smithi190 ceph-mon[178398]: failed to encode map e58 with expected crc 2023-12-06T15:02:39.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:39 smithi190 ceph-mon[178398]: osd.0 [v2:172.21.15.152:6802/2356689289,v1:172.21.15.152:6803/2356689289] boot 2023-12-06T15:02:39.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:39 smithi190 ceph-mon[178398]: osdmap e58: 6 total, 6 up, 6 in 2023-12-06T15:02:39.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:39 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-06T15:02:39.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:39 smithi190 ceph-mon[178398]: failed to encode map e58 with expected crc 2023-12-06T15:02:39.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:39 smithi190 ceph-mon[178398]: pgmap v47: 65 pgs: 1 remapped+peering, 28 active+clean, 12 active+undersized, 16 active+undersized+degraded, 8 active+clean+remapped; 290 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 55/348 objects degraded (15.805%); 12/348 objects misplaced (3.448%); 9.0 MiB/s, 380 objects/s recovering 2023-12-06T15:02:39.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:39 smithi190 ceph-mon[178398]: from='client.? 172.21.15.152:0/4217957573' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-06T15:02:39.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:39 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:39.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:39 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:39.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:39 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:02:39.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:39 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T15:02:39.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:39 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:39.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:39 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:02:39.824 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:39 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:02:39.824 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:39 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:02:39.824 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:39 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:02:39.824 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:39 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-06T15:02:39.824 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:39 smithi190 ceph-mon[178398]: osdmap e59: 6 total, 6 up, 6 in 2023-12-06T15:02:40.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:40 smithi190 ceph-mon[178398]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:02:40.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:40 smithi190 ceph-mon[178398]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-06T15:02:40.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:40 smithi190 ceph-mon[178398]: Upgrade: unsafe to stop osd(s) at this time (14 PGs are or would become offline) 2023-12-06T15:02:40.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:40 smithi190 ceph-mon[178398]: failed to encode map e59 with expected crc 2023-12-06T15:02:40.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:40 smithi190 ceph-mon[178398]: failed to encode map e59 with expected crc 2023-12-06T15:02:40.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:40 smithi190 ceph-mon[178398]: failed to encode map e59 with expected crc 2023-12-06T15:02:40.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:40 smithi190 ceph-mon[178398]: failed to encode map e59 with expected crc 2023-12-06T15:02:40.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:40 smithi190 ceph-mon[178398]: failed to encode map e59 with expected crc 2023-12-06T15:02:40.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:40 smithi190 ceph-mon[178398]: failed to encode map e59 with expected crc 2023-12-06T15:02:40.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:40 smithi190 ceph-mon[178398]: from='client.? 172.21.15.152:0/1893636922' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-06T15:02:40.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:40 smithi190 ceph-mon[178398]: osdmap e60: 6 total, 6 up, 6 in 2023-12-06T15:02:40.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:40 smithi152 ceph-mon[192652]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:02:40.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:40 smithi152 ceph-mon[192652]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-06T15:02:40.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:40 smithi152 ceph-mon[192652]: Upgrade: unsafe to stop osd(s) at this time (14 PGs are or would become offline) 2023-12-06T15:02:40.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:40 smithi152 ceph-mon[192652]: failed to encode map e59 with expected crc 2023-12-06T15:02:40.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:40 smithi152 ceph-mon[192652]: failed to encode map e59 with expected crc 2023-12-06T15:02:40.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:40 smithi152 ceph-mon[192652]: failed to encode map e59 with expected crc 2023-12-06T15:02:40.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:40 smithi152 ceph-mon[192652]: failed to encode map e59 with expected crc 2023-12-06T15:02:40.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:40 smithi152 ceph-mon[192652]: failed to encode map e59 with expected crc 2023-12-06T15:02:40.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:40 smithi152 ceph-mon[192652]: failed to encode map e59 with expected crc 2023-12-06T15:02:40.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:40 smithi152 ceph-mon[192652]: from='client.? 172.21.15.152:0/1893636922' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-06T15:02:40.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:40 smithi152 ceph-mon[192652]: osdmap e60: 6 total, 6 up, 6 in 2023-12-06T15:02:41.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:41 smithi190 ceph-mon[178398]: failed to encode map e60 with expected crc 2023-12-06T15:02:41.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:41 smithi190 ceph-mon[178398]: failed to encode map e60 with expected crc 2023-12-06T15:02:41.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:41 smithi190 ceph-mon[178398]: failed to encode map e60 with expected crc 2023-12-06T15:02:41.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:41 smithi190 ceph-mon[178398]: failed to encode map e60 with expected crc 2023-12-06T15:02:41.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:41 smithi190 ceph-mon[178398]: pgmap v50: 65 pgs: 1 remapped+peering, 28 active+clean, 12 active+undersized, 16 active+undersized+degraded, 8 active+clean+remapped; 290 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 55/348 objects degraded (15.805%); 12/348 objects misplaced (3.448%); 9.0 MiB/s, 380 objects/s recovering 2023-12-06T15:02:41.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:41 smithi152 ceph-mon[192652]: failed to encode map e60 with expected crc 2023-12-06T15:02:41.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:41 smithi152 ceph-mon[192652]: failed to encode map e60 with expected crc 2023-12-06T15:02:41.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:41 smithi152 ceph-mon[192652]: failed to encode map e60 with expected crc 2023-12-06T15:02:41.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:41 smithi152 ceph-mon[192652]: failed to encode map e60 with expected crc 2023-12-06T15:02:41.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:41 smithi152 ceph-mon[192652]: pgmap v50: 65 pgs: 1 remapped+peering, 28 active+clean, 12 active+undersized, 16 active+undersized+degraded, 8 active+clean+remapped; 290 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 55/348 objects degraded (15.805%); 12/348 objects misplaced (3.448%); 9.0 MiB/s, 380 objects/s recovering 2023-12-06T15:02:43.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:43 smithi190 ceph-mon[178398]: failed to encode map e61 with expected crc 2023-12-06T15:02:43.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:43 smithi190 ceph-mon[178398]: osdmap e61: 6 total, 6 up, 6 in 2023-12-06T15:02:43.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:43 smithi190 ceph-mon[178398]: failed to encode map e61 with expected crc 2023-12-06T15:02:43.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:43 smithi190 ceph-mon[178398]: pgmap v52: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 62 active+clean, 1 active+recovering+undersized+remapped; 290 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s; 1383/348 objects degraded (397.414%); 0 B/s, 329 objects/s recovering 2023-12-06T15:02:43.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:43 smithi190 ceph-mon[178398]: failed to encode map e61 with expected crc 2023-12-06T15:02:43.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:43 smithi152 ceph-mon[192652]: failed to encode map e61 with expected crc 2023-12-06T15:02:43.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:43 smithi152 ceph-mon[192652]: osdmap e61: 6 total, 6 up, 6 in 2023-12-06T15:02:43.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:43 smithi152 ceph-mon[192652]: failed to encode map e61 with expected crc 2023-12-06T15:02:43.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:43 smithi152 ceph-mon[192652]: pgmap v52: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 62 active+clean, 1 active+recovering+undersized+remapped; 290 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s; 1383/348 objects degraded (397.414%); 0 B/s, 329 objects/s recovering 2023-12-06T15:02:43.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:43 smithi152 ceph-mon[192652]: failed to encode map e61 with expected crc 2023-12-06T15:02:44.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:44 smithi190 ceph-mon[178398]: Health check update: Degraded data redundancy: 1383/348 objects degraded (397.414%), 2 pgs degraded (PG_DEGRADED) 2023-12-06T15:02:44.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:44 smithi190 ceph-mon[178398]: failed to encode map e62 with expected crc 2023-12-06T15:02:44.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:44 smithi190 ceph-mon[178398]: osdmap e62: 6 total, 6 up, 6 in 2023-12-06T15:02:44.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:44 smithi190 ceph-mon[178398]: failed to encode map e62 with expected crc 2023-12-06T15:02:44.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:44 smithi190 ceph-mon[178398]: failed to encode map e62 with expected crc 2023-12-06T15:02:44.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:44 smithi190 ceph-mon[178398]: failed to encode map e62 with expected crc 2023-12-06T15:02:44.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:44 smithi152 ceph-mon[192652]: Health check update: Degraded data redundancy: 1383/348 objects degraded (397.414%), 2 pgs degraded (PG_DEGRADED) 2023-12-06T15:02:44.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:44 smithi152 ceph-mon[192652]: failed to encode map e62 with expected crc 2023-12-06T15:02:44.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:44 smithi152 ceph-mon[192652]: osdmap e62: 6 total, 6 up, 6 in 2023-12-06T15:02:44.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:44 smithi152 ceph-mon[192652]: failed to encode map e62 with expected crc 2023-12-06T15:02:44.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:44 smithi152 ceph-mon[192652]: failed to encode map e62 with expected crc 2023-12-06T15:02:44.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:44 smithi152 ceph-mon[192652]: failed to encode map e62 with expected crc 2023-12-06T15:02:45.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:45 smithi152 ceph-mon[192652]: failed to encode map e62 with expected crc 2023-12-06T15:02:45.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:45 smithi152 ceph-mon[192652]: failed to encode map e63 with expected crc 2023-12-06T15:02:45.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:45 smithi152 ceph-mon[192652]: osdmap e63: 6 total, 6 up, 6 in 2023-12-06T15:02:45.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:45 smithi152 ceph-mon[192652]: failed to encode map e63 with expected crc 2023-12-06T15:02:45.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:45 smithi152 ceph-mon[192652]: failed to encode map e63 with expected crc 2023-12-06T15:02:45.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:45 smithi152 ceph-mon[192652]: pgmap v55: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 62 active+clean, 1 active+recovering+undersized+remapped; 290 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s; 1383/348 objects degraded (397.414%); 0 B/s, 329 objects/s recovering 2023-12-06T15:02:46.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:45 smithi190 ceph-mon[178398]: failed to encode map e62 with expected crc 2023-12-06T15:02:46.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:45 smithi190 ceph-mon[178398]: failed to encode map e63 with expected crc 2023-12-06T15:02:46.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:45 smithi190 ceph-mon[178398]: osdmap e63: 6 total, 6 up, 6 in 2023-12-06T15:02:46.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:45 smithi190 ceph-mon[178398]: failed to encode map e63 with expected crc 2023-12-06T15:02:46.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:45 smithi190 ceph-mon[178398]: failed to encode map e63 with expected crc 2023-12-06T15:02:46.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:45 smithi190 ceph-mon[178398]: pgmap v55: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 62 active+clean, 1 active+recovering+undersized+remapped; 290 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s; 1383/348 objects degraded (397.414%); 0 B/s, 329 objects/s recovering 2023-12-06T15:02:46.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:46 smithi152 ceph-mon[192652]: failed to encode map e63 with expected crc 2023-12-06T15:02:46.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:46 smithi152 ceph-mon[192652]: failed to encode map e64 with expected crc 2023-12-06T15:02:46.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:46 smithi152 ceph-mon[192652]: osdmap e64: 6 total, 6 up, 6 in 2023-12-06T15:02:46.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:46 smithi152 ceph-mon[192652]: failed to encode map e64 with expected crc 2023-12-06T15:02:46.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:46 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:46.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:46 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:02:47.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:46 smithi190 ceph-mon[178398]: failed to encode map e63 with expected crc 2023-12-06T15:02:47.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:46 smithi190 ceph-mon[178398]: failed to encode map e64 with expected crc 2023-12-06T15:02:47.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:46 smithi190 ceph-mon[178398]: osdmap e64: 6 total, 6 up, 6 in 2023-12-06T15:02:47.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:46 smithi190 ceph-mon[178398]: failed to encode map e64 with expected crc 2023-12-06T15:02:47.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:46 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:47.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:46 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:02:47.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:47 smithi152 ceph-mon[192652]: pgmap v57: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 62 active+clean, 1 active+recovering+undersized+remapped; 290 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1383/348 objects degraded (397.414%) 2023-12-06T15:02:48.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:47 smithi190 ceph-mon[178398]: pgmap v57: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 62 active+clean, 1 active+recovering+undersized+remapped; 290 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1383/348 objects degraded (397.414%) 2023-12-06T15:02:49.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:48 smithi190 ceph-mon[178398]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1383/348 objects degraded (397.414%), 2 pgs degraded) 2023-12-06T15:02:49.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:48 smithi190 ceph-mon[178398]: Cluster is now healthy 2023-12-06T15:02:49.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:48 smithi152 ceph-mon[192652]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1383/348 objects degraded (397.414%), 2 pgs degraded) 2023-12-06T15:02:49.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:48 smithi152 ceph-mon[192652]: Cluster is now healthy 2023-12-06T15:02:50.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:49 smithi190 ceph-mon[178398]: pgmap v58: 65 pgs: 65 active+clean; 290 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 0 B/s, 239 objects/s recovering 2023-12-06T15:02:50.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:49 smithi152 ceph-mon[192652]: pgmap v58: 65 pgs: 65 active+clean; 290 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 0 B/s, 239 objects/s recovering 2023-12-06T15:02:51.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:50 smithi190 ceph-mon[178398]: pgmap v59: 65 pgs: 65 active+clean; 290 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s; 0 B/s, 204 objects/s recovering 2023-12-06T15:02:51.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:50 smithi152 ceph-mon[192652]: pgmap v59: 65 pgs: 65 active+clean; 290 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s; 0 B/s, 204 objects/s recovering 2023-12-06T15:02:54.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:53 smithi190 ceph-mon[178398]: pgmap v60: 65 pgs: 65 active+clean; 290 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 0 B/s, 179 objects/s recovering 2023-12-06T15:02:54.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:53 smithi152 ceph-mon[192652]: pgmap v60: 65 pgs: 65 active+clean; 290 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 0 B/s, 179 objects/s recovering 2023-12-06T15:02:55.042 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:54 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-06T15:02:55.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:54 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-06T15:02:55.941 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:55 smithi152 ceph-mon[192652]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-06T15:02:55.941 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:55 smithi152 ceph-mon[192652]: Upgrade: osd.1 is safe to restart 2023-12-06T15:02:55.941 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:55 smithi152 ceph-mon[192652]: pgmap v61: 65 pgs: 65 active+clean; 290 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 0 B/s, 143 objects/s recovering 2023-12-06T15:02:55.941 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:55 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:55.942 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:55 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-06T15:02:55.942 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:55 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:02:56.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:55 smithi190 ceph-mon[178398]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2023-12-06T15:02:56.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:55 smithi190 ceph-mon[178398]: Upgrade: osd.1 is safe to restart 2023-12-06T15:02:56.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:55 smithi190 ceph-mon[178398]: pgmap v61: 65 pgs: 65 active+clean; 290 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 0 B/s, 143 objects/s recovering 2023-12-06T15:02:56.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:55 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:56.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:55 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-06T15:02:56.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:55 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:02:56.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:56 smithi152 ceph-mon[192652]: Upgrade: Updating osd.1 2023-12-06T15:02:56.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:56 smithi152 ceph-mon[192652]: Deploying daemon osd.1 on smithi152 2023-12-06T15:02:56.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:56 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:57.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:56 smithi190 ceph-mon[178398]: Upgrade: Updating osd.1 2023-12-06T15:02:57.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:56 smithi190 ceph-mon[178398]: Deploying daemon osd.1 on smithi152 2023-12-06T15:02:57.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:56 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:02:57.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:57 smithi152 ceph-mon[192652]: pgmap v62: 65 pgs: 65 active+clean; 290 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s; 0 B/s, 130 objects/s recovering 2023-12-06T15:02:57.878 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 15:02:57 smithi152 systemd[1]: Stopping Ceph osd.1 for 062f0e3c-9447-11ee-95a2-87774f69a715... 2023-12-06T15:02:57.878 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 15:02:57 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-1[144858]: 2023-12-06T15:02:57.709+0000 7fe515b22700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-06T15:02:57.878 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 15:02:57 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-1[144858]: 2023-12-06T15:02:57.709+0000 7fe515b22700 -1 osd.1 64 *** Got signal Terminated *** 2023-12-06T15:02:57.879 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 15:02:57 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-1[144858]: 2023-12-06T15:02:57.709+0000 7fe515b22700 -1 osd.1 64 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-06T15:02:58.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:57 smithi190 ceph-mon[178398]: pgmap v62: 65 pgs: 65 active+clean; 290 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s; 0 B/s, 130 objects/s recovering 2023-12-06T15:02:59.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:58 smithi190 ceph-mon[178398]: osd.1 marked itself down and dead 2023-12-06T15:02:59.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:58 smithi152 ceph-mon[192652]: osd.1 marked itself down and dead 2023-12-06T15:02:59.628 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 15:02:59 smithi152 bash[209049]: ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-1 2023-12-06T15:03:00.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:59 smithi190 ceph-mon[178398]: pgmap v63: 65 pgs: 65 active+clean; 290 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 0 B/s, 119 objects/s recovering 2023-12-06T15:03:00.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:59 smithi190 ceph-mon[178398]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-06T15:03:00.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:59 smithi190 ceph-mon[178398]: osdmap e65: 6 total, 5 up, 6 in 2023-12-06T15:03:00.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:59 smithi190 ceph-mon[178398]: failed to encode map e65 with expected crc 2023-12-06T15:03:00.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:59 smithi190 ceph-mon[178398]: failed to encode map e65 with expected crc 2023-12-06T15:03:00.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:59 smithi190 ceph-mon[178398]: failed to encode map e65 with expected crc 2023-12-06T15:03:00.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:02:59 smithi190 ceph-mon[178398]: failed to encode map e65 with expected crc 2023-12-06T15:03:00.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:59 smithi152 ceph-mon[192652]: pgmap v63: 65 pgs: 65 active+clean; 290 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 0 B/s, 119 objects/s recovering 2023-12-06T15:03:00.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:59 smithi152 ceph-mon[192652]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-06T15:03:00.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:59 smithi152 ceph-mon[192652]: osdmap e65: 6 total, 5 up, 6 in 2023-12-06T15:03:00.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:59 smithi152 ceph-mon[192652]: failed to encode map e65 with expected crc 2023-12-06T15:03:00.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:59 smithi152 ceph-mon[192652]: failed to encode map e65 with expected crc 2023-12-06T15:03:00.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:59 smithi152 ceph-mon[192652]: failed to encode map e65 with expected crc 2023-12-06T15:03:00.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:02:59 smithi152 ceph-mon[192652]: failed to encode map e65 with expected crc 2023-12-06T15:03:00.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:00 smithi152 ceph-mon[192652]: failed to encode map e66 with expected crc 2023-12-06T15:03:00.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:00 smithi152 ceph-mon[192652]: failed to encode map e66 with expected crc 2023-12-06T15:03:00.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:00 smithi152 ceph-mon[192652]: failed to encode map e66 with expected crc 2023-12-06T15:03:00.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:00 smithi152 ceph-mon[192652]: failed to encode map e66 with expected crc 2023-12-06T15:03:00.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:00 smithi152 ceph-mon[192652]: osdmap e66: 6 total, 5 up, 6 in 2023-12-06T15:03:00.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:00 smithi152 ceph-mon[192652]: failed to encode map e66 with expected crc 2023-12-06T15:03:00.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:00 smithi152 ceph-mon[192652]: failed to encode map e66 with expected crc 2023-12-06T15:03:00.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:00 smithi152 ceph-mon[192652]: failed to encode map e66 with expected crc 2023-12-06T15:03:00.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:00 smithi152 ceph-mon[192652]: failed to encode map e66 with expected crc 2023-12-06T15:03:00.880 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:00 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:00.880 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:00 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:03:00.880 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 15:03:00 smithi152 systemd[1]: ceph-062f0e3c-9447-11ee-95a2-87774f69a715@osd.1.service: Succeeded. 2023-12-06T15:03:00.880 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 15:03:00 smithi152 systemd[1]: Stopped Ceph osd.1 for 062f0e3c-9447-11ee-95a2-87774f69a715. 2023-12-06T15:03:00.880 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 15:03:00 smithi152 systemd[1]: Starting Ceph osd.1 for 062f0e3c-9447-11ee-95a2-87774f69a715... 2023-12-06T15:03:01.074 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:00 smithi190 ceph-mon[178398]: failed to encode map e66 with expected crc 2023-12-06T15:03:01.074 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:00 smithi190 ceph-mon[178398]: failed to encode map e66 with expected crc 2023-12-06T15:03:01.074 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:00 smithi190 ceph-mon[178398]: failed to encode map e66 with expected crc 2023-12-06T15:03:01.074 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:00 smithi190 ceph-mon[178398]: failed to encode map e66 with expected crc 2023-12-06T15:03:01.074 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:00 smithi190 ceph-mon[178398]: osdmap e66: 6 total, 5 up, 6 in 2023-12-06T15:03:01.074 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:00 smithi190 ceph-mon[178398]: failed to encode map e66 with expected crc 2023-12-06T15:03:01.074 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:00 smithi190 ceph-mon[178398]: failed to encode map e66 with expected crc 2023-12-06T15:03:01.074 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:00 smithi190 ceph-mon[178398]: failed to encode map e66 with expected crc 2023-12-06T15:03:01.074 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:00 smithi190 ceph-mon[178398]: failed to encode map e66 with expected crc 2023-12-06T15:03:01.074 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:00 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:01.074 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:00 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:03:01.690 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 15:03:01 smithi152 bash[209319]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-06T15:03:01.691 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 15:03:01 smithi152 bash[209319]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2023-12-06T15:03:01.691 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 15:03:01 smithi152 bash[209319]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2023-12-06T15:03:01.691 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 15:03:01 smithi152 bash[209319]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2023-12-06T15:03:01.691 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 15:03:01 smithi152 bash[209319]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2023-12-06T15:03:01.691 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 15:03:01 smithi152 bash[209319]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-06T15:03:01.691 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 15:03:01 smithi152 bash[209319]: --> ceph-volume raw activate successful for osd ID: 1 2023-12-06T15:03:02.043 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:01 smithi152 ceph-mon[192652]: pgmap v66: 65 pgs: 11 stale+active+clean, 54 active+clean; 290 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-12-06T15:03:02.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:01 smithi190 ceph-mon[178398]: pgmap v66: 65 pgs: 11 stale+active+clean, 54 active+clean; 290 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-12-06T15:03:02.378 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 15:03:02 smithi152 ceph-osd[209641]: -- 172.21.15.152:0/1668654673 <== mon.0 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c1787eb1e0 con 0x55c1787bac00 2023-12-06T15:03:02.378 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 15:03:02 smithi152 bash[209604]: c0eaab4b2fd0d2dd06fa5d7ff2159bd4429046d15c95cefba4e54ae04fa940be 2023-12-06T15:03:02.378 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 15:03:02 smithi152 systemd[1]: Started Ceph osd.1 for 062f0e3c-9447-11ee-95a2-87774f69a715. 2023-12-06T15:03:03.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:02 smithi190 ceph-mon[178398]: mgrmap e38: smithi152.meodco(active, since 91s), standbys: smithi190.ubusrr 2023-12-06T15:03:03.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:02 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:03.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:02 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:03.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:02 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:03:03.128 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 15:03:02 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-1[209618]: 2023-12-06T15:03:02.644+0000 7f3a83a55640 -1 Falling back to public interface 2023-12-06T15:03:03.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:02 smithi152 ceph-mon[192652]: mgrmap e38: smithi152.meodco(active, since 91s), standbys: smithi190.ubusrr 2023-12-06T15:03:03.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:02 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:03.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:02 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:03.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:02 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:03:03.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:03 smithi152 ceph-mon[192652]: pgmap v67: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 290 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 767 B/s wr, 0 op/s; 55/348 objects degraded (15.805%) 2023-12-06T15:03:03.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:03 smithi152 ceph-mon[192652]: Health check failed: Degraded data redundancy: 55/348 objects degraded (15.805%), 16 pgs degraded (PG_DEGRADED) 2023-12-06T15:03:04.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:03 smithi190 ceph-mon[178398]: pgmap v67: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 290 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 767 B/s wr, 0 op/s; 55/348 objects degraded (15.805%) 2023-12-06T15:03:04.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:03 smithi190 ceph-mon[178398]: Health check failed: Degraded data redundancy: 55/348 objects degraded (15.805%), 16 pgs degraded (PG_DEGRADED) 2023-12-06T15:03:06.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:05 smithi190 ceph-mon[178398]: pgmap v68: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 290 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 767 B/s wr, 0 op/s; 55/348 objects degraded (15.805%) 2023-12-06T15:03:06.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:05 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:06.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:05 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:06.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:05 smithi152 ceph-mon[192652]: pgmap v68: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 290 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 767 B/s wr, 0 op/s; 55/348 objects degraded (15.805%) 2023-12-06T15:03:06.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:05 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:06.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:05 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:07.195 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:07 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:07.195 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:07 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:07.195 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:07 smithi152 ceph-mon[192652]: pgmap v69: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 290 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 767 B/s wr, 0 op/s; 55/348 objects degraded (15.805%) 2023-12-06T15:03:07.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:07 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:07.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:07 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:07.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:07 smithi190 ceph-mon[178398]: pgmap v69: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 290 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 767 B/s wr, 0 op/s; 55/348 objects degraded (15.805%) 2023-12-06T15:03:07.629 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 15:03:07 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-1[209618]: 2023-12-06T15:03:07.192+0000 7f3a83a55640 -1 osd.1 0 read_superblock omap replica is missing. 2023-12-06T15:03:08.127 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 15:03:07 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-1[209618]: 2023-12-06T15:03:07.705+0000 7f3a83a55640 -1 osd.1 64 log_to_monitors true 2023-12-06T15:03:08.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:08 smithi152 ceph-mon[192652]: from='osd.1 [v2:172.21.15.152:6810/3248615058,v1:172.21.15.152:6811/3248615058]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-06T15:03:08.378 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 15:03:08 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-1[209618]: 2023-12-06T15:03:08.151+0000 7f3a746c5700 -1 osd.1 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-06T15:03:08.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:08 smithi190 ceph-mon[178398]: from='osd.1 [v2:172.21.15.152:6810/3248615058,v1:172.21.15.152:6811/3248615058]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-06T15:03:09.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:09 smithi190 ceph-mon[178398]: from='osd.1 [v2:172.21.15.152:6810/3248615058,v1:172.21.15.152:6811/3248615058]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-06T15:03:09.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:09 smithi190 ceph-mon[178398]: failed to encode map e67 with expected crc 2023-12-06T15:03:09.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:09 smithi190 ceph-mon[178398]: osdmap e67: 6 total, 5 up, 6 in 2023-12-06T15:03:09.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:09 smithi190 ceph-mon[178398]: from='osd.1 [v2:172.21.15.152:6810/3248615058,v1:172.21.15.152:6811/3248615058]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-06T15:03:09.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:09 smithi190 ceph-mon[178398]: pgmap v71: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 290 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 688 B/s wr, 0 op/s; 55/348 objects degraded (15.805%) 2023-12-06T15:03:09.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:09 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:09.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:09 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:09.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:09 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:03:09.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:09 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T15:03:09.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:09 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:09.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:09 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:03:09.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:09 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:03:09.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:09 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:03:09.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:09 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:03:09.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:09 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-06T15:03:09.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:09 smithi152 ceph-mon[192652]: from='osd.1 [v2:172.21.15.152:6810/3248615058,v1:172.21.15.152:6811/3248615058]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-06T15:03:09.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:09 smithi152 ceph-mon[192652]: failed to encode map e67 with expected crc 2023-12-06T15:03:09.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:09 smithi152 ceph-mon[192652]: osdmap e67: 6 total, 5 up, 6 in 2023-12-06T15:03:09.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:09 smithi152 ceph-mon[192652]: from='osd.1 [v2:172.21.15.152:6810/3248615058,v1:172.21.15.152:6811/3248615058]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-06T15:03:09.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:09 smithi152 ceph-mon[192652]: pgmap v71: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 290 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 688 B/s wr, 0 op/s; 55/348 objects degraded (15.805%) 2023-12-06T15:03:09.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:09 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:09.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:09 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:09.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:09 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:03:09.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:09 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T15:03:09.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:09 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:09.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:09 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:03:09.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:09 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:03:09.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:09 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:03:09.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:09 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:03:09.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:09 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-06T15:03:09.721 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.719+0000 7f4c31704700 1 -- 172.21.15.152:0/3248172820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c2c0fcd90 msgr2=0x7f4c2c0fd200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:09.721 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.719+0000 7f4c31704700 1 --2- 172.21.15.152:0/3248172820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c2c0fcd90 0x7f4c2c0fd200 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c004940 tx=0x7f4c1c009e30 comp rx=0 tx=0).stop 2023-12-06T15:03:09.722 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.719+0000 7f4c31704700 1 -- 172.21.15.152:0/3248172820 shutdown_connections 2023-12-06T15:03:09.722 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.719+0000 7f4c31704700 1 --2- 172.21.15.152:0/3248172820 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c2c0fcd90 0x7f4c2c0fd200 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:09.722 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.719+0000 7f4c31704700 1 --2- 172.21.15.152:0/3248172820 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c2c0fbae0 0x7f4c2c0fbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:09.722 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.719+0000 7f4c31704700 1 -- 172.21.15.152:0/3248172820 >> 172.21.15.152:0/3248172820 conn(0x7f4c2c0f7240 msgr2=0x7f4c2c0f9670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:03:09.722 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.719+0000 7f4c31704700 1 -- 172.21.15.152:0/3248172820 shutdown_connections 2023-12-06T15:03:09.722 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.719+0000 7f4c31704700 1 -- 172.21.15.152:0/3248172820 wait complete. 2023-12-06T15:03:09.722 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.719+0000 7f4c31704700 1 Processor -- start 2023-12-06T15:03:09.722 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.719+0000 7f4c31704700 1 -- start start 2023-12-06T15:03:09.722 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.720+0000 7f4c31704700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c2c0fbae0 0x7f4c2c110270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:09.722 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.720+0000 7f4c31704700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c2c0fcd90 0x7f4c2c1127c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:09.722 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.720+0000 7f4c31704700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c0669c0 con 0x7f4c2c0fcd90 2023-12-06T15:03:09.722 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.720+0000 7f4c31704700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c066b00 con 0x7f4c2c0fbae0 2023-12-06T15:03:09.723 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.720+0000 7f4c2a7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c2c0fcd90 0x7f4c2c1127c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:09.723 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.720+0000 7f4c2a7fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c2c0fcd90 0x7f4c2c1127c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56926/0 (socket says 172.21.15.152:56926) 2023-12-06T15:03:09.723 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.720+0000 7f4c2a7fc700 1 -- 172.21.15.152:0/1337399480 learned_addr learned my addr 172.21.15.152:0/1337399480 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:03:09.723 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.720+0000 7f4c2affd700 1 --2- 172.21.15.152:0/1337399480 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c2c0fbae0 0x7f4c2c110270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:09.723 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.720+0000 7f4c2a7fc700 1 -- 172.21.15.152:0/1337399480 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c2c0fbae0 msgr2=0x7f4c2c110270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:09.723 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.720+0000 7f4c2a7fc700 1 --2- 172.21.15.152:0/1337399480 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c2c0fbae0 0x7f4c2c110270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:09.723 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.720+0000 7f4c2a7fc700 1 -- 172.21.15.152:0/1337399480 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1c005040 con 0x7f4c2c0fcd90 2023-12-06T15:03:09.723 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.720+0000 7f4c2affd700 1 --2- 172.21.15.152:0/1337399480 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c2c0fbae0 0x7f4c2c110270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-06T15:03:09.723 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.720+0000 7f4c2a7fc700 1 --2- 172.21.15.152:0/1337399480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c2c0fcd90 0x7f4c2c1127c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c009380 tx=0x7f4c1c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:03:09.723 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.720+0000 7f4c137fe700 1 -- 172.21.15.152:0/1337399480 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c1c00e040 con 0x7f4c2c0fcd90 2023-12-06T15:03:09.723 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.720+0000 7f4c137fe700 1 -- 172.21.15.152:0/1337399480 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4c1c00bda0 con 0x7f4c2c0fcd90 2023-12-06T15:03:09.723 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.720+0000 7f4c31704700 1 -- 172.21.15.152:0/1337399480 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c2c112dc0 con 0x7f4c2c0fcd90 2023-12-06T15:03:09.723 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.720+0000 7f4c137fe700 1 -- 172.21.15.152:0/1337399480 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c1c01c630 con 0x7f4c2c0fcd90 2023-12-06T15:03:09.724 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.720+0000 7f4c31704700 1 -- 172.21.15.152:0/1337399480 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c2c113280 con 0x7f4c2c0fcd90 2023-12-06T15:03:09.724 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.721+0000 7f4c31704700 1 -- 172.21.15.152:0/1337399480 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c2c04bb80 con 0x7f4c2c0fcd90 2023-12-06T15:03:09.724 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.722+0000 7f4c137fe700 1 -- 172.21.15.152:0/1337399480 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f4c1c0139d0 con 0x7f4c2c0fcd90 2023-12-06T15:03:09.724 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.722+0000 7f4c137fe700 1 --2- 172.21.15.152:0/1337399480 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f4c1406ce60 0x7f4c1406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:09.725 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.722+0000 7f4c137fe700 1 -- 172.21.15.152:0/1337399480 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f4c1c08d750 con 0x7f4c2c0fcd90 2023-12-06T15:03:09.725 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.722+0000 7f4c2affd700 1 --2- 172.21.15.152:0/1337399480 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f4c1406ce60 0x7f4c1406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:09.725 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.723+0000 7f4c2affd700 1 --2- 172.21.15.152:0/1337399480 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f4c1406ce60 0x7f4c1406f310 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4c200041d0 tx=0x7f4c20009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:03:09.728 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.727+0000 7f4c137fe700 1 -- 172.21.15.152:0/1337399480 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4c1c057640 con 0x7f4c2c0fcd90 2023-12-06T15:03:09.934 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.932+0000 7f4c31704700 1 -- 172.21.15.152:0/1337399480 --> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c2c1016e0 con 0x7f4c1406ce60 2023-12-06T15:03:09.935 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.934+0000 7f4c137fe700 1 -- 172.21.15.152:0/1337399480 <== mgr.34104 v2:172.21.15.152:6800/2427836422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f4c2c1016e0 con 0x7f4c1406ce60 2023-12-06T15:03:09.937 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.936+0000 7f4c31704700 1 -- 172.21.15.152:0/1337399480 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f4c1406ce60 msgr2=0x7f4c1406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:09.937 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.936+0000 7f4c31704700 1 --2- 172.21.15.152:0/1337399480 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f4c1406ce60 0x7f4c1406f310 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4c200041d0 tx=0x7f4c20009040 comp rx=0 tx=0).stop 2023-12-06T15:03:09.937 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.936+0000 7f4c31704700 1 -- 172.21.15.152:0/1337399480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c2c0fcd90 msgr2=0x7f4c2c1127c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:09.937 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.936+0000 7f4c31704700 1 --2- 172.21.15.152:0/1337399480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c2c0fcd90 0x7f4c2c1127c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c009380 tx=0x7f4c1c009e30 comp rx=0 tx=0).stop 2023-12-06T15:03:09.937 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.936+0000 7f4c31704700 1 -- 172.21.15.152:0/1337399480 shutdown_connections 2023-12-06T15:03:09.937 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.936+0000 7f4c31704700 1 --2- 172.21.15.152:0/1337399480 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f4c1406ce60 0x7f4c1406f310 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:09.938 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.936+0000 7f4c31704700 1 --2- 172.21.15.152:0/1337399480 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c2c0fbae0 0x7f4c2c110270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:09.938 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.936+0000 7f4c31704700 1 --2- 172.21.15.152:0/1337399480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c2c0fcd90 0x7f4c2c1127c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:09.938 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.936+0000 7f4c31704700 1 -- 172.21.15.152:0/1337399480 >> 172.21.15.152:0/1337399480 conn(0x7f4c2c0f7240 msgr2=0x7f4c2c0fffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:03:09.938 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.936+0000 7f4c31704700 1 -- 172.21.15.152:0/1337399480 shutdown_connections 2023-12-06T15:03:09.938 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:09.936+0000 7f4c31704700 1 -- 172.21.15.152:0/1337399480 wait complete. 2023-12-06T15:03:09.948 INFO:teuthology.orchestra.run.smithi152.stdout:true 2023-12-06T15:03:10.039 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.038+0000 7f0e651db700 1 -- 172.21.15.152:0/3685071997 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e600fcd00 msgr2=0x7f0e600fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:10.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.038+0000 7f0e651db700 1 --2- 172.21.15.152:0/3685071997 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e600fcd00 0x7f0e600fd150 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0e50004940 tx=0x7f0e50009e30 comp rx=0 tx=0).stop 2023-12-06T15:03:10.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.038+0000 7f0e651db700 1 -- 172.21.15.152:0/3685071997 shutdown_connections 2023-12-06T15:03:10.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.038+0000 7f0e651db700 1 --2- 172.21.15.152:0/3685071997 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e600fcd00 0x7f0e600fd150 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:10.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.038+0000 7f0e651db700 1 --2- 172.21.15.152:0/3685071997 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e600fbaf0 0x7f0e600fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:10.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.038+0000 7f0e651db700 1 -- 172.21.15.152:0/3685071997 >> 172.21.15.152:0/3685071997 conn(0x7f0e600f71b0 msgr2=0x7f0e600f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:03:10.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.038+0000 7f0e651db700 1 -- 172.21.15.152:0/3685071997 shutdown_connections 2023-12-06T15:03:10.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.038+0000 7f0e651db700 1 -- 172.21.15.152:0/3685071997 wait complete. 2023-12-06T15:03:10.041 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.039+0000 7f0e651db700 1 Processor -- start 2023-12-06T15:03:10.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.039+0000 7f0e651db700 1 -- start start 2023-12-06T15:03:10.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.039+0000 7f0e651db700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e600fbaf0 0x7f0e601101a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:10.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.039+0000 7f0e651db700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e600fcd00 0x7f0e601126f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:10.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.039+0000 7f0e651db700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e600669a0 con 0x7f0e600fbaf0 2023-12-06T15:03:10.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.039+0000 7f0e651db700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e60066ae0 con 0x7f0e600fcd00 2023-12-06T15:03:10.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.039+0000 7f0e5ed9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e600fbaf0 0x7f0e601101a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:10.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.039+0000 7f0e5ed9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e600fbaf0 0x7f0e601101a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56934/0 (socket says 172.21.15.152:56934) 2023-12-06T15:03:10.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.039+0000 7f0e5ed9d700 1 -- 172.21.15.152:0/1387695195 learned_addr learned my addr 172.21.15.152:0/1387695195 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:03:10.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.039+0000 7f0e5e59c700 1 --2- 172.21.15.152:0/1387695195 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e600fcd00 0x7f0e601126f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:10.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.039+0000 7f0e5ed9d700 1 -- 172.21.15.152:0/1387695195 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e600fcd00 msgr2=0x7f0e601126f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:10.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.039+0000 7f0e5ed9d700 1 --2- 172.21.15.152:0/1387695195 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e600fcd00 0x7f0e601126f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:10.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.039+0000 7f0e5ed9d700 1 -- 172.21.15.152:0/1387695195 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e50005040 con 0x7f0e600fbaf0 2023-12-06T15:03:10.042 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.040+0000 7f0e5ed9d700 1 --2- 172.21.15.152:0/1387695195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e600fbaf0 0x7f0e601101a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0e4800eb70 tx=0x7f0e4800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:03:10.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.040+0000 7f0e577fe700 1 -- 172.21.15.152:0/1387695195 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e48007cc0 con 0x7f0e600fbaf0 2023-12-06T15:03:10.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.040+0000 7f0e577fe700 1 -- 172.21.15.152:0/1387695195 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0e4800f040 con 0x7f0e600fbaf0 2023-12-06T15:03:10.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.040+0000 7f0e577fe700 1 -- 172.21.15.152:0/1387695195 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e4800c9d0 con 0x7f0e600fbaf0 2023-12-06T15:03:10.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.040+0000 7f0e651db700 1 -- 172.21.15.152:0/1387695195 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e60112cf0 con 0x7f0e600fbaf0 2023-12-06T15:03:10.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.040+0000 7f0e651db700 1 -- 172.21.15.152:0/1387695195 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e60113180 con 0x7f0e600fbaf0 2023-12-06T15:03:10.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.041+0000 7f0e651db700 1 -- 172.21.15.152:0/1387695195 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e6004bb80 con 0x7f0e600fbaf0 2023-12-06T15:03:10.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.041+0000 7f0e577fe700 1 -- 172.21.15.152:0/1387695195 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f0e4800cc40 con 0x7f0e600fbaf0 2023-12-06T15:03:10.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.041+0000 7f0e577fe700 1 --2- 172.21.15.152:0/1387695195 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f0e4c06ce60 0x7f0e4c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:10.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.042+0000 7f0e577fe700 1 -- 172.21.15.152:0/1387695195 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f0e4808bf30 con 0x7f0e600fbaf0 2023-12-06T15:03:10.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.042+0000 7f0e5e59c700 1 --2- 172.21.15.152:0/1387695195 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f0e4c06ce60 0x7f0e4c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:10.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.042+0000 7f0e5e59c700 1 --2- 172.21.15.152:0/1387695195 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f0e4c06ce60 0x7f0e4c06f310 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0e50000c00 tx=0x7f0e50009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:03:10.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.046+0000 7f0e577fe700 1 -- 172.21.15.152:0/1387695195 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f0e48055d10 con 0x7f0e600fbaf0 2023-12-06T15:03:10.279 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.278+0000 7f0e651db700 1 -- 172.21.15.152:0/1387695195 --> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e60101650 con 0x7f0e4c06ce60 2023-12-06T15:03:10.280 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.279+0000 7f0e577fe700 1 -- 172.21.15.152:0/1387695195 <== mgr.34104 v2:172.21.15.152:6800/2427836422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f0e60101650 con 0x7f0e4c06ce60 2023-12-06T15:03:10.282 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.281+0000 7f0e651db700 1 -- 172.21.15.152:0/1387695195 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f0e4c06ce60 msgr2=0x7f0e4c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:10.282 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.281+0000 7f0e651db700 1 --2- 172.21.15.152:0/1387695195 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f0e4c06ce60 0x7f0e4c06f310 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0e50000c00 tx=0x7f0e50009e30 comp rx=0 tx=0).stop 2023-12-06T15:03:10.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.281+0000 7f0e651db700 1 -- 172.21.15.152:0/1387695195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e600fbaf0 msgr2=0x7f0e601101a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:10.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.281+0000 7f0e651db700 1 --2- 172.21.15.152:0/1387695195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e600fbaf0 0x7f0e601101a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0e4800eb70 tx=0x7f0e4800b040 comp rx=0 tx=0).stop 2023-12-06T15:03:10.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.281+0000 7f0e651db700 1 -- 172.21.15.152:0/1387695195 shutdown_connections 2023-12-06T15:03:10.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.281+0000 7f0e651db700 1 --2- 172.21.15.152:0/1387695195 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f0e4c06ce60 0x7f0e4c06f310 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:10.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.281+0000 7f0e651db700 1 --2- 172.21.15.152:0/1387695195 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0e600fbaf0 0x7f0e601101a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:10.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.281+0000 7f0e651db700 1 --2- 172.21.15.152:0/1387695195 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e600fcd00 0x7f0e601126f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:10.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.281+0000 7f0e651db700 1 -- 172.21.15.152:0/1387695195 >> 172.21.15.152:0/1387695195 conn(0x7f0e600f71b0 msgr2=0x7f0e600fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:03:10.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.281+0000 7f0e651db700 1 -- 172.21.15.152:0/1387695195 shutdown_connections 2023-12-06T15:03:10.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.282+0000 7f0e651db700 1 -- 172.21.15.152:0/1387695195 wait complete. 2023-12-06T15:03:10.384 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.383+0000 7fb8fff3b700 1 -- 172.21.15.152:0/2396747325 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8f80fbaf0 msgr2=0x7fb8f80fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:10.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.383+0000 7fb8fff3b700 1 --2- 172.21.15.152:0/2396747325 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8f80fbaf0 0x7fb8f80fbf00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4004940 tx=0x7fb8f4009e30 comp rx=0 tx=0).stop 2023-12-06T15:03:10.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.383+0000 7fb8fff3b700 1 -- 172.21.15.152:0/2396747325 shutdown_connections 2023-12-06T15:03:10.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.383+0000 7fb8fff3b700 1 --2- 172.21.15.152:0/2396747325 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8f80fcd00 0x7fb8f80fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:10.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.383+0000 7fb8fff3b700 1 --2- 172.21.15.152:0/2396747325 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8f80fbaf0 0x7fb8f80fbf00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:10.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.383+0000 7fb8fff3b700 1 -- 172.21.15.152:0/2396747325 >> 172.21.15.152:0/2396747325 conn(0x7fb8f80f7190 msgr2=0x7fb8f80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:03:10.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.383+0000 7fb8fff3b700 1 -- 172.21.15.152:0/2396747325 shutdown_connections 2023-12-06T15:03:10.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.383+0000 7fb8fff3b700 1 -- 172.21.15.152:0/2396747325 wait complete. 2023-12-06T15:03:10.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.383+0000 7fb8fff3b700 1 Processor -- start 2023-12-06T15:03:10.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.383+0000 7fb8fff3b700 1 -- start start 2023-12-06T15:03:10.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.384+0000 7fb8fff3b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8f80fbaf0 0x7fb8f810c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:10.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.384+0000 7fb8fff3b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8f80fcd00 0x7fb8f810c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:10.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.384+0000 7fb8fff3b700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f810cfc0 con 0x7fb8f80fcd00 2023-12-06T15:03:10.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.384+0000 7fb8fff3b700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f810d860 con 0x7fb8f80fbaf0 2023-12-06T15:03:10.387 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.384+0000 7fb8fd4d6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8f80fcd00 0x7fb8f810c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:10.387 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.384+0000 7fb8fd4d6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8f80fcd00 0x7fb8f810c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56958/0 (socket says 172.21.15.152:56958) 2023-12-06T15:03:10.387 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.384+0000 7fb8fd4d6700 1 -- 172.21.15.152:0/987612816 learned_addr learned my addr 172.21.15.152:0/987612816 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:03:10.387 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.384+0000 7fb8fdcd7700 1 --2- 172.21.15.152:0/987612816 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8f80fbaf0 0x7fb8f810c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:10.387 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.384+0000 7fb8fd4d6700 1 -- 172.21.15.152:0/987612816 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8f80fbaf0 msgr2=0x7fb8f810c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:10.387 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.384+0000 7fb8fd4d6700 1 --2- 172.21.15.152:0/987612816 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8f80fbaf0 0x7fb8f810c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:10.387 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.384+0000 7fb8fd4d6700 1 -- 172.21.15.152:0/987612816 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f4005040 con 0x7fb8f80fcd00 2023-12-06T15:03:10.387 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.384+0000 7fb8fd4d6700 1 --2- 172.21.15.152:0/987612816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8f80fcd00 0x7fb8f810c9c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec00c830 tx=0x7fb8ec004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:03:10.387 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.384+0000 7fb8ea7fc700 1 -- 172.21.15.152:0/987612816 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8ec0106f0 con 0x7fb8f80fcd00 2023-12-06T15:03:10.387 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.384+0000 7fb8ea7fc700 1 -- 172.21.15.152:0/987612816 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb8ec010d00 con 0x7fb8f80fcd00 2023-12-06T15:03:10.388 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.384+0000 7fb8ea7fc700 1 -- 172.21.15.152:0/987612816 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8ec012e90 con 0x7fb8f80fcd00 2023-12-06T15:03:10.388 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.384+0000 7fb8fff3b700 1 -- 172.21.15.152:0/987612816 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f810db40 con 0x7fb8f80fcd00 2023-12-06T15:03:10.388 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.385+0000 7fb8fff3b700 1 -- 172.21.15.152:0/987612816 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f810e080 con 0x7fb8f80fcd00 2023-12-06T15:03:10.388 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.385+0000 7fb8fff3b700 1 -- 172.21.15.152:0/987612816 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f804bb80 con 0x7fb8f80fcd00 2023-12-06T15:03:10.388 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.386+0000 7fb8ea7fc700 1 -- 172.21.15.152:0/987612816 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fb8ec010850 con 0x7fb8f80fcd00 2023-12-06T15:03:10.388 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.386+0000 7fb8ea7fc700 1 --2- 172.21.15.152:0/987612816 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fb8e406ce70 0x7fb8e406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:10.389 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.386+0000 7fb8ea7fc700 1 -- 172.21.15.152:0/987612816 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6675+0+0 (secure 0 0 0) 0x7fb8ec08c360 con 0x7fb8f80fcd00 2023-12-06T15:03:10.389 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.386+0000 7fb8fdcd7700 1 --2- 172.21.15.152:0/987612816 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fb8e406ce70 0x7fb8e406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:10.389 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.387+0000 7fb8fdcd7700 1 --2- 172.21.15.152:0/987612816 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fb8e406ce70 0x7fb8e406f320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb8f400b3b0 tx=0x7fb8f4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:03:10.392 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.391+0000 7fb8ea7fc700 1 -- 172.21.15.152:0/987612816 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fb8ec059c40 con 0x7fb8f80fcd00 2023-12-06T15:03:10.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:10 smithi190 ceph-mon[178398]: failed to encode map e67 with expected crc 2023-12-06T15:03:10.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:10 smithi190 ceph-mon[178398]: failed to encode map e67 with expected crc 2023-12-06T15:03:10.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:10 smithi190 ceph-mon[178398]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-06T15:03:10.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:10 smithi190 ceph-mon[178398]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-12-06T15:03:10.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:10 smithi190 ceph-mon[178398]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-06T15:03:10.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:10 smithi190 ceph-mon[178398]: failed to encode map e68 with expected crc 2023-12-06T15:03:10.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:10 smithi190 ceph-mon[178398]: osd.1 [v2:172.21.15.152:6810/3248615058,v1:172.21.15.152:6811/3248615058] boot 2023-12-06T15:03:10.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:10 smithi190 ceph-mon[178398]: osdmap e68: 6 total, 6 up, 6 in 2023-12-06T15:03:10.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:10 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-06T15:03:10.593 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.591+0000 7fb8fff3b700 1 -- 172.21.15.152:0/987612816 --> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8f810e530 con 0x7fb8e406ce70 2023-12-06T15:03:10.602 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.601+0000 7fb8ea7fc700 1 -- 172.21.15.152:0/987612816 <== mgr.34104 v2:172.21.15.152:6800/2427836422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fb8f810e530 con 0x7fb8e406ce70 2023-12-06T15:03:10.602 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-06T15:03:10.602 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 running (3m) 5s ago 8m 26.3M - 0.25.0 c8568f914cd2 b1a46cc95546 2023-12-06T15:03:10.603 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (56s) 5s ago 9m 7470k - 19.0.0-26-g0482646f 26bb7d89db2e 222039c21ee0 2023-12-06T15:03:10.603 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi190 smithi190 running (53s) 51s ago 8m 7457k - 19.0.0-26-g0482646f 26bb7d89db2e 8841ae485b70 2023-12-06T15:03:10.603 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (3m) 5s ago 8m 81.8M - 9.4.7 954c08fa6188 5c6a52d58144 2023-12-06T15:03:10.603 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.acqswy smithi152 running (5m) 5s ago 5m 5566M - 17.2.7-113-gece0d607 a5c6421f1c5f ff9375cec192 2023-12-06T15:03:10.603 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.ypivwc smithi152 running (5m) 5s ago 5m 538M - 17.2.7-113-gece0d607 a5c6421f1c5f d809a681491b 2023-12-06T15:03:10.603 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi190.edwtqj smithi190 running (5m) 51s ago 5m 626M - 17.2.7-113-gece0d607 a5c6421f1c5f f3b7ebd93b04 2023-12-06T15:03:10.603 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi190.uucxzu smithi190 running (5m) 51s ago 5m 4860M - 17.2.7-113-gece0d607 a5c6421f1c5f c01be1409c5f 2023-12-06T15:03:10.603 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.meodco smithi152 *:8443,9283,8765 running (2m) 5s ago 10m 508M - 19.0.0-26-g0482646f 26bb7d89db2e 16ed2af8a3d0 2023-12-06T15:03:10.603 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi190.ubusrr smithi190 *:8443,9283,8765 running (2m) 51s ago 8m 447M - 19.0.0-26-g0482646f 26bb7d89db2e cfae14b9324d 2023-12-06T15:03:10.603 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (109s) 5s ago 10m 65.7M 2048M 19.0.0-26-g0482646f 26bb7d89db2e f5163d3b0f5f 2023-12-06T15:03:10.603 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi190 smithi190 running (87s) 51s ago 8m 41.2M 2048M 19.0.0-26-g0482646f 26bb7d89db2e b25040d5fdfe 2023-12-06T15:03:10.603 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 running (3m) 5s ago 9m 18.1M - 1.5.0 0da6a335fe13 81be696b9be8 2023-12-06T15:03:10.603 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi190 smithi190 *:9100 running (2m) 51s ago 8m 18.3M - 1.5.0 0da6a335fe13 2e521e235bf7 2023-12-06T15:03:10.604 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (38s) 5s ago 7m 161M 1568M 19.0.0-26-g0482646f 26bb7d89db2e 05e00966036e 2023-12-06T15:03:10.604 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (8s) 5s ago 7m 14.9M 1568M 19.0.0-26-g0482646f 26bb7d89db2e c0eaab4b2fd0 2023-12-06T15:03:10.604 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (7m) 5s ago 7m 781M 1568M 17.2.7-113-gece0d607 a5c6421f1c5f 80bcc4927bb2 2023-12-06T15:03:10.604 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi190 running (6m) 51s ago 6m 962M 2592M 17.2.7-113-gece0d607 a5c6421f1c5f f0281d01fec4 2023-12-06T15:03:10.604 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi190 running (6m) 51s ago 6m 726M 2592M 17.2.7-113-gece0d607 a5c6421f1c5f a415b29ad9c7 2023-12-06T15:03:10.604 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi190 running (6m) 51s ago 6m 856M 2592M 17.2.7-113-gece0d607 a5c6421f1c5f b0f2767055a5 2023-12-06T15:03:10.604 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi152 smithi152 *:9095 running (2m) 5s ago 8m 48.5M - 2.43.0 a07b618ecd1d 5f7e5860a419 2023-12-06T15:03:10.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.603+0000 7fb8fff3b700 1 -- 172.21.15.152:0/987612816 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fb8e406ce70 msgr2=0x7fb8e406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:10.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.603+0000 7fb8fff3b700 1 --2- 172.21.15.152:0/987612816 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fb8e406ce70 0x7fb8e406f320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb8f400b3b0 tx=0x7fb8f4009e30 comp rx=0 tx=0).stop 2023-12-06T15:03:10.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.603+0000 7fb8fff3b700 1 -- 172.21.15.152:0/987612816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8f80fcd00 msgr2=0x7fb8f810c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:10.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.603+0000 7fb8fff3b700 1 --2- 172.21.15.152:0/987612816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8f80fcd00 0x7fb8f810c9c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec00c830 tx=0x7fb8ec004470 comp rx=0 tx=0).stop 2023-12-06T15:03:10.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.603+0000 7fb8fff3b700 1 -- 172.21.15.152:0/987612816 shutdown_connections 2023-12-06T15:03:10.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.603+0000 7fb8fff3b700 1 --2- 172.21.15.152:0/987612816 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fb8e406ce70 0x7fb8e406f320 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:10.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.603+0000 7fb8fff3b700 1 --2- 172.21.15.152:0/987612816 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8f80fbaf0 0x7fb8f810c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:10.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.603+0000 7fb8fff3b700 1 --2- 172.21.15.152:0/987612816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8f80fcd00 0x7fb8f810c9c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:10.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.603+0000 7fb8fff3b700 1 -- 172.21.15.152:0/987612816 >> 172.21.15.152:0/987612816 conn(0x7fb8f80f7190 msgr2=0x7fb8f80fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:03:10.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.603+0000 7fb8fff3b700 1 -- 172.21.15.152:0/987612816 shutdown_connections 2023-12-06T15:03:10.605 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.603+0000 7fb8fff3b700 1 -- 172.21.15.152:0/987612816 wait complete. 2023-12-06T15:03:10.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:10 smithi152 ceph-mon[192652]: failed to encode map e67 with expected crc 2023-12-06T15:03:10.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:10 smithi152 ceph-mon[192652]: failed to encode map e67 with expected crc 2023-12-06T15:03:10.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:10 smithi152 ceph-mon[192652]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-06T15:03:10.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:10 smithi152 ceph-mon[192652]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2023-12-06T15:03:10.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:10 smithi152 ceph-mon[192652]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-06T15:03:10.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:10 smithi152 ceph-mon[192652]: failed to encode map e68 with expected crc 2023-12-06T15:03:10.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:10 smithi152 ceph-mon[192652]: osd.1 [v2:172.21.15.152:6810/3248615058,v1:172.21.15.152:6811/3248615058] boot 2023-12-06T15:03:10.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:10 smithi152 ceph-mon[192652]: osdmap e68: 6 total, 6 up, 6 in 2023-12-06T15:03:10.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:10 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-06T15:03:10.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.704+0000 7fb188545700 1 -- 172.21.15.152:0/3078468752 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1800fcbf0 msgr2=0x7fb1800fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:10.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.704+0000 7fb188545700 1 --2- 172.21.15.152:0/3078468752 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1800fcbf0 0x7fb1800fd000 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb17c004940 tx=0x7fb17c009e30 comp rx=0 tx=0).stop 2023-12-06T15:03:10.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.704+0000 7fb188545700 1 -- 172.21.15.152:0/3078468752 shutdown_connections 2023-12-06T15:03:10.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.704+0000 7fb188545700 1 --2- 172.21.15.152:0/3078468752 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1800fde00 0x7fb1800fe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:10.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.704+0000 7fb188545700 1 --2- 172.21.15.152:0/3078468752 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1800fcbf0 0x7fb1800fd000 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:10.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.704+0000 7fb188545700 1 -- 172.21.15.152:0/3078468752 >> 172.21.15.152:0/3078468752 conn(0x7fb1800f82d0 msgr2=0x7fb1800fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:03:10.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.704+0000 7fb188545700 1 -- 172.21.15.152:0/3078468752 shutdown_connections 2023-12-06T15:03:10.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.704+0000 7fb188545700 1 -- 172.21.15.152:0/3078468752 wait complete. 2023-12-06T15:03:10.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.705+0000 7fb188545700 1 Processor -- start 2023-12-06T15:03:10.706 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.705+0000 7fb188545700 1 -- start start 2023-12-06T15:03:10.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.705+0000 7fb188545700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1800fcbf0 0x7fb18010d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:10.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.705+0000 7fb188545700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1800fde00 0x7fb18010da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:10.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.705+0000 7fb188545700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18010e010 con 0x7fb1800fde00 2023-12-06T15:03:10.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.705+0000 7fb188545700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18010e8b0 con 0x7fb1800fcbf0 2023-12-06T15:03:10.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.705+0000 7fb185ae0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1800fde00 0x7fb18010da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:10.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.705+0000 7fb185ae0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1800fde00 0x7fb18010da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56980/0 (socket says 172.21.15.152:56980) 2023-12-06T15:03:10.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.705+0000 7fb185ae0700 1 -- 172.21.15.152:0/2389313490 learned_addr learned my addr 172.21.15.152:0/2389313490 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:03:10.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.705+0000 7fb1862e1700 1 --2- 172.21.15.152:0/2389313490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1800fcbf0 0x7fb18010d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:10.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.705+0000 7fb185ae0700 1 -- 172.21.15.152:0/2389313490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1800fcbf0 msgr2=0x7fb18010d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:10.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.705+0000 7fb185ae0700 1 --2- 172.21.15.152:0/2389313490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1800fcbf0 0x7fb18010d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:10.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.705+0000 7fb185ae0700 1 -- 172.21.15.152:0/2389313490 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17c005040 con 0x7fb1800fde00 2023-12-06T15:03:10.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.706+0000 7fb185ae0700 1 --2- 172.21.15.152:0/2389313490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1800fde00 0x7fb18010da10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb17000eb40 tx=0x7fb17000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:03:10.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.706+0000 7fb176ffd700 1 -- 172.21.15.152:0/2389313490 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb170007cc0 con 0x7fb1800fde00 2023-12-06T15:03:10.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.706+0000 7fb176ffd700 1 -- 172.21.15.152:0/2389313490 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb17000f040 con 0x7fb1800fde00 2023-12-06T15:03:10.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.706+0000 7fb176ffd700 1 -- 172.21.15.152:0/2389313490 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb170009570 con 0x7fb1800fde00 2023-12-06T15:03:10.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.706+0000 7fb188545700 1 -- 172.21.15.152:0/2389313490 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb18010eb30 con 0x7fb1800fde00 2023-12-06T15:03:10.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.706+0000 7fb188545700 1 -- 172.21.15.152:0/2389313490 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb18010f070 con 0x7fb1800fde00 2023-12-06T15:03:10.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.707+0000 7fb188545700 1 -- 172.21.15.152:0/2389313490 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb18004bb80 con 0x7fb1800fde00 2023-12-06T15:03:10.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.707+0000 7fb176ffd700 1 -- 172.21.15.152:0/2389313490 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fb1700096d0 con 0x7fb1800fde00 2023-12-06T15:03:10.711 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.707+0000 7fb176ffd700 1 --2- 172.21.15.152:0/2389313490 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fb16c06ce60 0x7fb16c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:10.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.708+0000 7fb1862e1700 1 --2- 172.21.15.152:0/2389313490 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fb16c06ce60 0x7fb16c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:10.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.708+0000 7fb176ffd700 1 -- 172.21.15.152:0/2389313490 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6675+0+0 (secure 0 0 0) 0x7fb17008c000 con 0x7fb1800fde00 2023-12-06T15:03:10.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.708+0000 7fb1862e1700 1 --2- 172.21.15.152:0/2389313490 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fb16c06ce60 0x7fb16c06f310 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb17c013600 tx=0x7fb17c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:03:10.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.712+0000 7fb176ffd700 1 -- 172.21.15.152:0/2389313490 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fb170059990 con 0x7fb1800fde00 2023-12-06T15:03:10.982 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.981+0000 7fb188545700 1 -- 172.21.15.152:0/2389313490 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb180105590 con 0x7fb1800fde00 2023-12-06T15:03:10.982 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.981+0000 7fb176ffd700 1 -- 172.21.15.152:0/2389313490 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+827 (secure 0 0 0) 0x7fb170059520 con 0x7fb1800fde00 2023-12-06T15:03:10.982 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-12-06T15:03:10.983 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": { 2023-12-06T15:03:10.983 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 2 2023-12-06T15:03:10.983 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:03:10.983 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": { 2023-12-06T15:03:10.983 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 2 2023-12-06T15:03:10.983 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:03:10.983 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": { 2023-12-06T15:03:10.983 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 4, 2023-12-06T15:03:10.983 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 2 2023-12-06T15:03:10.983 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:03:10.983 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2023-12-06T15:03:10.983 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 4 2023-12-06T15:03:10.983 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:03:10.983 INFO:teuthology.orchestra.run.smithi152.stdout: "overall": { 2023-12-06T15:03:10.984 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 8, 2023-12-06T15:03:10.984 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 6 2023-12-06T15:03:10.984 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-12-06T15:03:10.984 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-12-06T15:03:10.984 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.983+0000 7fb188545700 1 -- 172.21.15.152:0/2389313490 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fb16c06ce60 msgr2=0x7fb16c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:10.984 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.983+0000 7fb188545700 1 --2- 172.21.15.152:0/2389313490 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fb16c06ce60 0x7fb16c06f310 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb17c013600 tx=0x7fb17c009e30 comp rx=0 tx=0).stop 2023-12-06T15:03:10.985 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.983+0000 7fb188545700 1 -- 172.21.15.152:0/2389313490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1800fde00 msgr2=0x7fb18010da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:10.985 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.983+0000 7fb188545700 1 --2- 172.21.15.152:0/2389313490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1800fde00 0x7fb18010da10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb17000eb40 tx=0x7fb17000b040 comp rx=0 tx=0).stop 2023-12-06T15:03:10.985 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.983+0000 7fb188545700 1 -- 172.21.15.152:0/2389313490 shutdown_connections 2023-12-06T15:03:10.985 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.983+0000 7fb188545700 1 --2- 172.21.15.152:0/2389313490 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fb16c06ce60 0x7fb16c06f310 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:10.985 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.983+0000 7fb188545700 1 --2- 172.21.15.152:0/2389313490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1800fcbf0 0x7fb18010d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:10.985 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.983+0000 7fb188545700 1 --2- 172.21.15.152:0/2389313490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1800fde00 0x7fb18010da10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:10.985 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.983+0000 7fb188545700 1 -- 172.21.15.152:0/2389313490 >> 172.21.15.152:0/2389313490 conn(0x7fb1800f82d0 msgr2=0x7fb180101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:03:10.985 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.983+0000 7fb188545700 1 -- 172.21.15.152:0/2389313490 shutdown_connections 2023-12-06T15:03:10.985 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:10.983+0000 7fb188545700 1 -- 172.21.15.152:0/2389313490 wait complete. 2023-12-06T15:03:11.086 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.084+0000 7f652f8a6700 1 -- 172.21.15.152:0/4283132420 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65280fcd00 msgr2=0x7f65280fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:11.086 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.084+0000 7f652f8a6700 1 --2- 172.21.15.152:0/4283132420 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65280fcd00 0x7f65280fd150 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6518004940 tx=0x7f6518009e30 comp rx=0 tx=0).stop 2023-12-06T15:03:11.086 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.084+0000 7f652f8a6700 1 -- 172.21.15.152:0/4283132420 shutdown_connections 2023-12-06T15:03:11.086 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.084+0000 7f652f8a6700 1 --2- 172.21.15.152:0/4283132420 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65280fcd00 0x7f65280fd150 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:11.086 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.084+0000 7f652f8a6700 1 --2- 172.21.15.152:0/4283132420 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65280fbaf0 0x7f65280fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:11.086 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.084+0000 7f652f8a6700 1 -- 172.21.15.152:0/4283132420 >> 172.21.15.152:0/4283132420 conn(0x7f65280f7190 msgr2=0x7f65280f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:03:11.086 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.084+0000 7f652f8a6700 1 -- 172.21.15.152:0/4283132420 shutdown_connections 2023-12-06T15:03:11.086 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.084+0000 7f652f8a6700 1 -- 172.21.15.152:0/4283132420 wait complete. 2023-12-06T15:03:11.088 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.085+0000 7f652f8a6700 1 Processor -- start 2023-12-06T15:03:11.088 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.085+0000 7f652f8a6700 1 -- start start 2023-12-06T15:03:11.088 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.085+0000 7f652f8a6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65280fbaf0 0x7f6528110290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:11.088 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.085+0000 7f652f8a6700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65280fcd00 0x7f65281127e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:11.088 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.085+0000 7f652f8a6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65280661a0 con 0x7f65280fbaf0 2023-12-06T15:03:11.088 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.085+0000 7f652f8a6700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65280662e0 con 0x7f65280fcd00 2023-12-06T15:03:11.088 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.085+0000 7f652d642700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65280fbaf0 0x7f6528110290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:11.088 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.085+0000 7f652d642700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65280fbaf0 0x7f6528110290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56994/0 (socket says 172.21.15.152:56994) 2023-12-06T15:03:11.088 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.085+0000 7f652d642700 1 -- 172.21.15.152:0/2423236070 learned_addr learned my addr 172.21.15.152:0/2423236070 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:03:11.088 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.085+0000 7f652ce41700 1 --2- 172.21.15.152:0/2423236070 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65280fcd00 0x7f65281127e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:11.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.086+0000 7f652d642700 1 -- 172.21.15.152:0/2423236070 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65280fcd00 msgr2=0x7f65281127e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:11.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.086+0000 7f652d642700 1 --2- 172.21.15.152:0/2423236070 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65280fcd00 0x7f65281127e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:11.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.086+0000 7f652d642700 1 -- 172.21.15.152:0/2423236070 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6518005040 con 0x7f65280fbaf0 2023-12-06T15:03:11.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.086+0000 7f652d642700 1 --2- 172.21.15.152:0/2423236070 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65280fbaf0 0x7f6528110290 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f652400b790 tx=0x7f6524009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:03:11.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.086+0000 7f651dffb700 1 -- 172.21.15.152:0/2423236070 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f652400f6f0 con 0x7f65280fbaf0 2023-12-06T15:03:11.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.086+0000 7f652f8a6700 1 -- 172.21.15.152:0/2423236070 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6528112e70 con 0x7f65280fbaf0 2023-12-06T15:03:11.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.086+0000 7f651dffb700 1 -- 172.21.15.152:0/2423236070 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f652400fd00 con 0x7f65280fbaf0 2023-12-06T15:03:11.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.086+0000 7f651dffb700 1 -- 172.21.15.152:0/2423236070 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65240103a0 con 0x7f65280fbaf0 2023-12-06T15:03:11.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.086+0000 7f652f8a6700 1 -- 172.21.15.152:0/2423236070 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6528113320 con 0x7f65280fbaf0 2023-12-06T15:03:11.089 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.087+0000 7f652f8a6700 1 -- 172.21.15.152:0/2423236070 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f652804bb80 con 0x7f65280fbaf0 2023-12-06T15:03:11.090 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.087+0000 7f651dffb700 1 -- 172.21.15.152:0/2423236070 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f652400f850 con 0x7f65280fbaf0 2023-12-06T15:03:11.090 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.088+0000 7f651dffb700 1 --2- 172.21.15.152:0/2423236070 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f651406ce60 0x7f651406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:11.090 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.088+0000 7f651dffb700 1 -- 172.21.15.152:0/2423236070 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f652408c280 con 0x7f65280fbaf0 2023-12-06T15:03:11.090 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.088+0000 7f652ce41700 1 --2- 172.21.15.152:0/2423236070 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f651406ce60 0x7f651406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:11.090 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.088+0000 7f652ce41700 1 --2- 172.21.15.152:0/2423236070 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f651406ce60 0x7f651406f310 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f651800b3b0 tx=0x7f6518009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:03:11.093 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.092+0000 7f651dffb700 1 -- 172.21.15.152:0/2423236070 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f6524056050 con 0x7f65280fbaf0 2023-12-06T15:03:11.326 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.324+0000 7f652f8a6700 1 -- 172.21.15.152:0/2423236070 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6528104530 con 0x7f65280fbaf0 2023-12-06T15:03:11.326 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.325+0000 7f651dffb700 1 -- 172.21.15.152:0/2423236070 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1907 (secure 0 0 0) 0x7f6524059670 con 0x7f65280fbaf0 2023-12-06T15:03:11.326 INFO:teuthology.orchestra.run.smithi152.stdout:e16 2023-12-06T15:03:11.327 INFO:teuthology.orchestra.run.smithi152.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-06T15:03:11.327 INFO:teuthology.orchestra.run.smithi152.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-06T15:03:11.327 INFO:teuthology.orchestra.run.smithi152.stdout:legacy client fscid: 1 2023-12-06T15:03:11.327 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T15:03:11.327 INFO:teuthology.orchestra.run.smithi152.stdout:Filesystem 'cephfs' (1) 2023-12-06T15:03:11.327 INFO:teuthology.orchestra.run.smithi152.stdout:fs_name cephfs 2023-12-06T15:03:11.327 INFO:teuthology.orchestra.run.smithi152.stdout:epoch 16 2023-12-06T15:03:11.327 INFO:teuthology.orchestra.run.smithi152.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-06T15:03:11.327 INFO:teuthology.orchestra.run.smithi152.stdout:created 2023-12-06T14:57:59.352201+0000 2023-12-06T15:03:11.327 INFO:teuthology.orchestra.run.smithi152.stdout:modified 2023-12-06T15:01:48.235717+0000 2023-12-06T15:03:11.327 INFO:teuthology.orchestra.run.smithi152.stdout:tableserver 0 2023-12-06T15:03:11.327 INFO:teuthology.orchestra.run.smithi152.stdout:root 0 2023-12-06T15:03:11.327 INFO:teuthology.orchestra.run.smithi152.stdout:session_timeout 60 2023-12-06T15:03:11.327 INFO:teuthology.orchestra.run.smithi152.stdout:session_autoclose 300 2023-12-06T15:03:11.328 INFO:teuthology.orchestra.run.smithi152.stdout:max_file_size 1099511627776 2023-12-06T15:03:11.328 INFO:teuthology.orchestra.run.smithi152.stdout:max_xattr_size 65536 2023-12-06T15:03:11.328 INFO:teuthology.orchestra.run.smithi152.stdout:required_client_features {} 2023-12-06T15:03:11.328 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure 0 2023-12-06T15:03:11.328 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure_osd_epoch 0 2023-12-06T15:03:11.328 INFO:teuthology.orchestra.run.smithi152.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-06T15:03:11.328 INFO:teuthology.orchestra.run.smithi152.stdout:max_mds 2 2023-12-06T15:03:11.328 INFO:teuthology.orchestra.run.smithi152.stdout:in 0,1 2023-12-06T15:03:11.328 INFO:teuthology.orchestra.run.smithi152.stdout:up {0=14464,1=24255} 2023-12-06T15:03:11.328 INFO:teuthology.orchestra.run.smithi152.stdout:failed 2023-12-06T15:03:11.328 INFO:teuthology.orchestra.run.smithi152.stdout:damaged 2023-12-06T15:03:11.328 INFO:teuthology.orchestra.run.smithi152.stdout:stopped 2023-12-06T15:03:11.328 INFO:teuthology.orchestra.run.smithi152.stdout:data_pools [3] 2023-12-06T15:03:11.328 INFO:teuthology.orchestra.run.smithi152.stdout:metadata_pool 2 2023-12-06T15:03:11.328 INFO:teuthology.orchestra.run.smithi152.stdout:inline_data disabled 2023-12-06T15:03:11.329 INFO:teuthology.orchestra.run.smithi152.stdout:balancer 2023-12-06T15:03:11.329 INFO:teuthology.orchestra.run.smithi152.stdout:bal_rank_mask -1 2023-12-06T15:03:11.329 INFO:teuthology.orchestra.run.smithi152.stdout:standby_count_wanted 1 2023-12-06T15:03:11.329 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.acqswy{0:14464} state up:active seq 4 export targets 1 join_fscid=1 addr [v2:172.21.15.152:6826/2467413186,v1:172.21.15.152:6827/2467413186] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:03:11.329 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi190.edwtqj{0:24271} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.190:6826/2256465065,v1:172.21.15.190:6827/2256465065] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:03:11.329 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi190.uucxzu{1:24255} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.190:6824/3250692478,v1:172.21.15.190:6825/3250692478] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:03:11.329 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.ypivwc{1:14480} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.152:6828/697313573,v1:172.21.15.152:6829/697313573] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:03:11.329 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T15:03:11.329 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T15:03:11.330 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.327+0000 7f652f8a6700 1 -- 172.21.15.152:0/2423236070 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f651406ce60 msgr2=0x7f651406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:11.330 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.327+0000 7f652f8a6700 1 --2- 172.21.15.152:0/2423236070 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f651406ce60 0x7f651406f310 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f651800b3b0 tx=0x7f6518009e30 comp rx=0 tx=0).stop 2023-12-06T15:03:11.330 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.327+0000 7f652f8a6700 1 -- 172.21.15.152:0/2423236070 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65280fbaf0 msgr2=0x7f6528110290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:11.330 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.327+0000 7f652f8a6700 1 --2- 172.21.15.152:0/2423236070 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65280fbaf0 0x7f6528110290 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f652400b790 tx=0x7f6524009220 comp rx=0 tx=0).stop 2023-12-06T15:03:11.330 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.327+0000 7f652f8a6700 1 -- 172.21.15.152:0/2423236070 shutdown_connections 2023-12-06T15:03:11.330 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.327+0000 7f652f8a6700 1 --2- 172.21.15.152:0/2423236070 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f651406ce60 0x7f651406f310 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:11.330 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.327+0000 7f652f8a6700 1 --2- 172.21.15.152:0/2423236070 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65280fbaf0 0x7f6528110290 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:11.331 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.327+0000 7f652f8a6700 1 --2- 172.21.15.152:0/2423236070 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65280fcd00 0x7f65281127e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:11.331 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.327+0000 7f652f8a6700 1 -- 172.21.15.152:0/2423236070 >> 172.21.15.152:0/2423236070 conn(0x7f65280f7190 msgr2=0x7f65280fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:03:11.331 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.327+0000 7f652f8a6700 1 -- 172.21.15.152:0/2423236070 shutdown_connections 2023-12-06T15:03:11.331 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.327+0000 7f652f8a6700 1 -- 172.21.15.152:0/2423236070 wait complete. 2023-12-06T15:03:11.331 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 16 2023-12-06T15:03:11.432 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.429+0000 7f21575bb700 1 -- 172.21.15.152:0/17056703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21500ffd70 msgr2=0x7f21501021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:11.432 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.429+0000 7f21575bb700 1 --2- 172.21.15.152:0/17056703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21500ffd70 0x7f21501021d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2144004940 tx=0x7f2144009e30 comp rx=0 tx=0).stop 2023-12-06T15:03:11.432 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.429+0000 7f21575bb700 1 -- 172.21.15.152:0/17056703 shutdown_connections 2023-12-06T15:03:11.432 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.429+0000 7f21575bb700 1 --2- 172.21.15.152:0/17056703 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21500ffd70 0x7f21501021d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:11.432 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.429+0000 7f21575bb700 1 --2- 172.21.15.152:0/17056703 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2150066920 0x7f21500ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:11.432 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.429+0000 7f21575bb700 1 -- 172.21.15.152:0/17056703 >> 172.21.15.152:0/17056703 conn(0x7f21500f71b0 msgr2=0x7f21500f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:03:11.433 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.429+0000 7f21575bb700 1 -- 172.21.15.152:0/17056703 shutdown_connections 2023-12-06T15:03:11.433 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.429+0000 7f21575bb700 1 -- 172.21.15.152:0/17056703 wait complete. 2023-12-06T15:03:11.433 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.429+0000 7f21575bb700 1 Processor -- start 2023-12-06T15:03:11.433 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.430+0000 7f21575bb700 1 -- start start 2023-12-06T15:03:11.433 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.430+0000 7f21575bb700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2150066920 0x7f215010d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:11.433 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.430+0000 7f21575bb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21500ffd70 0x7f215010da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:11.433 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.430+0000 7f21575bb700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215010e050 con 0x7f21500ffd70 2023-12-06T15:03:11.433 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.430+0000 7f21575bb700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215010e8f0 con 0x7f2150066920 2023-12-06T15:03:11.433 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.430+0000 7f2154b56700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21500ffd70 0x7f215010da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:11.433 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.430+0000 7f2154b56700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21500ffd70 0x7f215010da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57004/0 (socket says 172.21.15.152:57004) 2023-12-06T15:03:11.433 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.430+0000 7f2154b56700 1 -- 172.21.15.152:0/2216778778 learned_addr learned my addr 172.21.15.152:0/2216778778 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:03:11.434 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.430+0000 7f2155357700 1 --2- 172.21.15.152:0/2216778778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2150066920 0x7f215010d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:11.434 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.430+0000 7f2154b56700 1 -- 172.21.15.152:0/2216778778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2150066920 msgr2=0x7f215010d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:11.434 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.430+0000 7f2154b56700 1 --2- 172.21.15.152:0/2216778778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2150066920 0x7f215010d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:11.434 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.430+0000 7f2154b56700 1 -- 172.21.15.152:0/2216778778 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2144005040 con 0x7f21500ffd70 2023-12-06T15:03:11.434 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.430+0000 7f2154b56700 1 --2- 172.21.15.152:0/2216778778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21500ffd70 0x7f215010da50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2144009380 tx=0x7f2144009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:03:11.434 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.430+0000 7f2141ffb700 1 -- 172.21.15.152:0/2216778778 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f214400e040 con 0x7f21500ffd70 2023-12-06T15:03:11.434 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.430+0000 7f2141ffb700 1 -- 172.21.15.152:0/2216778778 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f214400bcd0 con 0x7f21500ffd70 2023-12-06T15:03:11.434 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.430+0000 7f21575bb700 1 -- 172.21.15.152:0/2216778778 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f215010eb70 con 0x7f21500ffd70 2023-12-06T15:03:11.434 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.430+0000 7f2141ffb700 1 -- 172.21.15.152:0/2216778778 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f214401c630 con 0x7f21500ffd70 2023-12-06T15:03:11.435 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.431+0000 7f21575bb700 1 -- 172.21.15.152:0/2216778778 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f215010f0b0 con 0x7f21500ffd70 2023-12-06T15:03:11.435 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.432+0000 7f21575bb700 1 -- 172.21.15.152:0/2216778778 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21501075c0 con 0x7f21500ffd70 2023-12-06T15:03:11.436 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.432+0000 7f2141ffb700 1 -- 172.21.15.152:0/2216778778 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f2144013420 con 0x7f21500ffd70 2023-12-06T15:03:11.436 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.432+0000 7f2141ffb700 1 --2- 172.21.15.152:0/2216778778 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f213c06ce60 0x7f213c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:11.436 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.432+0000 7f2141ffb700 1 -- 172.21.15.152:0/2216778778 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f214408d840 con 0x7f21500ffd70 2023-12-06T15:03:11.436 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.432+0000 7f2155357700 1 --2- 172.21.15.152:0/2216778778 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f213c06ce60 0x7f213c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:11.436 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.433+0000 7f2155357700 1 --2- 172.21.15.152:0/2216778778 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f213c06ce60 0x7f213c06f310 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f214c0041d0 tx=0x7f214c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:03:11.438 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.437+0000 7f2141ffb700 1 -- 172.21.15.152:0/2216778778 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f214405b120 con 0x7f21500ffd70 2023-12-06T15:03:11.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:11 smithi190 ceph-mon[178398]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:03:11.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:11 smithi190 ceph-mon[178398]: failed to encode map e69 with expected crc 2023-12-06T15:03:11.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:11 smithi190 ceph-mon[178398]: osdmap e69: 6 total, 6 up, 6 in 2023-12-06T15:03:11.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:11 smithi190 ceph-mon[178398]: failed to encode map e69 with expected crc 2023-12-06T15:03:11.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:11 smithi190 ceph-mon[178398]: failed to encode map e69 with expected crc 2023-12-06T15:03:11.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:11 smithi190 ceph-mon[178398]: failed to encode map e69 with expected crc 2023-12-06T15:03:11.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:11 smithi190 ceph-mon[178398]: failed to encode map e69 with expected crc 2023-12-06T15:03:11.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:11 smithi190 ceph-mon[178398]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:03:11.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:11 smithi190 ceph-mon[178398]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:03:11.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:11 smithi190 ceph-mon[178398]: pgmap v74: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 290 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 55/348 objects degraded (15.805%) 2023-12-06T15:03:11.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:11 smithi190 ceph-mon[178398]: from='client.? 172.21.15.152:0/2389313490' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:03:11.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:11 smithi152 ceph-mon[192652]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:03:11.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:11 smithi152 ceph-mon[192652]: failed to encode map e69 with expected crc 2023-12-06T15:03:11.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:11 smithi152 ceph-mon[192652]: osdmap e69: 6 total, 6 up, 6 in 2023-12-06T15:03:11.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:11 smithi152 ceph-mon[192652]: failed to encode map e69 with expected crc 2023-12-06T15:03:11.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:11 smithi152 ceph-mon[192652]: failed to encode map e69 with expected crc 2023-12-06T15:03:11.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:11 smithi152 ceph-mon[192652]: failed to encode map e69 with expected crc 2023-12-06T15:03:11.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:11 smithi152 ceph-mon[192652]: failed to encode map e69 with expected crc 2023-12-06T15:03:11.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:11 smithi152 ceph-mon[192652]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:03:11.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:11 smithi152 ceph-mon[192652]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:03:11.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:11 smithi152 ceph-mon[192652]: pgmap v74: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 290 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 55/348 objects degraded (15.805%) 2023-12-06T15:03:11.629 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:11 smithi152 ceph-mon[192652]: from='client.? 172.21.15.152:0/2389313490' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:03:11.647 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.646+0000 7f21575bb700 1 -- 172.21.15.152:0/2216778778 --> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f215002b150 con 0x7f213c06ce60 2023-12-06T15:03:11.648 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.647+0000 7f2141ffb700 1 -- 172.21.15.152:0/2216778778 <== mgr.34104 v2:172.21.15.152:6800/2427836422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f215002b150 con 0x7f213c06ce60 2023-12-06T15:03:11.648 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-12-06T15:03:11.649 INFO:teuthology.orchestra.run.smithi152.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e331a81036b9c4be9167bdaf54e458c7294ca3446212b9c6126786d23318b1cf", 2023-12-06T15:03:11.649 INFO:teuthology.orchestra.run.smithi152.stdout: "in_progress": true, 2023-12-06T15:03:11.649 INFO:teuthology.orchestra.run.smithi152.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-06T15:03:11.649 INFO:teuthology.orchestra.run.smithi152.stdout: "services_complete": [ 2023-12-06T15:03:11.649 INFO:teuthology.orchestra.run.smithi152.stdout: "crash", 2023-12-06T15:03:11.649 INFO:teuthology.orchestra.run.smithi152.stdout: "mon", 2023-12-06T15:03:11.649 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr" 2023-12-06T15:03:11.649 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2023-12-06T15:03:11.649 INFO:teuthology.orchestra.run.smithi152.stdout: "progress": "8/21 daemons upgraded", 2023-12-06T15:03:11.649 INFO:teuthology.orchestra.run.smithi152.stdout: "message": "Currently upgrading osd daemons", 2023-12-06T15:03:11.649 INFO:teuthology.orchestra.run.smithi152.stdout: "is_paused": false 2023-12-06T15:03:11.649 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-12-06T15:03:11.650 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.649+0000 7f21575bb700 1 -- 172.21.15.152:0/2216778778 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f213c06ce60 msgr2=0x7f213c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:11.651 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.649+0000 7f21575bb700 1 --2- 172.21.15.152:0/2216778778 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f213c06ce60 0x7f213c06f310 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f214c0041d0 tx=0x7f214c009040 comp rx=0 tx=0).stop 2023-12-06T15:03:11.651 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.649+0000 7f21575bb700 1 -- 172.21.15.152:0/2216778778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21500ffd70 msgr2=0x7f215010da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:11.651 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.649+0000 7f21575bb700 1 --2- 172.21.15.152:0/2216778778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21500ffd70 0x7f215010da50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2144009380 tx=0x7f2144009e30 comp rx=0 tx=0).stop 2023-12-06T15:03:11.651 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.649+0000 7f21575bb700 1 -- 172.21.15.152:0/2216778778 shutdown_connections 2023-12-06T15:03:11.651 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.649+0000 7f21575bb700 1 --2- 172.21.15.152:0/2216778778 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f213c06ce60 0x7f213c06f310 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:11.651 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.649+0000 7f21575bb700 1 --2- 172.21.15.152:0/2216778778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2150066920 0x7f215010d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:11.651 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.649+0000 7f21575bb700 1 --2- 172.21.15.152:0/2216778778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21500ffd70 0x7f215010da50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:11.651 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.649+0000 7f21575bb700 1 -- 172.21.15.152:0/2216778778 >> 172.21.15.152:0/2216778778 conn(0x7f21500f71b0 msgr2=0x7f21500f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:03:11.651 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.650+0000 7f21575bb700 1 -- 172.21.15.152:0/2216778778 shutdown_connections 2023-12-06T15:03:11.651 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.650+0000 7f21575bb700 1 -- 172.21.15.152:0/2216778778 wait complete. 2023-12-06T15:03:11.751 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.750+0000 7f249d22d700 1 -- 172.21.15.152:0/1464587332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24980fcd00 msgr2=0x7f24980fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:11.751 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.750+0000 7f249d22d700 1 --2- 172.21.15.152:0/1464587332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24980fcd00 0x7f24980fd150 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2480004940 tx=0x7f2480009e30 comp rx=0 tx=0).stop 2023-12-06T15:03:11.752 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.750+0000 7f249d22d700 1 -- 172.21.15.152:0/1464587332 shutdown_connections 2023-12-06T15:03:11.752 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.750+0000 7f249d22d700 1 --2- 172.21.15.152:0/1464587332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24980fcd00 0x7f24980fd150 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:11.752 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.750+0000 7f249d22d700 1 --2- 172.21.15.152:0/1464587332 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24980fbaf0 0x7f24980fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:11.752 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.750+0000 7f249d22d700 1 -- 172.21.15.152:0/1464587332 >> 172.21.15.152:0/1464587332 conn(0x7f24980f71b0 msgr2=0x7f24980f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:03:11.752 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.750+0000 7f249d22d700 1 -- 172.21.15.152:0/1464587332 shutdown_connections 2023-12-06T15:03:11.752 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.750+0000 7f249d22d700 1 -- 172.21.15.152:0/1464587332 wait complete. 2023-12-06T15:03:11.754 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.751+0000 7f249d22d700 1 Processor -- start 2023-12-06T15:03:11.754 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.751+0000 7f249d22d700 1 -- start start 2023-12-06T15:03:11.754 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.751+0000 7f249d22d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24980fbaf0 0x7f2498112540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:11.754 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.751+0000 7f249d22d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24980fcd00 0x7f2498114a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:11.754 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.751+0000 7f249d22d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24980668f0 con 0x7f24980fbaf0 2023-12-06T15:03:11.754 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.751+0000 7f249d22d700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2498066a30 con 0x7f24980fcd00 2023-12-06T15:03:11.754 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.751+0000 7f2496d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24980fbaf0 0x7f2498112540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:11.754 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.751+0000 7f2496d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24980fbaf0 0x7f2498112540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57014/0 (socket says 172.21.15.152:57014) 2023-12-06T15:03:11.754 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.751+0000 7f2496d9d700 1 -- 172.21.15.152:0/772574812 learned_addr learned my addr 172.21.15.152:0/772574812 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:03:11.754 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.751+0000 7f249659c700 1 --2- 172.21.15.152:0/772574812 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24980fcd00 0x7f2498114a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:11.754 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.751+0000 7f2496d9d700 1 -- 172.21.15.152:0/772574812 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24980fcd00 msgr2=0x7f2498114a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:11.754 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.751+0000 7f2496d9d700 1 --2- 172.21.15.152:0/772574812 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24980fcd00 0x7f2498114a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:11.755 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.751+0000 7f2496d9d700 1 -- 172.21.15.152:0/772574812 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2480005040 con 0x7f24980fbaf0 2023-12-06T15:03:11.755 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.751+0000 7f249659c700 1 --2- 172.21.15.152:0/772574812 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24980fcd00 0x7f2498114a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-06T15:03:11.755 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.751+0000 7f2496d9d700 1 --2- 172.21.15.152:0/772574812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24980fbaf0 0x7f2498112540 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f248800eb70 tx=0x7f248800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:03:11.755 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.752+0000 7f248f7fe700 1 -- 172.21.15.152:0/772574812 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2488007cc0 con 0x7f24980fbaf0 2023-12-06T15:03:11.755 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.752+0000 7f248f7fe700 1 -- 172.21.15.152:0/772574812 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f248800f040 con 0x7f24980fbaf0 2023-12-06T15:03:11.755 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.752+0000 7f249d22d700 1 -- 172.21.15.152:0/772574812 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2498114fd0 con 0x7f24980fbaf0 2023-12-06T15:03:11.755 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.752+0000 7f248f7fe700 1 -- 172.21.15.152:0/772574812 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f248800cad0 con 0x7f24980fbaf0 2023-12-06T15:03:11.755 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.752+0000 7f249d22d700 1 -- 172.21.15.152:0/772574812 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2498115370 con 0x7f24980fbaf0 2023-12-06T15:03:11.755 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.752+0000 7f249d22d700 1 -- 172.21.15.152:0/772574812 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249804bb80 con 0x7f24980fbaf0 2023-12-06T15:03:11.756 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.753+0000 7f248f7fe700 1 -- 172.21.15.152:0/772574812 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f248800cc30 con 0x7f24980fbaf0 2023-12-06T15:03:11.756 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.753+0000 7f248f7fe700 1 --2- 172.21.15.152:0/772574812 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f248406ce60 0x7f248406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:11.756 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.753+0000 7f248f7fe700 1 -- 172.21.15.152:0/772574812 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f248808bef0 con 0x7f24980fbaf0 2023-12-06T15:03:11.756 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.753+0000 7f249659c700 1 --2- 172.21.15.152:0/772574812 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f248406ce60 0x7f248406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:11.756 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.754+0000 7f249659c700 1 --2- 172.21.15.152:0/772574812 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f248406ce60 0x7f248406f310 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f248000b0d0 tx=0x7f2480009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:03:11.759 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:11.758+0000 7f248f7fe700 1 -- 172.21.15.152:0/772574812 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f2488055d70 con 0x7f24980fbaf0 2023-12-06T15:03:12.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:12.021+0000 7f249d22d700 1 -- 172.21.15.152:0/772574812 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f2498104490 con 0x7f24980fbaf0 2023-12-06T15:03:12.023 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:12.022+0000 7f248f7fe700 1 -- 172.21.15.152:0/772574812 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1071 (secure 0 0 0) 0x7f2488059390 con 0x7f24980fbaf0 2023-12-06T15:03:12.023 INFO:teuthology.orchestra.run.smithi152.stdout:HEALTH_WARN Degraded data redundancy: 55/348 objects degraded (15.805%), 16 pgs degraded 2023-12-06T15:03:12.023 INFO:teuthology.orchestra.run.smithi152.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 55/348 objects degraded (15.805%), 16 pgs degraded 2023-12-06T15:03:12.023 INFO:teuthology.orchestra.run.smithi152.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2023-12-06T15:03:12.023 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2023-12-06T15:03:12.023 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2023-12-06T15:03:12.023 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2023-12-06T15:03:12.023 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2023-12-06T15:03:12.024 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2023-12-06T15:03:12.024 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2023-12-06T15:03:12.024 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2023-12-06T15:03:12.024 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2023-12-06T15:03:12.024 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2023-12-06T15:03:12.024 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2023-12-06T15:03:12.024 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.11 is active+undersized+degraded, acting [4,3] 2023-12-06T15:03:12.024 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.12 is active+undersized+degraded, acting [3,0] 2023-12-06T15:03:12.024 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2023-12-06T15:03:12.024 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.17 is active+undersized+degraded, acting [5,2] 2023-12-06T15:03:12.024 INFO:teuthology.orchestra.run.smithi152.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2023-12-06T15:03:12.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:12.024+0000 7f249d22d700 1 -- 172.21.15.152:0/772574812 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f248406ce60 msgr2=0x7f248406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:12.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:12.024+0000 7f249d22d700 1 --2- 172.21.15.152:0/772574812 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f248406ce60 0x7f248406f310 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f248000b0d0 tx=0x7f2480009e30 comp rx=0 tx=0).stop 2023-12-06T15:03:12.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:12.024+0000 7f249d22d700 1 -- 172.21.15.152:0/772574812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24980fbaf0 msgr2=0x7f2498112540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:12.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:12.024+0000 7f249d22d700 1 --2- 172.21.15.152:0/772574812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24980fbaf0 0x7f2498112540 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f248800eb70 tx=0x7f248800b040 comp rx=0 tx=0).stop 2023-12-06T15:03:12.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:12.024+0000 7f249d22d700 1 -- 172.21.15.152:0/772574812 shutdown_connections 2023-12-06T15:03:12.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:12.024+0000 7f249d22d700 1 --2- 172.21.15.152:0/772574812 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f248406ce60 0x7f248406f310 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:12.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:12.024+0000 7f249d22d700 1 --2- 172.21.15.152:0/772574812 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24980fbaf0 0x7f2498112540 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:12.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:12.024+0000 7f249d22d700 1 --2- 172.21.15.152:0/772574812 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24980fcd00 0x7f2498114a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:12.025 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:12.024+0000 7f249d22d700 1 -- 172.21.15.152:0/772574812 >> 172.21.15.152:0/772574812 conn(0x7f24980f71b0 msgr2=0x7f24980fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:03:12.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:12.024+0000 7f249d22d700 1 -- 172.21.15.152:0/772574812 shutdown_connections 2023-12-06T15:03:12.026 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:12.024+0000 7f249d22d700 1 -- 172.21.15.152:0/772574812 wait complete. 2023-12-06T15:03:12.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:12 smithi190 ceph-mon[178398]: from='client.? 172.21.15.152:0/2423236070' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-06T15:03:12.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:12 smithi190 ceph-mon[178398]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:03:12.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:12 smithi190 ceph-mon[178398]: from='client.? 172.21.15.152:0/772574812' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-06T15:03:12.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:12 smithi152 ceph-mon[192652]: from='client.? 172.21.15.152:0/2423236070' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-06T15:03:12.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:12 smithi152 ceph-mon[192652]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:03:12.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:12 smithi152 ceph-mon[192652]: from='client.? 172.21.15.152:0/772574812' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-06T15:03:13.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:13 smithi190 ceph-mon[178398]: pgmap v75: 65 pgs: 4 active+undersized, 7 active+undersized+degraded, 54 active+clean; 290 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.3 KiB/s rd, 3 op/s; 22/348 objects degraded (6.322%); 108 B/s, 0 objects/s recovering 2023-12-06T15:03:13.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:13 smithi152 ceph-mon[192652]: pgmap v75: 65 pgs: 4 active+undersized, 7 active+undersized+degraded, 54 active+clean; 290 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.3 KiB/s rd, 3 op/s; 22/348 objects degraded (6.322%); 108 B/s, 0 objects/s recovering 2023-12-06T15:03:14.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:14 smithi190 ceph-mon[178398]: Health check update: Degraded data redundancy: 22/348 objects degraded (6.322%), 7 pgs degraded (PG_DEGRADED) 2023-12-06T15:03:14.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:14 smithi152 ceph-mon[192652]: Health check update: Degraded data redundancy: 22/348 objects degraded (6.322%), 7 pgs degraded (PG_DEGRADED) 2023-12-06T15:03:15.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:15 smithi190 ceph-mon[178398]: pgmap v76: 65 pgs: 65 active+clean; 290 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s; 100 B/s, 0 objects/s recovering 2023-12-06T15:03:15.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:15 smithi152 ceph-mon[192652]: pgmap v76: 65 pgs: 65 active+clean; 290 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s; 100 B/s, 0 objects/s recovering 2023-12-06T15:03:16.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:16 smithi190 ceph-mon[178398]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/348 objects degraded (6.322%), 7 pgs degraded) 2023-12-06T15:03:16.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:16 smithi190 ceph-mon[178398]: Cluster is now healthy 2023-12-06T15:03:16.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:16 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:16.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:16 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:03:16.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:16 smithi152 ceph-mon[192652]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/348 objects degraded (6.322%), 7 pgs degraded) 2023-12-06T15:03:16.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:16 smithi152 ceph-mon[192652]: Cluster is now healthy 2023-12-06T15:03:16.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:16 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:16.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:16 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:03:17.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:17 smithi190 ceph-mon[178398]: pgmap v77: 65 pgs: 65 active+clean; 290 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s; 81 B/s, 0 objects/s recovering 2023-12-06T15:03:17.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:17 smithi152 ceph-mon[192652]: pgmap v77: 65 pgs: 65 active+clean; 290 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s; 81 B/s, 0 objects/s recovering 2023-12-06T15:03:20.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:19 smithi190 ceph-mon[178398]: pgmap v78: 65 pgs: 65 active+clean; 290 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 69 B/s, 0 objects/s recovering 2023-12-06T15:03:20.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:19 smithi152 ceph-mon[192652]: pgmap v78: 65 pgs: 65 active+clean; 290 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 69 B/s, 0 objects/s recovering 2023-12-06T15:03:22.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:21 smithi190 ceph-mon[178398]: pgmap v79: 65 pgs: 65 active+clean; 290 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s; 62 B/s, 0 objects/s recovering 2023-12-06T15:03:22.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:21 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:22.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:21 smithi152 ceph-mon[192652]: pgmap v79: 65 pgs: 65 active+clean; 290 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s; 62 B/s, 0 objects/s recovering 2023-12-06T15:03:22.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:21 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:23.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:23 smithi190 ceph-mon[178398]: fsmap cephfs:2 {0=cephfs.smithi152.acqswy=up:active,1=cephfs.smithi190.uucxzu=up:active} 2 up:standby-replay 2023-12-06T15:03:23.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:23 smithi190 ceph-mon[178398]: pgmap v80: 65 pgs: 65 active+clean; 290 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s; 54 B/s, 0 objects/s recovering 2023-12-06T15:03:23.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:23 smithi152 ceph-mon[192652]: fsmap cephfs:2 {0=cephfs.smithi152.acqswy=up:active,1=cephfs.smithi190.uucxzu=up:active} 2 up:standby-replay 2023-12-06T15:03:23.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:23 smithi152 ceph-mon[192652]: pgmap v80: 65 pgs: 65 active+clean; 290 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s; 54 B/s, 0 objects/s recovering 2023-12-06T15:03:24.304 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:24 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-06T15:03:24.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:24 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-06T15:03:25.307 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:25 smithi152 ceph-mon[192652]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-06T15:03:25.307 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:25 smithi152 ceph-mon[192652]: Upgrade: osd.2 is safe to restart 2023-12-06T15:03:25.308 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:25 smithi152 ceph-mon[192652]: pgmap v81: 65 pgs: 65 active+clean; 290 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:03:25.308 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:25 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:25.308 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:25 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-06T15:03:25.308 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:25 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:03:25.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:25 smithi190 ceph-mon[178398]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2023-12-06T15:03:25.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:25 smithi190 ceph-mon[178398]: Upgrade: osd.2 is safe to restart 2023-12-06T15:03:25.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:25 smithi190 ceph-mon[178398]: pgmap v81: 65 pgs: 65 active+clean; 290 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:03:25.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:25 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:25.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:25 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-06T15:03:25.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:25 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:03:26.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:26 smithi190 ceph-mon[178398]: Upgrade: Updating osd.2 2023-12-06T15:03:26.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:26 smithi190 ceph-mon[178398]: Deploying daemon osd.2 on smithi152 2023-12-06T15:03:26.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:26 smithi152 ceph-mon[192652]: Upgrade: Updating osd.2 2023-12-06T15:03:26.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:26 smithi152 ceph-mon[192652]: Deploying daemon osd.2 on smithi152 2023-12-06T15:03:27.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:27 smithi190 ceph-mon[178398]: pgmap v82: 65 pgs: 65 active+clean; 290 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:03:27.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:27 smithi152 ceph-mon[192652]: pgmap v82: 65 pgs: 65 active+clean; 290 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:03:27.379 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 15:03:27 smithi152 systemd[1]: Stopping Ceph osd.2 for 062f0e3c-9447-11ee-95a2-87774f69a715... 2023-12-06T15:03:27.379 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 15:03:27 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-2[154671]: 2023-12-06T15:03:27.233+0000 7f4d4921a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-06T15:03:27.379 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 15:03:27 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-2[154671]: 2023-12-06T15:03:27.233+0000 7f4d4921a700 -1 osd.2 69 *** Got signal Terminated *** 2023-12-06T15:03:27.379 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 15:03:27 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-2[154671]: 2023-12-06T15:03:27.233+0000 7f4d4921a700 -1 osd.2 69 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-06T15:03:28.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:28 smithi190 ceph-mon[178398]: osd.2 marked itself down and dead 2023-12-06T15:03:28.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:28 smithi152 ceph-mon[192652]: osd.2 marked itself down and dead 2023-12-06T15:03:29.058 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 15:03:28 smithi152 bash[216331]: ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-2 2023-12-06T15:03:29.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:29 smithi190 ceph-mon[178398]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-06T15:03:29.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:29 smithi190 ceph-mon[178398]: osdmap e70: 6 total, 5 up, 6 in 2023-12-06T15:03:29.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:29 smithi190 ceph-mon[178398]: failed to encode map e70 with expected crc 2023-12-06T15:03:29.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:29 smithi190 ceph-mon[178398]: failed to encode map e70 with expected crc 2023-12-06T15:03:29.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:29 smithi190 ceph-mon[178398]: failed to encode map e70 with expected crc 2023-12-06T15:03:29.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:29 smithi190 ceph-mon[178398]: failed to encode map e70 with expected crc 2023-12-06T15:03:29.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:29 smithi190 ceph-mon[178398]: pgmap v84: 65 pgs: 6 peering, 7 stale+active+clean, 52 active+clean; 290 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 3 op/s 2023-12-06T15:03:29.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:29 smithi152 ceph-mon[192652]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-06T15:03:29.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:29 smithi152 ceph-mon[192652]: osdmap e70: 6 total, 5 up, 6 in 2023-12-06T15:03:29.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:29 smithi152 ceph-mon[192652]: failed to encode map e70 with expected crc 2023-12-06T15:03:29.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:29 smithi152 ceph-mon[192652]: failed to encode map e70 with expected crc 2023-12-06T15:03:29.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:29 smithi152 ceph-mon[192652]: failed to encode map e70 with expected crc 2023-12-06T15:03:29.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:29 smithi152 ceph-mon[192652]: failed to encode map e70 with expected crc 2023-12-06T15:03:29.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:29 smithi152 ceph-mon[192652]: pgmap v84: 65 pgs: 6 peering, 7 stale+active+clean, 52 active+clean; 290 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 3 op/s 2023-12-06T15:03:30.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:30 smithi190 ceph-mon[178398]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2023-12-06T15:03:30.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:30 smithi190 ceph-mon[178398]: failed to encode map e71 with expected crc 2023-12-06T15:03:30.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:30 smithi190 ceph-mon[178398]: osdmap e71: 6 total, 5 up, 6 in 2023-12-06T15:03:30.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:30 smithi190 ceph-mon[178398]: failed to encode map e71 with expected crc 2023-12-06T15:03:30.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:30 smithi190 ceph-mon[178398]: failed to encode map e71 with expected crc 2023-12-06T15:03:30.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:30 smithi190 ceph-mon[178398]: failed to encode map e71 with expected crc 2023-12-06T15:03:30.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:30 smithi190 ceph-mon[178398]: failed to encode map e71 with expected crc 2023-12-06T15:03:30.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:30 smithi190 ceph-mon[178398]: failed to encode map e71 with expected crc 2023-12-06T15:03:30.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:30 smithi190 ceph-mon[178398]: failed to encode map e71 with expected crc 2023-12-06T15:03:30.348 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:30 smithi152 ceph-mon[192652]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2023-12-06T15:03:30.348 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:30 smithi152 ceph-mon[192652]: failed to encode map e71 with expected crc 2023-12-06T15:03:30.349 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:30 smithi152 ceph-mon[192652]: osdmap e71: 6 total, 5 up, 6 in 2023-12-06T15:03:30.349 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:30 smithi152 ceph-mon[192652]: failed to encode map e71 with expected crc 2023-12-06T15:03:30.349 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:30 smithi152 ceph-mon[192652]: failed to encode map e71 with expected crc 2023-12-06T15:03:30.349 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:30 smithi152 ceph-mon[192652]: failed to encode map e71 with expected crc 2023-12-06T15:03:30.349 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:30 smithi152 ceph-mon[192652]: failed to encode map e71 with expected crc 2023-12-06T15:03:30.349 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:30 smithi152 ceph-mon[192652]: failed to encode map e71 with expected crc 2023-12-06T15:03:30.349 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:30 smithi152 ceph-mon[192652]: failed to encode map e71 with expected crc 2023-12-06T15:03:30.349 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 15:03:29 smithi152 systemd[1]: ceph-062f0e3c-9447-11ee-95a2-87774f69a715@osd.2.service: Succeeded. 2023-12-06T15:03:30.349 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 15:03:29 smithi152 systemd[1]: Stopped Ceph osd.2 for 062f0e3c-9447-11ee-95a2-87774f69a715. 2023-12-06T15:03:30.349 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 15:03:30 smithi152 systemd[1]: Starting Ceph osd.2 for 062f0e3c-9447-11ee-95a2-87774f69a715... 2023-12-06T15:03:31.128 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 15:03:30 smithi152 bash[216596]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-06T15:03:31.128 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 15:03:30 smithi152 bash[216596]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2023-12-06T15:03:31.128 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 15:03:30 smithi152 bash[216596]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2023-12-06T15:03:31.128 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 15:03:30 smithi152 bash[216596]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2023-12-06T15:03:31.128 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 15:03:30 smithi152 bash[216596]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2023-12-06T15:03:31.128 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 15:03:30 smithi152 bash[216596]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-06T15:03:31.128 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 15:03:30 smithi152 bash[216596]: --> ceph-volume raw activate successful for osd ID: 2 2023-12-06T15:03:31.878 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 15:03:31 smithi152 ceph-osd[216917]: -- 172.21.15.152:0/734237696 <== mon.0 v2:172.21.15.152:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55dd0db8d1e0 con 0x55dd0db5d000 2023-12-06T15:03:31.878 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 15:03:31 smithi152 bash[216879]: 1440f943b48ef172e21f08dafcc539e00f6b6e524b006615c6d7ef1a6f9b4985 2023-12-06T15:03:31.878 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 15:03:31 smithi152 systemd[1]: Started Ceph osd.2 for 062f0e3c-9447-11ee-95a2-87774f69a715. 2023-12-06T15:03:31.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:31 smithi152 ceph-mon[192652]: pgmap v86: 65 pgs: 6 peering, 7 stale+active+clean, 52 active+clean; 290 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s 2023-12-06T15:03:31.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:31 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:31.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:31 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:03:31.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:31 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:31.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:31 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:31.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:31 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:03:32.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:31 smithi190 ceph-mon[178398]: pgmap v86: 65 pgs: 6 peering, 7 stale+active+clean, 52 active+clean; 290 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s 2023-12-06T15:03:32.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:31 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:32.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:31 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:03:32.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:31 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:32.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:31 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:32.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:31 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:03:32.378 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 15:03:32 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-2[216894]: 2023-12-06T15:03:32.047+0000 7f3505d3d640 -1 Falling back to public interface 2023-12-06T15:03:33.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:32 smithi190 ceph-mon[178398]: Health check failed: Degraded data redundancy: 39/348 objects degraded (11.207%), 11 pgs degraded (PG_DEGRADED) 2023-12-06T15:03:33.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:32 smithi152 ceph-mon[192652]: Health check failed: Degraded data redundancy: 39/348 objects degraded (11.207%), 11 pgs degraded (PG_DEGRADED) 2023-12-06T15:03:34.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:33 smithi190 ceph-mon[178398]: pgmap v87: 65 pgs: 14 active+undersized, 11 active+undersized+degraded, 6 peering, 34 active+clean; 290 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 39/348 objects degraded (11.207%) 2023-12-06T15:03:34.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:33 smithi152 ceph-mon[192652]: pgmap v87: 65 pgs: 14 active+undersized, 11 active+undersized+degraded, 6 peering, 34 active+clean; 290 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 39/348 objects degraded (11.207%) 2023-12-06T15:03:35.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:34 smithi190 ceph-mon[178398]: pgmap v88: 65 pgs: 17 active+undersized, 14 active+undersized+degraded, 34 active+clean; 290 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 52/348 objects degraded (14.943%) 2023-12-06T15:03:35.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:34 smithi152 ceph-mon[192652]: pgmap v88: 65 pgs: 17 active+undersized, 14 active+undersized+degraded, 34 active+clean; 290 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 52/348 objects degraded (14.943%) 2023-12-06T15:03:36.014 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:35 smithi152 ceph-mon[192652]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2023-12-06T15:03:36.014 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:35 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:36.014 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:35 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:36.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:35 smithi190 ceph-mon[178398]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2023-12-06T15:03:36.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:35 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:36.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:35 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:36.292 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 15:03:36 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-2[216894]: 2023-12-06T15:03:36.013+0000 7f3505d3d640 -1 osd.2 0 read_superblock omap replica is missing. 2023-12-06T15:03:36.761 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 15:03:36 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-2[216894]: 2023-12-06T15:03:36.541+0000 7f3505d3d640 -1 osd.2 69 log_to_monitors true 2023-12-06T15:03:37.037 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:36 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:37.038 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:36 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:37.038 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:36 smithi152 ceph-mon[192652]: from='osd.2 [v2:172.21.15.152:6818/1164280420,v1:172.21.15.152:6819/1164280420]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-06T15:03:37.038 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:36 smithi152 ceph-mon[192652]: pgmap v89: 65 pgs: 17 active+undersized, 14 active+undersized+degraded, 34 active+clean; 290 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 52/348 objects degraded (14.943%) 2023-12-06T15:03:37.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:36 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:37.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:36 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:37.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:36 smithi190 ceph-mon[178398]: from='osd.2 [v2:172.21.15.152:6818/1164280420,v1:172.21.15.152:6819/1164280420]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-06T15:03:37.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:36 smithi190 ceph-mon[178398]: pgmap v89: 65 pgs: 17 active+undersized, 14 active+undersized+degraded, 34 active+clean; 290 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 52/348 objects degraded (14.943%) 2023-12-06T15:03:37.378 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 15:03:37 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-2[216894]: 2023-12-06T15:03:37.061+0000 7f34f51aa700 -1 osd.2 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-06T15:03:38.303 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:38 smithi152 ceph-mon[192652]: from='osd.2 [v2:172.21.15.152:6818/1164280420,v1:172.21.15.152:6819/1164280420]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-06T15:03:38.303 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:38 smithi152 ceph-mon[192652]: failed to encode map e72 with expected crc 2023-12-06T15:03:38.303 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:38 smithi152 ceph-mon[192652]: osdmap e72: 6 total, 5 up, 6 in 2023-12-06T15:03:38.303 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:38 smithi152 ceph-mon[192652]: from='osd.2 [v2:172.21.15.152:6818/1164280420,v1:172.21.15.152:6819/1164280420]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-06T15:03:38.303 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:38 smithi152 ceph-mon[192652]: failed to encode map e72 with expected crc 2023-12-06T15:03:38.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:38 smithi190 ceph-mon[178398]: from='osd.2 [v2:172.21.15.152:6818/1164280420,v1:172.21.15.152:6819/1164280420]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-06T15:03:38.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:38 smithi190 ceph-mon[178398]: failed to encode map e72 with expected crc 2023-12-06T15:03:38.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:38 smithi190 ceph-mon[178398]: osdmap e72: 6 total, 5 up, 6 in 2023-12-06T15:03:38.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:38 smithi190 ceph-mon[178398]: from='osd.2 [v2:172.21.15.152:6818/1164280420,v1:172.21.15.152:6819/1164280420]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi152", "root=default"]}]: dispatch 2023-12-06T15:03:38.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:38 smithi190 ceph-mon[178398]: failed to encode map e72 with expected crc 2023-12-06T15:03:39.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:39 smithi190 ceph-mon[178398]: failed to encode map e72 with expected crc 2023-12-06T15:03:39.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:39 smithi190 ceph-mon[178398]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-06T15:03:39.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:39 smithi190 ceph-mon[178398]: osd.2 [v2:172.21.15.152:6818/1164280420,v1:172.21.15.152:6819/1164280420] boot 2023-12-06T15:03:39.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:39 smithi190 ceph-mon[178398]: osdmap e73: 6 total, 6 up, 6 in 2023-12-06T15:03:39.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:39 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-06T15:03:39.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:39 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:39.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:39 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:39.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:39 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:03:39.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:39 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T15:03:39.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:39 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:39.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:39 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:03:39.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:39 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:03:39.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:39 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:03:39.324 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:39 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:03:39.324 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:39 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-06T15:03:39.324 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:39 smithi190 ceph-mon[178398]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-06T15:03:39.324 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:39 smithi190 ceph-mon[178398]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2023-12-06T15:03:39.324 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:39 smithi190 ceph-mon[178398]: pgmap v92: 65 pgs: 2 peering, 16 active+undersized, 13 active+undersized+degraded, 34 active+clean; 290 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 49/348 objects degraded (14.080%) 2023-12-06T15:03:39.324 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:39 smithi190 ceph-mon[178398]: osdmap e74: 6 total, 6 up, 6 in 2023-12-06T15:03:39.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:39 smithi152 ceph-mon[192652]: failed to encode map e72 with expected crc 2023-12-06T15:03:39.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:39 smithi152 ceph-mon[192652]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-06T15:03:39.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:39 smithi152 ceph-mon[192652]: osd.2 [v2:172.21.15.152:6818/1164280420,v1:172.21.15.152:6819/1164280420] boot 2023-12-06T15:03:39.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:39 smithi152 ceph-mon[192652]: osdmap e73: 6 total, 6 up, 6 in 2023-12-06T15:03:39.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:39 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-06T15:03:39.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:39 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:39.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:39 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:39.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:39 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:03:39.379 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:39 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T15:03:39.380 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:39 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:39.380 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:39 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:03:39.380 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:39 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:03:39.380 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:39 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:03:39.380 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:39 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:03:39.380 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:39 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-06T15:03:39.380 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:39 smithi152 ceph-mon[192652]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-06T15:03:39.380 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:39 smithi152 ceph-mon[192652]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2023-12-06T15:03:39.381 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:39 smithi152 ceph-mon[192652]: pgmap v92: 65 pgs: 2 peering, 16 active+undersized, 13 active+undersized+degraded, 34 active+clean; 290 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 49/348 objects degraded (14.080%) 2023-12-06T15:03:39.381 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:39 smithi152 ceph-mon[192652]: osdmap e74: 6 total, 6 up, 6 in 2023-12-06T15:03:40.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:40 smithi190 ceph-mon[178398]: failed to encode map e74 with expected crc 2023-12-06T15:03:40.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:40 smithi190 ceph-mon[178398]: failed to encode map e74 with expected crc 2023-12-06T15:03:40.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:40 smithi190 ceph-mon[178398]: failed to encode map e74 with expected crc 2023-12-06T15:03:40.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:40 smithi190 ceph-mon[178398]: failed to encode map e74 with expected crc 2023-12-06T15:03:40.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:40 smithi190 ceph-mon[178398]: failed to encode map e74 with expected crc 2023-12-06T15:03:40.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:40 smithi190 ceph-mon[178398]: failed to encode map e74 with expected crc 2023-12-06T15:03:40.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:40 smithi190 ceph-mon[178398]: Health check update: Degraded data redundancy: 49/348 objects degraded (14.080%), 13 pgs degraded (PG_DEGRADED) 2023-12-06T15:03:40.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:40 smithi152 ceph-mon[192652]: failed to encode map e74 with expected crc 2023-12-06T15:03:40.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:40 smithi152 ceph-mon[192652]: failed to encode map e74 with expected crc 2023-12-06T15:03:40.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:40 smithi152 ceph-mon[192652]: failed to encode map e74 with expected crc 2023-12-06T15:03:40.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:40 smithi152 ceph-mon[192652]: failed to encode map e74 with expected crc 2023-12-06T15:03:40.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:40 smithi152 ceph-mon[192652]: failed to encode map e74 with expected crc 2023-12-06T15:03:40.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:40 smithi152 ceph-mon[192652]: failed to encode map e74 with expected crc 2023-12-06T15:03:40.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:40 smithi152 ceph-mon[192652]: Health check update: Degraded data redundancy: 49/348 objects degraded (14.080%), 13 pgs degraded (PG_DEGRADED) 2023-12-06T15:03:42.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:41 smithi190 ceph-mon[178398]: pgmap v94: 65 pgs: 2 peering, 16 active+undersized, 13 active+undersized+degraded, 34 active+clean; 290 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 49/348 objects degraded (14.080%) 2023-12-06T15:03:42.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:41 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:42.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:41 smithi152 ceph-mon[192652]: pgmap v94: 65 pgs: 2 peering, 16 active+undersized, 13 active+undersized+degraded, 34 active+clean; 290 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 49/348 objects degraded (14.080%) 2023-12-06T15:03:42.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:41 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:42.141 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.140+0000 7fcc7fc80700 1 -- 172.21.15.152:0/2270536003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc780fbaf0 msgr2=0x7fcc780fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:42.141 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.140+0000 7fcc7fc80700 1 --2- 172.21.15.152:0/2270536003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc780fbaf0 0x7fcc780fbf00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcc74004940 tx=0x7fcc74009e30 comp rx=0 tx=0).stop 2023-12-06T15:03:42.141 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.140+0000 7fcc7fc80700 1 -- 172.21.15.152:0/2270536003 shutdown_connections 2023-12-06T15:03:42.141 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.140+0000 7fcc7fc80700 1 --2- 172.21.15.152:0/2270536003 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc780fcd00 0x7fcc780fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:42.141 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.140+0000 7fcc7fc80700 1 --2- 172.21.15.152:0/2270536003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc780fbaf0 0x7fcc780fbf00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:42.141 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.140+0000 7fcc7fc80700 1 -- 172.21.15.152:0/2270536003 >> 172.21.15.152:0/2270536003 conn(0x7fcc780f7190 msgr2=0x7fcc780f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:03:42.141 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.140+0000 7fcc7fc80700 1 -- 172.21.15.152:0/2270536003 shutdown_connections 2023-12-06T15:03:42.142 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.140+0000 7fcc7fc80700 1 -- 172.21.15.152:0/2270536003 wait complete. 2023-12-06T15:03:42.142 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.140+0000 7fcc7fc80700 1 Processor -- start 2023-12-06T15:03:42.142 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.140+0000 7fcc7fc80700 1 -- start start 2023-12-06T15:03:42.142 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.141+0000 7fcc7fc80700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc780fbaf0 0x7fcc7810d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:42.142 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.141+0000 7fcc7fc80700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc780fcd00 0x7fcc7810dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:42.142 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.141+0000 7fcc7fc80700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7810e0c0 con 0x7fcc780fbaf0 2023-12-06T15:03:42.142 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.141+0000 7fcc7fc80700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7810e960 con 0x7fcc780fcd00 2023-12-06T15:03:42.142 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.141+0000 7fcc7da1c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc780fbaf0 0x7fcc7810d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:42.142 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.141+0000 7fcc7da1c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc780fbaf0 0x7fcc7810d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52408/0 (socket says 172.21.15.152:52408) 2023-12-06T15:03:42.142 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.141+0000 7fcc7da1c700 1 -- 172.21.15.152:0/1172922739 learned_addr learned my addr 172.21.15.152:0/1172922739 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:03:42.142 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.141+0000 7fcc7d21b700 1 --2- 172.21.15.152:0/1172922739 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc780fcd00 0x7fcc7810dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:42.142 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.141+0000 7fcc7da1c700 1 -- 172.21.15.152:0/1172922739 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc780fcd00 msgr2=0x7fcc7810dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:42.142 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.141+0000 7fcc7da1c700 1 --2- 172.21.15.152:0/1172922739 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc780fcd00 0x7fcc7810dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:42.142 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.141+0000 7fcc7da1c700 1 -- 172.21.15.152:0/1172922739 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc74005040 con 0x7fcc780fbaf0 2023-12-06T15:03:42.142 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.141+0000 7fcc7d21b700 1 --2- 172.21.15.152:0/1172922739 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc780fcd00 0x7fcc7810dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-06T15:03:42.143 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.141+0000 7fcc7da1c700 1 --2- 172.21.15.152:0/1172922739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc780fbaf0 0x7fcc7810d580 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcc74000c00 tx=0x7fcc74009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:03:42.144 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.141+0000 7fcc6e7fc700 1 -- 172.21.15.152:0/1172922739 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc7400e040 con 0x7fcc780fbaf0 2023-12-06T15:03:42.144 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.141+0000 7fcc6e7fc700 1 -- 172.21.15.152:0/1172922739 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcc74009af0 con 0x7fcc780fbaf0 2023-12-06T15:03:42.144 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.141+0000 7fcc7fc80700 1 -- 172.21.15.152:0/1172922739 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc7810ebe0 con 0x7fcc780fbaf0 2023-12-06T15:03:42.144 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.141+0000 7fcc6e7fc700 1 -- 172.21.15.152:0/1172922739 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc7401c630 con 0x7fcc780fbaf0 2023-12-06T15:03:42.144 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.141+0000 7fcc7fc80700 1 -- 172.21.15.152:0/1172922739 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc7810f120 con 0x7fcc780fbaf0 2023-12-06T15:03:42.144 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.142+0000 7fcc7fc80700 1 -- 172.21.15.152:0/1172922739 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc7804bb80 con 0x7fcc780fbaf0 2023-12-06T15:03:42.144 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.143+0000 7fcc6e7fc700 1 -- 172.21.15.152:0/1172922739 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fcc7400bcd0 con 0x7fcc780fbaf0 2023-12-06T15:03:42.144 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.144+0000 7fcc6e7fc700 1 --2- 172.21.15.152:0/1172922739 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fcc6406ce60 0x7fcc6406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:42.144 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.144+0000 7fcc6e7fc700 1 -- 172.21.15.152:0/1172922739 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6675+0+0 (secure 0 0 0) 0x7fcc7408e2c0 con 0x7fcc780fbaf0 2023-12-06T15:03:42.144 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.144+0000 7fcc7d21b700 1 --2- 172.21.15.152:0/1172922739 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fcc6406ce60 0x7fcc6406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:42.145 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.144+0000 7fcc7d21b700 1 --2- 172.21.15.152:0/1172922739 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fcc6406ce60 0x7fcc6406f310 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcc68009fd0 tx=0x7fcc68009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:03:42.148 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.148+0000 7fcc6e7fc700 1 -- 172.21.15.152:0/1172922739 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fcc7405bc40 con 0x7fcc780fbaf0 2023-12-06T15:03:42.358 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.357+0000 7fcc7fc80700 1 -- 172.21.15.152:0/1172922739 --> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc7810f5c0 con 0x7fcc6406ce60 2023-12-06T15:03:42.359 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.359+0000 7fcc6e7fc700 1 -- 172.21.15.152:0/1172922739 <== mgr.34104 v2:172.21.15.152:6800/2427836422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fcc7810f5c0 con 0x7fcc6406ce60 2023-12-06T15:03:42.361 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.361+0000 7fcc7fc80700 1 -- 172.21.15.152:0/1172922739 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fcc6406ce60 msgr2=0x7fcc6406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:42.361 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.361+0000 7fcc7fc80700 1 --2- 172.21.15.152:0/1172922739 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fcc6406ce60 0x7fcc6406f310 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcc68009fd0 tx=0x7fcc68009ee0 comp rx=0 tx=0).stop 2023-12-06T15:03:42.361 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.361+0000 7fcc7fc80700 1 -- 172.21.15.152:0/1172922739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc780fbaf0 msgr2=0x7fcc7810d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:42.361 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.361+0000 7fcc7fc80700 1 --2- 172.21.15.152:0/1172922739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc780fbaf0 0x7fcc7810d580 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcc74000c00 tx=0x7fcc74009e30 comp rx=0 tx=0).stop 2023-12-06T15:03:42.361 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.361+0000 7fcc7fc80700 1 -- 172.21.15.152:0/1172922739 shutdown_connections 2023-12-06T15:03:42.361 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.361+0000 7fcc7fc80700 1 --2- 172.21.15.152:0/1172922739 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fcc6406ce60 0x7fcc6406f310 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:42.361 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.361+0000 7fcc7fc80700 1 --2- 172.21.15.152:0/1172922739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcc780fbaf0 0x7fcc7810d580 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:42.362 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.361+0000 7fcc7fc80700 1 --2- 172.21.15.152:0/1172922739 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc780fcd00 0x7fcc7810dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:42.362 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.361+0000 7fcc7fc80700 1 -- 172.21.15.152:0/1172922739 >> 172.21.15.152:0/1172922739 conn(0x7fcc780f7190 msgr2=0x7fcc78065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:03:42.362 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.361+0000 7fcc7fc80700 1 -- 172.21.15.152:0/1172922739 shutdown_connections 2023-12-06T15:03:42.362 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.361+0000 7fcc7fc80700 1 -- 172.21.15.152:0/1172922739 wait complete. 2023-12-06T15:03:42.371 INFO:teuthology.orchestra.run.smithi152.stdout:true 2023-12-06T15:03:42.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.463+0000 7f9a227c5700 1 -- 172.21.15.152:0/3713040862 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a1c0fbaf0 msgr2=0x7f9a1c0fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:42.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.463+0000 7f9a227c5700 1 --2- 172.21.15.152:0/3713040862 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a1c0fbaf0 0x7f9a1c0fbf00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c004940 tx=0x7f9a0c009e30 comp rx=0 tx=0).stop 2023-12-06T15:03:42.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.463+0000 7f9a227c5700 1 -- 172.21.15.152:0/3713040862 shutdown_connections 2023-12-06T15:03:42.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.463+0000 7f9a227c5700 1 --2- 172.21.15.152:0/3713040862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a1c0fcd00 0x7f9a1c0fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:42.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.463+0000 7f9a227c5700 1 --2- 172.21.15.152:0/3713040862 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a1c0fbaf0 0x7f9a1c0fbf00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:42.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.463+0000 7f9a227c5700 1 -- 172.21.15.152:0/3713040862 >> 172.21.15.152:0/3713040862 conn(0x7f9a1c0f7190 msgr2=0x7f9a1c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:03:42.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.463+0000 7f9a227c5700 1 -- 172.21.15.152:0/3713040862 shutdown_connections 2023-12-06T15:03:42.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.463+0000 7f9a227c5700 1 -- 172.21.15.152:0/3713040862 wait complete. 2023-12-06T15:03:42.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.464+0000 7f9a227c5700 1 Processor -- start 2023-12-06T15:03:42.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.464+0000 7f9a227c5700 1 -- start start 2023-12-06T15:03:42.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.464+0000 7f9a227c5700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a1c0fbaf0 0x7f9a1c10c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:42.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.464+0000 7f9a227c5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a1c0fcd00 0x7f9a1c10c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:42.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.464+0000 7f9a227c5700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c10cfc0 con 0x7f9a1c0fcd00 2023-12-06T15:03:42.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.464+0000 7f9a227c5700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c10d860 con 0x7f9a1c0fbaf0 2023-12-06T15:03:42.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.464+0000 7f9a1b7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a1c0fcd00 0x7f9a1c10c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:42.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.464+0000 7f9a1b7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a1c0fcd00 0x7f9a1c10c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52428/0 (socket says 172.21.15.152:52428) 2023-12-06T15:03:42.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.464+0000 7f9a1b7fe700 1 -- 172.21.15.152:0/2789110291 learned_addr learned my addr 172.21.15.152:0/2789110291 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:03:42.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.464+0000 7f9a1bfff700 1 --2- 172.21.15.152:0/2789110291 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a1c0fbaf0 0x7f9a1c10c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:42.465 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.464+0000 7f9a1b7fe700 1 -- 172.21.15.152:0/2789110291 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a1c0fbaf0 msgr2=0x7f9a1c10c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:42.466 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.464+0000 7f9a1b7fe700 1 --2- 172.21.15.152:0/2789110291 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a1c0fbaf0 0x7f9a1c10c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:42.466 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.464+0000 7f9a1b7fe700 1 -- 172.21.15.152:0/2789110291 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0c005040 con 0x7f9a1c0fcd00 2023-12-06T15:03:42.466 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.464+0000 7f9a1bfff700 1 --2- 172.21.15.152:0/2789110291 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a1c0fbaf0 0x7f9a1c10c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-06T15:03:42.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.465+0000 7f9a1b7fe700 1 --2- 172.21.15.152:0/2789110291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a1c0fcd00 0x7f9a1c10c9c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9a1000c830 tx=0x7f9a10004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:03:42.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.465+0000 7f9a18ff9700 1 -- 172.21.15.152:0/2789110291 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a1000a760 con 0x7f9a1c0fcd00 2023-12-06T15:03:42.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.465+0000 7f9a18ff9700 1 -- 172.21.15.152:0/2789110291 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9a1000ad70 con 0x7f9a1c0fcd00 2023-12-06T15:03:42.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.465+0000 7f9a227c5700 1 -- 172.21.15.152:0/2789110291 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a1c10db40 con 0x7f9a1c0fcd00 2023-12-06T15:03:42.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.465+0000 7f9a18ff9700 1 -- 172.21.15.152:0/2789110291 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a100113a0 con 0x7f9a1c0fcd00 2023-12-06T15:03:42.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.465+0000 7f9a227c5700 1 -- 172.21.15.152:0/2789110291 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a1c10e080 con 0x7f9a1c0fcd00 2023-12-06T15:03:42.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.466+0000 7f9a227c5700 1 -- 172.21.15.152:0/2789110291 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a1c04bb80 con 0x7f9a1c0fcd00 2023-12-06T15:03:42.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.466+0000 7f9a18ff9700 1 -- 172.21.15.152:0/2789110291 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f9a1000a8c0 con 0x7f9a1c0fcd00 2023-12-06T15:03:42.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.466+0000 7f9a18ff9700 1 --2- 172.21.15.152:0/2789110291 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f9a0406ce60 0x7f9a0406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:42.468 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.467+0000 7f9a18ff9700 1 -- 172.21.15.152:0/2789110291 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f9a1008c370 con 0x7f9a1c0fcd00 2023-12-06T15:03:42.468 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.467+0000 7f9a1bfff700 1 --2- 172.21.15.152:0/2789110291 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f9a0406ce60 0x7f9a0406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:42.468 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.467+0000 7f9a1bfff700 1 --2- 172.21.15.152:0/2789110291 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f9a0406ce60 0x7f9a0406f310 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c00b3b0 tx=0x7f9a0c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:03:42.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.471+0000 7f9a18ff9700 1 -- 172.21.15.152:0/2789110291 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f9a10059cf0 con 0x7f9a1c0fcd00 2023-12-06T15:03:42.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.680+0000 7f9a227c5700 1 -- 172.21.15.152:0/2789110291 --> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a1c10e580 con 0x7f9a0406ce60 2023-12-06T15:03:42.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.681+0000 7f9a18ff9700 1 -- 172.21.15.152:0/2789110291 <== mgr.34104 v2:172.21.15.152:6800/2427836422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9a1c10e580 con 0x7f9a0406ce60 2023-12-06T15:03:42.683 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.683+0000 7f9a227c5700 1 -- 172.21.15.152:0/2789110291 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f9a0406ce60 msgr2=0x7f9a0406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:42.683 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.683+0000 7f9a227c5700 1 --2- 172.21.15.152:0/2789110291 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f9a0406ce60 0x7f9a0406f310 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c00b3b0 tx=0x7f9a0c009e30 comp rx=0 tx=0).stop 2023-12-06T15:03:42.683 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.683+0000 7f9a227c5700 1 -- 172.21.15.152:0/2789110291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a1c0fcd00 msgr2=0x7f9a1c10c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:42.684 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.683+0000 7f9a227c5700 1 --2- 172.21.15.152:0/2789110291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a1c0fcd00 0x7f9a1c10c9c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9a1000c830 tx=0x7f9a10004470 comp rx=0 tx=0).stop 2023-12-06T15:03:42.684 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.683+0000 7f9a227c5700 1 -- 172.21.15.152:0/2789110291 shutdown_connections 2023-12-06T15:03:42.684 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.683+0000 7f9a227c5700 1 --2- 172.21.15.152:0/2789110291 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f9a0406ce60 0x7f9a0406f310 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:42.684 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.683+0000 7f9a227c5700 1 --2- 172.21.15.152:0/2789110291 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a1c0fbaf0 0x7f9a1c10c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:42.684 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.683+0000 7f9a227c5700 1 --2- 172.21.15.152:0/2789110291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9a1c0fcd00 0x7f9a1c10c9c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:42.684 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.683+0000 7f9a227c5700 1 -- 172.21.15.152:0/2789110291 >> 172.21.15.152:0/2789110291 conn(0x7f9a1c0f7190 msgr2=0x7f9a1c0fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:03:42.684 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.683+0000 7f9a227c5700 1 -- 172.21.15.152:0/2789110291 shutdown_connections 2023-12-06T15:03:42.684 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.683+0000 7f9a227c5700 1 -- 172.21.15.152:0/2789110291 wait complete. 2023-12-06T15:03:42.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.784+0000 7faa3f534700 1 -- 172.21.15.152:0/3840032009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa38066070 msgr2=0x7faa380ff7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:42.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.784+0000 7faa3f534700 1 --2- 172.21.15.152:0/3840032009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa38066070 0x7faa380ff7c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faa34004940 tx=0x7faa34009e30 comp rx=0 tx=0).stop 2023-12-06T15:03:42.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.784+0000 7faa3f534700 1 -- 172.21.15.152:0/3840032009 shutdown_connections 2023-12-06T15:03:42.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.784+0000 7faa3f534700 1 --2- 172.21.15.152:0/3840032009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa380ffd90 0x7faa381021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:42.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.784+0000 7faa3f534700 1 --2- 172.21.15.152:0/3840032009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa38066070 0x7faa380ff7c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:42.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.785+0000 7faa3f534700 1 -- 172.21.15.152:0/3840032009 >> 172.21.15.152:0/3840032009 conn(0x7faa380f7190 msgr2=0x7faa380f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:03:42.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.785+0000 7faa3f534700 1 -- 172.21.15.152:0/3840032009 shutdown_connections 2023-12-06T15:03:42.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.785+0000 7faa3f534700 1 -- 172.21.15.152:0/3840032009 wait complete. 2023-12-06T15:03:42.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.785+0000 7faa3f534700 1 Processor -- start 2023-12-06T15:03:42.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.785+0000 7faa3f534700 1 -- start start 2023-12-06T15:03:42.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.785+0000 7faa3f534700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa38066070 0x7faa380fd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:42.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.785+0000 7faa3f534700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa380ffd90 0x7faa380fb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:42.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.785+0000 7faa3f534700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa380fbcc0 con 0x7faa38066070 2023-12-06T15:03:42.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.785+0000 7faa3f534700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa380fbe30 con 0x7faa380ffd90 2023-12-06T15:03:42.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.785+0000 7faa3d2d0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa38066070 0x7faa380fd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:42.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.785+0000 7faa3d2d0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa38066070 0x7faa380fd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52438/0 (socket says 172.21.15.152:52438) 2023-12-06T15:03:42.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.785+0000 7faa3d2d0700 1 -- 172.21.15.152:0/2909503532 learned_addr learned my addr 172.21.15.152:0/2909503532 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:03:42.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.786+0000 7faa3cacf700 1 --2- 172.21.15.152:0/2909503532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa380ffd90 0x7faa380fb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:42.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.786+0000 7faa3d2d0700 1 -- 172.21.15.152:0/2909503532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa380ffd90 msgr2=0x7faa380fb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:42.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.786+0000 7faa3d2d0700 1 --2- 172.21.15.152:0/2909503532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa380ffd90 0x7faa380fb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:42.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.786+0000 7faa3d2d0700 1 -- 172.21.15.152:0/2909503532 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa34005040 con 0x7faa38066070 2023-12-06T15:03:42.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.786+0000 7faa3d2d0700 1 --2- 172.21.15.152:0/2909503532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa38066070 0x7faa380fd240 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7faa34009360 tx=0x7faa34009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:03:42.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.786+0000 7faa2dffb700 1 -- 172.21.15.152:0/2909503532 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa3400e040 con 0x7faa38066070 2023-12-06T15:03:42.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.786+0000 7faa3f534700 1 -- 172.21.15.152:0/2909503532 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa380fc0b0 con 0x7faa38066070 2023-12-06T15:03:42.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.786+0000 7faa2dffb700 1 -- 172.21.15.152:0/2909503532 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faa3400bcd0 con 0x7faa38066070 2023-12-06T15:03:42.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.786+0000 7faa2dffb700 1 -- 172.21.15.152:0/2909503532 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa3401c630 con 0x7faa38066070 2023-12-06T15:03:42.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.786+0000 7faa3f534700 1 -- 172.21.15.152:0/2909503532 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa38115560 con 0x7faa38066070 2023-12-06T15:03:42.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.787+0000 7faa3f534700 1 -- 172.21.15.152:0/2909503532 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa381075f0 con 0x7faa38066070 2023-12-06T15:03:42.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.788+0000 7faa2dffb700 1 -- 172.21.15.152:0/2909503532 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7faa34013960 con 0x7faa38066070 2023-12-06T15:03:42.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.789+0000 7faa2dffb700 1 --2- 172.21.15.152:0/2909503532 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7faa2406ce60 0x7faa2406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:42.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.789+0000 7faa2dffb700 1 -- 172.21.15.152:0/2909503532 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6675+0+0 (secure 0 0 0) 0x7faa3408e3c0 con 0x7faa38066070 2023-12-06T15:03:42.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.789+0000 7faa3cacf700 1 --2- 172.21.15.152:0/2909503532 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7faa2406ce60 0x7faa2406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:42.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.789+0000 7faa3cacf700 1 --2- 172.21.15.152:0/2909503532 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7faa2406ce60 0x7faa2406f310 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7faa38065db0 tx=0x7faa2800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:03:42.792 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.793+0000 7faa2dffb700 1 -- 172.21.15.152:0/2909503532 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7faa3405bc80 con 0x7faa38066070 2023-12-06T15:03:42.989 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.989+0000 7faa3f534700 1 -- 172.21.15.152:0/2909503532 --> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7faa3802b250 con 0x7faa2406ce60 2023-12-06T15:03:42.999 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:42.999+0000 7faa2dffb700 1 -- 172.21.15.152:0/2909503532 <== mgr.34104 v2:172.21.15.152:6800/2427836422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7faa3802b250 con 0x7faa2406ce60 2023-12-06T15:03:42.999 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-06T15:03:42.999 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 running (3m) 8s ago 9m 26.3M - 0.25.0 c8568f914cd2 b1a46cc95546 2023-12-06T15:03:42.999 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (88s) 8s ago 9m 7470k - 19.0.0-26-g0482646f 26bb7d89db2e 222039c21ee0 2023-12-06T15:03:43.000 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi190 smithi190 running (85s) 83s ago 8m 7457k - 19.0.0-26-g0482646f 26bb7d89db2e 8841ae485b70 2023-12-06T15:03:43.000 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (3m) 8s ago 9m 88.0M - 9.4.7 954c08fa6188 5c6a52d58144 2023-12-06T15:03:43.000 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.acqswy smithi152 running (5m) 8s ago 5m 5566M - 17.2.7-113-gece0d607 a5c6421f1c5f ff9375cec192 2023-12-06T15:03:43.000 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.ypivwc smithi152 running (5m) 8s ago 5m 538M - 17.2.7-113-gece0d607 a5c6421f1c5f d809a681491b 2023-12-06T15:03:43.000 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi190.edwtqj smithi190 running (5m) 83s ago 5m 626M - 17.2.7-113-gece0d607 a5c6421f1c5f f3b7ebd93b04 2023-12-06T15:03:43.000 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi190.uucxzu smithi190 running (5m) 83s ago 5m 4860M - 17.2.7-113-gece0d607 a5c6421f1c5f c01be1409c5f 2023-12-06T15:03:43.000 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.meodco smithi152 *:8443,9283,8765 running (3m) 8s ago 10m 510M - 19.0.0-26-g0482646f 26bb7d89db2e 16ed2af8a3d0 2023-12-06T15:03:43.000 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi190.ubusrr smithi190 *:8443,9283,8765 running (2m) 83s ago 8m 447M - 19.0.0-26-g0482646f 26bb7d89db2e cfae14b9324d 2023-12-06T15:03:43.000 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (2m) 8s ago 10m 66.8M 2048M 19.0.0-26-g0482646f 26bb7d89db2e f5163d3b0f5f 2023-12-06T15:03:43.000 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi190 smithi190 running (119s) 83s ago 8m 41.2M 2048M 19.0.0-26-g0482646f 26bb7d89db2e b25040d5fdfe 2023-12-06T15:03:43.000 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 running (3m) 8s ago 9m 18.5M - 1.5.0 0da6a335fe13 81be696b9be8 2023-12-06T15:03:43.000 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi190 smithi190 *:9100 running (3m) 83s ago 8m 18.3M - 1.5.0 0da6a335fe13 2e521e235bf7 2023-12-06T15:03:43.000 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (71s) 8s ago 8m 169M 1568M 19.0.0-26-g0482646f 26bb7d89db2e 05e00966036e 2023-12-06T15:03:43.000 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (41s) 8s ago 7m 122M 1568M 19.0.0-26-g0482646f 26bb7d89db2e c0eaab4b2fd0 2023-12-06T15:03:43.001 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (11s) 8s ago 7m 12.6M 1568M 19.0.0-26-g0482646f 26bb7d89db2e 1440f943b48e 2023-12-06T15:03:43.001 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi190 running (7m) 83s ago 7m 962M 2592M 17.2.7-113-gece0d607 a5c6421f1c5f f0281d01fec4 2023-12-06T15:03:43.001 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi190 running (6m) 83s ago 6m 726M 2592M 17.2.7-113-gece0d607 a5c6421f1c5f a415b29ad9c7 2023-12-06T15:03:43.001 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi190 running (6m) 83s ago 6m 856M 2592M 17.2.7-113-gece0d607 a5c6421f1c5f b0f2767055a5 2023-12-06T15:03:43.001 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi152 smithi152 *:9095 running (2m) 8s ago 9m 48.7M - 2.43.0 a07b618ecd1d 5f7e5860a419 2023-12-06T15:03:43.001 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.001+0000 7faa3f534700 1 -- 172.21.15.152:0/2909503532 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7faa2406ce60 msgr2=0x7faa2406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:43.002 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.001+0000 7faa3f534700 1 --2- 172.21.15.152:0/2909503532 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7faa2406ce60 0x7faa2406f310 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7faa38065db0 tx=0x7faa2800b040 comp rx=0 tx=0).stop 2023-12-06T15:03:43.002 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.001+0000 7faa3f534700 1 -- 172.21.15.152:0/2909503532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa38066070 msgr2=0x7faa380fd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:43.002 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.001+0000 7faa3f534700 1 --2- 172.21.15.152:0/2909503532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa38066070 0x7faa380fd240 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7faa34009360 tx=0x7faa34009e30 comp rx=0 tx=0).stop 2023-12-06T15:03:43.002 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.001+0000 7faa3f534700 1 -- 172.21.15.152:0/2909503532 shutdown_connections 2023-12-06T15:03:43.002 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.001+0000 7faa3f534700 1 --2- 172.21.15.152:0/2909503532 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7faa2406ce60 0x7faa2406f310 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:43.002 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.001+0000 7faa3f534700 1 --2- 172.21.15.152:0/2909503532 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa38066070 0x7faa380fd240 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:43.002 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.001+0000 7faa3f534700 1 --2- 172.21.15.152:0/2909503532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa380ffd90 0x7faa380fb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:43.002 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.001+0000 7faa3f534700 1 -- 172.21.15.152:0/2909503532 >> 172.21.15.152:0/2909503532 conn(0x7faa380f7190 msgr2=0x7faa380f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:03:43.002 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.002+0000 7faa3f534700 1 -- 172.21.15.152:0/2909503532 shutdown_connections 2023-12-06T15:03:43.002 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.002+0000 7faa3f534700 1 -- 172.21.15.152:0/2909503532 wait complete. 2023-12-06T15:03:43.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:42 smithi190 ceph-mon[178398]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:03:43.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:42 smithi190 ceph-mon[178398]: pgmap v95: 65 pgs: 2 peering, 63 active+clean; 290 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-12-06T15:03:43.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:42 smithi190 ceph-mon[178398]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:03:43.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:42 smithi190 ceph-mon[178398]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 49/348 objects degraded (14.080%), 13 pgs degraded) 2023-12-06T15:03:43.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:42 smithi190 ceph-mon[178398]: Cluster is now healthy 2023-12-06T15:03:43.104 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.103+0000 7f8b82ded700 1 -- 172.21.15.152:0/3321540992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b7c0fd120 msgr2=0x7f8b7c0fd530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:43.105 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.103+0000 7f8b82ded700 1 --2- 172.21.15.152:0/3321540992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b7c0fd120 0x7f8b7c0fd530 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8b70004940 tx=0x7f8b70009e30 comp rx=0 tx=0).stop 2023-12-06T15:03:43.105 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.103+0000 7f8b82ded700 1 -- 172.21.15.152:0/3321540992 shutdown_connections 2023-12-06T15:03:43.105 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.103+0000 7f8b82ded700 1 --2- 172.21.15.152:0/3321540992 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b7c0fbe30 0x7f8b7c0fc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:43.105 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.103+0000 7f8b82ded700 1 --2- 172.21.15.152:0/3321540992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b7c0fd120 0x7f8b7c0fd530 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:43.105 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.103+0000 7f8b82ded700 1 -- 172.21.15.152:0/3321540992 >> 172.21.15.152:0/3321540992 conn(0x7f8b7c0f6950 msgr2=0x7f8b7c0f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:03:43.105 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.104+0000 7f8b82ded700 1 -- 172.21.15.152:0/3321540992 shutdown_connections 2023-12-06T15:03:43.105 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.104+0000 7f8b82ded700 1 -- 172.21.15.152:0/3321540992 wait complete. 2023-12-06T15:03:43.105 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.104+0000 7f8b82ded700 1 Processor -- start 2023-12-06T15:03:43.105 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.104+0000 7f8b82ded700 1 -- start start 2023-12-06T15:03:43.106 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.104+0000 7f8b82ded700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b7c0fbe30 0x7f8b7c10d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:43.106 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.104+0000 7f8b82ded700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b7c0fd120 0x7f8b7c10dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:43.106 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.104+0000 7f8b82ded700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c10e1a0 con 0x7f8b7c0fd120 2023-12-06T15:03:43.106 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.104+0000 7f8b82ded700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c10ea40 con 0x7f8b7c0fbe30 2023-12-06T15:03:43.106 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.104+0000 7f8b7bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b7c0fd120 0x7f8b7c10dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:43.107 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.105+0000 7f8b7bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b7c0fd120 0x7f8b7c10dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52460/0 (socket says 172.21.15.152:52460) 2023-12-06T15:03:43.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.105+0000 7f8b7bfff700 1 -- 172.21.15.152:0/380865500 learned_addr learned my addr 172.21.15.152:0/380865500 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:03:43.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.105+0000 7f8b80b89700 1 --2- 172.21.15.152:0/380865500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b7c0fbe30 0x7f8b7c10d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:43.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.105+0000 7f8b7bfff700 1 -- 172.21.15.152:0/380865500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b7c0fbe30 msgr2=0x7f8b7c10d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:43.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.105+0000 7f8b7bfff700 1 --2- 172.21.15.152:0/380865500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b7c0fbe30 0x7f8b7c10d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:43.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.105+0000 7f8b7bfff700 1 -- 172.21.15.152:0/380865500 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b70005040 con 0x7f8b7c0fd120 2023-12-06T15:03:43.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.105+0000 7f8b7bfff700 1 --2- 172.21.15.152:0/380865500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b7c0fd120 0x7f8b7c10dba0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8b6800c810 tx=0x7f8b68004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:03:43.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.105+0000 7f8b797fa700 1 -- 172.21.15.152:0/380865500 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b68012810 con 0x7f8b7c0fd120 2023-12-06T15:03:43.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.105+0000 7f8b82ded700 1 -- 172.21.15.152:0/380865500 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b7c10ed20 con 0x7f8b7c0fd120 2023-12-06T15:03:43.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.105+0000 7f8b797fa700 1 -- 172.21.15.152:0/380865500 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8b68012e20 con 0x7f8b7c0fd120 2023-12-06T15:03:43.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.105+0000 7f8b797fa700 1 -- 172.21.15.152:0/380865500 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b6800a370 con 0x7f8b7c0fd120 2023-12-06T15:03:43.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.105+0000 7f8b82ded700 1 -- 172.21.15.152:0/380865500 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b7c10f260 con 0x7f8b7c0fd120 2023-12-06T15:03:43.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.106+0000 7f8b82ded700 1 -- 172.21.15.152:0/380865500 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b7c04bb80 con 0x7f8b7c0fd120 2023-12-06T15:03:43.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.107+0000 7f8b797fa700 1 -- 172.21.15.152:0/380865500 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f8b68011780 con 0x7f8b7c0fd120 2023-12-06T15:03:43.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.107+0000 7f8b797fa700 1 --2- 172.21.15.152:0/380865500 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f8b6c06ce60 0x7f8b6c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:43.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.107+0000 7f8b80b89700 1 --2- 172.21.15.152:0/380865500 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f8b6c06ce60 0x7f8b6c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:43.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.107+0000 7f8b797fa700 1 -- 172.21.15.152:0/380865500 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f8b6808c890 con 0x7f8b7c0fd120 2023-12-06T15:03:43.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.107+0000 7f8b80b89700 1 --2- 172.21.15.152:0/380865500 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f8b6c06ce60 0x7f8b6c06f310 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8b7000b3b0 tx=0x7f8b70009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:03:43.111 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.111+0000 7f8b797fa700 1 -- 172.21.15.152:0/380865500 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f8b6805a0f0 con 0x7f8b7c0fd120 2023-12-06T15:03:43.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:42 smithi152 ceph-mon[192652]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:03:43.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:42 smithi152 ceph-mon[192652]: pgmap v95: 65 pgs: 2 peering, 63 active+clean; 290 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2023-12-06T15:03:43.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:42 smithi152 ceph-mon[192652]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:03:43.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:42 smithi152 ceph-mon[192652]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 49/348 objects degraded (14.080%), 13 pgs degraded) 2023-12-06T15:03:43.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:42 smithi152 ceph-mon[192652]: Cluster is now healthy 2023-12-06T15:03:43.380 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.379+0000 7f8b82ded700 1 -- 172.21.15.152:0/380865500 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8b7c1044f0 con 0x7f8b7c0fd120 2023-12-06T15:03:43.380 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.380+0000 7f8b797fa700 1 -- 172.21.15.152:0/380865500 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+827 (secure 0 0 0) 0x7f8b68059c80 con 0x7f8b7c0fd120 2023-12-06T15:03:43.380 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-12-06T15:03:43.380 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": { 2023-12-06T15:03:43.380 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 2 2023-12-06T15:03:43.380 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:03:43.380 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": { 2023-12-06T15:03:43.381 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 2 2023-12-06T15:03:43.381 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:03:43.381 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": { 2023-12-06T15:03:43.381 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 3, 2023-12-06T15:03:43.381 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 3 2023-12-06T15:03:43.381 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:03:43.381 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2023-12-06T15:03:43.381 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 4 2023-12-06T15:03:43.381 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:03:43.381 INFO:teuthology.orchestra.run.smithi152.stdout: "overall": { 2023-12-06T15:03:43.381 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 7, 2023-12-06T15:03:43.381 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 7 2023-12-06T15:03:43.381 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-12-06T15:03:43.381 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-12-06T15:03:43.382 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.382+0000 7f8b82ded700 1 -- 172.21.15.152:0/380865500 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f8b6c06ce60 msgr2=0x7f8b6c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:43.382 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.382+0000 7f8b82ded700 1 --2- 172.21.15.152:0/380865500 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f8b6c06ce60 0x7f8b6c06f310 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8b7000b3b0 tx=0x7f8b70009e30 comp rx=0 tx=0).stop 2023-12-06T15:03:43.382 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.382+0000 7f8b82ded700 1 -- 172.21.15.152:0/380865500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b7c0fd120 msgr2=0x7f8b7c10dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:43.382 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.382+0000 7f8b82ded700 1 --2- 172.21.15.152:0/380865500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b7c0fd120 0x7f8b7c10dba0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8b6800c810 tx=0x7f8b68004470 comp rx=0 tx=0).stop 2023-12-06T15:03:43.382 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.382+0000 7f8b82ded700 1 -- 172.21.15.152:0/380865500 shutdown_connections 2023-12-06T15:03:43.383 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.382+0000 7f8b82ded700 1 --2- 172.21.15.152:0/380865500 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f8b6c06ce60 0x7f8b6c06f310 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:43.383 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.382+0000 7f8b82ded700 1 --2- 172.21.15.152:0/380865500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b7c0fbe30 0x7f8b7c10d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:43.383 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.382+0000 7f8b82ded700 1 --2- 172.21.15.152:0/380865500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b7c0fd120 0x7f8b7c10dba0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:43.383 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.382+0000 7f8b82ded700 1 -- 172.21.15.152:0/380865500 >> 172.21.15.152:0/380865500 conn(0x7f8b7c0f6950 msgr2=0x7f8b7c0fad20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:03:43.383 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.382+0000 7f8b82ded700 1 -- 172.21.15.152:0/380865500 shutdown_connections 2023-12-06T15:03:43.383 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.382+0000 7f8b82ded700 1 -- 172.21.15.152:0/380865500 wait complete. 2023-12-06T15:03:43.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.482+0000 7f4fea0a0700 1 -- 172.21.15.152:0/1334648422 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fe40fbaf0 msgr2=0x7f4fe40fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:43.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.482+0000 7f4fea0a0700 1 --2- 172.21.15.152:0/1334648422 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fe40fbaf0 0x7f4fe40fbf00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4004940 tx=0x7f4fd4009e30 comp rx=0 tx=0).stop 2023-12-06T15:03:43.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.482+0000 7f4fea0a0700 1 -- 172.21.15.152:0/1334648422 shutdown_connections 2023-12-06T15:03:43.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.482+0000 7f4fea0a0700 1 --2- 172.21.15.152:0/1334648422 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4fe40fcd00 0x7f4fe40fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:43.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.482+0000 7f4fea0a0700 1 --2- 172.21.15.152:0/1334648422 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fe40fbaf0 0x7f4fe40fbf00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:43.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.482+0000 7f4fea0a0700 1 -- 172.21.15.152:0/1334648422 >> 172.21.15.152:0/1334648422 conn(0x7f4fe40f7190 msgr2=0x7f4fe40f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:03:43.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.482+0000 7f4fea0a0700 1 -- 172.21.15.152:0/1334648422 shutdown_connections 2023-12-06T15:03:43.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.482+0000 7f4fea0a0700 1 -- 172.21.15.152:0/1334648422 wait complete. 2023-12-06T15:03:43.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.483+0000 7f4fea0a0700 1 Processor -- start 2023-12-06T15:03:43.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.483+0000 7f4fea0a0700 1 -- start start 2023-12-06T15:03:43.485 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.483+0000 7f4fea0a0700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fe40fbaf0 0x7f4fe410c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:43.486 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.483+0000 7f4fea0a0700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4fe40fcd00 0x7f4fe410c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:43.486 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.483+0000 7f4fea0a0700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe410cfc0 con 0x7f4fe40fbaf0 2023-12-06T15:03:43.486 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.483+0000 7f4fea0a0700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe410d860 con 0x7f4fe40fcd00 2023-12-06T15:03:43.486 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.483+0000 7f4fe37fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fe40fbaf0 0x7f4fe410c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:43.486 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.483+0000 7f4fe37fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fe40fbaf0 0x7f4fe410c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52486/0 (socket says 172.21.15.152:52486) 2023-12-06T15:03:43.486 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.483+0000 7f4fe37fe700 1 -- 172.21.15.152:0/310045245 learned_addr learned my addr 172.21.15.152:0/310045245 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:03:43.486 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.484+0000 7f4fe2ffd700 1 --2- 172.21.15.152:0/310045245 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4fe40fcd00 0x7f4fe410c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:43.486 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.484+0000 7f4fe37fe700 1 -- 172.21.15.152:0/310045245 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4fe40fcd00 msgr2=0x7f4fe410c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:43.486 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.484+0000 7f4fe37fe700 1 --2- 172.21.15.152:0/310045245 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4fe40fcd00 0x7f4fe410c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:43.486 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.484+0000 7f4fe37fe700 1 -- 172.21.15.152:0/310045245 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd4005040 con 0x7f4fe40fbaf0 2023-12-06T15:03:43.486 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.484+0000 7f4fe37fe700 1 --2- 172.21.15.152:0/310045245 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fe40fbaf0 0x7f4fe410c480 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4004f90 tx=0x7f4fd4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:03:43.486 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.484+0000 7f4fcbfff700 1 -- 172.21.15.152:0/310045245 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fd400e040 con 0x7f4fe40fbaf0 2023-12-06T15:03:43.487 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.484+0000 7f4fcbfff700 1 -- 172.21.15.152:0/310045245 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4fd400bc50 con 0x7f4fe40fbaf0 2023-12-06T15:03:43.487 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.484+0000 7f4fcbfff700 1 -- 172.21.15.152:0/310045245 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fd401c630 con 0x7f4fe40fbaf0 2023-12-06T15:03:43.487 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.484+0000 7f4fea0a0700 1 -- 172.21.15.152:0/310045245 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fe410dae0 con 0x7f4fe40fbaf0 2023-12-06T15:03:43.487 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.484+0000 7f4fea0a0700 1 -- 172.21.15.152:0/310045245 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fe410dfd0 con 0x7f4fe40fbaf0 2023-12-06T15:03:43.487 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.485+0000 7f4fea0a0700 1 -- 172.21.15.152:0/310045245 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fe404bb80 con 0x7f4fe40fbaf0 2023-12-06T15:03:43.487 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.486+0000 7f4fcbfff700 1 -- 172.21.15.152:0/310045245 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f4fd4013420 con 0x7f4fe40fbaf0 2023-12-06T15:03:43.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.486+0000 7f4fcbfff700 1 --2- 172.21.15.152:0/310045245 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f4fcc06ce60 0x7f4fcc06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:43.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.486+0000 7f4fcbfff700 1 -- 172.21.15.152:0/310045245 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f4fd408d7c0 con 0x7f4fe40fbaf0 2023-12-06T15:03:43.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.486+0000 7f4fe2ffd700 1 --2- 172.21.15.152:0/310045245 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f4fcc06ce60 0x7f4fcc06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:43.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.486+0000 7f4fe2ffd700 1 --2- 172.21.15.152:0/310045245 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f4fcc06ce60 0x7f4fcc06f310 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8004f40 tx=0x7f4fd800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:03:43.490 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.490+0000 7f4fcbfff700 1 -- 172.21.15.152:0/310045245 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4fd405b0a0 con 0x7f4fe40fbaf0 2023-12-06T15:03:43.724 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.723+0000 7f4fea0a0700 1 -- 172.21.15.152:0/310045245 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4fe410e3d0 con 0x7f4fe40fbaf0 2023-12-06T15:03:43.724 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.724+0000 7f4fcbfff700 1 -- 172.21.15.152:0/310045245 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1890 (secure 0 0 0) 0x7f4fd405ac30 con 0x7f4fe40fbaf0 2023-12-06T15:03:43.725 INFO:teuthology.orchestra.run.smithi152.stdout:e17 2023-12-06T15:03:43.725 INFO:teuthology.orchestra.run.smithi152.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-06T15:03:43.725 INFO:teuthology.orchestra.run.smithi152.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-06T15:03:43.725 INFO:teuthology.orchestra.run.smithi152.stdout:legacy client fscid: 1 2023-12-06T15:03:43.725 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T15:03:43.725 INFO:teuthology.orchestra.run.smithi152.stdout:Filesystem 'cephfs' (1) 2023-12-06T15:03:43.725 INFO:teuthology.orchestra.run.smithi152.stdout:fs_name cephfs 2023-12-06T15:03:43.725 INFO:teuthology.orchestra.run.smithi152.stdout:epoch 17 2023-12-06T15:03:43.726 INFO:teuthology.orchestra.run.smithi152.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-06T15:03:43.726 INFO:teuthology.orchestra.run.smithi152.stdout:created 2023-12-06T14:57:59.352201+0000 2023-12-06T15:03:43.726 INFO:teuthology.orchestra.run.smithi152.stdout:modified 2023-12-06T15:03:21.575408+0000 2023-12-06T15:03:43.726 INFO:teuthology.orchestra.run.smithi152.stdout:tableserver 0 2023-12-06T15:03:43.726 INFO:teuthology.orchestra.run.smithi152.stdout:root 0 2023-12-06T15:03:43.726 INFO:teuthology.orchestra.run.smithi152.stdout:session_timeout 60 2023-12-06T15:03:43.726 INFO:teuthology.orchestra.run.smithi152.stdout:session_autoclose 300 2023-12-06T15:03:43.726 INFO:teuthology.orchestra.run.smithi152.stdout:max_file_size 1099511627776 2023-12-06T15:03:43.727 INFO:teuthology.orchestra.run.smithi152.stdout:max_xattr_size 65536 2023-12-06T15:03:43.727 INFO:teuthology.orchestra.run.smithi152.stdout:required_client_features {} 2023-12-06T15:03:43.727 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure 0 2023-12-06T15:03:43.727 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure_osd_epoch 0 2023-12-06T15:03:43.727 INFO:teuthology.orchestra.run.smithi152.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-06T15:03:43.727 INFO:teuthology.orchestra.run.smithi152.stdout:max_mds 2 2023-12-06T15:03:43.727 INFO:teuthology.orchestra.run.smithi152.stdout:in 0,1 2023-12-06T15:03:43.728 INFO:teuthology.orchestra.run.smithi152.stdout:up {0=14464,1=24255} 2023-12-06T15:03:43.728 INFO:teuthology.orchestra.run.smithi152.stdout:failed 2023-12-06T15:03:43.728 INFO:teuthology.orchestra.run.smithi152.stdout:damaged 2023-12-06T15:03:43.728 INFO:teuthology.orchestra.run.smithi152.stdout:stopped 2023-12-06T15:03:43.728 INFO:teuthology.orchestra.run.smithi152.stdout:data_pools [3] 2023-12-06T15:03:43.728 INFO:teuthology.orchestra.run.smithi152.stdout:metadata_pool 2 2023-12-06T15:03:43.728 INFO:teuthology.orchestra.run.smithi152.stdout:inline_data disabled 2023-12-06T15:03:43.729 INFO:teuthology.orchestra.run.smithi152.stdout:balancer 2023-12-06T15:03:43.729 INFO:teuthology.orchestra.run.smithi152.stdout:bal_rank_mask -1 2023-12-06T15:03:43.729 INFO:teuthology.orchestra.run.smithi152.stdout:standby_count_wanted 1 2023-12-06T15:03:43.729 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.acqswy{0:14464} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.152:6826/2467413186,v1:172.21.15.152:6827/2467413186] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:03:43.729 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi190.edwtqj{0:24271} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.190:6826/2256465065,v1:172.21.15.190:6827/2256465065] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:03:43.729 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi190.uucxzu{1:24255} state up:active seq 3 export targets 0 join_fscid=1 addr [v2:172.21.15.190:6824/3250692478,v1:172.21.15.190:6825/3250692478] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:03:43.730 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.ypivwc{1:14480} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.152:6828/697313573,v1:172.21.15.152:6829/697313573] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:03:43.730 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T15:03:43.730 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T15:03:43.731 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.726+0000 7f4fea0a0700 1 -- 172.21.15.152:0/310045245 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f4fcc06ce60 msgr2=0x7f4fcc06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:43.731 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.726+0000 7f4fea0a0700 1 --2- 172.21.15.152:0/310045245 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f4fcc06ce60 0x7f4fcc06f310 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8004f40 tx=0x7f4fd800b040 comp rx=0 tx=0).stop 2023-12-06T15:03:43.731 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.726+0000 7f4fea0a0700 1 -- 172.21.15.152:0/310045245 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fe40fbaf0 msgr2=0x7f4fe410c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:43.731 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.726+0000 7f4fea0a0700 1 --2- 172.21.15.152:0/310045245 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fe40fbaf0 0x7f4fe410c480 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4004f90 tx=0x7f4fd4009e30 comp rx=0 tx=0).stop 2023-12-06T15:03:43.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.726+0000 7f4fea0a0700 1 -- 172.21.15.152:0/310045245 shutdown_connections 2023-12-06T15:03:43.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.726+0000 7f4fea0a0700 1 --2- 172.21.15.152:0/310045245 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f4fcc06ce60 0x7f4fcc06f310 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:43.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.726+0000 7f4fea0a0700 1 --2- 172.21.15.152:0/310045245 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fe40fbaf0 0x7f4fe410c480 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:43.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.726+0000 7f4fea0a0700 1 --2- 172.21.15.152:0/310045245 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4fe40fcd00 0x7f4fe410c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:43.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.726+0000 7f4fea0a0700 1 -- 172.21.15.152:0/310045245 >> 172.21.15.152:0/310045245 conn(0x7f4fe40f7190 msgr2=0x7f4fe40fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:03:43.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.726+0000 7f4fea0a0700 1 -- 172.21.15.152:0/310045245 shutdown_connections 2023-12-06T15:03:43.733 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.726+0000 7f4fea0a0700 1 -- 172.21.15.152:0/310045245 wait complete. 2023-12-06T15:03:43.733 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 17 2023-12-06T15:03:43.829 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.828+0000 7ffa6e7f3700 1 -- 172.21.15.152:0/2039543095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa680fbb00 msgr2=0x7ffa680fbf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:43.829 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.828+0000 7ffa6e7f3700 1 --2- 172.21.15.152:0/2039543095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa680fbb00 0x7ffa680fbf10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ffa58004940 tx=0x7ffa58009e30 comp rx=0 tx=0).stop 2023-12-06T15:03:43.829 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.829+0000 7ffa6e7f3700 1 -- 172.21.15.152:0/2039543095 shutdown_connections 2023-12-06T15:03:43.829 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.829+0000 7ffa6e7f3700 1 --2- 172.21.15.152:0/2039543095 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa680fcd10 0x7ffa680fd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:43.829 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.829+0000 7ffa6e7f3700 1 --2- 172.21.15.152:0/2039543095 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa680fbb00 0x7ffa680fbf10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:43.829 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.829+0000 7ffa6e7f3700 1 -- 172.21.15.152:0/2039543095 >> 172.21.15.152:0/2039543095 conn(0x7ffa680f71c0 msgr2=0x7ffa680f95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:03:43.829 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.829+0000 7ffa6e7f3700 1 -- 172.21.15.152:0/2039543095 shutdown_connections 2023-12-06T15:03:43.830 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.829+0000 7ffa6e7f3700 1 -- 172.21.15.152:0/2039543095 wait complete. 2023-12-06T15:03:43.830 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.829+0000 7ffa6e7f3700 1 Processor -- start 2023-12-06T15:03:43.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.829+0000 7ffa6e7f3700 1 -- start start 2023-12-06T15:03:43.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.829+0000 7ffa6e7f3700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa680fbb00 0x7ffa68110270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:43.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.829+0000 7ffa6e7f3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa680fcd10 0x7ffa681127c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:43.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.829+0000 7ffa6e7f3700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa680669c0 con 0x7ffa680fcd10 2023-12-06T15:03:43.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.829+0000 7ffa6e7f3700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa68066b00 con 0x7ffa680fbb00 2023-12-06T15:03:43.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.830+0000 7ffa677fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa680fcd10 0x7ffa681127c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:43.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.830+0000 7ffa677fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa680fcd10 0x7ffa681127c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52518/0 (socket says 172.21.15.152:52518) 2023-12-06T15:03:43.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.830+0000 7ffa677fe700 1 -- 172.21.15.152:0/201971771 learned_addr learned my addr 172.21.15.152:0/201971771 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:03:43.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.830+0000 7ffa67fff700 1 --2- 172.21.15.152:0/201971771 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa680fbb00 0x7ffa68110270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:43.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.830+0000 7ffa677fe700 1 -- 172.21.15.152:0/201971771 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa680fbb00 msgr2=0x7ffa68110270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:43.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.830+0000 7ffa677fe700 1 --2- 172.21.15.152:0/201971771 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa680fbb00 0x7ffa68110270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:43.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.830+0000 7ffa677fe700 1 -- 172.21.15.152:0/201971771 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa58005040 con 0x7ffa680fcd10 2023-12-06T15:03:43.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.830+0000 7ffa677fe700 1 --2- 172.21.15.152:0/201971771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa680fcd10 0x7ffa681127c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ffa5000c8c0 tx=0x7ffa500044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:03:43.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.830+0000 7ffa64ff9700 1 -- 172.21.15.152:0/201971771 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa5000a760 con 0x7ffa680fcd10 2023-12-06T15:03:43.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.830+0000 7ffa64ff9700 1 -- 172.21.15.152:0/201971771 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffa5000ad70 con 0x7ffa680fcd10 2023-12-06T15:03:43.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.830+0000 7ffa6e7f3700 1 -- 172.21.15.152:0/201971771 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa68112e20 con 0x7ffa680fcd10 2023-12-06T15:03:43.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.830+0000 7ffa64ff9700 1 -- 172.21.15.152:0/201971771 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa500113a0 con 0x7ffa680fcd10 2023-12-06T15:03:43.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.830+0000 7ffa6e7f3700 1 -- 172.21.15.152:0/201971771 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa681132e0 con 0x7ffa680fcd10 2023-12-06T15:03:43.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.831+0000 7ffa6e7f3700 1 -- 172.21.15.152:0/201971771 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa681064e0 con 0x7ffa680fcd10 2023-12-06T15:03:43.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.832+0000 7ffa64ff9700 1 -- 172.21.15.152:0/201971771 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7ffa50012400 con 0x7ffa680fcd10 2023-12-06T15:03:43.833 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.832+0000 7ffa64ff9700 1 --2- 172.21.15.152:0/201971771 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7ffa5406ce60 0x7ffa5406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:43.834 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.832+0000 7ffa64ff9700 1 -- 172.21.15.152:0/201971771 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6675+0+0 (secure 0 0 0) 0x7ffa5008c400 con 0x7ffa680fcd10 2023-12-06T15:03:43.834 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.832+0000 7ffa67fff700 1 --2- 172.21.15.152:0/201971771 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7ffa5406ce60 0x7ffa5406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:43.834 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.832+0000 7ffa67fff700 1 --2- 172.21.15.152:0/201971771 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7ffa5406ce60 0x7ffa5406f310 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffa5800b7d0 tx=0x7ffa58009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:03:43.836 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:43.836+0000 7ffa64ff9700 1 -- 172.21.15.152:0/201971771 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ffa50056250 con 0x7ffa680fcd10 2023-12-06T15:03:44.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.043+0000 7ffa6e7f3700 1 -- 172.21.15.152:0/201971771 --> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa6802b1f0 con 0x7ffa5406ce60 2023-12-06T15:03:44.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.044+0000 7ffa64ff9700 1 -- 172.21.15.152:0/201971771 <== mgr.34104 v2:172.21.15.152:6800/2427836422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ffa6802b1f0 con 0x7ffa5406ce60 2023-12-06T15:03:44.044 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-12-06T15:03:44.044 INFO:teuthology.orchestra.run.smithi152.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e331a81036b9c4be9167bdaf54e458c7294ca3446212b9c6126786d23318b1cf", 2023-12-06T15:03:44.044 INFO:teuthology.orchestra.run.smithi152.stdout: "in_progress": true, 2023-12-06T15:03:44.044 INFO:teuthology.orchestra.run.smithi152.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-06T15:03:44.045 INFO:teuthology.orchestra.run.smithi152.stdout: "services_complete": [ 2023-12-06T15:03:44.045 INFO:teuthology.orchestra.run.smithi152.stdout: "crash", 2023-12-06T15:03:44.045 INFO:teuthology.orchestra.run.smithi152.stdout: "mon", 2023-12-06T15:03:44.045 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr" 2023-12-06T15:03:44.045 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2023-12-06T15:03:44.045 INFO:teuthology.orchestra.run.smithi152.stdout: "progress": "9/21 daemons upgraded", 2023-12-06T15:03:44.045 INFO:teuthology.orchestra.run.smithi152.stdout: "message": "Currently upgrading osd daemons", 2023-12-06T15:03:44.045 INFO:teuthology.orchestra.run.smithi152.stdout: "is_paused": false 2023-12-06T15:03:44.045 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-12-06T15:03:44.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.046+0000 7ffa6e7f3700 1 -- 172.21.15.152:0/201971771 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7ffa5406ce60 msgr2=0x7ffa5406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:44.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.046+0000 7ffa6e7f3700 1 --2- 172.21.15.152:0/201971771 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7ffa5406ce60 0x7ffa5406f310 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffa5800b7d0 tx=0x7ffa58009e30 comp rx=0 tx=0).stop 2023-12-06T15:03:44.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.046+0000 7ffa6e7f3700 1 -- 172.21.15.152:0/201971771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa680fcd10 msgr2=0x7ffa681127c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:44.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.046+0000 7ffa6e7f3700 1 --2- 172.21.15.152:0/201971771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa680fcd10 0x7ffa681127c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ffa5000c8c0 tx=0x7ffa500044c0 comp rx=0 tx=0).stop 2023-12-06T15:03:44.046 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.046+0000 7ffa6e7f3700 1 -- 172.21.15.152:0/201971771 shutdown_connections 2023-12-06T15:03:44.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.046+0000 7ffa6e7f3700 1 --2- 172.21.15.152:0/201971771 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7ffa5406ce60 0x7ffa5406f310 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:44.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.046+0000 7ffa6e7f3700 1 --2- 172.21.15.152:0/201971771 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa680fbb00 0x7ffa68110270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:44.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.046+0000 7ffa6e7f3700 1 --2- 172.21.15.152:0/201971771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa680fcd10 0x7ffa681127c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:44.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.046+0000 7ffa6e7f3700 1 -- 172.21.15.152:0/201971771 >> 172.21.15.152:0/201971771 conn(0x7ffa680f71c0 msgr2=0x7ffa680f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:03:44.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.046+0000 7ffa6e7f3700 1 -- 172.21.15.152:0/201971771 shutdown_connections 2023-12-06T15:03:44.047 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.046+0000 7ffa6e7f3700 1 -- 172.21.15.152:0/201971771 wait complete. 2023-12-06T15:03:44.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:43 smithi190 ceph-mon[178398]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:03:44.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:43 smithi190 ceph-mon[178398]: from='client.? 172.21.15.152:0/380865500' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:03:44.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:43 smithi190 ceph-mon[178398]: from='client.? 172.21.15.152:0/310045245' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-06T15:03:44.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:43 smithi152 ceph-mon[192652]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:03:44.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:43 smithi152 ceph-mon[192652]: from='client.? 172.21.15.152:0/380865500' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:03:44.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:43 smithi152 ceph-mon[192652]: from='client.? 172.21.15.152:0/310045245' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-06T15:03:44.147 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.146+0000 7f553259f700 1 -- 172.21.15.152:0/2452915426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f552c0fcd00 msgr2=0x7f552c0fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:44.147 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.146+0000 7f553259f700 1 --2- 172.21.15.152:0/2452915426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f552c0fcd00 0x7f552c0fd150 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5520004940 tx=0x7f5520009e30 comp rx=0 tx=0).stop 2023-12-06T15:03:44.147 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.146+0000 7f553259f700 1 -- 172.21.15.152:0/2452915426 shutdown_connections 2023-12-06T15:03:44.147 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.146+0000 7f553259f700 1 --2- 172.21.15.152:0/2452915426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f552c0fcd00 0x7f552c0fd150 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:44.147 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.146+0000 7f553259f700 1 --2- 172.21.15.152:0/2452915426 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f552c0fbaf0 0x7f552c0fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:44.148 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.146+0000 7f553259f700 1 -- 172.21.15.152:0/2452915426 >> 172.21.15.152:0/2452915426 conn(0x7f552c0f7190 msgr2=0x7f552c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:03:44.148 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.146+0000 7f553259f700 1 -- 172.21.15.152:0/2452915426 shutdown_connections 2023-12-06T15:03:44.148 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.146+0000 7f553259f700 1 -- 172.21.15.152:0/2452915426 wait complete. 2023-12-06T15:03:44.148 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.146+0000 7f553259f700 1 Processor -- start 2023-12-06T15:03:44.148 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.147+0000 7f553259f700 1 -- start start 2023-12-06T15:03:44.148 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.147+0000 7f553259f700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f552c0fbaf0 0x7f552c110270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:44.148 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.147+0000 7f553259f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f552c0fcd00 0x7f552c1127c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:44.148 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.147+0000 7f553259f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552c066130 con 0x7f552c0fcd00 2023-12-06T15:03:44.148 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.147+0000 7f553259f700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552c066270 con 0x7f552c0fbaf0 2023-12-06T15:03:44.148 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.147+0000 7f552b7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f552c0fcd00 0x7f552c1127c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:44.148 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.147+0000 7f552b7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f552c0fcd00 0x7f552c1127c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52542/0 (socket says 172.21.15.152:52542) 2023-12-06T15:03:44.148 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.147+0000 7f552b7fe700 1 -- 172.21.15.152:0/3104869128 learned_addr learned my addr 172.21.15.152:0/3104869128 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:03:44.148 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.147+0000 7f552bfff700 1 --2- 172.21.15.152:0/3104869128 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f552c0fbaf0 0x7f552c110270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:44.148 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.147+0000 7f552b7fe700 1 -- 172.21.15.152:0/3104869128 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f552c0fbaf0 msgr2=0x7f552c110270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:44.149 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.147+0000 7f552b7fe700 1 --2- 172.21.15.152:0/3104869128 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f552c0fbaf0 0x7f552c110270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:44.149 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.147+0000 7f552b7fe700 1 -- 172.21.15.152:0/3104869128 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5520005040 con 0x7f552c0fcd00 2023-12-06T15:03:44.149 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.147+0000 7f552b7fe700 1 --2- 172.21.15.152:0/3104869128 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f552c0fcd00 0x7f552c1127c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5520009fd0 tx=0x7f5520009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:03:44.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.147+0000 7f5528ff9700 1 -- 172.21.15.152:0/3104869128 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f552000e040 con 0x7f552c0fcd00 2023-12-06T15:03:44.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.148+0000 7f5528ff9700 1 -- 172.21.15.152:0/3104869128 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5520004290 con 0x7f552c0fcd00 2023-12-06T15:03:44.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.148+0000 7f553259f700 1 -- 172.21.15.152:0/3104869128 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f552c112dc0 con 0x7f552c0fcd00 2023-12-06T15:03:44.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.148+0000 7f5528ff9700 1 -- 172.21.15.152:0/3104869128 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f552001c3f0 con 0x7f552c0fcd00 2023-12-06T15:03:44.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.148+0000 7f553259f700 1 -- 172.21.15.152:0/3104869128 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f552c1132b0 con 0x7f552c0fcd00 2023-12-06T15:03:44.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.149+0000 7f553259f700 1 -- 172.21.15.152:0/3104869128 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f552c04bb80 con 0x7f552c0fcd00 2023-12-06T15:03:44.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.149+0000 7f5528ff9700 1 -- 172.21.15.152:0/3104869128 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f5520013420 con 0x7f552c0fcd00 2023-12-06T15:03:44.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.149+0000 7f5528ff9700 1 --2- 172.21.15.152:0/3104869128 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f551406ce70 0x7f551406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:03:44.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.150+0000 7f5528ff9700 1 -- 172.21.15.152:0/3104869128 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f552008d870 con 0x7f552c0fcd00 2023-12-06T15:03:44.150 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.150+0000 7f552bfff700 1 --2- 172.21.15.152:0/3104869128 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f551406ce70 0x7f551406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:03:44.151 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.150+0000 7f552bfff700 1 --2- 172.21.15.152:0/3104869128 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f551406ce70 0x7f551406f320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f551c009fd0 tx=0x7f551c009f00 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:03:44.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.154+0000 7f5528ff9700 1 -- 172.21.15.152:0/3104869128 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f5520057640 con 0x7f552c0fcd00 2023-12-06T15:03:44.421 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.420+0000 7f553259f700 1 -- 172.21.15.152:0/3104869128 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f552c104490 con 0x7f552c0fcd00 2023-12-06T15:03:44.421 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.421+0000 7f5528ff9700 1 -- 172.21.15.152:0/3104869128 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f552005ac60 con 0x7f552c0fcd00 2023-12-06T15:03:44.421 INFO:teuthology.orchestra.run.smithi152.stdout:HEALTH_OK 2023-12-06T15:03:44.423 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.423+0000 7f553259f700 1 -- 172.21.15.152:0/3104869128 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f551406ce70 msgr2=0x7f551406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:44.423 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.423+0000 7f553259f700 1 --2- 172.21.15.152:0/3104869128 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f551406ce70 0x7f551406f320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f551c009fd0 tx=0x7f551c009f00 comp rx=0 tx=0).stop 2023-12-06T15:03:44.423 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.423+0000 7f553259f700 1 -- 172.21.15.152:0/3104869128 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f552c0fcd00 msgr2=0x7f552c1127c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:03:44.423 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.423+0000 7f553259f700 1 --2- 172.21.15.152:0/3104869128 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f552c0fcd00 0x7f552c1127c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5520009fd0 tx=0x7f5520009e30 comp rx=0 tx=0).stop 2023-12-06T15:03:44.423 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.423+0000 7f553259f700 1 -- 172.21.15.152:0/3104869128 shutdown_connections 2023-12-06T15:03:44.423 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.423+0000 7f553259f700 1 --2- 172.21.15.152:0/3104869128 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f551406ce70 0x7f551406f320 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:44.423 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.423+0000 7f553259f700 1 --2- 172.21.15.152:0/3104869128 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f552c0fbaf0 0x7f552c110270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:44.424 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.423+0000 7f553259f700 1 --2- 172.21.15.152:0/3104869128 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f552c0fcd00 0x7f552c1127c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:03:44.424 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.423+0000 7f553259f700 1 -- 172.21.15.152:0/3104869128 >> 172.21.15.152:0/3104869128 conn(0x7f552c0f7190 msgr2=0x7f552c0fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:03:44.424 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.423+0000 7f553259f700 1 -- 172.21.15.152:0/3104869128 shutdown_connections 2023-12-06T15:03:44.424 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:03:44.423+0000 7f553259f700 1 -- 172.21.15.152:0/3104869128 wait complete. 2023-12-06T15:03:45.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:44 smithi190 ceph-mon[178398]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:03:45.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:44 smithi190 ceph-mon[178398]: from='client.? 172.21.15.152:0/3104869128' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-06T15:03:45.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:44 smithi190 ceph-mon[178398]: pgmap v96: 65 pgs: 65 active+clean; 290 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 946 B/s rd, 1 op/s 2023-12-06T15:03:45.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:44 smithi152 ceph-mon[192652]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:03:45.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:44 smithi152 ceph-mon[192652]: from='client.? 172.21.15.152:0/3104869128' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-06T15:03:45.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:44 smithi152 ceph-mon[192652]: pgmap v96: 65 pgs: 65 active+clean; 290 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 946 B/s rd, 1 op/s 2023-12-06T15:03:47.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:46 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:47.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:46 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:03:47.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:46 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:47.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:46 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:03:48.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:47 smithi190 ceph-mon[178398]: pgmap v97: 65 pgs: 65 active+clean; 290 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2023-12-06T15:03:48.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:47 smithi152 ceph-mon[192652]: pgmap v97: 65 pgs: 65 active+clean; 290 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2023-12-06T15:03:50.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:49 smithi190 ceph-mon[178398]: pgmap v98: 65 pgs: 65 active+clean; 290 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:03:50.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:49 smithi190 ceph-mon[178398]: fsmap cephfs:2 {0=cephfs.smithi152.acqswy=up:active,1=cephfs.smithi190.uucxzu=up:active} 2 up:standby-replay 2023-12-06T15:03:50.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:49 smithi152 ceph-mon[192652]: pgmap v98: 65 pgs: 65 active+clean; 290 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:03:50.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:49 smithi152 ceph-mon[192652]: fsmap cephfs:2 {0=cephfs.smithi152.acqswy=up:active,1=cephfs.smithi190.uucxzu=up:active} 2 up:standby-replay 2023-12-06T15:03:52.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:51 smithi190 ceph-mon[178398]: pgmap v99: 65 pgs: 65 active+clean; 290 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2023-12-06T15:03:52.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:51 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:52.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:51 smithi152 ceph-mon[192652]: pgmap v99: 65 pgs: 65 active+clean; 290 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2023-12-06T15:03:52.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:51 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:53.967 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:53 smithi190 ceph-mon[178398]: pgmap v100: 65 pgs: 65 active+clean; 290 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2023-12-06T15:03:53.967 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:53 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-06T15:03:54.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:53 smithi152 ceph-mon[192652]: pgmap v100: 65 pgs: 65 active+clean; 290 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2023-12-06T15:03:54.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:53 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-06T15:03:54.966 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:54 smithi190 ceph-mon[178398]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-06T15:03:54.966 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:54 smithi190 ceph-mon[178398]: Upgrade: osd.3 is safe to restart 2023-12-06T15:03:54.966 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:54 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:54.966 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:54 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-06T15:03:54.966 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:54 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:03:55.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:54 smithi152 ceph-mon[192652]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2023-12-06T15:03:55.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:54 smithi152 ceph-mon[192652]: Upgrade: osd.3 is safe to restart 2023-12-06T15:03:55.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:54 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:03:55.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:54 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-06T15:03:55.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:54 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:03:56.007 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:55 smithi190 ceph-mon[178398]: Upgrade: Updating osd.3 2023-12-06T15:03:56.007 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:55 smithi190 ceph-mon[178398]: Deploying daemon osd.3 on smithi190 2023-12-06T15:03:56.007 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:55 smithi190 ceph-mon[178398]: pgmap v101: 65 pgs: 65 active+clean; 290 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:03:56.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:55 smithi152 ceph-mon[192652]: Upgrade: Updating osd.3 2023-12-06T15:03:56.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:55 smithi152 ceph-mon[192652]: Deploying daemon osd.3 on smithi190 2023-12-06T15:03:56.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:55 smithi152 ceph-mon[192652]: pgmap v101: 65 pgs: 65 active+clean; 290 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:03:57.048 INFO:journalctl@ceph.osd.3.smithi190.stdout:Dec 06 15:03:56 smithi190 systemd[1]: Stopping Ceph osd.3 for 062f0e3c-9447-11ee-95a2-87774f69a715... 2023-12-06T15:03:57.048 INFO:journalctl@ceph.osd.3.smithi190.stdout:Dec 06 15:03:56 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-3[127701]: 2023-12-06T15:03:56.830+0000 7f84a3a0f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-06T15:03:57.049 INFO:journalctl@ceph.osd.3.smithi190.stdout:Dec 06 15:03:56 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-3[127701]: 2023-12-06T15:03:56.830+0000 7f84a3a0f700 -1 osd.3 74 *** Got signal Terminated *** 2023-12-06T15:03:57.049 INFO:journalctl@ceph.osd.3.smithi190.stdout:Dec 06 15:03:56 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-3[127701]: 2023-12-06T15:03:56.830+0000 7f84a3a0f700 -1 osd.3 74 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-06T15:03:57.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:57 smithi190 ceph-mon[178398]: pgmap v102: 65 pgs: 65 active+clean; 290 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:03:57.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:57 smithi190 ceph-mon[178398]: osd.3 marked itself down and dead 2023-12-06T15:03:57.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:57 smithi152 ceph-mon[192652]: pgmap v102: 65 pgs: 65 active+clean; 290 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:03:57.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:57 smithi152 ceph-mon[192652]: osd.3 marked itself down and dead 2023-12-06T15:03:57.822 INFO:journalctl@ceph.osd.3.smithi190.stdout:Dec 06 15:03:57 smithi190 bash[190266]: ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-3 2023-12-06T15:03:58.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:58 smithi190 ceph-mon[178398]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-06T15:03:58.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:58 smithi190 ceph-mon[178398]: failed to encode map e75 with expected crc 2023-12-06T15:03:58.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:58 smithi190 ceph-mon[178398]: failed to encode map e75 with expected crc 2023-12-06T15:03:58.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:58 smithi190 ceph-mon[178398]: osdmap e75: 6 total, 5 up, 6 in 2023-12-06T15:03:58.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:58 smithi190 ceph-mon[178398]: failed to encode map e75 with expected crc 2023-12-06T15:03:58.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:58 smithi152 ceph-mon[192652]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-06T15:03:58.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:58 smithi152 ceph-mon[192652]: failed to encode map e75 with expected crc 2023-12-06T15:03:58.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:58 smithi152 ceph-mon[192652]: failed to encode map e75 with expected crc 2023-12-06T15:03:58.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:58 smithi152 ceph-mon[192652]: osdmap e75: 6 total, 5 up, 6 in 2023-12-06T15:03:58.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:58 smithi152 ceph-mon[192652]: failed to encode map e75 with expected crc 2023-12-06T15:03:59.060 INFO:journalctl@ceph.osd.3.smithi190.stdout:Dec 06 15:03:58 smithi190 systemd[1]: ceph-062f0e3c-9447-11ee-95a2-87774f69a715@osd.3.service: Succeeded. 2023-12-06T15:03:59.060 INFO:journalctl@ceph.osd.3.smithi190.stdout:Dec 06 15:03:58 smithi190 systemd[1]: Stopped Ceph osd.3 for 062f0e3c-9447-11ee-95a2-87774f69a715. 2023-12-06T15:03:59.060 INFO:journalctl@ceph.osd.3.smithi190.stdout:Dec 06 15:03:58 smithi190 systemd[1]: Starting Ceph osd.3 for 062f0e3c-9447-11ee-95a2-87774f69a715... 2023-12-06T15:03:59.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:59 smithi190 ceph-mon[178398]: osdmap e76: 6 total, 5 up, 6 in 2023-12-06T15:03:59.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:59 smithi190 ceph-mon[178398]: failed to encode map e76 with expected crc 2023-12-06T15:03:59.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:59 smithi190 ceph-mon[178398]: failed to encode map e76 with expected crc 2023-12-06T15:03:59.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:59 smithi190 ceph-mon[178398]: failed to encode map e76 with expected crc 2023-12-06T15:03:59.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:59 smithi190 ceph-mon[178398]: failed to encode map e76 with expected crc 2023-12-06T15:03:59.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:03:59 smithi190 ceph-mon[178398]: pgmap v105: 65 pgs: 2 active+undersized, 6 active+undersized+degraded, 11 peering, 7 stale+active+clean, 39 active+clean; 290 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 20/348 objects degraded (5.747%) 2023-12-06T15:03:59.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:59 smithi152 ceph-mon[192652]: osdmap e76: 6 total, 5 up, 6 in 2023-12-06T15:03:59.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:59 smithi152 ceph-mon[192652]: failed to encode map e76 with expected crc 2023-12-06T15:03:59.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:59 smithi152 ceph-mon[192652]: failed to encode map e76 with expected crc 2023-12-06T15:03:59.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:59 smithi152 ceph-mon[192652]: failed to encode map e76 with expected crc 2023-12-06T15:03:59.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:59 smithi152 ceph-mon[192652]: failed to encode map e76 with expected crc 2023-12-06T15:03:59.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:03:59 smithi152 ceph-mon[192652]: pgmap v105: 65 pgs: 2 active+undersized, 6 active+undersized+degraded, 11 peering, 7 stale+active+clean, 39 active+clean; 290 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 20/348 objects degraded (5.747%) 2023-12-06T15:04:00.061 INFO:journalctl@ceph.osd.3.smithi190.stdout:Dec 06 15:03:59 smithi190 bash[190533]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-06T15:04:00.061 INFO:journalctl@ceph.osd.3.smithi190.stdout:Dec 06 15:03:59 smithi190 bash[190533]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2023-12-06T15:04:00.061 INFO:journalctl@ceph.osd.3.smithi190.stdout:Dec 06 15:03:59 smithi190 bash[190533]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2023-12-06T15:04:00.062 INFO:journalctl@ceph.osd.3.smithi190.stdout:Dec 06 15:03:59 smithi190 bash[190533]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2023-12-06T15:04:00.062 INFO:journalctl@ceph.osd.3.smithi190.stdout:Dec 06 15:03:59 smithi190 bash[190533]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2023-12-06T15:04:00.062 INFO:journalctl@ceph.osd.3.smithi190.stdout:Dec 06 15:03:59 smithi190 bash[190533]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-06T15:04:00.062 INFO:journalctl@ceph.osd.3.smithi190.stdout:Dec 06 15:03:59 smithi190 bash[190533]: --> ceph-volume raw activate successful for osd ID: 3 2023-12-06T15:04:00.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:00 smithi190 ceph-mon[178398]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2023-12-06T15:04:00.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:00 smithi190 ceph-mon[178398]: Health check failed: Degraded data redundancy: 20/348 objects degraded (5.747%), 6 pgs degraded (PG_DEGRADED) 2023-12-06T15:04:00.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:00 smithi152 ceph-mon[192652]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2023-12-06T15:04:00.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:00 smithi152 ceph-mon[192652]: Health check failed: Degraded data redundancy: 20/348 objects degraded (5.747%), 6 pgs degraded (PG_DEGRADED) 2023-12-06T15:04:00.822 INFO:journalctl@ceph.osd.3.smithi190.stdout:Dec 06 15:04:00 smithi190 ceph-osd[190853]: -- 172.21.15.190:0/2449575896 <== mon.1 v2:172.21.15.190:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ac930ef1e0 con 0x55ac930bec00 2023-12-06T15:04:00.823 INFO:journalctl@ceph.osd.3.smithi190.stdout:Dec 06 15:04:00 smithi190 bash[190815]: 9871106e0a4ff9d3067d51753f01d8652f7b2342a55e92e394f1667271d319b3 2023-12-06T15:04:00.823 INFO:journalctl@ceph.osd.3.smithi190.stdout:Dec 06 15:04:00 smithi190 systemd[1]: Started Ceph osd.3 for 062f0e3c-9447-11ee-95a2-87774f69a715. 2023-12-06T15:04:01.322 INFO:journalctl@ceph.osd.3.smithi190.stdout:Dec 06 15:04:00 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-3[190830]: 2023-12-06T15:04:00.852+0000 7fa10febf640 -1 Falling back to public interface 2023-12-06T15:04:01.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:01.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:01.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:04:01.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:01 smithi190 ceph-mon[178398]: pgmap v106: 65 pgs: 2 active+undersized, 6 active+undersized+degraded, 11 peering, 7 stale+active+clean, 39 active+clean; 290 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 20/348 objects degraded (5.747%) 2023-12-06T15:04:01.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:01.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:04:01.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:01.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:01.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:01.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:01.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:04:01.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:01 smithi152 ceph-mon[192652]: pgmap v106: 65 pgs: 2 active+undersized, 6 active+undersized+degraded, 11 peering, 7 stale+active+clean, 39 active+clean; 290 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 20/348 objects degraded (5.747%) 2023-12-06T15:04:01.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:01.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:04:01.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:01.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:03.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:03 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:03.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:03 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:03.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:03 smithi190 ceph-mon[178398]: pgmap v107: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 290 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 60/348 objects degraded (17.241%) 2023-12-06T15:04:03.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:03 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:03.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:03 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:03.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:03 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:03.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:03 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:03.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:03 smithi152 ceph-mon[192652]: pgmap v107: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 290 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 60/348 objects degraded (17.241%) 2023-12-06T15:04:03.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:03 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:03.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:03 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:04.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:04 smithi190 ceph-mon[178398]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2023-12-06T15:04:04.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:04 smithi152 ceph-mon[192652]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2023-12-06T15:04:05.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:05 smithi190 ceph-mon[178398]: pgmap v108: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 290 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 60/348 objects degraded (17.241%) 2023-12-06T15:04:05.572 INFO:journalctl@ceph.osd.3.smithi190.stdout:Dec 06 15:04:05 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-3[190830]: 2023-12-06T15:04:05.429+0000 7fa10febf640 -1 osd.3 0 read_superblock omap replica is missing. 2023-12-06T15:04:05.593 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:05 smithi152 ceph-mon[192652]: pgmap v108: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 290 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 60/348 objects degraded (17.241%) 2023-12-06T15:04:06.322 INFO:journalctl@ceph.osd.3.smithi190.stdout:Dec 06 15:04:05 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-3[190830]: 2023-12-06T15:04:05.901+0000 7fa10febf640 -1 osd.3 74 log_to_monitors true 2023-12-06T15:04:06.822 INFO:journalctl@ceph.osd.3.smithi190.stdout:Dec 06 15:04:06 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-3[190830]: 2023-12-06T15:04:06.471+0000 7fa0fd328700 -1 osd.3 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-06T15:04:06.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:06 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:06.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:06 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:06.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:06 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:04:06.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:06 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T15:04:06.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:06 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:06.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:06 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:04:06.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:06 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:04:06.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:06 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:04:06.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:06 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:04:06.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:06 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-06T15:04:06.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:06 smithi190 ceph-mon[178398]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-06T15:04:06.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:06 smithi190 ceph-mon[178398]: Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2023-12-06T15:04:06.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:06 smithi190 ceph-mon[178398]: from='osd.3 [v2:172.21.15.190:6800/1202145658,v1:172.21.15.190:6801/1202145658]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-06T15:04:06.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:06 smithi190 ceph-mon[178398]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-06T15:04:06.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:06 smithi190 ceph-mon[178398]: Health check update: Degraded data redundancy: 60/348 objects degraded (17.241%), 16 pgs degraded (PG_DEGRADED) 2023-12-06T15:04:06.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:06 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:06.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:06 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:06.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:06 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:04:06.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:06 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T15:04:06.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:06 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:06.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:06 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:04:06.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:06 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:04:06.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:06 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:04:06.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:06 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:04:06.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:06 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-06T15:04:06.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:06 smithi152 ceph-mon[192652]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-06T15:04:06.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:06 smithi152 ceph-mon[192652]: Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2023-12-06T15:04:06.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:06 smithi152 ceph-mon[192652]: from='osd.3 [v2:172.21.15.190:6800/1202145658,v1:172.21.15.190:6801/1202145658]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-06T15:04:06.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:06 smithi152 ceph-mon[192652]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-06T15:04:06.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:06 smithi152 ceph-mon[192652]: Health check update: Degraded data redundancy: 60/348 objects degraded (17.241%), 16 pgs degraded (PG_DEGRADED) 2023-12-06T15:04:07.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:07 smithi190 ceph-mon[178398]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-06T15:04:07.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:07 smithi190 ceph-mon[178398]: from='osd.3 [v2:172.21.15.190:6800/1202145658,v1:172.21.15.190:6801/1202145658]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-12-06T15:04:07.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:07 smithi190 ceph-mon[178398]: osdmap e77: 6 total, 5 up, 6 in 2023-12-06T15:04:07.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:07 smithi190 ceph-mon[178398]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-12-06T15:04:07.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:07 smithi190 ceph-mon[178398]: pgmap v110: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 290 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 60/348 objects degraded (17.241%) 2023-12-06T15:04:07.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:07 smithi190 ceph-mon[178398]: failed to encode map e77 with expected crc 2023-12-06T15:04:07.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:07 smithi152 ceph-mon[192652]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-06T15:04:07.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:07 smithi152 ceph-mon[192652]: from='osd.3 [v2:172.21.15.190:6800/1202145658,v1:172.21.15.190:6801/1202145658]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-12-06T15:04:07.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:07 smithi152 ceph-mon[192652]: osdmap e77: 6 total, 5 up, 6 in 2023-12-06T15:04:07.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:07 smithi152 ceph-mon[192652]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-12-06T15:04:07.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:07 smithi152 ceph-mon[192652]: pgmap v110: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 290 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 60/348 objects degraded (17.241%) 2023-12-06T15:04:07.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:07 smithi152 ceph-mon[192652]: failed to encode map e77 with expected crc 2023-12-06T15:04:08.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:08 smithi190 ceph-mon[178398]: failed to encode map e77 with expected crc 2023-12-06T15:04:08.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:08 smithi190 ceph-mon[178398]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-06T15:04:08.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:08 smithi190 ceph-mon[178398]: failed to encode map e78 with expected crc 2023-12-06T15:04:08.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:08 smithi190 ceph-mon[178398]: osd.3 [v2:172.21.15.190:6800/1202145658,v1:172.21.15.190:6801/1202145658] boot 2023-12-06T15:04:08.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:08 smithi190 ceph-mon[178398]: osdmap e78: 6 total, 6 up, 6 in 2023-12-06T15:04:08.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:08 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-06T15:04:08.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:08 smithi190 ceph-mon[178398]: failed to encode map e78 with expected crc 2023-12-06T15:04:08.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:08 smithi190 ceph-mon[178398]: failed to encode map e78 with expected crc 2023-12-06T15:04:08.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:08 smithi152 ceph-mon[192652]: failed to encode map e77 with expected crc 2023-12-06T15:04:08.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:08 smithi152 ceph-mon[192652]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-06T15:04:08.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:08 smithi152 ceph-mon[192652]: failed to encode map e78 with expected crc 2023-12-06T15:04:08.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:08 smithi152 ceph-mon[192652]: osd.3 [v2:172.21.15.190:6800/1202145658,v1:172.21.15.190:6801/1202145658] boot 2023-12-06T15:04:08.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:08 smithi152 ceph-mon[192652]: osdmap e78: 6 total, 6 up, 6 in 2023-12-06T15:04:08.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:08 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-06T15:04:08.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:08 smithi152 ceph-mon[192652]: failed to encode map e78 with expected crc 2023-12-06T15:04:08.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:08 smithi152 ceph-mon[192652]: failed to encode map e78 with expected crc 2023-12-06T15:04:09.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:09 smithi190 ceph-mon[178398]: failed to encode map e79 with expected crc 2023-12-06T15:04:09.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:09 smithi190 ceph-mon[178398]: osdmap e79: 6 total, 6 up, 6 in 2023-12-06T15:04:09.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:09 smithi190 ceph-mon[178398]: failed to encode map e79 with expected crc 2023-12-06T15:04:09.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:09 smithi190 ceph-mon[178398]: failed to encode map e79 with expected crc 2023-12-06T15:04:09.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:09 smithi190 ceph-mon[178398]: failed to encode map e79 with expected crc 2023-12-06T15:04:09.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:09 smithi190 ceph-mon[178398]: failed to encode map e79 with expected crc 2023-12-06T15:04:09.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:09 smithi190 ceph-mon[178398]: pgmap v113: 65 pgs: 11 peering, 11 active+undersized, 11 active+undersized+degraded, 32 active+clean; 290 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 44/348 objects degraded (12.644%) 2023-12-06T15:04:09.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:09 smithi152 ceph-mon[192652]: failed to encode map e79 with expected crc 2023-12-06T15:04:09.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:09 smithi152 ceph-mon[192652]: osdmap e79: 6 total, 6 up, 6 in 2023-12-06T15:04:09.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:09 smithi152 ceph-mon[192652]: failed to encode map e79 with expected crc 2023-12-06T15:04:09.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:09 smithi152 ceph-mon[192652]: failed to encode map e79 with expected crc 2023-12-06T15:04:09.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:09 smithi152 ceph-mon[192652]: failed to encode map e79 with expected crc 2023-12-06T15:04:09.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:09 smithi152 ceph-mon[192652]: failed to encode map e79 with expected crc 2023-12-06T15:04:09.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:09 smithi152 ceph-mon[192652]: pgmap v113: 65 pgs: 11 peering, 11 active+undersized, 11 active+undersized+degraded, 32 active+clean; 290 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 44/348 objects degraded (12.644%) 2023-12-06T15:04:12.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:11 smithi190 ceph-mon[178398]: pgmap v114: 65 pgs: 11 peering, 11 active+undersized, 11 active+undersized+degraded, 32 active+clean; 290 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 44/348 objects degraded (12.644%) 2023-12-06T15:04:12.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:11 smithi190 ceph-mon[178398]: Health check update: Degraded data redundancy: 44/348 objects degraded (12.644%), 11 pgs degraded (PG_DEGRADED) 2023-12-06T15:04:12.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:11 smithi152 ceph-mon[192652]: pgmap v114: 65 pgs: 11 peering, 11 active+undersized, 11 active+undersized+degraded, 32 active+clean; 290 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 44/348 objects degraded (12.644%) 2023-12-06T15:04:12.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:11 smithi152 ceph-mon[192652]: Health check update: Degraded data redundancy: 44/348 objects degraded (12.644%), 11 pgs degraded (PG_DEGRADED) 2023-12-06T15:04:13.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:12 smithi190 ceph-mon[178398]: pgmap v115: 65 pgs: 6 peering, 59 active+clean; 290 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.9 KiB/s rd, 6 op/s 2023-12-06T15:04:13.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:12 smithi190 ceph-mon[178398]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 44/348 objects degraded (12.644%), 11 pgs degraded) 2023-12-06T15:04:13.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:12 smithi190 ceph-mon[178398]: Cluster is now healthy 2023-12-06T15:04:13.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:12 smithi152 ceph-mon[192652]: pgmap v115: 65 pgs: 6 peering, 59 active+clean; 290 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.9 KiB/s rd, 6 op/s 2023-12-06T15:04:13.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:12 smithi152 ceph-mon[192652]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 44/348 objects degraded (12.644%), 11 pgs degraded) 2023-12-06T15:04:13.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:12 smithi152 ceph-mon[192652]: Cluster is now healthy 2023-12-06T15:04:14.540 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.538+0000 7fd488801700 1 -- 172.21.15.152:0/1232523073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4840ffb70 msgr2=0x7fd484101fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:14.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.538+0000 7fd488801700 1 --2- 172.21.15.152:0/1232523073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4840ffb70 0x7fd484101fd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd478004940 tx=0x7fd478009e30 comp rx=0 tx=0).stop 2023-12-06T15:04:14.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.538+0000 7fd488801700 1 -- 172.21.15.152:0/1232523073 shutdown_connections 2023-12-06T15:04:14.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.538+0000 7fd488801700 1 --2- 172.21.15.152:0/1232523073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4840ffb70 0x7fd484101fd0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:14.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.538+0000 7fd488801700 1 --2- 172.21.15.152:0/1232523073 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd484066090 0x7fd4840ff5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:14.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.538+0000 7fd488801700 1 -- 172.21.15.152:0/1232523073 >> 172.21.15.152:0/1232523073 conn(0x7fd4840f6f70 msgr2=0x7fd4840f93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:04:14.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.539+0000 7fd488801700 1 -- 172.21.15.152:0/1232523073 shutdown_connections 2023-12-06T15:04:14.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.539+0000 7fd488801700 1 -- 172.21.15.152:0/1232523073 wait complete. 2023-12-06T15:04:14.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.539+0000 7fd488801700 1 Processor -- start 2023-12-06T15:04:14.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.539+0000 7fd488801700 1 -- start start 2023-12-06T15:04:14.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.539+0000 7fd488801700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd484066090 0x7fd48410d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:14.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.539+0000 7fd488801700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd4840ffb70 0x7fd48410d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:14.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.539+0000 7fd488801700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48410de20 con 0x7fd484066090 2023-12-06T15:04:14.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.539+0000 7fd488801700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48410e6c0 con 0x7fd4840ffb70 2023-12-06T15:04:14.541 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.540+0000 7fd482d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd484066090 0x7fd48410d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:14.542 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.540+0000 7fd482d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd484066090 0x7fd48410d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32804/0 (socket says 172.21.15.152:32804) 2023-12-06T15:04:14.542 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.540+0000 7fd482d9d700 1 -- 172.21.15.152:0/2476790665 learned_addr learned my addr 172.21.15.152:0/2476790665 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:04:14.542 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.540+0000 7fd48259c700 1 --2- 172.21.15.152:0/2476790665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd4840ffb70 0x7fd48410d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:14.542 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.540+0000 7fd482d9d700 1 -- 172.21.15.152:0/2476790665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd4840ffb70 msgr2=0x7fd48410d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:14.542 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.540+0000 7fd482d9d700 1 --2- 172.21.15.152:0/2476790665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd4840ffb70 0x7fd48410d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:14.542 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.540+0000 7fd482d9d700 1 -- 172.21.15.152:0/2476790665 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd478005040 con 0x7fd484066090 2023-12-06T15:04:14.542 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.540+0000 7fd482d9d700 1 --2- 172.21.15.152:0/2476790665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd484066090 0x7fd48410d2e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd47400c8c0 tx=0x7fd4740044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:04:14.542 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.540+0000 7fd46b7fe700 1 -- 172.21.15.152:0/2476790665 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd47400a760 con 0x7fd484066090 2023-12-06T15:04:14.542 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.540+0000 7fd46b7fe700 1 -- 172.21.15.152:0/2476790665 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd47400ad70 con 0x7fd484066090 2023-12-06T15:04:14.542 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.540+0000 7fd488801700 1 -- 172.21.15.152:0/2476790665 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd48410e9a0 con 0x7fd484066090 2023-12-06T15:04:14.542 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.540+0000 7fd46b7fe700 1 -- 172.21.15.152:0/2476790665 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4740113a0 con 0x7fd484066090 2023-12-06T15:04:14.542 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.540+0000 7fd488801700 1 -- 172.21.15.152:0/2476790665 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd48410eee0 con 0x7fd484066090 2023-12-06T15:04:14.543 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.541+0000 7fd488801700 1 -- 172.21.15.152:0/2476790665 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd48404bb80 con 0x7fd484066090 2023-12-06T15:04:14.543 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.542+0000 7fd46b7fe700 1 -- 172.21.15.152:0/2476790665 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fd474012400 con 0x7fd484066090 2023-12-06T15:04:14.543 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.542+0000 7fd46b7fe700 1 --2- 172.21.15.152:0/2476790665 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fd46c06ce60 0x7fd46c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:14.543 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.542+0000 7fd46b7fe700 1 -- 172.21.15.152:0/2476790665 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6675+0+0 (secure 0 0 0) 0x7fd47408c420 con 0x7fd484066090 2023-12-06T15:04:14.543 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.542+0000 7fd48259c700 1 --2- 172.21.15.152:0/2476790665 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fd46c06ce60 0x7fd46c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:14.544 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.543+0000 7fd48259c700 1 --2- 172.21.15.152:0/2476790665 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fd46c06ce60 0x7fd46c06f310 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd478004890 tx=0x7fd478009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:04:14.547 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.547+0000 7fd46b7fe700 1 -- 172.21.15.152:0/2476790665 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fd474059d00 con 0x7fd484066090 2023-12-06T15:04:14.755 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.755+0000 7fd488801700 1 -- 172.21.15.152:0/2476790665 --> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd484100810 con 0x7fd46c06ce60 2023-12-06T15:04:14.756 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.756+0000 7fd46b7fe700 1 -- 172.21.15.152:0/2476790665 <== mgr.34104 v2:172.21.15.152:6800/2427836422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fd484100810 con 0x7fd46c06ce60 2023-12-06T15:04:14.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.758+0000 7fd488801700 1 -- 172.21.15.152:0/2476790665 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fd46c06ce60 msgr2=0x7fd46c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:14.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.758+0000 7fd488801700 1 --2- 172.21.15.152:0/2476790665 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fd46c06ce60 0x7fd46c06f310 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd478004890 tx=0x7fd478009e30 comp rx=0 tx=0).stop 2023-12-06T15:04:14.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.758+0000 7fd488801700 1 -- 172.21.15.152:0/2476790665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd484066090 msgr2=0x7fd48410d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:14.758 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.758+0000 7fd488801700 1 --2- 172.21.15.152:0/2476790665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd484066090 0x7fd48410d2e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd47400c8c0 tx=0x7fd4740044c0 comp rx=0 tx=0).stop 2023-12-06T15:04:14.759 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.758+0000 7fd488801700 1 -- 172.21.15.152:0/2476790665 shutdown_connections 2023-12-06T15:04:14.759 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.758+0000 7fd488801700 1 --2- 172.21.15.152:0/2476790665 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fd46c06ce60 0x7fd46c06f310 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:14.759 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.758+0000 7fd488801700 1 --2- 172.21.15.152:0/2476790665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd484066090 0x7fd48410d2e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:14.759 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.758+0000 7fd488801700 1 --2- 172.21.15.152:0/2476790665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd4840ffb70 0x7fd48410d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:14.759 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.758+0000 7fd488801700 1 -- 172.21.15.152:0/2476790665 >> 172.21.15.152:0/2476790665 conn(0x7fd4840f6f70 msgr2=0x7fd4840f93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:04:14.759 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.758+0000 7fd488801700 1 -- 172.21.15.152:0/2476790665 shutdown_connections 2023-12-06T15:04:14.759 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.758+0000 7fd488801700 1 -- 172.21.15.152:0/2476790665 wait complete. 2023-12-06T15:04:14.769 INFO:teuthology.orchestra.run.smithi152.stdout:true 2023-12-06T15:04:14.861 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.859+0000 7fb2ed52c700 1 -- 172.21.15.152:0/3632795994 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2e80fcd00 msgr2=0x7fb2e80fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:14.861 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.859+0000 7fb2ed52c700 1 --2- 172.21.15.152:0/3632795994 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2e80fcd00 0x7fb2e80fd150 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8004940 tx=0x7fb2d8009e30 comp rx=0 tx=0).stop 2023-12-06T15:04:14.861 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.860+0000 7fb2ed52c700 1 -- 172.21.15.152:0/3632795994 shutdown_connections 2023-12-06T15:04:14.862 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.860+0000 7fb2ed52c700 1 --2- 172.21.15.152:0/3632795994 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2e80fcd00 0x7fb2e80fd150 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:14.862 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.860+0000 7fb2ed52c700 1 --2- 172.21.15.152:0/3632795994 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2e80fbaf0 0x7fb2e80fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:14.862 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.860+0000 7fb2ed52c700 1 -- 172.21.15.152:0/3632795994 >> 172.21.15.152:0/3632795994 conn(0x7fb2e80f71b0 msgr2=0x7fb2e80f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:04:14.862 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.860+0000 7fb2ed52c700 1 -- 172.21.15.152:0/3632795994 shutdown_connections 2023-12-06T15:04:14.862 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.860+0000 7fb2ed52c700 1 -- 172.21.15.152:0/3632795994 wait complete. 2023-12-06T15:04:14.862 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.860+0000 7fb2ed52c700 1 Processor -- start 2023-12-06T15:04:14.862 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.860+0000 7fb2ed52c700 1 -- start start 2023-12-06T15:04:14.862 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.860+0000 7fb2ed52c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2e80fbaf0 0x7fb2e81101f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:14.862 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.860+0000 7fb2ed52c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2e80fcd00 0x7fb2e8112740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:14.862 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.860+0000 7fb2ed52c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e80669c0 con 0x7fb2e80fcd00 2023-12-06T15:04:14.862 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.860+0000 7fb2ed52c700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e8066b00 con 0x7fb2e80fbaf0 2023-12-06T15:04:14.862 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.861+0000 7fb2e67fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2e80fcd00 0x7fb2e8112740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:14.862 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.861+0000 7fb2e67fc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2e80fcd00 0x7fb2e8112740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32822/0 (socket says 172.21.15.152:32822) 2023-12-06T15:04:14.863 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.861+0000 7fb2e67fc700 1 -- 172.21.15.152:0/3109410582 learned_addr learned my addr 172.21.15.152:0/3109410582 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:04:14.863 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.861+0000 7fb2e6ffd700 1 --2- 172.21.15.152:0/3109410582 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2e80fbaf0 0x7fb2e81101f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:14.863 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.861+0000 7fb2e67fc700 1 -- 172.21.15.152:0/3109410582 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2e80fbaf0 msgr2=0x7fb2e81101f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:14.863 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.861+0000 7fb2e67fc700 1 --2- 172.21.15.152:0/3109410582 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2e80fbaf0 0x7fb2e81101f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:14.863 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.861+0000 7fb2e67fc700 1 -- 172.21.15.152:0/3109410582 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d8005040 con 0x7fb2e80fcd00 2023-12-06T15:04:14.863 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.861+0000 7fb2e67fc700 1 --2- 172.21.15.152:0/3109410582 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2e80fcd00 0x7fb2e8112740 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8009360 tx=0x7fb2d8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:04:14.863 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.861+0000 7fb2cf7fe700 1 -- 172.21.15.152:0/3109410582 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2d800e040 con 0x7fb2e80fcd00 2023-12-06T15:04:14.863 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.861+0000 7fb2cf7fe700 1 -- 172.21.15.152:0/3109410582 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb2d800bcd0 con 0x7fb2e80fcd00 2023-12-06T15:04:14.863 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.861+0000 7fb2ed52c700 1 -- 172.21.15.152:0/3109410582 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e8112d40 con 0x7fb2e80fcd00 2023-12-06T15:04:14.863 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.861+0000 7fb2cf7fe700 1 -- 172.21.15.152:0/3109410582 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2d801c630 con 0x7fb2e80fcd00 2023-12-06T15:04:14.863 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.861+0000 7fb2ed52c700 1 -- 172.21.15.152:0/3109410582 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e8113230 con 0x7fb2e80fcd00 2023-12-06T15:04:14.864 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.862+0000 7fb2ed52c700 1 -- 172.21.15.152:0/3109410582 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e804bb80 con 0x7fb2e80fcd00 2023-12-06T15:04:14.864 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.863+0000 7fb2cf7fe700 1 -- 172.21.15.152:0/3109410582 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fb2d8013960 con 0x7fb2e80fcd00 2023-12-06T15:04:14.864 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.863+0000 7fb2cf7fe700 1 --2- 172.21.15.152:0/3109410582 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fb2d006ce60 0x7fb2d006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:14.864 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.863+0000 7fb2cf7fe700 1 -- 172.21.15.152:0/3109410582 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6675+0+0 (secure 0 0 0) 0x7fb2d808d8b0 con 0x7fb2e80fcd00 2023-12-06T15:04:14.864 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.863+0000 7fb2e6ffd700 1 --2- 172.21.15.152:0/3109410582 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fb2d006ce60 0x7fb2d006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:14.864 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.863+0000 7fb2e6ffd700 1 --2- 172.21.15.152:0/3109410582 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fb2d006ce60 0x7fb2d006f310 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8066640 tx=0x7fb2dc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:04:14.867 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:14.867+0000 7fb2cf7fe700 1 -- 172.21.15.152:0/3109410582 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fb2d8057700 con 0x7fb2e80fcd00 2023-12-06T15:04:15.075 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.075+0000 7fb2ed52c700 1 -- 172.21.15.152:0/3109410582 --> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2e8101650 con 0x7fb2d006ce60 2023-12-06T15:04:15.076 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.076+0000 7fb2cf7fe700 1 -- 172.21.15.152:0/3109410582 <== mgr.34104 v2:172.21.15.152:6800/2427836422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fb2e8101650 con 0x7fb2d006ce60 2023-12-06T15:04:15.079 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.078+0000 7fb2ed52c700 1 -- 172.21.15.152:0/3109410582 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fb2d006ce60 msgr2=0x7fb2d006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:15.079 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.078+0000 7fb2ed52c700 1 --2- 172.21.15.152:0/3109410582 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fb2d006ce60 0x7fb2d006f310 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8066640 tx=0x7fb2dc00b040 comp rx=0 tx=0).stop 2023-12-06T15:04:15.079 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.078+0000 7fb2ed52c700 1 -- 172.21.15.152:0/3109410582 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2e80fcd00 msgr2=0x7fb2e8112740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:15.079 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.078+0000 7fb2ed52c700 1 --2- 172.21.15.152:0/3109410582 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2e80fcd00 0x7fb2e8112740 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8009360 tx=0x7fb2d8009e30 comp rx=0 tx=0).stop 2023-12-06T15:04:15.079 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.078+0000 7fb2ed52c700 1 -- 172.21.15.152:0/3109410582 shutdown_connections 2023-12-06T15:04:15.079 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.078+0000 7fb2ed52c700 1 --2- 172.21.15.152:0/3109410582 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fb2d006ce60 0x7fb2d006f310 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:15.079 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.078+0000 7fb2ed52c700 1 --2- 172.21.15.152:0/3109410582 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2e80fbaf0 0x7fb2e81101f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:15.079 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.078+0000 7fb2ed52c700 1 --2- 172.21.15.152:0/3109410582 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2e80fcd00 0x7fb2e8112740 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:15.079 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.078+0000 7fb2ed52c700 1 -- 172.21.15.152:0/3109410582 >> 172.21.15.152:0/3109410582 conn(0x7fb2e80f71b0 msgr2=0x7fb2e80fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:04:15.079 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.078+0000 7fb2ed52c700 1 -- 172.21.15.152:0/3109410582 shutdown_connections 2023-12-06T15:04:15.079 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.078+0000 7fb2ed52c700 1 -- 172.21.15.152:0/3109410582 wait complete. 2023-12-06T15:04:15.180 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.179+0000 7f535c0d1700 1 -- 172.21.15.152:0/3067711851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53540fdf60 msgr2=0x7f53540fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:15.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.179+0000 7f535c0d1700 1 --2- 172.21.15.152:0/3067711851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53540fdf60 0x7f53540fe3b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5350004940 tx=0x7f5350009e30 comp rx=0 tx=0).stop 2023-12-06T15:04:15.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.179+0000 7f535c0d1700 1 -- 172.21.15.152:0/3067711851 shutdown_connections 2023-12-06T15:04:15.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.179+0000 7f535c0d1700 1 --2- 172.21.15.152:0/3067711851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53540fdf60 0x7f53540fe3b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:15.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.179+0000 7f535c0d1700 1 --2- 172.21.15.152:0/3067711851 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53540faed0 0x7f53540fb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:15.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.179+0000 7f535c0d1700 1 -- 172.21.15.152:0/3067711851 >> 172.21.15.152:0/3067711851 conn(0x7f53540f6950 msgr2=0x7f53540f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:04:15.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.179+0000 7f535c0d1700 1 -- 172.21.15.152:0/3067711851 shutdown_connections 2023-12-06T15:04:15.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.179+0000 7f535c0d1700 1 -- 172.21.15.152:0/3067711851 wait complete. 2023-12-06T15:04:15.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.179+0000 7f535c0d1700 1 Processor -- start 2023-12-06T15:04:15.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.180+0000 7f535c0d1700 1 -- start start 2023-12-06T15:04:15.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.180+0000 7f535c0d1700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53540faed0 0x7f53540fd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:15.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.180+0000 7f535c0d1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53540fdf60 0x7f53540fbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:15.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.180+0000 7f535c0d1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53540fc470 con 0x7f53540fdf60 2023-12-06T15:04:15.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.180+0000 7f535c0d1700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53540fc5e0 con 0x7f53540faed0 2023-12-06T15:04:15.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.180+0000 7f535966c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53540fdf60 0x7f53540fbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:15.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.180+0000 7f535966c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53540fdf60 0x7f53540fbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32852/0 (socket says 172.21.15.152:32852) 2023-12-06T15:04:15.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.180+0000 7f535966c700 1 -- 172.21.15.152:0/3337093984 learned_addr learned my addr 172.21.15.152:0/3337093984 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:04:15.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.180+0000 7f535966c700 1 -- 172.21.15.152:0/3337093984 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53540faed0 msgr2=0x7f53540fd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:15.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.180+0000 7f535966c700 1 --2- 172.21.15.152:0/3337093984 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53540faed0 0x7f53540fd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:15.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.180+0000 7f535966c700 1 -- 172.21.15.152:0/3337093984 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5350005040 con 0x7f53540fdf60 2023-12-06T15:04:15.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.180+0000 7f535966c700 1 --2- 172.21.15.152:0/3337093984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53540fdf60 0x7f53540fbe70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f535000b3b0 tx=0x7f5350009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:04:15.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.180+0000 7f534a7fc700 1 -- 172.21.15.152:0/3337093984 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f535000e040 con 0x7f53540fdf60 2023-12-06T15:04:15.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.180+0000 7f534a7fc700 1 -- 172.21.15.152:0/3337093984 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f535000bc50 con 0x7f53540fdf60 2023-12-06T15:04:15.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.180+0000 7f534a7fc700 1 -- 172.21.15.152:0/3337093984 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5350013660 con 0x7f53540fdf60 2023-12-06T15:04:15.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.180+0000 7f535c0d1700 1 -- 172.21.15.152:0/3337093984 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53540fc860 con 0x7f53540fdf60 2023-12-06T15:04:15.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.180+0000 7f535c0d1700 1 -- 172.21.15.152:0/3337093984 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53541156a0 con 0x7f53540fdf60 2023-12-06T15:04:15.183 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.182+0000 7f535c0d1700 1 -- 172.21.15.152:0/3337093984 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53541075f0 con 0x7f53540fdf60 2023-12-06T15:04:15.183 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.182+0000 7f534a7fc700 1 -- 172.21.15.152:0/3337093984 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f53500138d0 con 0x7f53540fdf60 2023-12-06T15:04:15.183 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.182+0000 7f534a7fc700 1 --2- 172.21.15.152:0/3337093984 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f534006ce60 0x7f534006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:15.183 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.182+0000 7f5359e6d700 1 --2- 172.21.15.152:0/3337093984 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f534006ce60 0x7f534006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:15.183 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.182+0000 7f534a7fc700 1 -- 172.21.15.152:0/3337093984 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f535008d160 con 0x7f53540fdf60 2023-12-06T15:04:15.183 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.183+0000 7f5359e6d700 1 --2- 172.21.15.152:0/3337093984 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f534006ce60 0x7f534006f310 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f53540fd780 tx=0x7f5344009ce0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:04:15.187 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.187+0000 7f534a7fc700 1 -- 172.21.15.152:0/3337093984 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f535005aaf0 con 0x7f53540fdf60 2023-12-06T15:04:15.385 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.385+0000 7f535c0d1700 1 -- 172.21.15.152:0/3337093984 --> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f535402b150 con 0x7f534006ce60 2023-12-06T15:04:15.395 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.395+0000 7f534a7fc700 1 -- 172.21.15.152:0/3337093984 <== mgr.34104 v2:172.21.15.152:6800/2427836422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f535402b150 con 0x7f534006ce60 2023-12-06T15:04:15.395 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-06T15:04:15.395 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 running (4m) 40s ago 10m 26.3M - 0.25.0 c8568f914cd2 b1a46cc95546 2023-12-06T15:04:15.395 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (2m) 40s ago 10m 7470k - 19.0.0-26-g0482646f 26bb7d89db2e 222039c21ee0 2023-12-06T15:04:15.396 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi190 smithi190 running (117s) 13s ago 9m 7457k - 19.0.0-26-g0482646f 26bb7d89db2e 8841ae485b70 2023-12-06T15:04:15.396 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (4m) 40s ago 9m 88.0M - 9.4.7 954c08fa6188 5c6a52d58144 2023-12-06T15:04:15.396 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.acqswy smithi152 running (6m) 40s ago 6m 5566M - 17.2.7-113-gece0d607 a5c6421f1c5f ff9375cec192 2023-12-06T15:04:15.396 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.ypivwc smithi152 running (6m) 40s ago 6m 538M - 17.2.7-113-gece0d607 a5c6421f1c5f d809a681491b 2023-12-06T15:04:15.396 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi190.edwtqj smithi190 running (6m) 13s ago 6m 626M - 17.2.7-113-gece0d607 a5c6421f1c5f f3b7ebd93b04 2023-12-06T15:04:15.396 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi190.uucxzu smithi190 running (6m) 13s ago 6m 4860M - 17.2.7-113-gece0d607 a5c6421f1c5f c01be1409c5f 2023-12-06T15:04:15.396 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.meodco smithi152 *:8443,9283,8765 running (3m) 40s ago 11m 510M - 19.0.0-26-g0482646f 26bb7d89db2e 16ed2af8a3d0 2023-12-06T15:04:15.396 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi190.ubusrr smithi190 *:8443,9283,8765 running (3m) 13s ago 9m 449M - 19.0.0-26-g0482646f 26bb7d89db2e cfae14b9324d 2023-12-06T15:04:15.396 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (2m) 40s ago 11m 66.8M 2048M 19.0.0-26-g0482646f 26bb7d89db2e f5163d3b0f5f 2023-12-06T15:04:15.396 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi190 smithi190 running (2m) 13s ago 9m 51.0M 2048M 19.0.0-26-g0482646f 26bb7d89db2e b25040d5fdfe 2023-12-06T15:04:15.396 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 running (4m) 40s ago 10m 18.5M - 1.5.0 0da6a335fe13 81be696b9be8 2023-12-06T15:04:15.396 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi190 smithi190 *:9100 running (3m) 13s ago 9m 19.6M - 1.5.0 0da6a335fe13 2e521e235bf7 2023-12-06T15:04:15.396 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (103s) 40s ago 8m 169M 1568M 19.0.0-26-g0482646f 26bb7d89db2e 05e00966036e 2023-12-06T15:04:15.396 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (73s) 40s ago 8m 122M 1568M 19.0.0-26-g0482646f 26bb7d89db2e c0eaab4b2fd0 2023-12-06T15:04:15.397 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (44s) 40s ago 8m 12.6M 1568M 19.0.0-26-g0482646f 26bb7d89db2e 1440f943b48e 2023-12-06T15:04:15.397 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi190 running (15s) 13s ago 7m 13.6M 2592M 19.0.0-26-g0482646f 26bb7d89db2e 9871106e0a4f 2023-12-06T15:04:15.397 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi190 running (7m) 13s ago 7m 814M 2592M 17.2.7-113-gece0d607 a5c6421f1c5f a415b29ad9c7 2023-12-06T15:04:15.397 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi190 running (7m) 13s ago 7m 1075M 2592M 17.2.7-113-gece0d607 a5c6421f1c5f b0f2767055a5 2023-12-06T15:04:15.397 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi152 smithi152 *:9095 running (3m) 40s ago 9m 48.7M - 2.43.0 a07b618ecd1d 5f7e5860a419 2023-12-06T15:04:15.397 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.397+0000 7f535c0d1700 1 -- 172.21.15.152:0/3337093984 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f534006ce60 msgr2=0x7f534006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:15.397 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.397+0000 7f535c0d1700 1 --2- 172.21.15.152:0/3337093984 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f534006ce60 0x7f534006f310 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f53540fd780 tx=0x7f5344009ce0 comp rx=0 tx=0).stop 2023-12-06T15:04:15.398 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.397+0000 7f535c0d1700 1 -- 172.21.15.152:0/3337093984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53540fdf60 msgr2=0x7f53540fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:15.398 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.397+0000 7f535c0d1700 1 --2- 172.21.15.152:0/3337093984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53540fdf60 0x7f53540fbe70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f535000b3b0 tx=0x7f5350009e30 comp rx=0 tx=0).stop 2023-12-06T15:04:15.398 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.397+0000 7f535c0d1700 1 -- 172.21.15.152:0/3337093984 shutdown_connections 2023-12-06T15:04:15.398 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.397+0000 7f535c0d1700 1 --2- 172.21.15.152:0/3337093984 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f534006ce60 0x7f534006f310 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:15.398 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.397+0000 7f535c0d1700 1 --2- 172.21.15.152:0/3337093984 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53540faed0 0x7f53540fd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:15.398 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.397+0000 7f535c0d1700 1 --2- 172.21.15.152:0/3337093984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53540fdf60 0x7f53540fbe70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:15.398 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.397+0000 7f535c0d1700 1 -- 172.21.15.152:0/3337093984 >> 172.21.15.152:0/3337093984 conn(0x7f53540f6950 msgr2=0x7f53540f8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:04:15.398 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.397+0000 7f535c0d1700 1 -- 172.21.15.152:0/3337093984 shutdown_connections 2023-12-06T15:04:15.398 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.397+0000 7f535c0d1700 1 -- 172.21.15.152:0/3337093984 wait complete. 2023-12-06T15:04:15.499 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.497+0000 7f0a43326700 1 -- 172.21.15.152:0/3973754491 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a3c1020e0 msgr2=0x7f0a3c1044c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:15.499 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.497+0000 7f0a43326700 1 --2- 172.21.15.152:0/3973754491 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a3c1020e0 0x7f0a3c1044c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c004940 tx=0x7f0a2c009e30 comp rx=0 tx=0).stop 2023-12-06T15:04:15.499 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.497+0000 7f0a43326700 1 -- 172.21.15.152:0/3973754491 shutdown_connections 2023-12-06T15:04:15.499 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.497+0000 7f0a43326700 1 --2- 172.21.15.152:0/3973754491 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a3c1020e0 0x7f0a3c1044c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:15.499 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.497+0000 7f0a43326700 1 --2- 172.21.15.152:0/3973754491 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a3c066090 0x7f0a3c101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:15.499 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.497+0000 7f0a43326700 1 -- 172.21.15.152:0/3973754491 >> 172.21.15.152:0/3973754491 conn(0x7f0a3c0f7190 msgr2=0x7f0a3c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:04:15.499 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.497+0000 7f0a43326700 1 -- 172.21.15.152:0/3973754491 shutdown_connections 2023-12-06T15:04:15.499 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.497+0000 7f0a43326700 1 -- 172.21.15.152:0/3973754491 wait complete. 2023-12-06T15:04:15.499 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.498+0000 7f0a43326700 1 Processor -- start 2023-12-06T15:04:15.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.498+0000 7f0a43326700 1 -- start start 2023-12-06T15:04:15.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.498+0000 7f0a43326700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a3c066090 0x7f0a3c10f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:15.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.498+0000 7f0a43326700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a3c1020e0 0x7f0a3c10fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:15.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.498+0000 7f0a43326700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c110240 con 0x7f0a3c066090 2023-12-06T15:04:15.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.498+0000 7f0a43326700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c110ae0 con 0x7f0a3c1020e0 2023-12-06T15:04:15.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.498+0000 7f0a410c2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a3c066090 0x7f0a3c10f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:15.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.498+0000 7f0a410c2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a3c066090 0x7f0a3c10f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32876/0 (socket says 172.21.15.152:32876) 2023-12-06T15:04:15.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.498+0000 7f0a410c2700 1 -- 172.21.15.152:0/920736619 learned_addr learned my addr 172.21.15.152:0/920736619 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:04:15.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.498+0000 7f0a408c1700 1 --2- 172.21.15.152:0/920736619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a3c1020e0 0x7f0a3c10fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:15.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.498+0000 7f0a410c2700 1 -- 172.21.15.152:0/920736619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a3c1020e0 msgr2=0x7f0a3c10fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:15.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.498+0000 7f0a410c2700 1 --2- 172.21.15.152:0/920736619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a3c1020e0 0x7f0a3c10fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:15.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.499+0000 7f0a410c2700 1 -- 172.21.15.152:0/920736619 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a2c005040 con 0x7f0a3c066090 2023-12-06T15:04:15.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.499+0000 7f0a408c1700 1 --2- 172.21.15.152:0/920736619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a3c1020e0 0x7f0a3c10fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-06T15:04:15.500 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.499+0000 7f0a410c2700 1 --2- 172.21.15.152:0/920736619 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a3c066090 0x7f0a3c10f700 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0a3800eb70 tx=0x7f0a3800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:04:15.501 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.499+0000 7f0a31ffb700 1 -- 172.21.15.152:0/920736619 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a38007cc0 con 0x7f0a3c066090 2023-12-06T15:04:15.501 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.499+0000 7f0a43326700 1 -- 172.21.15.152:0/920736619 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a3c110d60 con 0x7f0a3c066090 2023-12-06T15:04:15.501 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.499+0000 7f0a31ffb700 1 -- 172.21.15.152:0/920736619 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0a3800f040 con 0x7f0a3c066090 2023-12-06T15:04:15.501 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.499+0000 7f0a31ffb700 1 -- 172.21.15.152:0/920736619 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a380095f0 con 0x7f0a3c066090 2023-12-06T15:04:15.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.499+0000 7f0a43326700 1 -- 172.21.15.152:0/920736619 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a3c1112a0 con 0x7f0a3c066090 2023-12-06T15:04:15.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.500+0000 7f0a43326700 1 -- 172.21.15.152:0/920736619 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a3c04bb80 con 0x7f0a3c066090 2023-12-06T15:04:15.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.500+0000 7f0a31ffb700 1 -- 172.21.15.152:0/920736619 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f0a38009750 con 0x7f0a3c066090 2023-12-06T15:04:15.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.501+0000 7f0a31ffb700 1 --2- 172.21.15.152:0/920736619 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f0a2806ce60 0x7f0a2806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:15.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.501+0000 7f0a31ffb700 1 -- 172.21.15.152:0/920736619 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f0a3808c070 con 0x7f0a3c066090 2023-12-06T15:04:15.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.501+0000 7f0a408c1700 1 --2- 172.21.15.152:0/920736619 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f0a2806ce60 0x7f0a2806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:15.502 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.501+0000 7f0a408c1700 1 --2- 172.21.15.152:0/920736619 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f0a2806ce60 0x7f0a2806f310 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c004560 tx=0x7f0a2c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:04:15.505 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.505+0000 7f0a31ffb700 1 -- 172.21.15.152:0/920736619 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f0a380598d0 con 0x7f0a3c066090 2023-12-06T15:04:15.777 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.777+0000 7f0a43326700 1 -- 172.21.15.152:0/920736619 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0a3c111920 con 0x7f0a3c066090 2023-12-06T15:04:15.777 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.777+0000 7f0a31ffb700 1 -- 172.21.15.152:0/920736619 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+827 (secure 0 0 0) 0x7f0a38059460 con 0x7f0a3c066090 2023-12-06T15:04:15.778 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-12-06T15:04:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": { 2023-12-06T15:04:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 2 2023-12-06T15:04:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:04:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": { 2023-12-06T15:04:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 2 2023-12-06T15:04:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:04:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": { 2023-12-06T15:04:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 2, 2023-12-06T15:04:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 4 2023-12-06T15:04:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:04:15.779 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2023-12-06T15:04:15.779 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 4 2023-12-06T15:04:15.779 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:04:15.779 INFO:teuthology.orchestra.run.smithi152.stdout: "overall": { 2023-12-06T15:04:15.779 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 6, 2023-12-06T15:04:15.779 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 8 2023-12-06T15:04:15.779 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-12-06T15:04:15.779 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-12-06T15:04:15.780 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.779+0000 7f0a43326700 1 -- 172.21.15.152:0/920736619 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f0a2806ce60 msgr2=0x7f0a2806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:15.780 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.779+0000 7f0a43326700 1 --2- 172.21.15.152:0/920736619 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f0a2806ce60 0x7f0a2806f310 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c004560 tx=0x7f0a2c009e30 comp rx=0 tx=0).stop 2023-12-06T15:04:15.780 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.779+0000 7f0a43326700 1 -- 172.21.15.152:0/920736619 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a3c066090 msgr2=0x7f0a3c10f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:15.780 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.779+0000 7f0a43326700 1 --2- 172.21.15.152:0/920736619 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a3c066090 0x7f0a3c10f700 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0a3800eb70 tx=0x7f0a3800b040 comp rx=0 tx=0).stop 2023-12-06T15:04:15.780 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.780+0000 7f0a43326700 1 -- 172.21.15.152:0/920736619 shutdown_connections 2023-12-06T15:04:15.780 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.780+0000 7f0a43326700 1 --2- 172.21.15.152:0/920736619 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f0a2806ce60 0x7f0a2806f310 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:15.780 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.780+0000 7f0a43326700 1 --2- 172.21.15.152:0/920736619 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a3c066090 0x7f0a3c10f700 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:15.780 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.780+0000 7f0a43326700 1 --2- 172.21.15.152:0/920736619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0a3c1020e0 0x7f0a3c10fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:15.780 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.780+0000 7f0a43326700 1 -- 172.21.15.152:0/920736619 >> 172.21.15.152:0/920736619 conn(0x7f0a3c0f7190 msgr2=0x7f0a3c0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:04:15.780 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.780+0000 7f0a43326700 1 -- 172.21.15.152:0/920736619 shutdown_connections 2023-12-06T15:04:15.780 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.780+0000 7f0a43326700 1 -- 172.21.15.152:0/920736619 wait complete. 2023-12-06T15:04:15.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.879+0000 7f3030a02700 1 -- 172.21.15.152:0/3167871973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f302c0faed0 msgr2=0x7f302c0fb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:15.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.879+0000 7f3030a02700 1 --2- 172.21.15.152:0/3167871973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f302c0faed0 0x7f302c0fb2e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3014004940 tx=0x7f3014009e30 comp rx=0 tx=0).stop 2023-12-06T15:04:15.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.879+0000 7f3030a02700 1 -- 172.21.15.152:0/3167871973 shutdown_connections 2023-12-06T15:04:15.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.879+0000 7f3030a02700 1 --2- 172.21.15.152:0/3167871973 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f302c0fdf60 0x7f302c0fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:15.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.879+0000 7f3030a02700 1 --2- 172.21.15.152:0/3167871973 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f302c0faed0 0x7f302c0fb2e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:15.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.879+0000 7f3030a02700 1 -- 172.21.15.152:0/3167871973 >> 172.21.15.152:0/3167871973 conn(0x7f302c0f6950 msgr2=0x7f302c0f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:04:15.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.879+0000 7f3030a02700 1 -- 172.21.15.152:0/3167871973 shutdown_connections 2023-12-06T15:04:15.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.879+0000 7f3030a02700 1 -- 172.21.15.152:0/3167871973 wait complete. 2023-12-06T15:04:15.881 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.880+0000 7f3030a02700 1 Processor -- start 2023-12-06T15:04:15.881 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.880+0000 7f3030a02700 1 -- start start 2023-12-06T15:04:15.882 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.880+0000 7f3030a02700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f302c0faed0 0x7f302c10d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:15.882 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.880+0000 7f3030a02700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f302c0fdf60 0x7f302c10db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:15.882 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.880+0000 7f3030a02700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302c10e120 con 0x7f302c0faed0 2023-12-06T15:04:15.882 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.880+0000 7f3030a02700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302c10e9c0 con 0x7f302c0fdf60 2023-12-06T15:04:15.882 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.880+0000 7f302a59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f302c0faed0 0x7f302c10d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:15.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.880+0000 7f302a59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f302c0faed0 0x7f302c10d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32882/0 (socket says 172.21.15.152:32882) 2023-12-06T15:04:15.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.880+0000 7f302a59c700 1 -- 172.21.15.152:0/3788197104 learned_addr learned my addr 172.21.15.152:0/3788197104 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:04:15.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.881+0000 7f3029d9b700 1 --2- 172.21.15.152:0/3788197104 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f302c0fdf60 0x7f302c10db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:15.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.881+0000 7f302a59c700 1 -- 172.21.15.152:0/3788197104 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f302c0fdf60 msgr2=0x7f302c10db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:15.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.881+0000 7f302a59c700 1 --2- 172.21.15.152:0/3788197104 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f302c0fdf60 0x7f302c10db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:15.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.881+0000 7f302a59c700 1 -- 172.21.15.152:0/3788197104 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3014005040 con 0x7f302c0faed0 2023-12-06T15:04:15.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.881+0000 7f3029d9b700 1 --2- 172.21.15.152:0/3788197104 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f302c0fdf60 0x7f302c10db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-06T15:04:15.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.881+0000 7f302a59c700 1 --2- 172.21.15.152:0/3788197104 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f302c0faed0 0x7f302c10d5e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3014009fd0 tx=0x7f3014009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:04:15.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.881+0000 7f3022ffd700 1 -- 172.21.15.152:0/3788197104 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f301400e040 con 0x7f302c0faed0 2023-12-06T15:04:15.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.881+0000 7f3030a02700 1 -- 172.21.15.152:0/3788197104 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f302c10ec40 con 0x7f302c0faed0 2023-12-06T15:04:15.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.881+0000 7f3022ffd700 1 -- 172.21.15.152:0/3788197104 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f301400bc50 con 0x7f302c0faed0 2023-12-06T15:04:15.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.881+0000 7f3022ffd700 1 -- 172.21.15.152:0/3788197104 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f301401c630 con 0x7f302c0faed0 2023-12-06T15:04:15.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.881+0000 7f3030a02700 1 -- 172.21.15.152:0/3788197104 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f302c10f180 con 0x7f302c0faed0 2023-12-06T15:04:15.883 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.882+0000 7f3030a02700 1 -- 172.21.15.152:0/3788197104 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f302c1075f0 con 0x7f302c0faed0 2023-12-06T15:04:15.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.883+0000 7f3022ffd700 1 -- 172.21.15.152:0/3788197104 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f3014013420 con 0x7f302c0faed0 2023-12-06T15:04:15.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.883+0000 7f3022ffd700 1 --2- 172.21.15.152:0/3788197104 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f301806ce60 0x7f301806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:15.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.883+0000 7f3022ffd700 1 -- 172.21.15.152:0/3788197104 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f301408d780 con 0x7f302c0faed0 2023-12-06T15:04:15.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.883+0000 7f3029d9b700 1 --2- 172.21.15.152:0/3788197104 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f301806ce60 0x7f301806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:15.884 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.883+0000 7f3029d9b700 1 --2- 172.21.15.152:0/3788197104 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f301806ce60 0x7f301806f310 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f301c009fd0 tx=0x7f301c009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:04:15.887 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:15.888+0000 7f3022ffd700 1 -- 172.21.15.152:0/3788197104 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f301405b060 con 0x7f302c0faed0 2023-12-06T15:04:16.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:15 smithi190 ceph-mon[178398]: pgmap v116: 65 pgs: 65 active+clean; 290 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s 2023-12-06T15:04:16.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:15 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:16.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:15 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:04:16.121 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.119+0000 7f3030a02700 1 -- 172.21.15.152:0/3788197104 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f302c04bb80 con 0x7f302c0faed0 2023-12-06T15:04:16.122 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.119+0000 7f3022ffd700 1 -- 172.21.15.152:0/3788197104 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1873 (secure 0 0 0) 0x7f301405abf0 con 0x7f302c0faed0 2023-12-06T15:04:16.122 INFO:teuthology.orchestra.run.smithi152.stdout:e18 2023-12-06T15:04:16.122 INFO:teuthology.orchestra.run.smithi152.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-06T15:04:16.122 INFO:teuthology.orchestra.run.smithi152.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-06T15:04:16.122 INFO:teuthology.orchestra.run.smithi152.stdout:legacy client fscid: 1 2023-12-06T15:04:16.122 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T15:04:16.122 INFO:teuthology.orchestra.run.smithi152.stdout:Filesystem 'cephfs' (1) 2023-12-06T15:04:16.122 INFO:teuthology.orchestra.run.smithi152.stdout:fs_name cephfs 2023-12-06T15:04:16.123 INFO:teuthology.orchestra.run.smithi152.stdout:epoch 18 2023-12-06T15:04:16.123 INFO:teuthology.orchestra.run.smithi152.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-06T15:04:16.123 INFO:teuthology.orchestra.run.smithi152.stdout:created 2023-12-06T14:57:59.352201+0000 2023-12-06T15:04:16.123 INFO:teuthology.orchestra.run.smithi152.stdout:modified 2023-12-06T15:03:48.238467+0000 2023-12-06T15:04:16.123 INFO:teuthology.orchestra.run.smithi152.stdout:tableserver 0 2023-12-06T15:04:16.123 INFO:teuthology.orchestra.run.smithi152.stdout:root 0 2023-12-06T15:04:16.123 INFO:teuthology.orchestra.run.smithi152.stdout:session_timeout 60 2023-12-06T15:04:16.123 INFO:teuthology.orchestra.run.smithi152.stdout:session_autoclose 300 2023-12-06T15:04:16.123 INFO:teuthology.orchestra.run.smithi152.stdout:max_file_size 1099511627776 2023-12-06T15:04:16.123 INFO:teuthology.orchestra.run.smithi152.stdout:max_xattr_size 65536 2023-12-06T15:04:16.123 INFO:teuthology.orchestra.run.smithi152.stdout:required_client_features {} 2023-12-06T15:04:16.123 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure 0 2023-12-06T15:04:16.123 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure_osd_epoch 0 2023-12-06T15:04:16.123 INFO:teuthology.orchestra.run.smithi152.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-06T15:04:16.123 INFO:teuthology.orchestra.run.smithi152.stdout:max_mds 2 2023-12-06T15:04:16.124 INFO:teuthology.orchestra.run.smithi152.stdout:in 0,1 2023-12-06T15:04:16.124 INFO:teuthology.orchestra.run.smithi152.stdout:up {0=14464,1=24255} 2023-12-06T15:04:16.124 INFO:teuthology.orchestra.run.smithi152.stdout:failed 2023-12-06T15:04:16.124 INFO:teuthology.orchestra.run.smithi152.stdout:damaged 2023-12-06T15:04:16.124 INFO:teuthology.orchestra.run.smithi152.stdout:stopped 2023-12-06T15:04:16.124 INFO:teuthology.orchestra.run.smithi152.stdout:data_pools [3] 2023-12-06T15:04:16.124 INFO:teuthology.orchestra.run.smithi152.stdout:metadata_pool 2 2023-12-06T15:04:16.124 INFO:teuthology.orchestra.run.smithi152.stdout:inline_data disabled 2023-12-06T15:04:16.124 INFO:teuthology.orchestra.run.smithi152.stdout:balancer 2023-12-06T15:04:16.124 INFO:teuthology.orchestra.run.smithi152.stdout:bal_rank_mask -1 2023-12-06T15:04:16.124 INFO:teuthology.orchestra.run.smithi152.stdout:standby_count_wanted 1 2023-12-06T15:04:16.124 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.acqswy{0:14464} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.152:6826/2467413186,v1:172.21.15.152:6827/2467413186] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:04:16.124 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi190.edwtqj{0:24271} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.190:6826/2256465065,v1:172.21.15.190:6827/2256465065] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:04:16.124 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi190.uucxzu{1:24255} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.190:6824/3250692478,v1:172.21.15.190:6825/3250692478] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:04:16.124 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.ypivwc{1:14480} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.152:6828/697313573,v1:172.21.15.152:6829/697313573] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:04:16.124 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T15:04:16.125 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T15:04:16.125 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.121+0000 7f3030a02700 1 -- 172.21.15.152:0/3788197104 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f301806ce60 msgr2=0x7f301806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:16.125 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.121+0000 7f3030a02700 1 --2- 172.21.15.152:0/3788197104 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f301806ce60 0x7f301806f310 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f301c009fd0 tx=0x7f301c009ee0 comp rx=0 tx=0).stop 2023-12-06T15:04:16.125 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.121+0000 7f3030a02700 1 -- 172.21.15.152:0/3788197104 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f302c0faed0 msgr2=0x7f302c10d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:16.126 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.121+0000 7f3030a02700 1 --2- 172.21.15.152:0/3788197104 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f302c0faed0 0x7f302c10d5e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3014009fd0 tx=0x7f3014009e30 comp rx=0 tx=0).stop 2023-12-06T15:04:16.126 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.121+0000 7f3030a02700 1 -- 172.21.15.152:0/3788197104 shutdown_connections 2023-12-06T15:04:16.126 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.121+0000 7f3030a02700 1 --2- 172.21.15.152:0/3788197104 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f301806ce60 0x7f301806f310 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:16.126 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.121+0000 7f3030a02700 1 --2- 172.21.15.152:0/3788197104 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f302c0faed0 0x7f302c10d5e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:16.126 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.121+0000 7f3030a02700 1 --2- 172.21.15.152:0/3788197104 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f302c0fdf60 0x7f302c10db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:16.126 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.121+0000 7f3030a02700 1 -- 172.21.15.152:0/3788197104 >> 172.21.15.152:0/3788197104 conn(0x7f302c0f6950 msgr2=0x7f302c0f8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:04:16.126 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.121+0000 7f3030a02700 1 -- 172.21.15.152:0/3788197104 shutdown_connections 2023-12-06T15:04:16.126 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.121+0000 7f3030a02700 1 -- 172.21.15.152:0/3788197104 wait complete. 2023-12-06T15:04:16.126 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 18 2023-12-06T15:04:16.127 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:15 smithi152 ceph-mon[192652]: pgmap v116: 65 pgs: 65 active+clean; 290 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s 2023-12-06T15:04:16.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:15 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:16.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:15 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:04:16.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.223+0000 7f5939ccb700 1 -- 172.21.15.152:0/1857499800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59340fbaf0 msgr2=0x7f59340fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:16.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.223+0000 7f5939ccb700 1 --2- 172.21.15.152:0/1857499800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59340fbaf0 0x7f59340fbf00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5924004940 tx=0x7f5924009e30 comp rx=0 tx=0).stop 2023-12-06T15:04:16.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.223+0000 7f5939ccb700 1 -- 172.21.15.152:0/1857499800 shutdown_connections 2023-12-06T15:04:16.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.223+0000 7f5939ccb700 1 --2- 172.21.15.152:0/1857499800 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59340fcd00 0x7f59340fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:16.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.223+0000 7f5939ccb700 1 --2- 172.21.15.152:0/1857499800 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59340fbaf0 0x7f59340fbf00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:16.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.223+0000 7f5939ccb700 1 -- 172.21.15.152:0/1857499800 >> 172.21.15.152:0/1857499800 conn(0x7f59340f71b0 msgr2=0x7f59340f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:04:16.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.223+0000 7f5939ccb700 1 -- 172.21.15.152:0/1857499800 shutdown_connections 2023-12-06T15:04:16.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.223+0000 7f5939ccb700 1 -- 172.21.15.152:0/1857499800 wait complete. 2023-12-06T15:04:16.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.224+0000 7f5939ccb700 1 Processor -- start 2023-12-06T15:04:16.225 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.224+0000 7f5939ccb700 1 -- start start 2023-12-06T15:04:16.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.224+0000 7f5939ccb700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59340fbaf0 0x7f593410c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:16.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.224+0000 7f5939ccb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59340fcd00 0x7f593410c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:16.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.224+0000 7f5939ccb700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593410cfa0 con 0x7f59340fcd00 2023-12-06T15:04:16.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.224+0000 7f5939ccb700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593410d840 con 0x7f59340fbaf0 2023-12-06T15:04:16.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.224+0000 7f592bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59340fcd00 0x7f593410c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:16.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.224+0000 7f592bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59340fcd00 0x7f593410c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32894/0 (socket says 172.21.15.152:32894) 2023-12-06T15:04:16.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.224+0000 7f592bfff700 1 -- 172.21.15.152:0/2880538222 learned_addr learned my addr 172.21.15.152:0/2880538222 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:04:16.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.224+0000 7f59337fe700 1 --2- 172.21.15.152:0/2880538222 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59340fbaf0 0x7f593410c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:16.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.224+0000 7f592bfff700 1 -- 172.21.15.152:0/2880538222 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59340fbaf0 msgr2=0x7f593410c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:16.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.224+0000 7f592bfff700 1 --2- 172.21.15.152:0/2880538222 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59340fbaf0 0x7f593410c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:16.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.224+0000 7f592bfff700 1 -- 172.21.15.152:0/2880538222 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5924005040 con 0x7f59340fcd00 2023-12-06T15:04:16.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.224+0000 7f592bfff700 1 --2- 172.21.15.152:0/2880538222 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59340fcd00 0x7f593410c9a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f591c00fce0 tx=0x7f591c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:04:16.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.225+0000 7f5930ff9700 1 -- 172.21.15.152:0/2880538222 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f591c007ea0 con 0x7f59340fcd00 2023-12-06T15:04:16.226 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.225+0000 7f5930ff9700 1 -- 172.21.15.152:0/2880538222 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f591c00dd80 con 0x7f59340fcd00 2023-12-06T15:04:16.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.225+0000 7f5939ccb700 1 -- 172.21.15.152:0/2880538222 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f593410dac0 con 0x7f59340fcd00 2023-12-06T15:04:16.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.225+0000 7f5930ff9700 1 -- 172.21.15.152:0/2880538222 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f591c012460 con 0x7f59340fcd00 2023-12-06T15:04:16.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.225+0000 7f5939ccb700 1 -- 172.21.15.152:0/2880538222 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f593410e000 con 0x7f59340fcd00 2023-12-06T15:04:16.227 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.226+0000 7f5939ccb700 1 -- 172.21.15.152:0/2880538222 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f593404bb80 con 0x7f59340fcd00 2023-12-06T15:04:16.228 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.226+0000 7f5930ff9700 1 -- 172.21.15.152:0/2880538222 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f591c009360 con 0x7f59340fcd00 2023-12-06T15:04:16.228 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.226+0000 7f5930ff9700 1 --2- 172.21.15.152:0/2880538222 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f592006ce60 0x7f592006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:16.228 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.227+0000 7f5930ff9700 1 -- 172.21.15.152:0/2880538222 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f591c08ea80 con 0x7f59340fcd00 2023-12-06T15:04:16.228 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.227+0000 7f59337fe700 1 --2- 172.21.15.152:0/2880538222 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f592006ce60 0x7f592006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:16.228 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.227+0000 7f59337fe700 1 --2- 172.21.15.152:0/2880538222 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f592006ce60 0x7f592006f310 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5924000c00 tx=0x7f5924009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:04:16.231 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.231+0000 7f5930ff9700 1 -- 172.21.15.152:0/2880538222 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f591c05c2e0 con 0x7f59340fcd00 2023-12-06T15:04:16.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.439+0000 7f5939ccb700 1 -- 172.21.15.152:0/2880538222 --> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f593410e490 con 0x7f592006ce60 2023-12-06T15:04:16.441 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.441+0000 7f5930ff9700 1 -- 172.21.15.152:0/2880538222 <== mgr.34104 v2:172.21.15.152:6800/2427836422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f593410e490 con 0x7f592006ce60 2023-12-06T15:04:16.441 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-12-06T15:04:16.441 INFO:teuthology.orchestra.run.smithi152.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e331a81036b9c4be9167bdaf54e458c7294ca3446212b9c6126786d23318b1cf", 2023-12-06T15:04:16.441 INFO:teuthology.orchestra.run.smithi152.stdout: "in_progress": true, 2023-12-06T15:04:16.441 INFO:teuthology.orchestra.run.smithi152.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-06T15:04:16.441 INFO:teuthology.orchestra.run.smithi152.stdout: "services_complete": [ 2023-12-06T15:04:16.441 INFO:teuthology.orchestra.run.smithi152.stdout: "crash", 2023-12-06T15:04:16.441 INFO:teuthology.orchestra.run.smithi152.stdout: "mon", 2023-12-06T15:04:16.441 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr" 2023-12-06T15:04:16.442 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2023-12-06T15:04:16.442 INFO:teuthology.orchestra.run.smithi152.stdout: "progress": "10/21 daemons upgraded", 2023-12-06T15:04:16.442 INFO:teuthology.orchestra.run.smithi152.stdout: "message": "Currently upgrading osd daemons", 2023-12-06T15:04:16.442 INFO:teuthology.orchestra.run.smithi152.stdout: "is_paused": false 2023-12-06T15:04:16.442 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-12-06T15:04:16.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.443+0000 7f5939ccb700 1 -- 172.21.15.152:0/2880538222 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f592006ce60 msgr2=0x7f592006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:16.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.443+0000 7f5939ccb700 1 --2- 172.21.15.152:0/2880538222 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f592006ce60 0x7f592006f310 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5924000c00 tx=0x7f5924009e30 comp rx=0 tx=0).stop 2023-12-06T15:04:16.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.443+0000 7f5939ccb700 1 -- 172.21.15.152:0/2880538222 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59340fcd00 msgr2=0x7f593410c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:16.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.443+0000 7f5939ccb700 1 --2- 172.21.15.152:0/2880538222 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59340fcd00 0x7f593410c9a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f591c00fce0 tx=0x7f591c0046b0 comp rx=0 tx=0).stop 2023-12-06T15:04:16.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.443+0000 7f5939ccb700 1 -- 172.21.15.152:0/2880538222 shutdown_connections 2023-12-06T15:04:16.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.443+0000 7f5939ccb700 1 --2- 172.21.15.152:0/2880538222 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f592006ce60 0x7f592006f310 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:16.443 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.443+0000 7f5939ccb700 1 --2- 172.21.15.152:0/2880538222 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59340fbaf0 0x7f593410c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:16.444 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.443+0000 7f5939ccb700 1 --2- 172.21.15.152:0/2880538222 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59340fcd00 0x7f593410c9a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:16.444 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.443+0000 7f5939ccb700 1 -- 172.21.15.152:0/2880538222 >> 172.21.15.152:0/2880538222 conn(0x7f59340f71b0 msgr2=0x7f59340f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:04:16.444 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.443+0000 7f5939ccb700 1 -- 172.21.15.152:0/2880538222 shutdown_connections 2023-12-06T15:04:16.444 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.443+0000 7f5939ccb700 1 -- 172.21.15.152:0/2880538222 wait complete. 2023-12-06T15:04:16.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.546+0000 7f6a29195700 1 -- 172.21.15.152:0/1643823870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a240fcd00 msgr2=0x7f6a240fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:16.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.546+0000 7f6a29195700 1 --2- 172.21.15.152:0/1643823870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a240fcd00 0x7f6a240fd150 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c004940 tx=0x7f6a0c009e30 comp rx=0 tx=0).stop 2023-12-06T15:04:16.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.546+0000 7f6a29195700 1 -- 172.21.15.152:0/1643823870 shutdown_connections 2023-12-06T15:04:16.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.546+0000 7f6a29195700 1 --2- 172.21.15.152:0/1643823870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a240fcd00 0x7f6a240fd150 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:16.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.546+0000 7f6a29195700 1 --2- 172.21.15.152:0/1643823870 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a240fbaf0 0x7f6a240fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:16.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.546+0000 7f6a29195700 1 -- 172.21.15.152:0/1643823870 >> 172.21.15.152:0/1643823870 conn(0x7f6a240f7190 msgr2=0x7f6a240f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:04:16.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.546+0000 7f6a29195700 1 -- 172.21.15.152:0/1643823870 shutdown_connections 2023-12-06T15:04:16.547 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.546+0000 7f6a29195700 1 -- 172.21.15.152:0/1643823870 wait complete. 2023-12-06T15:04:16.548 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.546+0000 7f6a29195700 1 Processor -- start 2023-12-06T15:04:16.548 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.546+0000 7f6a29195700 1 -- start start 2023-12-06T15:04:16.548 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.547+0000 7f6a29195700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a240fbaf0 0x7f6a24110270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:16.548 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.547+0000 7f6a29195700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a240fcd00 0x7f6a241127c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:16.548 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.547+0000 7f6a29195700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a24066130 con 0x7f6a240fbaf0 2023-12-06T15:04:16.549 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.547+0000 7f6a29195700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a24066270 con 0x7f6a240fcd00 2023-12-06T15:04:16.549 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.547+0000 7f6a22d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a240fbaf0 0x7f6a24110270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:16.549 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.547+0000 7f6a22d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a240fbaf0 0x7f6a24110270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:32918/0 (socket says 172.21.15.152:32918) 2023-12-06T15:04:16.549 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.547+0000 7f6a22d9d700 1 -- 172.21.15.152:0/3557135838 learned_addr learned my addr 172.21.15.152:0/3557135838 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:04:16.549 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.547+0000 7f6a2259c700 1 --2- 172.21.15.152:0/3557135838 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a240fcd00 0x7f6a241127c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:16.549 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.547+0000 7f6a22d9d700 1 -- 172.21.15.152:0/3557135838 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a240fcd00 msgr2=0x7f6a241127c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:16.549 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.547+0000 7f6a22d9d700 1 --2- 172.21.15.152:0/3557135838 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a240fcd00 0x7f6a241127c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:16.549 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.547+0000 7f6a22d9d700 1 -- 172.21.15.152:0/3557135838 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a0c005040 con 0x7f6a240fbaf0 2023-12-06T15:04:16.549 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.547+0000 7f6a2259c700 1 --2- 172.21.15.152:0/3557135838 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a240fcd00 0x7f6a241127c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-06T15:04:16.549 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.547+0000 7f6a22d9d700 1 --2- 172.21.15.152:0/3557135838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a240fbaf0 0x7f6a24110270 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6a14002a80 tx=0x7f6a14004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:04:16.549 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.547+0000 7f6a1b7fe700 1 -- 172.21.15.152:0/3557135838 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a14007cc0 con 0x7f6a240fbaf0 2023-12-06T15:04:16.549 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.547+0000 7f6a1b7fe700 1 -- 172.21.15.152:0/3557135838 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6a1400f040 con 0x7f6a240fbaf0 2023-12-06T15:04:16.549 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.547+0000 7f6a29195700 1 -- 172.21.15.152:0/3557135838 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a24112e20 con 0x7f6a240fbaf0 2023-12-06T15:04:16.549 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.547+0000 7f6a1b7fe700 1 -- 172.21.15.152:0/3557135838 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a1400da20 con 0x7f6a240fbaf0 2023-12-06T15:04:16.549 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.547+0000 7f6a29195700 1 -- 172.21.15.152:0/3557135838 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a24113280 con 0x7f6a240fbaf0 2023-12-06T15:04:16.550 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.548+0000 7f6a29195700 1 -- 172.21.15.152:0/3557135838 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a2404bb80 con 0x7f6a240fbaf0 2023-12-06T15:04:16.550 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.549+0000 7f6a1b7fe700 1 -- 172.21.15.152:0/3557135838 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f6a1400db80 con 0x7f6a240fbaf0 2023-12-06T15:04:16.550 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.549+0000 7f6a1b7fe700 1 --2- 172.21.15.152:0/3557135838 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f6a1006ce60 0x7f6a1006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:16.551 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.549+0000 7f6a1b7fe700 1 -- 172.21.15.152:0/3557135838 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f6a1408c1e0 con 0x7f6a240fbaf0 2023-12-06T15:04:16.551 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.549+0000 7f6a2259c700 1 --2- 172.21.15.152:0/3557135838 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f6a1006ce60 0x7f6a1006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:16.551 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.550+0000 7f6a2259c700 1 --2- 172.21.15.152:0/3557135838 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f6a1006ce60 0x7f6a1006f310 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c00b3b0 tx=0x7f6a0c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:04:16.554 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.554+0000 7f6a1b7fe700 1 -- 172.21.15.152:0/3557135838 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f6a14055fb0 con 0x7f6a240fbaf0 2023-12-06T15:04:16.824 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.824+0000 7f6a29195700 1 -- 172.21.15.152:0/3557135838 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6a241134a0 con 0x7f6a240fbaf0 2023-12-06T15:04:16.825 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.825+0000 7f6a1b7fe700 1 -- 172.21.15.152:0/3557135838 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f6a140595d0 con 0x7f6a240fbaf0 2023-12-06T15:04:16.825 INFO:teuthology.orchestra.run.smithi152.stdout:HEALTH_OK 2023-12-06T15:04:16.827 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.827+0000 7f6a29195700 1 -- 172.21.15.152:0/3557135838 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f6a1006ce60 msgr2=0x7f6a1006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:16.827 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.827+0000 7f6a29195700 1 --2- 172.21.15.152:0/3557135838 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f6a1006ce60 0x7f6a1006f310 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c00b3b0 tx=0x7f6a0c009e30 comp rx=0 tx=0).stop 2023-12-06T15:04:16.827 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.827+0000 7f6a29195700 1 -- 172.21.15.152:0/3557135838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a240fbaf0 msgr2=0x7f6a24110270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:16.827 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.827+0000 7f6a29195700 1 --2- 172.21.15.152:0/3557135838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a240fbaf0 0x7f6a24110270 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6a14002a80 tx=0x7f6a14004600 comp rx=0 tx=0).stop 2023-12-06T15:04:16.827 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.827+0000 7f6a29195700 1 -- 172.21.15.152:0/3557135838 shutdown_connections 2023-12-06T15:04:16.827 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.827+0000 7f6a29195700 1 --2- 172.21.15.152:0/3557135838 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f6a1006ce60 0x7f6a1006f310 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:16.827 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.827+0000 7f6a29195700 1 --2- 172.21.15.152:0/3557135838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a240fbaf0 0x7f6a24110270 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:16.828 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.827+0000 7f6a29195700 1 --2- 172.21.15.152:0/3557135838 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6a240fcd00 0x7f6a241127c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:16.828 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.827+0000 7f6a29195700 1 -- 172.21.15.152:0/3557135838 >> 172.21.15.152:0/3557135838 conn(0x7f6a240f7190 msgr2=0x7f6a240fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:04:16.828 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.827+0000 7f6a29195700 1 -- 172.21.15.152:0/3557135838 shutdown_connections 2023-12-06T15:04:16.828 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:16.827+0000 7f6a29195700 1 -- 172.21.15.152:0/3557135838 wait complete. 2023-12-06T15:04:17.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:16 smithi190 ceph-mon[178398]: from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:04:17.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:16 smithi190 ceph-mon[178398]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:04:17.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:16 smithi190 ceph-mon[178398]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:04:17.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:16 smithi190 ceph-mon[178398]: from='client.? 172.21.15.152:0/920736619' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:04:17.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:16 smithi190 ceph-mon[178398]: from='client.? 172.21.15.152:0/3788197104' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-06T15:04:17.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:16 smithi152 ceph-mon[192652]: from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:04:17.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:16 smithi152 ceph-mon[192652]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:04:17.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:16 smithi152 ceph-mon[192652]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:04:17.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:16 smithi152 ceph-mon[192652]: from='client.? 172.21.15.152:0/920736619' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:04:17.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:16 smithi152 ceph-mon[192652]: from='client.? 172.21.15.152:0/3788197104' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-06T15:04:18.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:17 smithi190 ceph-mon[178398]: from='client.34300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:04:18.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:17 smithi190 ceph-mon[178398]: pgmap v117: 65 pgs: 65 active+clean; 290 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2023-12-06T15:04:18.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:17 smithi190 ceph-mon[178398]: from='client.? 172.21.15.152:0/3557135838' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-06T15:04:18.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:17 smithi152 ceph-mon[192652]: from='client.34300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:04:18.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:17 smithi152 ceph-mon[192652]: pgmap v117: 65 pgs: 65 active+clean; 290 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2023-12-06T15:04:18.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:17 smithi152 ceph-mon[192652]: from='client.? 172.21.15.152:0/3557135838' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-06T15:04:20.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:19 smithi190 ceph-mon[178398]: pgmap v118: 65 pgs: 65 active+clean; 290 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2023-12-06T15:04:20.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:19 smithi152 ceph-mon[192652]: pgmap v118: 65 pgs: 65 active+clean; 290 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2023-12-06T15:04:21.013 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:20 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-06T15:04:21.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:20 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-06T15:04:22.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:21 smithi190 ceph-mon[178398]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-06T15:04:22.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:21 smithi190 ceph-mon[178398]: Upgrade: osd.4 is safe to restart 2023-12-06T15:04:22.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:21 smithi190 ceph-mon[178398]: pgmap v119: 65 pgs: 65 active+clean; 290 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2023-12-06T15:04:22.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:21 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:22.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:21 smithi152 ceph-mon[192652]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2023-12-06T15:04:22.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:21 smithi152 ceph-mon[192652]: Upgrade: osd.4 is safe to restart 2023-12-06T15:04:22.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:21 smithi152 ceph-mon[192652]: pgmap v119: 65 pgs: 65 active+clean; 290 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2023-12-06T15:04:22.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:21 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:23.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:22 smithi190 ceph-mon[178398]: Upgrade: Updating osd.4 2023-12-06T15:04:23.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:22 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:23.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:22 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-06T15:04:23.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:22 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:04:23.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:22 smithi190 ceph-mon[178398]: Deploying daemon osd.4 on smithi190 2023-12-06T15:04:23.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:22 smithi190 ceph-mon[178398]: pgmap v120: 65 pgs: 65 active+clean; 290 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2023-12-06T15:04:23.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:22 smithi152 ceph-mon[192652]: Upgrade: Updating osd.4 2023-12-06T15:04:23.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:22 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:23.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:22 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-06T15:04:23.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:22 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:04:23.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:22 smithi152 ceph-mon[192652]: Deploying daemon osd.4 on smithi190 2023-12-06T15:04:23.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:22 smithi152 ceph-mon[192652]: pgmap v120: 65 pgs: 65 active+clean; 290 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2023-12-06T15:04:24.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:24 smithi190 ceph-mon[178398]: osd.4 marked itself down and dead 2023-12-06T15:04:24.323 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 15:04:23 smithi190 systemd[1]: Stopping Ceph osd.4 for 062f0e3c-9447-11ee-95a2-87774f69a715... 2023-12-06T15:04:24.323 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 15:04:24 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-4[136281]: 2023-12-06T15:04:24.010+0000 7f333e9d4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-06T15:04:24.323 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 15:04:24 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-4[136281]: 2023-12-06T15:04:24.010+0000 7f333e9d4700 -1 osd.4 79 *** Got signal Terminated *** 2023-12-06T15:04:24.323 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 15:04:24 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-4[136281]: 2023-12-06T15:04:24.010+0000 7f333e9d4700 -1 osd.4 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-06T15:04:24.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:24 smithi152 ceph-mon[192652]: osd.4 marked itself down and dead 2023-12-06T15:04:24.822 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 15:04:24 smithi190 bash[196401]: ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-4 2023-12-06T15:04:25.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:25 smithi190 ceph-mon[178398]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-06T15:04:25.325 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:25 smithi190 ceph-mon[178398]: osdmap e80: 6 total, 5 up, 6 in 2023-12-06T15:04:25.325 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:25 smithi190 ceph-mon[178398]: failed to encode map e80 with expected crc 2023-12-06T15:04:25.325 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:25 smithi190 ceph-mon[178398]: failed to encode map e80 with expected crc 2023-12-06T15:04:25.325 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:25 smithi190 ceph-mon[178398]: pgmap v122: 65 pgs: 5 stale+active+clean, 60 active+clean; 290 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2023-12-06T15:04:25.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:25 smithi152 ceph-mon[192652]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-06T15:04:25.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:25 smithi152 ceph-mon[192652]: osdmap e80: 6 total, 5 up, 6 in 2023-12-06T15:04:25.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:25 smithi152 ceph-mon[192652]: failed to encode map e80 with expected crc 2023-12-06T15:04:25.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:25 smithi152 ceph-mon[192652]: failed to encode map e80 with expected crc 2023-12-06T15:04:25.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:25 smithi152 ceph-mon[192652]: pgmap v122: 65 pgs: 5 stale+active+clean, 60 active+clean; 290 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2023-12-06T15:04:26.045 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 15:04:25 smithi190 systemd[1]: ceph-062f0e3c-9447-11ee-95a2-87774f69a715@osd.4.service: Succeeded. 2023-12-06T15:04:26.046 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 15:04:25 smithi190 systemd[1]: Stopped Ceph osd.4 for 062f0e3c-9447-11ee-95a2-87774f69a715. 2023-12-06T15:04:26.046 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 15:04:25 smithi190 systemd[1]: Starting Ceph osd.4 for 062f0e3c-9447-11ee-95a2-87774f69a715... 2023-12-06T15:04:26.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:26 smithi190 ceph-mon[178398]: failed to encode map e81 with expected crc 2023-12-06T15:04:26.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:26 smithi190 ceph-mon[178398]: osdmap e81: 6 total, 5 up, 6 in 2023-12-06T15:04:26.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:26 smithi190 ceph-mon[178398]: failed to encode map e81 with expected crc 2023-12-06T15:04:26.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:26 smithi190 ceph-mon[178398]: failed to encode map e81 with expected crc 2023-12-06T15:04:26.323 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:26 smithi190 ceph-mon[178398]: failed to encode map e81 with expected crc 2023-12-06T15:04:26.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:26 smithi152 ceph-mon[192652]: failed to encode map e81 with expected crc 2023-12-06T15:04:26.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:26 smithi152 ceph-mon[192652]: osdmap e81: 6 total, 5 up, 6 in 2023-12-06T15:04:26.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:26 smithi152 ceph-mon[192652]: failed to encode map e81 with expected crc 2023-12-06T15:04:26.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:26 smithi152 ceph-mon[192652]: failed to encode map e81 with expected crc 2023-12-06T15:04:26.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:26 smithi152 ceph-mon[192652]: failed to encode map e81 with expected crc 2023-12-06T15:04:26.822 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 15:04:26 smithi190 bash[196668]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-06T15:04:26.823 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 15:04:26 smithi190 bash[196668]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2023-12-06T15:04:26.823 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 15:04:26 smithi190 bash[196668]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2023-12-06T15:04:26.823 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 15:04:26 smithi190 bash[196668]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2023-12-06T15:04:26.823 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 15:04:26 smithi190 bash[196668]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2023-12-06T15:04:26.823 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 15:04:26 smithi190 bash[196668]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-06T15:04:26.823 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 15:04:26 smithi190 bash[196668]: --> ceph-volume raw activate successful for osd ID: 4 2023-12-06T15:04:27.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:27 smithi152 ceph-mon[192652]: pgmap v124: 65 pgs: 6 active+undersized, 8 active+undersized+degraded, 3 stale+active+clean, 48 active+clean; 290 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 32/348 objects degraded (9.195%) 2023-12-06T15:04:27.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:27 smithi190 ceph-mon[178398]: pgmap v124: 65 pgs: 6 active+undersized, 8 active+undersized+degraded, 3 stale+active+clean, 48 active+clean; 290 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 32/348 objects degraded (9.195%) 2023-12-06T15:04:27.573 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 15:04:27 smithi190 bash[196921]: c2350bc6d4482674557a1599adb849e096977cffee9f090328d33a7a6be998ca 2023-12-06T15:04:27.573 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 15:04:27 smithi190 ceph-osd[196958]: -- 172.21.15.190:0/1959072682 <== mon.1 v2:172.21.15.190:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x559d88a991e0 con 0x559d88a68c00 2023-12-06T15:04:27.573 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 15:04:27 smithi190 systemd[1]: Started Ceph osd.4 for 062f0e3c-9447-11ee-95a2-87774f69a715. 2023-12-06T15:04:28.072 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 15:04:27 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-4[196935]: 2023-12-06T15:04:27.707+0000 7fdcfab50640 -1 Falling back to public interface 2023-12-06T15:04:28.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:28 smithi152 ceph-mon[192652]: Health check failed: Degraded data redundancy: 32/348 objects degraded (9.195%), 8 pgs degraded (PG_DEGRADED) 2023-12-06T15:04:28.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:28 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:28.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:28 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:28.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:28 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:04:28.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:28 smithi190 ceph-mon[178398]: Health check failed: Degraded data redundancy: 32/348 objects degraded (9.195%), 8 pgs degraded (PG_DEGRADED) 2023-12-06T15:04:28.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:28 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:28.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:28 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:28.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:28 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:04:29.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:29 smithi190 ceph-mon[178398]: pgmap v125: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 290 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 57/348 objects degraded (16.379%) 2023-12-06T15:04:29.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:29 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:29.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:29 smithi152 ceph-mon[192652]: pgmap v125: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 290 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 57/348 objects degraded (16.379%) 2023-12-06T15:04:29.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:29 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:30.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:30 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:30.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:30 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:30.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:30 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:30.438 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:30 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:30.438 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:30 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:30.438 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:30 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:32.043 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:31 smithi190 ceph-mon[178398]: pgmap v126: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 290 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 57/348 objects degraded (16.379%) 2023-12-06T15:04:32.043 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:31 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:32.043 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:31 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:04:32.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:31 smithi152 ceph-mon[192652]: pgmap v126: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 290 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 57/348 objects degraded (16.379%) 2023-12-06T15:04:32.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:31 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:32.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:31 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:04:32.322 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 15:04:32 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-4[196935]: 2023-12-06T15:04:32.281+0000 7fdcfab50640 -1 osd.4 0 read_superblock omap replica is missing. 2023-12-06T15:04:33.072 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 15:04:32 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-4[196935]: 2023-12-06T15:04:32.727+0000 7fdcfab50640 -1 osd.4 79 log_to_monitors true 2023-12-06T15:04:33.822 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 15:04:33 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-4[196935]: 2023-12-06T15:04:33.503+0000 7fdcebfc1700 -1 osd.4 79 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-06T15:04:33.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:33 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:33.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:33 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:33.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:33 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:04:33.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:33 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T15:04:33.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:33 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:33.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:33 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:04:33.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:33 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:04:33.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:33 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:04:33.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:33 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:04:33.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:33 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-06T15:04:33.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:33 smithi190 ceph-mon[178398]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-06T15:04:33.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:33 smithi190 ceph-mon[178398]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2023-12-06T15:04:33.824 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:33 smithi190 ceph-mon[178398]: pgmap v127: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 290 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 57/348 objects degraded (16.379%) 2023-12-06T15:04:33.824 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:33 smithi190 ceph-mon[178398]: from='osd.4 [v2:172.21.15.190:6808/3285745876,v1:172.21.15.190:6809/3285745876]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-06T15:04:33.824 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:33 smithi190 ceph-mon[178398]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-06T15:04:33.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:33 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:33.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:33 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:33.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:33 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:04:33.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:33 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T15:04:33.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:33 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:33.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:33 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:04:33.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:33 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:04:33.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:33 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:04:33.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:33 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:04:33.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:33 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-06T15:04:33.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:33 smithi152 ceph-mon[192652]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-06T15:04:33.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:33 smithi152 ceph-mon[192652]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2023-12-06T15:04:33.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:33 smithi152 ceph-mon[192652]: pgmap v127: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 290 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 57/348 objects degraded (16.379%) 2023-12-06T15:04:33.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:33 smithi152 ceph-mon[192652]: from='osd.4 [v2:172.21.15.190:6808/3285745876,v1:172.21.15.190:6809/3285745876]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-06T15:04:33.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:33 smithi152 ceph-mon[192652]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-06T15:04:34.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:34 smithi190 ceph-mon[178398]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-06T15:04:34.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:34 smithi190 ceph-mon[178398]: osdmap e82: 6 total, 5 up, 6 in 2023-12-06T15:04:34.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:34 smithi190 ceph-mon[178398]: from='osd.4 [v2:172.21.15.190:6808/3285745876,v1:172.21.15.190:6809/3285745876]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-12-06T15:04:34.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:34 smithi190 ceph-mon[178398]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-12-06T15:04:34.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:34 smithi190 ceph-mon[178398]: failed to encode map e82 with expected crc 2023-12-06T15:04:34.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:34 smithi152 ceph-mon[192652]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-06T15:04:34.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:34 smithi152 ceph-mon[192652]: osdmap e82: 6 total, 5 up, 6 in 2023-12-06T15:04:34.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:34 smithi152 ceph-mon[192652]: from='osd.4 [v2:172.21.15.190:6808/3285745876,v1:172.21.15.190:6809/3285745876]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-12-06T15:04:34.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:34 smithi152 ceph-mon[192652]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-12-06T15:04:34.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:34 smithi152 ceph-mon[192652]: failed to encode map e82 with expected crc 2023-12-06T15:04:35.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:35 smithi190 ceph-mon[178398]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-06T15:04:35.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:35 smithi190 ceph-mon[178398]: failed to encode map e83 with expected crc 2023-12-06T15:04:35.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:35 smithi190 ceph-mon[178398]: osd.4 [v2:172.21.15.190:6808/3285745876,v1:172.21.15.190:6809/3285745876] boot 2023-12-06T15:04:35.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:35 smithi190 ceph-mon[178398]: osdmap e83: 6 total, 6 up, 6 in 2023-12-06T15:04:35.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:35 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-06T15:04:35.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:35 smithi190 ceph-mon[178398]: failed to encode map e83 with expected crc 2023-12-06T15:04:35.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:35 smithi190 ceph-mon[178398]: pgmap v130: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 290 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 57/348 objects degraded (16.379%) 2023-12-06T15:04:35.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:35 smithi190 ceph-mon[178398]: osdmap e84: 6 total, 6 up, 6 in 2023-12-06T15:04:35.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:35 smithi152 ceph-mon[192652]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-06T15:04:35.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:35 smithi152 ceph-mon[192652]: failed to encode map e83 with expected crc 2023-12-06T15:04:35.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:35 smithi152 ceph-mon[192652]: osd.4 [v2:172.21.15.190:6808/3285745876,v1:172.21.15.190:6809/3285745876] boot 2023-12-06T15:04:35.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:35 smithi152 ceph-mon[192652]: osdmap e83: 6 total, 6 up, 6 in 2023-12-06T15:04:35.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:35 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-06T15:04:35.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:35 smithi152 ceph-mon[192652]: failed to encode map e83 with expected crc 2023-12-06T15:04:35.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:35 smithi152 ceph-mon[192652]: pgmap v130: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 290 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 57/348 objects degraded (16.379%) 2023-12-06T15:04:35.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:35 smithi152 ceph-mon[192652]: osdmap e84: 6 total, 6 up, 6 in 2023-12-06T15:04:36.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:36 smithi190 ceph-mon[178398]: failed to encode map e84 with expected crc 2023-12-06T15:04:36.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:36 smithi190 ceph-mon[178398]: failed to encode map e84 with expected crc 2023-12-06T15:04:36.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:36 smithi190 ceph-mon[178398]: Health check update: Degraded data redundancy: 57/348 objects degraded (16.379%), 16 pgs degraded (PG_DEGRADED) 2023-12-06T15:04:36.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:36 smithi152 ceph-mon[192652]: failed to encode map e84 with expected crc 2023-12-06T15:04:36.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:36 smithi152 ceph-mon[192652]: failed to encode map e84 with expected crc 2023-12-06T15:04:36.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:36 smithi152 ceph-mon[192652]: Health check update: Degraded data redundancy: 57/348 objects degraded (16.379%), 16 pgs degraded (PG_DEGRADED) 2023-12-06T15:04:37.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:37 smithi190 ceph-mon[178398]: pgmap v132: 65 pgs: 10 active+undersized, 10 active+undersized+degraded, 45 active+clean; 290 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 6 op/s; 30/348 objects degraded (8.621%) 2023-12-06T15:04:37.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:37 smithi152 ceph-mon[192652]: pgmap v132: 65 pgs: 10 active+undersized, 10 active+undersized+degraded, 45 active+clean; 290 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 6 op/s; 30/348 objects degraded (8.621%) 2023-12-06T15:04:39.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:38 smithi190 ceph-mon[178398]: pgmap v133: 65 pgs: 65 active+clean; 290 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2023-12-06T15:04:39.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:38 smithi190 ceph-mon[178398]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 30/348 objects degraded (8.621%), 10 pgs degraded) 2023-12-06T15:04:39.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:38 smithi190 ceph-mon[178398]: Cluster is now healthy 2023-12-06T15:04:39.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:38 smithi152 ceph-mon[192652]: pgmap v133: 65 pgs: 65 active+clean; 290 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2023-12-06T15:04:39.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:38 smithi152 ceph-mon[192652]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 30/348 objects degraded (8.621%), 10 pgs degraded) 2023-12-06T15:04:39.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:38 smithi152 ceph-mon[192652]: Cluster is now healthy 2023-12-06T15:04:42.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:41 smithi190 ceph-mon[178398]: pgmap v134: 65 pgs: 65 active+clean; 290 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2023-12-06T15:04:42.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:41 smithi152 ceph-mon[192652]: pgmap v134: 65 pgs: 65 active+clean; 290 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2023-12-06T15:04:44.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:43 smithi190 ceph-mon[178398]: pgmap v135: 65 pgs: 65 active+clean; 290 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2023-12-06T15:04:44.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:43 smithi152 ceph-mon[192652]: pgmap v135: 65 pgs: 65 active+clean; 290 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2023-12-06T15:04:46.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:45 smithi190 ceph-mon[178398]: pgmap v136: 65 pgs: 65 active+clean; 290 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2023-12-06T15:04:46.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:45 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:46.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:45 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:04:46.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:45 smithi152 ceph-mon[192652]: pgmap v136: 65 pgs: 65 active+clean; 290 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2023-12-06T15:04:46.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:45 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:46.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:45 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:04:46.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:46.938+0000 7f1c28e59700 1 -- 172.21.15.152:0/1896477663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c240ffd90 msgr2=0x7f1c241021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:46.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:46.938+0000 7f1c28e59700 1 --2- 172.21.15.152:0/1896477663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c240ffd90 0x7f1c241021d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1c18004940 tx=0x7f1c18009e30 comp rx=0 tx=0).stop 2023-12-06T15:04:46.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:46.938+0000 7f1c28e59700 1 -- 172.21.15.152:0/1896477663 shutdown_connections 2023-12-06T15:04:46.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:46.938+0000 7f1c28e59700 1 --2- 172.21.15.152:0/1896477663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c240ffd90 0x7f1c241021d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:46.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:46.938+0000 7f1c28e59700 1 --2- 172.21.15.152:0/1896477663 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c24066900 0x7f1c240ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:46.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:46.938+0000 7f1c28e59700 1 -- 172.21.15.152:0/1896477663 >> 172.21.15.152:0/1896477663 conn(0x7f1c240f71b0 msgr2=0x7f1c240f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:04:46.939 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:46.938+0000 7f1c28e59700 1 -- 172.21.15.152:0/1896477663 shutdown_connections 2023-12-06T15:04:46.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:46.938+0000 7f1c28e59700 1 -- 172.21.15.152:0/1896477663 wait complete. 2023-12-06T15:04:46.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:46.938+0000 7f1c28e59700 1 Processor -- start 2023-12-06T15:04:46.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:46.938+0000 7f1c28e59700 1 -- start start 2023-12-06T15:04:46.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:46.939+0000 7f1c28e59700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c24066900 0x7f1c2410d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:46.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:46.939+0000 7f1c28e59700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c240ffd90 0x7f1c2410da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:46.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:46.939+0000 7f1c28e59700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2410e000 con 0x7f1c24066900 2023-12-06T15:04:46.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:46.939+0000 7f1c28e59700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2410e8a0 con 0x7f1c240ffd90 2023-12-06T15:04:46.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:46.939+0000 7f1c2259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c24066900 0x7f1c2410d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:46.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:46.939+0000 7f1c2259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c24066900 0x7f1c2410d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44974/0 (socket says 172.21.15.152:44974) 2023-12-06T15:04:46.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:46.939+0000 7f1c2259c700 1 -- 172.21.15.152:0/2834641227 learned_addr learned my addr 172.21.15.152:0/2834641227 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:04:46.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:46.939+0000 7f1c21d9b700 1 --2- 172.21.15.152:0/2834641227 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c240ffd90 0x7f1c2410da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:46.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:46.939+0000 7f1c2259c700 1 -- 172.21.15.152:0/2834641227 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c240ffd90 msgr2=0x7f1c2410da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:46.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:46.939+0000 7f1c2259c700 1 --2- 172.21.15.152:0/2834641227 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c240ffd90 0x7f1c2410da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:46.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:46.939+0000 7f1c2259c700 1 -- 172.21.15.152:0/2834641227 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c18005040 con 0x7f1c24066900 2023-12-06T15:04:46.940 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:46.939+0000 7f1c2259c700 1 --2- 172.21.15.152:0/2834641227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c24066900 0x7f1c2410d4c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1c14002a80 tx=0x7f1c140046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:04:46.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:46.939+0000 7f1c12ffd700 1 -- 172.21.15.152:0/2834641227 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c14007cc0 con 0x7f1c24066900 2023-12-06T15:04:46.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:46.939+0000 7f1c12ffd700 1 -- 172.21.15.152:0/2834641227 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1c1400f040 con 0x7f1c24066900 2023-12-06T15:04:46.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:46.939+0000 7f1c28e59700 1 -- 172.21.15.152:0/2834641227 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c2410eb80 con 0x7f1c24066900 2023-12-06T15:04:46.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:46.939+0000 7f1c12ffd700 1 -- 172.21.15.152:0/2834641227 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c14009640 con 0x7f1c24066900 2023-12-06T15:04:46.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:46.939+0000 7f1c28e59700 1 -- 172.21.15.152:0/2834641227 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c2410f0c0 con 0x7f1c24066900 2023-12-06T15:04:46.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:46.940+0000 7f1c28e59700 1 -- 172.21.15.152:0/2834641227 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c2404bb80 con 0x7f1c24066900 2023-12-06T15:04:46.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:46.941+0000 7f1c12ffd700 1 -- 172.21.15.152:0/2834641227 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f1c140097a0 con 0x7f1c24066900 2023-12-06T15:04:46.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:46.941+0000 7f1c12ffd700 1 --2- 172.21.15.152:0/2834641227 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f1c0c06ce60 0x7f1c0c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:46.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:46.941+0000 7f1c12ffd700 1 -- 172.21.15.152:0/2834641227 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f1c1408bbc0 con 0x7f1c24066900 2023-12-06T15:04:46.942 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:46.941+0000 7f1c21d9b700 1 --2- 172.21.15.152:0/2834641227 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f1c0c06ce60 0x7f1c0c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:46.943 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:46.942+0000 7f1c21d9b700 1 --2- 172.21.15.152:0/2834641227 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f1c0c06ce60 0x7f1c0c06f310 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1c1800b3b0 tx=0x7f1c18009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:04:46.946 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:46.946+0000 7f1c12ffd700 1 -- 172.21.15.152:0/2834641227 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1c14059420 con 0x7f1c24066900 2023-12-06T15:04:47.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:46 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:47.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:46 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:47.152 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.152+0000 7f1c28e59700 1 -- 172.21.15.152:0/2834641227 --> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c2410f4e0 con 0x7f1c0c06ce60 2023-12-06T15:04:47.154 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.154+0000 7f1c12ffd700 1 -- 172.21.15.152:0/2834641227 <== mgr.34104 v2:172.21.15.152:6800/2427836422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f1c2410f4e0 con 0x7f1c0c06ce60 2023-12-06T15:04:47.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.156+0000 7f1c28e59700 1 -- 172.21.15.152:0/2834641227 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f1c0c06ce60 msgr2=0x7f1c0c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:47.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.156+0000 7f1c28e59700 1 --2- 172.21.15.152:0/2834641227 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f1c0c06ce60 0x7f1c0c06f310 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1c1800b3b0 tx=0x7f1c18009e30 comp rx=0 tx=0).stop 2023-12-06T15:04:47.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.156+0000 7f1c28e59700 1 -- 172.21.15.152:0/2834641227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c24066900 msgr2=0x7f1c2410d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:47.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.156+0000 7f1c28e59700 1 --2- 172.21.15.152:0/2834641227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c24066900 0x7f1c2410d4c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1c14002a80 tx=0x7f1c140046b0 comp rx=0 tx=0).stop 2023-12-06T15:04:47.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.156+0000 7f1c28e59700 1 -- 172.21.15.152:0/2834641227 shutdown_connections 2023-12-06T15:04:47.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.156+0000 7f1c28e59700 1 --2- 172.21.15.152:0/2834641227 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f1c0c06ce60 0x7f1c0c06f310 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:47.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.156+0000 7f1c28e59700 1 --2- 172.21.15.152:0/2834641227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1c24066900 0x7f1c2410d4c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:47.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.156+0000 7f1c28e59700 1 --2- 172.21.15.152:0/2834641227 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1c240ffd90 0x7f1c2410da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:47.156 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.156+0000 7f1c28e59700 1 -- 172.21.15.152:0/2834641227 >> 172.21.15.152:0/2834641227 conn(0x7f1c240f71b0 msgr2=0x7f1c240f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:04:47.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.156+0000 7f1c28e59700 1 -- 172.21.15.152:0/2834641227 shutdown_connections 2023-12-06T15:04:47.157 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.156+0000 7f1c28e59700 1 -- 172.21.15.152:0/2834641227 wait complete. 2023-12-06T15:04:47.166 INFO:teuthology.orchestra.run.smithi152.stdout:true 2023-12-06T15:04:47.258 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.257+0000 7fd65a3d1700 1 -- 172.21.15.152:0/2498920784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6540ffdd0 msgr2=0x7fd6541021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:47.258 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.257+0000 7fd65a3d1700 1 --2- 172.21.15.152:0/2498920784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6540ffdd0 0x7fd6541021d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd648004940 tx=0x7fd648009e30 comp rx=0 tx=0).stop 2023-12-06T15:04:47.258 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.257+0000 7fd65a3d1700 1 -- 172.21.15.152:0/2498920784 shutdown_connections 2023-12-06T15:04:47.258 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.257+0000 7fd65a3d1700 1 --2- 172.21.15.152:0/2498920784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6540ffdd0 0x7fd6541021d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:47.258 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.257+0000 7fd65a3d1700 1 --2- 172.21.15.152:0/2498920784 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6540668c0 0x7fd6540ff800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:47.258 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.257+0000 7fd65a3d1700 1 -- 172.21.15.152:0/2498920784 >> 172.21.15.152:0/2498920784 conn(0x7fd6540f71b0 msgr2=0x7fd6540f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:04:47.258 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.257+0000 7fd65a3d1700 1 -- 172.21.15.152:0/2498920784 shutdown_connections 2023-12-06T15:04:47.258 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.257+0000 7fd65a3d1700 1 -- 172.21.15.152:0/2498920784 wait complete. 2023-12-06T15:04:47.258 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.258+0000 7fd65a3d1700 1 Processor -- start 2023-12-06T15:04:47.260 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.258+0000 7fd65a3d1700 1 -- start start 2023-12-06T15:04:47.260 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.258+0000 7fd65a3d1700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6540668c0 0x7fd6540fd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:47.260 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.258+0000 7fd65a3d1700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6540ffdd0 0x7fd6540fb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:47.260 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.258+0000 7fd65a3d1700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6540fbd90 con 0x7fd6540ffdd0 2023-12-06T15:04:47.260 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.258+0000 7fd65a3d1700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6540fbf00 con 0x7fd6540668c0 2023-12-06T15:04:47.260 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.258+0000 7fd6537fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6540ffdd0 0x7fd6540fb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:47.260 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.258+0000 7fd6537fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6540ffdd0 0x7fd6540fb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44990/0 (socket says 172.21.15.152:44990) 2023-12-06T15:04:47.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.258+0000 7fd6537fe700 1 -- 172.21.15.152:0/3437161610 learned_addr learned my addr 172.21.15.152:0/3437161610 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:04:47.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.258+0000 7fd653fff700 1 --2- 172.21.15.152:0/3437161610 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6540668c0 0x7fd6540fd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:47.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.258+0000 7fd6537fe700 1 -- 172.21.15.152:0/3437161610 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6540668c0 msgr2=0x7fd6540fd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:47.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.258+0000 7fd6537fe700 1 --2- 172.21.15.152:0/3437161610 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6540668c0 0x7fd6540fd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:47.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.259+0000 7fd6537fe700 1 -- 172.21.15.152:0/3437161610 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd648005040 con 0x7fd6540ffdd0 2023-12-06T15:04:47.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.259+0000 7fd653fff700 1 --2- 172.21.15.152:0/3437161610 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6540668c0 0x7fd6540fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-06T15:04:47.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.259+0000 7fd6537fe700 1 --2- 172.21.15.152:0/3437161610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6540ffdd0 0x7fd6540fb700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd648004f90 tx=0x7fd648009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:04:47.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.259+0000 7fd650ff9700 1 -- 172.21.15.152:0/3437161610 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd64800e040 con 0x7fd6540ffdd0 2023-12-06T15:04:47.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.259+0000 7fd65a3d1700 1 -- 172.21.15.152:0/3437161610 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6540fc180 con 0x7fd6540ffdd0 2023-12-06T15:04:47.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.259+0000 7fd650ff9700 1 -- 172.21.15.152:0/3437161610 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd64800bcd0 con 0x7fd6540ffdd0 2023-12-06T15:04:47.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.259+0000 7fd650ff9700 1 -- 172.21.15.152:0/3437161610 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd64801c630 con 0x7fd6540ffdd0 2023-12-06T15:04:47.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.259+0000 7fd65a3d1700 1 -- 172.21.15.152:0/3437161610 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd654115540 con 0x7fd6540ffdd0 2023-12-06T15:04:47.261 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.260+0000 7fd65a3d1700 1 -- 172.21.15.152:0/3437161610 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd65404bb80 con 0x7fd6540ffdd0 2023-12-06T15:04:47.262 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.260+0000 7fd650ff9700 1 -- 172.21.15.152:0/3437161610 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fd648013960 con 0x7fd6540ffdd0 2023-12-06T15:04:47.262 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.261+0000 7fd650ff9700 1 --2- 172.21.15.152:0/3437161610 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fd63c06ceb0 0x7fd63c06f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:47.262 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.261+0000 7fd650ff9700 1 -- 172.21.15.152:0/3437161610 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6675+0+0 (secure 0 0 0) 0x7fd64808d960 con 0x7fd6540ffdd0 2023-12-06T15:04:47.262 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.261+0000 7fd653fff700 1 --2- 172.21.15.152:0/3437161610 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fd63c06ceb0 0x7fd63c06f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:47.262 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.261+0000 7fd653fff700 1 --2- 172.21.15.152:0/3437161610 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fd63c06ceb0 0x7fd63c06f360 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd644006fd0 tx=0x7fd644008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:04:47.265 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.265+0000 7fd650ff9700 1 -- 172.21.15.152:0/3437161610 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fd64805b1a0 con 0x7fd6540ffdd0 2023-12-06T15:04:47.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.471+0000 7fd65a3d1700 1 -- 172.21.15.152:0/3437161610 --> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd654100a30 con 0x7fd63c06ceb0 2023-12-06T15:04:47.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.472+0000 7fd650ff9700 1 -- 172.21.15.152:0/3437161610 <== mgr.34104 v2:172.21.15.152:6800/2427836422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fd654100a30 con 0x7fd63c06ceb0 2023-12-06T15:04:47.475 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.475+0000 7fd65a3d1700 1 -- 172.21.15.152:0/3437161610 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fd63c06ceb0 msgr2=0x7fd63c06f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:47.475 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.475+0000 7fd65a3d1700 1 --2- 172.21.15.152:0/3437161610 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fd63c06ceb0 0x7fd63c06f360 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd644006fd0 tx=0x7fd644008040 comp rx=0 tx=0).stop 2023-12-06T15:04:47.475 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.475+0000 7fd65a3d1700 1 -- 172.21.15.152:0/3437161610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6540ffdd0 msgr2=0x7fd6540fb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:47.475 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.475+0000 7fd65a3d1700 1 --2- 172.21.15.152:0/3437161610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6540ffdd0 0x7fd6540fb700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd648004f90 tx=0x7fd648009e30 comp rx=0 tx=0).stop 2023-12-06T15:04:47.475 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.475+0000 7fd65a3d1700 1 -- 172.21.15.152:0/3437161610 shutdown_connections 2023-12-06T15:04:47.475 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.475+0000 7fd65a3d1700 1 --2- 172.21.15.152:0/3437161610 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fd63c06ceb0 0x7fd63c06f360 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:47.475 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.475+0000 7fd65a3d1700 1 --2- 172.21.15.152:0/3437161610 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6540668c0 0x7fd6540fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:47.475 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.475+0000 7fd65a3d1700 1 --2- 172.21.15.152:0/3437161610 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6540ffdd0 0x7fd6540fb700 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:47.476 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.475+0000 7fd65a3d1700 1 -- 172.21.15.152:0/3437161610 >> 172.21.15.152:0/3437161610 conn(0x7fd6540f71b0 msgr2=0x7fd6540f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:04:47.476 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.475+0000 7fd65a3d1700 1 -- 172.21.15.152:0/3437161610 shutdown_connections 2023-12-06T15:04:47.476 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.475+0000 7fd65a3d1700 1 -- 172.21.15.152:0/3437161610 wait complete. 2023-12-06T15:04:47.577 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.577+0000 7f30d176d700 1 -- 172.21.15.152:0/1599974268 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30cc0fcd00 msgr2=0x7f30cc0fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:47.577 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.577+0000 7f30d176d700 1 --2- 172.21.15.152:0/1599974268 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30cc0fcd00 0x7f30cc0fd150 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f30bc004940 tx=0x7f30bc009e30 comp rx=0 tx=0).stop 2023-12-06T15:04:47.577 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.577+0000 7f30d176d700 1 -- 172.21.15.152:0/1599974268 shutdown_connections 2023-12-06T15:04:47.577 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.577+0000 7f30d176d700 1 --2- 172.21.15.152:0/1599974268 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30cc0fcd00 0x7f30cc0fd150 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:47.577 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.577+0000 7f30d176d700 1 --2- 172.21.15.152:0/1599974268 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f30cc0fbaf0 0x7f30cc0fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:47.577 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.577+0000 7f30d176d700 1 -- 172.21.15.152:0/1599974268 >> 172.21.15.152:0/1599974268 conn(0x7f30cc0f71b0 msgr2=0x7f30cc0f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:04:47.577 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.577+0000 7f30d176d700 1 -- 172.21.15.152:0/1599974268 shutdown_connections 2023-12-06T15:04:47.577 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.577+0000 7f30d176d700 1 -- 172.21.15.152:0/1599974268 wait complete. 2023-12-06T15:04:47.579 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.578+0000 7f30d176d700 1 Processor -- start 2023-12-06T15:04:47.579 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.578+0000 7f30d176d700 1 -- start start 2023-12-06T15:04:47.579 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.578+0000 7f30d176d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30cc0fbaf0 0x7f30cc10c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:47.579 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.578+0000 7f30d176d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f30cc0fcd00 0x7f30cc10c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:47.579 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.578+0000 7f30d176d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc10cf30 con 0x7f30cc0fbaf0 2023-12-06T15:04:47.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.578+0000 7f30d176d700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc10d7d0 con 0x7f30cc0fcd00 2023-12-06T15:04:47.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.578+0000 7f30caffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30cc0fbaf0 0x7f30cc10c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:47.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.578+0000 7f30caffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30cc0fbaf0 0x7f30cc10c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44996/0 (socket says 172.21.15.152:44996) 2023-12-06T15:04:47.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.578+0000 7f30caffd700 1 -- 172.21.15.152:0/19513060 learned_addr learned my addr 172.21.15.152:0/19513060 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:04:47.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.578+0000 7f30ca7fc700 1 --2- 172.21.15.152:0/19513060 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f30cc0fcd00 0x7f30cc10c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:47.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.578+0000 7f30caffd700 1 -- 172.21.15.152:0/19513060 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f30cc0fcd00 msgr2=0x7f30cc10c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:47.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.578+0000 7f30caffd700 1 --2- 172.21.15.152:0/19513060 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f30cc0fcd00 0x7f30cc10c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:47.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.578+0000 7f30caffd700 1 -- 172.21.15.152:0/19513060 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30bc005040 con 0x7f30cc0fbaf0 2023-12-06T15:04:47.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.578+0000 7f30caffd700 1 --2- 172.21.15.152:0/19513060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30cc0fbaf0 0x7f30cc10c3f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f30c000c8b0 tx=0x7f30c0004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:04:47.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.579+0000 7f30b37fe700 1 -- 172.21.15.152:0/19513060 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30c000a760 con 0x7f30cc0fbaf0 2023-12-06T15:04:47.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.579+0000 7f30b37fe700 1 -- 172.21.15.152:0/19513060 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f30c000ad70 con 0x7f30cc0fbaf0 2023-12-06T15:04:47.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.579+0000 7f30d176d700 1 -- 172.21.15.152:0/19513060 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30cc10dab0 con 0x7f30cc0fbaf0 2023-12-06T15:04:47.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.579+0000 7f30b37fe700 1 -- 172.21.15.152:0/19513060 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30c00113a0 con 0x7f30cc0fbaf0 2023-12-06T15:04:47.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.579+0000 7f30d176d700 1 -- 172.21.15.152:0/19513060 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30cc10dff0 con 0x7f30cc0fbaf0 2023-12-06T15:04:47.581 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.580+0000 7f30b37fe700 1 -- 172.21.15.152:0/19513060 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f30c0012400 con 0x7f30cc0fbaf0 2023-12-06T15:04:47.581 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.580+0000 7f30d176d700 1 -- 172.21.15.152:0/19513060 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30cc04bb80 con 0x7f30cc0fbaf0 2023-12-06T15:04:47.581 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.580+0000 7f30b37fe700 1 --2- 172.21.15.152:0/19513060 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f30b406ce60 0x7f30b406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:47.582 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.580+0000 7f30b37fe700 1 -- 172.21.15.152:0/19513060 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f30c008c350 con 0x7f30cc0fbaf0 2023-12-06T15:04:47.582 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.581+0000 7f30ca7fc700 1 --2- 172.21.15.152:0/19513060 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f30b406ce60 0x7f30b406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:47.582 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.581+0000 7f30ca7fc700 1 --2- 172.21.15.152:0/19513060 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f30b406ce60 0x7f30b406f310 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f30bc00b3b0 tx=0x7f30bc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:04:47.585 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.585+0000 7f30b37fe700 1 -- 172.21.15.152:0/19513060 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f30c0059cd0 con 0x7f30cc0fbaf0 2023-12-06T15:04:47.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.787+0000 7f30d176d700 1 -- 172.21.15.152:0/19513060 --> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f30cc10e4f0 con 0x7f30b406ce60 2023-12-06T15:04:47.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.797+0000 7f30b37fe700 1 -- 172.21.15.152:0/19513060 <== mgr.34104 v2:172.21.15.152:6800/2427836422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f30cc10e4f0 con 0x7f30b406ce60 2023-12-06T15:04:47.797 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-06T15:04:47.797 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 running (4m) 72s ago 10m 26.3M - 0.25.0 c8568f914cd2 b1a46cc95546 2023-12-06T15:04:47.797 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (2m) 72s ago 10m 7470k - 19.0.0-26-g0482646f 26bb7d89db2e 222039c21ee0 2023-12-06T15:04:47.797 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi190 smithi190 running (2m) 18s ago 9m 7461k - 19.0.0-26-g0482646f 26bb7d89db2e 8841ae485b70 2023-12-06T15:04:47.797 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (4m) 72s ago 10m 88.0M - 9.4.7 954c08fa6188 5c6a52d58144 2023-12-06T15:04:47.798 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.acqswy smithi152 running (6m) 72s ago 6m 5566M - 17.2.7-113-gece0d607 a5c6421f1c5f ff9375cec192 2023-12-06T15:04:47.798 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.ypivwc smithi152 running (6m) 72s ago 6m 538M - 17.2.7-113-gece0d607 a5c6421f1c5f d809a681491b 2023-12-06T15:04:47.798 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi190.edwtqj smithi190 running (6m) 18s ago 6m 626M - 17.2.7-113-gece0d607 a5c6421f1c5f f3b7ebd93b04 2023-12-06T15:04:47.798 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi190.uucxzu smithi190 running (6m) 18s ago 6m 4860M - 17.2.7-113-gece0d607 a5c6421f1c5f c01be1409c5f 2023-12-06T15:04:47.798 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.meodco smithi152 *:8443,9283,8765 running (4m) 72s ago 11m 510M - 19.0.0-26-g0482646f 26bb7d89db2e 16ed2af8a3d0 2023-12-06T15:04:47.798 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi190.ubusrr smithi190 *:8443,9283,8765 running (3m) 18s ago 9m 449M - 19.0.0-26-g0482646f 26bb7d89db2e cfae14b9324d 2023-12-06T15:04:47.798 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (3m) 72s ago 11m 66.8M 2048M 19.0.0-26-g0482646f 26bb7d89db2e f5163d3b0f5f 2023-12-06T15:04:47.798 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi190 smithi190 running (3m) 18s ago 9m 54.0M 2048M 19.0.0-26-g0482646f 26bb7d89db2e b25040d5fdfe 2023-12-06T15:04:47.798 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 running (4m) 72s ago 10m 18.5M - 1.5.0 0da6a335fe13 81be696b9be8 2023-12-06T15:04:47.798 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi190 smithi190 *:9100 running (4m) 18s ago 9m 18.9M - 1.5.0 0da6a335fe13 2e521e235bf7 2023-12-06T15:04:47.798 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (2m) 72s ago 9m 169M 1568M 19.0.0-26-g0482646f 26bb7d89db2e 05e00966036e 2023-12-06T15:04:47.799 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (105s) 72s ago 8m 122M 1568M 19.0.0-26-g0482646f 26bb7d89db2e c0eaab4b2fd0 2023-12-06T15:04:47.799 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (76s) 72s ago 8m 12.6M 1568M 19.0.0-26-g0482646f 26bb7d89db2e 1440f943b48e 2023-12-06T15:04:47.799 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi190 running (47s) 18s ago 8m 122M 2592M 19.0.0-26-g0482646f 26bb7d89db2e 9871106e0a4f 2023-12-06T15:04:47.799 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi190 running (20s) 18s ago 8m 12.1M 2592M 19.0.0-26-g0482646f 26bb7d89db2e c2350bc6d448 2023-12-06T15:04:47.799 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi190 running (7m) 18s ago 7m 1083M 2592M 17.2.7-113-gece0d607 a5c6421f1c5f b0f2767055a5 2023-12-06T15:04:47.799 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi152 smithi152 *:9095 running (3m) 72s ago 10m 48.7M - 2.43.0 a07b618ecd1d 5f7e5860a419 2023-12-06T15:04:47.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.799+0000 7f30d176d700 1 -- 172.21.15.152:0/19513060 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f30b406ce60 msgr2=0x7f30b406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:47.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.799+0000 7f30d176d700 1 --2- 172.21.15.152:0/19513060 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f30b406ce60 0x7f30b406f310 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f30bc00b3b0 tx=0x7f30bc009e30 comp rx=0 tx=0).stop 2023-12-06T15:04:47.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.799+0000 7f30d176d700 1 -- 172.21.15.152:0/19513060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30cc0fbaf0 msgr2=0x7f30cc10c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:47.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.799+0000 7f30d176d700 1 --2- 172.21.15.152:0/19513060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30cc0fbaf0 0x7f30cc10c3f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f30c000c8b0 tx=0x7f30c0004470 comp rx=0 tx=0).stop 2023-12-06T15:04:47.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.799+0000 7f30d176d700 1 -- 172.21.15.152:0/19513060 shutdown_connections 2023-12-06T15:04:47.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.799+0000 7f30d176d700 1 --2- 172.21.15.152:0/19513060 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f30b406ce60 0x7f30b406f310 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:47.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.799+0000 7f30d176d700 1 --2- 172.21.15.152:0/19513060 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f30cc0fbaf0 0x7f30cc10c3f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:47.801 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.799+0000 7f30d176d700 1 --2- 172.21.15.152:0/19513060 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f30cc0fcd00 0x7f30cc10c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:47.801 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.799+0000 7f30d176d700 1 -- 172.21.15.152:0/19513060 >> 172.21.15.152:0/19513060 conn(0x7f30cc0f71b0 msgr2=0x7f30cc0fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:04:47.801 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.799+0000 7f30d176d700 1 -- 172.21.15.152:0/19513060 shutdown_connections 2023-12-06T15:04:47.801 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.799+0000 7f30d176d700 1 -- 172.21.15.152:0/19513060 wait complete. 2023-12-06T15:04:47.900 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.900+0000 7f0d6acdc700 1 -- 172.21.15.152:0/3515011306 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d640fde00 msgr2=0x7f0d640fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:47.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.900+0000 7f0d6acdc700 1 --2- 172.21.15.152:0/3515011306 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d640fde00 0x7f0d640fe250 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0d50004940 tx=0x7f0d50009e30 comp rx=0 tx=0).stop 2023-12-06T15:04:47.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.900+0000 7f0d6acdc700 1 -- 172.21.15.152:0/3515011306 shutdown_connections 2023-12-06T15:04:47.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.900+0000 7f0d6acdc700 1 --2- 172.21.15.152:0/3515011306 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d640fde00 0x7f0d640fe250 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:47.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.900+0000 7f0d6acdc700 1 --2- 172.21.15.152:0/3515011306 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d640fcbf0 0x7f0d640fd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:47.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.900+0000 7f0d6acdc700 1 -- 172.21.15.152:0/3515011306 >> 172.21.15.152:0/3515011306 conn(0x7f0d640f82d0 msgr2=0x7f0d640fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:04:47.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.900+0000 7f0d6acdc700 1 -- 172.21.15.152:0/3515011306 shutdown_connections 2023-12-06T15:04:47.901 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.900+0000 7f0d6acdc700 1 -- 172.21.15.152:0/3515011306 wait complete. 2023-12-06T15:04:47.902 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.900+0000 7f0d6acdc700 1 Processor -- start 2023-12-06T15:04:47.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.900+0000 7f0d6acdc700 1 -- start start 2023-12-06T15:04:47.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.901+0000 7f0d6acdc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d640fcbf0 0x7f0d6410d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:47.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.901+0000 7f0d6acdc700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d640fde00 0x7f0d6410da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:47.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.901+0000 7f0d6acdc700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6410e000 con 0x7f0d640fde00 2023-12-06T15:04:47.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.901+0000 7f0d6acdc700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6410e8a0 con 0x7f0d640fcbf0 2023-12-06T15:04:47.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.901+0000 7f0d63fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d640fde00 0x7f0d6410da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:47.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.901+0000 7f0d63fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d640fde00 0x7f0d6410da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45016/0 (socket says 172.21.15.152:45016) 2023-12-06T15:04:47.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.901+0000 7f0d63fff700 1 -- 172.21.15.152:0/118615624 learned_addr learned my addr 172.21.15.152:0/118615624 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:04:47.903 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.901+0000 7f0d68a78700 1 --2- 172.21.15.152:0/118615624 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d640fcbf0 0x7f0d6410d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:47.905 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.901+0000 7f0d63fff700 1 -- 172.21.15.152:0/118615624 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d640fcbf0 msgr2=0x7f0d6410d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:47.905 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.901+0000 7f0d63fff700 1 --2- 172.21.15.152:0/118615624 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d640fcbf0 0x7f0d6410d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:47.906 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.901+0000 7f0d63fff700 1 -- 172.21.15.152:0/118615624 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d50005040 con 0x7f0d640fde00 2023-12-06T15:04:47.906 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.901+0000 7f0d63fff700 1 --2- 172.21.15.152:0/118615624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d640fde00 0x7f0d6410da00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0d50000c00 tx=0x7f0d50009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:04:47.906 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.901+0000 7f0d617fa700 1 -- 172.21.15.152:0/118615624 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d50021070 con 0x7f0d640fde00 2023-12-06T15:04:47.906 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.901+0000 7f0d6acdc700 1 -- 172.21.15.152:0/118615624 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d6410eb20 con 0x7f0d640fde00 2023-12-06T15:04:47.906 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.901+0000 7f0d617fa700 1 -- 172.21.15.152:0/118615624 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0d5001c400 con 0x7f0d640fde00 2023-12-06T15:04:47.907 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.901+0000 7f0d617fa700 1 -- 172.21.15.152:0/118615624 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d5000e070 con 0x7f0d640fde00 2023-12-06T15:04:47.907 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.901+0000 7f0d6acdc700 1 -- 172.21.15.152:0/118615624 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d6410f000 con 0x7f0d640fde00 2023-12-06T15:04:47.907 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.902+0000 7f0d6acdc700 1 -- 172.21.15.152:0/118615624 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d6404bb80 con 0x7f0d640fde00 2023-12-06T15:04:47.907 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.903+0000 7f0d617fa700 1 -- 172.21.15.152:0/118615624 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f0d5001c9c0 con 0x7f0d640fde00 2023-12-06T15:04:47.907 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.903+0000 7f0d617fa700 1 --2- 172.21.15.152:0/118615624 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f0d5406ce60 0x7f0d5406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:47.907 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.903+0000 7f0d617fa700 1 -- 172.21.15.152:0/118615624 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f0d5008d5c0 con 0x7f0d640fde00 2023-12-06T15:04:47.907 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.903+0000 7f0d68a78700 1 --2- 172.21.15.152:0/118615624 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f0d5406ce60 0x7f0d5406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:47.907 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.904+0000 7f0d68a78700 1 --2- 172.21.15.152:0/118615624 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f0d5406ce60 0x7f0d5406f310 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0d58009b80 tx=0x7f0d5800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:04:47.908 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:47.908+0000 7f0d617fa700 1 -- 172.21.15.152:0/118615624 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f0d5005aea0 con 0x7f0d640fde00 2023-12-06T15:04:48.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:47 smithi190 ceph-mon[178398]: pgmap v137: 65 pgs: 65 active+clean; 290 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-06T15:04:48.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:47 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-06T15:04:48.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:47 smithi152 ceph-mon[192652]: pgmap v137: 65 pgs: 65 active+clean; 290 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-06T15:04:48.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:47 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-06T15:04:48.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.176+0000 7f0d6acdc700 1 -- 172.21.15.152:0/118615624 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0d64105590 con 0x7f0d640fde00 2023-12-06T15:04:48.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.176+0000 7f0d617fa700 1 -- 172.21.15.152:0/118615624 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+827 (secure 0 0 0) 0x7f0d5005aa30 con 0x7f0d640fde00 2023-12-06T15:04:48.176 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-12-06T15:04:48.177 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": { 2023-12-06T15:04:48.177 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 2 2023-12-06T15:04:48.177 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:04:48.177 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": { 2023-12-06T15:04:48.177 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 2 2023-12-06T15:04:48.177 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:04:48.177 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": { 2023-12-06T15:04:48.177 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 1, 2023-12-06T15:04:48.177 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 5 2023-12-06T15:04:48.177 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:04:48.177 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2023-12-06T15:04:48.177 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 4 2023-12-06T15:04:48.177 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:04:48.177 INFO:teuthology.orchestra.run.smithi152.stdout: "overall": { 2023-12-06T15:04:48.177 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 5, 2023-12-06T15:04:48.177 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 9 2023-12-06T15:04:48.178 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-12-06T15:04:48.178 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-12-06T15:04:48.178 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.178+0000 7f0d6acdc700 1 -- 172.21.15.152:0/118615624 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f0d5406ce60 msgr2=0x7f0d5406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:48.178 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.178+0000 7f0d6acdc700 1 --2- 172.21.15.152:0/118615624 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f0d5406ce60 0x7f0d5406f310 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0d58009b80 tx=0x7f0d5800b040 comp rx=0 tx=0).stop 2023-12-06T15:04:48.178 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.178+0000 7f0d6acdc700 1 -- 172.21.15.152:0/118615624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d640fde00 msgr2=0x7f0d6410da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:48.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.178+0000 7f0d6acdc700 1 --2- 172.21.15.152:0/118615624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d640fde00 0x7f0d6410da00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0d50000c00 tx=0x7f0d50009e30 comp rx=0 tx=0).stop 2023-12-06T15:04:48.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.178+0000 7f0d6acdc700 1 -- 172.21.15.152:0/118615624 shutdown_connections 2023-12-06T15:04:48.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.178+0000 7f0d6acdc700 1 --2- 172.21.15.152:0/118615624 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f0d5406ce60 0x7f0d5406f310 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:48.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.178+0000 7f0d6acdc700 1 --2- 172.21.15.152:0/118615624 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d640fcbf0 0x7f0d6410d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:48.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.178+0000 7f0d6acdc700 1 --2- 172.21.15.152:0/118615624 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d640fde00 0x7f0d6410da00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:48.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.178+0000 7f0d6acdc700 1 -- 172.21.15.152:0/118615624 >> 172.21.15.152:0/118615624 conn(0x7f0d640f82d0 msgr2=0x7f0d64101030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:04:48.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.178+0000 7f0d6acdc700 1 -- 172.21.15.152:0/118615624 shutdown_connections 2023-12-06T15:04:48.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.178+0000 7f0d6acdc700 1 -- 172.21.15.152:0/118615624 wait complete. 2023-12-06T15:04:48.280 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.278+0000 7fda1fef5700 1 -- 172.21.15.152:0/305953691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda180fbaf0 msgr2=0x7fda180fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:48.280 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.278+0000 7fda1fef5700 1 --2- 172.21.15.152:0/305953691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda180fbaf0 0x7fda180fbf00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fda0c004940 tx=0x7fda0c009e30 comp rx=0 tx=0).stop 2023-12-06T15:04:48.280 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.278+0000 7fda1fef5700 1 -- 172.21.15.152:0/305953691 shutdown_connections 2023-12-06T15:04:48.280 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.278+0000 7fda1fef5700 1 --2- 172.21.15.152:0/305953691 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda180fcd00 0x7fda180fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:48.280 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.278+0000 7fda1fef5700 1 --2- 172.21.15.152:0/305953691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda180fbaf0 0x7fda180fbf00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:48.280 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.278+0000 7fda1fef5700 1 -- 172.21.15.152:0/305953691 >> 172.21.15.152:0/305953691 conn(0x7fda180f7190 msgr2=0x7fda180f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:04:48.280 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.278+0000 7fda1fef5700 1 -- 172.21.15.152:0/305953691 shutdown_connections 2023-12-06T15:04:48.280 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.278+0000 7fda1fef5700 1 -- 172.21.15.152:0/305953691 wait complete. 2023-12-06T15:04:48.280 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.279+0000 7fda1fef5700 1 Processor -- start 2023-12-06T15:04:48.280 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.279+0000 7fda1fef5700 1 -- start start 2023-12-06T15:04:48.280 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.279+0000 7fda1fef5700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda180fbaf0 0x7fda1810f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:48.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.279+0000 7fda1fef5700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda180fcd00 0x7fda1810fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:48.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.279+0000 7fda1fef5700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda18110340 con 0x7fda180fbaf0 2023-12-06T15:04:48.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.279+0000 7fda1fef5700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda18110b80 con 0x7fda180fcd00 2023-12-06T15:04:48.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.279+0000 7fda1dc91700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda180fbaf0 0x7fda1810f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:48.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.279+0000 7fda1dc91700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda180fbaf0 0x7fda1810f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45028/0 (socket says 172.21.15.152:45028) 2023-12-06T15:04:48.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.279+0000 7fda1dc91700 1 -- 172.21.15.152:0/1093518684 learned_addr learned my addr 172.21.15.152:0/1093518684 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:04:48.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.279+0000 7fda1d490700 1 --2- 172.21.15.152:0/1093518684 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda180fcd00 0x7fda1810fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:48.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.279+0000 7fda1dc91700 1 -- 172.21.15.152:0/1093518684 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda180fcd00 msgr2=0x7fda1810fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:48.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.279+0000 7fda1dc91700 1 --2- 172.21.15.152:0/1093518684 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda180fcd00 0x7fda1810fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:48.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.279+0000 7fda1dc91700 1 -- 172.21.15.152:0/1093518684 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0c005040 con 0x7fda180fbaf0 2023-12-06T15:04:48.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.280+0000 7fda1dc91700 1 --2- 172.21.15.152:0/1093518684 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda180fbaf0 0x7fda1810f770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fda0c004f90 tx=0x7fda0c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:04:48.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.280+0000 7fda0a7fc700 1 -- 172.21.15.152:0/1093518684 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda0c00e040 con 0x7fda180fbaf0 2023-12-06T15:04:48.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.280+0000 7fda1fef5700 1 -- 172.21.15.152:0/1093518684 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda18110e00 con 0x7fda180fbaf0 2023-12-06T15:04:48.281 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.280+0000 7fda0a7fc700 1 -- 172.21.15.152:0/1093518684 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fda0c00bc50 con 0x7fda180fbaf0 2023-12-06T15:04:48.282 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.280+0000 7fda0a7fc700 1 -- 172.21.15.152:0/1093518684 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda0c01c630 con 0x7fda180fbaf0 2023-12-06T15:04:48.282 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.280+0000 7fda1fef5700 1 -- 172.21.15.152:0/1093518684 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda18111340 con 0x7fda180fbaf0 2023-12-06T15:04:48.282 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.281+0000 7fda1fef5700 1 -- 172.21.15.152:0/1093518684 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda1804bb80 con 0x7fda180fbaf0 2023-12-06T15:04:48.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.281+0000 7fda0a7fc700 1 -- 172.21.15.152:0/1093518684 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fda0c013420 con 0x7fda180fbaf0 2023-12-06T15:04:48.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.282+0000 7fda0a7fc700 1 --2- 172.21.15.152:0/1093518684 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fda0406ce60 0x7fda0406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:48.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.282+0000 7fda0a7fc700 1 -- 172.21.15.152:0/1093518684 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6675+0+0 (secure 0 0 0) 0x7fda0c08d7c0 con 0x7fda180fbaf0 2023-12-06T15:04:48.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.282+0000 7fda1d490700 1 --2- 172.21.15.152:0/1093518684 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fda0406ce60 0x7fda0406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:48.283 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.282+0000 7fda1d490700 1 --2- 172.21.15.152:0/1093518684 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fda0406ce60 0x7fda0406f310 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fda14009bf0 tx=0x7fda140091a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:04:48.286 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.286+0000 7fda0a7fc700 1 -- 172.21.15.152:0/1093518684 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fda0c05b0a0 con 0x7fda180fbaf0 2023-12-06T15:04:48.525 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.525+0000 7fda1fef5700 1 -- 172.21.15.152:0/1093518684 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fda181117b0 con 0x7fda180fbaf0 2023-12-06T15:04:48.526 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.526+0000 7fda0a7fc700 1 -- 172.21.15.152:0/1093518684 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1873 (secure 0 0 0) 0x7fda0c05ac30 con 0x7fda180fbaf0 2023-12-06T15:04:48.526 INFO:teuthology.orchestra.run.smithi152.stdout:e18 2023-12-06T15:04:48.526 INFO:teuthology.orchestra.run.smithi152.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-06T15:04:48.526 INFO:teuthology.orchestra.run.smithi152.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-06T15:04:48.526 INFO:teuthology.orchestra.run.smithi152.stdout:legacy client fscid: 1 2023-12-06T15:04:48.526 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T15:04:48.527 INFO:teuthology.orchestra.run.smithi152.stdout:Filesystem 'cephfs' (1) 2023-12-06T15:04:48.527 INFO:teuthology.orchestra.run.smithi152.stdout:fs_name cephfs 2023-12-06T15:04:48.527 INFO:teuthology.orchestra.run.smithi152.stdout:epoch 18 2023-12-06T15:04:48.527 INFO:teuthology.orchestra.run.smithi152.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-06T15:04:48.527 INFO:teuthology.orchestra.run.smithi152.stdout:created 2023-12-06T14:57:59.352201+0000 2023-12-06T15:04:48.527 INFO:teuthology.orchestra.run.smithi152.stdout:modified 2023-12-06T15:03:48.238467+0000 2023-12-06T15:04:48.527 INFO:teuthology.orchestra.run.smithi152.stdout:tableserver 0 2023-12-06T15:04:48.527 INFO:teuthology.orchestra.run.smithi152.stdout:root 0 2023-12-06T15:04:48.527 INFO:teuthology.orchestra.run.smithi152.stdout:session_timeout 60 2023-12-06T15:04:48.527 INFO:teuthology.orchestra.run.smithi152.stdout:session_autoclose 300 2023-12-06T15:04:48.527 INFO:teuthology.orchestra.run.smithi152.stdout:max_file_size 1099511627776 2023-12-06T15:04:48.527 INFO:teuthology.orchestra.run.smithi152.stdout:max_xattr_size 65536 2023-12-06T15:04:48.527 INFO:teuthology.orchestra.run.smithi152.stdout:required_client_features {} 2023-12-06T15:04:48.527 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure 0 2023-12-06T15:04:48.527 INFO:teuthology.orchestra.run.smithi152.stdout:last_failure_osd_epoch 0 2023-12-06T15:04:48.528 INFO:teuthology.orchestra.run.smithi152.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-06T15:04:48.528 INFO:teuthology.orchestra.run.smithi152.stdout:max_mds 2 2023-12-06T15:04:48.528 INFO:teuthology.orchestra.run.smithi152.stdout:in 0,1 2023-12-06T15:04:48.528 INFO:teuthology.orchestra.run.smithi152.stdout:up {0=14464,1=24255} 2023-12-06T15:04:48.528 INFO:teuthology.orchestra.run.smithi152.stdout:failed 2023-12-06T15:04:48.528 INFO:teuthology.orchestra.run.smithi152.stdout:damaged 2023-12-06T15:04:48.528 INFO:teuthology.orchestra.run.smithi152.stdout:stopped 2023-12-06T15:04:48.528 INFO:teuthology.orchestra.run.smithi152.stdout:data_pools [3] 2023-12-06T15:04:48.528 INFO:teuthology.orchestra.run.smithi152.stdout:metadata_pool 2 2023-12-06T15:04:48.528 INFO:teuthology.orchestra.run.smithi152.stdout:inline_data disabled 2023-12-06T15:04:48.528 INFO:teuthology.orchestra.run.smithi152.stdout:balancer 2023-12-06T15:04:48.528 INFO:teuthology.orchestra.run.smithi152.stdout:bal_rank_mask -1 2023-12-06T15:04:48.528 INFO:teuthology.orchestra.run.smithi152.stdout:standby_count_wanted 1 2023-12-06T15:04:48.528 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.acqswy{0:14464} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.152:6826/2467413186,v1:172.21.15.152:6827/2467413186] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:04:48.528 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi190.edwtqj{0:24271} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.190:6826/2256465065,v1:172.21.15.190:6827/2256465065] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:04:48.529 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi190.uucxzu{1:24255} state up:active seq 3 join_fscid=1 addr [v2:172.21.15.190:6824/3250692478,v1:172.21.15.190:6825/3250692478] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:04:48.529 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.cephfs.smithi152.ypivwc{1:14480} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.152:6828/697313573,v1:172.21.15.152:6829/697313573] compat {c=[1],r=[1],i=[7ff]}] 2023-12-06T15:04:48.529 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T15:04:48.529 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T15:04:48.529 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.528+0000 7fda1fef5700 1 -- 172.21.15.152:0/1093518684 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fda0406ce60 msgr2=0x7fda0406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:48.529 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.528+0000 7fda1fef5700 1 --2- 172.21.15.152:0/1093518684 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fda0406ce60 0x7fda0406f310 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fda14009bf0 tx=0x7fda140091a0 comp rx=0 tx=0).stop 2023-12-06T15:04:48.530 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.528+0000 7fda1fef5700 1 -- 172.21.15.152:0/1093518684 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda180fbaf0 msgr2=0x7fda1810f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:48.530 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.528+0000 7fda1fef5700 1 --2- 172.21.15.152:0/1093518684 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda180fbaf0 0x7fda1810f770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fda0c004f90 tx=0x7fda0c009e30 comp rx=0 tx=0).stop 2023-12-06T15:04:48.530 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.528+0000 7fda1fef5700 1 -- 172.21.15.152:0/1093518684 shutdown_connections 2023-12-06T15:04:48.530 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.528+0000 7fda1fef5700 1 --2- 172.21.15.152:0/1093518684 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fda0406ce60 0x7fda0406f310 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:48.530 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.528+0000 7fda1fef5700 1 --2- 172.21.15.152:0/1093518684 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda180fbaf0 0x7fda1810f770 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:48.530 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.528+0000 7fda1fef5700 1 --2- 172.21.15.152:0/1093518684 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda180fcd00 0x7fda1810fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:48.530 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.528+0000 7fda1fef5700 1 -- 172.21.15.152:0/1093518684 >> 172.21.15.152:0/1093518684 conn(0x7fda180f7190 msgr2=0x7fda18065370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:04:48.530 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.528+0000 7fda1fef5700 1 -- 172.21.15.152:0/1093518684 shutdown_connections 2023-12-06T15:04:48.530 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.528+0000 7fda1fef5700 1 -- 172.21.15.152:0/1093518684 wait complete. 2023-12-06T15:04:48.530 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 18 2023-12-06T15:04:48.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.630+0000 7f5b2b864700 1 -- 172.21.15.152:0/3199103696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b240ffd70 msgr2=0x7f5b241021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:48.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.630+0000 7f5b2b864700 1 --2- 172.21.15.152:0/3199103696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b240ffd70 0x7f5b241021d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5b14004940 tx=0x7f5b14009e30 comp rx=0 tx=0).stop 2023-12-06T15:04:48.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.630+0000 7f5b2b864700 1 -- 172.21.15.152:0/3199103696 shutdown_connections 2023-12-06T15:04:48.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.630+0000 7f5b2b864700 1 --2- 172.21.15.152:0/3199103696 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b240ffd70 0x7f5b241021d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:48.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.630+0000 7f5b2b864700 1 --2- 172.21.15.152:0/3199103696 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5b24066090 0x7f5b240ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:48.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.630+0000 7f5b2b864700 1 -- 172.21.15.152:0/3199103696 >> 172.21.15.152:0/3199103696 conn(0x7f5b240f7190 msgr2=0x7f5b240f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:04:48.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.630+0000 7f5b2b864700 1 -- 172.21.15.152:0/3199103696 shutdown_connections 2023-12-06T15:04:48.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.630+0000 7f5b2b864700 1 -- 172.21.15.152:0/3199103696 wait complete. 2023-12-06T15:04:48.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.631+0000 7f5b2b864700 1 Processor -- start 2023-12-06T15:04:48.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.631+0000 7f5b2b864700 1 -- start start 2023-12-06T15:04:48.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.631+0000 7f5b2b864700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5b24066090 0x7f5b2410d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:48.632 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.631+0000 7f5b2b864700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b240ffd70 0x7f5b2410da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:48.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.631+0000 7f5b2b864700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2410e020 con 0x7f5b240ffd70 2023-12-06T15:04:48.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.631+0000 7f5b2b864700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2410e8c0 con 0x7f5b24066090 2023-12-06T15:04:48.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.631+0000 7f5b28dff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b240ffd70 0x7f5b2410da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:48.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.631+0000 7f5b28dff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b240ffd70 0x7f5b2410da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45044/0 (socket says 172.21.15.152:45044) 2023-12-06T15:04:48.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.631+0000 7f5b28dff700 1 -- 172.21.15.152:0/2948338548 learned_addr learned my addr 172.21.15.152:0/2948338548 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:04:48.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.631+0000 7f5b29600700 1 --2- 172.21.15.152:0/2948338548 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5b24066090 0x7f5b2410d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:48.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.631+0000 7f5b28dff700 1 -- 172.21.15.152:0/2948338548 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5b24066090 msgr2=0x7f5b2410d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:48.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.631+0000 7f5b28dff700 1 --2- 172.21.15.152:0/2948338548 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5b24066090 0x7f5b2410d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:48.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.631+0000 7f5b28dff700 1 -- 172.21.15.152:0/2948338548 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b14005040 con 0x7f5b240ffd70 2023-12-06T15:04:48.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.631+0000 7f5b28dff700 1 --2- 172.21.15.152:0/2948338548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b240ffd70 0x7f5b2410da20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5b14000c00 tx=0x7f5b14009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:04:48.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.632+0000 7f5b19ffb700 1 -- 172.21.15.152:0/2948338548 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b14021070 con 0x7f5b240ffd70 2023-12-06T15:04:48.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.632+0000 7f5b2b864700 1 -- 172.21.15.152:0/2948338548 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b2410eb40 con 0x7f5b240ffd70 2023-12-06T15:04:48.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.632+0000 7f5b19ffb700 1 -- 172.21.15.152:0/2948338548 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5b1401c400 con 0x7f5b240ffd70 2023-12-06T15:04:48.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.632+0000 7f5b19ffb700 1 -- 172.21.15.152:0/2948338548 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b1400e070 con 0x7f5b240ffd70 2023-12-06T15:04:48.633 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.632+0000 7f5b2b864700 1 -- 172.21.15.152:0/2948338548 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b2410f020 con 0x7f5b240ffd70 2023-12-06T15:04:48.634 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.633+0000 7f5b2b864700 1 -- 172.21.15.152:0/2948338548 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b2404bb80 con 0x7f5b240ffd70 2023-12-06T15:04:48.634 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.633+0000 7f5b19ffb700 1 -- 172.21.15.152:0/2948338548 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f5b1401ca00 con 0x7f5b240ffd70 2023-12-06T15:04:48.635 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.634+0000 7f5b19ffb700 1 --2- 172.21.15.152:0/2948338548 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f5b1006ce60 0x7f5b1006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:48.635 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.634+0000 7f5b19ffb700 1 -- 172.21.15.152:0/2948338548 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f5b1408d550 con 0x7f5b240ffd70 2023-12-06T15:04:48.635 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.634+0000 7f5b29600700 1 --2- 172.21.15.152:0/2948338548 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f5b1006ce60 0x7f5b1006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:48.635 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.634+0000 7f5b29600700 1 --2- 172.21.15.152:0/2948338548 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f5b1006ce60 0x7f5b1006f310 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5b20009b80 tx=0x7f5b2000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:04:48.638 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.638+0000 7f5b19ffb700 1 -- 172.21.15.152:0/2948338548 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f5b1405ae30 con 0x7f5b240ffd70 2023-12-06T15:04:48.852 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.852+0000 7f5b2b864700 1 -- 172.21.15.152:0/2948338548 --> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b2410f430 con 0x7f5b1006ce60 2023-12-06T15:04:48.853 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.853+0000 7f5b19ffb700 1 -- 172.21.15.152:0/2948338548 <== mgr.34104 v2:172.21.15.152:6800/2427836422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f5b2410f430 con 0x7f5b1006ce60 2023-12-06T15:04:48.853 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-12-06T15:04:48.853 INFO:teuthology.orchestra.run.smithi152.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e331a81036b9c4be9167bdaf54e458c7294ca3446212b9c6126786d23318b1cf", 2023-12-06T15:04:48.853 INFO:teuthology.orchestra.run.smithi152.stdout: "in_progress": true, 2023-12-06T15:04:48.854 INFO:teuthology.orchestra.run.smithi152.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-06T15:04:48.854 INFO:teuthology.orchestra.run.smithi152.stdout: "services_complete": [ 2023-12-06T15:04:48.854 INFO:teuthology.orchestra.run.smithi152.stdout: "crash", 2023-12-06T15:04:48.854 INFO:teuthology.orchestra.run.smithi152.stdout: "mon", 2023-12-06T15:04:48.854 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr" 2023-12-06T15:04:48.854 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2023-12-06T15:04:48.854 INFO:teuthology.orchestra.run.smithi152.stdout: "progress": "11/21 daemons upgraded", 2023-12-06T15:04:48.854 INFO:teuthology.orchestra.run.smithi152.stdout: "message": "Currently upgrading osd daemons", 2023-12-06T15:04:48.854 INFO:teuthology.orchestra.run.smithi152.stdout: "is_paused": false 2023-12-06T15:04:48.854 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-12-06T15:04:48.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.855+0000 7f5b2b864700 1 -- 172.21.15.152:0/2948338548 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f5b1006ce60 msgr2=0x7f5b1006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:48.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.855+0000 7f5b2b864700 1 --2- 172.21.15.152:0/2948338548 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f5b1006ce60 0x7f5b1006f310 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5b20009b80 tx=0x7f5b2000b040 comp rx=0 tx=0).stop 2023-12-06T15:04:48.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.855+0000 7f5b2b864700 1 -- 172.21.15.152:0/2948338548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b240ffd70 msgr2=0x7f5b2410da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:48.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.855+0000 7f5b2b864700 1 --2- 172.21.15.152:0/2948338548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b240ffd70 0x7f5b2410da20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5b14000c00 tx=0x7f5b14009e30 comp rx=0 tx=0).stop 2023-12-06T15:04:48.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.855+0000 7f5b2b864700 1 -- 172.21.15.152:0/2948338548 shutdown_connections 2023-12-06T15:04:48.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.855+0000 7f5b2b864700 1 --2- 172.21.15.152:0/2948338548 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f5b1006ce60 0x7f5b1006f310 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:48.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.856+0000 7f5b2b864700 1 --2- 172.21.15.152:0/2948338548 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5b24066090 0x7f5b2410d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:48.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.856+0000 7f5b2b864700 1 --2- 172.21.15.152:0/2948338548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b240ffd70 0x7f5b2410da20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:48.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.856+0000 7f5b2b864700 1 -- 172.21.15.152:0/2948338548 >> 172.21.15.152:0/2948338548 conn(0x7f5b240f7190 msgr2=0x7f5b240f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:04:48.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.856+0000 7f5b2b864700 1 -- 172.21.15.152:0/2948338548 shutdown_connections 2023-12-06T15:04:48.856 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.856+0000 7f5b2b864700 1 -- 172.21.15.152:0/2948338548 wait complete. 2023-12-06T15:04:48.956 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.956+0000 7f7f25f1d700 1 -- 172.21.15.152:0/1816979927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f200fbaf0 msgr2=0x7f7f200fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:48.956 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.956+0000 7f7f25f1d700 1 --2- 172.21.15.152:0/1816979927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f200fbaf0 0x7f7f200fbf00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7f10004940 tx=0x7f7f10009e30 comp rx=0 tx=0).stop 2023-12-06T15:04:48.956 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.956+0000 7f7f25f1d700 1 -- 172.21.15.152:0/1816979927 shutdown_connections 2023-12-06T15:04:48.956 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.956+0000 7f7f25f1d700 1 --2- 172.21.15.152:0/1816979927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f200fcd00 0x7f7f200fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:48.956 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.956+0000 7f7f25f1d700 1 --2- 172.21.15.152:0/1816979927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f200fbaf0 0x7f7f200fbf00 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:48.957 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.956+0000 7f7f25f1d700 1 -- 172.21.15.152:0/1816979927 >> 172.21.15.152:0/1816979927 conn(0x7f7f200f71b0 msgr2=0x7f7f200f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:04:48.957 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.956+0000 7f7f25f1d700 1 -- 172.21.15.152:0/1816979927 shutdown_connections 2023-12-06T15:04:48.957 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.956+0000 7f7f25f1d700 1 -- 172.21.15.152:0/1816979927 wait complete. 2023-12-06T15:04:48.957 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.956+0000 7f7f25f1d700 1 Processor -- start 2023-12-06T15:04:48.959 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.956+0000 7f7f25f1d700 1 -- start start 2023-12-06T15:04:48.959 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.957+0000 7f7f25f1d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f200fbaf0 0x7f7f2010c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:48.959 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.957+0000 7f7f25f1d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f200fcd00 0x7f7f2010c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:48.959 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.957+0000 7f7f25f1d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2010cf10 con 0x7f7f200fbaf0 2023-12-06T15:04:48.959 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.957+0000 7f7f25f1d700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2010d7b0 con 0x7f7f200fcd00 2023-12-06T15:04:48.959 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.957+0000 7f7f1f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f200fbaf0 0x7f7f2010c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:48.959 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.957+0000 7f7f1f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f200fbaf0 0x7f7f2010c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45060/0 (socket says 172.21.15.152:45060) 2023-12-06T15:04:48.959 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.957+0000 7f7f1f7fe700 1 -- 172.21.15.152:0/874321409 learned_addr learned my addr 172.21.15.152:0/874321409 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:04:48.959 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.957+0000 7f7f1effd700 1 --2- 172.21.15.152:0/874321409 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f200fcd00 0x7f7f2010c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:48.959 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.957+0000 7f7f1f7fe700 1 -- 172.21.15.152:0/874321409 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f200fcd00 msgr2=0x7f7f2010c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:48.959 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.957+0000 7f7f1f7fe700 1 --2- 172.21.15.152:0/874321409 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f200fcd00 0x7f7f2010c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:48.960 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.957+0000 7f7f1f7fe700 1 -- 172.21.15.152:0/874321409 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f10005040 con 0x7f7f200fbaf0 2023-12-06T15:04:48.960 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.957+0000 7f7f1f7fe700 1 --2- 172.21.15.152:0/874321409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f200fbaf0 0x7f7f2010c3d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7f10009380 tx=0x7f7f10009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:04:48.960 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.957+0000 7f7f17fff700 1 -- 172.21.15.152:0/874321409 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f1000e040 con 0x7f7f200fbaf0 2023-12-06T15:04:48.960 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.957+0000 7f7f25f1d700 1 -- 172.21.15.152:0/874321409 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f2010da30 con 0x7f7f200fbaf0 2023-12-06T15:04:48.960 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.957+0000 7f7f17fff700 1 -- 172.21.15.152:0/874321409 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7f1000be60 con 0x7f7f200fbaf0 2023-12-06T15:04:48.960 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.957+0000 7f7f17fff700 1 -- 172.21.15.152:0/874321409 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f10013660 con 0x7f7f200fbaf0 2023-12-06T15:04:48.960 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.957+0000 7f7f25f1d700 1 -- 172.21.15.152:0/874321409 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f2010df10 con 0x7f7f200fbaf0 2023-12-06T15:04:48.960 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.958+0000 7f7f25f1d700 1 -- 172.21.15.152:0/874321409 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f2004bb80 con 0x7f7f200fbaf0 2023-12-06T15:04:48.960 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.959+0000 7f7f17fff700 1 -- 172.21.15.152:0/874321409 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f7f1001ea60 con 0x7f7f200fbaf0 2023-12-06T15:04:48.961 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.959+0000 7f7f17fff700 1 --2- 172.21.15.152:0/874321409 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f7f0c06ce60 0x7f7f0c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:04:48.961 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.959+0000 7f7f17fff700 1 -- 172.21.15.152:0/874321409 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f7f10090340 con 0x7f7f200fbaf0 2023-12-06T15:04:48.961 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.959+0000 7f7f1effd700 1 --2- 172.21.15.152:0/874321409 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f7f0c06ce60 0x7f7f0c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:04:48.961 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.960+0000 7f7f1effd700 1 --2- 172.21.15.152:0/874321409 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f7f0c06ce60 0x7f7f0c06f310 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7f08009fd0 tx=0x7f7f0800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:04:48.964 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:48.964+0000 7f7f17fff700 1 -- 172.21.15.152:0/874321409 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f7f1005dba0 con 0x7f7f200fbaf0 2023-12-06T15:04:49.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:48 smithi190 ceph-mon[178398]: from='client.34310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:04:49.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:48 smithi190 ceph-mon[178398]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:04:49.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:48 smithi190 ceph-mon[178398]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-06T15:04:49.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:48 smithi190 ceph-mon[178398]: Upgrade: osd.5 is safe to restart 2023-12-06T15:04:49.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:48 smithi190 ceph-mon[178398]: from='client.? 172.21.15.152:0/118615624' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:04:49.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:48 smithi190 ceph-mon[178398]: from='client.? 172.21.15.152:0/1093518684' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-06T15:04:49.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:48 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:49.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:48 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-06T15:04:49.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:48 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:04:49.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:48 smithi152 ceph-mon[192652]: from='client.34310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:04:49.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:48 smithi152 ceph-mon[192652]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:04:49.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:48 smithi152 ceph-mon[192652]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2023-12-06T15:04:49.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:48 smithi152 ceph-mon[192652]: Upgrade: osd.5 is safe to restart 2023-12-06T15:04:49.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:48 smithi152 ceph-mon[192652]: from='client.? 172.21.15.152:0/118615624' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:04:49.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:48 smithi152 ceph-mon[192652]: from='client.? 172.21.15.152:0/1093518684' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-06T15:04:49.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:48 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:49.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:48 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-06T15:04:49.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:48 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:04:49.235 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:49.234+0000 7f7f25f1d700 1 -- 172.21.15.152:0/874321409 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7f20104490 con 0x7f7f200fbaf0 2023-12-06T15:04:49.235 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:49.235+0000 7f7f17fff700 1 -- 172.21.15.152:0/874321409 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f7f1005d730 con 0x7f7f200fbaf0 2023-12-06T15:04:49.236 INFO:teuthology.orchestra.run.smithi152.stdout:HEALTH_OK 2023-12-06T15:04:49.237 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:49.237+0000 7f7f25f1d700 1 -- 172.21.15.152:0/874321409 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f7f0c06ce60 msgr2=0x7f7f0c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:49.237 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:49.237+0000 7f7f25f1d700 1 --2- 172.21.15.152:0/874321409 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f7f0c06ce60 0x7f7f0c06f310 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7f08009fd0 tx=0x7f7f0800b040 comp rx=0 tx=0).stop 2023-12-06T15:04:49.238 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:49.237+0000 7f7f25f1d700 1 -- 172.21.15.152:0/874321409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f200fbaf0 msgr2=0x7f7f2010c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:04:49.238 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:49.237+0000 7f7f25f1d700 1 --2- 172.21.15.152:0/874321409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f200fbaf0 0x7f7f2010c3d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7f10009380 tx=0x7f7f10009e30 comp rx=0 tx=0).stop 2023-12-06T15:04:49.238 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:49.237+0000 7f7f25f1d700 1 -- 172.21.15.152:0/874321409 shutdown_connections 2023-12-06T15:04:49.238 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:49.237+0000 7f7f25f1d700 1 --2- 172.21.15.152:0/874321409 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f7f0c06ce60 0x7f7f0c06f310 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:49.238 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:49.237+0000 7f7f25f1d700 1 --2- 172.21.15.152:0/874321409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7f200fbaf0 0x7f7f2010c3d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:49.239 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:49.237+0000 7f7f25f1d700 1 --2- 172.21.15.152:0/874321409 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f200fcd00 0x7f7f2010c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:04:49.239 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:49.237+0000 7f7f25f1d700 1 -- 172.21.15.152:0/874321409 >> 172.21.15.152:0/874321409 conn(0x7f7f200f71b0 msgr2=0x7f7f200fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:04:49.239 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:49.237+0000 7f7f25f1d700 1 -- 172.21.15.152:0/874321409 shutdown_connections 2023-12-06T15:04:49.239 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:04:49.237+0000 7f7f25f1d700 1 -- 172.21.15.152:0/874321409 wait complete. 2023-12-06T15:04:50.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:49 smithi190 ceph-mon[178398]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:04:50.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:49 smithi190 ceph-mon[178398]: pgmap v138: 65 pgs: 65 active+clean; 290 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:04:50.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:49 smithi190 ceph-mon[178398]: Upgrade: Updating osd.5 2023-12-06T15:04:50.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:49 smithi190 ceph-mon[178398]: Deploying daemon osd.5 on smithi190 2023-12-06T15:04:50.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:49 smithi190 ceph-mon[178398]: from='client.? 172.21.15.152:0/874321409' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-06T15:04:50.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:49 smithi152 ceph-mon[192652]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:04:50.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:49 smithi152 ceph-mon[192652]: pgmap v138: 65 pgs: 65 active+clean; 290 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:04:50.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:49 smithi152 ceph-mon[192652]: Upgrade: Updating osd.5 2023-12-06T15:04:50.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:49 smithi152 ceph-mon[192652]: Deploying daemon osd.5 on smithi190 2023-12-06T15:04:50.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:49 smithi152 ceph-mon[192652]: from='client.? 172.21.15.152:0/874321409' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-06T15:04:51.010 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:50 smithi190 ceph-mon[178398]: from='client.34330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:04:51.010 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:04:50 smithi190 systemd[1]: Stopping Ceph osd.5 for 062f0e3c-9447-11ee-95a2-87774f69a715... 2023-12-06T15:04:51.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:50 smithi152 ceph-mon[192652]: from='client.34330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:04:51.322 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:04:51 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-5[145013]: 2023-12-06T15:04:51.008+0000 7f3772934700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-06T15:04:51.322 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:04:51 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-5[145013]: 2023-12-06T15:04:51.008+0000 7f3772934700 -1 osd.5 84 *** Got signal Terminated *** 2023-12-06T15:04:51.323 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:04:51 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-5[145013]: 2023-12-06T15:04:51.008+0000 7f3772934700 -1 osd.5 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-06T15:04:52.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:51 smithi190 ceph-mon[178398]: pgmap v139: 65 pgs: 65 active+clean; 290 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:04:52.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:51 smithi190 ceph-mon[178398]: osd.5 marked itself down and dead 2023-12-06T15:04:52.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:51 smithi152 ceph-mon[192652]: pgmap v139: 65 pgs: 65 active+clean; 290 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:04:52.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:51 smithi152 ceph-mon[192652]: osd.5 marked itself down and dead 2023-12-06T15:04:52.731 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:04:52 smithi190 bash[203251]: ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-5 2023-12-06T15:04:53.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:52 smithi190 ceph-mon[178398]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-06T15:04:53.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:52 smithi190 ceph-mon[178398]: osdmap e85: 6 total, 5 up, 6 in 2023-12-06T15:04:53.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:52 smithi190 ceph-mon[178398]: pgmap v141: 65 pgs: 14 peering, 7 stale+active+clean, 44 active+clean; 290 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-06T15:04:53.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:52 smithi152 ceph-mon[192652]: Health check failed: 1 osds down (OSD_DOWN) 2023-12-06T15:04:53.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:52 smithi152 ceph-mon[192652]: osdmap e85: 6 total, 5 up, 6 in 2023-12-06T15:04:53.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:52 smithi152 ceph-mon[192652]: pgmap v141: 65 pgs: 14 peering, 7 stale+active+clean, 44 active+clean; 290 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2023-12-06T15:04:54.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:53 smithi190 ceph-mon[178398]: Health check failed: Reduced data availability: 1 pg inactive, 7 pgs peering (PG_AVAILABILITY) 2023-12-06T15:04:54.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:53 smithi190 ceph-mon[178398]: osdmap e86: 6 total, 5 up, 6 in 2023-12-06T15:04:54.073 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:04:53 smithi190 systemd[1]: ceph-062f0e3c-9447-11ee-95a2-87774f69a715@osd.5.service: Succeeded. 2023-12-06T15:04:54.073 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:04:53 smithi190 systemd[1]: Stopped Ceph osd.5 for 062f0e3c-9447-11ee-95a2-87774f69a715. 2023-12-06T15:04:54.073 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:04:53 smithi190 systemd[1]: Starting Ceph osd.5 for 062f0e3c-9447-11ee-95a2-87774f69a715... 2023-12-06T15:04:54.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:53 smithi152 ceph-mon[192652]: Health check failed: Reduced data availability: 1 pg inactive, 7 pgs peering (PG_AVAILABILITY) 2023-12-06T15:04:54.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:53 smithi152 ceph-mon[192652]: osdmap e86: 6 total, 5 up, 6 in 2023-12-06T15:04:55.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:54 smithi190 ceph-mon[178398]: pgmap v143: 65 pgs: 4 active+undersized, 5 active+undersized+degraded, 14 peering, 3 stale+active+clean, 39 active+clean; 290 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 14/348 objects degraded (4.023%) 2023-12-06T15:04:55.073 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:04:54 smithi190 bash[203518]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-06T15:04:55.073 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:04:54 smithi190 bash[203518]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2023-12-06T15:04:55.073 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:04:54 smithi190 bash[203518]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2023-12-06T15:04:55.073 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:04:54 smithi190 bash[203518]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2023-12-06T15:04:55.073 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:04:54 smithi190 bash[203518]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2023-12-06T15:04:55.073 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:04:54 smithi190 bash[203518]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-06T15:04:55.073 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:04:54 smithi190 bash[203518]: --> ceph-volume raw activate successful for osd ID: 5 2023-12-06T15:04:55.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:54 smithi152 ceph-mon[192652]: pgmap v143: 65 pgs: 4 active+undersized, 5 active+undersized+degraded, 14 peering, 3 stale+active+clean, 39 active+clean; 290 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 14/348 objects degraded (4.023%) 2023-12-06T15:04:55.739 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:04:55 smithi190 ceph-osd[203809]: -- 172.21.15.190:0/2366823515 <== mon.1 v2:172.21.15.190:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5654fa9ff1e0 con 0x5654fa9cf000 2023-12-06T15:04:55.739 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:04:55 smithi190 bash[203772]: 8e8b6c38342a83cc9a4dc9f7a32c95e927a847df9fc8a2b82c043242c7d2e4dc 2023-12-06T15:04:55.739 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:04:55 smithi190 systemd[1]: Started Ceph osd.5 for 062f0e3c-9447-11ee-95a2-87774f69a715. 2023-12-06T15:04:56.072 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:04:55 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-5[203786]: 2023-12-06T15:04:55.857+0000 7f1775957640 -1 Falling back to public interface 2023-12-06T15:04:56.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:55 smithi190 ceph-mon[178398]: Health check failed: Degraded data redundancy: 14/348 objects degraded (4.023%), 5 pgs degraded (PG_DEGRADED) 2023-12-06T15:04:56.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:55 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:56.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:55 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:56.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:55 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:04:56.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:55 smithi152 ceph-mon[192652]: Health check failed: Degraded data redundancy: 14/348 objects degraded (4.023%), 5 pgs degraded (PG_DEGRADED) 2023-12-06T15:04:56.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:55 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:56.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:55 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:56.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:55 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:04:57.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:56 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:57.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:56 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:57.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:56 smithi190 ceph-mon[178398]: pgmap v144: 65 pgs: 7 active+undersized, 9 active+undersized+degraded, 14 peering, 35 active+clean; 290 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 36/348 objects degraded (10.345%) 2023-12-06T15:04:57.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:56 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:57.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:56 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:57.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:56 smithi152 ceph-mon[192652]: pgmap v144: 65 pgs: 7 active+undersized, 9 active+undersized+degraded, 14 peering, 35 active+clean; 290 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 36/348 objects degraded (10.345%) 2023-12-06T15:04:58.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:58 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:58.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:58 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:58.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:58 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:58.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:58 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:58.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:58 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:58.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:58 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:58.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:58 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:58.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:58 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:04:59.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:04:59 smithi190 ceph-mon[178398]: pgmap v145: 65 pgs: 15 active+undersized, 15 active+undersized+degraded, 35 active+clean; 290 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 57/348 objects degraded (16.379%) 2023-12-06T15:04:59.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:04:59 smithi152 ceph-mon[192652]: pgmap v145: 65 pgs: 15 active+undersized, 15 active+undersized+degraded, 35 active+clean; 290 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 57/348 objects degraded (16.379%) 2023-12-06T15:05:00.392 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:05:00 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-5[203786]: 2023-12-06T15:05:00.098+0000 7f1775957640 -1 osd.5 0 read_superblock omap replica is missing. 2023-12-06T15:05:00.802 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:00 smithi152 ceph-mon[192652]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 7 pgs peering) 2023-12-06T15:05:00.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:00 smithi190 ceph-mon[178398]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 7 pgs peering) 2023-12-06T15:05:00.822 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:05:00 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-5[203786]: 2023-12-06T15:05:00.582+0000 7f1775957640 -1 osd.5 84 log_to_monitors true 2023-12-06T15:05:01.822 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:05:01 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-5[203786]: 2023-12-06T15:05:01.527+0000 7f17645c3700 -1 osd.5 84 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-06T15:05:01.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:01 smithi190 ceph-mon[178398]: from='osd.5 [v2:172.21.15.190:6816/3404864287,v1:172.21.15.190:6817/3404864287]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-06T15:05:01.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:01 smithi190 ceph-mon[178398]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-06T15:05:01.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:05:01.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:05:01.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:05:01.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T15:05:01.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:05:01.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:01 smithi190 ceph-mon[178398]: pgmap v146: 65 pgs: 15 active+undersized, 15 active+undersized+degraded, 35 active+clean; 290 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 57/348 objects degraded (16.379%) 2023-12-06T15:05:01.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:05:01.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:05:01.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:05:01.824 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:05:01.824 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:05:01.824 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:05:01.824 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:05:01.824 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:05:01.824 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2023-12-06T15:05:01.824 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2023-12-06T15:05:01.824 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2023-12-06T15:05:01.824 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2023-12-06T15:05:01.824 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2023-12-06T15:05:01.824 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2023-12-06T15:05:01.824 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2023-12-06T15:05:01.824 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2023-12-06T15:05:01.824 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2023-12-06T15:05:01.824 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2023-12-06T15:05:01.825 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2023-12-06T15:05:01.825 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2023-12-06T15:05:01.825 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd require-osd-release", "release": "unknown"}]: dispatch 2023-12-06T15:05:01.825 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:05:01.825 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:05:01.825 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:05:01.825 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T15:05:01.825 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:05:01.825 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:01 smithi190 ceph-mon[178398]: Health check update: Degraded data redundancy: 57/348 objects degraded (16.379%), 15 pgs degraded (PG_DEGRADED) 2023-12-06T15:05:01.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:01 smithi152 ceph-mon[192652]: from='osd.5 [v2:172.21.15.190:6816/3404864287,v1:172.21.15.190:6817/3404864287]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-06T15:05:01.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:01 smithi152 ceph-mon[192652]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-06T15:05:01.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:05:01.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:05:01.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:05:01.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T15:05:01.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:05:01.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:01 smithi152 ceph-mon[192652]: pgmap v146: 65 pgs: 15 active+undersized, 15 active+undersized+degraded, 35 active+clean; 290 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 57/348 objects degraded (16.379%) 2023-12-06T15:05:01.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:05:01.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:05:01.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:05:01.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:05:01.880 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:05:01.880 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:05:01.880 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:05:01.880 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:05:01.880 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2023-12-06T15:05:01.880 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2023-12-06T15:05:01.880 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2023-12-06T15:05:01.880 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2023-12-06T15:05:01.880 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2023-12-06T15:05:01.880 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2023-12-06T15:05:01.880 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2023-12-06T15:05:01.880 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2023-12-06T15:05:01.880 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2023-12-06T15:05:01.880 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2023-12-06T15:05:01.880 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2023-12-06T15:05:01.881 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2023-12-06T15:05:01.881 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd require-osd-release", "release": "unknown"}]: dispatch 2023-12-06T15:05:01.881 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:05:01.881 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:05:01.881 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:05:01.881 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T15:05:01.881 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:05:01.881 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:01 smithi152 ceph-mon[192652]: Health check update: Degraded data redundancy: 57/348 objects degraded (16.379%), 15 pgs degraded (PG_DEGRADED) 2023-12-06T15:05:01.881 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:01 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-mon-smithi152[192629]: 2023-12-06T15:05:01.629+0000 7f0906937700 -1 log_channel(cluster) log [ERR] : Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-06T15:05:02.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:02 smithi190 ceph-mon[178398]: Upgrade: Setting container_image for all osd 2023-12-06T15:05:02.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:02 smithi190 ceph-mon[178398]: Upgrade: Setting require_osd_release to 19 unknown 2023-12-06T15:05:02.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:02 smithi190 ceph-mon[178398]: Upgrade: Paused due to UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-06T15:05:02.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:02 smithi190 ceph-mon[178398]: pgmap v147: 65 pgs: 15 active+undersized, 15 active+undersized+degraded, 35 active+clean; 290 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 57/348 objects degraded (16.379%) 2023-12-06T15:05:02.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:02 smithi190 ceph-mon[178398]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-06T15:05:02.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:02 smithi190 ceph-mon[178398]: osdmap e87: 6 total, 5 up, 6 in 2023-12-06T15:05:02.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:02 smithi190 ceph-mon[178398]: from='osd.5 [v2:172.21.15.190:6816/3404864287,v1:172.21.15.190:6817/3404864287]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-12-06T15:05:02.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:02 smithi190 ceph-mon[178398]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-12-06T15:05:02.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:02 smithi190 ceph-mon[178398]: Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-06T15:05:02.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:02 smithi152 ceph-mon[192652]: Upgrade: Setting container_image for all osd 2023-12-06T15:05:02.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:02 smithi152 ceph-mon[192652]: Upgrade: Setting require_osd_release to 19 unknown 2023-12-06T15:05:02.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:02 smithi152 ceph-mon[192652]: Upgrade: Paused due to UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-06T15:05:02.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:02 smithi152 ceph-mon[192652]: pgmap v147: 65 pgs: 15 active+undersized, 15 active+undersized+degraded, 35 active+clean; 290 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 57/348 objects degraded (16.379%) 2023-12-06T15:05:02.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:02 smithi152 ceph-mon[192652]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-06T15:05:02.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:02 smithi152 ceph-mon[192652]: osdmap e87: 6 total, 5 up, 6 in 2023-12-06T15:05:02.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:02 smithi152 ceph-mon[192652]: from='osd.5 [v2:172.21.15.190:6816/3404864287,v1:172.21.15.190:6817/3404864287]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-12-06T15:05:02.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:02 smithi152 ceph-mon[192652]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]: dispatch 2023-12-06T15:05:02.879 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:02 smithi152 ceph-mon[192652]: Health check failed: Upgrade: failed due to an unexpected exception (UPGRADE_EXCEPTION) 2023-12-06T15:05:03.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:03 smithi190 ceph-mon[178398]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-06T15:05:03.822 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:03 smithi190 ceph-mon[178398]: osd.5 [v2:172.21.15.190:6816/3404864287,v1:172.21.15.190:6817/3404864287] boot 2023-12-06T15:05:03.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:03 smithi190 ceph-mon[178398]: osdmap e88: 6 total, 6 up, 6 in 2023-12-06T15:05:03.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:03 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-06T15:05:03.823 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:03 smithi190 ceph-mon[178398]: osdmap e89: 6 total, 6 up, 6 in 2023-12-06T15:05:03.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:03 smithi152 ceph-mon[192652]: Health check cleared: OSD_DOWN (was: 1 osds down) 2023-12-06T15:05:03.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:03 smithi152 ceph-mon[192652]: osd.5 [v2:172.21.15.190:6816/3404864287,v1:172.21.15.190:6817/3404864287] boot 2023-12-06T15:05:03.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:03 smithi152 ceph-mon[192652]: osdmap e88: 6 total, 6 up, 6 in 2023-12-06T15:05:03.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:03 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-06T15:05:03.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:03 smithi152 ceph-mon[192652]: osdmap e89: 6 total, 6 up, 6 in 2023-12-06T15:05:04.825 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:04 smithi190 ceph-mon[178398]: pgmap v150: 65 pgs: 2 peering, 13 active+undersized, 15 active+undersized+degraded, 35 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 5 op/s; 57/348 objects degraded (16.379%) 2023-12-06T15:05:04.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:04 smithi152 ceph-mon[192652]: pgmap v150: 65 pgs: 2 peering, 13 active+undersized, 15 active+undersized+degraded, 35 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 5 op/s; 57/348 objects degraded (16.379%) 2023-12-06T15:05:07.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:06 smithi190 ceph-mon[178398]: pgmap v152: 65 pgs: 7 peering, 11 active+undersized, 12 active+undersized+degraded, 35 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s; 49/348 objects degraded (14.080%) 2023-12-06T15:05:07.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:06 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:05:07.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:06 smithi190 ceph-mon[178398]: Health check update: Degraded data redundancy: 49/348 objects degraded (14.080%), 12 pgs degraded (PG_DEGRADED) 2023-12-06T15:05:07.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:06 smithi152 ceph-mon[192652]: pgmap v152: 65 pgs: 7 peering, 11 active+undersized, 12 active+undersized+degraded, 35 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s; 49/348 objects degraded (14.080%) 2023-12-06T15:05:07.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:06 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:05:07.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:06 smithi152 ceph-mon[192652]: Health check update: Degraded data redundancy: 49/348 objects degraded (14.080%), 12 pgs degraded (PG_DEGRADED) 2023-12-06T15:05:08.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:07 smithi190 ceph-mon[178398]: pgmap v153: 65 pgs: 7 peering, 1 active+undersized, 4 active+undersized+degraded, 53 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 4 op/s; 14/348 objects degraded (4.023%) 2023-12-06T15:05:08.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:07 smithi152 ceph-mon[192652]: pgmap v153: 65 pgs: 7 peering, 1 active+undersized, 4 active+undersized+degraded, 53 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 4 op/s; 14/348 objects degraded (4.023%) 2023-12-06T15:05:09.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:08 smithi190 ceph-mon[178398]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/348 objects degraded (4.023%), 4 pgs degraded) 2023-12-06T15:05:09.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:08 smithi152 ceph-mon[192652]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/348 objects degraded (4.023%), 4 pgs degraded) 2023-12-06T15:05:10.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:09 smithi152 ceph-mon[192652]: pgmap v154: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2023-12-06T15:05:10.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:09 smithi190 ceph-mon[178398]: pgmap v154: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2023-12-06T15:05:12.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:12 smithi190 ceph-mon[178398]: pgmap v155: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 740 B/s rd, 0 op/s 2023-12-06T15:05:12.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:12 smithi152 ceph-mon[192652]: pgmap v155: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 740 B/s rd, 0 op/s 2023-12-06T15:05:14.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:14 smithi190 ceph-mon[178398]: pgmap v156: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 2 op/s 2023-12-06T15:05:14.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:14 smithi152 ceph-mon[192652]: pgmap v156: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 2 op/s 2023-12-06T15:05:17.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:16 smithi190 ceph-mon[178398]: pgmap v157: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s 2023-12-06T15:05:17.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:16 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:05:17.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:16 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:05:17.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:16 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:05:17.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:16 smithi152 ceph-mon[192652]: pgmap v157: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s 2023-12-06T15:05:17.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:16 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:05:17.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:16 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:05:17.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:16 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:05:19.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:18 smithi190 ceph-mon[178398]: pgmap v158: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s 2023-12-06T15:05:19.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:18 smithi152 ceph-mon[192652]: pgmap v158: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s 2023-12-06T15:05:19.352 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.351+0000 7f789612a700 1 -- 172.21.15.152:0/1758957522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78900faed0 msgr2=0x7f78900fb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:05:19.352 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.351+0000 7f789612a700 1 --2- 172.21.15.152:0/1758957522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78900faed0 0x7f78900fb2e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7880004940 tx=0x7f7880009e30 comp rx=0 tx=0).stop 2023-12-06T15:05:19.352 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.352+0000 7f789612a700 1 -- 172.21.15.152:0/1758957522 shutdown_connections 2023-12-06T15:05:19.353 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.352+0000 7f789612a700 1 --2- 172.21.15.152:0/1758957522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78900fdf60 0x7f78900fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:05:19.353 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.352+0000 7f789612a700 1 --2- 172.21.15.152:0/1758957522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78900faed0 0x7f78900fb2e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:05:19.353 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.352+0000 7f789612a700 1 -- 172.21.15.152:0/1758957522 >> 172.21.15.152:0/1758957522 conn(0x7f78900f6950 msgr2=0x7f78900f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:05:19.353 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.352+0000 7f789612a700 1 -- 172.21.15.152:0/1758957522 shutdown_connections 2023-12-06T15:05:19.353 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.352+0000 7f789612a700 1 -- 172.21.15.152:0/1758957522 wait complete. 2023-12-06T15:05:19.354 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.353+0000 7f789612a700 1 Processor -- start 2023-12-06T15:05:19.354 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.353+0000 7f789612a700 1 -- start start 2023-12-06T15:05:19.355 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.353+0000 7f789612a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78900faed0 0x7f789010d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:05:19.355 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.353+0000 7f789612a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78900fdf60 0x7f789010db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:05:19.355 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.353+0000 7f789612a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789010e120 con 0x7f78900fdf60 2023-12-06T15:05:19.355 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.353+0000 7f789612a700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789010e9c0 con 0x7f78900faed0 2023-12-06T15:05:19.355 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.353+0000 7f788effd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78900fdf60 0x7f789010db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:05:19.355 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.353+0000 7f788effd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78900fdf60 0x7f789010db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59936/0 (socket says 172.21.15.152:59936) 2023-12-06T15:05:19.355 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.353+0000 7f788effd700 1 -- 172.21.15.152:0/1871255578 learned_addr learned my addr 172.21.15.152:0/1871255578 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:05:19.355 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.353+0000 7f788f7fe700 1 --2- 172.21.15.152:0/1871255578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78900faed0 0x7f789010d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:05:19.355 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.354+0000 7f788effd700 1 -- 172.21.15.152:0/1871255578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78900faed0 msgr2=0x7f789010d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:05:19.355 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.354+0000 7f788effd700 1 --2- 172.21.15.152:0/1871255578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78900faed0 0x7f789010d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:05:19.355 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.354+0000 7f788effd700 1 -- 172.21.15.152:0/1871255578 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7880005040 con 0x7f78900fdf60 2023-12-06T15:05:19.355 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.354+0000 7f788effd700 1 --2- 172.21.15.152:0/1871255578 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78900fdf60 0x7f789010db20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f788400c830 tx=0x7f7884004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:05:19.355 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.354+0000 7f7877fff700 1 -- 172.21.15.152:0/1871255578 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f788400a760 con 0x7f78900fdf60 2023-12-06T15:05:19.355 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.354+0000 7f7877fff700 1 -- 172.21.15.152:0/1871255578 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f788400ad70 con 0x7f78900fdf60 2023-12-06T15:05:19.355 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.354+0000 7f789612a700 1 -- 172.21.15.152:0/1871255578 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f789010eca0 con 0x7f78900fdf60 2023-12-06T15:05:19.356 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.354+0000 7f7877fff700 1 -- 172.21.15.152:0/1871255578 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78840113a0 con 0x7f78900fdf60 2023-12-06T15:05:19.356 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.354+0000 7f789612a700 1 -- 172.21.15.152:0/1871255578 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f789010f1e0 con 0x7f78900fdf60 2023-12-06T15:05:19.356 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.355+0000 7f789612a700 1 -- 172.21.15.152:0/1871255578 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78901075f0 con 0x7f78900fdf60 2023-12-06T15:05:19.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.355+0000 7f7877fff700 1 -- 172.21.15.152:0/1871255578 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f7884012400 con 0x7f78900fdf60 2023-12-06T15:05:19.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.356+0000 7f7877fff700 1 --2- 172.21.15.152:0/1871255578 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f787806ce60 0x7f787806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:05:19.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.356+0000 7f7877fff700 1 -- 172.21.15.152:0/1871255578 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f788408c420 con 0x7f78900fdf60 2023-12-06T15:05:19.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.356+0000 7f788f7fe700 1 --2- 172.21.15.152:0/1871255578 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f787806ce60 0x7f787806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:05:19.357 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.356+0000 7f788f7fe700 1 --2- 172.21.15.152:0/1871255578 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f787806ce60 0x7f787806f310 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7880004f90 tx=0x7f7880009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:05:19.361 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.360+0000 7f7877fff700 1 -- 172.21.15.152:0/1871255578 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f7884059d00 con 0x7f78900fdf60 2023-12-06T15:05:19.570 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.570+0000 7f789612a700 1 -- 172.21.15.152:0/1871255578 --> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f789010f460 con 0x7f787806ce60 2023-12-06T15:05:19.571 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.571+0000 7f7877fff700 1 -- 172.21.15.152:0/1871255578 <== mgr.34104 v2:172.21.15.152:6800/2427836422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7f789010f460 con 0x7f787806ce60 2023-12-06T15:05:19.574 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.573+0000 7f789612a700 1 -- 172.21.15.152:0/1871255578 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f787806ce60 msgr2=0x7f787806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:05:19.574 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.573+0000 7f789612a700 1 --2- 172.21.15.152:0/1871255578 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f787806ce60 0x7f787806f310 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7880004f90 tx=0x7f7880009e30 comp rx=0 tx=0).stop 2023-12-06T15:05:19.574 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.573+0000 7f789612a700 1 -- 172.21.15.152:0/1871255578 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78900fdf60 msgr2=0x7f789010db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:05:19.574 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.573+0000 7f789612a700 1 --2- 172.21.15.152:0/1871255578 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78900fdf60 0x7f789010db20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f788400c830 tx=0x7f7884004470 comp rx=0 tx=0).stop 2023-12-06T15:05:19.574 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.573+0000 7f789612a700 1 -- 172.21.15.152:0/1871255578 shutdown_connections 2023-12-06T15:05:19.574 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.573+0000 7f789612a700 1 --2- 172.21.15.152:0/1871255578 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f787806ce60 0x7f787806f310 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:05:19.575 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.573+0000 7f789612a700 1 --2- 172.21.15.152:0/1871255578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78900faed0 0x7f789010d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:05:19.575 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.574+0000 7f789612a700 1 --2- 172.21.15.152:0/1871255578 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78900fdf60 0x7f789010db20 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:05:19.575 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.574+0000 7f789612a700 1 -- 172.21.15.152:0/1871255578 >> 172.21.15.152:0/1871255578 conn(0x7f78900f6950 msgr2=0x7f78900f8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:05:19.575 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.574+0000 7f789612a700 1 -- 172.21.15.152:0/1871255578 shutdown_connections 2023-12-06T15:05:19.575 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.574+0000 7f789612a700 1 -- 172.21.15.152:0/1871255578 wait complete. 2023-12-06T15:05:19.584 INFO:teuthology.orchestra.run.smithi152.stdout:true 2023-12-06T15:05:19.677 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.676+0000 7f4843f37700 1 -- 172.21.15.152:0/3857811475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f483c0fe270 msgr2=0x7f483c0fe680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:05:19.677 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.676+0000 7f4843f37700 1 --2- 172.21.15.152:0/3857811475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f483c0fe270 0x7f483c0fe680 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4838004940 tx=0x7f4838009e30 comp rx=0 tx=0).stop 2023-12-06T15:05:19.677 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.676+0000 7f4843f37700 1 -- 172.21.15.152:0/3857811475 shutdown_connections 2023-12-06T15:05:19.677 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.676+0000 7f4843f37700 1 --2- 172.21.15.152:0/3857811475 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f483c0fec50 0x7f483c0fad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:05:19.677 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.676+0000 7f4843f37700 1 --2- 172.21.15.152:0/3857811475 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f483c0fe270 0x7f483c0fe680 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:05:19.677 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.676+0000 7f4843f37700 1 -- 172.21.15.152:0/3857811475 >> 172.21.15.152:0/3857811475 conn(0x7f483c0f6950 msgr2=0x7f483c0f8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:05:19.677 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.676+0000 7f4843f37700 1 -- 172.21.15.152:0/3857811475 shutdown_connections 2023-12-06T15:05:19.677 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.676+0000 7f4843f37700 1 -- 172.21.15.152:0/3857811475 wait complete. 2023-12-06T15:05:19.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.677+0000 7f4843f37700 1 Processor -- start 2023-12-06T15:05:19.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.677+0000 7f4843f37700 1 -- start start 2023-12-06T15:05:19.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.677+0000 7f4843f37700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f483c0fe270 0x7f483c10d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:05:19.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.677+0000 7f4843f37700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f483c10db50 0x7f483c10e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:05:19.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.677+0000 7f4843f37700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483c10e010 con 0x7f483c0fe270 2023-12-06T15:05:19.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.677+0000 7f4843f37700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483c10e150 con 0x7f483c10db50 2023-12-06T15:05:19.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.678+0000 7f4841cd3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f483c0fe270 0x7f483c10d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:05:19.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.678+0000 7f4841cd3700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f483c0fe270 0x7f483c10d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59964/0 (socket says 172.21.15.152:59964) 2023-12-06T15:05:19.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.678+0000 7f4841cd3700 1 -- 172.21.15.152:0/431626048 learned_addr learned my addr 172.21.15.152:0/431626048 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:05:19.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.678+0000 7f4841cd3700 1 -- 172.21.15.152:0/431626048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f483c10db50 msgr2=0x7f483c10e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:05:19.679 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.678+0000 7f4841cd3700 1 --2- 172.21.15.152:0/431626048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f483c10db50 0x7f483c10e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:05:19.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.678+0000 7f4841cd3700 1 -- 172.21.15.152:0/431626048 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4838005040 con 0x7f483c0fe270 2023-12-06T15:05:19.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.678+0000 7f4841cd3700 1 --2- 172.21.15.152:0/431626048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f483c0fe270 0x7f483c10d610 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4838009180 tx=0x7f4838009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:05:19.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.678+0000 7f48327fc700 1 -- 172.21.15.152:0/431626048 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f483800e040 con 0x7f483c0fe270 2023-12-06T15:05:19.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.678+0000 7f48327fc700 1 -- 172.21.15.152:0/431626048 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4838004290 con 0x7f483c0fe270 2023-12-06T15:05:19.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.678+0000 7f4843f37700 1 -- 172.21.15.152:0/431626048 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f483c10eff0 con 0x7f483c0fe270 2023-12-06T15:05:19.680 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.678+0000 7f48327fc700 1 -- 172.21.15.152:0/431626048 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f483801c630 con 0x7f483c0fe270 2023-12-06T15:05:19.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.678+0000 7f4843f37700 1 -- 172.21.15.152:0/431626048 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f483c10f500 con 0x7f483c0fe270 2023-12-06T15:05:19.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.679+0000 7f4843f37700 1 -- 172.21.15.152:0/431626048 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f483c107620 con 0x7f483c0fe270 2023-12-06T15:05:19.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.680+0000 7f48327fc700 1 -- 172.21.15.152:0/431626048 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f483801c790 con 0x7f483c0fe270 2023-12-06T15:05:19.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.680+0000 7f48327fc700 1 --2- 172.21.15.152:0/431626048 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f482806ce70 0x7f482806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:05:19.681 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.680+0000 7f48327fc700 1 -- 172.21.15.152:0/431626048 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f483808d6f0 con 0x7f483c0fe270 2023-12-06T15:05:19.682 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.680+0000 7f48414d2700 1 --2- 172.21.15.152:0/431626048 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f482806ce70 0x7f482806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:05:19.682 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.680+0000 7f48414d2700 1 --2- 172.21.15.152:0/431626048 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f482806ce70 0x7f482806f320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f483c065b10 tx=0x7f482c009ce0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:05:19.684 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.685+0000 7f48327fc700 1 -- 172.21.15.152:0/431626048 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f483805b0e0 con 0x7f483c0fe270 2023-12-06T15:05:19.891 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.891+0000 7f4843f37700 1 -- 172.21.15.152:0/431626048 --> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f483c0fec50 con 0x7f482806ce70 2023-12-06T15:05:19.892 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.892+0000 7f48327fc700 1 -- 172.21.15.152:0/431626048 <== mgr.34104 v2:172.21.15.152:6800/2427836422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7f483c0fec50 con 0x7f482806ce70 2023-12-06T15:05:19.894 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.894+0000 7f4843f37700 1 -- 172.21.15.152:0/431626048 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f482806ce70 msgr2=0x7f482806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:05:19.894 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.894+0000 7f4843f37700 1 --2- 172.21.15.152:0/431626048 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f482806ce70 0x7f482806f320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f483c065b10 tx=0x7f482c009ce0 comp rx=0 tx=0).stop 2023-12-06T15:05:19.894 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.894+0000 7f4843f37700 1 -- 172.21.15.152:0/431626048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f483c0fe270 msgr2=0x7f483c10d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:05:19.894 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.894+0000 7f4843f37700 1 --2- 172.21.15.152:0/431626048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f483c0fe270 0x7f483c10d610 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4838009180 tx=0x7f4838009e30 comp rx=0 tx=0).stop 2023-12-06T15:05:19.894 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.894+0000 7f4843f37700 1 -- 172.21.15.152:0/431626048 shutdown_connections 2023-12-06T15:05:19.894 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.894+0000 7f4843f37700 1 --2- 172.21.15.152:0/431626048 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f482806ce70 0x7f482806f320 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:05:19.894 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.894+0000 7f4843f37700 1 --2- 172.21.15.152:0/431626048 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f483c0fe270 0x7f483c10d610 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:05:19.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.894+0000 7f4843f37700 1 --2- 172.21.15.152:0/431626048 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f483c10db50 0x7f483c10e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:05:19.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.894+0000 7f4843f37700 1 -- 172.21.15.152:0/431626048 >> 172.21.15.152:0/431626048 conn(0x7f483c0f6950 msgr2=0x7f483c0f8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:05:19.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.894+0000 7f4843f37700 1 -- 172.21.15.152:0/431626048 shutdown_connections 2023-12-06T15:05:19.895 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:19.894+0000 7f4843f37700 1 -- 172.21.15.152:0/431626048 wait complete. 2023-12-06T15:05:19.904 INFO:teuthology.orchestra.run.smithi152.stdout:"Error: UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception" 2023-12-06T15:05:20.296 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -e sha1=0482646fcf78576d871bc87843257d82edb79541 -- bash -c 'ceph orch ps' 2023-12-06T15:05:20.604 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T15:05:21.041 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:20 smithi152 ceph-mon[192652]: pgmap v159: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:05:21.041 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:20 smithi152 ceph-mon[192652]: from='client.34340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:05:21.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:20 smithi190 ceph-mon[178398]: pgmap v159: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:05:21.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:20 smithi190 ceph-mon[178398]: from='client.34340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:05:21.613 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.609+0000 7fa19097c700 1 -- 172.21.15.152:0/1912210642 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa18c0fbb30 msgr2=0x7fa18c0fbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:05:21.614 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.609+0000 7fa19097c700 1 --2- 172.21.15.152:0/1912210642 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa18c0fbb30 0x7fa18c0fbfa0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa17c004940 tx=0x7fa17c009e30 comp rx=0 tx=0).stop 2023-12-06T15:05:21.614 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.609+0000 7fa19097c700 1 -- 172.21.15.152:0/1912210642 shutdown_connections 2023-12-06T15:05:21.614 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.609+0000 7fa19097c700 1 --2- 172.21.15.152:0/1912210642 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa18c0fbb30 0x7fa18c0fbfa0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:05:21.614 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.609+0000 7fa19097c700 1 --2- 172.21.15.152:0/1912210642 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa18c101af0 0x7fa18c101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:05:21.614 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.609+0000 7fa19097c700 1 -- 172.21.15.152:0/1912210642 >> 172.21.15.152:0/1912210642 conn(0x7fa18c0f7690 msgr2=0x7fa18c0f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:05:21.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.609+0000 7fa19097c700 1 -- 172.21.15.152:0/1912210642 shutdown_connections 2023-12-06T15:05:21.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.609+0000 7fa19097c700 1 -- 172.21.15.152:0/1912210642 wait complete. 2023-12-06T15:05:21.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.610+0000 7fa19097c700 1 Processor -- start 2023-12-06T15:05:21.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.610+0000 7fa19097c700 1 -- start start 2023-12-06T15:05:21.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.610+0000 7fa19097c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa18c0fbb30 0x7fa18c10e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:05:21.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.610+0000 7fa19097c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa18c101af0 0x7fa18c10ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:05:21.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.610+0000 7fa19097c700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c10f1c0 con 0x7fa18c0fbb30 2023-12-06T15:05:21.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.610+0000 7fa19097c700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c10f330 con 0x7fa18c101af0 2023-12-06T15:05:21.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.610+0000 7fa18a59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa18c0fbb30 0x7fa18c10e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:05:21.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.610+0000 7fa18a59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa18c0fbb30 0x7fa18c10e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59988/0 (socket says 172.21.15.152:59988) 2023-12-06T15:05:21.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.610+0000 7fa18a59c700 1 -- 172.21.15.152:0/4121239099 learned_addr learned my addr 172.21.15.152:0/4121239099 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:05:21.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.610+0000 7fa189d9b700 1 --2- 172.21.15.152:0/4121239099 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa18c101af0 0x7fa18c10ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:05:21.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.610+0000 7fa18a59c700 1 -- 172.21.15.152:0/4121239099 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa18c101af0 msgr2=0x7fa18c10ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:05:21.615 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.610+0000 7fa18a59c700 1 --2- 172.21.15.152:0/4121239099 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa18c101af0 0x7fa18c10ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:05:21.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.610+0000 7fa18a59c700 1 -- 172.21.15.152:0/4121239099 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa17c005040 con 0x7fa18c0fbb30 2023-12-06T15:05:21.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.610+0000 7fa189d9b700 1 --2- 172.21.15.152:0/4121239099 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa18c101af0 0x7fa18c10ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-06T15:05:21.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.611+0000 7fa18a59c700 1 --2- 172.21.15.152:0/4121239099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa18c0fbb30 0x7fa18c10e6d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa174002a80 tx=0x7fa1740046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:05:21.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.611+0000 7fa182ffd700 1 -- 172.21.15.152:0/4121239099 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa174007cc0 con 0x7fa18c0fbb30 2023-12-06T15:05:21.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.611+0000 7fa19097c700 1 -- 172.21.15.152:0/4121239099 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa18c1176a0 con 0x7fa18c0fbb30 2023-12-06T15:05:21.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.611+0000 7fa182ffd700 1 -- 172.21.15.152:0/4121239099 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa17400f040 con 0x7fa18c0fbb30 2023-12-06T15:05:21.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.611+0000 7fa182ffd700 1 -- 172.21.15.152:0/4121239099 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa174009640 con 0x7fa18c0fbb30 2023-12-06T15:05:21.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.611+0000 7fa19097c700 1 -- 172.21.15.152:0/4121239099 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa18c117bb0 con 0x7fa18c0fbb30 2023-12-06T15:05:21.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.612+0000 7fa19097c700 1 -- 172.21.15.152:0/4121239099 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa18c103fa0 con 0x7fa18c0fbb30 2023-12-06T15:05:21.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.612+0000 7fa182ffd700 1 -- 172.21.15.152:0/4121239099 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fa1740097a0 con 0x7fa18c0fbb30 2023-12-06T15:05:21.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.613+0000 7fa182ffd700 1 --2- 172.21.15.152:0/4121239099 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fa17806ce60 0x7fa17806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:05:21.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.613+0000 7fa182ffd700 1 -- 172.21.15.152:0/4121239099 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6675+0+0 (secure 0 0 0) 0x7fa17408bbc0 con 0x7fa18c0fbb30 2023-12-06T15:05:21.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.613+0000 7fa189d9b700 1 --2- 172.21.15.152:0/4121239099 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fa17806ce60 0x7fa17806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:05:21.616 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.613+0000 7fa189d9b700 1 --2- 172.21.15.152:0/4121239099 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fa17806ce60 0x7fa17806f310 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa17c004f90 tx=0x7fa17c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:05:21.617 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.617+0000 7fa182ffd700 1 -- 172.21.15.152:0/4121239099 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fa174055990 con 0x7fa18c0fbb30 2023-12-06T15:05:21.818 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.818+0000 7fa19097c700 1 -- 172.21.15.152:0/4121239099 --> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa18c04bc20 con 0x7fa17806ce60 2023-12-06T15:05:21.828 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.828+0000 7fa182ffd700 1 -- 172.21.15.152:0/4121239099 <== mgr.34104 v2:172.21.15.152:6800/2427836422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fa17c007cc0 con 0x7fa17806ce60 2023-12-06T15:05:21.828 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-06T15:05:21.828 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 running (5m) 106s ago 11m 26.3M - 0.25.0 c8568f914cd2 b1a46cc95546 2023-12-06T15:05:21.828 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (3m) 106s ago 11m 7470k - 19.0.0-26-g0482646f 26bb7d89db2e 222039c21ee0 2023-12-06T15:05:21.828 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi190 smithi190 running (3m) 24s ago 10m 7461k - 19.0.0-26-g0482646f 26bb7d89db2e 8841ae485b70 2023-12-06T15:05:21.829 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (5m) 106s ago 10m 88.0M - 9.4.7 954c08fa6188 5c6a52d58144 2023-12-06T15:05:21.829 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.acqswy smithi152 running (7m) 106s ago 7m 5566M - 17.2.7-113-gece0d607 a5c6421f1c5f ff9375cec192 2023-12-06T15:05:21.829 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.ypivwc smithi152 running (7m) 106s ago 7m 538M - 17.2.7-113-gece0d607 a5c6421f1c5f d809a681491b 2023-12-06T15:05:21.829 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi190.edwtqj smithi190 running (7m) 24s ago 7m 626M - 17.2.7-113-gece0d607 a5c6421f1c5f f3b7ebd93b04 2023-12-06T15:05:21.829 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi190.uucxzu smithi190 running (7m) 24s ago 7m 4860M - 17.2.7-113-gece0d607 a5c6421f1c5f c01be1409c5f 2023-12-06T15:05:21.829 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.meodco smithi152 *:8443,9283,8765 running (4m) 106s ago 12m 510M - 19.0.0-26-g0482646f 26bb7d89db2e 16ed2af8a3d0 2023-12-06T15:05:21.829 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi190.ubusrr smithi190 *:8443,9283,8765 running (4m) 24s ago 10m 449M - 19.0.0-26-g0482646f 26bb7d89db2e cfae14b9324d 2023-12-06T15:05:21.829 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (4m) 106s ago 12m 66.8M 2048M 19.0.0-26-g0482646f 26bb7d89db2e f5163d3b0f5f 2023-12-06T15:05:21.829 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi190 smithi190 running (3m) 24s ago 10m 56.8M 2048M 19.0.0-26-g0482646f 26bb7d89db2e b25040d5fdfe 2023-12-06T15:05:21.829 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 running (5m) 106s ago 11m 18.5M - 1.5.0 0da6a335fe13 81be696b9be8 2023-12-06T15:05:21.829 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi190 smithi190 *:9100 running (4m) 24s ago 10m 20.0M - 1.5.0 0da6a335fe13 2e521e235bf7 2023-12-06T15:05:21.829 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (2m) 106s ago 9m 169M 1568M 19.0.0-26-g0482646f 26bb7d89db2e 05e00966036e 2023-12-06T15:05:21.829 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (2m) 106s ago 9m 122M 1568M 19.0.0-26-g0482646f 26bb7d89db2e c0eaab4b2fd0 2023-12-06T15:05:21.829 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (110s) 106s ago 9m 12.6M 1568M 19.0.0-26-g0482646f 26bb7d89db2e 1440f943b48e 2023-12-06T15:05:21.829 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi190 running (81s) 24s ago 8m 130M 2592M 19.0.0-26-g0482646f 26bb7d89db2e 9871106e0a4f 2023-12-06T15:05:21.830 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi190 running (54s) 24s ago 8m 116M 2592M 19.0.0-26-g0482646f 26bb7d89db2e c2350bc6d448 2023-12-06T15:05:21.830 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi190 running (26s) 24s ago 8m 16.2M 2592M 19.0.0-26-g0482646f 26bb7d89db2e 8e8b6c38342a 2023-12-06T15:05:21.830 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi152 smithi152 *:9095 running (4m) 106s ago 10m 48.7M - 2.43.0 a07b618ecd1d 5f7e5860a419 2023-12-06T15:05:21.830 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.830+0000 7fa19097c700 1 -- 172.21.15.152:0/4121239099 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fa17806ce60 msgr2=0x7fa17806f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:05:21.830 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.830+0000 7fa19097c700 1 --2- 172.21.15.152:0/4121239099 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fa17806ce60 0x7fa17806f310 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa17c004f90 tx=0x7fa17c009e30 comp rx=0 tx=0).stop 2023-12-06T15:05:21.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.830+0000 7fa19097c700 1 -- 172.21.15.152:0/4121239099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa18c0fbb30 msgr2=0x7fa18c10e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:05:21.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.830+0000 7fa19097c700 1 --2- 172.21.15.152:0/4121239099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa18c0fbb30 0x7fa18c10e6d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa174002a80 tx=0x7fa1740046b0 comp rx=0 tx=0).stop 2023-12-06T15:05:21.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.830+0000 7fa19097c700 1 -- 172.21.15.152:0/4121239099 shutdown_connections 2023-12-06T15:05:21.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.830+0000 7fa19097c700 1 --2- 172.21.15.152:0/4121239099 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fa17806ce60 0x7fa17806f310 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:05:21.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.830+0000 7fa19097c700 1 --2- 172.21.15.152:0/4121239099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa18c0fbb30 0x7fa18c10e6d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:05:21.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.830+0000 7fa19097c700 1 --2- 172.21.15.152:0/4121239099 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa18c101af0 0x7fa18c10ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:05:21.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.830+0000 7fa19097c700 1 -- 172.21.15.152:0/4121239099 >> 172.21.15.152:0/4121239099 conn(0x7fa18c0f7690 msgr2=0x7fa18c0f91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:05:21.831 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.830+0000 7fa19097c700 1 -- 172.21.15.152:0/4121239099 shutdown_connections 2023-12-06T15:05:21.832 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:21.830+0000 7fa19097c700 1 -- 172.21.15.152:0/4121239099 wait complete. 2023-12-06T15:05:22.007 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:21 smithi152 ceph-mon[192652]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:05:22.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:21 smithi190 ceph-mon[178398]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:05:22.212 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -e sha1=0482646fcf78576d871bc87843257d82edb79541 -- bash -c 'ceph orch upgrade status' 2023-12-06T15:05:22.477 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T15:05:22.878 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:22 smithi152 ceph-mon[192652]: pgmap v160: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:05:23.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:22 smithi190 ceph-mon[178398]: pgmap v160: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:05:23.526 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.525+0000 7f207f7c9700 1 -- 172.21.15.152:0/3374008819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20780fb9c0 msgr2=0x7f20780fbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:05:23.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.525+0000 7f207f7c9700 1 --2- 172.21.15.152:0/3374008819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20780fb9c0 0x7f20780fbd90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2074004940 tx=0x7f2074009e30 comp rx=0 tx=0).stop 2023-12-06T15:05:23.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.525+0000 7f207f7c9700 1 -- 172.21.15.152:0/3374008819 shutdown_connections 2023-12-06T15:05:23.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.525+0000 7f207f7c9700 1 --2- 172.21.15.152:0/3374008819 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f20780fc2d0 0x7f2078109030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:05:23.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.525+0000 7f207f7c9700 1 --2- 172.21.15.152:0/3374008819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20780fb9c0 0x7f20780fbd90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:05:23.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.525+0000 7f207f7c9700 1 -- 172.21.15.152:0/3374008819 >> 172.21.15.152:0/3374008819 conn(0x7f20780f7690 msgr2=0x7f20780f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:05:23.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.525+0000 7f207f7c9700 1 -- 172.21.15.152:0/3374008819 shutdown_connections 2023-12-06T15:05:23.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.525+0000 7f207f7c9700 1 -- 172.21.15.152:0/3374008819 wait complete. 2023-12-06T15:05:23.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.526+0000 7f207f7c9700 1 Processor -- start 2023-12-06T15:05:23.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.526+0000 7f207f7c9700 1 -- start start 2023-12-06T15:05:23.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.526+0000 7f207f7c9700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f20780fb9c0 0x7f2078115730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:05:23.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.526+0000 7f207f7c9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20780fc2d0 0x7f2078115c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:05:23.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.526+0000 7f207f7c9700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20781162c0 con 0x7f20780fc2d0 2023-12-06T15:05:23.527 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.526+0000 7f207f7c9700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207810f5f0 con 0x7f20780fb9c0 2023-12-06T15:05:23.528 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.526+0000 7f207cd64700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20780fc2d0 0x7f2078115c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:05:23.528 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.526+0000 7f207cd64700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20780fc2d0 0x7f2078115c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60008/0 (socket says 172.21.15.152:60008) 2023-12-06T15:05:23.528 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.526+0000 7f207cd64700 1 -- 172.21.15.152:0/2946039927 learned_addr learned my addr 172.21.15.152:0/2946039927 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:05:23.528 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.526+0000 7f207d565700 1 --2- 172.21.15.152:0/2946039927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f20780fb9c0 0x7f2078115730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:05:23.528 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.526+0000 7f207cd64700 1 -- 172.21.15.152:0/2946039927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f20780fb9c0 msgr2=0x7f2078115730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:05:23.528 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.526+0000 7f207cd64700 1 --2- 172.21.15.152:0/2946039927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f20780fb9c0 0x7f2078115730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:05:23.528 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.526+0000 7f207cd64700 1 -- 172.21.15.152:0/2946039927 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2074005040 con 0x7f20780fc2d0 2023-12-06T15:05:23.528 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.526+0000 7f207cd64700 1 --2- 172.21.15.152:0/2946039927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20780fc2d0 0x7f2078115c70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f206800eb40 tx=0x7f206800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:05:23.528 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.527+0000 7f206dffb700 1 -- 172.21.15.152:0/2946039927 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2068007cc0 con 0x7f20780fc2d0 2023-12-06T15:05:23.528 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.527+0000 7f207f7c9700 1 -- 172.21.15.152:0/2946039927 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f207810f870 con 0x7f20780fc2d0 2023-12-06T15:05:23.528 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.527+0000 7f206dffb700 1 -- 172.21.15.152:0/2946039927 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f206800f040 con 0x7f20780fc2d0 2023-12-06T15:05:23.528 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.527+0000 7f206dffb700 1 -- 172.21.15.152:0/2946039927 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f206800c990 con 0x7f20780fc2d0 2023-12-06T15:05:23.529 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.527+0000 7f207f7c9700 1 -- 172.21.15.152:0/2946039927 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f207810fdb0 con 0x7f20780fc2d0 2023-12-06T15:05:23.529 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.528+0000 7f207f7c9700 1 -- 172.21.15.152:0/2946039927 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2078106760 con 0x7f20780fc2d0 2023-12-06T15:05:23.529 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.528+0000 7f206dffb700 1 -- 172.21.15.152:0/2946039927 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f206800cc00 con 0x7f20780fc2d0 2023-12-06T15:05:23.529 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.528+0000 7f206dffb700 1 --2- 172.21.15.152:0/2946039927 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f206406ce60 0x7f206406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:05:23.530 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.529+0000 7f206dffb700 1 -- 172.21.15.152:0/2946039927 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f206808bfe0 con 0x7f20780fc2d0 2023-12-06T15:05:23.530 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.529+0000 7f207d565700 1 --2- 172.21.15.152:0/2946039927 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f206406ce60 0x7f206406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:05:23.530 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.529+0000 7f207d565700 1 --2- 172.21.15.152:0/2946039927 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f206406ce60 0x7f206406f310 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f207400b0d0 tx=0x7f2074009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:05:23.533 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.533+0000 7f206dffb700 1 -- 172.21.15.152:0/2946039927 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f20680598f0 con 0x7f20780fc2d0 2023-12-06T15:05:23.745 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.744+0000 7f207f7c9700 1 -- 172.21.15.152:0/2946039927 --> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2078110d10 con 0x7f206406ce60 2023-12-06T15:05:23.745 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.746+0000 7f206dffb700 1 -- 172.21.15.152:0/2946039927 <== mgr.34104 v2:172.21.15.152:6800/2427836422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+456 (secure 0 0 0) 0x7f2078110d10 con 0x7f206406ce60 2023-12-06T15:05:23.746 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-12-06T15:05:23.746 INFO:teuthology.orchestra.run.smithi152.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:e331a81036b9c4be9167bdaf54e458c7294ca3446212b9c6126786d23318b1cf", 2023-12-06T15:05:23.746 INFO:teuthology.orchestra.run.smithi152.stdout: "in_progress": true, 2023-12-06T15:05:23.746 INFO:teuthology.orchestra.run.smithi152.stdout: "which": "Upgrading all daemon types on all hosts", 2023-12-06T15:05:23.746 INFO:teuthology.orchestra.run.smithi152.stdout: "services_complete": [ 2023-12-06T15:05:23.746 INFO:teuthology.orchestra.run.smithi152.stdout: "crash", 2023-12-06T15:05:23.746 INFO:teuthology.orchestra.run.smithi152.stdout: "mon", 2023-12-06T15:05:23.746 INFO:teuthology.orchestra.run.smithi152.stdout: "osd", 2023-12-06T15:05:23.746 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr" 2023-12-06T15:05:23.746 INFO:teuthology.orchestra.run.smithi152.stdout: ], 2023-12-06T15:05:23.746 INFO:teuthology.orchestra.run.smithi152.stdout: "progress": "12/21 daemons upgraded", 2023-12-06T15:05:23.746 INFO:teuthology.orchestra.run.smithi152.stdout: "message": "Error: UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception", 2023-12-06T15:05:23.747 INFO:teuthology.orchestra.run.smithi152.stdout: "is_paused": true 2023-12-06T15:05:23.747 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-12-06T15:05:23.748 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.748+0000 7f207f7c9700 1 -- 172.21.15.152:0/2946039927 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f206406ce60 msgr2=0x7f206406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:05:23.748 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.748+0000 7f207f7c9700 1 --2- 172.21.15.152:0/2946039927 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f206406ce60 0x7f206406f310 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f207400b0d0 tx=0x7f2074009e30 comp rx=0 tx=0).stop 2023-12-06T15:05:23.748 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.748+0000 7f207f7c9700 1 -- 172.21.15.152:0/2946039927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20780fc2d0 msgr2=0x7f2078115c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:05:23.748 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.748+0000 7f207f7c9700 1 --2- 172.21.15.152:0/2946039927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20780fc2d0 0x7f2078115c70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f206800eb40 tx=0x7f206800b040 comp rx=0 tx=0).stop 2023-12-06T15:05:23.748 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.748+0000 7f207f7c9700 1 -- 172.21.15.152:0/2946039927 shutdown_connections 2023-12-06T15:05:23.748 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.748+0000 7f207f7c9700 1 --2- 172.21.15.152:0/2946039927 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f206406ce60 0x7f206406f310 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:05:23.748 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.748+0000 7f207f7c9700 1 --2- 172.21.15.152:0/2946039927 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f20780fb9c0 0x7f2078115730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:05:23.749 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.748+0000 7f207f7c9700 1 --2- 172.21.15.152:0/2946039927 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20780fc2d0 0x7f2078115c70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:05:23.749 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.748+0000 7f207f7c9700 1 -- 172.21.15.152:0/2946039927 >> 172.21.15.152:0/2946039927 conn(0x7f20780f7690 msgr2=0x7f20780f8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:05:23.749 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.748+0000 7f207f7c9700 1 -- 172.21.15.152:0/2946039927 shutdown_connections 2023-12-06T15:05:23.749 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:23.748+0000 7f207f7c9700 1 -- 172.21.15.152:0/2946039927 wait complete. 2023-12-06T15:05:24.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:23 smithi190 ceph-mon[178398]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:05:24.089 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:23 smithi152 ceph-mon[192652]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:05:24.136 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -e sha1=0482646fcf78576d871bc87843257d82edb79541 -- bash -c 'ceph health detail' 2023-12-06T15:05:24.402 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T15:05:24.857 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:24 smithi152 ceph-mon[192652]: pgmap v161: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:05:25.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:24 smithi190 ceph-mon[178398]: pgmap v161: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:05:25.423 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.423+0000 7f7424f65700 1 -- 172.21.15.152:0/920799575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7420101b00 msgr2=0x7f7420101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:05:25.423 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.423+0000 7f7424f65700 1 --2- 172.21.15.152:0/920799575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7420101b00 0x7f7420101ed0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7408004940 tx=0x7f7408009e30 comp rx=0 tx=0).stop 2023-12-06T15:05:25.424 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.423+0000 7f7424f65700 1 -- 172.21.15.152:0/920799575 shutdown_connections 2023-12-06T15:05:25.424 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.423+0000 7f7424f65700 1 --2- 172.21.15.152:0/920799575 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74200fbb40 0x7f74200fbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:05:25.424 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.423+0000 7f7424f65700 1 --2- 172.21.15.152:0/920799575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7420101b00 0x7f7420101ed0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:05:25.424 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.423+0000 7f7424f65700 1 -- 172.21.15.152:0/920799575 >> 172.21.15.152:0/920799575 conn(0x7f74200719b0 msgr2=0x7f7420071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:05:25.424 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.423+0000 7f7424f65700 1 -- 172.21.15.152:0/920799575 shutdown_connections 2023-12-06T15:05:25.424 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.423+0000 7f7424f65700 1 -- 172.21.15.152:0/920799575 wait complete. 2023-12-06T15:05:25.425 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.424+0000 7f7424f65700 1 Processor -- start 2023-12-06T15:05:25.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.424+0000 7f7424f65700 1 -- start start 2023-12-06T15:05:25.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.424+0000 7f7424f65700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74200fbb40 0x7f7420113620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:05:25.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.424+0000 7f7424f65700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7420101b00 0x7f7420113ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:05:25.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.424+0000 7f7424f65700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742010d4e0 con 0x7f7420101b00 2023-12-06T15:05:25.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.424+0000 7f7424f65700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742010d650 con 0x7f74200fbb40 2023-12-06T15:05:25.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.424+0000 7f741dd9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7420101b00 0x7f7420113ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:05:25.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.424+0000 7f741dd9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7420101b00 0x7f7420113ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60028/0 (socket says 172.21.15.152:60028) 2023-12-06T15:05:25.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.424+0000 7f741dd9b700 1 -- 172.21.15.152:0/1222545952 learned_addr learned my addr 172.21.15.152:0/1222545952 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:05:25.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.424+0000 7f741e59c700 1 --2- 172.21.15.152:0/1222545952 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74200fbb40 0x7f7420113620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:05:25.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.424+0000 7f741dd9b700 1 -- 172.21.15.152:0/1222545952 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74200fbb40 msgr2=0x7f7420113620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:05:25.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.424+0000 7f741dd9b700 1 --2- 172.21.15.152:0/1222545952 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74200fbb40 0x7f7420113620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:05:25.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.424+0000 7f741dd9b700 1 -- 172.21.15.152:0/1222545952 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7408005040 con 0x7f7420101b00 2023-12-06T15:05:25.426 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.424+0000 7f741dd9b700 1 --2- 172.21.15.152:0/1222545952 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7420101b00 0x7f7420113ba0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f741000b790 tx=0x7f7410009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:05:25.427 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.425+0000 7f7416ffd700 1 -- 172.21.15.152:0/1222545952 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f741000f770 con 0x7f7420101b00 2023-12-06T15:05:25.427 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.425+0000 7f7416ffd700 1 -- 172.21.15.152:0/1222545952 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f741000fd80 con 0x7f7420101b00 2023-12-06T15:05:25.427 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.425+0000 7f7416ffd700 1 -- 172.21.15.152:0/1222545952 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f741000d310 con 0x7f7420101b00 2023-12-06T15:05:25.427 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.425+0000 7f7424f65700 1 -- 172.21.15.152:0/1222545952 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f742010d930 con 0x7f7420101b00 2023-12-06T15:05:25.427 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.425+0000 7f7424f65700 1 -- 172.21.15.152:0/1222545952 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f742010de70 con 0x7f7420101b00 2023-12-06T15:05:25.427 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.426+0000 7f7424f65700 1 -- 172.21.15.152:0/1222545952 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74200734d0 con 0x7f7420101b00 2023-12-06T15:05:25.428 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.426+0000 7f7416ffd700 1 -- 172.21.15.152:0/1222545952 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f7410010420 con 0x7f7420101b00 2023-12-06T15:05:25.428 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.426+0000 7f7416ffd700 1 --2- 172.21.15.152:0/1222545952 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f740c06ce60 0x7f740c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:05:25.428 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.427+0000 7f741e59c700 1 --2- 172.21.15.152:0/1222545952 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f740c06ce60 0x7f740c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:05:25.428 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.427+0000 7f7416ffd700 1 -- 172.21.15.152:0/1222545952 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f741008c380 con 0x7f7420101b00 2023-12-06T15:05:25.428 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.427+0000 7f741e59c700 1 --2- 172.21.15.152:0/1222545952 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f740c06ce60 0x7f740c06f310 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7408004f90 tx=0x7f7408009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:05:25.431 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.431+0000 7f7416ffd700 1 -- 172.21.15.152:0/1222545952 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f7410059c60 con 0x7f7420101b00 2023-12-06T15:05:25.702 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.701+0000 7f7424f65700 1 -- 172.21.15.152:0/1222545952 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f742010ec00 con 0x7f7420101b00 2023-12-06T15:05:25.702 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.702+0000 7f7416ffd700 1 -- 172.21.15.152:0/1222545952 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+261 (secure 0 0 0) 0x7f74100597f0 con 0x7f7420101b00 2023-12-06T15:05:25.702 INFO:teuthology.orchestra.run.smithi152.stdout:HEALTH_ERR Upgrade: failed due to an unexpected exception 2023-12-06T15:05:25.702 INFO:teuthology.orchestra.run.smithi152.stdout:[ERR] UPGRADE_EXCEPTION: Upgrade: failed due to an unexpected exception 2023-12-06T15:05:25.702 INFO:teuthology.orchestra.run.smithi152.stdout: Unexpected exception occurred during upgrade process: osd require-osd-release failed: unrecognized release unknown retval: -22 2023-12-06T15:05:25.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.704+0000 7f7424f65700 1 -- 172.21.15.152:0/1222545952 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f740c06ce60 msgr2=0x7f740c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:05:25.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.704+0000 7f7424f65700 1 --2- 172.21.15.152:0/1222545952 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f740c06ce60 0x7f740c06f310 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7408004f90 tx=0x7f7408009e30 comp rx=0 tx=0).stop 2023-12-06T15:05:25.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.704+0000 7f7424f65700 1 -- 172.21.15.152:0/1222545952 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7420101b00 msgr2=0x7f7420113ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:05:25.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.704+0000 7f7424f65700 1 --2- 172.21.15.152:0/1222545952 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7420101b00 0x7f7420113ba0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f741000b790 tx=0x7f7410009250 comp rx=0 tx=0).stop 2023-12-06T15:05:25.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.704+0000 7f7424f65700 1 -- 172.21.15.152:0/1222545952 shutdown_connections 2023-12-06T15:05:25.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.704+0000 7f7424f65700 1 --2- 172.21.15.152:0/1222545952 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f740c06ce60 0x7f740c06f310 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:05:25.704 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.704+0000 7f7424f65700 1 --2- 172.21.15.152:0/1222545952 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74200fbb40 0x7f7420113620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:05:25.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.704+0000 7f7424f65700 1 --2- 172.21.15.152:0/1222545952 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7420101b00 0x7f7420113ba0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:05:25.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.704+0000 7f7424f65700 1 -- 172.21.15.152:0/1222545952 >> 172.21.15.152:0/1222545952 conn(0x7f74200719b0 msgr2=0x7f7420065470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:05:25.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.704+0000 7f7424f65700 1 -- 172.21.15.152:0/1222545952 shutdown_connections 2023-12-06T15:05:25.705 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:25.704+0000 7f7424f65700 1 -- 172.21.15.152:0/1222545952 wait complete. 2023-12-06T15:05:26.052 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:25 smithi152 ceph-mon[192652]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:05:26.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:25 smithi190 ceph-mon[178398]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:05:26.095 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -e sha1=0482646fcf78576d871bc87843257d82edb79541 -- bash -c 'ceph versions' 2023-12-06T15:05:26.358 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T15:05:26.831 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:26 smithi152 ceph-mon[192652]: pgmap v162: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:05:26.832 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:26 smithi152 ceph-mon[192652]: from='client.? 172.21.15.152:0/1222545952' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-06T15:05:27.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:26 smithi190 ceph-mon[178398]: pgmap v162: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:05:27.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:26 smithi190 ceph-mon[178398]: from='client.? 172.21.15.152:0/1222545952' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2023-12-06T15:05:27.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.371+0000 7f13ce5aa700 1 -- 172.21.15.152:0/3790591880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13c80fbb30 msgr2=0x7f13c80fbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:05:27.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.371+0000 7f13ce5aa700 1 --2- 172.21.15.152:0/3790591880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13c80fbb30 0x7f13c80fbfa0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f13bc004940 tx=0x7f13bc009e30 comp rx=0 tx=0).stop 2023-12-06T15:05:27.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.371+0000 7f13ce5aa700 1 -- 172.21.15.152:0/3790591880 shutdown_connections 2023-12-06T15:05:27.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.371+0000 7f13ce5aa700 1 --2- 172.21.15.152:0/3790591880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13c80fbb30 0x7f13c80fbfa0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:05:27.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.371+0000 7f13ce5aa700 1 --2- 172.21.15.152:0/3790591880 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13c8101af0 0x7f13c8101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:05:27.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.371+0000 7f13ce5aa700 1 -- 172.21.15.152:0/3790591880 >> 172.21.15.152:0/3790591880 conn(0x7f13c80f7690 msgr2=0x7f13c80f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:05:27.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.371+0000 7f13ce5aa700 1 -- 172.21.15.152:0/3790591880 shutdown_connections 2023-12-06T15:05:27.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.371+0000 7f13ce5aa700 1 -- 172.21.15.152:0/3790591880 wait complete. 2023-12-06T15:05:27.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.372+0000 7f13ce5aa700 1 Processor -- start 2023-12-06T15:05:27.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.372+0000 7f13ce5aa700 1 -- start start 2023-12-06T15:05:27.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.372+0000 7f13ce5aa700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13c80fbb30 0x7f13c81125f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:05:27.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.372+0000 7f13ce5aa700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13c8101af0 0x7f13c8112b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:05:27.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.372+0000 7f13ce5aa700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c810c4b0 con 0x7f13c8101af0 2023-12-06T15:05:27.374 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.372+0000 7f13ce5aa700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c810c620 con 0x7f13c80fbb30 2023-12-06T15:05:27.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.372+0000 7f13c77fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13c8101af0 0x7f13c8112b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:05:27.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.372+0000 7f13c77fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13c8101af0 0x7f13c8112b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:60056/0 (socket says 172.21.15.152:60056) 2023-12-06T15:05:27.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.372+0000 7f13c77fe700 1 -- 172.21.15.152:0/1001369801 learned_addr learned my addr 172.21.15.152:0/1001369801 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:05:27.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.373+0000 7f13c77fe700 1 -- 172.21.15.152:0/1001369801 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13c80fbb30 msgr2=0x7f13c81125f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:05:27.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.373+0000 7f13c7fff700 1 --2- 172.21.15.152:0/1001369801 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13c80fbb30 0x7f13c81125f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:05:27.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.373+0000 7f13c77fe700 1 --2- 172.21.15.152:0/1001369801 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13c80fbb30 0x7f13c81125f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:05:27.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.373+0000 7f13c77fe700 1 -- 172.21.15.152:0/1001369801 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13bc005040 con 0x7f13c8101af0 2023-12-06T15:05:27.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.373+0000 7f13c7fff700 1 --2- 172.21.15.152:0/1001369801 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13c80fbb30 0x7f13c81125f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-06T15:05:27.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.373+0000 7f13c77fe700 1 --2- 172.21.15.152:0/1001369801 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13c8101af0 0x7f13c8112b70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f13bc00b3b0 tx=0x7f13bc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:05:27.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.373+0000 7f13c4ff9700 1 -- 172.21.15.152:0/1001369801 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13bc00e040 con 0x7f13c8101af0 2023-12-06T15:05:27.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.373+0000 7f13ce5aa700 1 -- 172.21.15.152:0/1001369801 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13c810c8a0 con 0x7f13c8101af0 2023-12-06T15:05:27.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.373+0000 7f13c4ff9700 1 -- 172.21.15.152:0/1001369801 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f13bc00bc50 con 0x7f13c8101af0 2023-12-06T15:05:27.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.373+0000 7f13c4ff9700 1 -- 172.21.15.152:0/1001369801 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13bc013420 con 0x7f13c8101af0 2023-12-06T15:05:27.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.373+0000 7f13ce5aa700 1 -- 172.21.15.152:0/1001369801 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c810cde0 con 0x7f13c8101af0 2023-12-06T15:05:27.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.374+0000 7f13ce5aa700 1 -- 172.21.15.152:0/1001369801 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13c8103fa0 con 0x7f13c8101af0 2023-12-06T15:05:27.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.374+0000 7f13c4ff9700 1 -- 172.21.15.152:0/1001369801 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f13bc01c430 con 0x7f13c8101af0 2023-12-06T15:05:27.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.375+0000 7f13c4ff9700 1 --2- 172.21.15.152:0/1001369801 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f13b006ce60 0x7f13b006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:05:27.377 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.375+0000 7f13c4ff9700 1 -- 172.21.15.152:0/1001369801 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f13bc08d0f0 con 0x7f13c8101af0 2023-12-06T15:05:27.377 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.375+0000 7f13c7fff700 1 --2- 172.21.15.152:0/1001369801 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f13b006ce60 0x7f13b006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:05:27.377 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.375+0000 7f13c7fff700 1 --2- 172.21.15.152:0/1001369801 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f13b006ce60 0x7f13b006f310 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f13b8006fd0 tx=0x7f13b8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:05:27.379 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.380+0000 7f13c4ff9700 1 -- 172.21.15.152:0/1001369801 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f13bc05ab20 con 0x7f13c8101af0 2023-12-06T15:05:27.656 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.656+0000 7f13ce5aa700 1 -- 172.21.15.152:0/1001369801 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f13c8064800 con 0x7f13c8101af0 2023-12-06T15:05:27.657 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.657+0000 7f13c4ff9700 1 -- 172.21.15.152:0/1001369801 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+721 (secure 0 0 0) 0x7f13bc05a6b0 con 0x7f13c8101af0 2023-12-06T15:05:27.657 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-12-06T15:05:27.657 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": { 2023-12-06T15:05:27.657 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 2 2023-12-06T15:05:27.657 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:05:27.657 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": { 2023-12-06T15:05:27.657 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 2 2023-12-06T15:05:27.657 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:05:27.657 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": { 2023-12-06T15:05:27.657 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 6 2023-12-06T15:05:27.658 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:05:27.658 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2023-12-06T15:05:27.658 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 4 2023-12-06T15:05:27.658 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:05:27.658 INFO:teuthology.orchestra.run.smithi152.stdout: "overall": { 2023-12-06T15:05:27.658 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 4, 2023-12-06T15:05:27.658 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 10 2023-12-06T15:05:27.658 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-12-06T15:05:27.658 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-12-06T15:05:27.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.659+0000 7f13ce5aa700 1 -- 172.21.15.152:0/1001369801 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f13b006ce60 msgr2=0x7f13b006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:05:27.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.659+0000 7f13ce5aa700 1 --2- 172.21.15.152:0/1001369801 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f13b006ce60 0x7f13b006f310 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f13b8006fd0 tx=0x7f13b8008040 comp rx=0 tx=0).stop 2023-12-06T15:05:27.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.659+0000 7f13ce5aa700 1 -- 172.21.15.152:0/1001369801 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13c8101af0 msgr2=0x7f13c8112b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:05:27.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.659+0000 7f13ce5aa700 1 --2- 172.21.15.152:0/1001369801 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13c8101af0 0x7f13c8112b70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f13bc00b3b0 tx=0x7f13bc009e30 comp rx=0 tx=0).stop 2023-12-06T15:05:27.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.659+0000 7f13ce5aa700 1 -- 172.21.15.152:0/1001369801 shutdown_connections 2023-12-06T15:05:27.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.659+0000 7f13ce5aa700 1 --2- 172.21.15.152:0/1001369801 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f13b006ce60 0x7f13b006f310 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:05:27.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.659+0000 7f13ce5aa700 1 --2- 172.21.15.152:0/1001369801 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13c80fbb30 0x7f13c81125f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:05:27.659 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.659+0000 7f13ce5aa700 1 --2- 172.21.15.152:0/1001369801 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13c8101af0 0x7f13c8112b70 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:05:27.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.659+0000 7f13ce5aa700 1 -- 172.21.15.152:0/1001369801 >> 172.21.15.152:0/1001369801 conn(0x7f13c80f7690 msgr2=0x7f13c80f9120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:05:27.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.659+0000 7f13ce5aa700 1 -- 172.21.15.152:0/1001369801 shutdown_connections 2023-12-06T15:05:27.660 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:05:27.659+0000 7f13ce5aa700 1 -- 172.21.15.152:0/1001369801 wait complete. 2023-12-06T15:05:27.985 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:27 smithi152 ceph-mon[192652]: from='client.? 172.21.15.152:0/1001369801' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:05:28.036 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -e sha1=0482646fcf78576d871bc87843257d82edb79541 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2023-12-06T15:05:28.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:27 smithi190 ceph-mon[178398]: from='client.? 172.21.15.152:0/1001369801' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:05:28.299 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T15:05:28.968 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:28 smithi152 ceph-mon[192652]: pgmap v163: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:05:29.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:28 smithi190 ceph-mon[178398]: pgmap v163: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:05:29.315 INFO:teuthology.orchestra.run.smithi152.stdout:wait for servicemap items w/ changing names to refresh 2023-12-06T15:05:29.661 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -e sha1=0482646fcf78576d871bc87843257d82edb79541 -- bash -c 'sleep 60' 2023-12-06T15:05:29.929 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T15:05:31.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:30 smithi190 ceph-mon[178398]: pgmap v164: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:05:31.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:30 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:05:31.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:30 smithi152 ceph-mon[192652]: pgmap v164: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:05:31.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:30 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:05:33.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:32 smithi190 ceph-mon[178398]: pgmap v165: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:05:33.129 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:32 smithi152 ceph-mon[192652]: pgmap v165: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:05:35.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:34 smithi190 ceph-mon[178398]: pgmap v166: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:05:35.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:34 smithi152 ceph-mon[192652]: pgmap v166: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:05:37.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:36 smithi190 ceph-mon[178398]: pgmap v167: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:05:37.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:36 smithi152 ceph-mon[192652]: pgmap v167: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:05:39.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:38 smithi190 ceph-mon[178398]: pgmap v168: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:05:39.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:38 smithi152 ceph-mon[192652]: pgmap v168: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:05:41.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:40 smithi190 ceph-mon[178398]: pgmap v169: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:05:41.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:40 smithi152 ceph-mon[192652]: pgmap v169: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:05:43.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:42 smithi190 ceph-mon[178398]: pgmap v170: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:05:43.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:42 smithi152 ceph-mon[192652]: pgmap v170: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:05:45.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:44 smithi190 ceph-mon[178398]: pgmap v171: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:05:45.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:44 smithi152 ceph-mon[192652]: pgmap v171: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:05:46.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:45 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:05:46.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:45 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:05:47.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:46 smithi190 ceph-mon[178398]: pgmap v172: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:05:47.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:46 smithi152 ceph-mon[192652]: pgmap v172: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:05:48.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:47 smithi190 ceph-mon[178398]: pgmap v173: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:05:48.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:47 smithi152 ceph-mon[192652]: pgmap v173: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:05:50.128 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:49 smithi152 ceph-mon[192652]: pgmap v174: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:05:50.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:49 smithi190 ceph-mon[178398]: pgmap v174: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:05:52.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:52 smithi190 ceph-mon[178398]: pgmap v175: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:05:52.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:52 smithi152 ceph-mon[192652]: pgmap v175: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:05:54.322 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:54 smithi190 ceph-mon[178398]: pgmap v176: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:05:54.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:54 smithi152 ceph-mon[192652]: pgmap v176: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:05:56.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:56 smithi152 ceph-mon[192652]: pgmap v177: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:05:56.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:56 smithi190 ceph-mon[178398]: pgmap v177: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:05:58.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:05:58 smithi152 ceph-mon[192652]: pgmap v178: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:05:58.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:05:58 smithi190 ceph-mon[178398]: pgmap v178: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:06:00.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:00 smithi152 ceph-mon[192652]: pgmap v179: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:06:00.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:00 smithi190 ceph-mon[178398]: pgmap v179: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:06:01.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:06:01.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:01 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:06:01.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:06:01.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:01 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-06T15:06:02.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:02 smithi152 ceph-mon[192652]: pgmap v180: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:06:02.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:02 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:06:02.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:02 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T15:06:02.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:02 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:06:02.574 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:02 smithi190 ceph-mon[178398]: pgmap v180: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:06:02.574 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:02 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-06T15:06:02.574 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:02 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-06T15:06:02.574 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:02 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' 2023-12-06T15:06:04.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:04 smithi152 ceph-mon[192652]: pgmap v181: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:06:04.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:04 smithi190 ceph-mon[178398]: pgmap v181: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:06:06.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:06 smithi152 ceph-mon[192652]: pgmap v182: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:06:06.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:06 smithi190 ceph-mon[178398]: pgmap v182: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:06:08.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:08 smithi152 ceph-mon[192652]: pgmap v183: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:06:08.574 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:08 smithi190 ceph-mon[178398]: pgmap v183: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:06:10.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:10 smithi152 ceph-mon[192652]: pgmap v184: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:06:10.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:10 smithi190 ceph-mon[178398]: pgmap v184: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:06:12.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:12 smithi152 ceph-mon[192652]: pgmap v185: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:06:12.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:12 smithi190 ceph-mon[178398]: pgmap v185: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:06:14.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:14 smithi152 ceph-mon[192652]: pgmap v186: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:06:14.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:14 smithi190 ceph-mon[178398]: pgmap v186: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:06:16.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:16 smithi152 ceph-mon[192652]: pgmap v187: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:06:16.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:16 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:06:16.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:16 smithi190 ceph-mon[178398]: pgmap v187: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:06:16.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:16 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:06:18.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:18 smithi152 ceph-mon[192652]: pgmap v188: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:06:18.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:18 smithi190 ceph-mon[178398]: pgmap v188: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:06:20.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:20 smithi152 ceph-mon[192652]: pgmap v189: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:06:20.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:20 smithi190 ceph-mon[178398]: pgmap v189: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:06:22.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:22 smithi152 ceph-mon[192652]: pgmap v190: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:06:22.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:22 smithi190 ceph-mon[178398]: pgmap v190: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:06:24.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:24 smithi152 ceph-mon[192652]: pgmap v191: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:06:24.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:24 smithi190 ceph-mon[178398]: pgmap v191: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:06:26.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:26 smithi190 ceph-mon[178398]: pgmap v192: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:06:26.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:26 smithi152 ceph-mon[192652]: pgmap v192: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:06:28.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:28 smithi190 ceph-mon[178398]: pgmap v193: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:06:28.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:28 smithi152 ceph-mon[192652]: pgmap v193: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:06:30.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:30 smithi190 ceph-mon[178398]: pgmap v194: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:06:30.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:30 smithi152 ceph-mon[192652]: pgmap v194: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:06:31.199 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -e sha1=0482646fcf78576d871bc87843257d82edb79541 -- bash -c 'ceph orch ps' 2023-12-06T15:06:31.470 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T15:06:31.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:31 smithi190 ceph-mon[178398]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:06:31.603 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:31 smithi152 ceph-mon[192652]: from='mgr.34104 172.21.15.152:0/199516554' entity='mgr.smithi152.meodco' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-06T15:06:32.330 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:32 smithi152 ceph-mon[192652]: pgmap v195: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:06:32.543 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.543+0000 7f1123128700 1 -- 172.21.15.152:0/3148221144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f111c102410 msgr2=0x7f111c0fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:32.544 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.543+0000 7f1123128700 1 --2- 172.21.15.152:0/3148221144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f111c102410 0x7f111c0fc2f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1108004940 tx=0x7f1108009e30 comp rx=0 tx=0).stop 2023-12-06T15:06:32.544 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.543+0000 7f1123128700 1 -- 172.21.15.152:0/3148221144 shutdown_connections 2023-12-06T15:06:32.544 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.543+0000 7f1123128700 1 --2- 172.21.15.152:0/3148221144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f111c102410 0x7f111c0fc2f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:32.544 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.543+0000 7f1123128700 1 --2- 172.21.15.152:0/3148221144 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f111c101b00 0x7f111c101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:32.544 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.543+0000 7f1123128700 1 -- 172.21.15.152:0/3148221144 >> 172.21.15.152:0/3148221144 conn(0x7f111c0711a0 msgr2=0x7f111c0715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:06:32.544 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.543+0000 7f1123128700 1 -- 172.21.15.152:0/3148221144 shutdown_connections 2023-12-06T15:06:32.544 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.543+0000 7f1123128700 1 -- 172.21.15.152:0/3148221144 wait complete. 2023-12-06T15:06:32.544 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.543+0000 7f1123128700 1 Processor -- start 2023-12-06T15:06:32.544 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.543+0000 7f1123128700 1 -- start start 2023-12-06T15:06:32.545 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.544+0000 7f1123128700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f111c101b00 0x7f111c112570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:32.545 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.544+0000 7f1123128700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f111c102410 0x7f111c112ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:32.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.544+0000 7f1123128700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111c113100 con 0x7f111c102410 2023-12-06T15:06:32.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.544+0000 7f1123128700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111c10c430 con 0x7f111c101b00 2023-12-06T15:06:32.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.544+0000 7f111bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f111c102410 0x7f111c112ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:32.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.544+0000 7f111bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f111c102410 0x7f111c112ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35096/0 (socket says 172.21.15.152:35096) 2023-12-06T15:06:32.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.544+0000 7f111bfff700 1 -- 172.21.15.152:0/1115094351 learned_addr learned my addr 172.21.15.152:0/1115094351 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:06:32.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.544+0000 7f1120ec4700 1 --2- 172.21.15.152:0/1115094351 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f111c101b00 0x7f111c112570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:32.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.544+0000 7f111bfff700 1 -- 172.21.15.152:0/1115094351 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f111c101b00 msgr2=0x7f111c112570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:32.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.544+0000 7f111bfff700 1 --2- 172.21.15.152:0/1115094351 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f111c101b00 0x7f111c112570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:32.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.544+0000 7f111bfff700 1 -- 172.21.15.152:0/1115094351 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1108005040 con 0x7f111c102410 2023-12-06T15:06:32.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.544+0000 7f111bfff700 1 --2- 172.21.15.152:0/1115094351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f111c102410 0x7f111c112ab0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1108009390 tx=0x7f1108009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:06:32.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.544+0000 7f11197fa700 1 -- 172.21.15.152:0/1115094351 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f110800e040 con 0x7f111c102410 2023-12-06T15:06:32.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.545+0000 7f11197fa700 1 -- 172.21.15.152:0/1115094351 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f110800bd90 con 0x7f111c102410 2023-12-06T15:06:32.546 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.545+0000 7f1123128700 1 -- 172.21.15.152:0/1115094351 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f111c10c6b0 con 0x7f111c102410 2023-12-06T15:06:32.547 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.545+0000 7f11197fa700 1 -- 172.21.15.152:0/1115094351 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1108013660 con 0x7f111c102410 2023-12-06T15:06:32.547 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.545+0000 7f1123128700 1 -- 172.21.15.152:0/1115094351 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f111c10cb90 con 0x7f111c102410 2023-12-06T15:06:32.547 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.545+0000 7f1123128700 1 -- 172.21.15.152:0/1115094351 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f111c072cc0 con 0x7f111c102410 2023-12-06T15:06:32.547 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.546+0000 7f11197fa700 1 -- 172.21.15.152:0/1115094351 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f110801e420 con 0x7f111c102410 2023-12-06T15:06:32.548 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.547+0000 7f11197fa700 1 --2- 172.21.15.152:0/1115094351 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f110c06ce70 0x7f110c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:32.548 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.547+0000 7f11197fa700 1 -- 172.21.15.152:0/1115094351 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f1108090de0 con 0x7f111c102410 2023-12-06T15:06:32.548 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.547+0000 7f1120ec4700 1 --2- 172.21.15.152:0/1115094351 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f110c06ce70 0x7f110c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:32.548 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.547+0000 7f1120ec4700 1 --2- 172.21.15.152:0/1115094351 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f110c06ce70 0x7f110c06f320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1110004f40 tx=0x7f111000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:06:32.551 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.551+0000 7f11197fa700 1 -- 172.21.15.152:0/1115094351 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f110805e660 con 0x7f111c102410 2023-12-06T15:06:32.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:32 smithi190 ceph-mon[178398]: pgmap v195: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:06:32.750 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.750+0000 7f1123128700 1 -- 172.21.15.152:0/1115094351 --> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f111c10dbc0 con 0x7f110c06ce70 2023-12-06T15:06:32.760 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.760+0000 7f11197fa700 1 -- 172.21.15.152:0/1115094351 <== mgr.34104 v2:172.21.15.152:6800/2427836422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f111c10dbc0 con 0x7f110c06ce70 2023-12-06T15:06:32.760 INFO:teuthology.orchestra.run.smithi152.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-06T15:06:32.761 INFO:teuthology.orchestra.run.smithi152.stdout:alertmanager.smithi152 smithi152 *:9093,9094 running (6m) 2m ago 12m 26.3M - 0.25.0 c8568f914cd2 b1a46cc95546 2023-12-06T15:06:32.761 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi152 smithi152 running (4m) 2m ago 12m 7470k - 19.0.0-26-g0482646f 26bb7d89db2e 222039c21ee0 2023-12-06T15:06:32.761 INFO:teuthology.orchestra.run.smithi152.stdout:crash.smithi190 smithi190 running (4m) 95s ago 11m 7461k - 19.0.0-26-g0482646f 26bb7d89db2e 8841ae485b70 2023-12-06T15:06:32.761 INFO:teuthology.orchestra.run.smithi152.stdout:grafana.smithi152 smithi152 *:3000 running (6m) 2m ago 12m 88.0M - 9.4.7 954c08fa6188 5c6a52d58144 2023-12-06T15:06:32.761 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.acqswy smithi152 running (8m) 2m ago 8m 5566M - 17.2.7-113-gece0d607 a5c6421f1c5f ff9375cec192 2023-12-06T15:06:32.761 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi152.ypivwc smithi152 running (8m) 2m ago 8m 538M - 17.2.7-113-gece0d607 a5c6421f1c5f d809a681491b 2023-12-06T15:06:32.761 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi190.edwtqj smithi190 running (8m) 95s ago 8m 626M - 17.2.7-113-gece0d607 a5c6421f1c5f f3b7ebd93b04 2023-12-06T15:06:32.761 INFO:teuthology.orchestra.run.smithi152.stdout:mds.cephfs.smithi190.uucxzu smithi190 running (8m) 95s ago 8m 4860M - 17.2.7-113-gece0d607 a5c6421f1c5f c01be1409c5f 2023-12-06T15:06:32.761 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi152.meodco smithi152 *:8443,9283,8765 running (5m) 2m ago 13m 510M - 19.0.0-26-g0482646f 26bb7d89db2e 16ed2af8a3d0 2023-12-06T15:06:32.761 INFO:teuthology.orchestra.run.smithi152.stdout:mgr.smithi190.ubusrr smithi190 *:8443,9283,8765 running (5m) 95s ago 11m 449M - 19.0.0-26-g0482646f 26bb7d89db2e cfae14b9324d 2023-12-06T15:06:32.761 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi152 smithi152 running (5m) 2m ago 13m 66.8M 2048M 19.0.0-26-g0482646f 26bb7d89db2e f5163d3b0f5f 2023-12-06T15:06:32.761 INFO:teuthology.orchestra.run.smithi152.stdout:mon.smithi190 smithi190 running (4m) 95s ago 11m 56.8M 2048M 19.0.0-26-g0482646f 26bb7d89db2e b25040d5fdfe 2023-12-06T15:06:32.761 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi152 smithi152 *:9100 running (6m) 2m ago 12m 18.5M - 1.5.0 0da6a335fe13 81be696b9be8 2023-12-06T15:06:32.761 INFO:teuthology.orchestra.run.smithi152.stdout:node-exporter.smithi190 smithi190 *:9100 running (5m) 95s ago 11m 20.0M - 1.5.0 0da6a335fe13 2e521e235bf7 2023-12-06T15:06:32.762 INFO:teuthology.orchestra.run.smithi152.stdout:osd.0 smithi152 running (4m) 2m ago 11m 169M 1568M 19.0.0-26-g0482646f 26bb7d89db2e 05e00966036e 2023-12-06T15:06:32.762 INFO:teuthology.orchestra.run.smithi152.stdout:osd.1 smithi152 running (3m) 2m ago 10m 122M 1568M 19.0.0-26-g0482646f 26bb7d89db2e c0eaab4b2fd0 2023-12-06T15:06:32.762 INFO:teuthology.orchestra.run.smithi152.stdout:osd.2 smithi152 running (3m) 2m ago 10m 12.6M 1568M 19.0.0-26-g0482646f 26bb7d89db2e 1440f943b48e 2023-12-06T15:06:32.762 INFO:teuthology.orchestra.run.smithi152.stdout:osd.3 smithi190 running (2m) 95s ago 10m 130M 2592M 19.0.0-26-g0482646f 26bb7d89db2e 9871106e0a4f 2023-12-06T15:06:32.762 INFO:teuthology.orchestra.run.smithi152.stdout:osd.4 smithi190 running (2m) 95s ago 9m 116M 2592M 19.0.0-26-g0482646f 26bb7d89db2e c2350bc6d448 2023-12-06T15:06:32.762 INFO:teuthology.orchestra.run.smithi152.stdout:osd.5 smithi190 running (97s) 95s ago 9m 16.2M 2592M 19.0.0-26-g0482646f 26bb7d89db2e 8e8b6c38342a 2023-12-06T15:06:32.762 INFO:teuthology.orchestra.run.smithi152.stdout:prometheus.smithi152 smithi152 *:9095 running (5m) 2m ago 11m 48.7M - 2.43.0 a07b618ecd1d 5f7e5860a419 2023-12-06T15:06:32.763 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.762+0000 7f1123128700 1 -- 172.21.15.152:0/1115094351 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f110c06ce70 msgr2=0x7f110c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:32.763 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.762+0000 7f1123128700 1 --2- 172.21.15.152:0/1115094351 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f110c06ce70 0x7f110c06f320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1110004f40 tx=0x7f111000b040 comp rx=0 tx=0).stop 2023-12-06T15:06:32.763 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.762+0000 7f1123128700 1 -- 172.21.15.152:0/1115094351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f111c102410 msgr2=0x7f111c112ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:32.763 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.762+0000 7f1123128700 1 --2- 172.21.15.152:0/1115094351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f111c102410 0x7f111c112ab0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1108009390 tx=0x7f1108009e30 comp rx=0 tx=0).stop 2023-12-06T15:06:32.763 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.762+0000 7f1123128700 1 -- 172.21.15.152:0/1115094351 shutdown_connections 2023-12-06T15:06:32.763 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.762+0000 7f1123128700 1 --2- 172.21.15.152:0/1115094351 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f110c06ce70 0x7f110c06f320 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:32.763 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.762+0000 7f1123128700 1 --2- 172.21.15.152:0/1115094351 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f111c101b00 0x7f111c112570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:32.763 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.762+0000 7f1123128700 1 --2- 172.21.15.152:0/1115094351 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f111c102410 0x7f111c112ab0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:32.763 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.762+0000 7f1123128700 1 -- 172.21.15.152:0/1115094351 >> 172.21.15.152:0/1115094351 conn(0x7f111c0711a0 msgr2=0x7f111c0fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:06:32.763 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.762+0000 7f1123128700 1 -- 172.21.15.152:0/1115094351 shutdown_connections 2023-12-06T15:06:32.763 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:32.762+0000 7f1123128700 1 -- 172.21.15.152:0/1115094351 wait complete. 2023-12-06T15:06:33.125 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -e sha1=0482646fcf78576d871bc87843257d82edb79541 -- bash -c 'ceph versions' 2023-12-06T15:06:33.391 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T15:06:34.246 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:34 smithi152 ceph-mon[192652]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:06:34.247 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:34 smithi152 ceph-mon[192652]: pgmap v196: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:06:34.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.447+0000 7fb1b2373700 1 -- 172.21.15.152:0/3196120901 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1ac0fdc30 msgr2=0x7fb1ac0fe000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:34.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.447+0000 7fb1b2373700 1 --2- 172.21.15.152:0/3196120901 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1ac0fdc30 0x7fb1ac0fe000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb19c004940 tx=0x7fb19c009e30 comp rx=0 tx=0).stop 2023-12-06T15:06:34.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.447+0000 7fb1b2373700 1 -- 172.21.15.152:0/3196120901 shutdown_connections 2023-12-06T15:06:34.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.447+0000 7fb1b2373700 1 --2- 172.21.15.152:0/3196120901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1ac0fe5d0 0x7fb1ac106ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:34.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.447+0000 7fb1b2373700 1 --2- 172.21.15.152:0/3196120901 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1ac0fdc30 0x7fb1ac0fe000 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:34.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.447+0000 7fb1b2373700 1 -- 172.21.15.152:0/3196120901 >> 172.21.15.152:0/3196120901 conn(0x7fb1ac0f7690 msgr2=0x7fb1ac0f9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:06:34.448 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.447+0000 7fb1b2373700 1 -- 172.21.15.152:0/3196120901 shutdown_connections 2023-12-06T15:06:34.448 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.447+0000 7fb1b2373700 1 -- 172.21.15.152:0/3196120901 wait complete. 2023-12-06T15:06:34.449 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.447+0000 7fb1b2373700 1 Processor -- start 2023-12-06T15:06:34.449 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.448+0000 7fb1b2373700 1 -- start start 2023-12-06T15:06:34.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.448+0000 7fb1b2373700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1ac0fdc30 0x7fb1ac1136c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:34.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.448+0000 7fb1b2373700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1ac0fe5d0 0x7fb1ac113c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:34.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.448+0000 7fb1b2373700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac114290 con 0x7fb1ac0fdc30 2023-12-06T15:06:34.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.448+0000 7fb1b2373700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac10d580 con 0x7fb1ac0fe5d0 2023-12-06T15:06:34.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.448+0000 7fb1abfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1ac0fdc30 0x7fb1ac1136c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:34.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.448+0000 7fb1abfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1ac0fdc30 0x7fb1ac1136c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35120/0 (socket says 172.21.15.152:35120) 2023-12-06T15:06:34.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.448+0000 7fb1abfff700 1 -- 172.21.15.152:0/1948989444 learned_addr learned my addr 172.21.15.152:0/1948989444 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:06:34.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.448+0000 7fb1ab7fe700 1 --2- 172.21.15.152:0/1948989444 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1ac0fe5d0 0x7fb1ac113c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:34.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.448+0000 7fb1abfff700 1 -- 172.21.15.152:0/1948989444 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1ac0fe5d0 msgr2=0x7fb1ac113c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:34.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.448+0000 7fb1abfff700 1 --2- 172.21.15.152:0/1948989444 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1ac0fe5d0 0x7fb1ac113c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:34.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.448+0000 7fb1abfff700 1 -- 172.21.15.152:0/1948989444 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19c005040 con 0x7fb1ac0fdc30 2023-12-06T15:06:34.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.448+0000 7fb1ab7fe700 1 --2- 172.21.15.152:0/1948989444 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1ac0fe5d0 0x7fb1ac113c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-06T15:06:34.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.448+0000 7fb1abfff700 1 --2- 172.21.15.152:0/1948989444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1ac0fdc30 0x7fb1ac1136c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb19c009150 tx=0x7fb19c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:06:34.451 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.448+0000 7fb1a8ff9700 1 -- 172.21.15.152:0/1948989444 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb19c00e040 con 0x7fb1ac0fdc30 2023-12-06T15:06:34.451 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.449+0000 7fb1a8ff9700 1 -- 172.21.15.152:0/1948989444 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb19c013420 con 0x7fb1ac0fdc30 2023-12-06T15:06:34.451 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.449+0000 7fb1b2373700 1 -- 172.21.15.152:0/1948989444 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1ac10d7b0 con 0x7fb1ac0fdc30 2023-12-06T15:06:34.451 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.449+0000 7fb1a8ff9700 1 -- 172.21.15.152:0/1948989444 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb19c01c630 con 0x7fb1ac0fdc30 2023-12-06T15:06:34.451 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.449+0000 7fb1b2373700 1 -- 172.21.15.152:0/1948989444 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1ac10dcf0 con 0x7fb1ac0fdc30 2023-12-06T15:06:34.451 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.449+0000 7fb1b2373700 1 -- 172.21.15.152:0/1948989444 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1ac104360 con 0x7fb1ac0fdc30 2023-12-06T15:06:34.452 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.450+0000 7fb1a8ff9700 1 -- 172.21.15.152:0/1948989444 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fb19c013970 con 0x7fb1ac0fdc30 2023-12-06T15:06:34.452 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.450+0000 7fb1a8ff9700 1 --2- 172.21.15.152:0/1948989444 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fb19406ce60 0x7fb19406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:34.452 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.450+0000 7fb1a8ff9700 1 -- 172.21.15.152:0/1948989444 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6675+0+0 (secure 0 0 0) 0x7fb19c08d720 con 0x7fb1ac0fdc30 2023-12-06T15:06:34.452 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.450+0000 7fb1ab7fe700 1 --2- 172.21.15.152:0/1948989444 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fb19406ce60 0x7fb19406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:34.452 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.451+0000 7fb1ab7fe700 1 --2- 172.21.15.152:0/1948989444 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fb19406ce60 0x7fb19406f310 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0009fd0 tx=0x7fb1a0009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:06:34.455 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.455+0000 7fb1a8ff9700 1 -- 172.21.15.152:0/1948989444 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fb19c05b000 con 0x7fb1ac0fdc30 2023-12-06T15:06:34.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:34 smithi190 ceph-mon[178398]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-06T15:06:34.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:34 smithi190 ceph-mon[178398]: pgmap v196: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:06:34.728 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.728+0000 7fb1b2373700 1 -- 172.21.15.152:0/1948989444 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb1ac0fb260 con 0x7fb1ac0fdc30 2023-12-06T15:06:34.729 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.729+0000 7fb1a8ff9700 1 -- 172.21.15.152:0/1948989444 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+721 (secure 0 0 0) 0x7fb19c05ab90 con 0x7fb1ac0fdc30 2023-12-06T15:06:34.729 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2023-12-06T15:06:34.729 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": { 2023-12-06T15:06:34.729 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 2 2023-12-06T15:06:34.729 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:06:34.729 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": { 2023-12-06T15:06:34.729 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 2 2023-12-06T15:06:34.729 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:06:34.730 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": { 2023-12-06T15:06:34.730 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 6 2023-12-06T15:06:34.730 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:06:34.730 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": { 2023-12-06T15:06:34.730 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 4 2023-12-06T15:06:34.730 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2023-12-06T15:06:34.730 INFO:teuthology.orchestra.run.smithi152.stdout: "overall": { 2023-12-06T15:06:34.730 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 17.2.7-113-gece0d607 (ece0d60728c6966000bb839fe46b2b8e2bdb5305) quincy (stable)": 4, 2023-12-06T15:06:34.730 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph version 19.0.0-26-g0482646f (0482646fcf78576d871bc87843257d82edb79541) reef (dev)": 10 2023-12-06T15:06:34.730 INFO:teuthology.orchestra.run.smithi152.stdout: } 2023-12-06T15:06:34.730 INFO:teuthology.orchestra.run.smithi152.stdout:} 2023-12-06T15:06:34.731 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.731+0000 7fb1b2373700 1 -- 172.21.15.152:0/1948989444 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fb19406ce60 msgr2=0x7fb19406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:34.731 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.731+0000 7fb1b2373700 1 --2- 172.21.15.152:0/1948989444 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fb19406ce60 0x7fb19406f310 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0009fd0 tx=0x7fb1a0009ee0 comp rx=0 tx=0).stop 2023-12-06T15:06:34.731 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.731+0000 7fb1b2373700 1 -- 172.21.15.152:0/1948989444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1ac0fdc30 msgr2=0x7fb1ac1136c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:34.731 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.731+0000 7fb1b2373700 1 --2- 172.21.15.152:0/1948989444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1ac0fdc30 0x7fb1ac1136c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb19c009150 tx=0x7fb19c009e30 comp rx=0 tx=0).stop 2023-12-06T15:06:34.731 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.731+0000 7fb1b2373700 1 -- 172.21.15.152:0/1948989444 shutdown_connections 2023-12-06T15:06:34.731 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.731+0000 7fb1b2373700 1 --2- 172.21.15.152:0/1948989444 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fb19406ce60 0x7fb19406f310 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:34.731 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.731+0000 7fb1b2373700 1 --2- 172.21.15.152:0/1948989444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb1ac0fdc30 0x7fb1ac1136c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:34.731 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.731+0000 7fb1b2373700 1 --2- 172.21.15.152:0/1948989444 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1ac0fe5d0 0x7fb1ac113c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:34.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.731+0000 7fb1b2373700 1 -- 172.21.15.152:0/1948989444 >> 172.21.15.152:0/1948989444 conn(0x7fb1ac0f7690 msgr2=0x7fb1ac1014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:06:34.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.731+0000 7fb1b2373700 1 -- 172.21.15.152:0/1948989444 shutdown_connections 2023-12-06T15:06:34.732 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:34.731+0000 7fb1b2373700 1 -- 172.21.15.152:0/1948989444 wait complete. 2023-12-06T15:06:35.108 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -e sha1=0482646fcf78576d871bc87843257d82edb79541 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2023-12-06T15:06:35.372 INFO:teuthology.orchestra.run.smithi152.stderr:Inferring config /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/mon.smithi152/config 2023-12-06T15:06:35.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:35 smithi152 ceph-mon[192652]: from='client.? 172.21.15.152:0/1948989444' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:06:35.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:35 smithi190 ceph-mon[178398]: from='client.? 172.21.15.152:0/1948989444' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:06:36.460 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.458+0000 7f931735e700 1 -- 172.21.15.152:0/3021432714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93101035a0 msgr2=0x7f93100fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:36.460 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.458+0000 7f931735e700 1 --2- 172.21.15.152:0/3021432714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93101035a0 0x7f93100fcc10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f930c004940 tx=0x7f930c009e30 comp rx=0 tx=0).stop 2023-12-06T15:06:36.460 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.458+0000 7f931735e700 1 -- 172.21.15.152:0/3021432714 shutdown_connections 2023-12-06T15:06:36.460 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.458+0000 7f931735e700 1 --2- 172.21.15.152:0/3021432714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93101035a0 0x7f93100fcc10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:36.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.458+0000 7f931735e700 1 --2- 172.21.15.152:0/3021432714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9310102c00 0x7f9310102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:36.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.458+0000 7f931735e700 1 -- 172.21.15.152:0/3021432714 >> 172.21.15.152:0/3021432714 conn(0x7f93100f8790 msgr2=0x7f93100faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:06:36.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.458+0000 7f931735e700 1 -- 172.21.15.152:0/3021432714 shutdown_connections 2023-12-06T15:06:36.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.459+0000 7f931735e700 1 -- 172.21.15.152:0/3021432714 wait complete. 2023-12-06T15:06:36.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.459+0000 7f931735e700 1 Processor -- start 2023-12-06T15:06:36.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.459+0000 7f931735e700 1 -- start start 2023-12-06T15:06:36.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.459+0000 7f931735e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9310102c00 0x7f931006ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:36.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.459+0000 7f931735e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93101035a0 0x7f9310070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:36.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.459+0000 7f931735e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9310070b10 con 0x7f9310102c00 2023-12-06T15:06:36.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.459+0000 7f931735e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9310070c80 con 0x7f93101035a0 2023-12-06T15:06:36.461 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.459+0000 7f93150fa700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9310102c00 0x7f931006ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:36.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.459+0000 7f93150fa700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9310102c00 0x7f931006ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35138/0 (socket says 172.21.15.152:35138) 2023-12-06T15:06:36.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.459+0000 7f93150fa700 1 -- 172.21.15.152:0/3954318499 learned_addr learned my addr 172.21.15.152:0/3954318499 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:06:36.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.460+0000 7f93148f9700 1 --2- 172.21.15.152:0/3954318499 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93101035a0 0x7f9310070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:36.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.460+0000 7f93150fa700 1 -- 172.21.15.152:0/3954318499 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93101035a0 msgr2=0x7f9310070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:36.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.460+0000 7f93150fa700 1 --2- 172.21.15.152:0/3954318499 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93101035a0 0x7f9310070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:36.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.460+0000 7f93150fa700 1 -- 172.21.15.152:0/3954318499 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f930c005040 con 0x7f9310102c00 2023-12-06T15:06:36.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.460+0000 7f93150fa700 1 --2- 172.21.15.152:0/3954318499 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9310102c00 0x7f931006ff40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f930000b790 tx=0x7f9300009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:06:36.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.460+0000 7f9305ffb700 1 -- 172.21.15.152:0/3954318499 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f930000f770 con 0x7f9310102c00 2023-12-06T15:06:36.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.460+0000 7f931735e700 1 -- 172.21.15.152:0/3954318499 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9310119910 con 0x7f9310102c00 2023-12-06T15:06:36.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.460+0000 7f9305ffb700 1 -- 172.21.15.152:0/3954318499 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f930000fd80 con 0x7f9310102c00 2023-12-06T15:06:36.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.460+0000 7f9305ffb700 1 -- 172.21.15.152:0/3954318499 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f930000d310 con 0x7f9310102c00 2023-12-06T15:06:36.462 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.460+0000 7f931735e700 1 -- 172.21.15.152:0/3954318499 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9310119e00 con 0x7f9310102c00 2023-12-06T15:06:36.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.461+0000 7f931735e700 1 -- 172.21.15.152:0/3954318499 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93100fff10 con 0x7f9310102c00 2023-12-06T15:06:36.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.461+0000 7f9305ffb700 1 -- 172.21.15.152:0/3954318499 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f9300010420 con 0x7f9310102c00 2023-12-06T15:06:36.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.462+0000 7f9305ffb700 1 --2- 172.21.15.152:0/3954318499 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f92fc06ce60 0x7f92fc06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:36.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.462+0000 7f9305ffb700 1 -- 172.21.15.152:0/3954318499 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f930008c380 con 0x7f9310102c00 2023-12-06T15:06:36.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.462+0000 7f93148f9700 1 --2- 172.21.15.152:0/3954318499 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f92fc06ce60 0x7f92fc06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:36.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.462+0000 7f93148f9700 1 --2- 172.21.15.152:0/3954318499 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f92fc06ce60 0x7f92fc06f310 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9310071940 tx=0x7f930c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:06:36.466 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.466+0000 7f9305ffb700 1 -- 172.21.15.152:0/3954318499 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f93000561d0 con 0x7f9310102c00 2023-12-06T15:06:36.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:36 smithi190 ceph-mon[178398]: pgmap v197: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:06:36.628 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:36 smithi152 ceph-mon[192652]: pgmap v197: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:06:36.738 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.738+0000 7f931735e700 1 -- 172.21.15.152:0/3954318499 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9310071680 con 0x7f9310102c00 2023-12-06T15:06:36.739 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.738+0000 7f9305ffb700 1 -- 172.21.15.152:0/3954318499 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+721 (secure 0 0 0) 0x7f93000597f0 con 0x7f9310102c00 2023-12-06T15:06:36.741 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.740+0000 7f931735e700 1 -- 172.21.15.152:0/3954318499 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f92fc06ce60 msgr2=0x7f92fc06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:36.741 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.740+0000 7f931735e700 1 --2- 172.21.15.152:0/3954318499 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f92fc06ce60 0x7f92fc06f310 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9310071940 tx=0x7f930c009e30 comp rx=0 tx=0).stop 2023-12-06T15:06:36.741 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.740+0000 7f931735e700 1 -- 172.21.15.152:0/3954318499 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9310102c00 msgr2=0x7f931006ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:36.741 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.740+0000 7f931735e700 1 --2- 172.21.15.152:0/3954318499 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9310102c00 0x7f931006ff40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f930000b790 tx=0x7f9300009250 comp rx=0 tx=0).stop 2023-12-06T15:06:36.741 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.740+0000 7f931735e700 1 -- 172.21.15.152:0/3954318499 shutdown_connections 2023-12-06T15:06:36.741 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.740+0000 7f931735e700 1 --2- 172.21.15.152:0/3954318499 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f92fc06ce60 0x7f92fc06f310 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:36.741 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.740+0000 7f931735e700 1 --2- 172.21.15.152:0/3954318499 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9310102c00 0x7f931006ff40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:36.741 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.740+0000 7f931735e700 1 --2- 172.21.15.152:0/3954318499 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93101035a0 0x7f9310070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:36.741 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.740+0000 7f931735e700 1 -- 172.21.15.152:0/3954318499 >> 172.21.15.152:0/3954318499 conn(0x7f93100f8790 msgr2=0x7f93100fa1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:06:36.741 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.741+0000 7f931735e700 1 -- 172.21.15.152:0/3954318499 shutdown_connections 2023-12-06T15:06:36.741 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:36.741+0000 7f931735e700 1 -- 172.21.15.152:0/3954318499 wait complete. 2023-12-06T15:06:36.751 INFO:teuthology.orchestra.run.smithi152.stdout:false 2023-12-06T15:06:37.056 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-06T15:06:37.057 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_0482646fcf78576d871bc87843257d82edb79541/qa/tasks/cephadm.py", line 1351, in shell _shell(ctx, cluster_name, remote, File "/home/teuthworker/src/git.ceph.com_ceph-c_0482646fcf78576d871bc87843257d82edb79541/qa/tasks/cephadm.py", line 40, in _shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi152 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -e sha1=0482646fcf78576d871bc87843257d82edb79541 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2023-12-06T15:06:37.133 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=5f005f20f61947b5bc69f0e131474550 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_0482646fcf78576d871bc87843257d82edb79541/qa/tasks/cephadm.py", line 1351, in shell _shell(ctx, cluster_name, remote, File "/home/teuthworker/src/git.ceph.com_ceph-c_0482646fcf78576d871bc87843257d82edb79541/qa/tasks/cephadm.py", line 40, in _shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi152 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -e sha1=0482646fcf78576d871bc87843257d82edb79541 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2023-12-06T15:06:37.137 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-12-06T15:06:37.147 INFO:tasks.kclient:Unmounting kernel clients... 2023-12-06T15:06:37.148 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-06T15:06:37.148 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-06T15:06:37.177 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-12-06T15:06:37.178 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-06T15:06:37.237 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-06T15:06:37.302 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:37 smithi152 ceph-mon[192652]: from='client.? 172.21.15.152:0/3954318499' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:06:37.399 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.398+0000 7f1d75e2f700 1 -- 172.21.15.152:0/280878895 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d700fb820 msgr2=0x7f1d700fbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:37.399 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.398+0000 7f1d75e2f700 1 --2- 172.21.15.152:0/280878895 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d700fb820 0x7f1d700fbbf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1d64004940 tx=0x7f1d64009e30 comp rx=0 tx=0).stop 2023-12-06T15:06:37.399 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.398+0000 7f1d75e2f700 1 -- 172.21.15.152:0/280878895 shutdown_connections 2023-12-06T15:06:37.400 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.398+0000 7f1d75e2f700 1 --2- 172.21.15.152:0/280878895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d700fc130 0x7f1d70108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:37.400 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.398+0000 7f1d75e2f700 1 --2- 172.21.15.152:0/280878895 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d700fb820 0x7f1d700fbbf0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:37.400 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.398+0000 7f1d75e2f700 1 -- 172.21.15.152:0/280878895 >> 172.21.15.152:0/280878895 conn(0x7f1d700756d0 msgr2=0x7f1d700f99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:06:37.400 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.398+0000 7f1d75e2f700 1 -- 172.21.15.152:0/280878895 shutdown_connections 2023-12-06T15:06:37.400 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.398+0000 7f1d75e2f700 1 -- 172.21.15.152:0/280878895 wait complete. 2023-12-06T15:06:37.400 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.399+0000 7f1d75e2f700 1 Processor -- start 2023-12-06T15:06:37.400 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.399+0000 7f1d75e2f700 1 -- start start 2023-12-06T15:06:37.403 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.399+0000 7f1d75e2f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d700fb820 0x7f1d70115330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:37.403 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.399+0000 7f1d75e2f700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d700fc130 0x7f1d70115870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:37.403 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.399+0000 7f1d75e2f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d70115ec0 con 0x7f1d700fb820 2023-12-06T15:06:37.403 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.399+0000 7f1d75e2f700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7010f3e0 con 0x7f1d700fc130 2023-12-06T15:06:37.403 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.400+0000 7f1d6f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d700fb820 0x7f1d70115330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:37.403 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.400+0000 7f1d6f7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d700fb820 0x7f1d70115330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35156/0 (socket says 172.21.15.152:35156) 2023-12-06T15:06:37.403 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.400+0000 7f1d6f7fe700 1 -- 172.21.15.152:0/304142986 learned_addr learned my addr 172.21.15.152:0/304142986 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:06:37.404 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.400+0000 7f1d6effd700 1 --2- 172.21.15.152:0/304142986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d700fc130 0x7f1d70115870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:37.404 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.400+0000 7f1d6f7fe700 1 -- 172.21.15.152:0/304142986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d700fc130 msgr2=0x7f1d70115870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:37.404 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.400+0000 7f1d6f7fe700 1 --2- 172.21.15.152:0/304142986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d700fc130 0x7f1d70115870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:37.404 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.400+0000 7f1d6f7fe700 1 -- 172.21.15.152:0/304142986 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d64005040 con 0x7f1d700fb820 2023-12-06T15:06:37.404 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.400+0000 7f1d6effd700 1 --2- 172.21.15.152:0/304142986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d700fc130 0x7f1d70115870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-06T15:06:37.404 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.400+0000 7f1d6f7fe700 1 --2- 172.21.15.152:0/304142986 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d700fb820 0x7f1d70115330 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1d64009390 tx=0x7f1d64009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:06:37.404 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.400+0000 7f1d57fff700 1 -- 172.21.15.152:0/304142986 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d6400e040 con 0x7f1d700fb820 2023-12-06T15:06:37.404 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.400+0000 7f1d57fff700 1 -- 172.21.15.152:0/304142986 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1d64004290 con 0x7f1d700fb820 2023-12-06T15:06:37.404 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.400+0000 7f1d75e2f700 1 -- 172.21.15.152:0/304142986 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d7010f6c0 con 0x7f1d700fb820 2023-12-06T15:06:37.405 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.400+0000 7f1d57fff700 1 -- 172.21.15.152:0/304142986 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d6401c630 con 0x7f1d700fb820 2023-12-06T15:06:37.405 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.400+0000 7f1d75e2f700 1 -- 172.21.15.152:0/304142986 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d7010fc80 con 0x7f1d700fb820 2023-12-06T15:06:37.405 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.401+0000 7f1d75e2f700 1 -- 172.21.15.152:0/304142986 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d701065c0 con 0x7f1d700fb820 2023-12-06T15:06:37.405 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.402+0000 7f1d57fff700 1 -- 172.21.15.152:0/304142986 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f1d6401c8f0 con 0x7f1d700fb820 2023-12-06T15:06:37.405 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.402+0000 7f1d57fff700 1 --2- 172.21.15.152:0/304142986 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f1d5806ce70 0x7f1d5806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:37.405 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.402+0000 7f1d57fff700 1 -- 172.21.15.152:0/304142986 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f1d6408d760 con 0x7f1d700fb820 2023-12-06T15:06:37.405 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.402+0000 7f1d6effd700 1 --2- 172.21.15.152:0/304142986 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f1d5806ce70 0x7f1d5806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:37.405 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.402+0000 7f1d6effd700 1 --2- 172.21.15.152:0/304142986 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f1d5806ce70 0x7f1d5806f320 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1d60009fd0 tx=0x7f1d60009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:06:37.406 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.406+0000 7f1d57fff700 1 -- 172.21.15.152:0/304142986 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1d6405b190 con 0x7f1d700fb820 2023-12-06T15:06:37.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:37 smithi190 ceph-mon[178398]: from='client.? 172.21.15.152:0/3954318499' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2023-12-06T15:06:37.599 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.599+0000 7f1d75e2f700 1 -- 172.21.15.152:0/304142986 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d70064730 con 0x7f1d700fb820 2023-12-06T15:06:37.600 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.600+0000 7f1d57fff700 1 -- 172.21.15.152:0/304142986 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+16970 (secure 0 0 0) 0x7f1d6405ad20 con 0x7f1d700fb820 2023-12-06T15:06:37.601 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T15:06:37.601 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":89,"fsid":"062f0e3c-9447-11ee-95a2-87774f69a715","created":"2023-12-06T14:53:01.413534+0000","modified":"2023-12-06T15:05:03.509118+0000","last_up_change":"2023-12-06T15:05:02.507144+0000","last_in_change":"2023-12-06T14:56:53.456498+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-06T14:56:15.276535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-06T14:57:57.673767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-06T14:57:58.572251+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72a62158-6e7d-42af-8212-f6ae2b8df6e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":48,"up_from":58,"up_thru":88,"down_at":49,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":2356689289},{"type":"v1","addr":"172.21.15.152:6803","nonce":2356689289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":2356689289},{"type":"v1","addr":"172.21.15.152:6805","nonce":2356689289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":2356689289},{"type":"v1","addr":"172.21.15.152:6809","nonce":2356689289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":2356689289},{"type":"v1","addr":"172.21.15.152:6807","nonce":2356689289}]},"public_addr":"172.21.15.152:6803/2356689289","cluster_addr":"172.21.15.152:6805/2356689289","heartbeat_back_addr":"172.21.15.152:6809/2356689289","heartbeat_front_addr":"172.21.15.152:6807/2356689289","state":["exists","up"]},{"osd":1,"uuid":"50dee56b-c95b-4361-ad0d-4f71198f9105","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":64,"up_from":68,"up_thru":88,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3248615058},{"type":"v1","addr":"172.21.15.152:6811","nonce":3248615058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3248615058},{"type":"v1","addr":"172.21.15.152:6813","nonce":3248615058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3248615058},{"type":"v1","addr":"172.21.15.152:6817","nonce":3248615058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3248615058},{"type":"v1","addr":"172.21.15.152:6815","nonce":3248615058}]},"public_addr":"172.21.15.152:6811/3248615058","cluster_addr":"172.21.15.152:6813/3248615058","heartbeat_back_addr":"172.21.15.152:6817/3248615058","heartbeat_front_addr":"172.21.15.152:6815/3248615058","state":["exists","up"]},{"osd":2,"uuid":"8dce6383-8296-4737-99d9-427bbd62f9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":69,"up_from":73,"up_thru":88,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1164280420},{"type":"v1","addr":"172.21.15.152:6819","nonce":1164280420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1164280420},{"type":"v1","addr":"172.21.15.152:6821","nonce":1164280420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":1164280420},{"type":"v1","addr":"172.21.15.152:6825","nonce":1164280420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1164280420},{"type":"v1","addr":"172.21.15.152:6823","nonce":1164280420}]},"public_addr":"172.21.15.152:6819/1164280420","cluster_addr":"172.21.15.152:6821/1164280420","heartbeat_back_addr":"172.21.15.152:6825/1164280420","heartbeat_front_addr":"172.21.15.152:6823/1164280420","state":["exists","up"]},{"osd":3,"uuid":"ea52387d-fb71-4ed5-bde5-85550b5cc117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":25,"last_clean_end":74,"up_from":78,"up_thru":88,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1202145658},{"type":"v1","addr":"172.21.15.190:6801","nonce":1202145658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1202145658},{"type":"v1","addr":"172.21.15.190:6803","nonce":1202145658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1202145658},{"type":"v1","addr":"172.21.15.190:6807","nonce":1202145658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1202145658},{"type":"v1","addr":"172.21.15.190:6805","nonce":1202145658}]},"public_addr":"172.21.15.190:6801/1202145658","cluster_addr":"172.21.15.190:6803/1202145658","heartbeat_back_addr":"172.21.15.190:6807/1202145658","heartbeat_front_addr":"172.21.15.190:6805/1202145658","state":["exists","up"]},{"osd":4,"uuid":"23efef41-308e-467c-9f90-ae159a8d43a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":32,"last_clean_end":79,"up_from":83,"up_thru":88,"down_at":80,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3285745876},{"type":"v1","addr":"172.21.15.190:6809","nonce":3285745876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3285745876},{"type":"v1","addr":"172.21.15.190:6811","nonce":3285745876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3285745876},{"type":"v1","addr":"172.21.15.190:6815","nonce":3285745876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3285745876},{"type":"v1","addr":"172.21.15.190:6813","nonce":3285745876}]},"public_addr":"172.21.15.190:6809/3285745876","cluster_addr":"172.21.15.190:6811/3285745876","heartbeat_back_addr":"172.21.15.190:6815/3285745876","heartbeat_front_addr":"172.21.15.190:6813/3285745876","state":["exists","up"]},{"osd":5,"uuid":"fe0aeff2-a9e0-4cb5-9cd9-fd0e3db4807f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":37,"last_clean_end":84,"up_from":88,"up_thru":88,"down_at":85,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":3404864287},{"type":"v1","addr":"172.21.15.190:6817","nonce":3404864287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":3404864287},{"type":"v1","addr":"172.21.15.190:6819","nonce":3404864287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":3404864287},{"type":"v1","addr":"172.21.15.190:6823","nonce":3404864287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":3404864287},{"type":"v1","addr":"172.21.15.190:6821","nonce":3404864287}]},"public_addr":"172.21.15.190:6817/3404864287","cluster_addr":"172.21.15.190:6819/3404864287","heartbeat_back_addr":"172.21.15.190:6823/3404864287","heartbeat_front_addr":"172.21.15.190:6821/3404864287","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T14:55:32.948973+0000","dead_epoch":48},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T14:55:53.358269+0000","dead_epoch":64},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T14:56:12.783635+0000","dead_epoch":69},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T14:56:30.517271+0000","dead_epoch":74},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T14:56:49.401042+0000","dead_epoch":79},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T14:57:08.146152+0000","dead_epoch":84}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":3,"to":2}]},{"pgid":"2.e","mappings":[{"from":3,"to":5}]},{"pgid":"2.1d","mappings":[{"from":3,"to":2}]},{"pgid":"3.3","mappings":[{"from":4,"to":5}]},{"pgid":"3.4","mappings":[{"from":1,"to":0}]},{"pgid":"3.6","mappings":[{"from":1,"to":2}]},{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.e","mappings":[{"from":4,"to":0}]},{"pgid":"3.14","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.152:0/3550921367":"2023-12-07T14:59:40.851866+0000","172.21.15.152:0/145030765":"2023-12-07T14:53:50.748958+0000","172.21.15.190:6829/3047155534":"2023-12-07T15:00:50.131153+0000","172.21.15.152:6801/2466555973":"2023-12-07T14:53:50.748958+0000","172.21.15.152:0/1389268383":"2023-12-07T14:59:40.851866+0000","172.21.15.152:0/4186839809":"2023-12-07T14:53:24.414825+0000","172.21.15.152:0/2581585771":"2023-12-07T14:53:50.748958+0000","172.21.15.190:6828/3047155534":"2023-12-07T15:00:50.131153+0000","172.21.15.190:0/781150211":"2023-12-07T15:00:50.131153+0000","172.21.15.152:6801/4105588516":"2023-12-07T15:01:30.573634+0000","172.21.15.152:0/2095526930":"2023-12-07T14:54:40.970995+0000","172.21.15.190:0/3203466810":"2023-12-07T15:00:50.131153+0000","172.21.15.152:6800/2466555973":"2023-12-07T14:53:50.748958+0000","172.21.15.190:0/1733155328":"2023-12-07T15:00:50.131153+0000","172.21.15.152:0/251625153":"2023-12-07T14:54:40.970995+0000","172.21.15.152:0/959508847":"2023-12-07T14:54:40.970995+0000","172.21.15.152:6801/3517650686":"2023-12-07T14:54:40.970995+0000","172.21.15.152:0/1805885486":"2023-12-07T15:01:30.573634+0000","172.21.15.152:0/498144396":"2023-12-07T15:01:30.573634+0000","172.21.15.190:0/609524120":"2023-12-07T15:00:50.131153+0000","172.21.15.152:0/2756816012":"2023-12-07T14:59:40.851866+0000","172.21.15.152:0/2571521952":"2023-12-07T14:53:50.748958+0000","172.21.15.152:6800/3317409709":"2023-12-07T14:59:40.851866+0000","172.21.15.152:6801/1793082857":"2023-12-07T14:53:24.414825+0000","172.21.15.190:0/1446993889":"2023-12-07T15:00:50.131153+0000","172.21.15.152:6800/1793082857":"2023-12-07T14:53:24.414825+0000","172.21.15.152:0/2442962105":"2023-12-07T15:01:30.573634+0000","172.21.15.152:0/3538958834":"2023-12-07T14:53:24.414825+0000","172.21.15.190:0/2097810823":"2023-12-07T15:00:50.131153+0000","172.21.15.152:6800/3517650686":"2023-12-07T14:54:40.970995+0000","172.21.15.152:0/561475554":"2023-12-07T14:59:40.851866+0000","172.21.15.152:0/2210289933":"2023-12-07T15:01:30.573634+0000","172.21.15.152:0/235446797":"2023-12-07T15:01:30.573634+0000","172.21.15.152:0/2125669406":"2023-12-07T15:01:30.573634+0000","172.21.15.152:0/181182783":"2023-12-07T14:53:24.414825+0000","172.21.15.152:6801/3317409709":"2023-12-07T14:59:40.851866+0000","172.21.15.152:6800/4105588516":"2023-12-07T15:01:30.573634+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-06T15:06:37.603 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.602+0000 7f1d75e2f700 1 -- 172.21.15.152:0/304142986 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f1d5806ce70 msgr2=0x7f1d5806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:37.603 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.602+0000 7f1d75e2f700 1 --2- 172.21.15.152:0/304142986 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f1d5806ce70 0x7f1d5806f320 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1d60009fd0 tx=0x7f1d60009ee0 comp rx=0 tx=0).stop 2023-12-06T15:06:37.603 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.602+0000 7f1d75e2f700 1 -- 172.21.15.152:0/304142986 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d700fb820 msgr2=0x7f1d70115330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:37.603 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.603+0000 7f1d75e2f700 1 --2- 172.21.15.152:0/304142986 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d700fb820 0x7f1d70115330 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1d64009390 tx=0x7f1d64009e30 comp rx=0 tx=0).stop 2023-12-06T15:06:37.603 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.603+0000 7f1d75e2f700 1 -- 172.21.15.152:0/304142986 shutdown_connections 2023-12-06T15:06:37.603 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.603+0000 7f1d75e2f700 1 --2- 172.21.15.152:0/304142986 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f1d5806ce70 0x7f1d5806f320 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:37.604 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.603+0000 7f1d75e2f700 1 --2- 172.21.15.152:0/304142986 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d700fb820 0x7f1d70115330 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:37.604 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.603+0000 7f1d75e2f700 1 --2- 172.21.15.152:0/304142986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d700fc130 0x7f1d70115870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:37.604 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.603+0000 7f1d75e2f700 1 -- 172.21.15.152:0/304142986 >> 172.21.15.152:0/304142986 conn(0x7f1d700756d0 msgr2=0x7f1d700724f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:06:37.604 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.603+0000 7f1d75e2f700 1 -- 172.21.15.152:0/304142986 shutdown_connections 2023-12-06T15:06:37.604 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.603+0000 7f1d75e2f700 1 -- 172.21.15.152:0/304142986 wait complete. 2023-12-06T15:06:37.618 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-06T14:56:15.276535+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-06T14:57:57.673767+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-06T14:57:58.572251+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-06T15:06:37.618 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-06T15:06:37.781 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.777+0000 7f93dcd6f700 1 -- 172.21.15.152:0/2835754086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93d81023d0 msgr2=0x7f93d80fba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:37.781 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.777+0000 7f93dcd6f700 1 --2- 172.21.15.152:0/2835754086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93d81023d0 0x7f93d80fba60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f93c8004940 tx=0x7f93c8009e30 comp rx=0 tx=0).stop 2023-12-06T15:06:37.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.777+0000 7f93dcd6f700 1 -- 172.21.15.152:0/2835754086 shutdown_connections 2023-12-06T15:06:37.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.777+0000 7f93dcd6f700 1 --2- 172.21.15.152:0/2835754086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93d81023d0 0x7f93d80fba60 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:37.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.777+0000 7f93dcd6f700 1 --2- 172.21.15.152:0/2835754086 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93d8101ac0 0x7f93d8101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:37.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.777+0000 7f93dcd6f700 1 -- 172.21.15.152:0/2835754086 >> 172.21.15.152:0/2835754086 conn(0x7f93d8071970 msgr2=0x7f93d8071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:06:37.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.777+0000 7f93dcd6f700 1 -- 172.21.15.152:0/2835754086 shutdown_connections 2023-12-06T15:06:37.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.777+0000 7f93dcd6f700 1 -- 172.21.15.152:0/2835754086 wait complete. 2023-12-06T15:06:37.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.778+0000 7f93dcd6f700 1 Processor -- start 2023-12-06T15:06:37.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.778+0000 7f93dcd6f700 1 -- start start 2023-12-06T15:06:37.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.778+0000 7f93dcd6f700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93d8101ac0 0x7f93d8112260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:37.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.778+0000 7f93dcd6f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93d81023d0 0x7f93d81127a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:37.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.778+0000 7f93dcd6f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d8112e80 con 0x7f93d81023d0 2023-12-06T15:06:37.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.778+0000 7f93dcd6f700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d810c310 con 0x7f93d8101ac0 2023-12-06T15:06:37.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.778+0000 7f93d5d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93d81023d0 0x7f93d81127a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:37.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.778+0000 7f93d5d9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93d81023d0 0x7f93d81127a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35182/0 (socket says 172.21.15.152:35182) 2023-12-06T15:06:37.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.778+0000 7f93d5d9b700 1 -- 172.21.15.152:0/3234654597 learned_addr learned my addr 172.21.15.152:0/3234654597 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:06:37.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.778+0000 7f93d659c700 1 --2- 172.21.15.152:0/3234654597 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93d8101ac0 0x7f93d8112260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:37.785 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.778+0000 7f93d5d9b700 1 -- 172.21.15.152:0/3234654597 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93d8101ac0 msgr2=0x7f93d8112260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:37.785 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.778+0000 7f93d5d9b700 1 --2- 172.21.15.152:0/3234654597 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93d8101ac0 0x7f93d8112260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:37.785 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.778+0000 7f93d5d9b700 1 -- 172.21.15.152:0/3234654597 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c8005040 con 0x7f93d81023d0 2023-12-06T15:06:37.785 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.779+0000 7f93d5d9b700 1 --2- 172.21.15.152:0/3234654597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93d81023d0 0x7f93d81127a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f93c8009380 tx=0x7f93c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:06:37.785 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.779+0000 7f93ceffd700 1 -- 172.21.15.152:0/3234654597 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93c800e040 con 0x7f93d81023d0 2023-12-06T15:06:37.785 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.779+0000 7f93dcd6f700 1 -- 172.21.15.152:0/3234654597 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d810c530 con 0x7f93d81023d0 2023-12-06T15:06:37.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.779+0000 7f93ceffd700 1 -- 172.21.15.152:0/3234654597 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f93c8013420 con 0x7f93d81023d0 2023-12-06T15:06:37.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.779+0000 7f93ceffd700 1 -- 172.21.15.152:0/3234654597 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93c801c630 con 0x7f93d81023d0 2023-12-06T15:06:37.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.779+0000 7f93dcd6f700 1 -- 172.21.15.152:0/3234654597 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d810caf0 con 0x7f93d81023d0 2023-12-06T15:06:37.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.780+0000 7f93dcd6f700 1 -- 172.21.15.152:0/3234654597 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d8064730 con 0x7f93d81023d0 2023-12-06T15:06:37.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.780+0000 7f93ceffd700 1 -- 172.21.15.152:0/3234654597 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f93c8013590 con 0x7f93d81023d0 2023-12-06T15:06:37.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.780+0000 7f93ceffd700 1 --2- 172.21.15.152:0/3234654597 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f93c406ce60 0x7f93c406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:37.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.781+0000 7f93d659c700 1 --2- 172.21.15.152:0/3234654597 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f93c406ce60 0x7f93c406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:37.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.781+0000 7f93ceffd700 1 -- 172.21.15.152:0/3234654597 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f93c808d730 con 0x7f93d81023d0 2023-12-06T15:06:37.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.781+0000 7f93d659c700 1 --2- 172.21.15.152:0/3234654597 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f93c406ce60 0x7f93c406f310 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f93c0009bf0 tx=0x7f93c00091a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:06:37.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.785+0000 7f93ceffd700 1 -- 172.21.15.152:0/3234654597 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f93c805b020 con 0x7f93d81023d0 2023-12-06T15:06:37.973 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.973+0000 7f93dcd6f700 1 -- 172.21.15.152:0/3234654597 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f93d810cd10 con 0x7f93d81023d0 2023-12-06T15:06:37.974 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.973+0000 7f93ceffd700 1 -- 172.21.15.152:0/3234654597 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7f93c8055e60 con 0x7f93d81023d0 2023-12-06T15:06:37.974 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2023-12-06T15:06:37.976 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.975+0000 7f93dcd6f700 1 -- 172.21.15.152:0/3234654597 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f93c406ce60 msgr2=0x7f93c406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:37.976 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.975+0000 7f93dcd6f700 1 --2- 172.21.15.152:0/3234654597 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f93c406ce60 0x7f93c406f310 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f93c0009bf0 tx=0x7f93c00091a0 comp rx=0 tx=0).stop 2023-12-06T15:06:37.977 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.975+0000 7f93dcd6f700 1 -- 172.21.15.152:0/3234654597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93d81023d0 msgr2=0x7f93d81127a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:37.977 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.975+0000 7f93dcd6f700 1 --2- 172.21.15.152:0/3234654597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93d81023d0 0x7f93d81127a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f93c8009380 tx=0x7f93c8009e30 comp rx=0 tx=0).stop 2023-12-06T15:06:37.977 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.976+0000 7f93dcd6f700 1 -- 172.21.15.152:0/3234654597 shutdown_connections 2023-12-06T15:06:37.977 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.976+0000 7f93dcd6f700 1 --2- 172.21.15.152:0/3234654597 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f93c406ce60 0x7f93c406f310 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:37.978 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.976+0000 7f93dcd6f700 1 --2- 172.21.15.152:0/3234654597 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f93d8101ac0 0x7f93d8112260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:37.978 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.976+0000 7f93dcd6f700 1 --2- 172.21.15.152:0/3234654597 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93d81023d0 0x7f93d81127a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:37.978 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.976+0000 7f93dcd6f700 1 -- 172.21.15.152:0/3234654597 >> 172.21.15.152:0/3234654597 conn(0x7f93d8071970 msgr2=0x7f93d80fade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:06:37.978 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.976+0000 7f93dcd6f700 1 -- 172.21.15.152:0/3234654597 shutdown_connections 2023-12-06T15:06:37.979 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:37.976+0000 7f93dcd6f700 1 -- 172.21.15.152:0/3234654597 wait complete. 2023-12-06T15:06:37.988 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-06T15:06:38.110 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.110+0000 7fe8916cf700 1 -- 172.21.15.152:0/3866440995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe88c0fba50 msgr2=0x7fe88c0fbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:38.110 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.110+0000 7fe8916cf700 1 --2- 172.21.15.152:0/3866440995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe88c0fba50 0x7fe88c0fbec0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe880004940 tx=0x7fe880009e30 comp rx=0 tx=0).stop 2023-12-06T15:06:38.110 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.110+0000 7fe8916cf700 1 -- 172.21.15.152:0/3866440995 shutdown_connections 2023-12-06T15:06:38.111 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.110+0000 7fe8916cf700 1 --2- 172.21.15.152:0/3866440995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe88c0fba50 0x7fe88c0fbec0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:38.111 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.110+0000 7fe8916cf700 1 --2- 172.21.15.152:0/3866440995 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe88c101a90 0x7fe88c101e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:38.111 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.110+0000 7fe8916cf700 1 -- 172.21.15.152:0/3866440995 >> 172.21.15.152:0/3866440995 conn(0x7fe88c0f75b0 msgr2=0x7fe88c0f99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:06:38.111 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.110+0000 7fe8916cf700 1 -- 172.21.15.152:0/3866440995 shutdown_connections 2023-12-06T15:06:38.111 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.110+0000 7fe8916cf700 1 -- 172.21.15.152:0/3866440995 wait complete. 2023-12-06T15:06:38.113 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.110+0000 7fe8916cf700 1 Processor -- start 2023-12-06T15:06:38.114 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.110+0000 7fe8916cf700 1 -- start start 2023-12-06T15:06:38.114 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.111+0000 7fe8916cf700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe88c0fba50 0x7fe88c10e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:38.115 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.111+0000 7fe8916cf700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe88c101a90 0x7fe88c10e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:38.115 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.111+0000 7fe8916cf700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c10ee30 con 0x7fe88c0fba50 2023-12-06T15:06:38.115 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.111+0000 7fe8916cf700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c10ef70 con 0x7fe88c101a90 2023-12-06T15:06:38.115 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.111+0000 7fe88affd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe88c0fba50 0x7fe88c10e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:38.115 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.111+0000 7fe88affd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe88c0fba50 0x7fe88c10e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35204/0 (socket says 172.21.15.152:35204) 2023-12-06T15:06:38.116 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.111+0000 7fe88affd700 1 -- 172.21.15.152:0/1423500723 learned_addr learned my addr 172.21.15.152:0/1423500723 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:06:38.116 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.111+0000 7fe88a7fc700 1 --2- 172.21.15.152:0/1423500723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe88c101a90 0x7fe88c10e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:38.116 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.111+0000 7fe88affd700 1 -- 172.21.15.152:0/1423500723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe88c101a90 msgr2=0x7fe88c10e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:38.116 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.111+0000 7fe88affd700 1 --2- 172.21.15.152:0/1423500723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe88c101a90 0x7fe88c10e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:38.116 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.111+0000 7fe88affd700 1 -- 172.21.15.152:0/1423500723 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe880005040 con 0x7fe88c0fba50 2023-12-06T15:06:38.116 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.111+0000 7fe88a7fc700 1 --2- 172.21.15.152:0/1423500723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe88c101a90 0x7fe88c10e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-06T15:06:38.116 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.111+0000 7fe88affd700 1 --2- 172.21.15.152:0/1423500723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe88c0fba50 0x7fe88c10e3b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00eb40 tx=0x7fe87c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:06:38.116 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.111+0000 7fe8737fe700 1 -- 172.21.15.152:0/1423500723 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe87c007cc0 con 0x7fe88c0fba50 2023-12-06T15:06:38.116 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.111+0000 7fe8737fe700 1 -- 172.21.15.152:0/1423500723 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe87c00f040 con 0x7fe88c0fba50 2023-12-06T15:06:38.117 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.111+0000 7fe8737fe700 1 -- 172.21.15.152:0/1423500723 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe87c009570 con 0x7fe88c0fba50 2023-12-06T15:06:38.117 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.111+0000 7fe8916cf700 1 -- 172.21.15.152:0/1423500723 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe88c10f1f0 con 0x7fe88c0fba50 2023-12-06T15:06:38.117 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.111+0000 7fe8916cf700 1 -- 172.21.15.152:0/1423500723 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe88c1177a0 con 0x7fe88c0fba50 2023-12-06T15:06:38.117 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.112+0000 7fe8916cf700 1 -- 172.21.15.152:0/1423500723 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe88c064b80 con 0x7fe88c0fba50 2023-12-06T15:06:38.117 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.113+0000 7fe8737fe700 1 -- 172.21.15.152:0/1423500723 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fe87c0096d0 con 0x7fe88c0fba50 2023-12-06T15:06:38.117 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.113+0000 7fe8737fe700 1 --2- 172.21.15.152:0/1423500723 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fe87406ce60 0x7fe87406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:38.117 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.113+0000 7fe8737fe700 1 -- 172.21.15.152:0/1423500723 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6675+0+0 (secure 0 0 0) 0x7fe87c08bfb0 con 0x7fe88c0fba50 2023-12-06T15:06:38.117 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.113+0000 7fe88a7fc700 1 --2- 172.21.15.152:0/1423500723 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fe87406ce60 0x7fe87406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:38.117 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.113+0000 7fe88a7fc700 1 --2- 172.21.15.152:0/1423500723 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fe87406ce60 0x7fe87406f310 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe88000b0d0 tx=0x7fe880009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:06:38.118 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.118+0000 7fe8737fe700 1 -- 172.21.15.152:0/1423500723 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe87c055eb0 con 0x7fe88c0fba50 2023-12-06T15:06:38.310 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.309+0000 7fe8916cf700 1 -- 172.21.15.152:0/1423500723 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fe88c108a10 con 0x7fe88c0fba50 2023-12-06T15:06:38.310 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.310+0000 7fe8737fe700 1 -- 172.21.15.152:0/1423500723 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v89) v1 ==== 107+0+11 (secure 0 0 0) 0x7fe87c0594d0 con 0x7fe88c0fba50 2023-12-06T15:06:38.310 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2023-12-06T15:06:38.312 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.312+0000 7fe8916cf700 1 -- 172.21.15.152:0/1423500723 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fe87406ce60 msgr2=0x7fe87406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:38.312 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.312+0000 7fe8916cf700 1 --2- 172.21.15.152:0/1423500723 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fe87406ce60 0x7fe87406f310 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe88000b0d0 tx=0x7fe880009e30 comp rx=0 tx=0).stop 2023-12-06T15:06:38.312 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.312+0000 7fe8916cf700 1 -- 172.21.15.152:0/1423500723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe88c0fba50 msgr2=0x7fe88c10e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:38.312 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.312+0000 7fe8916cf700 1 --2- 172.21.15.152:0/1423500723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe88c0fba50 0x7fe88c10e3b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00eb40 tx=0x7fe87c00b040 comp rx=0 tx=0).stop 2023-12-06T15:06:38.313 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.312+0000 7fe8916cf700 1 -- 172.21.15.152:0/1423500723 shutdown_connections 2023-12-06T15:06:38.313 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.312+0000 7fe8916cf700 1 --2- 172.21.15.152:0/1423500723 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fe87406ce60 0x7fe87406f310 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:38.313 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.312+0000 7fe8916cf700 1 --2- 172.21.15.152:0/1423500723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe88c0fba50 0x7fe88c10e3b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:38.313 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.312+0000 7fe8916cf700 1 --2- 172.21.15.152:0/1423500723 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe88c101a90 0x7fe88c10e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:38.313 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.312+0000 7fe8916cf700 1 -- 172.21.15.152:0/1423500723 >> 172.21.15.152:0/1423500723 conn(0x7fe88c0f75b0 msgr2=0x7fe88c0f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:06:38.313 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.312+0000 7fe8916cf700 1 -- 172.21.15.152:0/1423500723 shutdown_connections 2023-12-06T15:06:38.313 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.312+0000 7fe8916cf700 1 -- 172.21.15.152:0/1423500723 wait complete. 2023-12-06T15:06:38.323 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:38 smithi152 ceph-mon[192652]: pgmap v198: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:06:38.323 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:38 smithi152 ceph-mon[192652]: from='client.? 172.21.15.152:0/304142986' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-06T15:06:38.324 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:38 smithi152 ceph-mon[192652]: from='client.? 172.21.15.152:0/3234654597' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-06T15:06:38.324 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-06T15:06:38.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.445+0000 7fe7baa63700 1 -- 172.21.15.152:0/3701374854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7b4103480 msgr2=0x7fe7b40fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:38.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.445+0000 7fe7baa63700 1 --2- 172.21.15.152:0/3701374854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7b4103480 0x7fe7b40fb0f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8004940 tx=0x7fe7a8009e30 comp rx=0 tx=0).stop 2023-12-06T15:06:38.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.445+0000 7fe7baa63700 1 -- 172.21.15.152:0/3701374854 shutdown_connections 2023-12-06T15:06:38.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.445+0000 7fe7baa63700 1 --2- 172.21.15.152:0/3701374854 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7b4103480 0x7fe7b40fb0f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:38.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.445+0000 7fe7baa63700 1 --2- 172.21.15.152:0/3701374854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7b4102ae0 0x7fe7b4102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:38.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.445+0000 7fe7baa63700 1 -- 172.21.15.152:0/3701374854 >> 172.21.15.152:0/3701374854 conn(0x7fe7b40710d0 msgr2=0x7fe7b40714d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:06:38.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.445+0000 7fe7baa63700 1 -- 172.21.15.152:0/3701374854 shutdown_connections 2023-12-06T15:06:38.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.445+0000 7fe7baa63700 1 -- 172.21.15.152:0/3701374854 wait complete. 2023-12-06T15:06:38.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.446+0000 7fe7baa63700 1 Processor -- start 2023-12-06T15:06:38.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.446+0000 7fe7baa63700 1 -- start start 2023-12-06T15:06:38.449 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.446+0000 7fe7baa63700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7b4102ae0 0x7fe7b4113380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:38.449 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.446+0000 7fe7baa63700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7b4103480 0x7fe7b41138c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:38.449 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.446+0000 7fe7baa63700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b4113f10 con 0x7fe7b4102ae0 2023-12-06T15:06:38.449 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.446+0000 7fe7baa63700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b410d430 con 0x7fe7b4103480 2023-12-06T15:06:38.449 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.446+0000 7fe7b3fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7b4102ae0 0x7fe7b4113380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:38.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.446+0000 7fe7b3fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7b4102ae0 0x7fe7b4113380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35224/0 (socket says 172.21.15.152:35224) 2023-12-06T15:06:38.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.446+0000 7fe7b3fff700 1 -- 172.21.15.152:0/1853451315 learned_addr learned my addr 172.21.15.152:0/1853451315 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:06:38.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.447+0000 7fe7b37fe700 1 --2- 172.21.15.152:0/1853451315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7b4103480 0x7fe7b41138c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:38.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.447+0000 7fe7b3fff700 1 -- 172.21.15.152:0/1853451315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7b4103480 msgr2=0x7fe7b41138c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:38.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.447+0000 7fe7b3fff700 1 --2- 172.21.15.152:0/1853451315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7b4103480 0x7fe7b41138c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:38.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.447+0000 7fe7b3fff700 1 -- 172.21.15.152:0/1853451315 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a8005040 con 0x7fe7b4102ae0 2023-12-06T15:06:38.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.447+0000 7fe7b3fff700 1 --2- 172.21.15.152:0/1853451315 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7b4102ae0 0x7fe7b4113380 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe7a400c8c0 tx=0x7fe7a40044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:06:38.450 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.447+0000 7fe7b0ff9700 1 -- 172.21.15.152:0/1853451315 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7a400a760 con 0x7fe7b4102ae0 2023-12-06T15:06:38.451 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.447+0000 7fe7b0ff9700 1 -- 172.21.15.152:0/1853451315 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe7a400ad70 con 0x7fe7b4102ae0 2023-12-06T15:06:38.451 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.447+0000 7fe7baa63700 1 -- 172.21.15.152:0/1853451315 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b410d710 con 0x7fe7b4102ae0 2023-12-06T15:06:38.451 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.447+0000 7fe7b0ff9700 1 -- 172.21.15.152:0/1853451315 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7a40113a0 con 0x7fe7b4102ae0 2023-12-06T15:06:38.451 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.447+0000 7fe7baa63700 1 -- 172.21.15.152:0/1853451315 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b410dc50 con 0x7fe7b4102ae0 2023-12-06T15:06:38.451 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.448+0000 7fe7baa63700 1 -- 172.21.15.152:0/1853451315 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7b40ffe20 con 0x7fe7b4102ae0 2023-12-06T15:06:38.451 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.449+0000 7fe7b0ff9700 1 -- 172.21.15.152:0/1853451315 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fe7a4012400 con 0x7fe7b4102ae0 2023-12-06T15:06:38.451 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.449+0000 7fe7b0ff9700 1 --2- 172.21.15.152:0/1853451315 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fe79c06ce70 0x7fe79c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:38.451 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.449+0000 7fe7b0ff9700 1 -- 172.21.15.152:0/1853451315 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6675+0+0 (secure 0 0 0) 0x7fe7a408c310 con 0x7fe7b4102ae0 2023-12-06T15:06:38.451 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.449+0000 7fe7b37fe700 1 --2- 172.21.15.152:0/1853451315 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fe79c06ce70 0x7fe79c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:38.452 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.450+0000 7fe7b37fe700 1 --2- 172.21.15.152:0/1853451315 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fe79c06ce70 0x7fe79c06f320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe7b410ec20 tx=0x7fe7a8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:06:38.453 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.454+0000 7fe7b0ff9700 1 -- 172.21.15.152:0/1853451315 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe7a4059c90 con 0x7fe7b4102ae0 2023-12-06T15:06:38.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:38 smithi190 ceph-mon[178398]: pgmap v198: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2023-12-06T15:06:38.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:38 smithi190 ceph-mon[178398]: from='client.? 172.21.15.152:0/304142986' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-06T15:06:38.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:38 smithi190 ceph-mon[178398]: from='client.? 172.21.15.152:0/3234654597' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-06T15:06:38.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.643+0000 7fe7baa63700 1 -- 172.21.15.152:0/1853451315 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fe7b4063ea0 con 0x7fe7b4102ae0 2023-12-06T15:06:38.643 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.643+0000 7fe7b0ff9700 1 -- 172.21.15.152:0/1853451315 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v89) v1 ==== 107+0+11 (secure 0 0 0) 0x7fe7a4059820 con 0x7fe7b4102ae0 2023-12-06T15:06:38.643 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2023-12-06T15:06:38.646 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.645+0000 7fe7baa63700 1 -- 172.21.15.152:0/1853451315 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fe79c06ce70 msgr2=0x7fe79c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:38.646 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.645+0000 7fe7baa63700 1 --2- 172.21.15.152:0/1853451315 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fe79c06ce70 0x7fe79c06f320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe7b410ec20 tx=0x7fe7a8009e30 comp rx=0 tx=0).stop 2023-12-06T15:06:38.646 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.645+0000 7fe7baa63700 1 -- 172.21.15.152:0/1853451315 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7b4102ae0 msgr2=0x7fe7b4113380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:38.646 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.645+0000 7fe7baa63700 1 --2- 172.21.15.152:0/1853451315 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7b4102ae0 0x7fe7b4113380 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe7a400c8c0 tx=0x7fe7a40044c0 comp rx=0 tx=0).stop 2023-12-06T15:06:38.646 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.645+0000 7fe7baa63700 1 -- 172.21.15.152:0/1853451315 shutdown_connections 2023-12-06T15:06:38.646 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.645+0000 7fe7baa63700 1 --2- 172.21.15.152:0/1853451315 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fe79c06ce70 0x7fe79c06f320 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:38.646 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.645+0000 7fe7baa63700 1 --2- 172.21.15.152:0/1853451315 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe7b4102ae0 0x7fe7b4113380 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:38.646 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.645+0000 7fe7baa63700 1 --2- 172.21.15.152:0/1853451315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe7b4103480 0x7fe7b41138c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:38.647 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.645+0000 7fe7baa63700 1 -- 172.21.15.152:0/1853451315 >> 172.21.15.152:0/1853451315 conn(0x7fe7b40710d0 msgr2=0x7fe7b40fa7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:06:38.647 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.646+0000 7fe7baa63700 1 -- 172.21.15.152:0/1853451315 shutdown_connections 2023-12-06T15:06:38.647 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.646+0000 7fe7baa63700 1 -- 172.21.15.152:0/1853451315 wait complete. 2023-12-06T15:06:38.658 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-06T15:06:38.777 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.777+0000 7f5d5d778700 1 -- 172.21.15.152:0/44558895 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d58101200 msgr2=0x7f5d581015d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:38.778 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.777+0000 7f5d5d778700 1 --2- 172.21.15.152:0/44558895 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d58101200 0x7f5d581015d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c004940 tx=0x7f5d4c009e30 comp rx=0 tx=0).stop 2023-12-06T15:06:38.778 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.777+0000 7f5d5d778700 1 -- 172.21.15.152:0/44558895 shutdown_connections 2023-12-06T15:06:38.778 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.777+0000 7f5d5d778700 1 --2- 172.21.15.152:0/44558895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5d58101ba0 0x7f5d580fb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:38.778 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.777+0000 7f5d5d778700 1 --2- 172.21.15.152:0/44558895 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d58101200 0x7f5d581015d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:38.778 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.777+0000 7f5d5d778700 1 -- 172.21.15.152:0/44558895 >> 172.21.15.152:0/44558895 conn(0x7f5d580710d0 msgr2=0x7f5d580714d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:06:38.778 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.777+0000 7f5d5d778700 1 -- 172.21.15.152:0/44558895 shutdown_connections 2023-12-06T15:06:38.778 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.777+0000 7f5d5d778700 1 -- 172.21.15.152:0/44558895 wait complete. 2023-12-06T15:06:38.781 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.778+0000 7f5d5d778700 1 Processor -- start 2023-12-06T15:06:38.781 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.778+0000 7f5d5d778700 1 -- start start 2023-12-06T15:06:38.781 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.778+0000 7f5d5d778700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d58101200 0x7f5d581133b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:38.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.778+0000 7f5d5d778700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5d58101ba0 0x7f5d581138f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:38.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.778+0000 7f5d5d778700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d58113fd0 con 0x7f5d58101200 2023-12-06T15:06:38.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.778+0000 7f5d5d778700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5810d460 con 0x7f5d58101ba0 2023-12-06T15:06:38.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.778+0000 7f5d56ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d58101200 0x7f5d581133b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:38.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.778+0000 7f5d56ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d58101200 0x7f5d581133b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:35240/0 (socket says 172.21.15.152:35240) 2023-12-06T15:06:38.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.778+0000 7f5d56ffd700 1 -- 172.21.15.152:0/4131527482 learned_addr learned my addr 172.21.15.152:0/4131527482 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:06:38.783 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.778+0000 7f5d567fc700 1 --2- 172.21.15.152:0/4131527482 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5d58101ba0 0x7f5d581138f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:38.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.778+0000 7f5d56ffd700 1 -- 172.21.15.152:0/4131527482 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5d58101ba0 msgr2=0x7f5d581138f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:38.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.778+0000 7f5d56ffd700 1 --2- 172.21.15.152:0/4131527482 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5d58101ba0 0x7f5d581138f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:38.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.778+0000 7f5d56ffd700 1 -- 172.21.15.152:0/4131527482 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4c005040 con 0x7f5d58101200 2023-12-06T15:06:38.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.778+0000 7f5d56ffd700 1 --2- 172.21.15.152:0/4131527482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d58101200 0x7f5d581133b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c009180 tx=0x7f5d4c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:06:38.784 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.778+0000 7f5d3f7fe700 1 -- 172.21.15.152:0/4131527482 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d4c00e040 con 0x7f5d58101200 2023-12-06T15:06:38.785 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.778+0000 7f5d3f7fe700 1 -- 172.21.15.152:0/4131527482 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5d4c013420 con 0x7f5d58101200 2023-12-06T15:06:38.785 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.778+0000 7f5d5d778700 1 -- 172.21.15.152:0/4131527482 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d5810d680 con 0x7f5d58101200 2023-12-06T15:06:38.785 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.778+0000 7f5d3f7fe700 1 -- 172.21.15.152:0/4131527482 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d4c01c630 con 0x7f5d58101200 2023-12-06T15:06:38.785 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.779+0000 7f5d5d778700 1 -- 172.21.15.152:0/4131527482 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d5810dbc0 con 0x7f5d58101200 2023-12-06T15:06:38.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.780+0000 7f5d5d778700 1 -- 172.21.15.152:0/4131527482 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d58064b80 con 0x7f5d58101200 2023-12-06T15:06:38.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.780+0000 7f5d3f7fe700 1 -- 172.21.15.152:0/4131527482 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f5d4c01c8f0 con 0x7f5d58101200 2023-12-06T15:06:38.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.780+0000 7f5d3f7fe700 1 --2- 172.21.15.152:0/4131527482 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f5d4006ce60 0x7f5d4006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:38.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.780+0000 7f5d3f7fe700 1 -- 172.21.15.152:0/4131527482 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f5d4c08d730 con 0x7f5d58101200 2023-12-06T15:06:38.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.780+0000 7f5d567fc700 1 --2- 172.21.15.152:0/4131527482 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f5d4006ce60 0x7f5d4006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:38.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.781+0000 7f5d567fc700 1 --2- 172.21.15.152:0/4131527482 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f5d4006ce60 0x7f5d4006f310 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5d48006fd0 tx=0x7f5d48008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:06:38.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.785+0000 7f5d3f7fe700 1 -- 172.21.15.152:0/4131527482 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f5d4c05b080 con 0x7f5d58101200 2023-12-06T15:06:38.989 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.989+0000 7f5d5d778700 1 -- 172.21.15.152:0/4131527482 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5d58108230 con 0x7f5d58101200 2023-12-06T15:06:38.989 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.989+0000 7f5d3f7fe700 1 -- 172.21.15.152:0/4131527482 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 37 entries v89) v1 ==== 81+0+2210 (secure 0 0 0) 0x7f5d4c05ac10 con 0x7f5d58101200 2023-12-06T15:06:38.990 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/3550921367 2023-12-07T14:59:40.851866+0000 2023-12-06T15:06:38.990 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/145030765 2023-12-07T14:53:50.748958+0000 2023-12-06T15:06:38.990 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.190:6829/3047155534 2023-12-07T15:00:50.131153+0000 2023-12-06T15:06:38.990 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6801/2466555973 2023-12-07T14:53:50.748958+0000 2023-12-06T15:06:38.990 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/1389268383 2023-12-07T14:59:40.851866+0000 2023-12-06T15:06:38.991 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/4186839809 2023-12-07T14:53:24.414825+0000 2023-12-06T15:06:38.991 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/2581585771 2023-12-07T14:53:50.748958+0000 2023-12-06T15:06:38.991 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.190:6828/3047155534 2023-12-07T15:00:50.131153+0000 2023-12-06T15:06:38.991 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.190:0/781150211 2023-12-07T15:00:50.131153+0000 2023-12-06T15:06:38.991 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6801/4105588516 2023-12-07T15:01:30.573634+0000 2023-12-06T15:06:38.991 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/2095526930 2023-12-07T14:54:40.970995+0000 2023-12-06T15:06:38.991 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.190:0/3203466810 2023-12-07T15:00:50.131153+0000 2023-12-06T15:06:38.991 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6800/2466555973 2023-12-07T14:53:50.748958+0000 2023-12-06T15:06:38.991 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.190:0/1733155328 2023-12-07T15:00:50.131153+0000 2023-12-06T15:06:38.992 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/251625153 2023-12-07T14:54:40.970995+0000 2023-12-06T15:06:38.992 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/959508847 2023-12-07T14:54:40.970995+0000 2023-12-06T15:06:38.992 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6801/3517650686 2023-12-07T14:54:40.970995+0000 2023-12-06T15:06:38.992 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/1805885486 2023-12-07T15:01:30.573634+0000 2023-12-06T15:06:38.992 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/498144396 2023-12-07T15:01:30.573634+0000 2023-12-06T15:06:38.992 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.190:0/609524120 2023-12-07T15:00:50.131153+0000 2023-12-06T15:06:38.992 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/2756816012 2023-12-07T14:59:40.851866+0000 2023-12-06T15:06:38.992 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/2571521952 2023-12-07T14:53:50.748958+0000 2023-12-06T15:06:38.992 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6800/3317409709 2023-12-07T14:59:40.851866+0000 2023-12-06T15:06:38.993 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6801/1793082857 2023-12-07T14:53:24.414825+0000 2023-12-06T15:06:38.993 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.190:0/1446993889 2023-12-07T15:00:50.131153+0000 2023-12-06T15:06:38.993 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6800/1793082857 2023-12-07T14:53:24.414825+0000 2023-12-06T15:06:38.993 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/2442962105 2023-12-07T15:01:30.573634+0000 2023-12-06T15:06:38.993 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/3538958834 2023-12-07T14:53:24.414825+0000 2023-12-06T15:06:38.993 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.190:0/2097810823 2023-12-07T15:00:50.131153+0000 2023-12-06T15:06:38.993 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6800/3517650686 2023-12-07T14:54:40.970995+0000 2023-12-06T15:06:38.993 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/561475554 2023-12-07T14:59:40.851866+0000 2023-12-06T15:06:38.993 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/2210289933 2023-12-07T15:01:30.573634+0000 2023-12-06T15:06:38.993 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/235446797 2023-12-07T15:01:30.573634+0000 2023-12-06T15:06:38.994 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/2125669406 2023-12-07T15:01:30.573634+0000 2023-12-06T15:06:38.994 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/181182783 2023-12-07T14:53:24.414825+0000 2023-12-06T15:06:38.994 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6801/3317409709 2023-12-07T14:59:40.851866+0000 2023-12-06T15:06:38.994 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6800/4105588516 2023-12-07T15:01:30.573634+0000 2023-12-06T15:06:38.995 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.992+0000 7f5d5d778700 1 -- 172.21.15.152:0/4131527482 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f5d4006ce60 msgr2=0x7f5d4006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:38.995 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.992+0000 7f5d5d778700 1 --2- 172.21.15.152:0/4131527482 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f5d4006ce60 0x7f5d4006f310 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5d48006fd0 tx=0x7f5d48008040 comp rx=0 tx=0).stop 2023-12-06T15:06:38.995 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.992+0000 7f5d5d778700 1 -- 172.21.15.152:0/4131527482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d58101200 msgr2=0x7f5d581133b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:38.995 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.992+0000 7f5d5d778700 1 --2- 172.21.15.152:0/4131527482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d58101200 0x7f5d581133b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c009180 tx=0x7f5d4c009e30 comp rx=0 tx=0).stop 2023-12-06T15:06:38.995 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.992+0000 7f5d5d778700 1 -- 172.21.15.152:0/4131527482 shutdown_connections 2023-12-06T15:06:38.995 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.992+0000 7f5d5d778700 1 --2- 172.21.15.152:0/4131527482 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f5d4006ce60 0x7f5d4006f310 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:38.996 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.992+0000 7f5d5d778700 1 --2- 172.21.15.152:0/4131527482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d58101200 0x7f5d581133b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:38.996 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.992+0000 7f5d5d778700 1 --2- 172.21.15.152:0/4131527482 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5d58101ba0 0x7f5d581138f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:38.996 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.992+0000 7f5d5d778700 1 -- 172.21.15.152:0/4131527482 >> 172.21.15.152:0/4131527482 conn(0x7f5d580710d0 msgr2=0x7f5d580fa790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:06:38.996 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.992+0000 7f5d5d778700 1 -- 172.21.15.152:0/4131527482 shutdown_connections 2023-12-06T15:06:38.996 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:38.992+0000 7f5d5d778700 1 -- 172.21.15.152:0/4131527482 wait complete. 2023-12-06T15:06:38.996 INFO:teuthology.orchestra.run.smithi152.stderr:listed 37 entries 2023-12-06T15:06:39.004 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-06T15:06:39.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T15:06:39.004 DEBUG:teuthology.orchestra.run.smithi152:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-06T15:06:39.041 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi152.front.sepia.ceph.com 2023-12-06T15:06:39.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T15:06:39.042 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-06T15:06:39.138 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-06T15:06:39.138 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-06T15:06:39.282 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-06T15:06:39.283 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-06T15:06:39.340 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-06T15:06:39.366 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:39 smithi152 ceph-mon[192652]: from='client.? 172.21.15.152:0/1423500723' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-06T15:06:39.366 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:39 smithi152 ceph-mon[192652]: from='client.? 172.21.15.152:0/1853451315' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-06T15:06:39.366 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:39 smithi152 ceph-mon[192652]: from='client.? 172.21.15.152:0/4131527482' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-06T15:06:39.468 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.466+0000 7f9b6be13700 1 -- 172.21.15.152:0/2296773755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b640fb970 msgr2=0x7f9b640fbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:39.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.466+0000 7f9b6be13700 1 --2- 172.21.15.152:0/2296773755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b640fb970 0x7f9b640fbde0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9b60004940 tx=0x7f9b60009e30 comp rx=0 tx=0).stop 2023-12-06T15:06:39.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.466+0000 7f9b6be13700 1 -- 172.21.15.152:0/2296773755 shutdown_connections 2023-12-06T15:06:39.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.466+0000 7f9b6be13700 1 --2- 172.21.15.152:0/2296773755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b640fb970 0x7f9b640fbde0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:39.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.466+0000 7f9b6be13700 1 --2- 172.21.15.152:0/2296773755 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b641019b0 0x7f9b64101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:39.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.466+0000 7f9b6be13700 1 -- 172.21.15.152:0/2296773755 >> 172.21.15.152:0/2296773755 conn(0x7f9b640756d0 msgr2=0x7f9b640f99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:06:39.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.466+0000 7f9b6be13700 1 -- 172.21.15.152:0/2296773755 shutdown_connections 2023-12-06T15:06:39.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.466+0000 7f9b6be13700 1 -- 172.21.15.152:0/2296773755 wait complete. 2023-12-06T15:06:39.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.467+0000 7f9b6be13700 1 Processor -- start 2023-12-06T15:06:39.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.467+0000 7f9b6be13700 1 -- start start 2023-12-06T15:06:39.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.467+0000 7f9b6be13700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b640fb970 0x7f9b6410e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:39.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.467+0000 7f9b6be13700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b641019b0 0x7f9b6410e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:39.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.467+0000 7f9b6be13700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6410ee20 con 0x7f9b640fb970 2023-12-06T15:06:39.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.467+0000 7f9b6be13700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6410ef60 con 0x7f9b641019b0 2023-12-06T15:06:39.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.467+0000 7f9b69baf700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b640fb970 0x7f9b6410e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:39.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.467+0000 7f9b69baf700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b640fb970 0x7f9b6410e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36968/0 (socket says 172.21.15.152:36968) 2023-12-06T15:06:39.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.467+0000 7f9b69baf700 1 -- 172.21.15.152:0/1812933119 learned_addr learned my addr 172.21.15.152:0/1812933119 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:06:39.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.467+0000 7f9b693ae700 1 --2- 172.21.15.152:0/1812933119 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b641019b0 0x7f9b6410e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:39.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.467+0000 7f9b69baf700 1 -- 172.21.15.152:0/1812933119 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b641019b0 msgr2=0x7f9b6410e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:39.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.467+0000 7f9b69baf700 1 --2- 172.21.15.152:0/1812933119 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b641019b0 0x7f9b6410e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:39.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.467+0000 7f9b69baf700 1 -- 172.21.15.152:0/1812933119 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b60005040 con 0x7f9b640fb970 2023-12-06T15:06:39.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.467+0000 7f9b69baf700 1 --2- 172.21.15.152:0/1812933119 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b640fb970 0x7f9b6410e310 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9b5400b790 tx=0x7f9b54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:06:39.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.468+0000 7f9b5a7fc700 1 -- 172.21.15.152:0/1812933119 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b5400f6f0 con 0x7f9b640fb970 2023-12-06T15:06:39.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.468+0000 7f9b5a7fc700 1 -- 172.21.15.152:0/1812933119 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9b5400fd00 con 0x7f9b640fb970 2023-12-06T15:06:39.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.468+0000 7f9b6be13700 1 -- 172.21.15.152:0/1812933119 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b64117380 con 0x7f9b640fb970 2023-12-06T15:06:39.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.468+0000 7f9b5a7fc700 1 -- 172.21.15.152:0/1812933119 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b540103a0 con 0x7f9b640fb970 2023-12-06T15:06:39.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.468+0000 7f9b6be13700 1 -- 172.21.15.152:0/1812933119 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b64117860 con 0x7f9b640fb970 2023-12-06T15:06:39.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.469+0000 7f9b6be13700 1 -- 172.21.15.152:0/1812933119 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b64064730 con 0x7f9b640fb970 2023-12-06T15:06:39.473 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.469+0000 7f9b5a7fc700 1 -- 172.21.15.152:0/1812933119 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f9b5400f850 con 0x7f9b640fb970 2023-12-06T15:06:39.473 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.470+0000 7f9b5a7fc700 1 --2- 172.21.15.152:0/1812933119 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f9b5006ce60 0x7f9b5006f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:39.473 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.470+0000 7f9b5a7fc700 1 -- 172.21.15.152:0/1812933119 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f9b5408c260 con 0x7f9b640fb970 2023-12-06T15:06:39.473 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.470+0000 7f9b693ae700 1 --2- 172.21.15.152:0/1812933119 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f9b5006ce60 0x7f9b5006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:39.473 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.470+0000 7f9b693ae700 1 --2- 172.21.15.152:0/1812933119 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f9b5006ce60 0x7f9b5006f310 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9b60004f90 tx=0x7f9b60009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:06:39.474 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.474+0000 7f9b5a7fc700 1 -- 172.21.15.152:0/1812933119 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f9b540560b0 con 0x7f9b640fb970 2023-12-06T15:06:39.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:39 smithi190 ceph-mon[178398]: from='client.? 172.21.15.152:0/1423500723' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-06T15:06:39.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:39 smithi190 ceph-mon[178398]: from='client.? 172.21.15.152:0/1853451315' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-06T15:06:39.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:39 smithi190 ceph-mon[178398]: from='client.? 172.21.15.152:0/4131527482' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-06T15:06:39.667 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.667+0000 7f9b6be13700 1 -- 172.21.15.152:0/1812933119 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b64108970 con 0x7f9b640fb970 2023-12-06T15:06:39.668 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.668+0000 7f9b5a7fc700 1 -- 172.21.15.152:0/1812933119 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+16970 (secure 0 0 0) 0x7f9b540596d0 con 0x7f9b640fb970 2023-12-06T15:06:39.668 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-12-06T15:06:39.669 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":89,"fsid":"062f0e3c-9447-11ee-95a2-87774f69a715","created":"2023-12-06T14:53:01.413534+0000","modified":"2023-12-06T15:05:03.509118+0000","last_up_change":"2023-12-06T15:05:02.507144+0000","last_in_change":"2023-12-06T14:56:53.456498+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-06T14:56:15.276535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2023-12-06T14:57:57.673767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2023-12-06T14:57:58.572251+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72a62158-6e7d-42af-8212-f6ae2b8df6e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":48,"up_from":58,"up_thru":88,"down_at":49,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":2356689289},{"type":"v1","addr":"172.21.15.152:6803","nonce":2356689289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":2356689289},{"type":"v1","addr":"172.21.15.152:6805","nonce":2356689289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":2356689289},{"type":"v1","addr":"172.21.15.152:6809","nonce":2356689289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":2356689289},{"type":"v1","addr":"172.21.15.152:6807","nonce":2356689289}]},"public_addr":"172.21.15.152:6803/2356689289","cluster_addr":"172.21.15.152:6805/2356689289","heartbeat_back_addr":"172.21.15.152:6809/2356689289","heartbeat_front_addr":"172.21.15.152:6807/2356689289","state":["exists","up"]},{"osd":1,"uuid":"50dee56b-c95b-4361-ad0d-4f71198f9105","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":64,"up_from":68,"up_thru":88,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":3248615058},{"type":"v1","addr":"172.21.15.152:6811","nonce":3248615058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":3248615058},{"type":"v1","addr":"172.21.15.152:6813","nonce":3248615058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3248615058},{"type":"v1","addr":"172.21.15.152:6817","nonce":3248615058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":3248615058},{"type":"v1","addr":"172.21.15.152:6815","nonce":3248615058}]},"public_addr":"172.21.15.152:6811/3248615058","cluster_addr":"172.21.15.152:6813/3248615058","heartbeat_back_addr":"172.21.15.152:6817/3248615058","heartbeat_front_addr":"172.21.15.152:6815/3248615058","state":["exists","up"]},{"osd":2,"uuid":"8dce6383-8296-4737-99d9-427bbd62f9a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":69,"up_from":73,"up_thru":88,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":1164280420},{"type":"v1","addr":"172.21.15.152:6819","nonce":1164280420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":1164280420},{"type":"v1","addr":"172.21.15.152:6821","nonce":1164280420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":1164280420},{"type":"v1","addr":"172.21.15.152:6825","nonce":1164280420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":1164280420},{"type":"v1","addr":"172.21.15.152:6823","nonce":1164280420}]},"public_addr":"172.21.15.152:6819/1164280420","cluster_addr":"172.21.15.152:6821/1164280420","heartbeat_back_addr":"172.21.15.152:6825/1164280420","heartbeat_front_addr":"172.21.15.152:6823/1164280420","state":["exists","up"]},{"osd":3,"uuid":"ea52387d-fb71-4ed5-bde5-85550b5cc117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":25,"last_clean_end":74,"up_from":78,"up_thru":88,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1202145658},{"type":"v1","addr":"172.21.15.190:6801","nonce":1202145658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1202145658},{"type":"v1","addr":"172.21.15.190:6803","nonce":1202145658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1202145658},{"type":"v1","addr":"172.21.15.190:6807","nonce":1202145658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1202145658},{"type":"v1","addr":"172.21.15.190:6805","nonce":1202145658}]},"public_addr":"172.21.15.190:6801/1202145658","cluster_addr":"172.21.15.190:6803/1202145658","heartbeat_back_addr":"172.21.15.190:6807/1202145658","heartbeat_front_addr":"172.21.15.190:6805/1202145658","state":["exists","up"]},{"osd":4,"uuid":"23efef41-308e-467c-9f90-ae159a8d43a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":32,"last_clean_end":79,"up_from":83,"up_thru":88,"down_at":80,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3285745876},{"type":"v1","addr":"172.21.15.190:6809","nonce":3285745876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3285745876},{"type":"v1","addr":"172.21.15.190:6811","nonce":3285745876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3285745876},{"type":"v1","addr":"172.21.15.190:6815","nonce":3285745876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3285745876},{"type":"v1","addr":"172.21.15.190:6813","nonce":3285745876}]},"public_addr":"172.21.15.190:6809/3285745876","cluster_addr":"172.21.15.190:6811/3285745876","heartbeat_back_addr":"172.21.15.190:6815/3285745876","heartbeat_front_addr":"172.21.15.190:6813/3285745876","state":["exists","up"]},{"osd":5,"uuid":"fe0aeff2-a9e0-4cb5-9cd9-fd0e3db4807f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":37,"last_clean_end":84,"up_from":88,"up_thru":88,"down_at":85,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":3404864287},{"type":"v1","addr":"172.21.15.190:6817","nonce":3404864287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":3404864287},{"type":"v1","addr":"172.21.15.190:6819","nonce":3404864287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":3404864287},{"type":"v1","addr":"172.21.15.190:6823","nonce":3404864287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":3404864287},{"type":"v1","addr":"172.21.15.190:6821","nonce":3404864287}]},"public_addr":"172.21.15.190:6817/3404864287","cluster_addr":"172.21.15.190:6819/3404864287","heartbeat_back_addr":"172.21.15.190:6823/3404864287","heartbeat_front_addr":"172.21.15.190:6821/3404864287","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T14:55:32.948973+0000","dead_epoch":48},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T14:55:53.358269+0000","dead_epoch":64},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T14:56:12.783635+0000","dead_epoch":69},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T14:56:30.517271+0000","dead_epoch":74},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T14:56:49.401042+0000","dead_epoch":79},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T14:57:08.146152+0000","dead_epoch":84}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":3,"to":2}]},{"pgid":"2.e","mappings":[{"from":3,"to":5}]},{"pgid":"2.1d","mappings":[{"from":3,"to":2}]},{"pgid":"3.3","mappings":[{"from":4,"to":5}]},{"pgid":"3.4","mappings":[{"from":1,"to":0}]},{"pgid":"3.6","mappings":[{"from":1,"to":2}]},{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.e","mappings":[{"from":4,"to":0}]},{"pgid":"3.14","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.152:0/3550921367":"2023-12-07T14:59:40.851866+0000","172.21.15.152:0/145030765":"2023-12-07T14:53:50.748958+0000","172.21.15.190:6829/3047155534":"2023-12-07T15:00:50.131153+0000","172.21.15.152:6801/2466555973":"2023-12-07T14:53:50.748958+0000","172.21.15.152:0/1389268383":"2023-12-07T14:59:40.851866+0000","172.21.15.152:0/4186839809":"2023-12-07T14:53:24.414825+0000","172.21.15.152:0/2581585771":"2023-12-07T14:53:50.748958+0000","172.21.15.190:6828/3047155534":"2023-12-07T15:00:50.131153+0000","172.21.15.190:0/781150211":"2023-12-07T15:00:50.131153+0000","172.21.15.152:6801/4105588516":"2023-12-07T15:01:30.573634+0000","172.21.15.152:0/2095526930":"2023-12-07T14:54:40.970995+0000","172.21.15.190:0/3203466810":"2023-12-07T15:00:50.131153+0000","172.21.15.152:6800/2466555973":"2023-12-07T14:53:50.748958+0000","172.21.15.190:0/1733155328":"2023-12-07T15:00:50.131153+0000","172.21.15.152:0/251625153":"2023-12-07T14:54:40.970995+0000","172.21.15.152:0/959508847":"2023-12-07T14:54:40.970995+0000","172.21.15.152:6801/3517650686":"2023-12-07T14:54:40.970995+0000","172.21.15.152:0/1805885486":"2023-12-07T15:01:30.573634+0000","172.21.15.152:0/498144396":"2023-12-07T15:01:30.573634+0000","172.21.15.190:0/609524120":"2023-12-07T15:00:50.131153+0000","172.21.15.152:0/2756816012":"2023-12-07T14:59:40.851866+0000","172.21.15.152:0/2571521952":"2023-12-07T14:53:50.748958+0000","172.21.15.152:6800/3317409709":"2023-12-07T14:59:40.851866+0000","172.21.15.152:6801/1793082857":"2023-12-07T14:53:24.414825+0000","172.21.15.190:0/1446993889":"2023-12-07T15:00:50.131153+0000","172.21.15.152:6800/1793082857":"2023-12-07T14:53:24.414825+0000","172.21.15.152:0/2442962105":"2023-12-07T15:01:30.573634+0000","172.21.15.152:0/3538958834":"2023-12-07T14:53:24.414825+0000","172.21.15.190:0/2097810823":"2023-12-07T15:00:50.131153+0000","172.21.15.152:6800/3517650686":"2023-12-07T14:54:40.970995+0000","172.21.15.152:0/561475554":"2023-12-07T14:59:40.851866+0000","172.21.15.152:0/2210289933":"2023-12-07T15:01:30.573634+0000","172.21.15.152:0/235446797":"2023-12-07T15:01:30.573634+0000","172.21.15.152:0/2125669406":"2023-12-07T15:01:30.573634+0000","172.21.15.152:0/181182783":"2023-12-07T14:53:24.414825+0000","172.21.15.152:6801/3317409709":"2023-12-07T14:59:40.851866+0000","172.21.15.152:6800/4105588516":"2023-12-07T15:01:30.573634+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-06T15:06:39.670 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.670+0000 7f9b6be13700 1 -- 172.21.15.152:0/1812933119 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f9b5006ce60 msgr2=0x7f9b5006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:39.671 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.670+0000 7f9b6be13700 1 --2- 172.21.15.152:0/1812933119 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f9b5006ce60 0x7f9b5006f310 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9b60004f90 tx=0x7f9b60009e30 comp rx=0 tx=0).stop 2023-12-06T15:06:39.671 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.670+0000 7f9b6be13700 1 -- 172.21.15.152:0/1812933119 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b640fb970 msgr2=0x7f9b6410e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:39.671 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.670+0000 7f9b6be13700 1 --2- 172.21.15.152:0/1812933119 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b640fb970 0x7f9b6410e310 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9b5400b790 tx=0x7f9b54009250 comp rx=0 tx=0).stop 2023-12-06T15:06:39.671 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.670+0000 7f9b6be13700 1 -- 172.21.15.152:0/1812933119 shutdown_connections 2023-12-06T15:06:39.671 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.670+0000 7f9b6be13700 1 --2- 172.21.15.152:0/1812933119 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f9b5006ce60 0x7f9b5006f310 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:39.671 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.670+0000 7f9b6be13700 1 --2- 172.21.15.152:0/1812933119 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b640fb970 0x7f9b6410e310 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:39.671 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.670+0000 7f9b6be13700 1 --2- 172.21.15.152:0/1812933119 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b641019b0 0x7f9b6410e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:39.672 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.670+0000 7f9b6be13700 1 -- 172.21.15.152:0/1812933119 >> 172.21.15.152:0/1812933119 conn(0x7f9b640756d0 msgr2=0x7f9b640728a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:06:39.672 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.670+0000 7f9b6be13700 1 -- 172.21.15.152:0/1812933119 shutdown_connections 2023-12-06T15:06:39.672 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.670+0000 7f9b6be13700 1 -- 172.21.15.152:0/1812933119 wait complete. 2023-12-06T15:06:39.683 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-06T14:56:15.276535+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2023-12-06T14:57:57.673767+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2023-12-06T14:57:58.572251+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-06T15:06:39.684 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-06T15:06:39.843 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.843+0000 7fded8595700 1 -- 172.21.15.152:0/441878557 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fded0064bb0 msgr2=0x7fded0065000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:39.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.843+0000 7fded8595700 1 --2- 172.21.15.152:0/441878557 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fded0064bb0 0x7fded0065000 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdecc004940 tx=0x7fdecc009e30 comp rx=0 tx=0).stop 2023-12-06T15:06:39.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.843+0000 7fded8595700 1 -- 172.21.15.152:0/441878557 shutdown_connections 2023-12-06T15:06:39.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.843+0000 7fded8595700 1 --2- 172.21.15.152:0/441878557 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fded0064bb0 0x7fded0065000 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:39.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.843+0000 7fded8595700 1 --2- 172.21.15.152:0/441878557 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fded0102bb0 0x7fded0102f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:39.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.843+0000 7fded8595700 1 -- 172.21.15.152:0/441878557 >> 172.21.15.152:0/441878557 conn(0x7fded0071970 msgr2=0x7fded0071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:06:39.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.843+0000 7fded8595700 1 -- 172.21.15.152:0/441878557 shutdown_connections 2023-12-06T15:06:39.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.843+0000 7fded8595700 1 -- 172.21.15.152:0/441878557 wait complete. 2023-12-06T15:06:39.844 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.843+0000 7fded8595700 1 Processor -- start 2023-12-06T15:06:39.845 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.844+0000 7fded8595700 1 -- start start 2023-12-06T15:06:39.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.844+0000 7fded8595700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fded0064bb0 0x7fded0113320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:39.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.844+0000 7fded8595700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fded0102bb0 0x7fded0113860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:39.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.844+0000 7fded8595700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded0113eb0 con 0x7fded0102bb0 2023-12-06T15:06:39.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.844+0000 7fded8595700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded010d3d0 con 0x7fded0064bb0 2023-12-06T15:06:39.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.844+0000 7fded5b30700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fded0102bb0 0x7fded0113860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:39.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.844+0000 7fded5b30700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fded0102bb0 0x7fded0113860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36994/0 (socket says 172.21.15.152:36994) 2023-12-06T15:06:39.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.844+0000 7fded5b30700 1 -- 172.21.15.152:0/212561206 learned_addr learned my addr 172.21.15.152:0/212561206 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:06:39.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.844+0000 7fded5b30700 1 -- 172.21.15.152:0/212561206 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fded0064bb0 msgr2=0x7fded0113320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:39.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.844+0000 7fded6331700 1 --2- 172.21.15.152:0/212561206 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fded0064bb0 0x7fded0113320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:39.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.844+0000 7fded5b30700 1 --2- 172.21.15.152:0/212561206 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fded0064bb0 0x7fded0113320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:39.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.844+0000 7fded5b30700 1 -- 172.21.15.152:0/212561206 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdecc005040 con 0x7fded0102bb0 2023-12-06T15:06:39.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.844+0000 7fded5b30700 1 --2- 172.21.15.152:0/212561206 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fded0102bb0 0x7fded0113860 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdecc00b3b0 tx=0x7fdecc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:06:39.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.844+0000 7fdec6ffd700 1 -- 172.21.15.152:0/212561206 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdecc00e040 con 0x7fded0102bb0 2023-12-06T15:06:39.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.845+0000 7fded8595700 1 -- 172.21.15.152:0/212561206 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fded010d650 con 0x7fded0102bb0 2023-12-06T15:06:39.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.845+0000 7fdec6ffd700 1 -- 172.21.15.152:0/212561206 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdecc00bc50 con 0x7fded0102bb0 2023-12-06T15:06:39.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.845+0000 7fdec6ffd700 1 -- 172.21.15.152:0/212561206 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdecc013420 con 0x7fded0102bb0 2023-12-06T15:06:39.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.845+0000 7fded8595700 1 -- 172.21.15.152:0/212561206 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded010dc10 con 0x7fded0102bb0 2023-12-06T15:06:39.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.846+0000 7fded8595700 1 -- 172.21.15.152:0/212561206 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fded0104f90 con 0x7fded0102bb0 2023-12-06T15:06:39.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.846+0000 7fdec6ffd700 1 -- 172.21.15.152:0/212561206 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fdecc01c430 con 0x7fded0102bb0 2023-12-06T15:06:39.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.846+0000 7fdec6ffd700 1 --2- 172.21.15.152:0/212561206 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fdebc06ce60 0x7fdebc06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:39.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.846+0000 7fdec6ffd700 1 -- 172.21.15.152:0/212561206 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6675+0+0 (secure 0 0 0) 0x7fdecc08d180 con 0x7fded0102bb0 2023-12-06T15:06:39.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.846+0000 7fded6331700 1 --2- 172.21.15.152:0/212561206 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fdebc06ce60 0x7fdebc06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:39.850 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.847+0000 7fded6331700 1 --2- 172.21.15.152:0/212561206 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fdebc06ce60 0x7fdebc06f310 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdec00041d0 tx=0x7fdec0009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:06:39.851 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:39.851+0000 7fdec6ffd700 1 -- 172.21.15.152:0/212561206 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fdecc05ab10 con 0x7fded0102bb0 2023-12-06T15:06:40.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.040+0000 7fded8595700 1 -- 172.21.15.152:0/212561206 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fded010e900 con 0x7fded0102bb0 2023-12-06T15:06:40.040 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.040+0000 7fdec6ffd700 1 -- 172.21.15.152:0/212561206 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdecc05a6a0 con 0x7fded0102bb0 2023-12-06T15:06:40.041 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2023-12-06T15:06:40.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.042+0000 7fded8595700 1 -- 172.21.15.152:0/212561206 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fdebc06ce60 msgr2=0x7fdebc06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:40.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.042+0000 7fded8595700 1 --2- 172.21.15.152:0/212561206 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fdebc06ce60 0x7fdebc06f310 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdec00041d0 tx=0x7fdec0009040 comp rx=0 tx=0).stop 2023-12-06T15:06:40.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.042+0000 7fded8595700 1 -- 172.21.15.152:0/212561206 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fded0102bb0 msgr2=0x7fded0113860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:40.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.042+0000 7fded8595700 1 --2- 172.21.15.152:0/212561206 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fded0102bb0 0x7fded0113860 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdecc00b3b0 tx=0x7fdecc009e30 comp rx=0 tx=0).stop 2023-12-06T15:06:40.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.043+0000 7fded8595700 1 -- 172.21.15.152:0/212561206 shutdown_connections 2023-12-06T15:06:40.043 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.043+0000 7fded8595700 1 --2- 172.21.15.152:0/212561206 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fdebc06ce60 0x7fdebc06f310 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:40.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.043+0000 7fded8595700 1 --2- 172.21.15.152:0/212561206 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fded0064bb0 0x7fded0113320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:40.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.043+0000 7fded8595700 1 --2- 172.21.15.152:0/212561206 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fded0102bb0 0x7fded0113860 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:40.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.043+0000 7fded8595700 1 -- 172.21.15.152:0/212561206 >> 172.21.15.152:0/212561206 conn(0x7fded0071970 msgr2=0x7fded00faba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:06:40.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.043+0000 7fded8595700 1 -- 172.21.15.152:0/212561206 shutdown_connections 2023-12-06T15:06:40.044 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.043+0000 7fded8595700 1 -- 172.21.15.152:0/212561206 wait complete. 2023-12-06T15:06:40.055 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2023-12-06T15:06:40.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.175+0000 7f91255fb700 1 -- 172.21.15.152:0/3325057934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91200fdd60 msgr2=0x7f91200fe130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:40.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.175+0000 7f91255fb700 1 --2- 172.21.15.152:0/3325057934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91200fdd60 0x7f91200fe130 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9114004940 tx=0x7f9114009e30 comp rx=0 tx=0).stop 2023-12-06T15:06:40.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.175+0000 7f91255fb700 1 -- 172.21.15.152:0/3325057934 shutdown_connections 2023-12-06T15:06:40.176 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.175+0000 7f91255fb700 1 --2- 172.21.15.152:0/3325057934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91200fe670 0x7f9120106dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:40.177 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.175+0000 7f91255fb700 1 --2- 172.21.15.152:0/3325057934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91200fdd60 0x7f91200fe130 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:40.177 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.176+0000 7f91255fb700 1 -- 172.21.15.152:0/3325057934 >> 172.21.15.152:0/3325057934 conn(0x7f91200f7760 msgr2=0x7f91200f9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:06:40.177 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.176+0000 7f91255fb700 1 -- 172.21.15.152:0/3325057934 shutdown_connections 2023-12-06T15:06:40.177 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.176+0000 7f91255fb700 1 -- 172.21.15.152:0/3325057934 wait complete. 2023-12-06T15:06:40.178 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.176+0000 7f91255fb700 1 Processor -- start 2023-12-06T15:06:40.178 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.176+0000 7f91255fb700 1 -- start start 2023-12-06T15:06:40.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.177+0000 7f91255fb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91200fdd60 0x7f91201135d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:40.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.177+0000 7f91255fb700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91200fe670 0x7f9120113b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:40.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.177+0000 7f91255fb700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9120114160 con 0x7f91200fdd60 2023-12-06T15:06:40.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.177+0000 7f91255fb700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912010d6a0 con 0x7f91200fe670 2023-12-06T15:06:40.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.177+0000 7f911effd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91200fdd60 0x7f91201135d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:40.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.177+0000 7f911effd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91200fdd60 0x7f91201135d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:37008/0 (socket says 172.21.15.152:37008) 2023-12-06T15:06:40.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.177+0000 7f911effd700 1 -- 172.21.15.152:0/580691525 learned_addr learned my addr 172.21.15.152:0/580691525 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:06:40.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.177+0000 7f911e7fc700 1 --2- 172.21.15.152:0/580691525 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91200fe670 0x7f9120113b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:40.179 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.177+0000 7f911effd700 1 -- 172.21.15.152:0/580691525 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91200fe670 msgr2=0x7f9120113b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:40.180 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.177+0000 7f911effd700 1 --2- 172.21.15.152:0/580691525 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91200fe670 0x7f9120113b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:40.180 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.177+0000 7f911effd700 1 -- 172.21.15.152:0/580691525 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9114005040 con 0x7f91200fdd60 2023-12-06T15:06:40.180 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.177+0000 7f911effd700 1 --2- 172.21.15.152:0/580691525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91200fdd60 0x7f91201135d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9114009fd0 tx=0x7f9114009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:06:40.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.179+0000 7f91077fe700 1 -- 172.21.15.152:0/580691525 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f911400e040 con 0x7f91200fdd60 2023-12-06T15:06:40.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.179+0000 7f91255fb700 1 -- 172.21.15.152:0/580691525 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f912010d920 con 0x7f91200fdd60 2023-12-06T15:06:40.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.179+0000 7f91077fe700 1 -- 172.21.15.152:0/580691525 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9114013420 con 0x7f91200fdd60 2023-12-06T15:06:40.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.179+0000 7f91077fe700 1 -- 172.21.15.152:0/580691525 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f911401c630 con 0x7f91200fdd60 2023-12-06T15:06:40.181 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.179+0000 7f91255fb700 1 -- 172.21.15.152:0/580691525 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f912010de60 con 0x7f91200fdd60 2023-12-06T15:06:40.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.180+0000 7f91255fb700 1 -- 172.21.15.152:0/580691525 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9120104460 con 0x7f91200fdd60 2023-12-06T15:06:40.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.181+0000 7f91077fe700 1 -- 172.21.15.152:0/580691525 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f911400bb80 con 0x7f91200fdd60 2023-12-06T15:06:40.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.181+0000 7f91077fe700 1 --2- 172.21.15.152:0/580691525 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f910806ce70 0x7f910806f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:40.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.181+0000 7f91077fe700 1 -- 172.21.15.152:0/580691525 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f911408d670 con 0x7f91200fdd60 2023-12-06T15:06:40.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.181+0000 7f911e7fc700 1 --2- 172.21.15.152:0/580691525 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f910806ce70 0x7f910806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:40.182 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.181+0000 7f911e7fc700 1 --2- 172.21.15.152:0/580691525 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f910806ce70 0x7f910806f320 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f912010ee70 tx=0x7f911000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:06:40.185 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.186+0000 7f91077fe700 1 -- 172.21.15.152:0/580691525 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f911405af50 con 0x7f91200fdd60 2023-12-06T15:06:40.372 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.372+0000 7f91255fb700 1 -- 172.21.15.152:0/580691525 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f91200640d0 con 0x7f91200fdd60 2023-12-06T15:06:40.373 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.373+0000 7f91077fe700 1 -- 172.21.15.152:0/580691525 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v89) v1 ==== 107+0+11 (secure 0 0 0) 0x7f911405aae0 con 0x7f91200fdd60 2023-12-06T15:06:40.373 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2023-12-06T15:06:40.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.375+0000 7f91255fb700 1 -- 172.21.15.152:0/580691525 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f910806ce70 msgr2=0x7f910806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:40.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.375+0000 7f91255fb700 1 --2- 172.21.15.152:0/580691525 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f910806ce70 0x7f910806f320 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f912010ee70 tx=0x7f911000b040 comp rx=0 tx=0).stop 2023-12-06T15:06:40.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.375+0000 7f91255fb700 1 -- 172.21.15.152:0/580691525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91200fdd60 msgr2=0x7f91201135d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:40.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.375+0000 7f91255fb700 1 --2- 172.21.15.152:0/580691525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91200fdd60 0x7f91201135d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9114009fd0 tx=0x7f9114009e30 comp rx=0 tx=0).stop 2023-12-06T15:06:40.375 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.375+0000 7f91255fb700 1 -- 172.21.15.152:0/580691525 shutdown_connections 2023-12-06T15:06:40.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.375+0000 7f91255fb700 1 --2- 172.21.15.152:0/580691525 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f910806ce70 0x7f910806f320 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:40.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.375+0000 7f91255fb700 1 --2- 172.21.15.152:0/580691525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91200fdd60 0x7f91201135d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:40.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.375+0000 7f91255fb700 1 --2- 172.21.15.152:0/580691525 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91200fe670 0x7f9120113b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:40.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.375+0000 7f91255fb700 1 -- 172.21.15.152:0/580691525 >> 172.21.15.152:0/580691525 conn(0x7f91200f7760 msgr2=0x7f91201015e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:06:40.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.375+0000 7f91255fb700 1 -- 172.21.15.152:0/580691525 shutdown_connections 2023-12-06T15:06:40.376 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.375+0000 7f91255fb700 1 -- 172.21.15.152:0/580691525 wait complete. 2023-12-06T15:06:40.377 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:40 smithi152 ceph-mon[192652]: pgmap v199: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:06:40.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:40 smithi152 ceph-mon[192652]: from='client.? 172.21.15.152:0/1812933119' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-06T15:06:40.378 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:40 smithi152 ceph-mon[192652]: from='client.? 172.21.15.152:0/212561206' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-06T15:06:40.387 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2023-12-06T15:06:40.511 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.510+0000 7fee877b7700 1 -- 172.21.15.152:0/3769184379 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee80064bb0 msgr2=0x7fee80065000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:40.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.510+0000 7fee877b7700 1 --2- 172.21.15.152:0/3769184379 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee80064bb0 0x7fee80065000 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fee70004940 tx=0x7fee70009e30 comp rx=0 tx=0).stop 2023-12-06T15:06:40.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.510+0000 7fee877b7700 1 -- 172.21.15.152:0/3769184379 shutdown_connections 2023-12-06T15:06:40.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.510+0000 7fee877b7700 1 --2- 172.21.15.152:0/3769184379 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee80064bb0 0x7fee80065000 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:40.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.510+0000 7fee877b7700 1 --2- 172.21.15.152:0/3769184379 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee80102bb0 0x7fee80102f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:40.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.510+0000 7fee877b7700 1 -- 172.21.15.152:0/3769184379 >> 172.21.15.152:0/3769184379 conn(0x7fee80071970 msgr2=0x7fee80071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:06:40.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.510+0000 7fee877b7700 1 -- 172.21.15.152:0/3769184379 shutdown_connections 2023-12-06T15:06:40.512 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.510+0000 7fee877b7700 1 -- 172.21.15.152:0/3769184379 wait complete. 2023-12-06T15:06:40.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.510+0000 7fee877b7700 1 Processor -- start 2023-12-06T15:06:40.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.510+0000 7fee877b7700 1 -- start start 2023-12-06T15:06:40.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.510+0000 7fee877b7700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee80064bb0 0x7fee80113320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:40.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.511+0000 7fee877b7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee80102bb0 0x7fee80113860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:40.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.511+0000 7fee877b7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee80113eb0 con 0x7fee80102bb0 2023-12-06T15:06:40.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.511+0000 7fee877b7700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8010d3d0 con 0x7fee80064bb0 2023-12-06T15:06:40.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.511+0000 7fee84d52700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee80102bb0 0x7fee80113860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:40.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.511+0000 7fee84d52700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee80102bb0 0x7fee80113860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:37030/0 (socket says 172.21.15.152:37030) 2023-12-06T15:06:40.513 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.511+0000 7fee84d52700 1 -- 172.21.15.152:0/84862905 learned_addr learned my addr 172.21.15.152:0/84862905 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:06:40.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.511+0000 7fee85553700 1 --2- 172.21.15.152:0/84862905 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee80064bb0 0x7fee80113320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:40.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.511+0000 7fee84d52700 1 -- 172.21.15.152:0/84862905 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee80064bb0 msgr2=0x7fee80113320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:40.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.511+0000 7fee84d52700 1 --2- 172.21.15.152:0/84862905 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee80064bb0 0x7fee80113320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:40.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.511+0000 7fee84d52700 1 -- 172.21.15.152:0/84862905 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee70005040 con 0x7fee80102bb0 2023-12-06T15:06:40.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.511+0000 7fee84d52700 1 --2- 172.21.15.152:0/84862905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee80102bb0 0x7fee80113860 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fee70009fd0 tx=0x7fee70009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:06:40.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.511+0000 7fee75ffb700 1 -- 172.21.15.152:0/84862905 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee7000e040 con 0x7fee80102bb0 2023-12-06T15:06:40.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.511+0000 7fee877b7700 1 -- 172.21.15.152:0/84862905 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee8010d650 con 0x7fee80102bb0 2023-12-06T15:06:40.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.511+0000 7fee75ffb700 1 -- 172.21.15.152:0/84862905 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fee7000bc50 con 0x7fee80102bb0 2023-12-06T15:06:40.514 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.511+0000 7fee75ffb700 1 -- 172.21.15.152:0/84862905 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee70013ea0 con 0x7fee80102bb0 2023-12-06T15:06:40.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.512+0000 7fee877b7700 1 -- 172.21.15.152:0/84862905 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee8010dc10 con 0x7fee80102bb0 2023-12-06T15:06:40.515 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.513+0000 7fee877b7700 1 -- 172.21.15.152:0/84862905 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee80104f90 con 0x7fee80102bb0 2023-12-06T15:06:40.516 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.514+0000 7fee75ffb700 1 -- 172.21.15.152:0/84862905 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7fee70013420 con 0x7fee80102bb0 2023-12-06T15:06:40.516 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.514+0000 7fee75ffb700 1 --2- 172.21.15.152:0/84862905 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fee6c06ce70 0x7fee6c06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:40.516 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.514+0000 7fee75ffb700 1 -- 172.21.15.152:0/84862905 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6675+0+0 (secure 0 0 0) 0x7fee7008d920 con 0x7fee80102bb0 2023-12-06T15:06:40.516 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.514+0000 7fee85553700 1 --2- 172.21.15.152:0/84862905 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fee6c06ce70 0x7fee6c06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:40.516 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.514+0000 7fee85553700 1 --2- 172.21.15.152:0/84862905 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fee6c06ce70 0x7fee6c06f320 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fee7c004d60 tx=0x7fee7c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:06:40.518 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.519+0000 7fee75ffb700 1 -- 172.21.15.152:0/84862905 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fee7005b180 con 0x7fee80102bb0 2023-12-06T15:06:40.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:40 smithi190 ceph-mon[178398]: pgmap v199: 65 pgs: 65 active+clean; 290 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2023-12-06T15:06:40.572 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:40 smithi190 ceph-mon[178398]: from='client.? 172.21.15.152:0/1812933119' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-06T15:06:40.573 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:40 smithi190 ceph-mon[178398]: from='client.? 172.21.15.152:0/212561206' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-06T15:06:40.709 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.709+0000 7fee877b7700 1 -- 172.21.15.152:0/84862905 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fee80064730 con 0x7fee80102bb0 2023-12-06T15:06:40.710 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.710+0000 7fee75ffb700 1 -- 172.21.15.152:0/84862905 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v89) v1 ==== 107+0+11 (secure 0 0 0) 0x7fee7005ad10 con 0x7fee80102bb0 2023-12-06T15:06:40.710 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2023-12-06T15:06:40.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.712+0000 7fee877b7700 1 -- 172.21.15.152:0/84862905 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fee6c06ce70 msgr2=0x7fee6c06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:40.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.712+0000 7fee877b7700 1 --2- 172.21.15.152:0/84862905 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fee6c06ce70 0x7fee6c06f320 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fee7c004d60 tx=0x7fee7c00b040 comp rx=0 tx=0).stop 2023-12-06T15:06:40.712 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.712+0000 7fee877b7700 1 -- 172.21.15.152:0/84862905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee80102bb0 msgr2=0x7fee80113860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:40.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.712+0000 7fee877b7700 1 --2- 172.21.15.152:0/84862905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee80102bb0 0x7fee80113860 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fee70009fd0 tx=0x7fee70009e30 comp rx=0 tx=0).stop 2023-12-06T15:06:40.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.712+0000 7fee877b7700 1 -- 172.21.15.152:0/84862905 shutdown_connections 2023-12-06T15:06:40.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.712+0000 7fee877b7700 1 --2- 172.21.15.152:0/84862905 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7fee6c06ce70 0x7fee6c06f320 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:40.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.712+0000 7fee877b7700 1 --2- 172.21.15.152:0/84862905 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee80064bb0 0x7fee80113320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:40.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.712+0000 7fee877b7700 1 --2- 172.21.15.152:0/84862905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee80102bb0 0x7fee80113860 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:40.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.712+0000 7fee877b7700 1 -- 172.21.15.152:0/84862905 >> 172.21.15.152:0/84862905 conn(0x7fee80071970 msgr2=0x7fee800faac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:06:40.713 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.712+0000 7fee877b7700 1 -- 172.21.15.152:0/84862905 shutdown_connections 2023-12-06T15:06:40.714 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.712+0000 7fee877b7700 1 -- 172.21.15.152:0/84862905 wait complete. 2023-12-06T15:06:40.724 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-06T15:06:40.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.844+0000 7f9487abf700 1 -- 172.21.15.152:0/2549595779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94801023d0 msgr2=0x7f94800fba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:40.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.844+0000 7f9487abf700 1 --2- 172.21.15.152:0/2549595779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94801023d0 0x7f94800fba60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f947c004940 tx=0x7f947c009e30 comp rx=0 tx=0).stop 2023-12-06T15:06:40.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.844+0000 7f9487abf700 1 -- 172.21.15.152:0/2549595779 shutdown_connections 2023-12-06T15:06:40.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.844+0000 7f9487abf700 1 --2- 172.21.15.152:0/2549595779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94801023d0 0x7f94800fba60 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:40.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.844+0000 7f9487abf700 1 --2- 172.21.15.152:0/2549595779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9480101ac0 0x7f9480101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:40.846 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.844+0000 7f9487abf700 1 -- 172.21.15.152:0/2549595779 >> 172.21.15.152:0/2549595779 conn(0x7f9480071970 msgr2=0x7f9480071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:06:40.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.844+0000 7f9487abf700 1 -- 172.21.15.152:0/2549595779 shutdown_connections 2023-12-06T15:06:40.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.844+0000 7f9487abf700 1 -- 172.21.15.152:0/2549595779 wait complete. 2023-12-06T15:06:40.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.844+0000 7f9487abf700 1 Processor -- start 2023-12-06T15:06:40.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.844+0000 7f9487abf700 1 -- start start 2023-12-06T15:06:40.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.845+0000 7f9487abf700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9480101ac0 0x7f948010e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:40.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.845+0000 7f9487abf700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94801023d0 0x7f948010e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:40.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.845+0000 7f9487abf700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948010eeb0 con 0x7f94801023d0 2023-12-06T15:06:40.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.845+0000 7f9487abf700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948010eff0 con 0x7f9480101ac0 2023-12-06T15:06:40.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.845+0000 7f948505a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94801023d0 0x7f948010e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:40.847 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.845+0000 7f948505a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94801023d0 0x7f948010e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:37058/0 (socket says 172.21.15.152:37058) 2023-12-06T15:06:40.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.845+0000 7f948505a700 1 -- 172.21.15.152:0/2074870502 learned_addr learned my addr 172.21.15.152:0/2074870502 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-12-06T15:06:40.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.845+0000 7f948585b700 1 --2- 172.21.15.152:0/2074870502 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9480101ac0 0x7f948010e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:40.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.845+0000 7f948505a700 1 -- 172.21.15.152:0/2074870502 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9480101ac0 msgr2=0x7f948010e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:40.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.845+0000 7f948505a700 1 --2- 172.21.15.152:0/2074870502 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9480101ac0 0x7f948010e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:40.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.845+0000 7f948505a700 1 -- 172.21.15.152:0/2074870502 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947c005040 con 0x7f94801023d0 2023-12-06T15:06:40.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.845+0000 7f948505a700 1 --2- 172.21.15.152:0/2074870502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94801023d0 0x7f948010e970 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f947c009fd0 tx=0x7f947c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:06:40.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.845+0000 7f94767fc700 1 -- 172.21.15.152:0/2074870502 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f947c00e040 con 0x7f94801023d0 2023-12-06T15:06:40.848 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.845+0000 7f94767fc700 1 -- 172.21.15.152:0/2074870502 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f947c00bd20 con 0x7f94801023d0 2023-12-06T15:06:40.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.845+0000 7f9487abf700 1 -- 172.21.15.152:0/2074870502 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f948010f270 con 0x7f94801023d0 2023-12-06T15:06:40.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.845+0000 7f94767fc700 1 -- 172.21.15.152:0/2074870502 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f947c01c630 con 0x7f94801023d0 2023-12-06T15:06:40.849 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.845+0000 7f9487abf700 1 -- 172.21.15.152:0/2074870502 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94801178a0 con 0x7f94801023d0 2023-12-06T15:06:40.850 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.846+0000 7f9487abf700 1 -- 172.21.15.152:0/2074870502 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9480103f00 con 0x7f94801023d0 2023-12-06T15:06:40.850 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.847+0000 7f94767fc700 1 -- 172.21.15.152:0/2074870502 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 38) v1 ==== 90938+0+0 (secure 0 0 0) 0x7f947c013420 con 0x7f94801023d0 2023-12-06T15:06:40.850 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.847+0000 7f94767fc700 1 --2- 172.21.15.152:0/2074870502 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f946c06ce60 0x7f946c06f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-06T15:06:40.850 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.847+0000 7f948585b700 1 --2- 172.21.15.152:0/2074870502 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f946c06ce60 0x7f946c06f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-06T15:06:40.850 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.847+0000 7f94767fc700 1 -- 172.21.15.152:0/2074870502 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f947c08d680 con 0x7f94801023d0 2023-12-06T15:06:40.850 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.848+0000 7f948585b700 1 --2- 172.21.15.152:0/2074870502 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f946c06ce60 0x7f946c06f310 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9470004990 tx=0x7f9470009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-06T15:06:40.852 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:40.852+0000 7f94767fc700 1 -- 172.21.15.152:0/2074870502 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f947c057570 con 0x7f94801023d0 2023-12-06T15:06:41.057 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:41.057+0000 7f9487abf700 1 -- 172.21.15.152:0/2074870502 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9480064730 con 0x7f94801023d0 2023-12-06T15:06:41.057 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:41.057+0000 7f94767fc700 1 -- 172.21.15.152:0/2074870502 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 37 entries v89) v1 ==== 81+0+2210 (secure 0 0 0) 0x7f947c05ab90 con 0x7f94801023d0 2023-12-06T15:06:41.057 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/3550921367 2023-12-07T14:59:40.851866+0000 2023-12-06T15:06:41.058 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/145030765 2023-12-07T14:53:50.748958+0000 2023-12-06T15:06:41.058 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.190:6829/3047155534 2023-12-07T15:00:50.131153+0000 2023-12-06T15:06:41.058 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6801/2466555973 2023-12-07T14:53:50.748958+0000 2023-12-06T15:06:41.058 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/1389268383 2023-12-07T14:59:40.851866+0000 2023-12-06T15:06:41.058 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/4186839809 2023-12-07T14:53:24.414825+0000 2023-12-06T15:06:41.058 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/2581585771 2023-12-07T14:53:50.748958+0000 2023-12-06T15:06:41.058 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.190:6828/3047155534 2023-12-07T15:00:50.131153+0000 2023-12-06T15:06:41.058 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.190:0/781150211 2023-12-07T15:00:50.131153+0000 2023-12-06T15:06:41.059 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6801/4105588516 2023-12-07T15:01:30.573634+0000 2023-12-06T15:06:41.059 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/2095526930 2023-12-07T14:54:40.970995+0000 2023-12-06T15:06:41.059 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.190:0/3203466810 2023-12-07T15:00:50.131153+0000 2023-12-06T15:06:41.059 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6800/2466555973 2023-12-07T14:53:50.748958+0000 2023-12-06T15:06:41.059 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.190:0/1733155328 2023-12-07T15:00:50.131153+0000 2023-12-06T15:06:41.059 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/251625153 2023-12-07T14:54:40.970995+0000 2023-12-06T15:06:41.059 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/959508847 2023-12-07T14:54:40.970995+0000 2023-12-06T15:06:41.059 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6801/3517650686 2023-12-07T14:54:40.970995+0000 2023-12-06T15:06:41.060 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/1805885486 2023-12-07T15:01:30.573634+0000 2023-12-06T15:06:41.060 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/498144396 2023-12-07T15:01:30.573634+0000 2023-12-06T15:06:41.060 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.190:0/609524120 2023-12-07T15:00:50.131153+0000 2023-12-06T15:06:41.060 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/2756816012 2023-12-07T14:59:40.851866+0000 2023-12-06T15:06:41.060 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/2571521952 2023-12-07T14:53:50.748958+0000 2023-12-06T15:06:41.060 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6800/3317409709 2023-12-07T14:59:40.851866+0000 2023-12-06T15:06:41.060 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6801/1793082857 2023-12-07T14:53:24.414825+0000 2023-12-06T15:06:41.060 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.190:0/1446993889 2023-12-07T15:00:50.131153+0000 2023-12-06T15:06:41.060 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6800/1793082857 2023-12-07T14:53:24.414825+0000 2023-12-06T15:06:41.061 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/2442962105 2023-12-07T15:01:30.573634+0000 2023-12-06T15:06:41.061 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/3538958834 2023-12-07T14:53:24.414825+0000 2023-12-06T15:06:41.061 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.190:0/2097810823 2023-12-07T15:00:50.131153+0000 2023-12-06T15:06:41.061 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6800/3517650686 2023-12-07T14:54:40.970995+0000 2023-12-06T15:06:41.061 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/561475554 2023-12-07T14:59:40.851866+0000 2023-12-06T15:06:41.061 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/2210289933 2023-12-07T15:01:30.573634+0000 2023-12-06T15:06:41.061 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/235446797 2023-12-07T15:01:30.573634+0000 2023-12-06T15:06:41.061 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/2125669406 2023-12-07T15:01:30.573634+0000 2023-12-06T15:06:41.061 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:0/181182783 2023-12-07T14:53:24.414825+0000 2023-12-06T15:06:41.062 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6801/3317409709 2023-12-07T14:59:40.851866+0000 2023-12-06T15:06:41.062 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152:6800/4105588516 2023-12-07T15:01:30.573634+0000 2023-12-06T15:06:41.063 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:41.059+0000 7f9487abf700 1 -- 172.21.15.152:0/2074870502 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f946c06ce60 msgr2=0x7f946c06f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:41.063 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:41.059+0000 7f9487abf700 1 --2- 172.21.15.152:0/2074870502 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f946c06ce60 0x7f946c06f310 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9470004990 tx=0x7f9470009ee0 comp rx=0 tx=0).stop 2023-12-06T15:06:41.063 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:41.059+0000 7f9487abf700 1 -- 172.21.15.152:0/2074870502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94801023d0 msgr2=0x7f948010e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-06T15:06:41.063 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:41.059+0000 7f9487abf700 1 --2- 172.21.15.152:0/2074870502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94801023d0 0x7f948010e970 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f947c009fd0 tx=0x7f947c009e30 comp rx=0 tx=0).stop 2023-12-06T15:06:41.063 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:41.059+0000 7f9487abf700 1 -- 172.21.15.152:0/2074870502 shutdown_connections 2023-12-06T15:06:41.063 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:41.059+0000 7f9487abf700 1 --2- 172.21.15.152:0/2074870502 >> [v2:172.21.15.152:6800/2427836422,v1:172.21.15.152:6801/2427836422] conn(0x7f946c06ce60 0x7f946c06f310 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:41.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:41.059+0000 7f9487abf700 1 --2- 172.21.15.152:0/2074870502 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9480101ac0 0x7f948010e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:41.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:41.059+0000 7f9487abf700 1 --2- 172.21.15.152:0/2074870502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94801023d0 0x7f948010e970 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-06T15:06:41.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:41.059+0000 7f9487abf700 1 -- 172.21.15.152:0/2074870502 >> 172.21.15.152:0/2074870502 conn(0x7f9480071970 msgr2=0x7f94800faf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-06T15:06:41.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:41.059+0000 7f9487abf700 1 -- 172.21.15.152:0/2074870502 shutdown_connections 2023-12-06T15:06:41.064 INFO:teuthology.orchestra.run.smithi152.stderr:2023-12-06T15:06:41.059+0000 7f9487abf700 1 -- 172.21.15.152:0/2074870502 wait complete. 2023-12-06T15:06:41.064 INFO:teuthology.orchestra.run.smithi152.stderr:listed 37 entries 2023-12-06T15:06:41.071 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-06T15:06:41.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T15:06:41.071 DEBUG:teuthology.orchestra.run.smithi190:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-06T15:06:41.121 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi190.front.sepia.ceph.com 2023-12-06T15:06:41.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T15:06:41.121 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-06T15:06:41.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T15:06:41.184 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2023-12-06T15:06:41.249 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-06T15:06:41.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T15:06:41.250 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-06T15:06:41.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T15:06:41.319 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link delete ceph-brx 2023-12-06T15:06:41.335 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:41 smithi152 ceph-mon[192652]: from='client.? 172.21.15.152:0/580691525' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-06T15:06:41.335 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:41 smithi152 ceph-mon[192652]: from='client.? 172.21.15.152:0/84862905' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-06T15:06:41.335 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:41 smithi152 ceph-mon[192652]: from='client.? 172.21.15.152:0/2074870502' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-06T15:06:41.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T15:06:41.384 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list 2023-12-06T15:06:41.403 INFO:teuthology.orchestra.run.smithi190.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-06T15:06:41.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T15:06:41.403 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-06T15:06:41.468 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:41 smithi190 ceph-mon[178398]: from='client.? 172.21.15.152:0/580691525' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2023-12-06T15:06:41.468 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:41 smithi190 ceph-mon[178398]: from='client.? 172.21.15.152:0/84862905' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2023-12-06T15:06:41.468 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:41 smithi190 ceph-mon[178398]: from='client.? 172.21.15.152:0/2074870502' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-06T15:06:41.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-06T15:06:41.490 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link delete ceph-brx 2023-12-06T15:06:41.588 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-12-06T15:06:41.601 INFO:tasks.cephadm:Teardown begin 2023-12-06T15:06:41.602 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-06T15:06:41.633 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-06T15:06:41.661 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-12-06T15:06:41.662 DEBUG:teuthology.orchestra.run.smithi152:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-06T15:06:41.691 DEBUG:teuthology.orchestra.run.smithi190:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-06T15:06:41.718 INFO:tasks.cephadm:Stopping all daemons... 2023-12-06T15:06:41.719 INFO:tasks.cephadm.mon.smithi152:Stopping mon.smithi152... 2023-12-06T15:06:41.719 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-062f0e3c-9447-11ee-95a2-87774f69a715@mon.smithi152 2023-12-06T15:06:41.961 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:41 smithi152 systemd[1]: Stopping Ceph mon.smithi152 for 062f0e3c-9447-11ee-95a2-87774f69a715... 2023-12-06T15:06:42.236 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:41 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-mon-smithi152[192629]: 2023-12-06T15:06:41.960+0000 7f090993d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi152 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-06T15:06:42.237 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:41 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-mon-smithi152[192629]: 2023-12-06T15:06:41.960+0000 7f090993d700 -1 mon.smithi152@0(leader) e3 *** Got Signal Terminated *** 2023-12-06T15:06:42.596 INFO:journalctl@ceph.mon.smithi152.smithi152.stdout:Dec 06 15:06:42 smithi152 bash[226710]: ceph-062f0e3c-9447-11ee-95a2-87774f69a715-mon-smithi152 2023-12-06T15:06:42.603 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-062f0e3c-9447-11ee-95a2-87774f69a715@mon.smithi152.service' 2023-12-06T15:06:42.660 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-06T15:06:42.661 INFO:tasks.cephadm.mon.smithi152:Stopped mon.smithi152 2023-12-06T15:06:42.661 INFO:tasks.cephadm.mon.smithi190:Stopping mon.smithi190... 2023-12-06T15:06:42.661 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-062f0e3c-9447-11ee-95a2-87774f69a715@mon.smithi190 2023-12-06T15:06:43.072 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:42 smithi190 systemd[1]: Stopping Ceph mon.smithi190 for 062f0e3c-9447-11ee-95a2-87774f69a715... 2023-12-06T15:06:43.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:42 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-mon-smithi190[178375]: 2023-12-06T15:06:42.900+0000 7f98edcbc700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi190 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-06T15:06:43.073 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:42 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-mon-smithi190[178375]: 2023-12-06T15:06:42.900+0000 7f98edcbc700 -1 mon.smithi190@1(peon) e3 *** Got Signal Terminated *** 2023-12-06T15:06:43.443 INFO:journalctl@ceph.mon.smithi190.smithi190.stdout:Dec 06 15:06:43 smithi190 bash[209445]: ceph-062f0e3c-9447-11ee-95a2-87774f69a715-mon-smithi190 2023-12-06T15:06:43.449 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-062f0e3c-9447-11ee-95a2-87774f69a715@mon.smithi190.service' 2023-12-06T15:06:43.501 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-06T15:06:43.501 INFO:tasks.cephadm.mon.smithi190:Stopped mon.smithi190 2023-12-06T15:06:43.501 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-12-06T15:06:43.501 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-062f0e3c-9447-11ee-95a2-87774f69a715@osd.0 2023-12-06T15:06:43.878 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 15:06:43 smithi152 systemd[1]: Stopping Ceph osd.0 for 062f0e3c-9447-11ee-95a2-87774f69a715... 2023-12-06T15:06:43.878 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 15:06:43 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-0[202821]: 2023-12-06T15:06:43.726+0000 7fce02dda700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-06T15:06:43.878 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 15:06:43 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-0[202821]: 2023-12-06T15:06:43.726+0000 7fce02dda700 -1 osd.0 89 *** Got signal Terminated *** 2023-12-06T15:06:43.878 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 15:06:43 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-0[202821]: 2023-12-06T15:06:43.726+0000 7fce02dda700 -1 osd.0 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-06T15:06:49.679 INFO:journalctl@ceph.osd.0.smithi152.stdout:Dec 06 15:06:49 smithi152 bash[226873]: ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-0 2023-12-06T15:06:50.644 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-062f0e3c-9447-11ee-95a2-87774f69a715@osd.0.service' 2023-12-06T15:06:50.685 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-06T15:06:50.685 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-12-06T15:06:50.685 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-12-06T15:06:50.686 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-062f0e3c-9447-11ee-95a2-87774f69a715@osd.1 2023-12-06T15:06:50.931 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 15:06:50 smithi152 systemd[1]: Stopping Ceph osd.1 for 062f0e3c-9447-11ee-95a2-87774f69a715... 2023-12-06T15:06:51.378 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 15:06:50 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-1[209618]: 2023-12-06T15:06:50.931+0000 7f3a798cd700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-06T15:06:51.378 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 15:06:50 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-1[209618]: 2023-12-06T15:06:50.931+0000 7f3a798cd700 -1 osd.1 89 *** Got signal Terminated *** 2023-12-06T15:06:51.379 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 15:06:50 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-1[209618]: 2023-12-06T15:06:50.931+0000 7f3a798cd700 -1 osd.1 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-06T15:06:56.878 INFO:journalctl@ceph.osd.1.smithi152.stdout:Dec 06 15:06:56 smithi152 bash[227133]: ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-1 2023-12-06T15:06:57.709 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-062f0e3c-9447-11ee-95a2-87774f69a715@osd.1.service' 2023-12-06T15:06:57.749 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-06T15:06:57.750 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-12-06T15:06:57.750 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-12-06T15:06:57.750 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ceph-062f0e3c-9447-11ee-95a2-87774f69a715@osd.2 2023-12-06T15:06:58.009 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 15:06:57 smithi152 systemd[1]: Stopping Ceph osd.2 for 062f0e3c-9447-11ee-95a2-87774f69a715... 2023-12-06T15:06:58.378 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 15:06:58 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-2[216894]: 2023-12-06T15:06:58.008+0000 7f34fbbb5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-06T15:06:58.378 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 15:06:58 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-2[216894]: 2023-12-06T15:06:58.008+0000 7f34fbbb5700 -1 osd.2 89 *** Got signal Terminated *** 2023-12-06T15:06:58.378 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 15:06:58 smithi152 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-2[216894]: 2023-12-06T15:06:58.008+0000 7f34fbbb5700 -1 osd.2 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-06T15:07:04.128 INFO:journalctl@ceph.osd.2.smithi152.stdout:Dec 06 15:07:03 smithi152 bash[227395]: ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-2 2023-12-06T15:07:04.941 DEBUG:teuthology.orchestra.run.smithi152:> sudo pkill -f 'journalctl -f -n 0 -u ceph-062f0e3c-9447-11ee-95a2-87774f69a715@osd.2.service' 2023-12-06T15:07:04.982 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-06T15:07:04.982 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-12-06T15:07:04.983 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-12-06T15:07:04.983 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-062f0e3c-9447-11ee-95a2-87774f69a715@osd.3 2023-12-06T15:07:05.322 INFO:journalctl@ceph.osd.3.smithi190.stdout:Dec 06 15:07:05 smithi190 systemd[1]: Stopping Ceph osd.3 for 062f0e3c-9447-11ee-95a2-87774f69a715... 2023-12-06T15:07:05.323 INFO:journalctl@ceph.osd.3.smithi190.stdout:Dec 06 15:07:05 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-3[190830]: 2023-12-06T15:07:05.208+0000 7fa105d37700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-06T15:07:05.323 INFO:journalctl@ceph.osd.3.smithi190.stdout:Dec 06 15:07:05 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-3[190830]: 2023-12-06T15:07:05.208+0000 7fa105d37700 -1 osd.3 89 *** Got signal Terminated *** 2023-12-06T15:07:05.323 INFO:journalctl@ceph.osd.3.smithi190.stdout:Dec 06 15:07:05 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-3[190830]: 2023-12-06T15:07:05.208+0000 7fa105d37700 -1 osd.3 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-06T15:07:10.072 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 15:07:09 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-4[196935]: 2023-12-06T15:07:09.710+0000 7fdced7c4700 -1 osd.4 89 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2023-12-06T15:06:47.047608+0000 front 2023-12-06T15:06:47.047584+0000 (oldest deadline 2023-12-06T15:07:09.347346+0000) 2023-12-06T15:07:10.713 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:07:10 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-5[203786]: 2023-12-06T15:07:10.354+0000 7f1765dc6700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2023-12-06T15:06:47.407374+0000 front 2023-12-06T15:06:47.407448+0000 (oldest deadline 2023-12-06T15:07:09.707319+0000) 2023-12-06T15:07:11.073 INFO:journalctl@ceph.osd.3.smithi190.stdout:Dec 06 15:07:10 smithi190 bash[209594]: ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-3 2023-12-06T15:07:11.073 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 15:07:10 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-4[196935]: 2023-12-06T15:07:10.712+0000 7fdced7c4700 -1 osd.4 89 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2023-12-06T15:06:47.047608+0000 front 2023-12-06T15:06:47.047584+0000 (oldest deadline 2023-12-06T15:07:09.347346+0000) 2023-12-06T15:07:11.572 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:07:11 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-5[203786]: 2023-12-06T15:07:11.312+0000 7f1765dc6700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2023-12-06T15:06:47.407374+0000 front 2023-12-06T15:06:47.407448+0000 (oldest deadline 2023-12-06T15:07:09.707319+0000) 2023-12-06T15:07:12.072 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 15:07:11 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-4[196935]: 2023-12-06T15:07:11.755+0000 7fdced7c4700 -1 osd.4 89 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2023-12-06T15:06:47.047608+0000 front 2023-12-06T15:06:47.047584+0000 (oldest deadline 2023-12-06T15:07:09.347346+0000) 2023-12-06T15:07:12.154 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-062f0e3c-9447-11ee-95a2-87774f69a715@osd.3.service' 2023-12-06T15:07:12.195 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-06T15:07:12.195 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-12-06T15:07:12.195 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-12-06T15:07:12.196 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-062f0e3c-9447-11ee-95a2-87774f69a715@osd.4 2023-12-06T15:07:12.444 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:07:12 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-5[203786]: 2023-12-06T15:07:12.268+0000 7f1765dc6700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2023-12-06T15:06:47.407374+0000 front 2023-12-06T15:06:47.407448+0000 (oldest deadline 2023-12-06T15:07:09.707319+0000) 2023-12-06T15:07:12.444 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 15:07:12 smithi190 systemd[1]: Stopping Ceph osd.4 for 062f0e3c-9447-11ee-95a2-87774f69a715... 2023-12-06T15:07:12.444 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 15:07:12 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-4[196935]: 2023-12-06T15:07:12.441+0000 7fdcf09c8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-06T15:07:12.750 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 15:07:12 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-4[196935]: 2023-12-06T15:07:12.441+0000 7fdcf09c8700 -1 osd.4 89 *** Got signal Terminated *** 2023-12-06T15:07:12.751 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 15:07:12 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-4[196935]: 2023-12-06T15:07:12.441+0000 7fdcf09c8700 -1 osd.4 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-06T15:07:13.072 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 15:07:12 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-4[196935]: 2023-12-06T15:07:12.750+0000 7fdced7c4700 -1 osd.4 89 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2023-12-06T15:06:47.047608+0000 front 2023-12-06T15:06:47.047584+0000 (oldest deadline 2023-12-06T15:07:09.347346+0000) 2023-12-06T15:07:13.572 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:07:13 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-5[203786]: 2023-12-06T15:07:13.286+0000 7f1765dc6700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2023-12-06T15:06:47.407374+0000 front 2023-12-06T15:06:47.407448+0000 (oldest deadline 2023-12-06T15:07:09.707319+0000) 2023-12-06T15:07:14.072 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 15:07:13 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-4[196935]: 2023-12-06T15:07:13.775+0000 7fdced7c4700 -1 osd.4 89 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2023-12-06T15:06:47.047608+0000 front 2023-12-06T15:06:47.047584+0000 (oldest deadline 2023-12-06T15:07:09.347346+0000) 2023-12-06T15:07:14.737 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:07:14 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-5[203786]: 2023-12-06T15:07:14.335+0000 7f1765dc6700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2023-12-06T15:06:47.407374+0000 front 2023-12-06T15:06:47.407448+0000 (oldest deadline 2023-12-06T15:07:09.707319+0000) 2023-12-06T15:07:15.072 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 15:07:14 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-4[196935]: 2023-12-06T15:07:14.737+0000 7fdced7c4700 -1 osd.4 89 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2023-12-06T15:06:47.047608+0000 front 2023-12-06T15:06:47.047584+0000 (oldest deadline 2023-12-06T15:07:09.347346+0000) 2023-12-06T15:07:15.763 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:07:15 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-5[203786]: 2023-12-06T15:07:15.375+0000 7f1765dc6700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2023-12-06T15:06:47.407374+0000 front 2023-12-06T15:06:47.407448+0000 (oldest deadline 2023-12-06T15:07:09.707319+0000) 2023-12-06T15:07:16.072 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 15:07:15 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-4[196935]: 2023-12-06T15:07:15.764+0000 7fdced7c4700 -1 osd.4 89 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2023-12-06T15:06:47.047608+0000 front 2023-12-06T15:06:47.047584+0000 (oldest deadline 2023-12-06T15:07:09.347346+0000) 2023-12-06T15:07:16.734 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:07:16 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-5[203786]: 2023-12-06T15:07:16.383+0000 7f1765dc6700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2023-12-06T15:06:47.407374+0000 front 2023-12-06T15:06:47.407448+0000 (oldest deadline 2023-12-06T15:07:09.707319+0000) 2023-12-06T15:07:17.072 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 15:07:16 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-4[196935]: 2023-12-06T15:07:16.734+0000 7fdced7c4700 -1 osd.4 89 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2023-12-06T15:06:47.047608+0000 front 2023-12-06T15:06:47.047584+0000 (oldest deadline 2023-12-06T15:07:09.347346+0000) 2023-12-06T15:07:17.823 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:07:17 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-5[203786]: 2023-12-06T15:07:17.353+0000 7f1765dc6700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2023-12-06T15:06:47.407374+0000 front 2023-12-06T15:06:47.407448+0000 (oldest deadline 2023-12-06T15:07:09.707319+0000) 2023-12-06T15:07:18.574 INFO:journalctl@ceph.osd.4.smithi190.stdout:Dec 06 15:07:18 smithi190 bash[209859]: ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-4 2023-12-06T15:07:18.574 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:07:18 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-5[203786]: 2023-12-06T15:07:18.346+0000 7f1765dc6700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2023-12-06T15:06:47.407374+0000 front 2023-12-06T15:06:47.407448+0000 (oldest deadline 2023-12-06T15:07:09.707319+0000) 2023-12-06T15:07:18.574 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:07:18 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-5[203786]: 2023-12-06T15:07:18.346+0000 7f1765dc6700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.152:6814 osd.1 since back 2023-12-06T15:06:54.308644+0000 front 2023-12-06T15:06:54.308661+0000 (oldest deadline 2023-12-06T15:07:17.808585+0000) 2023-12-06T15:07:19.354 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-062f0e3c-9447-11ee-95a2-87774f69a715@osd.4.service' 2023-12-06T15:07:19.395 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-06T15:07:19.396 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-12-06T15:07:19.396 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-12-06T15:07:19.396 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-062f0e3c-9447-11ee-95a2-87774f69a715@osd.5 2023-12-06T15:07:19.633 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:07:19 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-5[203786]: 2023-12-06T15:07:19.323+0000 7f1765dc6700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2023-12-06T15:06:47.407374+0000 front 2023-12-06T15:06:47.407448+0000 (oldest deadline 2023-12-06T15:07:09.707319+0000) 2023-12-06T15:07:19.634 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:07:19 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-5[203786]: 2023-12-06T15:07:19.323+0000 7f1765dc6700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.152:6814 osd.1 since back 2023-12-06T15:06:54.308644+0000 front 2023-12-06T15:06:54.308661+0000 (oldest deadline 2023-12-06T15:07:17.808585+0000) 2023-12-06T15:07:19.634 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:07:19 smithi190 systemd[1]: Stopping Ceph osd.5 for 062f0e3c-9447-11ee-95a2-87774f69a715... 2023-12-06T15:07:20.072 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:07:19 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-5[203786]: 2023-12-06T15:07:19.633+0000 7f176b7cf700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-06T15:07:20.072 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:07:19 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-5[203786]: 2023-12-06T15:07:19.633+0000 7f176b7cf700 -1 osd.5 89 *** Got signal Terminated *** 2023-12-06T15:07:20.072 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:07:19 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-5[203786]: 2023-12-06T15:07:19.633+0000 7f176b7cf700 -1 osd.5 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-06T15:07:20.822 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:07:20 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-5[203786]: 2023-12-06T15:07:20.332+0000 7f1765dc6700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2023-12-06T15:06:47.407374+0000 front 2023-12-06T15:06:47.407448+0000 (oldest deadline 2023-12-06T15:07:09.707319+0000) 2023-12-06T15:07:20.826 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:07:20 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-5[203786]: 2023-12-06T15:07:20.332+0000 7f1765dc6700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.152:6814 osd.1 since back 2023-12-06T15:06:54.308644+0000 front 2023-12-06T15:06:54.308661+0000 (oldest deadline 2023-12-06T15:07:17.808585+0000) 2023-12-06T15:07:21.822 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:07:21 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-5[203786]: 2023-12-06T15:07:21.358+0000 7f1765dc6700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2023-12-06T15:06:47.407374+0000 front 2023-12-06T15:06:47.407448+0000 (oldest deadline 2023-12-06T15:07:09.707319+0000) 2023-12-06T15:07:21.822 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:07:21 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-5[203786]: 2023-12-06T15:07:21.358+0000 7f1765dc6700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.152:6814 osd.1 since back 2023-12-06T15:06:54.308644+0000 front 2023-12-06T15:06:54.308661+0000 (oldest deadline 2023-12-06T15:07:17.808585+0000) 2023-12-06T15:07:22.822 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:07:22 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-5[203786]: 2023-12-06T15:07:22.388+0000 7f1765dc6700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2023-12-06T15:06:47.407374+0000 front 2023-12-06T15:06:47.407448+0000 (oldest deadline 2023-12-06T15:07:09.707319+0000) 2023-12-06T15:07:22.822 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:07:22 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-5[203786]: 2023-12-06T15:07:22.388+0000 7f1765dc6700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.152:6814 osd.1 since back 2023-12-06T15:06:54.308644+0000 front 2023-12-06T15:06:54.308661+0000 (oldest deadline 2023-12-06T15:07:17.808585+0000) 2023-12-06T15:07:23.822 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:07:23 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-5[203786]: 2023-12-06T15:07:23.362+0000 7f1765dc6700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2023-12-06T15:06:47.407374+0000 front 2023-12-06T15:06:47.407448+0000 (oldest deadline 2023-12-06T15:07:09.707319+0000) 2023-12-06T15:07:23.822 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:07:23 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-5[203786]: 2023-12-06T15:07:23.362+0000 7f1765dc6700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.152:6814 osd.1 since back 2023-12-06T15:06:54.308644+0000 front 2023-12-06T15:06:54.308661+0000 (oldest deadline 2023-12-06T15:07:17.808585+0000) 2023-12-06T15:07:24.822 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:07:24 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-5[203786]: 2023-12-06T15:07:24.359+0000 7f1765dc6700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.152:6806 osd.0 since back 2023-12-06T15:06:47.407374+0000 front 2023-12-06T15:06:47.407448+0000 (oldest deadline 2023-12-06T15:07:09.707319+0000) 2023-12-06T15:07:24.822 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:07:24 smithi190 ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-5[203786]: 2023-12-06T15:07:24.360+0000 7f1765dc6700 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.152:6814 osd.1 since back 2023-12-06T15:06:54.308644+0000 front 2023-12-06T15:06:54.308661+0000 (oldest deadline 2023-12-06T15:07:17.808585+0000) 2023-12-06T15:07:25.322 INFO:journalctl@ceph.osd.5.smithi190.stdout:Dec 06 15:07:25 smithi190 bash[210124]: ceph-062f0e3c-9447-11ee-95a2-87774f69a715-osd-5 2023-12-06T15:07:26.294 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-062f0e3c-9447-11ee-95a2-87774f69a715@osd.5.service' 2023-12-06T15:07:26.334 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-06T15:07:26.334 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-12-06T15:07:26.335 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 --force --keep-logs 2023-12-06T15:07:42.304 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 --force --keep-logs 2023-12-06T15:07:55.345 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-06T15:07:55.384 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-06T15:07:55.415 INFO:tasks.cephadm:Archiving crash dumps... 2023-12-06T15:07:55.417 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/crash to /home/teuthworker/archive/adking-2023-12-06_14:29:19-orch:cephadm-wip-adk-testing-2023-12-05-1905-distro-default-smithi/7480270/remote/smithi152/crash 2023-12-06T15:07:55.418 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/crash -- . 2023-12-06T15:07:55.454 INFO:teuthology.orchestra.run.smithi152.stderr:tar: /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/crash: Cannot open: No such file or directory 2023-12-06T15:07:55.454 INFO:teuthology.orchestra.run.smithi152.stderr:tar: Error is not recoverable: exiting now 2023-12-06T15:07:55.456 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/crash to /home/teuthworker/archive/adking-2023-12-06_14:29:19-orch:cephadm-wip-adk-testing-2023-12-05-1905-distro-default-smithi/7480270/remote/smithi190/crash 2023-12-06T15:07:55.457 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/crash -- . 2023-12-06T15:07:55.484 INFO:teuthology.orchestra.run.smithi190.stderr:tar: /var/lib/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/crash: Cannot open: No such file or directory 2023-12-06T15:07:55.484 INFO:teuthology.orchestra.run.smithi190.stderr:tar: Error is not recoverable: exiting now 2023-12-06T15:07:55.485 INFO:tasks.cephadm:Checking cluster log for badness... 2023-12-06T15:07:55.485 DEBUG:teuthology.orchestra.run.smithi152:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-12-06T15:07:55.527 INFO:teuthology.orchestra.run.smithi152.stderr:grep: /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph.log: No such file or directory 2023-12-06T15:07:55.530 INFO:tasks.cephadm:Compressing logs... 2023-12-06T15:07:55.530 DEBUG:teuthology.orchestra.run.smithi152:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-06T15:07:55.572 DEBUG:teuthology.orchestra.run.smithi190:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-06T15:07:55.598 INFO:teuthology.orchestra.run.smithi152.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-06T15:07:55.598 INFO:teuthology.orchestra.run.smithi152.stderr:: No such file or directory 2023-12-06T15:07:55.598 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi152.ypivwc.log 2023-12-06T15:07:55.598 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-volume.log 2023-12-06T15:07:55.601 INFO:teuthology.orchestra.run.smithi190.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-06T15:07:55.601 INFO:teuthology.orchestra.run.smithi190.stderr:: No such file or directory 2023-12-06T15:07:55.601 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-volume.log 2023-12-06T15:07:55.601 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-mgr.smithi190.ubusrr.log 2023-12-06T15:07:55.602 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-osd.3.log 2023-12-06T15:07:55.602 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi190.uucxzu.log 2023-12-06T15:07:55.602 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-mgr.smithi190.ubusrr.log: /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi190.edwtqj.log 2023-12-06T15:07:55.603 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-osd.2.log 2023-12-06T15:07:55.603 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi152.ypivwc.log: /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-osd.0.log 2023-12-06T15:07:55.603 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi152.acqswy.log 2023-12-06T15:07:55.603 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi190.uucxzu.log: gzip -5 --verbose -- /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-mon.smithi190.log 2023-12-06T15:07:55.603 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi190.edwtqj.log: /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-mon.smithi190.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-06T15:07:55.606 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-osd.4.log 2023-12-06T15:07:55.607 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-osd.0.log: /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi152.acqswy.log: gzip -5 --verbose -- /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-mon.smithi152.log 2023-12-06T15:07:55.607 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-mon.smithi152.log: 91.3% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-06T15:07:55.608 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-mgr.smithi152.meodco.log 2023-12-06T15:07:55.609 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-osd.1.log 2023-12-06T15:07:55.610 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-mgr.smithi152.meodco.log: 90.7% -- replaced with /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-volume.log.gz 2023-12-06T15:07:55.610 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-osd.4.log: 90.9% -- replaced with /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-volume.log.gz 2023-12-06T15:07:55.612 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-osd.5.log 2023-12-06T15:07:55.641 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-osd.5.log: 88.5% -- replaced with /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-mgr.smithi190.ubusrr.log.gz 2023-12-06T15:07:55.793 INFO:teuthology.orchestra.run.smithi190.stderr: 92.5% -- replaced with /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-mon.smithi190.log.gz 2023-12-06T15:07:55.862 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-osd.1.log: 88.3% -- replaced with /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-mgr.smithi152.meodco.log.gz 2023-12-06T15:07:56.352 INFO:teuthology.orchestra.run.smithi152.stderr: 90.8% -- replaced with /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-mon.smithi152.log.gz 2023-12-06T15:07:59.907 INFO:teuthology.orchestra.run.smithi190.stderr: 93.1% -- replaced with /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-osd.4.log.gz 2023-12-06T15:08:00.144 INFO:teuthology.orchestra.run.smithi152.stderr: 93.2% -- replaced with /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-osd.2.log.gz 2023-12-06T15:08:00.496 INFO:teuthology.orchestra.run.smithi152.stderr: 95.2% -- replaced with /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi152.ypivwc.log.gz 2023-12-06T15:08:00.921 INFO:teuthology.orchestra.run.smithi152.stderr: 93.1% -- replaced with /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-osd.1.log.gz 2023-12-06T15:08:00.979 INFO:teuthology.orchestra.run.smithi190.stderr: 95.1% -- replaced with /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi190.edwtqj.log.gz 2023-12-06T15:08:01.725 INFO:teuthology.orchestra.run.smithi190.stderr: 93.0% -- replaced with /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-osd.5.log.gz 2023-12-06T15:08:01.733 INFO:teuthology.orchestra.run.smithi152.stderr: 93.4% -- replaced with /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-osd.0.log.gz 2023-12-06T15:08:02.962 INFO:teuthology.orchestra.run.smithi190.stderr: 93.1% -- replaced with /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-osd.3.log.gz 2023-12-06T15:08:33.107 INFO:teuthology.orchestra.run.smithi190.stderr: 93.1% -- replaced with /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi190.uucxzu.log.gz 2023-12-06T15:08:33.109 INFO:teuthology.orchestra.run.smithi190.stderr: 2023-12-06T15:08:33.109 INFO:teuthology.orchestra.run.smithi190.stderr:real 0m37.520s 2023-12-06T15:08:33.109 INFO:teuthology.orchestra.run.smithi190.stderr:user 0m58.816s 2023-12-06T15:08:33.109 INFO:teuthology.orchestra.run.smithi190.stderr:sys 0m2.023s 2023-12-06T15:08:38.212 INFO:teuthology.orchestra.run.smithi152.stderr: 92.9% -- replaced with /var/log/ceph/062f0e3c-9447-11ee-95a2-87774f69a715/ceph-mds.cephfs.smithi152.acqswy.log.gz 2023-12-06T15:08:38.214 INFO:teuthology.orchestra.run.smithi152.stderr: 2023-12-06T15:08:38.214 INFO:teuthology.orchestra.run.smithi152.stderr:real 0m42.626s 2023-12-06T15:08:38.214 INFO:teuthology.orchestra.run.smithi152.stderr:user 1m2.401s 2023-12-06T15:08:38.214 INFO:teuthology.orchestra.run.smithi152.stderr:sys 0m2.041s 2023-12-06T15:08:38.215 INFO:tasks.cephadm:Archiving logs... 2023-12-06T15:08:38.215 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/log/ceph to /home/teuthworker/archive/adking-2023-12-06_14:29:19-orch:cephadm-wip-adk-testing-2023-12-05-1905-distro-default-smithi/7480270/remote/smithi152/log 2023-12-06T15:08:38.216 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-06T15:08:47.351 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/log/ceph to /home/teuthworker/archive/adking-2023-12-06_14:29:19-orch:cephadm-wip-adk-testing-2023-12-05-1905-distro-default-smithi/7480270/remote/smithi190/log 2023-12-06T15:08:47.352 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-06T15:08:56.098 INFO:tasks.cephadm:Removing cluster... 2023-12-06T15:08:56.099 DEBUG:teuthology.orchestra.run.smithi152:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 --force 2023-12-06T15:08:56.631 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 --force 2023-12-06T15:08:57.163 INFO:tasks.cephadm:Removing cephadm ... 2023-12-06T15:08:57.163 DEBUG:teuthology.orchestra.run.smithi152:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-06T15:08:57.185 DEBUG:teuthology.orchestra.run.smithi190:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-06T15:08:57.203 INFO:tasks.cephadm:Teardown complete 2023-12-06T15:08:57.204 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-06T15:08:57.215 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-06T15:08:57.215 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-06T15:08:57.227 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-06T15:08:57.328 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-06T15:08:57.339 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-06T15:08:57.339 DEBUG:teuthology.orchestra.run.smithi152:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-06T15:08:57.341 DEBUG:teuthology.orchestra.run.smithi190:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-06T15:08:57.357 INFO:teuthology.orchestra.run.smithi152.stderr:bash: ntpq: command not found 2023-12-06T15:08:57.358 INFO:teuthology.orchestra.run.smithi190.stderr:bash: ntpq: command not found 2023-12-06T15:08:57.362 INFO:teuthology.orchestra.run.smithi190.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-06T15:08:57.363 INFO:teuthology.orchestra.run.smithi190.stdout:=============================================================================== 2023-12-06T15:08:57.363 INFO:teuthology.orchestra.run.smithi190.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 23 +3019us[+3062us] +/- 86ms 2023-12-06T15:08:57.363 INFO:teuthology.orchestra.run.smithi190.stdout:^* hv02.front.sepia.ceph.com 3 6 377 22 -275us[ -232us] +/- 77ms 2023-12-06T15:08:57.363 INFO:teuthology.orchestra.run.smithi190.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 22 -2780us[-2780us] +/- 91ms 2023-12-06T15:08:57.363 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-06T15:08:57.364 INFO:teuthology.orchestra.run.smithi152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-06T15:08:57.364 INFO:teuthology.orchestra.run.smithi152.stdout:=============================================================================== 2023-12-06T15:08:57.364 INFO:teuthology.orchestra.run.smithi152.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 22 +3109us[+3145us] +/- 86ms 2023-12-06T15:08:57.364 INFO:teuthology.orchestra.run.smithi152.stdout:^* hv02.front.sepia.ceph.com 3 7 377 20 -143us[ -108us] +/- 77ms 2023-12-06T15:08:57.364 INFO:teuthology.orchestra.run.smithi152.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 21 -2656us[-2620us] +/- 91ms 2023-12-06T15:08:57.365 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-06T15:08:57.365 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-06T15:08:57.375 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-06T15:08:57.375 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-06T15:08:57.386 DEBUG:teuthology.orchestra.run.smithi152:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-06T15:08:57.504 DEBUG:teuthology.orchestra.run.smithi190:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-06T15:08:57.599 DEBUG:teuthology.orchestra.run.smithi152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-06T15:08:57.632 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-06T15:08:57.632 DEBUG:teuthology.orchestra.run.smithi190:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-06T15:08:57.664 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-06T15:08:57.664 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-06T15:08:57.675 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-06T15:08:57.685 INFO:teuthology.task.internal:Duration was 1708.286825 seconds 2023-12-06T15:08:57.686 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-06T15:08:57.696 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-06T15:08:57.697 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-06T15:08:57.699 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-06T15:08:57.743 INFO:teuthology.orchestra.run.smithi152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-06T15:08:57.750 INFO:teuthology.orchestra.run.smithi190.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-06T15:08:57.890 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-06T15:08:57.890 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi152.front.sepia.ceph.com 2023-12-06T15:08:57.890 DEBUG:teuthology.orchestra.run.smithi152:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-06T15:08:57.912 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi190.front.sepia.ceph.com 2023-12-06T15:08:57.912 DEBUG:teuthology.orchestra.run.smithi190:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-06T15:08:57.934 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-06T15:08:57.934 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-06T15:08:57.954 DEBUG:teuthology.orchestra.run.smithi190:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-06T15:08:58.022 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-06T15:08:58.022 DEBUG:teuthology.orchestra.run.smithi152:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-06T15:08:58.024 DEBUG:teuthology.orchestra.run.smithi190:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-06T15:08:58.135 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-06T15:08:58.146 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-06T15:08:58.147 DEBUG:teuthology.orchestra.run.smithi152:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-06T15:08:58.173 DEBUG:teuthology.orchestra.run.smithi190:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-06T15:08:58.200 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-06T15:08:58.212 DEBUG:teuthology.orchestra.run.smithi152:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-06T15:08:58.216 DEBUG:teuthology.orchestra.run.smithi190:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-06T15:08:58.240 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = core 2023-12-06T15:08:58.266 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern = core 2023-12-06T15:08:58.280 DEBUG:teuthology.orchestra.run.smithi152:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-06T15:08:58.309 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-06T15:08:58.310 DEBUG:teuthology.orchestra.run.smithi190:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-06T15:08:58.337 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-06T15:08:58.337 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-06T15:08:58.349 INFO:teuthology.task.internal:Transferring archived files... 2023-12-06T15:08:58.350 DEBUG:teuthology.misc:Transferring archived files from smithi152:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/adking-2023-12-06_14:29:19-orch:cephadm-wip-adk-testing-2023-12-05-1905-distro-default-smithi/7480270/remote/smithi152 2023-12-06T15:08:58.350 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-06T15:08:58.391 DEBUG:teuthology.misc:Transferring archived files from smithi190:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/adking-2023-12-06_14:29:19-orch:cephadm-wip-adk-testing-2023-12-05-1905-distro-default-smithi/7480270/remote/smithi190 2023-12-06T15:08:58.391 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-06T15:08:58.434 INFO:teuthology.task.internal:Removing archive directory... 2023-12-06T15:08:58.435 DEBUG:teuthology.orchestra.run.smithi152:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-06T15:08:58.437 DEBUG:teuthology.orchestra.run.smithi190:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-06T15:08:58.482 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-06T15:08:58.493 INFO:teuthology.task.internal:Not uploading archives. 2023-12-06T15:08:58.494 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-06T15:08:58.505 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-06T15:08:58.505 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-06T15:08:58.507 DEBUG:teuthology.orchestra.run.smithi190:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-06T15:08:58.522 INFO:teuthology.orchestra.run.smithi152.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 6 15:08 /home/ubuntu/cephtest 2023-12-06T15:08:58.539 INFO:teuthology.orchestra.run.smithi190.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 6 15:08 /home/ubuntu/cephtest 2023-12-06T15:08:58.540 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-06T15:08:58.552 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-06T15:08:58.576 INFO:teuthology.nuke:Checking targets against current locks 2023-12-06T15:08:58.603 DEBUG:teuthology.nuke:shortname: smithi152 2023-12-06T15:08:58.604 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-06T15:08:58.629 DEBUG:teuthology.nuke:shortname: smithi190 2023-12-06T15:08:58.629 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-06T15:08:58.632 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-12-06_14:29:19-orch:cephadm-wip-adk-testing-2023-12-05-1905-distro-default-smithi/7480270', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-06 14:31:12.785954', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAGZVRlFHxrIzzq3xXuUbpXjLuiky7MinfUvixOnItkg9xA3I3/4H7rfA2BozkHRZUv2o66qU5nOEYSlvNWbJwQ='} 2023-12-06T15:08:58.656 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-12-06_14:29:19-orch:cephadm-wip-adk-testing-2023-12-05-1905-distro-default-smithi/7480270', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-06 14:31:12.784641', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLZX2VRnca7s6Qk9yipVo+7S/Ug6IDq6WEYevg+VDOpKVyZ+f3JdIE2KyYOIfDCPLR5BdhFW8Fm65g6K+XgncHs='} 2023-12-06T15:08:58.686 INFO:teuthology.orchestra.console.smithi152:Power off 2023-12-06T15:08:58.687 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-06T15:08:58.703 INFO:teuthology.orchestra.console.smithi190:Power off 2023-12-06T15:08:58.704 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-06T15:08:58.714 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off 2023-12-06T15:08:58.714 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T15:08:58.727 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2023-12-06T15:08:58.728 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T15:08:58.737 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2023-12-06T15:08:58.754 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-12-06T15:09:02.739 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T15:09:02.755 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T15:09:02.850 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2023-12-06T15:09:02.865 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-12-06T15:09:06.854 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T15:09:06.866 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T15:09:06.964 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-12-06T15:09:06.976 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-12-06T15:09:07.066 INFO:teuthology.orchestra.console.smithi152:Power off completed 2023-12-06T15:09:07.077 INFO:teuthology.orchestra.console.smithi190:Power off completed 2023-12-06T15:09:07.182 INFO:teuthology.run:Summary data: description: orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 1708.2868254184723 failure_reason: 'Command failed on smithi152 with status 1: ''sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 062f0e3c-9447-11ee-95a2-87774f69a715 -e sha1=0482646fcf78576d871bc87843257d82edb79541 -- bash -c \''ceph versions | jq -e \''"\''"\''.overall | length == 1\''"\''"\''\''''' flavor: default owner: scheduled_adking@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=5f005f20f61947b5bc69f0e131474550 status: fail success: false 2023-12-06T15:09:07.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-06T15:09:07.266 INFO:teuthology.run:FAIL